Task 11703626

Name	famous_v2bh_1999_200_006688771_2
Workunit	6892024
Created	26 Aug 2010, 15:48:38 UTC
Sent	4 Sep 2010, 5:55:50 UTC
Report deadline	4 Dec 2010, 13:23:01 UTC
Received	14 Sep 2010, 21:12:15 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1050514
Run time	2 days 19 hours 21 min 41 sec
CPU time	2 days 17 hours 54 min
Validate state	Invalid
Credit	5,435.25
Device peak FLOPS	3.56 GFLOPS
Application version	UK Met Office FAMOUS v6.11 i686-apple-darwin
Stderr	<core_client_version>6.10.56</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Signal 1 received, exiting... (48703): called boinc_finish Signal 1 received, exiting... (48698): called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 1 received, exiting... (49951): called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... SIGSEGV: segmentation violation Crashed executable name: famous_um_6.11_i686-apple-darwin built using BOINC library version 6.11.1 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.6.4 build 10F569 Fri Sep 10 09:34:42 2010 sh: /usr/bin/atos: No such file or directory 0 0x0048fdcf 1 0x0049054a 2 0x902441fb 3 0xffffffff 4 0x0134e6b3 5 0x0134d44f 6 0x003f5826 7 0x00450bd8 8 0x004698c0 9 0x000026b6 10 0x000025dd 11 0x00000003 Thread 0 crashed with X86 Thread State (32-bit): eax: 0xffffffe1 ebx: 0x00000003 ecx: 0xbfffd48c edx: 0x901de0fa edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffd4c8 esp: 0xbfffd48c ss: 0x0000001f efl: 0x00000206 eip: 0x901de0fa cs: 0x00000007 ds: 0x0000001f es: 0x0000001f fs: 0x00000000 gs: 0x00000037 Binary Images Description: 0x1000 - 0x517fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_um_6.11_i686-apple-darwin 0x12a9000 - 0x12c4fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v2bh_1999_200_006688771/lib/libsvml.dylib 0x131c000 - 0x13b3fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v2bh_1999_200_006688771/lib/libifcoremt.dylib 0x13fc000 - 0x1556fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v2bh_1999_200_006688771/lib/libimf.dylib 0x1669000 - 0x1697fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v2bh_1999_200_006688771/lib/libirc.dylib 0x901dd000 - 0x90383fff /usr/lib/libSystem.B.dylib 0x95083000 - 0x95091fff /usr/lib/libz.1.dylib 0x9678a000 - 0x9678dfff /usr/lib/system/libmathCommon.A.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=189, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 1 received, exiting... (2401): called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Sorry, too many model crashes! :-( (17623): called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
14 Sep 2010 20:48:40	1050514	11703626	famous_v2bh_1999_200_006688771_2	1,647,386	235,924	0.1432
14 Sep 2010 20:22:12	1050514	11703626	famous_v2bh_1999_200_006688771_2	1,638,026	234,470	0.1431
14 Sep 2010 20:00:49	1050514	11703626	famous_v2bh_1999_200_006688771_2	1,628,666	233,152	0.1432
14 Sep 2010 19:21:43	1050514	11703626	famous_v2bh_1999_200_006688771_2	1,619,306	231,840	0.1432
14 Sep 2010 18:59:21	1050514	11703626	famous_v2bh_1999_200_006688771_2	1,609,946	230,535	0.1432
14 Sep 2010 18:32:52	1050514	11703626	famous_v2bh_1999_200_006688771_2	1,600,586	229,236	0.1432
14 Sep 2010 18:11:38	1050514	11703626	famous_v2bh_1999_200_006688771_2	1,591,226	227,943	0.1432
14 Sep 2010 17:50:19	1050514	11703626	famous_v2bh_1999_200_006688771_2	1,581,866	226,642	0.1433
14 Sep 2010 17:28:51	1050514	11703626	famous_v2bh_1999_200_006688771_2	1,572,506	225,334	0.1433
14 Sep 2010 17:06:41	1050514	11703626	famous_v2bh_1999_200_006688771_2	1,563,146	224,034	0.1433
14 Sep 2010 16:44:38	1050514	11703626	famous_v2bh_1999_200_006688771_2	1,553,786	222,734	0.1433
14 Sep 2010 16:22:40	1050514	11703626	famous_v2bh_1999_200_006688771_2	1,544,426	221,421	0.1434
14 Sep 2010 15:59:51	1050514	11703626	famous_v2bh_1999_200_006688771_2	1,535,066	220,102	0.1434
14 Sep 2010 15:41:16	1050514	11703626	famous_v2bh_1999_200_006688771_2	1,525,706	218,783	0.1434
14 Sep 2010 15:16:04	1050514	11703626	famous_v2bh_1999_200_006688771_2	1,516,346	217,485	0.1434
14 Sep 2010 14:54:30	1050514	11703626	famous_v2bh_1999_200_006688771_2	1,506,986	216,186	0.1435
14 Sep 2010 14:33:06	1050514	11703626	famous_v2bh_1999_200_006688771_2	1,497,626	214,884	0.1435
14 Sep 2010 14:11:57	1050514	11703626	famous_v2bh_1999_200_006688771_2	1,488,266	213,583	0.1435
14 Sep 2010 13:45:21	1050514	11703626	famous_v2bh_1999_200_006688771_2	1,478,906	212,277	0.1435
14 Sep 2010 13:23:26	1050514	11703626	famous_v2bh_1999_200_006688771_2	1,469,546	210,970	0.1436