Task 11734812

Name	famous_v74q_1399_200_006695008_3
Workunit	6898261
Created	26 Aug 2010, 16:09:00 UTC
Sent	12 Dec 2010, 14:56:34 UTC
Report deadline	13 Mar 2011, 22:23:45 UTC
Received	15 Jan 2011, 12:53:04 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1092136
Run time	2 days 1 hours 5 min 19 sec
CPU time	1 days 13 hours 16 min 5 sec
Validate state	Invalid
Credit	2,223.56
Device peak FLOPS	2.63 GFLOPS
Application version	UK Met Office FAMOUS v6.11 i686-apple-darwin
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... (48077): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... (48077): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 1 received, exiting... (9545): called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 1 received, exiting... (21618): called boinc_finish (30355): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (30355): No heartbeat from core client for 30 sec - exiting SIGSEGV: segmentation violation Crashed executable name: famous_um_6.11_i686-apple-darwin built using BOINC library version 6.11.1 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.6.4 build 10F569 Sat Dec 18 00:00:11 2010 sh: /usr/bin/atos: No such file or directory 0 0x0048fdcf 1 0x0049054a 2 0x915eb1fb 3 0xffffffff 4 0x0134e6b3 5 0x0134d44f 6 0x002eeac6 7 0x003f55ea 8 0x00452abd 9 0x004698c0 10 0x000026b6 11 0x000025dd Thread 0 crashed with X86 Thread State (32-bit): eax: 0xffffffe1 ebx: 0x00000003 ecx: 0xbfffc3ec edx: 0x915850fa edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc428 esp: 0xbfffc3ec ss: 0x0000001f efl: 0x00000206 eip: 0x915850fa cs: 0x00000007 ds: 0x0000001f es: 0x0000001f fs: 0x00000000 gs: 0x00000037 Binary Images Description: 0x1000 - 0x517fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_um_6.11_i686-apple-darwin 0x12a9000 - 0x12c4fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v74q_1399_200_006695008/lib/libsvml.dylib 0x131c000 - 0x13b3fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v74q_1399_200_006695008/lib/libifcoremt.dylib 0x13fc000 - 0x1556fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v74q_1399_200_006695008/lib/libimf.dylib 0x1669000 - 0x1697fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v74q_1399_200_006695008/lib/libirc.dylib 0x91584000 - 0x9172afff /usr/lib/libSystem.B.dylib 0x9524c000 - 0x9525afff /usr/lib/libz.1.dylib 0x98ec1000 - 0x98ec4fff /usr/lib/system/libmathCommon.A.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=30550, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Signal 1 received, exiting... (30555): called boinc_finish Signal 1 received, exiting... (30550): called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Signal 1 received, exiting... (34924): called boinc_finish Signal 1 received, exiting... (34911): called boinc_finish CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 1 received, exiting... (40948): called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Signal 1 received, exiting... (42983): called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... (48080): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 1 received, exiting... (83603): called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Signal 1 received, exiting... (86320): called boinc_finish CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 1 received, exiting... (91525): called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Signal 1 received, exiting... (94727): called boinc_finish Signal 1 received, exiting... (94723): called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy SIGSEGV: segmentation violation Crashed executable name: famous_um_6.11_i686-apple-darwin built using BOINC library version 6.11.1 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.6.6 build 10J567 Sat Jan 15 05:11:11 2011 sh: /usr/bin/atos: No such file or directory 0 0x0048fdcf 1 0x0049054a 2 0x961c346b 3 0xffffffff 4 0x0134e6b3 5 0x0134d44f 6 0x002eeac6 7 0x003f55ea 8 0x00452abd 9 0x004698c0 10 0x000026b6 11 0x000025dd Thread 0 crashed with X86 Thread State (32-bit): eax: 0xffffffe1 ebx: 0x00000003 ecx: 0xbfffc3ec edx: 0x9615d0fa edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc428 esp: 0xbfffc3ec ss: 0x0000001f efl: 0x00000206 eip: 0x9615d0fa cs: 0x00000007 ds: 0x0000001f es: 0x0000001f fs: 0x00000000 gs: 0x00000037 Binary Images Description: 0x1000 - 0x517fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_um_6.11_i686-apple-darwin 0x12a9000 - 0x12c4fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v74q_1399_200_006695008/lib/libsvml.dylib 0x131c000 - 0x13b3fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v74q_1399_200_006695008/lib/libifcoremt.dylib 0x13fc000 - 0x1556fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v74q_1399_200_006695008/lib/libimf.dylib 0x1669000 - 0x1697fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v74q_1399_200_006695008/lib/libirc.dylib 0x9615c000 - 0x96303fff /usr/lib/libSystem.B.dylib 0x974ec000 - 0x974fafff /usr/lib/libz.1.dylib 0x998b5000 - 0x998b8fff /usr/lib/system/libmathCommon.A.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2406, iMonCtr=1 Model crash detected, will try to restart... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Sorry, too many model crashes! :-( (2406): called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
15 Jan 2011 12:57:31	1092136	11734812	famous_v74q_1399_200_006695008_3	673,946	133,184	0.1976
15 Jan 2011 12:57:31	1092136	11734812	famous_v74q_1399_200_006695008_3	664,586	131,304	0.1976
15 Jan 2011 12:57:31	1092136	11734812	famous_v74q_1399_200_006695008_3	655,226	129,426	0.1975
02 Jan 2011 15:26:54	1092136	11734812	famous_v74q_1399_200_006695008_3	645,866	127,553	0.1975
02 Jan 2011 09:58:16	1092136	11734812	famous_v74q_1399_200_006695008_3	636,506	125,688	0.1975
01 Jan 2011 09:59:19	1092136	11734812	famous_v74q_1399_200_006695008_3	627,146	123,842	0.1975
01 Jan 2011 02:55:57	1092136	11734812	famous_v74q_1399_200_006695008_3	617,786	122,000	0.1975
26 Dec 2010 11:20:09	1092136	11734812	famous_v74q_1399_200_006695008_3	608,426	119,860	0.1970
24 Dec 2010 23:38:15	1092136	11734812	famous_v74q_1399_200_006695008_3	599,066	117,532	0.1962
24 Dec 2010 20:42:45	1092136	11734812	famous_v74q_1399_200_006695008_3	589,706	115,673	0.1962
24 Dec 2010 16:37:20	1092136	11734812	famous_v74q_1399_200_006695008_3	580,346	113,808	0.1961
24 Dec 2010 12:25:02	1092136	11734812	famous_v74q_1399_200_006695008_3	570,986	111,932	0.1960
24 Dec 2010 10:42:39	1092136	11734812	famous_v74q_1399_200_006695008_3	561,626	110,062	0.1960
24 Dec 2010 10:42:39	1092136	11734812	famous_v74q_1399_200_006695008_3	552,266	108,171	0.1959
23 Dec 2010 11:10:42	1092136	11734812	famous_v74q_1399_200_006695008_3	542,906	106,296	0.1958
22 Dec 2010 11:20:47	1092136	11734812	famous_v74q_1399_200_006695008_3	533,546	104,432	0.1957
22 Dec 2010 11:20:47	1092136	11734812	famous_v74q_1399_200_006695008_3	524,186	102,596	0.1957
19 Dec 2010 21:34:53	1092136	11734812	famous_v74q_1399_200_006695008_3	514,826	100,714	0.1956
19 Dec 2010 13:12:33	1092136	11734812	famous_v74q_1399_200_006695008_3	505,466	98,831	0.1955
19 Dec 2010 11:06:02	1092136	11734812	famous_v74q_1399_200_006695008_3	496,106	96,963	0.1954