Task 12562938

Name	famous_vosp_1199_200_006738285_3
Workunit	6941629
Created	8 Feb 2011, 0:44:27 UTC
Sent	8 Feb 2011, 0:44:30 UTC
Report deadline	10 May 2011, 8:11:41 UTC
Received	10 Feb 2011, 3:37:21 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1098754
Run time	19 hours 46 min 50 sec
CPU time	16 hours 10 min 53 sec
Validate state	Invalid
Credit	1,173.59
Device peak FLOPS	3.11 GFLOPS
Application version	UK Met Office FAMOUS v6.11 i686-apple-darwin
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... SIGSEGV: segmentation violation Crashed executable name: famous_um_6.11_i686-apple-darwin built using BOINC library version 6.11.1 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.6.5 build 10H574 Tue Feb 8 08:56:43 2011 sh: /usr/bin/atos: No such file or directory 0 0x0048fdcf 1 0x0049054a 2 0x9039c46b 3 0xffffffff 4 0x0134e6b3 5 0x0134d44f 6 0x002eeac6 7 0x003f55ea 8 0x00452abd 9 0x004698c0 10 0x000026b6 11 0x000025dd Thread 0 crashed with X86 Thread State (32-bit): eax: 0xffffffe1 ebx: 0x00000003 ecx: 0xbfffc3cc edx: 0x903360fa edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc408 esp: 0xbfffc3cc ss: 0x00000023 efl: 0x00000206 eip: 0x903360fa cs: 0x0000000b ds: 0x00000023 es: 0x00000023 fs: 0x00000000 gs: 0x0000000f Binary Images Description: 0x1000 - 0x517fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_um_6.11_i686-apple-darwin 0x12a9000 - 0x12c4fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vosp_1199_200_006738285/lib/libsvml.dylib 0x131c000 - 0x13b3fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vosp_1199_200_006738285/lib/libifcoremt.dylib 0x13fc000 - 0x1556fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vosp_1199_200_006738285/lib/libimf.dylib 0x1669000 - 0x1697fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vosp_1199_200_006738285/lib/libirc.dylib 0x90335000 - 0x904dcfff /usr/lib/libSystem.B.dylib 0x9814f000 - 0x98152fff /usr/lib/system/libmathCommon.A.dylib 0x986be000 - 0x986ccfff /usr/lib/libz.1.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7574, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... SIGSEGV: segmentation violation Crashed executable name: famous_um_6.11_i686-apple-darwin built using BOINC library version 6.11.1 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.6.5 build 10H574 Tue Feb 8 14:17:53 2011 sh: /usr/bin/atos: No such file or directory 0 0x0048fdcf 1 0x0049054a 2 0x9039c46b 3 0xffffffff 4 0x0134e6b3 5 0x0134d44f 6 0x003f5826 7 0x00450bd8 8 0x004698c0 9 0x000026b6 10 0x000025dd Thread 0 crashed with X86 Thread State (32-bit): eax: 0xffffffe1 ebx: 0x00000003 ecx: 0xbfffd45c edx: 0x903360fa edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffd498 esp: 0xbfffd45c ss: 0x00000023 efl: 0x00000206 eip: 0x903360fa cs: 0x0000000b ds: 0x00000023 es: 0x00000023 fs: 0x00000000 gs: 0x0000000f Binary Images Description: 0x1000 - 0x517fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_um_6.11_i686-apple-darwin 0x12a9000 - 0x12c4fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vosp_1199_200_006738285/lib/libsvml.dylib 0x131c000 - 0x13b3fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vosp_1199_200_006738285/lib/libifcoremt.dylib 0x13fc000 - 0x1556fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vosp_1199_200_006738285/lib/libimf.dylib 0x1669000 - 0x1697fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vosp_1199_200_006738285/lib/libirc.dylib 0x90335000 - 0x904dcfff /usr/lib/libSystem.B.dylib 0x9814f000 - 0x98152fff /usr/lib/system/libmathCommon.A.dylib 0x986be000 - 0x986ccfff /usr/lib/libz.1.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=10993, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... SIGSEGV: segmentation violation Crashed executable name: famous_um_6.11_i686-apple-darwin built using BOINC library version 6.11.1 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.6.5 build 10H574 Wed Feb 9 23:55:36 2011 sh: /usr/bin/atos: No such file or directory 0 0x0048fdcf 1 0x0049054a 2 0x9039c46b 3 0xffffffff 4 0x0134e6b3 5 0x0134d44f 6 0x002eeac6 7 0x003f55ea 8 0x00452abd 9 0x004698c0 10 0x000026b6 11 0x000025dd Thread 0 crashed with X86 Thread State (32-bit): eax: 0xffffffe1 ebx: 0x00000003 ecx: 0xbfffc3cc edx: 0x903360fa edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc408 esp: 0xbfffc3cc ss: 0x00000023 efl: 0x00000206 eip: 0x903360fa cs: 0x0000000b ds: 0x00000023 es: 0x00000023 fs: 0x00000000 gs: 0x0000000f Binary Images Description: 0x1000 - 0x517fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_um_6.11_i686-apple-darwin 0x12a9000 - 0x12c4fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vosp_1199_200_006738285/lib/libsvml.dylib 0x131c000 - 0x13b3fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vosp_1199_200_006738285/lib/libifcoremt.dylib 0x13fc000 - 0x1556fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vosp_1199_200_006738285/lib/libimf.dylib 0x1669000 - 0x1697fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vosp_1199_200_006738285/lib/libirc.dylib 0x90335000 - 0x904dcfff /usr/lib/libSystem.B.dylib 0x9814f000 - 0x98152fff /usr/lib/system/libmathCommon.A.dylib 0x986be000 - 0x986ccfff /usr/lib/libz.1.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=32360, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Sorry, too many model crashes! :-( (35148): called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
10 Feb 2011 03:17:57	1098754	12562938	famous_vosp_1199_200_006738285_3	355,706	57,269	0.1610
10 Feb 2011 02:41:44	1098754	12562938	famous_vosp_1199_200_006738285_3	346,346	55,759	0.1610
10 Feb 2011 02:10:21	1098754	12562938	famous_vosp_1199_200_006738285_3	336,986	54,251	0.1610
10 Feb 2011 01:33:43	1098754	12562938	famous_vosp_1199_200_006738285_3	327,626	52,742	0.1610
10 Feb 2011 00:57:39	1098754	12562938	famous_vosp_1199_200_006738285_3	318,266	51,233	0.1610
10 Feb 2011 00:25:52	1098754	12562938	famous_vosp_1199_200_006738285_3	308,906	49,723	0.1610
09 Feb 2011 23:48:31	1098754	12562938	famous_vosp_1199_200_006738285_3	299,546	48,211	0.1609
09 Feb 2011 23:12:56	1098754	12562938	famous_vosp_1199_200_006738285_3	290,186	46,698	0.1609
09 Feb 2011 22:36:38	1098754	12562938	famous_vosp_1199_200_006738285_3	280,826	45,187	0.1609
09 Feb 2011 22:06:41	1098754	12562938	famous_vosp_1199_200_006738285_3	271,466	43,675	0.1609
09 Feb 2011 21:32:25	1098754	12562938	famous_vosp_1199_200_006738285_3	262,106	42,166	0.1609
09 Feb 2011 20:56:32	1098754	12562938	famous_vosp_1199_200_006738285_3	252,746	40,655	0.1609
09 Feb 2011 20:23:00	1098754	12562938	famous_vosp_1199_200_006738285_3	243,386	39,146	0.1608
09 Feb 2011 20:14:43	1098754	12562938	famous_vosp_1199_200_006738285_3	234,026	37,634	0.1608
09 Feb 2011 20:14:43	1098754	12562938	famous_vosp_1199_200_006738285_3	224,666	36,125	0.1608
09 Feb 2011 19:12:24	1098754	12562938	famous_vosp_1199_200_006738285_3	215,306	34,612	0.1608
09 Feb 2011 19:06:30	1098754	12562938	famous_vosp_1199_200_006738285_3	205,946	33,103	0.1607
09 Feb 2011 18:59:00	1098754	12562938	famous_vosp_1199_200_006738285_3	196,586	31,592	0.1607
09 Feb 2011 16:50:04	1098754	12562938	famous_vosp_1199_200_006738285_3	187,226	30,083	0.1607
09 Feb 2011 16:17:49	1098754	12562938	famous_vosp_1199_200_006738285_3	177,866	28,573	0.1606