Task 12572322

Name	famous_vhvg_1999_200_006708930_6
Workunit	6912183
Created	10 Feb 2011, 23:38:47 UTC
Sent	10 Feb 2011, 23:38:53 UTC
Report deadline	13 May 2011, 7:06:04 UTC
Received	14 Feb 2011, 22:47:08 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1125051
Run time	3 days 21 hours 30 min 2 sec
CPU time	3 days 17 hours 38 min 15 sec
Validate state	Invalid
Credit	4,539.69
Device peak FLOPS	2.20 GFLOPS
Application version	UK Met Office FAMOUS v6.11 i686-apple-darwin
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... SIGSEGV: segmentation violation Crashed executable name: famous_um_6.11_i686-apple-darwin built using BOINC library version 6.11.1 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.6.6 build 10J567 Sat Feb 12 02:45:57 2011 sh: /usr/bin/atos: No such file or directory 0 0x0048fdcf 1 0x0049054a 2 0x9973246b 3 0xffffffff 4 0x0134e6b3 5 0x0134d44f 6 0x002eeac6 7 0x003f55ea 8 0x00452abd 9 0x004698c0 10 0x000026b6 11 0x000025dd Thread 0 crashed with X86 Thread State (32-bit): eax: 0xffffffe1 ebx: 0x00000003 ecx: 0xbfffc41c edx: 0x996cc0fa edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc458 esp: 0xbfffc41c ss: 0x0000001f efl: 0x00000206 eip: 0x996cc0fa cs: 0x00000007 ds: 0x0000001f es: 0x0000001f fs: 0x00000000 gs: 0x00000037 Binary Images Description: 0x1000 - 0x517fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_um_6.11_i686-apple-darwin 0x12a9000 - 0x12c4fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vhvg_1999_200_006708930/lib/libsvml.dylib 0x131c000 - 0x13b3fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vhvg_1999_200_006708930/lib/libifcoremt.dylib 0x13fc000 - 0x1556fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vhvg_1999_200_006708930/lib/libimf.dylib 0x1669000 - 0x1697fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vhvg_1999_200_006708930/lib/libirc.dylib 0x911d4000 - 0x911d7fff /usr/lib/system/libmathCommon.A.dylib 0x996cb000 - 0x99872fff /usr/lib/libSystem.B.dylib 0x999a0000 - 0x999aefff /usr/lib/libz.1.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=43191, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... SIGSEGV: segmentation violation Crashed executable name: famous_um_6.11_i686-apple-darwin built using BOINC library version 6.11.1 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.6.6 build 10J567 Sat Feb 12 03:01:03 2011 sh: /usr/bin/atos: No such file or directory 0 0x0048fdcf 1 0x0049054a 2 0x9973246b 3 0xffffffff 4 0x0134e6b3 5 0x0134d44f 6 0x002eeac6 7 0x003f55ea 8 0x00452abd 9 0x004698c0 10 0x000026b6 11 0x000025dd Thread 0 crashed with X86 Thread State (32-bit): eax: 0xffffffe1 ebx: 0x00000003 ecx: 0xbfffc41c edx: 0x996cc0fa edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc458 esp: 0xbfffc41c ss: 0x0000001f efl: 0x00000206 eip: 0x996cc0fa cs: 0x00000007 ds: 0x0000001f es: 0x0000001f fs: 0x00000000 gs: 0x00000037 Binary Images Description: 0x1000 - 0x517fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_um_6.11_i686-apple-darwin 0x12a9000 - 0x12c4fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vhvg_1999_200_006708930/lib/libsvml.dylib 0x131c000 - 0x13b3fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vhvg_1999_200_006708930/lib/libifcoremt.dylib 0x13fc000 - 0x1556fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vhvg_1999_200_006708930/lib/libimf.dylib 0x1669000 - 0x1697fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vhvg_1999_200_006708930/lib/libirc.dylib 0x911d4000 - 0x911d7fff /usr/lib/system/libmathCommon.A.dylib 0x996cb000 - 0x99872fff /usr/lib/libSystem.B.dylib 0x999a0000 - 0x999aefff /usr/lib/libz.1.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=43630, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... SIGSEGV: segmentation violation Crashed executable name: famous_um_6.11_i686-apple-darwin built using BOINC library version 6.11.1 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.6.6 build 10J567 Sat Feb 12 03:18:34 2011 sh: /usr/bin/atos: No such file or directory 0 0x0048fdcf 1 0x0049054a 2 0x9973246b 3 0xffffffff 4 0x0134e6b3 5 0x0134d44f 6 0x002eeac6 7 0x003f55ea 8 0x00452abd 9 0x004698c0 10 0x000026b6 11 0x000025dd Thread 0 crashed with X86 Thread State (32-bit): eax: 0xffffffe1 ebx: 0x00000003 ecx: 0xbfffc41c edx: 0x996cc0fa edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc458 esp: 0xbfffc41c ss: 0x0000001f efl: 0x00000206 eip: 0x996cc0fa cs: 0x00000007 ds: 0x0000001f es: 0x0000001f fs: 0x00000000 gs: 0x00000037 Binary Images Description: 0x1000 - 0x517fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_um_6.11_i686-apple-darwin 0x12a9000 - 0x12c4fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vhvg_1999_200_006708930/lib/libsvml.dylib 0x131c000 - 0x13b3fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vhvg_1999_200_006708930/lib/libifcoremt.dylib 0x13fc000 - 0x1556fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vhvg_1999_200_006708930/lib/libimf.dylib 0x1669000 - 0x1697fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vhvg_1999_200_006708930/lib/libirc.dylib 0x911d4000 - 0x911d7fff /usr/lib/system/libmathCommon.A.dylib 0x996cb000 - 0x99872fff /usr/lib/libSystem.B.dylib 0x999a0000 - 0x999aefff /usr/lib/libz.1.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=44400, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Sorry, too many model crashes! :-( (14972): called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
14 Feb 2011 22:09:11	1125051	12572322	famous_vhvg_1999_200_006708930_6	1,375,946	320,492	0.2329
14 Feb 2011 21:35:52	1125051	12572322	famous_vhvg_1999_200_006708930_6	1,366,586	318,301	0.2329
14 Feb 2011 21:14:05	1125051	12572322	famous_vhvg_1999_200_006708930_6	1,357,226	316,108	0.2329
14 Feb 2011 21:14:05	1125051	12572322	famous_vhvg_1999_200_006708930_6	1,347,866	313,915	0.2329
14 Feb 2011 19:39:33	1125051	12572322	famous_vhvg_1999_200_006708930_6	1,338,506	311,724	0.2329
14 Feb 2011 19:20:32	1125051	12572322	famous_vhvg_1999_200_006708930_6	1,329,146	309,532	0.2329
14 Feb 2011 19:15:36	1125051	12572322	famous_vhvg_1999_200_006708930_6	1,319,786	307,339	0.2329
14 Feb 2011 19:10:00	1125051	12572322	famous_vhvg_1999_200_006708930_6	1,310,426	305,149	0.2329
14 Feb 2011 17:01:54	1125051	12572322	famous_vhvg_1999_200_006708930_6	1,301,066	302,956	0.2329
14 Feb 2011 16:24:11	1125051	12572322	famous_vhvg_1999_200_006708930_6	1,291,706	300,763	0.2328
14 Feb 2011 15:49:30	1125051	12572322	famous_vhvg_1999_200_006708930_6	1,282,346	298,575	0.2328
14 Feb 2011 15:08:44	1125051	12572322	famous_vhvg_1999_200_006708930_6	1,272,986	296,384	0.2328
14 Feb 2011 14:31:01	1125051	12572322	famous_vhvg_1999_200_006708930_6	1,263,626	294,191	0.2328
14 Feb 2011 13:54:01	1125051	12572322	famous_vhvg_1999_200_006708930_6	1,254,266	291,998	0.2328
14 Feb 2011 13:16:44	1125051	12572322	famous_vhvg_1999_200_006708930_6	1,244,906	289,807	0.2328
14 Feb 2011 12:40:31	1125051	12572322	famous_vhvg_1999_200_006708930_6	1,235,546	287,616	0.2328
14 Feb 2011 12:01:29	1125051	12572322	famous_vhvg_1999_200_006708930_6	1,226,186	285,424	0.2328
14 Feb 2011 11:21:53	1125051	12572322	famous_vhvg_1999_200_006708930_6	1,216,826	283,232	0.2328
14 Feb 2011 10:40:23	1125051	12572322	famous_vhvg_1999_200_006708930_6	1,207,466	281,041	0.2328
14 Feb 2011 10:03:19	1125051	12572322	famous_vhvg_1999_200_006708930_6	1,198,106	278,850	0.2327