Task 12834017

Name	hadcm3n_p7ar_1900_40_007227043_1
Workunit	7425283
Created	26 Apr 2011, 15:39:07 UTC
Sent	26 Apr 2011, 21:51:17 UTC
Report deadline	27 Jul 2011, 5:18:28 UTC
Received	17 Jun 2011, 10:36:22 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	976458
Run time	17 days 2 hours 40 min 15 sec
CPU time	13 days 5 hours 35 min 44 sec
Validate state	Invalid
Credit	11,508.48
Device peak FLOPS	3.35 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>6.6.29</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 CPDN Monitor - Quit request from BOINC... Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 18:56:24 (76348): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 CPDN Monitor - Quit request from BOINC... Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.5.8 build 9L30 Fri Jun 17 04:44:20 2011 BOINC backtrace under OS 10.5.x only shows exported (global) symbols and may not show the final location which caused a crash. For a better backtrace, either run under OS 10.4.x or run under OS 10.6.x or later. 0 hadcm3n_um_6.07_i686-apple-darwin 0x00445d97 PrintBacktrace (in hadcm3n_um_6.07_i686-apple-darwin) + 1071 1 hadcm3n_um_6.07_i686-apple-darwin 0x0043bd7a boinc_catch_signal (in hadcm3n_um_6.07_i686-apple-darwin) + 476 2 libSystem.B.dylib 0x975ae2bb _sigtramp + 43 3 ??? 0xffffffff 0x0 + 4294967295 4 libSystem.B.dylib 0x9762223a raise + 26 5 libSystem.B.dylib 0x9762e679 abort + 73 6 hadcm3n_um_6.07_i686-apple-darwin 0x00336cff um_setup (in hadcm3n_um_6.07_i686-apple-darwin) + 127 7 hadcm3n_um_6.07_i686-apple-darwin 0x00389b71 um_shell (in hadcm3n_um_6.07_i686-apple-darwin) + 3953 8 hadcm3n_um_6.07_i686-apple-darwin 0x000048e1 main (in hadcm3n_um_6.07_i686-apple-darwin) + 1153 9 hadcm3n_um_6.07_i686-apple-darwin 0x000027fb _start (in hadcm3n_um_6.07_i686-apple-darwin) + 209 10 hadcm3n_um_6.07_i686-apple-darwin 0x00002729 start (in hadcm3n_um_6.07_i686-apple-darwin) + 41 Thread 0 crashed with X86 Thread State (32-bit): eax: 0xffffffe1 ebx: 0x975768c2 ecx: 0xbfffd4ec edx: 0x97542266 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffd528 esp: 0xbfffd4ec ss: 0x0000001f efl: 0x00000206 eip: 0x97542266 cs: 0x00000007 ds: 0x0000001f es: 0x0000001f fs: 0x00000000 gs: 0x00000037 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x91885000 - 0x91893fff /usr/lib/libz.1.dylib 0x921e7000 - 0x921eefff /usr/lib/libgcc_s.1.dylib 0x9241d000 - 0x92421fff /usr/lib/system/libmathCommon.A.dylib 0x97541000 - 0x976a8fff /usr/lib/libSystem.B.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=53971, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.5.8 build 9L30 Fri Jun 17 04:44:25 2011 BOINC backtrace under OS 10.5.x only shows exported (global) symbols and may not show the final location which caused a crash. For a better backtrace, either run under OS 10.4.x or run under OS 10.6.x or later. 0 hadcm3n_um_6.07_i686-apple-darwin 0x00445d97 PrintBacktrace (in hadcm3n_um_6.07_i686-apple-darwin) + 1071 1 hadcm3n_um_6.07_i686-apple-darwin 0x0043bd7a boinc_catch_signal (in hadcm3n_um_6.07_i686-apple-darwin) + 476 2 libSystem.B.dylib 0x975ae2bb _sigtramp + 43 3 ??? 0xffffffff 0x0 + 4294967295 4 libSystem.B.dylib 0x9762223a raise + 26 5 libSystem.B.dylib 0x9762e679 abort + 73 6 hadcm3n_um_6.07_i686-apple-darwin 0x00336cff um_setup (in hadcm3n_um_6.07_i686-apple-darwin) + 127 7 hadcm3n_um_6.07_i686-apple-darwin 0x00389b71 um_shell (in hadcm3n_um_6.07_i686-apple-darwin) + 3953 8 hadcm3n_um_6.07_i686-apple-darwin 0x000048e1 main (in hadcm3n_um_6.07_i686-apple-darwin) + 1153 9 hadcm3n_um_6.07_i686-apple-darwin 0x000027fb _start (in hadcm3n_um_6.07_i686-apple-darwin) + 209 10 hadcm3n_um_6.07_i686-apple-darwin 0x00002729 start (in hadcm3n_um_6.07_i686-apple-darwin) + 41 Thread 0 crashed with X86 Thread State (32-bit): eax: 0xffffffe1 ebx: 0x975768c2 ecx: 0xbfffd4ec edx: 0x97542266 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffd528 esp: 0xbfffd4ec ss: 0x0000001f efl: 0x00000206 eip: 0x97542266 cs: 0x00000007 ds: 0x0000001f es: 0x0000001f fs: 0x00000000 gs: 0x00000037 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x91885000 - 0x91893fff /usr/lib/libz.1.dylib 0x921e7000 - 0x921eefff /usr/lib/libgcc_s.1.dylib 0x9241d000 - 0x92421fff /usr/lib/system/libmathCommon.A.dylib 0x97541000 - 0x976a8fff /usr/lib/libSystem.B.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=53971, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.5.8 build 9L30 Fri Jun 17 04:44:27 2011 BOINC backtrace under OS 10.5.x only shows exported (global) symbols and may not show the final location which caused a crash. For a better backtrace, either run under OS 10.4.x or run under OS 10.6.x or later. 0 hadcm3n_um_6.07_i686-apple-darwin 0x00445d97 PrintBacktrace (in hadcm3n_um_6.07_i686-apple-darwin) + 1071 1 hadcm3n_um_6.07_i686-apple-darwin 0x0043bd7a boinc_catch_signal (in hadcm3n_um_6.07_i686-apple-darwin) + 476 2 libSystem.B.dylib 0x975ae2bb _sigtramp + 43 3 ??? 0xffffffff 0x0 + 4294967295 4 libSystem.B.dylib 0x9762223a raise + 26 5 libSystem.B.dylib 0x9762e679 abort + 73 6 hadcm3n_um_6.07_i686-apple-darwin 0x00336cff um_setup (in hadcm3n_um_6.07_i686-apple-darwin) + 127 7 hadcm3n_um_6.07_i686-apple-darwin 0x00389b71 um_shell (in hadcm3n_um_6.07_i686-apple-darwin) + 3953 8 hadcm3n_um_6.07_i686-apple-darwin 0x000048e1 main (in hadcm3n_um_6.07_i686-apple-darwin) + 1153 9 hadcm3n_um_6.07_i686-apple-darwin 0x000027fb _start (in hadcm3n_um_6.07_i686-apple-darwin) + 209 10 hadcm3n_um_6.07_i686-apple-darwin 0x00002729 start (in hadcm3n_um_6.07_i686-apple-darwin) + 41 Thread 0 crashed with X86 Thread State (32-bit): eax: 0xffffffe1 ebx: 0x975768c2 ecx: 0xbfffd4ec edx: 0x97542266 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffd528 esp: 0xbfffd4ec ss: 0x0000001f efl: 0x00000206 eip: 0x97542266 cs: 0x00000007 ds: 0x0000001f es: 0x0000001f fs: 0x00000000 gs: 0x00000037 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x91885000 - 0x91893fff /usr/lib/libz.1.dylib 0x921e7000 - 0x921eefff /usr/lib/libgcc_s.1.dylib 0x9241d000 - 0x92421fff /usr/lib/system/libmathCommon.A.dylib 0x97541000 - 0x976a8fff /usr/lib/libSystem.B.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=53971, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.5.8 build 9L30 Fri Jun 17 04:44:30 2011 BOINC backtrace under OS 10.5.x only shows exported (global) symbols and may not show the final location which caused a crash. For a better backtrace, either run under OS 10.4.x or run under OS 10.6.x or later. 0 hadcm3n_um_6.07_i686-apple-darwin 0x00445d97 PrintBacktrace (in hadcm3n_um_6.07_i686-apple-darwin) + 1071 1 hadcm3n_um_6.07_i686-apple-darwin 0x0043bd7a boinc_catch_signal (in hadcm3n_um_6.07_i686-apple-darwin) + 476 2 libSystem.B.dylib 0x975ae2bb _sigtramp + 43 3 ??? 0xffffffff 0x0 + 4294967295 4 libSystem.B.dylib 0x9762223a raise + 26 5 libSystem.B.dylib 0x9762e679 abort + 73 6 hadcm3n_um_6.07_i686-apple-darwin 0x00336cff um_setup (in hadcm3n_um_6.07_i686-apple-darwin) + 127 7 hadcm3n_um_6.07_i686-apple-darwin 0x00389b71 um_shell (in hadcm3n_um_6.07_i686-apple-darwin) + 3953 8 hadcm3n_um_6.07_i686-apple-darwin 0x000048e1 main (in hadcm3n_um_6.07_i686-apple-darwin) + 1153 9 hadcm3n_um_6.07_i686-apple-darwin 0x000027fb _start (in hadcm3n_um_6.07_i686-apple-darwin) + 209 10 hadcm3n_um_6.07_i686-apple-darwin 0x00002729 start (in hadcm3n_um_6.07_i686-apple-darwin) + 41 Thread 0 crashed with X86 Thread State (32-bit): eax: 0xffffffe1 ebx: 0x975768c2 ecx: 0xbfffd4ec edx: 0x97542266 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffd528 esp: 0xbfffd4ec ss: 0x0000001f efl: 0x00000206 eip: 0x97542266 cs: 0x00000007 ds: 0x0000001f es: 0x0000001f fs: 0x00000000 gs: 0x00000037 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x91885000 - 0x91893fff /usr/lib/libz.1.dylib 0x921e7000 - 0x921eefff /usr/lib/libgcc_s.1.dylib 0x9241d000 - 0x92421fff /usr/lib/system/libmathCommon.A.dylib 0x97541000 - 0x976a8fff /usr/lib/libSystem.B.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=53971, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.5.8 build 9L30 Fri Jun 17 04:44:33 2011 BOINC backtrace under OS 10.5.x only shows exported (global) symbols and may not show the final location which caused a crash. For a better backtrace, either run under OS 10.4.x or run under OS 10.6.x or later. CPDN Monitor - Quit request from BOINC... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.5.8 build 9L30 Fri Jun 17 04:49:26 2011 BOINC backtrace under OS 10.5.x only shows exported (global) symbols and may not show the final location which caused a crash. For a better backtrace, either run under OS 10.4.x or run under OS 10.6.x or later. 0 hadcm3n_um_6.07_i686-apple-darwin 0x00445d97 PrintBacktrace (in hadcm3n_um_6.07_i686-apple-darwin) + 1071 1 hadcm3n_um_6.07_i686-apple-darwin 0x0043bd7a boinc_catch_signal (in hadcm3n_um_6.07_i686-apple-darwin) + 476 2 libSystem.B.dylib 0x975ae2bb _sigtramp + 43 3 ??? 0xffffffff 0x0 + 4294967295 4 libSystem.B.dylib 0x9762223a raise + 26 5 libSystem.B.dylib 0x9762e679 abort + 73 6 hadcm3n_um_6.07_i686-apple-darwin 0x00336cff um_setup (in hadcm3n_um_6.07_i686-apple-darwin) + 127 7 hadcm3n_um_6.07_i686-apple-darwin 0x00389b71 um_shell (in hadcm3n_um_6.07_i686-apple-darwin) + 3953 8 hadcm3n_um_6.07_i686-apple-darwin 0x000048e1 main (in hadcm3n_um_6.07_i686-apple-darwin) + 1153 9 hadcm3n_um_6.07_i686-apple-darwin 0x000027fb _start (in hadcm3n_um_6.07_i686-apple-darwin) + 209 10 hadcm3n_um_6.07_i686-apple-darwin 0x00002729 start (in hadcm3n_um_6.07_i686-apple-darwin) + 41 Thread 0 crashed with X86 Thread State (32-bit): eax: 0xffffffe1 ebx: 0x975768c2 ecx: 0xbfffd4ec edx: 0x97542266 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffd528 esp: 0xbfffd4ec ss: 0x0000001f efl: 0x00000206 eip: 0x97542266 cs: 0x00000007 ds: 0x0000001f es: 0x0000001f fs: 0x00000000 gs: 0x00000037 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x91885000 - 0x91893fff /usr/lib/libz.1.dylib 0x921e7000 - 0x921eefff /usr/lib/libgcc_s.1.dylib 0x9241d000 - 0x92421fff /usr/lib/system/libmathCommon.A.dylib 0x97541000 - 0x976a8fff /usr/lib/libSystem.B.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=54086, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.5.8 build 9L30 Fri Jun 17 04:49:30 2011 BOINC backtrace under OS 10.5.x only shows exported (global) symbols and may not show the final location which caused a crash. For a better backtrace, either run under OS 10.4.x or run under OS 10.6.x or later. 0 hadcm3n_um_6.07_i686-apple-darwin 0x00445d97 PrintBacktrace (in hadcm3n_um_6.07_i686-apple-darwin) + 1071 1 hadcm3n_um_6.07_i686-apple-darwin 0x0043bd7a boinc_catch_signal (in hadcm3n_um_6.07_i686-apple-darwin) + 476 2 libSystem.B.dylib 0x975ae2bb _sigtramp + 43 3 ??? 0xffffffff 0x0 + 4294967295 4 libSystem.B.dylib 0x9762223a raise + 26 5 libSystem.B.dylib 0x9762e679 abort + 73 6 hadcm3n_um_6.07_i686-apple-darwin 0x00336cff um_setup (in hadcm3n_um_6.07_i686-apple-darwin) + 127 7 hadcm3n_um_6.07_i686-apple-darwin 0x00389b71 um_shell (in hadcm3n_um_6.07_i686-apple-darwin) + 3953 8 hadcm3n_um_6.07_i686-apple-darwin 0x000048e1 main (in hadcm3n_um_6.07_i686-apple-darwin) + 1153 9 hadcm3n_um_6.07_i686-apple-darwin 0x000027fb _start (in hadcm3n_um_6.07_i686-apple-darwin) + 209 10 hadcm3n_um_6.07_i686-apple-darwin 0x00002729 start (in hadcm3n_um_6.07_i686-apple-darwin) + 41 Thread 0 crashed with X86 Thread State (32-bit): eax: 0xffffffe1 ebx: 0x975768c2 ecx: 0xbfffd4ec edx: 0x97542266 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffd528 esp: 0xbfffd4ec ss: 0x0000001f efl: 0x00000206 eip: 0x97542266 cs: 0x00000007 ds: 0x0000001f es: 0x0000001f fs: 0x00000000 gs: 0x00000037 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x91885000 - 0x91893fff /usr/lib/libz.1.dylib 0x921e7000 - 0x921eefff /usr/lib/libgcc_s.1.dylib 0x9241d000 - 0x92421fff /usr/lib/system/libmathCommon.A.dylib 0x97541000 - 0x976a8fff /usr/lib/libSystem.B.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=54086, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
16 Jun 2011 22:34:51	976458	12834017	hadcm3n_p7ar_1900_40_007227043_1	959,040	1,114,107	1.1617
16 Jun 2011 12:16:38	976458	12834017	hadcm3n_p7ar_1900_40_007227043_1	933,120	1,088,740	1.1668
16 Jun 2011 01:18:26	976458	12834017	hadcm3n_p7ar_1900_40_007227043_1	907,200	1,052,204	1.1598
15 Jun 2011 15:45:30	976458	12834017	hadcm3n_p7ar_1900_40_007227043_1	881,280	1,015,684	1.1525
15 Jun 2011 04:45:37	976458	12834017	hadcm3n_p7ar_1900_40_007227043_1	855,360	979,409	1.1450
13 Jun 2011 07:33:43	976458	12834017	hadcm3n_p7ar_1900_40_007227043_1	829,440	943,315	1.1373
07 Jun 2011 15:33:12	976458	12834017	hadcm3n_p7ar_1900_40_007227043_1	803,520	907,042	1.1288
06 Jun 2011 13:54:04	976458	12834017	hadcm3n_p7ar_1900_40_007227043_1	777,600	871,313	1.1205
05 Jun 2011 21:19:53	976458	12834017	hadcm3n_p7ar_1900_40_007227043_1	751,680	834,846	1.1106
05 Jun 2011 11:11:40	976458	12834017	hadcm3n_p7ar_1900_40_007227043_1	725,760	832,255	1.1467
05 Jun 2011 00:27:26	976458	12834017	hadcm3n_p7ar_1900_40_007227043_1	699,840	794,891	1.1358
04 Jun 2011 11:44:52	976458	12834017	hadcm3n_p7ar_1900_40_007227043_1	673,920	782,613	1.1613
31 May 2011 20:09:18	976458	12834017	hadcm3n_p7ar_1900_40_007227043_1	648,000	758,039	1.1698
28 May 2011 04:23:18	976458	12834017	hadcm3n_p7ar_1900_40_007227043_1	622,080	719,874	1.1572
27 May 2011 17:35:43	976458	12834017	hadcm3n_p7ar_1900_40_007227043_1	596,160	681,627	1.1434
27 May 2011 06:39:14	976458	12834017	hadcm3n_p7ar_1900_40_007227043_1	570,240	643,185	1.1279
26 May 2011 17:25:24	976458	12834017	hadcm3n_p7ar_1900_40_007227043_1	544,320	604,860	1.1112
25 May 2011 17:01:33	976458	12834017	hadcm3n_p7ar_1900_40_007227043_1	518,400	566,951	1.0937
24 May 2011 21:52:44	976458	12834017	hadcm3n_p7ar_1900_40_007227043_1	492,480	528,887	1.0739
17 May 2011 17:12:40	976458	12834017	hadcm3n_p7ar_1900_40_007227043_1	466,560	491,283	1.0530