Task 13419338

Name	hadcm3n_t6lt_1940_40_007461875_3
Workunit	7659378
Created	25 Sep 2011, 1:26:17 UTC
Sent	25 Sep 2011, 2:02:31 UTC
Report deadline	25 Dec 2011, 9:29:42 UTC
Received	4 Nov 2011, 5:46:08 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1171111
Run time	2 days 19 hours 45 min 36 sec
CPU time	1 days 18 hours 54 min 27 sec
Validate state	Invalid
Credit	933.12
Device peak FLOPS	2.78 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:11:06 (65801): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... SIGSEGV: segmentation violation Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:02:33 (1084): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:34:09 (14298): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:13:54 (67209): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:23:54 (60066): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:23:56 (60066): No heartbeat from core client for 30 sec - exiting 10:23:57 (60066): No heartbeat from core client for 30 sec - exiting 10:23:58 (60066): No heartbeat from core client for 30 sec - exiting 10:23:59 (60066): No heartbeat from core client for 30 sec - exiting 10:24:00 (60066): No heartbeat from core client for 30 sec - exiting 10:24:01 (60066): No heartbeat from core client for 30 sec - exiting 10:24:02 (60066): No heartbeat from core client for 30 sec - exiting 10:24:03 (60066): No heartbeat from core client for 30 sec - exiting 10:24:04 (60066): No heartbeat from core client for 30 sec - exiting 10:24:06 (60066): No heartbeat from core client for 30 sec - exiting 10:24:07 (60066): No heartbeat from core client for 30 sec - exiting 10:24:08 (60066): No heartbeat from core client for 30 sec - exiting 10:24:09 (60066): No heartbeat from core client for 30 sec - exiting 10:24:10 (60066): No heartbeat from core client for 30 sec - exiting 10:24:11 (60066): No heartbeat from core client for 30 sec - exiting 10:24:12 (60066): No heartbeat from core client for 30 sec - exiting 10:24:13 (60066): No heartbeat from core client for 30 sec - exiting 10:24:14 (60066): No heartbeat from core client for 30 sec - exiting 10:24:15 (60066): No heartbeat from core client for 30 sec - exiting 10:24:16 (60066): No heartbeat from core client for 30 sec - exiting 10:24:17 (60066): No heartbeat from core client for 30 sec - exiting 10:24:18 (60066): No heartbeat from core client for 30 sec - exiting 10:24:19 (60066): No heartbeat from core client for 30 sec - exiting 10:24:20 (60066): No heartbeat from core client for 30 sec - exiting 10:24:21 (60066): No heartbeat from core client for 30 sec - exiting 10:24:22 (60066): No heartbeat from core client for 30 sec - exiting 10:24:23 (60066): No heartbeat from core client for 30 sec - exiting 10:24:24 (60066): No heartbeat from core client for 30 sec - exiting 10:24:25 (60066): No heartbeat from core client for 30 sec - exiting 10:24:26 (60066): No heartbeat from core client for 30 sec - exiting 10:24:27 (60066): No heartbeat from core client for 30 sec - exiting 10:24:28 (60066): No heartbeat from core client for 30 sec - exiting 10:24:29 (60066): No heartbeat from core client for 30 sec - exiting 10:24:30 (60066): No heartbeat from core client for 30 sec - exiting 10:24:31 (60066): No heartbeat from core client for 30 sec - exiting 10:24:32 (60066): No heartbeat from core client for 30 sec - exiting 10:24:33 (60066): No heartbeat from core client for 30 sec - exiting 10:24:34 (60066): No heartbeat from core client for 30 sec - exiting 10:24:35 (60066): No heartbeat from core client for 30 sec - exiting 10:24:36 (60066): No heartbeat from core client for 30 sec - exiting 10:24:37 (60066): No heartbeat from core client for 30 sec - exiting 10:24:38 (60066): No heartbeat from core client for 30 sec - exiting 10:24:39 (60066): No heartbeat from core client for 30 sec - exiting 10:24:40 (60066): No heartbeat from core client for 30 sec - exiting 10:24:41 (60066): No heartbeat from core client for 30 sec - exiting 10:24:42 (60066): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:58:58 (60481): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:59:00 (60481): No heartbeat from core client for 30 sec - exiting 10:59:01 (60481): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:34:01 (61722): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:34:03 (61722): No heartbeat from core client for 30 sec - exiting 11:34:04 (61722): No heartbeat from core client for 30 sec - exiting 11:34:05 (61722): No heartbeat from core client for 30 sec - exiting 11:34:06 (61722): No heartbeat from core client for 30 sec - exiting 11:34:07 (61722): No heartbeat from core client for 30 sec - exiting 11:34:08 (61722): No heartbeat from core client for 30 sec - exiting 11:34:09 (61722): No heartbeat from core client for 30 sec - exiting 11:34:10 (61722): No heartbeat from core client for 30 sec - exiting 11:34:11 (61722): No heartbeat from core client for 30 sec - exiting 11:34:12 (61722): No heartbeat from core client for 30 sec - exiting 11:34:13 (61722): No heartbeat from core client for 30 sec - exiting 11:34:14 (61722): No heartbeat from core client for 30 sec - exiting 11:34:15 (61722): No heartbeat from core client for 30 sec - exiting 11:49:02 (63047): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:09:05 (63572): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:49:10 (64339): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:49:13 (64339): No heartbeat from core client for 30 sec - exiting 12:49:14 (64339): No heartbeat from core client for 30 sec - exiting 12:49:15 (64339): No heartbeat from core client for 30 sec - exiting 12:49:16 (64339): No heartbeat from core client for 30 sec - exiting 12:49:17 (64339): No heartbeat from core client for 30 sec - exiting 12:49:18 (64339): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:31:29 (65799): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:16:14 (9613): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:12:00 (11468): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:48:58 (62646): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:39:51 (73466): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 04:36:29 (14859): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:21:45 (67029): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:10:33 (69812): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 00:00:43 (77693): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:00:52 (77693): No heartbeat from core client for 30 sec - exiting 00:00:53 (77693): No heartbeat from core client for 30 sec - exiting 00:00:54 (77693): No heartbeat from core client for 30 sec - exiting 00:00:55 (77693): No heartbeat from core client for 30 sec - exiting 00:00:56 (77693): No heartbeat from core client for 30 sec - exiting 00:00:57 (77693): No heartbeat from core client for 30 sec - exiting 00:00:58 (77693): No heartbeat from core client for 30 sec - exiting 00:00:59 (77693): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 06:16:26 (81189): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:22:53 (588): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.7.2 build 11C74 Thu Nov 3 07:23:00 2011 Thread 0 Crashed: Thread 1: Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffcd18 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0xcc1000 - 0xceffff /usr/lib/libSystem.B.dylib 0xcfc000 - 0xd00fff /usr/lib/system/libsystem_network.dylib 0xd07000 - 0xd0efff /usr/lib/system/libsystem_notify.dylib 0x90460000 - 0x90461fff /usr/lib/system/libquarantine.dylib 0x9060b000 - 0x90629fff /usr/lib/system/libsystem_kernel.dylib 0x9131a000 - 0x9131efff /usr/lib/system/libcache.dylib 0x929d0000 - 0x929d7fff /usr/lib/system/libsystem_dnssd.dylib 0x935d3000 - 0x935e9fff /usr/lib/system/libxpc.dylib 0x940bd000 - 0x940befff /usr/lib/system/libremovefile.dylib 0x94549000 - 0x9458cfff /usr/lib/system/libcommonCrypto.dylib 0x948a3000 - 0x948a5fff /usr/lib/system/libdyld.dylib 0x94976000 - 0x94977fff /usr/lib/system/libsystem_blocks.dylib 0x94f54000 - 0x94f62fff /usr/lib/system/libdispatch.dylib 0x95a63000 - 0x95a68fff /usr/lib/system/libmacho.dylib 0x95c84000 - 0x95c87fff /usr/lib/system/libcompiler_rt.dylib 0x969d9000 - 0x969e1fff /usr/lib/system/liblaunch.dylib 0x97dd6000 - 0x97ddefff /usr/lib/system/libunwind.dylib 0x97de4000 - 0x97eaffff /usr/lib/system/libsystem_c.dylib 0x98942000 - 0x98943fff /usr/lib/system/libsystem_sandbox.dylib 0x98b09000 - 0x98b17fff /usr/lib/libz.1.dylib 0x9968d000 - 0x996bcfff /usr/lib/system/libsystem_info.dylib 0x9989e000 - 0x998a1fff /usr/lib/system/libmathCommon.A.dylib 0x9ac8e000 - 0x9ac8ffff /usr/lib/system/libunc.dylib 0x9c4e4000 - 0x9c4e4fff /usr/lib/system/libdnsinfo.dylib 0x9c4e5000 - 0x9c4edfff /usr/lib/system/libcopyfile.dylib 0x9c6da000 - 0x9c6dafff /usr/lib/system/libkeymgr.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1912, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.7.2 build 11C74 Thu Nov 3 07:23:08 2011 Thread 0 Crashed: Thread 1: Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffcd18 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0xcc1000 - 0xceffff /usr/lib/libSystem.B.dylib 0xcfc000 - 0xd00fff /usr/lib/system/libsystem_network.dylib 0xd07000 - 0xd0efff /usr/lib/system/libsystem_notify.dylib 0x90460000 - 0x90461fff /usr/lib/system/libquarantine.dylib 0x9060b000 - 0x90629fff /usr/lib/system/libsystem_kernel.dylib 0x9131a000 - 0x9131efff /usr/lib/system/libcache.dylib 0x929d0000 - 0x929d7fff /usr/lib/system/libsystem_dnssd.dylib 0x935d3000 - 0x935e9fff /usr/lib/system/libxpc.dylib 0x940bd000 - 0x940befff /usr/lib/system/libremovefile.dylib 0x94549000 - 0x9458cfff /usr/lib/system/libcommonCrypto.dylib 0x948a3000 - 0x948a5fff /usr/lib/system/libdyld.dylib 0x94976000 - 0x94977fff /usr/lib/system/libsystem_blocks.dylib 0x94f54000 - 0x94f62fff /usr/lib/system/libdispatch.dylib 0x95a63000 - 0x95a68fff /usr/lib/system/libmacho.dylib 0x95c84000 - 0x95c87fff /usr/lib/system/libcompiler_rt.dylib 0x969d9000 - 0x969e1fff /usr/lib/system/liblaunch.dylib 0x97dd6000 - 0x97ddefff /usr/lib/system/libunwind.dylib 0x97de4000 - 0x97eaffff /usr/lib/system/libsystem_c.dylib 0x98942000 - 0x98943fff /usr/lib/system/libsystem_sandbox.dylib 0x98b09000 - 0x98b17fff /usr/lib/libz.1.dylib 0x9968d000 - 0x996bcfff /usr/lib/system/libsystem_info.dylib 0x9989e000 - 0x998a1fff /usr/lib/system/libmathCommon.A.dylib 0x9ac8e000 - 0x9ac8ffff /usr/lib/system/libunc.dylib 0x9c4e4000 - 0x9c4e4fff /usr/lib/system/libdnsinfo.dylib 0x9c4e5000 - 0x9c4edfff /usr/lib/system/libcopyfile.dylib 0x9c6da000 - 0x9c6dafff /usr/lib/system/libkeymgr.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1912, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.7.2 build 11C74 Thu Nov 3 07:23:11 2011 Thread 0 Crashed: Thread 1: Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffcd18 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0xcc1000 - 0xceffff /usr/lib/libSystem.B.dylib 0xcfc000 - 0xd00fff /usr/lib/system/libsystem_network.dylib 0xd07000 - 0xd0efff /usr/lib/system/libsystem_notify.dylib 0x90460000 - 0x90461fff /usr/lib/system/libquarantine.dylib 0x9060b000 - 0x90629fff /usr/lib/system/libsystem_kernel.dylib 0x9131a000 - 0x9131efff /usr/lib/system/libcache.dylib 0x929d0000 - 0x929d7fff /usr/lib/system/libsystem_dnssd.dylib 0x935d3000 - 0x935e9fff /usr/lib/system/libxpc.dylib 0x940bd000 - 0x940befff /usr/lib/system/libremovefile.dylib 0x94549000 - 0x9458cfff /usr/lib/system/libcommonCrypto.dylib 0x948a3000 - 0x948a5fff /usr/lib/system/libdyld.dylib 0x94976000 - 0x94977fff /usr/lib/system/libsystem_blocks.dylib 0x94f54000 - 0x94f62fff /usr/lib/system/libdispatch.dylib 0x95a63000 - 0x95a68fff /usr/lib/system/libmacho.dylib 0x95c84000 - 0x95c87fff /usr/lib/system/libcompiler_rt.dylib 0x969d9000 - 0x969e1fff /usr/lib/system/liblaunch.dylib 0x97dd6000 - 0x97ddefff /usr/lib/system/libunwind.dylib 0x97de4000 - 0x97eaffff /usr/lib/system/libsystem_c.dylib 0x98942000 - 0x98943fff /usr/lib/system/libsystem_sandbox.dylib 0x98b09000 - 0x98b17fff /usr/lib/libz.1.dylib 0x9968d000 - 0x996bcfff /usr/lib/system/libsystem_info.dylib 0x9989e000 - 0x998a1fff /usr/lib/system/libmathCommon.A.dylib 0x9ac8e000 - 0x9ac8ffff /usr/lib/system/libunc.dylib 0x9c4e4000 - 0x9c4e4fff /usr/lib/system/libdnsinfo.dylib 0x9c4e5000 - 0x9c4edfff /usr/lib/system/libcopyfile.dylib 0x9c6da000 - 0x9c6dafff /usr/lib/system/libkeymgr.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1912, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.7.2 build 11C74 Thu Nov 3 07:23:14 2011 Thread 0 Crashed: Thread 1: Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffcd18 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0xcc1000 - 0xceffff /usr/lib/libSystem.B.dylib 0xcfc000 - 0xd00fff /usr/lib/system/libsystem_network.dylib 0xd07000 - 0xd0efff /usr/lib/system/libsystem_notify.dylib 0x90460000 - 0x90461fff /usr/lib/system/libquarantine.dylib 0x9060b000 - 0x90629fff /usr/lib/system/libsystem_kernel.dylib 0x9131a000 - 0x9131efff /usr/lib/system/libcache.dylib 0x929d0000 - 0x929d7fff /usr/lib/system/libsystem_dnssd.dylib 0x935d3000 - 0x935e9fff /usr/lib/system/libxpc.dylib 0x940bd000 - 0x940befff /usr/lib/system/libremovefile.dylib 0x94549000 - 0x9458cfff /usr/lib/system/libcommonCrypto.dylib 0x948a3000 - 0x948a5fff /usr/lib/system/libdyld.dylib 0x94976000 - 0x94977fff /usr/lib/system/libsystem_blocks.dylib 0x94f54000 - 0x94f62fff /usr/lib/system/libdispatch.dylib 0x95a63000 - 0x95a68fff /usr/lib/system/libmacho.dylib 0x95c84000 - 0x95c87fff /usr/lib/system/libcompiler_rt.dylib 0x969d9000 - 0x969e1fff /usr/lib/system/liblaunch.dylib 0x97dd6000 - 0x97ddefff /usr/lib/system/libunwind.dylib 0x97de4000 - 0x97eaffff /usr/lib/system/libsystem_c.dylib 0x98942000 - 0x98943fff /usr/lib/system/libsystem_sandbox.dylib 0x98b09000 - 0x98b17fff /usr/lib/libz.1.dylib 0x9968d000 - 0x996bcfff /usr/lib/system/libsystem_info.dylib 0x9989e000 - 0x998a1fff /usr/lib/system/libmathCommon.A.dylib 0x9ac8e000 - 0x9ac8ffff /usr/lib/system/libunc.dylib 0x9c4e4000 - 0x9c4e4fff /usr/lib/system/libdnsinfo.dylib 0x9c4e5000 - 0x9c4edfff /usr/lib/system/libcopyfile.dylib 0x9c6da000 - 0x9c6dafff /usr/lib/system/libkeymgr.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1912, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.7.2 build 11C74 Thu Nov 3 07:23:17 2011 Thread 0 Crashed: Thread 1: Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffcd18 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0xcc1000 - 0xceffff /usr/lib/libSystem.B.dylib 0xcfc000 - 0xd00fff /usr/lib/system/libsystem_network.dylib 0xd07000 - 0xd0efff /usr/lib/system/libsystem_notify.dylib 0x90460000 - 0x90461fff /usr/lib/system/libquarantine.dylib 0x9060b000 - 0x90629fff /usr/lib/system/libsystem_kernel.dylib 0x9131a000 - 0x9131efff /usr/lib/system/libcache.dylib 0x929d0000 - 0x929d7fff /usr/lib/system/libsystem_dnssd.dylib 0x935d3000 - 0x935e9fff /usr/lib/system/libxpc.dylib 0x940bd000 - 0x940befff /usr/lib/system/libremovefile.dylib 0x94549000 - 0x9458cfff /usr/lib/system/libcommonCrypto.dylib 0x948a3000 - 0x948a5fff /usr/lib/system/libdyld.dylib 0x94976000 - 0x94977fff /usr/lib/system/libsystem_blocks.dylib 0x94f54000 - 0x94f62fff /usr/lib/system/libdispatch.dylib 0x95a63000 - 0x95a68fff /usr/lib/system/libmacho.dylib 0x95c84000 - 0x95c87fff /usr/lib/system/libcompiler_rt.dylib 0x969d9000 - 0x969e1fff /usr/lib/system/liblaunch.dylib 0x97dd6000 - 0x97ddefff /usr/lib/system/libunwind.dylib 0x97de4000 - 0x97eaffff /usr/lib/system/libsystem_c.dylib 0x98942000 - 0x98943fff /usr/lib/system/libsystem_sandbox.dylib 0x98b09000 - 0x98b17fff /usr/lib/libz.1.dylib 0x9968d000 - 0x996bcfff /usr/lib/system/libsystem_info.dylib 0x9989e000 - 0x998a1fff /usr/lib/system/libmathCommon.A.dylib 0x9ac8e000 - 0x9ac8ffff /usr/lib/system/libunc.dylib 0x9c4e4000 - 0x9c4e4fff /usr/lib/system/libdnsinfo.dylib 0x9c4e5000 - 0x9c4edfff /usr/lib/system/libcopyfile.dylib 0x9c6da000 - 0x9c6dafff /usr/lib/system/libkeymgr.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1912, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.7.2 build 11C74 Thu Nov 3 07:23:21 2011 Thread 0 Crashed: Thread 1: Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffcd18 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0xcc1000 - 0xceffff /usr/lib/libSystem.B.dylib 0xcfc000 - 0xd00fff /usr/lib/system/libsystem_network.dylib 0xd07000 - 0xd0efff /usr/lib/system/libsystem_notify.dylib 0x90460000 - 0x90461fff /usr/lib/system/libquarantine.dylib 0x9060b000 - 0x90629fff /usr/lib/system/libsystem_kernel.dylib 0x9131a000 - 0x9131efff /usr/lib/system/libcache.dylib 0x929d0000 - 0x929d7fff /usr/lib/system/libsystem_dnssd.dylib 0x935d3000 - 0x935e9fff /usr/lib/system/libxpc.dylib 0x940bd000 - 0x940befff /usr/lib/system/libremovefile.dylib 0x94549000 - 0x9458cfff /usr/lib/system/libcommonCrypto.dylib 0x948a3000 - 0x948a5fff /usr/lib/system/libdyld.dylib 0x94976000 - 0x94977fff /usr/lib/system/libsystem_blocks.dylib 0x94f54000 - 0x94f62fff /usr/lib/system/libdispatch.dylib 0x95a63000 - 0x95a68fff /usr/lib/system/libmacho.dylib 0x95c84000 - 0x95c87fff /usr/lib/system/libcompiler_rt.dylib 0x969d9000 - 0x969e1fff /usr/lib/system/liblaunch.dylib 0x97dd6000 - 0x97ddefff /usr/lib/system/libunwind.dylib 0x97de4000 - 0x97eaffff /usr/lib/system/libsystem_c.dylib 0x98942000 - 0x98943fff /usr/lib/system/libsystem_sandbox.dylib 0x98b09000 - 0x98b17fff /usr/lib/libz.1.dylib 0x9968d000 - 0x996bcfff /usr/lib/system/libsystem_info.dylib 0x9989e000 - 0x998a1fff /usr/lib/system/libmathCommon.A.dylib 0x9ac8e000 - 0x9ac8ffff /usr/lib/system/libunc.dylib 0x9c4e4000 - 0x9c4e4fff /usr/lib/system/libdnsinfo.dylib 0x9c4e5000 - 0x9c4edfff /usr/lib/system/libcopyfile.dylib 0x9c6da000 - 0x9c6dafff /usr/lib/system/libkeymgr.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1912, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
01 Nov 2011 14:36:40	1171111	13419338	hadcm3n_t6lt_1940_40_007461875_3	77,760	119,117	1.5319
31 Oct 2011 19:19:14	1171111	13419338	hadcm3n_t6lt_1940_40_007461875_3	51,840	80,647	1.5557
31 Oct 2011 18:25:15	1171111	13419338	hadcm3n_t6lt_1940_40_007461875_3	25,920	40,186	1.5504