Task 15847588

Name	hadcm3n_4n2u_1940_40_008304909_2
Workunit	8456044
Created	18 Jun 2013, 12:35:30 UTC
Sent	18 Jun 2013, 13:09:17 UTC
Report deadline	17 Sep 2013, 20:36:28 UTC
Received	5 Jul 2013, 7:07:54 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1110299
Run time	16 days 2 hours 45 min 4 sec
CPU time	12 days 20 hours 46 min 8 sec
Validate state	Invalid
Credit	5,598.72
Device peak FLOPS	2.93 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.0.65</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... 12:42:15 (71957): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:21:43 (82201): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:46:44 (83872): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:48:08 (86293): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:48:10 (86293): No heartbeat from core client for 30 sec - exiting 13:59:09 (87345): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:09:11 (7155): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:47:23 (38071): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:24:31 (57505): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:30:42 (77123): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:27:32 (82568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:36:06 (19451): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 12:47:14 (441): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:48:36 (1914): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:48:37 (1914): No heartbeat from core client for 30 sec - exiting 13:48:38 (1914): No heartbeat from core client for 30 sec - exiting 13:48:39 (1914): No heartbeat from core client for 30 sec - exiting 13:48:40 (1914): No heartbeat from core client for 30 sec - exiting 13:48:41 (1914): No heartbeat from core client for 30 sec - exiting 13:48:42 (1914): No heartbeat from core client for 30 sec - exiting 14:00:49 (3267): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:39:06 (3541): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:58:59 (15440): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:07:09 (25162): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.7.5 build 11G63 Fri Jul 5 07:07:34 2013 Thread 0 Crashed: Thread 1: Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffccc8 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x9026c000 - 0x9026ffff /usr/lib/system/libmathCommon.A.dylib 0x9038d000 - 0x903abfff /usr/lib/system/libsystem_kernel.dylib 0x90463000 - 0x90491fff /usr/lib/libSystem.B.dylib 0x90b16000 - 0x90b1bfff /usr/lib/system/libmacho.dylib 0x911af000 - 0x911b0fff /usr/lib/system/libremovefile.dylib 0x91ec6000 - 0x91ecafff /usr/lib/system/libsystem_network.dylib 0x926ee000 - 0x926fcfff /usr/lib/libz.1.dylib 0x93163000 - 0x93163fff /usr/lib/system/libkeymgr.dylib 0x93b82000 - 0x93b8afff /usr/lib/system/liblaunch.dylib 0x93ffb000 - 0x93ffefff /usr/lib/system/libcompiler_rt.dylib 0x94003000 - 0x94007fff /usr/lib/system/libcache.dylib 0x9459a000 - 0x9459bfff /usr/lib/system/libunc.dylib 0x96c1d000 - 0x96c33fff /usr/lib/system/libxpc.dylib 0x97e9a000 - 0x97eddfff /usr/lib/system/libcommonCrypto.dylib 0x9936e000 - 0x9939dfff /usr/lib/system/libsystem_info.dylib 0x9939e000 - 0x993a6fff /usr/lib/system/libcopyfile.dylib 0x9942d000 - 0x99434fff /usr/lib/system/libsystem_dnssd.dylib 0x99bae000 - 0x99bb6fff /usr/lib/system/libunwind.dylib 0x99d0e000 - 0x99d0efff /usr/lib/system/libdnsinfo.dylib 0x9a0bd000 - 0x9a0c4fff /usr/lib/system/libsystem_notify.dylib 0x9a5f8000 - 0x9a6c3fff /usr/lib/system/libsystem_c.dylib 0x9a6e6000 - 0x9a6f4fff /usr/lib/system/libdispatch.dylib 0x9aaae000 - 0x9aaaffff /usr/lib/system/libquarantine.dylib 0x9ae06000 - 0x9ae08fff /usr/lib/system/libdyld.dylib 0x9b0e0000 - 0x9b0e1fff /usr/lib/system/libsystem_blocks.dylib 0x9b0e2000 - 0x9b0e3fff /usr/lib/system/libsystem_sandbox.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=27401, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.7.5 build 11G63 Fri Jul 5 07:07:38 2013 Thread 0 Crashed: Thread 1: Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffccc8 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x9026c000 - 0x9026ffff /usr/lib/system/libmathCommon.A.dylib 0x9038d000 - 0x903abfff /usr/lib/system/libsystem_kernel.dylib 0x90463000 - 0x90491fff /usr/lib/libSystem.B.dylib 0x90b16000 - 0x90b1bfff /usr/lib/system/libmacho.dylib 0x911af000 - 0x911b0fff /usr/lib/system/libremovefile.dylib 0x91ec6000 - 0x91ecafff /usr/lib/system/libsystem_network.dylib 0x926ee000 - 0x926fcfff /usr/lib/libz.1.dylib 0x93163000 - 0x93163fff /usr/lib/system/libkeymgr.dylib 0x93b82000 - 0x93b8afff /usr/lib/system/liblaunch.dylib 0x93ffb000 - 0x93ffefff /usr/lib/system/libcompiler_rt.dylib 0x94003000 - 0x94007fff /usr/lib/system/libcache.dylib 0x9459a000 - 0x9459bfff /usr/lib/system/libunc.dylib 0x96c1d000 - 0x96c33fff /usr/lib/system/libxpc.dylib 0x97e9a000 - 0x97eddfff /usr/lib/system/libcommonCrypto.dylib 0x9936e000 - 0x9939dfff /usr/lib/system/libsystem_info.dylib 0x9939e000 - 0x993a6fff /usr/lib/system/libcopyfile.dylib 0x9942d000 - 0x99434fff /usr/lib/system/libsystem_dnssd.dylib 0x99bae000 - 0x99bb6fff /usr/lib/system/libunwind.dylib 0x99d0e000 - 0x99d0efff /usr/lib/system/libdnsinfo.dylib 0x9a0bd000 - 0x9a0c4fff /usr/lib/system/libsystem_notify.dylib 0x9a5f8000 - 0x9a6c3fff /usr/lib/system/libsystem_c.dylib 0x9a6e6000 - 0x9a6f4fff /usr/lib/system/libdispatch.dylib 0x9aaae000 - 0x9aaaffff /usr/lib/system/libquarantine.dylib 0x9ae06000 - 0x9ae08fff /usr/lib/system/libdyld.dylib 0x9b0e0000 - 0x9b0e1fff /usr/lib/system/libsystem_blocks.dylib 0x9b0e2000 - 0x9b0e3fff /usr/lib/system/libsystem_sandbox.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=27401, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.7.5 build 11G63 Fri Jul 5 07:07:41 2013 Thread 0 Crashed: Thread 1: Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffccc8 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x9026c000 - 0x9026ffff /usr/lib/system/libmathCommon.A.dylib 0x9038d000 - 0x903abfff /usr/lib/system/libsystem_kernel.dylib 0x90463000 - 0x90491fff /usr/lib/libSystem.B.dylib 0x90b16000 - 0x90b1bfff /usr/lib/system/libmacho.dylib 0x911af000 - 0x911b0fff /usr/lib/system/libremovefile.dylib 0x91ec6000 - 0x91ecafff /usr/lib/system/libsystem_network.dylib 0x926ee000 - 0x926fcfff /usr/lib/libz.1.dylib 0x93163000 - 0x93163fff /usr/lib/system/libkeymgr.dylib 0x93b82000 - 0x93b8afff /usr/lib/system/liblaunch.dylib 0x93ffb000 - 0x93ffefff /usr/lib/system/libcompiler_rt.dylib 0x94003000 - 0x94007fff /usr/lib/system/libcache.dylib 0x9459a000 - 0x9459bfff /usr/lib/system/libunc.dylib 0x96c1d000 - 0x96c33fff /usr/lib/system/libxpc.dylib 0x97e9a000 - 0x97eddfff /usr/lib/system/libcommonCrypto.dylib 0x9936e000 - 0x9939dfff /usr/lib/system/libsystem_info.dylib 0x9939e000 - 0x993a6fff /usr/lib/system/libcopyfile.dylib 0x9942d000 - 0x99434fff /usr/lib/system/libsystem_dnssd.dylib 0x99bae000 - 0x99bb6fff /usr/lib/system/libunwind.dylib 0x99d0e000 - 0x99d0efff /usr/lib/system/libdnsinfo.dylib 0x9a0bd000 - 0x9a0c4fff /usr/lib/system/libsystem_notify.dylib 0x9a5f8000 - 0x9a6c3fff /usr/lib/system/libsystem_c.dylib 0x9a6e6000 - 0x9a6f4fff /usr/lib/system/libdispatch.dylib 0x9aaae000 - 0x9aaaffff /usr/lib/system/libquarantine.dylib 0x9ae06000 - 0x9ae08fff /usr/lib/system/libdyld.dylib 0x9b0e0000 - 0x9b0e1fff /usr/lib/system/libsystem_blocks.dylib 0x9b0e2000 - 0x9b0e3fff /usr/lib/system/libsystem_sandbox.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=27401, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.7.5 build 11G63 Fri Jul 5 07:07:44 2013 Thread 0 Crashed: Thread 1: Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffccc8 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x9026c000 - 0x9026ffff /usr/lib/system/libmathCommon.A.dylib 0x9038d000 - 0x903abfff /usr/lib/system/libsystem_kernel.dylib 0x90463000 - 0x90491fff /usr/lib/libSystem.B.dylib 0x90b16000 - 0x90b1bfff /usr/lib/system/libmacho.dylib 0x911af000 - 0x911b0fff /usr/lib/system/libremovefile.dylib 0x91ec6000 - 0x91ecafff /usr/lib/system/libsystem_network.dylib 0x926ee000 - 0x926fcfff /usr/lib/libz.1.dylib 0x93163000 - 0x93163fff /usr/lib/system/libkeymgr.dylib 0x93b82000 - 0x93b8afff /usr/lib/system/liblaunch.dylib 0x93ffb000 - 0x93ffefff /usr/lib/system/libcompiler_rt.dylib 0x94003000 - 0x94007fff /usr/lib/system/libcache.dylib 0x9459a000 - 0x9459bfff /usr/lib/system/libunc.dylib 0x96c1d000 - 0x96c33fff /usr/lib/system/libxpc.dylib 0x97e9a000 - 0x97eddfff /usr/lib/system/libcommonCrypto.dylib 0x9936e000 - 0x9939dfff /usr/lib/system/libsystem_info.dylib 0x9939e000 - 0x993a6fff /usr/lib/system/libcopyfile.dylib 0x9942d000 - 0x99434fff /usr/lib/system/libsystem_dnssd.dylib 0x99bae000 - 0x99bb6fff /usr/lib/system/libunwind.dylib 0x99d0e000 - 0x99d0efff /usr/lib/system/libdnsinfo.dylib 0x9a0bd000 - 0x9a0c4fff /usr/lib/system/libsystem_notify.dylib 0x9a5f8000 - 0x9a6c3fff /usr/lib/system/libsystem_c.dylib 0x9a6e6000 - 0x9a6f4fff /usr/lib/system/libdispatch.dylib 0x9aaae000 - 0x9aaaffff /usr/lib/system/libquarantine.dylib 0x9ae06000 - 0x9ae08fff /usr/lib/system/libdyld.dylib 0x9b0e0000 - 0x9b0e1fff /usr/lib/system/libsystem_blocks.dylib 0x9b0e2000 - 0x9b0e3fff /usr/lib/system/libsystem_sandbox.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=27401, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.7.5 build 11G63 Fri Jul 5 07:07:47 2013 Thread 0 Crashed: Thread 1: Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffccc8 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x9026c000 - 0x9026ffff /usr/lib/system/libmathCommon.A.dylib 0x9038d000 - 0x903abfff /usr/lib/system/libsystem_kernel.dylib 0x90463000 - 0x90491fff /usr/lib/libSystem.B.dylib 0x90b16000 - 0x90b1bfff /usr/lib/system/libmacho.dylib 0x911af000 - 0x911b0fff /usr/lib/system/libremovefile.dylib 0x91ec6000 - 0x91ecafff /usr/lib/system/libsystem_network.dylib 0x926ee000 - 0x926fcfff /usr/lib/libz.1.dylib 0x93163000 - 0x93163fff /usr/lib/system/libkeymgr.dylib 0x93b82000 - 0x93b8afff /usr/lib/system/liblaunch.dylib 0x93ffb000 - 0x93ffefff /usr/lib/system/libcompiler_rt.dylib 0x94003000 - 0x94007fff /usr/lib/system/libcache.dylib 0x9459a000 - 0x9459bfff /usr/lib/system/libunc.dylib 0x96c1d000 - 0x96c33fff /usr/lib/system/libxpc.dylib 0x97e9a000 - 0x97eddfff /usr/lib/system/libcommonCrypto.dylib 0x9936e000 - 0x9939dfff /usr/lib/system/libsystem_info.dylib 0x9939e000 - 0x993a6fff /usr/lib/system/libcopyfile.dylib 0x9942d000 - 0x99434fff /usr/lib/system/libsystem_dnssd.dylib 0x99bae000 - 0x99bb6fff /usr/lib/system/libunwind.dylib 0x99d0e000 - 0x99d0efff /usr/lib/system/libdnsinfo.dylib 0x9a0bd000 - 0x9a0c4fff /usr/lib/system/libsystem_notify.dylib 0x9a5f8000 - 0x9a6c3fff /usr/lib/system/libsystem_c.dylib 0x9a6e6000 - 0x9a6f4fff /usr/lib/system/libdispatch.dylib 0x9aaae000 - 0x9aaaffff /usr/lib/system/libquarantine.dylib 0x9ae06000 - 0x9ae08fff /usr/lib/system/libdyld.dylib 0x9b0e0000 - 0x9b0e1fff /usr/lib/system/libsystem_blocks.dylib 0x9b0e2000 - 0x9b0e3fff /usr/lib/system/libsystem_sandbox.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=27401, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.7.5 build 11G63 Fri Jul 5 07:07:49 2013 Thread 0 Crashed: Thread 1: Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffccc8 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x9026c000 - 0x9026ffff /usr/lib/system/libmathCommon.A.dylib 0x9038d000 - 0x903abfff /usr/lib/system/libsystem_kernel.dylib 0x90463000 - 0x90491fff /usr/lib/libSystem.B.dylib 0x90b16000 - 0x90b1bfff /usr/lib/system/libmacho.dylib 0x911af000 - 0x911b0fff /usr/lib/system/libremovefile.dylib 0x91ec6000 - 0x91ecafff /usr/lib/system/libsystem_network.dylib 0x926ee000 - 0x926fcfff /usr/lib/libz.1.dylib 0x93163000 - 0x93163fff /usr/lib/system/libkeymgr.dylib 0x93b82000 - 0x93b8afff /usr/lib/system/liblaunch.dylib 0x93ffb000 - 0x93ffefff /usr/lib/system/libcompiler_rt.dylib 0x94003000 - 0x94007fff /usr/lib/system/libcache.dylib 0x9459a000 - 0x9459bfff /usr/lib/system/libunc.dylib 0x96c1d000 - 0x96c33fff /usr/lib/system/libxpc.dylib 0x97e9a000 - 0x97eddfff /usr/lib/system/libcommonCrypto.dylib 0x9936e000 - 0x9939dfff /usr/lib/system/libsystem_info.dylib 0x9939e000 - 0x993a6fff /usr/lib/system/libcopyfile.dylib 0x9942d000 - 0x99434fff /usr/lib/system/libsystem_dnssd.dylib 0x99bae000 - 0x99bb6fff /usr/lib/system/libunwind.dylib 0x99d0e000 - 0x99d0efff /usr/lib/system/libdnsinfo.dylib 0x9a0bd000 - 0x9a0c4fff /usr/lib/system/libsystem_notify.dylib 0x9a5f8000 - 0x9a6c3fff /usr/lib/system/libsystem_c.dylib 0x9a6e6000 - 0x9a6f4fff /usr/lib/system/libdispatch.dylib 0x9aaae000 - 0x9aaaffff /usr/lib/system/libquarantine.dylib 0x9ae06000 - 0x9ae08fff /usr/lib/system/libdyld.dylib 0x9b0e0000 - 0x9b0e1fff /usr/lib/system/libsystem_blocks.dylib 0x9b0e2000 - 0x9b0e3fff /usr/lib/system/libsystem_sandbox.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=27401, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
04 Jul 2013 14:28:19	1110299	15847588	hadcm3n_4n2u_1940_40_008304909_2	466,560	1,069,384	2.2921
03 Jul 2013 15:13:41	1110299	15847588	hadcm3n_4n2u_1940_40_008304909_2	440,640	1,011,036	2.2945
02 Jul 2013 19:25:08	1110299	15847588	hadcm3n_4n2u_1940_40_008304909_2	414,720	951,772	2.2950
02 Jul 2013 11:57:16	1110299	15847588	hadcm3n_4n2u_1940_40_008304909_2	388,800	892,068	2.2944
02 Jul 2013 11:07:22	1110299	15847588	hadcm3n_4n2u_1940_40_008304909_2	362,880	832,542	2.2943
02 Jul 2013 10:29:16	1110299	15847588	hadcm3n_4n2u_1940_40_008304909_2	336,960	772,581	2.2928
02 Jul 2013 10:00:41	1110299	15847588	hadcm3n_4n2u_1940_40_008304909_2	311,040	711,236	2.2866
28 Jun 2013 10:59:25	1110299	15847588	hadcm3n_4n2u_1940_40_008304909_2	285,120	650,968	2.2831
27 Jun 2013 13:31:00	1110299	15847588	hadcm3n_4n2u_1940_40_008304909_2	259,200	591,998	2.2839
26 Jun 2013 16:48:57	1110299	15847588	hadcm3n_4n2u_1940_40_008304909_2	233,280	532,452	2.2825
25 Jun 2013 19:54:53	1110299	15847588	hadcm3n_4n2u_1940_40_008304909_2	207,360	473,698	2.2844
24 Jun 2013 23:41:37	1110299	15847588	hadcm3n_4n2u_1940_40_008304909_2	181,440	413,421	2.2786
24 Jun 2013 02:47:16	1110299	15847588	hadcm3n_4n2u_1940_40_008304909_2	155,520	353,990	2.2762
23 Jun 2013 07:06:00	1110299	15847588	hadcm3n_4n2u_1940_40_008304909_2	129,600	294,290	2.2708
22 Jun 2013 11:32:30	1110299	15847588	hadcm3n_4n2u_1940_40_008304909_2	103,680	233,645	2.2535
21 Jun 2013 13:46:19	1110299	15847588	hadcm3n_4n2u_1940_40_008304909_2	77,760	174,559	2.2448
20 Jun 2013 14:45:45	1110299	15847588	hadcm3n_4n2u_1940_40_008304909_2	51,840	117,925	2.2748
19 Jun 2013 18:14:10	1110299	15847588	hadcm3n_4n2u_1940_40_008304909_2	25,920	56,768	2.1901