Task 19583727

Name	hadcm3n_saj5_198012_480_010221871_1
Workunit	10221871
Created	5 May 2016, 6:23:56 UTC
Sent	5 May 2016, 6:24:34 UTC
Report deadline	17 Apr 2017, 11:44:34 UTC
Received	11 May 2016, 20:39:10 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	859969
Run time	5 days 22 hours 12 min 55 sec
CPU time	4 days 16 hours 51 min 38 sec
Validate state	Invalid
Credit	4,354.56
Device peak FLOPS	3.86 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.6.22</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:08:35 (89728): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:08:37 (89728): No heartbeat from core client for 30 sec - exiting 21:08:38 (89728): No heartbeat from core client for 30 sec - exiting 21:08:39 (89728): No heartbeat from core client for 30 sec - exiting 21:08:40 (89728): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.11.4 build 15E65 Wed May 11 14:37:48 2016 Thread 0 Crashed: Thread 1: Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffccc8 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x90978000 - 0x909dffff /usr/lib/system/libcorecrypto.dylib 0x909ea000 - 0x909ebfff /usr/lib/libSystem.B.dylib 0x91d14000 - 0x91d1dfff /usr/lib/system/libsystem_networkextension.dylib 0x91d1e000 - 0x91d24fff /usr/lib/system/libsystem_platform.dylib 0x91d25000 - 0x91d33fff /usr/lib/libz.1.dylib 0x91e9a000 - 0x91ec2fff /usr/lib/system/libxpc.dylib 0x93c7a000 - 0x93ca4fff /usr/lib/system/libdispatch.dylib 0x93e81000 - 0x93e84fff /usr/lib/system/libdyld.dylib 0x94088000 - 0x94088fff /usr/lib/system/libsystem_blocks.dylib 0x942dd000 - 0x942dffff /usr/lib/system/libsystem_configuration.dylib 0x9451b000 - 0x94534fff /usr/lib/system/libsystem_malloc.dylib 0x95e02000 - 0x95e04fff /usr/lib/system/libsystem_coreservices.dylib 0x9612a000 - 0x9612efff /usr/lib/system/libcache.dylib 0x96133000 - 0x96135fff /usr/lib/system/libsystem_secinit.dylib 0x962f5000 - 0x9638afff /usr/lib/system/libsystem_c.dylib 0x96497000 - 0x964cafff /usr/lib/system/libsystem_m.dylib 0x96776000 - 0x96776fff /usr/lib/system/libkeymgr.dylib 0x96c32000 - 0x96ca0fff /usr/lib/system/libsystem_network.dylib 0x97449000 - 0x9744ffff /usr/lib/system/libunwind.dylib 0x9895e000 - 0x98969fff /usr/lib/system/libcommonCrypto.dylib 0x98c6c000 - 0x98c74fff /usr/lib/system/libsystem_dnssd.dylib 0x98c75000 - 0x98c96fff /usr/lib/system/libsystem_kernel.dylib 0x9915b000 - 0x99160fff /usr/lib/system/libmacho.dylib 0x99268000 - 0x99269fff /usr/lib/system/libremovefile.dylib 0x99348000 - 0x99352fff /usr/lib/system/libsystem_notify.dylib 0x99413000 - 0x99418fff /usr/lib/system/libcompiler_rt.dylib 0x9a3e0000 - 0x9a3f9fff /usr/lib/system/libsystem_asl.dylib 0x9a3fa000 - 0x9a402fff /usr/lib/system/libsystem_pthread.dylib 0x9a563000 - 0x9a56cfff /usr/lib/system/libcopyfile.dylib 0x9a9df000 - 0x9a9dffff /usr/lib/system/libunc.dylib 0x9ca58000 - 0x9ca6ffff /usr/lib/system/libsystem_coretls.dylib 0x9da2c000 - 0x9da56fff /usr/lib/system/libsystem_info.dylib 0x9de14000 - 0x9de16fff /usr/lib/system/libquarantine.dylib 0x9e180000 - 0x9e191fff /usr/lib/system/libsystem_trace.dylib 0x9e7d9000 - 0x9e7dcfff /usr/lib/system/libsystem_sandbox.dylib 0x9ea4a000 - 0x9ea4afff /usr/lib/system/liblaunch.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7429, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.11.4 build 15E65 Wed May 11 14:37:51 2016 Thread 0 Crashed: Thread 1: Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffccc8 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x90978000 - 0x909dffff /usr/lib/system/libcorecrypto.dylib 0x909ea000 - 0x909ebfff /usr/lib/libSystem.B.dylib 0x91d14000 - 0x91d1dfff /usr/lib/system/libsystem_networkextension.dylib 0x91d1e000 - 0x91d24fff /usr/lib/system/libsystem_platform.dylib 0x91d25000 - 0x91d33fff /usr/lib/libz.1.dylib 0x91e9a000 - 0x91ec2fff /usr/lib/system/libxpc.dylib 0x93c7a000 - 0x93ca4fff /usr/lib/system/libdispatch.dylib 0x93e81000 - 0x93e84fff /usr/lib/system/libdyld.dylib 0x94088000 - 0x94088fff /usr/lib/system/libsystem_blocks.dylib 0x942dd000 - 0x942dffff /usr/lib/system/libsystem_configuration.dylib 0x9451b000 - 0x94534fff /usr/lib/system/libsystem_malloc.dylib 0x95e02000 - 0x95e04fff /usr/lib/system/libsystem_coreservices.dylib 0x9612a000 - 0x9612efff /usr/lib/system/libcache.dylib 0x96133000 - 0x96135fff /usr/lib/system/libsystem_secinit.dylib 0x962f5000 - 0x9638afff /usr/lib/system/libsystem_c.dylib 0x96497000 - 0x964cafff /usr/lib/system/libsystem_m.dylib 0x96776000 - 0x96776fff /usr/lib/system/libkeymgr.dylib 0x96c32000 - 0x96ca0fff /usr/lib/system/libsystem_network.dylib 0x97449000 - 0x9744ffff /usr/lib/system/libunwind.dylib 0x9895e000 - 0x98969fff /usr/lib/system/libcommonCrypto.dylib 0x98c6c000 - 0x98c74fff /usr/lib/system/libsystem_dnssd.dylib 0x98c75000 - 0x98c96fff /usr/lib/system/libsystem_kernel.dylib 0x9915b000 - 0x99160fff /usr/lib/system/libmacho.dylib 0x99268000 - 0x99269fff /usr/lib/system/libremovefile.dylib 0x99348000 - 0x99352fff /usr/lib/system/libsystem_notify.dylib 0x99413000 - 0x99418fff /usr/lib/system/libcompiler_rt.dylib 0x9a3e0000 - 0x9a3f9fff /usr/lib/system/libsystem_asl.dylib 0x9a3fa000 - 0x9a402fff /usr/lib/system/libsystem_pthread.dylib 0x9a563000 - 0x9a56cfff /usr/lib/system/libcopyfile.dylib 0x9a9df000 - 0x9a9dffff /usr/lib/system/libunc.dylib 0x9ca58000 - 0x9ca6ffff /usr/lib/system/libsystem_coretls.dylib 0x9da2c000 - 0x9da56fff /usr/lib/system/libsystem_info.dylib 0x9de14000 - 0x9de16fff /usr/lib/system/libquarantine.dylib 0x9e180000 - 0x9e191fff /usr/lib/system/libsystem_trace.dylib 0x9e7d9000 - 0x9e7dcfff /usr/lib/system/libsystem_sandbox.dylib 0x9ea4a000 - 0x9ea4afff /usr/lib/system/liblaunch.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7429, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.11.4 build 15E65 Wed May 11 14:37:53 2016 Thread 0 Crashed: Thread 1: Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffccc8 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x90978000 - 0x909dffff /usr/lib/system/libcorecrypto.dylib 0x909ea000 - 0x909ebfff /usr/lib/libSystem.B.dylib 0x91d14000 - 0x91d1dfff /usr/lib/system/libsystem_networkextension.dylib 0x91d1e000 - 0x91d24fff /usr/lib/system/libsystem_platform.dylib 0x91d25000 - 0x91d33fff /usr/lib/libz.1.dylib 0x91e9a000 - 0x91ec2fff /usr/lib/system/libxpc.dylib 0x93c7a000 - 0x93ca4fff /usr/lib/system/libdispatch.dylib 0x93e81000 - 0x93e84fff /usr/lib/system/libdyld.dylib 0x94088000 - 0x94088fff /usr/lib/system/libsystem_blocks.dylib 0x942dd000 - 0x942dffff /usr/lib/system/libsystem_configuration.dylib 0x9451b000 - 0x94534fff /usr/lib/system/libsystem_malloc.dylib 0x95e02000 - 0x95e04fff /usr/lib/system/libsystem_coreservices.dylib 0x9612a000 - 0x9612efff /usr/lib/system/libcache.dylib 0x96133000 - 0x96135fff /usr/lib/system/libsystem_secinit.dylib 0x962f5000 - 0x9638afff /usr/lib/system/libsystem_c.dylib 0x96497000 - 0x964cafff /usr/lib/system/libsystem_m.dylib 0x96776000 - 0x96776fff /usr/lib/system/libkeymgr.dylib 0x96c32000 - 0x96ca0fff /usr/lib/system/libsystem_network.dylib 0x97449000 - 0x9744ffff /usr/lib/system/libunwind.dylib 0x9895e000 - 0x98969fff /usr/lib/system/libcommonCrypto.dylib 0x98c6c000 - 0x98c74fff /usr/lib/system/libsystem_dnssd.dylib 0x98c75000 - 0x98c96fff /usr/lib/system/libsystem_kernel.dylib 0x9915b000 - 0x99160fff /usr/lib/system/libmacho.dylib 0x99268000 - 0x99269fff /usr/lib/system/libremovefile.dylib 0x99348000 - 0x99352fff /usr/lib/system/libsystem_notify.dylib 0x99413000 - 0x99418fff /usr/lib/system/libcompiler_rt.dylib 0x9a3e0000 - 0x9a3f9fff /usr/lib/system/libsystem_asl.dylib 0x9a3fa000 - 0x9a402fff /usr/lib/system/libsystem_pthread.dylib 0x9a563000 - 0x9a56cfff /usr/lib/system/libcopyfile.dylib 0x9a9df000 - 0x9a9dffff /usr/lib/system/libunc.dylib 0x9ca58000 - 0x9ca6ffff /usr/lib/system/libsystem_coretls.dylib 0x9da2c000 - 0x9da56fff /usr/lib/system/libsystem_info.dylib 0x9de14000 - 0x9de16fff /usr/lib/system/libquarantine.dylib 0x9e180000 - 0x9e191fff /usr/lib/system/libsystem_trace.dylib 0x9e7d9000 - 0x9e7dcfff /usr/lib/system/libsystem_sandbox.dylib 0x9ea4a000 - 0x9ea4afff /usr/lib/system/liblaunch.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7429, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.11.4 build 15E65 Wed May 11 14:37:56 2016 Thread 0 Crashed: Thread 1: Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffccc8 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x90978000 - 0x909dffff /usr/lib/system/libcorecrypto.dylib 0x909ea000 - 0x909ebfff /usr/lib/libSystem.B.dylib 0x91d14000 - 0x91d1dfff /usr/lib/system/libsystem_networkextension.dylib 0x91d1e000 - 0x91d24fff /usr/lib/system/libsystem_platform.dylib 0x91d25000 - 0x91d33fff /usr/lib/libz.1.dylib 0x91e9a000 - 0x91ec2fff /usr/lib/system/libxpc.dylib 0x93c7a000 - 0x93ca4fff /usr/lib/system/libdispatch.dylib 0x93e81000 - 0x93e84fff /usr/lib/system/libdyld.dylib 0x94088000 - 0x94088fff /usr/lib/system/libsystem_blocks.dylib 0x942dd000 - 0x942dffff /usr/lib/system/libsystem_configuration.dylib 0x9451b000 - 0x94534fff /usr/lib/system/libsystem_malloc.dylib 0x95e02000 - 0x95e04fff /usr/lib/system/libsystem_coreservices.dylib 0x9612a000 - 0x9612efff /usr/lib/system/libcache.dylib 0x96133000 - 0x96135fff /usr/lib/system/libsystem_secinit.dylib 0x962f5000 - 0x9638afff /usr/lib/system/libsystem_c.dylib 0x96497000 - 0x964cafff /usr/lib/system/libsystem_m.dylib 0x96776000 - 0x96776fff /usr/lib/system/libkeymgr.dylib 0x96c32000 - 0x96ca0fff /usr/lib/system/libsystem_network.dylib 0x97449000 - 0x9744ffff /usr/lib/system/libunwind.dylib 0x9895e000 - 0x98969fff /usr/lib/system/libcommonCrypto.dylib 0x98c6c000 - 0x98c74fff /usr/lib/system/libsystem_dnssd.dylib 0x98c75000 - 0x98c96fff /usr/lib/system/libsystem_kernel.dylib 0x9915b000 - 0x99160fff /usr/lib/system/libmacho.dylib 0x99268000 - 0x99269fff /usr/lib/system/libremovefile.dylib 0x99348000 - 0x99352fff /usr/lib/system/libsystem_notify.dylib 0x99413000 - 0x99418fff /usr/lib/system/libcompiler_rt.dylib 0x9a3e0000 - 0x9a3f9fff /usr/lib/system/libsystem_asl.dylib 0x9a3fa000 - 0x9a402fff /usr/lib/system/libsystem_pthread.dylib 0x9a563000 - 0x9a56cfff /usr/lib/system/libcopyfile.dylib 0x9a9df000 - 0x9a9dffff /usr/lib/system/libunc.dylib 0x9ca58000 - 0x9ca6ffff /usr/lib/system/libsystem_coretls.dylib 0x9da2c000 - 0x9da56fff /usr/lib/system/libsystem_info.dylib 0x9de14000 - 0x9de16fff /usr/lib/system/libquarantine.dylib 0x9e180000 - 0x9e191fff /usr/lib/system/libsystem_trace.dylib 0x9e7d9000 - 0x9e7dcfff /usr/lib/system/libsystem_sandbox.dylib 0x9ea4a000 - 0x9ea4afff /usr/lib/system/liblaunch.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7429, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.11.4 build 15E65 Wed May 11 14:37:58 2016 Thread 0 Crashed: Thread 1: Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffccc8 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x90978000 - 0x909dffff /usr/lib/system/libcorecrypto.dylib 0x909ea000 - 0x909ebfff /usr/lib/libSystem.B.dylib 0x91d14000 - 0x91d1dfff /usr/lib/system/libsystem_networkextension.dylib 0x91d1e000 - 0x91d24fff /usr/lib/system/libsystem_platform.dylib 0x91d25000 - 0x91d33fff /usr/lib/libz.1.dylib 0x91e9a000 - 0x91ec2fff /usr/lib/system/libxpc.dylib 0x93c7a000 - 0x93ca4fff /usr/lib/system/libdispatch.dylib 0x93e81000 - 0x93e84fff /usr/lib/system/libdyld.dylib 0x94088000 - 0x94088fff /usr/lib/system/libsystem_blocks.dylib 0x942dd000 - 0x942dffff /usr/lib/system/libsystem_configuration.dylib 0x9451b000 - 0x94534fff /usr/lib/system/libsystem_malloc.dylib 0x95e02000 - 0x95e04fff /usr/lib/system/libsystem_coreservices.dylib 0x9612a000 - 0x9612efff /usr/lib/system/libcache.dylib 0x96133000 - 0x96135fff /usr/lib/system/libsystem_secinit.dylib 0x962f5000 - 0x9638afff /usr/lib/system/libsystem_c.dylib 0x96497000 - 0x964cafff /usr/lib/system/libsystem_m.dylib 0x96776000 - 0x96776fff /usr/lib/system/libkeymgr.dylib 0x96c32000 - 0x96ca0fff /usr/lib/system/libsystem_network.dylib 0x97449000 - 0x9744ffff /usr/lib/system/libunwind.dylib 0x9895e000 - 0x98969fff /usr/lib/system/libcommonCrypto.dylib 0x98c6c000 - 0x98c74fff /usr/lib/system/libsystem_dnssd.dylib 0x98c75000 - 0x98c96fff /usr/lib/system/libsystem_kernel.dylib 0x9915b000 - 0x99160fff /usr/lib/system/libmacho.dylib 0x99268000 - 0x99269fff /usr/lib/system/libremovefile.dylib 0x99348000 - 0x99352fff /usr/lib/system/libsystem_notify.dylib 0x99413000 - 0x99418fff /usr/lib/system/libcompiler_rt.dylib 0x9a3e0000 - 0x9a3f9fff /usr/lib/system/libsystem_asl.dylib 0x9a3fa000 - 0x9a402fff /usr/lib/system/libsystem_pthread.dylib 0x9a563000 - 0x9a56cfff /usr/lib/system/libcopyfile.dylib 0x9a9df000 - 0x9a9dffff /usr/lib/system/libunc.dylib 0x9ca58000 - 0x9ca6ffff /usr/lib/system/libsystem_coretls.dylib 0x9da2c000 - 0x9da56fff /usr/lib/system/libsystem_info.dylib 0x9de14000 - 0x9de16fff /usr/lib/system/libquarantine.dylib 0x9e180000 - 0x9e191fff /usr/lib/system/libsystem_trace.dylib 0x9e7d9000 - 0x9e7dcfff /usr/lib/system/libsystem_sandbox.dylib 0x9ea4a000 - 0x9ea4afff /usr/lib/system/liblaunch.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7429, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.11.4 build 15E65 Wed May 11 14:38:01 2016 Thread 0 Crashed: Thread 1: Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffccc8 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x90978000 - 0x909dffff /usr/lib/system/libcorecrypto.dylib 0x909ea000 - 0x909ebfff /usr/lib/libSystem.B.dylib 0x91d14000 - 0x91d1dfff /usr/lib/system/libsystem_networkextension.dylib 0x91d1e000 - 0x91d24fff /usr/lib/system/libsystem_platform.dylib 0x91d25000 - 0x91d33fff /usr/lib/libz.1.dylib 0x91e9a000 - 0x91ec2fff /usr/lib/system/libxpc.dylib 0x93c7a000 - 0x93ca4fff /usr/lib/system/libdispatch.dylib 0x93e81000 - 0x93e84fff /usr/lib/system/libdyld.dylib 0x94088000 - 0x94088fff /usr/lib/system/libsystem_blocks.dylib 0x942dd000 - 0x942dffff /usr/lib/system/libsystem_configuration.dylib 0x9451b000 - 0x94534fff /usr/lib/system/libsystem_malloc.dylib 0x95e02000 - 0x95e04fff /usr/lib/system/libsystem_coreservices.dylib 0x9612a000 - 0x9612efff /usr/lib/system/libcache.dylib 0x96133000 - 0x96135fff /usr/lib/system/libsystem_secinit.dylib 0x962f5000 - 0x9638afff /usr/lib/system/libsystem_c.dylib 0x96497000 - 0x964cafff /usr/lib/system/libsystem_m.dylib 0x96776000 - 0x96776fff /usr/lib/system/libkeymgr.dylib 0x96c32000 - 0x96ca0fff /usr/lib/system/libsystem_network.dylib 0x97449000 - 0x9744ffff /usr/lib/system/libunwind.dylib 0x9895e000 - 0x98969fff /usr/lib/system/libcommonCrypto.dylib 0x98c6c000 - 0x98c74fff /usr/lib/system/libsystem_dnssd.dylib 0x98c75000 - 0x98c96fff /usr/lib/system/libsystem_kernel.dylib 0x9915b000 - 0x99160fff /usr/lib/system/libmacho.dylib 0x99268000 - 0x99269fff /usr/lib/system/libremovefile.dylib 0x99348000 - 0x99352fff /usr/lib/system/libsystem_notify.dylib 0x99413000 - 0x99418fff /usr/lib/system/libcompiler_rt.dylib 0x9a3e0000 - 0x9a3f9fff /usr/lib/system/libsystem_asl.dylib 0x9a3fa000 - 0x9a402fff /usr/lib/system/libsystem_pthread.dylib 0x9a563000 - 0x9a56cfff /usr/lib/system/libcopyfile.dylib 0x9a9df000 - 0x9a9dffff /usr/lib/system/libunc.dylib 0x9ca58000 - 0x9ca6ffff /usr/lib/system/libsystem_coretls.dylib 0x9da2c000 - 0x9da56fff /usr/lib/system/libsystem_info.dylib 0x9de14000 - 0x9de16fff /usr/lib/system/libquarantine.dylib 0x9e180000 - 0x9e191fff /usr/lib/system/libsystem_trace.dylib 0x9e7d9000 - 0x9e7dcfff /usr/lib/system/libsystem_sandbox.dylib 0x9ea4a000 - 0x9ea4afff /usr/lib/system/liblaunch.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7429, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
11 May 2016 09:22:35	859969	19583727	hadcm3n_saj5_198012_480_010221871_1	362,880	391,550	1.0790
10 May 2016 22:59:47	859969	19583727	hadcm3n_saj5_198012_480_010221871_1	336,960	363,230	1.0780
10 May 2016 08:53:02	859969	19583727	hadcm3n_saj5_198012_480_010221871_1	311,040	335,371	1.0782
09 May 2016 22:45:48	859969	19583727	hadcm3n_saj5_198012_480_010221871_1	285,120	307,419	1.0782
09 May 2016 15:37:29	859969	19583727	hadcm3n_saj5_198012_480_010221871_1	259,200	279,453	1.0781
09 May 2016 04:54:17	859969	19583727	hadcm3n_saj5_198012_480_010221871_1	233,280	251,399	1.0777
08 May 2016 18:03:32	859969	19583727	hadcm3n_saj5_198012_480_010221871_1	207,360	223,695	1.0788
08 May 2016 09:08:59	859969	19583727	hadcm3n_saj5_198012_480_010221871_1	181,440	196,048	1.0805
08 May 2016 01:09:18	859969	19583727	hadcm3n_saj5_198012_480_010221871_1	155,520	168,290	1.0821
07 May 2016 14:52:34	859969	19583727	hadcm3n_saj5_198012_480_010221871_1	129,600	140,401	1.0833
07 May 2016 02:17:43	859969	19583727	hadcm3n_saj5_198012_480_010221871_1	103,680	112,113	1.0813
06 May 2016 16:33:09	859969	19583727	hadcm3n_saj5_198012_480_010221871_1	77,760	83,914	1.0791
06 May 2016 06:36:38	859969	19583727	hadcm3n_saj5_198012_480_010221871_1	51,840	56,091	1.0820
05 May 2016 23:40:51	859969	19583727	hadcm3n_saj5_198012_480_010221871_1	25,920	28,051	1.0822