Task 16063061

Name	hadcm3n_o8ie_1900_40_008466153_2
Workunit	8616992
Created	9 Oct 2013, 14:32:40 UTC
Sent	9 Oct 2013, 14:51:49 UTC
Report deadline	8 Jan 2014, 22:19:00 UTC
Received	27 Oct 2013, 6:18:53 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1229712
Run time	5 days 22 hours 37 min 13 sec
CPU time	4 days 16 hours 58 min 5 sec
Validate state	Invalid
Credit	4,043.52
Device peak FLOPS	3.74 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.0.65</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> dyld: DYLD_ environment variables being ignored because main executable (/Volumes/Ananke HD/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(36658,0xa0d7e1a8) malloc: * error for object 0x3216804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(36658,0xa0d7e1a8) malloc: * error for object 0x3217604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(36658,0xa0d7e1a8) malloc: * error for object 0x3217600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(36658,0xa0d7e1a8) malloc: * error for object 0x2a09c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(36658,0xa0d7e1a8) malloc: * error for object 0x2a09c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(36658,0xa0d7e1a8) malloc: * error for object 0x2a09c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(46684,0xa0d7e1a8) malloc: * error for object 0x4ace004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(46684,0xa0d7e1a8) malloc: * error for object 0x4ace000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(46684,0xa0d7e1a8) malloc: * error for object 0xacac04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(6542,0xa0d7e1a8) malloc: * error for object 0x1a0aa04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(6542,0xa0d7e1a8) malloc: * error for object 0x1a0aa00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.9 build 13A603 Sun Oct 27 01:27:15 2013 Thread 0 Crashed: Thread 1: -- Warning: /usr/bin/atos is moving and will be removed from a future OS X release. It is now available in the Xcode developer tools to be invoked via: `xcrun atos` To silence this warning, pass the '-d' command-line flag to this tool. -- Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffcd28 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Volumes/Ananke HD/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x90008000 - 0x90009fff /usr/lib/system/libunc.dylib 0x90590000 - 0x905b4fff /usr/lib/system/libxpc.dylib 0x905b5000 - 0x905bdfff /usr/lib/system/libcopyfile.dylib 0x90621000 - 0x90624fff /usr/lib/system/libdyld.dylib 0x91123000 - 0x9113bfff /usr/lib/system/libsystem_malloc.dylib 0x9114d000 - 0x9114efff /usr/lib/system/libsystem_blocks.dylib 0x91414000 - 0x9142cfff /usr/lib/system/libdispatch.dylib 0x92b8f000 - 0x92ba1fff /usr/lib/system/libsystem_asl.dylib 0x93104000 - 0x93196fff /usr/lib/system/libsystem_c.dylib 0x932e8000 - 0x932eafff /usr/lib/system/libquarantine.dylib 0x9461a000 - 0x9461cfff /usr/lib/system/libsystem_configuration.dylib 0x946e9000 - 0x946eafff /usr/lib/system/libsystem_sandbox.dylib 0x946eb000 - 0x946ebfff /usr/lib/system/libkeymgr.dylib 0x96146000 - 0x9614cfff /usr/lib/system/libunwind.dylib 0x962c8000 - 0x962c9fff /usr/lib/system/libremovefile.dylib 0x96eac000 - 0x96eb7fff /usr/lib/system/libcommonCrypto.dylib 0x9708a000 - 0x970a7fff /usr/lib/system/libsystem_kernel.dylib 0x973e9000 - 0x973edfff /usr/lib/system/libcache.dylib 0x981ff000 - 0x9822afff /usr/lib/system/libsystem_network.dylib 0x98a85000 - 0x98a89fff /usr/lib/system/libmacho.dylib 0x98c41000 - 0x98c49fff /usr/lib/system/libsystem_dnssd.dylib 0x990c8000 - 0x990f9fff /usr/lib/system/libsystem_m.dylib 0x99654000 - 0x9965bfff /usr/lib/system/libsystem_pthread.dylib 0x99766000 - 0x9976ffff /usr/lib/system/libsystem_notify.dylib 0x99b92000 - 0x99b93fff /usr/lib/libSystem.B.dylib 0x99fdc000 - 0x9a004fff /usr/lib/system/libsystem_info.dylib 0x9a723000 - 0x9a773fff /usr/lib/system/libcorecrypto.dylib 0x9aeb1000 - 0x9aeb9fff /usr/lib/system/liblaunch.dylib 0x9b102000 - 0x9b107fff /usr/lib/system/libcompiler_rt.dylib 0x9b228000 - 0x9b22dfff /usr/lib/system/libsystem_platform.dylib 0x9b527000 - 0x9b535fff /usr/lib/libz.1.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=15889, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.9 build 13A603 Sun Oct 27 01:27:17 2013 Thread 0 Crashed: Thread 1: -- Warning: /usr/bin/atos is moving and will be removed from a future OS X release. It is now available in the Xcode developer tools to be invoked via: `xcrun atos` To silence this warning, pass the '-d' command-line flag to this tool. -- Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffcd28 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Volumes/Ananke HD/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x90008000 - 0x90009fff /usr/lib/system/libunc.dylib 0x90590000 - 0x905b4fff /usr/lib/system/libxpc.dylib 0x905b5000 - 0x905bdfff /usr/lib/system/libcopyfile.dylib 0x90621000 - 0x90624fff /usr/lib/system/libdyld.dylib 0x91123000 - 0x9113bfff /usr/lib/system/libsystem_malloc.dylib 0x9114d000 - 0x9114efff /usr/lib/system/libsystem_blocks.dylib 0x91414000 - 0x9142cfff /usr/lib/system/libdispatch.dylib 0x92b8f000 - 0x92ba1fff /usr/lib/system/libsystem_asl.dylib 0x93104000 - 0x93196fff /usr/lib/system/libsystem_c.dylib 0x932e8000 - 0x932eafff /usr/lib/system/libquarantine.dylib 0x9461a000 - 0x9461cfff /usr/lib/system/libsystem_configuration.dylib 0x946e9000 - 0x946eafff /usr/lib/system/libsystem_sandbox.dylib 0x946eb000 - 0x946ebfff /usr/lib/system/libkeymgr.dylib 0x96146000 - 0x9614cfff /usr/lib/system/libunwind.dylib 0x962c8000 - 0x962c9fff /usr/lib/system/libremovefile.dylib 0x96eac000 - 0x96eb7fff /usr/lib/system/libcommonCrypto.dylib 0x9708a000 - 0x970a7fff /usr/lib/system/libsystem_kernel.dylib 0x973e9000 - 0x973edfff /usr/lib/system/libcache.dylib 0x981ff000 - 0x9822afff /usr/lib/system/libsystem_network.dylib 0x98a85000 - 0x98a89fff /usr/lib/system/libmacho.dylib 0x98c41000 - 0x98c49fff /usr/lib/system/libsystem_dnssd.dylib 0x990c8000 - 0x990f9fff /usr/lib/system/libsystem_m.dylib 0x99654000 - 0x9965bfff /usr/lib/system/libsystem_pthread.dylib 0x99766000 - 0x9976ffff /usr/lib/system/libsystem_notify.dylib 0x99b92000 - 0x99b93fff /usr/lib/libSystem.B.dylib 0x99fdc000 - 0x9a004fff /usr/lib/system/libsystem_info.dylib 0x9a723000 - 0x9a773fff /usr/lib/system/libcorecrypto.dylib 0x9aeb1000 - 0x9aeb9fff /usr/lib/system/liblaunch.dylib 0x9b102000 - 0x9b107fff /usr/lib/system/libcompiler_rt.dylib 0x9b228000 - 0x9b22dfff /usr/lib/system/libsystem_platform.dylib 0x9b527000 - 0x9b535fff /usr/lib/libz.1.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=15889, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.9 build 13A603 Sun Oct 27 01:27:20 2013 Thread 0 Crashed: Thread 1: -- Warning: /usr/bin/atos is moving and will be removed from a future OS X release. It is now available in the Xcode developer tools to be invoked via: `xcrun atos` To silence this warning, pass the '-d' command-line flag to this tool. -- Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffcd28 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Volumes/Ananke HD/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x90008000 - 0x90009fff /usr/lib/system/libunc.dylib 0x90590000 - 0x905b4fff /usr/lib/system/libxpc.dylib 0x905b5000 - 0x905bdfff /usr/lib/system/libcopyfile.dylib 0x90621000 - 0x90624fff /usr/lib/system/libdyld.dylib 0x91123000 - 0x9113bfff /usr/lib/system/libsystem_malloc.dylib 0x9114d000 - 0x9114efff /usr/lib/system/libsystem_blocks.dylib 0x91414000 - 0x9142cfff /usr/lib/system/libdispatch.dylib 0x92b8f000 - 0x92ba1fff /usr/lib/system/libsystem_asl.dylib 0x93104000 - 0x93196fff /usr/lib/system/libsystem_c.dylib 0x932e8000 - 0x932eafff /usr/lib/system/libquarantine.dylib 0x9461a000 - 0x9461cfff /usr/lib/system/libsystem_configuration.dylib 0x946e9000 - 0x946eafff /usr/lib/system/libsystem_sandbox.dylib 0x946eb000 - 0x946ebfff /usr/lib/system/libkeymgr.dylib 0x96146000 - 0x9614cfff /usr/lib/system/libunwind.dylib 0x962c8000 - 0x962c9fff /usr/lib/system/libremovefile.dylib 0x96eac000 - 0x96eb7fff /usr/lib/system/libcommonCrypto.dylib 0x9708a000 - 0x970a7fff /usr/lib/system/libsystem_kernel.dylib 0x973e9000 - 0x973edfff /usr/lib/system/libcache.dylib 0x981ff000 - 0x9822afff /usr/lib/system/libsystem_network.dylib 0x98a85000 - 0x98a89fff /usr/lib/system/libmacho.dylib 0x98c41000 - 0x98c49fff /usr/lib/system/libsystem_dnssd.dylib 0x990c8000 - 0x990f9fff /usr/lib/system/libsystem_m.dylib 0x99654000 - 0x9965bfff /usr/lib/system/libsystem_pthread.dylib 0x99766000 - 0x9976ffff /usr/lib/system/libsystem_notify.dylib 0x99b92000 - 0x99b93fff /usr/lib/libSystem.B.dylib 0x99fdc000 - 0x9a004fff /usr/lib/system/libsystem_info.dylib 0x9a723000 - 0x9a773fff /usr/lib/system/libcorecrypto.dylib 0x9aeb1000 - 0x9aeb9fff /usr/lib/system/liblaunch.dylib 0x9b102000 - 0x9b107fff /usr/lib/system/libcompiler_rt.dylib 0x9b228000 - 0x9b22dfff /usr/lib/system/libsystem_platform.dylib 0x9b527000 - 0x9b535fff /usr/lib/libz.1.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=15889, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.9 build 13A603 Sun Oct 27 01:27:23 2013 Thread 0 Crashed: Thread 1: -- Warning: /usr/bin/atos is moving and will be removed from a future OS X release. It is now available in the Xcode developer tools to be invoked via: `xcrun atos` To silence this warning, pass the '-d' command-line flag to this tool. -- Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffcd28 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Volumes/Ananke HD/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x90008000 - 0x90009fff /usr/lib/system/libunc.dylib 0x90590000 - 0x905b4fff /usr/lib/system/libxpc.dylib 0x905b5000 - 0x905bdfff /usr/lib/system/libcopyfile.dylib 0x90621000 - 0x90624fff /usr/lib/system/libdyld.dylib 0x91123000 - 0x9113bfff /usr/lib/system/libsystem_malloc.dylib 0x9114d000 - 0x9114efff /usr/lib/system/libsystem_blocks.dylib 0x91414000 - 0x9142cfff /usr/lib/system/libdispatch.dylib 0x92b8f000 - 0x92ba1fff /usr/lib/system/libsystem_asl.dylib 0x93104000 - 0x93196fff /usr/lib/system/libsystem_c.dylib 0x932e8000 - 0x932eafff /usr/lib/system/libquarantine.dylib 0x9461a000 - 0x9461cfff /usr/lib/system/libsystem_configuration.dylib 0x946e9000 - 0x946eafff /usr/lib/system/libsystem_sandbox.dylib 0x946eb000 - 0x946ebfff /usr/lib/system/libkeymgr.dylib 0x96146000 - 0x9614cfff /usr/lib/system/libunwind.dylib 0x962c8000 - 0x962c9fff /usr/lib/system/libremovefile.dylib 0x96eac000 - 0x96eb7fff /usr/lib/system/libcommonCrypto.dylib 0x9708a000 - 0x970a7fff /usr/lib/system/libsystem_kernel.dylib 0x973e9000 - 0x973edfff /usr/lib/system/libcache.dylib 0x981ff000 - 0x9822afff /usr/lib/system/libsystem_network.dylib 0x98a85000 - 0x98a89fff /usr/lib/system/libmacho.dylib 0x98c41000 - 0x98c49fff /usr/lib/system/libsystem_dnssd.dylib 0x990c8000 - 0x990f9fff /usr/lib/system/libsystem_m.dylib 0x99654000 - 0x9965bfff /usr/lib/system/libsystem_pthread.dylib 0x99766000 - 0x9976ffff /usr/lib/system/libsystem_notify.dylib 0x99b92000 - 0x99b93fff /usr/lib/libSystem.B.dylib 0x99fdc000 - 0x9a004fff /usr/lib/system/libsystem_info.dylib 0x9a723000 - 0x9a773fff /usr/lib/system/libcorecrypto.dylib 0x9aeb1000 - 0x9aeb9fff /usr/lib/system/liblaunch.dylib 0x9b102000 - 0x9b107fff /usr/lib/system/libcompiler_rt.dylib 0x9b228000 - 0x9b22dfff /usr/lib/system/libsystem_platform.dylib 0x9b527000 - 0x9b535fff /usr/lib/libz.1.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=15889, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.9 build 13A603 Sun Oct 27 01:27:25 2013 Thread 0 Crashed: Thread 1: -- Warning: /usr/bin/atos is moving and will be removed from a future OS X release. It is now available in the Xcode developer tools to be invoked via: `xcrun atos` To silence this warning, pass the '-d' command-line flag to this tool. -- Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffcd28 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Volumes/Ananke HD/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x90008000 - 0x90009fff /usr/lib/system/libunc.dylib 0x90590000 - 0x905b4fff /usr/lib/system/libxpc.dylib 0x905b5000 - 0x905bdfff /usr/lib/system/libcopyfile.dylib 0x90621000 - 0x90624fff /usr/lib/system/libdyld.dylib 0x91123000 - 0x9113bfff /usr/lib/system/libsystem_malloc.dylib 0x9114d000 - 0x9114efff /usr/lib/system/libsystem_blocks.dylib 0x91414000 - 0x9142cfff /usr/lib/system/libdispatch.dylib 0x92b8f000 - 0x92ba1fff /usr/lib/system/libsystem_asl.dylib 0x93104000 - 0x93196fff /usr/lib/system/libsystem_c.dylib 0x932e8000 - 0x932eafff /usr/lib/system/libquarantine.dylib 0x9461a000 - 0x9461cfff /usr/lib/system/libsystem_configuration.dylib 0x946e9000 - 0x946eafff /usr/lib/system/libsystem_sandbox.dylib 0x946eb000 - 0x946ebfff /usr/lib/system/libkeymgr.dylib 0x96146000 - 0x9614cfff /usr/lib/system/libunwind.dylib 0x962c8000 - 0x962c9fff /usr/lib/system/libremovefile.dylib 0x96eac000 - 0x96eb7fff /usr/lib/system/libcommonCrypto.dylib 0x9708a000 - 0x970a7fff /usr/lib/system/libsystem_kernel.dylib 0x973e9000 - 0x973edfff /usr/lib/system/libcache.dylib 0x981ff000 - 0x9822afff /usr/lib/system/libsystem_network.dylib 0x98a85000 - 0x98a89fff /usr/lib/system/libmacho.dylib 0x98c41000 - 0x98c49fff /usr/lib/system/libsystem_dnssd.dylib 0x990c8000 - 0x990f9fff /usr/lib/system/libsystem_m.dylib 0x99654000 - 0x9965bfff /usr/lib/system/libsystem_pthread.dylib 0x99766000 - 0x9976ffff /usr/lib/system/libsystem_notify.dylib 0x99b92000 - 0x99b93fff /usr/lib/libSystem.B.dylib 0x99fdc000 - 0x9a004fff /usr/lib/system/libsystem_info.dylib 0x9a723000 - 0x9a773fff /usr/lib/system/libcorecrypto.dylib 0x9aeb1000 - 0x9aeb9fff /usr/lib/system/liblaunch.dylib 0x9b102000 - 0x9b107fff /usr/lib/system/libcompiler_rt.dylib 0x9b228000 - 0x9b22dfff /usr/lib/system/libsystem_platform.dylib 0x9b527000 - 0x9b535fff /usr/lib/libz.1.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=15889, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.9 build 13A603 Sun Oct 27 01:27:28 2013 Thread 0 Crashed: Thread 1: -- Warning: /usr/bin/atos is moving and will be removed from a future OS X release. It is now available in the Xcode developer tools to be invoked via: `xcrun atos` To silence this warning, pass the '-d' command-line flag to this tool. -- Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffcd28 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Volumes/Ananke HD/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x90008000 - 0x90009fff /usr/lib/system/libunc.dylib 0x90590000 - 0x905b4fff /usr/lib/system/libxpc.dylib 0x905b5000 - 0x905bdfff /usr/lib/system/libcopyfile.dylib 0x90621000 - 0x90624fff /usr/lib/system/libdyld.dylib 0x91123000 - 0x9113bfff /usr/lib/system/libsystem_malloc.dylib 0x9114d000 - 0x9114efff /usr/lib/system/libsystem_blocks.dylib 0x91414000 - 0x9142cfff /usr/lib/system/libdispatch.dylib 0x92b8f000 - 0x92ba1fff /usr/lib/system/libsystem_asl.dylib 0x93104000 - 0x93196fff /usr/lib/system/libsystem_c.dylib 0x932e8000 - 0x932eafff /usr/lib/system/libquarantine.dylib 0x9461a000 - 0x9461cfff /usr/lib/system/libsystem_configuration.dylib 0x946e9000 - 0x946eafff /usr/lib/system/libsystem_sandbox.dylib 0x946eb000 - 0x946ebfff /usr/lib/system/libkeymgr.dylib 0x96146000 - 0x9614cfff /usr/lib/system/libunwind.dylib 0x962c8000 - 0x962c9fff /usr/lib/system/libremovefile.dylib 0x96eac000 - 0x96eb7fff /usr/lib/system/libcommonCrypto.dylib 0x9708a000 - 0x970a7fff /usr/lib/system/libsystem_kernel.dylib 0x973e9000 - 0x973edfff /usr/lib/system/libcache.dylib 0x981ff000 - 0x9822afff /usr/lib/system/libsystem_network.dylib 0x98a85000 - 0x98a89fff /usr/lib/system/libmacho.dylib 0x98c41000 - 0x98c49fff /usr/lib/system/libsystem_dnssd.dylib 0x990c8000 - 0x990f9fff /usr/lib/system/libsystem_m.dylib 0x99654000 - 0x9965bfff /usr/lib/system/libsystem_pthread.dylib 0x99766000 - 0x9976ffff /usr/lib/system/libsystem_notify.dylib 0x99b92000 - 0x99b93fff /usr/lib/libSystem.B.dylib 0x99fdc000 - 0x9a004fff /usr/lib/system/libsystem_info.dylib 0x9a723000 - 0x9a773fff /usr/lib/system/libcorecrypto.dylib 0x9aeb1000 - 0x9aeb9fff /usr/lib/system/liblaunch.dylib 0x9b102000 - 0x9b107fff /usr/lib/system/libcompiler_rt.dylib 0x9b228000 - 0x9b22dfff /usr/lib/system/libsystem_platform.dylib 0x9b527000 - 0x9b535fff /usr/lib/libz.1.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=15889, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
26 Oct 2013 16:10:23	1229712	16063061	hadcm3n_o8ie_1900_40_008466153_2	336,960	398,119	1.1815
23 Oct 2013 19:15:47	1229712	16063061	hadcm3n_o8ie_1900_40_008466153_2	311,040	367,311	1.1809
21 Oct 2013 10:08:51	1229712	16063061	hadcm3n_o8ie_1900_40_008466153_2	285,120	336,580	1.1805
18 Oct 2013 14:36:53	1229712	16063061	hadcm3n_o8ie_1900_40_008466153_2	259,200	304,762	1.1758
17 Oct 2013 15:25:45	1229712	16063061	hadcm3n_o8ie_1900_40_008466153_2	233,280	275,258	1.1799
16 Oct 2013 20:47:24	1229712	16063061	hadcm3n_o8ie_1900_40_008466153_2	207,360	246,719	1.1898
15 Oct 2013 21:26:04	1229712	16063061	hadcm3n_o8ie_1900_40_008466153_2	181,440	216,116	1.1911
15 Oct 2013 10:11:48	1229712	16063061	hadcm3n_o8ie_1900_40_008466153_2	155,520	185,000	1.1896
14 Oct 2013 08:57:06	1229712	16063061	hadcm3n_o8ie_1900_40_008466153_2	129,600	153,671	1.1857
12 Oct 2013 16:46:48	1229712	16063061	hadcm3n_o8ie_1900_40_008466153_2	103,680	122,511	1.1816
11 Oct 2013 21:23:59	1229712	16063061	hadcm3n_o8ie_1900_40_008466153_2	77,760	92,973	1.1956
11 Oct 2013 10:05:36	1229712	16063061	hadcm3n_o8ie_1900_40_008466153_2	51,840	61,985	1.1957
10 Oct 2013 13:25:32	1229712	16063061	hadcm3n_o8ie_1900_40_008466153_2	25,920	30,993	1.1957