Task 16066429

Name	hadcm3n_o1vj_1940_40_008382810_3
Workunit	8533669
Created	12 Oct 2013, 10:40:34 UTC
Sent	12 Oct 2013, 10:41:04 UTC
Report deadline	11 Jan 2014, 18:08:15 UTC
Received	11 Dec 2013, 20:20:48 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1290304
Run time	10 days 6 hours 59 min 9 sec
CPU time	9 days 9 hours 0 min 34 sec
Validate state	Invalid
Credit	10,264.32
Device peak FLOPS	3.11 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.0.65</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/5/../../switcher/switcher) is setuid or setgid Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/5/../../switcher/switcher) is setuid or setgid Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/5/../../switcher/switcher) is setuid or setgid Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/5/../../switcher/switcher) is setuid or setgid CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/5/../../switcher/switcher) is setuid or setgid Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/5/../../switcher/switcher) is setuid or setgid CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/5/../../switcher/switcher) is setuid or setgid Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/5/../../switcher/switcher) is setuid or setgid Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/5/../../switcher/switcher) is setuid or setgid Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/5/../../switcher/switcher) is setuid or setgid CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/5/../../switcher/switcher) is setuid or setgid Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/5/../../switcher/switcher) is setuid or setgid hadcm3n_6.07_i686-apple-darwin(7652,0xaccefa28) malloc: * error for object 0x1269c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/5/../../switcher/switcher) is setuid or setgid hadcm3n_6.07_i686-apple-darwin(262,0xaccefa28) malloc: * error for object 0x21f0004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/5/../../switcher/switcher) is setuid or setgid hadcm3n_6.07_i686-apple-darwin(15979,0xaccefa28) malloc: * error for object 0x9e6604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(15979,0xaccefa28) malloc: * error for object 0x9e6600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(15979,0xaccefa28) malloc: * error for object 0x19cae04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(15979,0xaccefa28) malloc: * error for object 0x19cae00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(15979,0xaccefa28) malloc: * error for object 0x19ca404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(15979,0xaccefa28) malloc: * error for object 0x19ca400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(15979,0xaccefa28) malloc: * error for object 0x19ca404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(15979,0xaccefa28) malloc: * error for object 0x19ca400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(15979,0xaccefa28) malloc: * error for object 0x19ca404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(15979,0xaccefa28) malloc: * error for object 0x19ca400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(15979,0xaccefa28) malloc: * error for object 0x19ca400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/5/../../switcher/switcher) is setuid or setgid hadcm3n_6.07_i686-apple-darwin(18883,0xaccefa28) malloc: * error for object 0x232a204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(18883,0xaccefa28) malloc: * error for object 0x232a200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(18883,0xaccefa28) malloc: * error for object 0x130e004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(18883,0xaccefa28) malloc: * error for object 0x130e000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(18883,0xaccefa28) malloc: * error for object 0x130e004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(18883,0xaccefa28) malloc: * error for object 0x130e000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(18883,0xaccefa28) malloc: * error for object 0x130e004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(18883,0xaccefa28) malloc: * error for object 0x130e000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(18883,0xaccefa28) malloc: * error for object 0x130e004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(18883,0xaccefa28) malloc: * error for object 0x130e000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(18883,0xaccefa28) malloc: * error for object 0x130e004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(18883,0xaccefa28) malloc: * error for object 0x130e000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/5/../../switcher/switcher) is setuid or setgid Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/5/../../switcher/switcher) is setuid or setgid Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/5/../../switcher/switcher) is setuid or setgid Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/5/../../switcher/switcher) is setuid or setgid Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/5/../../switcher/switcher) is setuid or setgid Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/5/../../switcher/switcher) is setuid or setgid CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/5/../../switcher/switcher) is setuid or setgid CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/5/../../switcher/switcher) is setuid or setgid CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/5/../../switcher/switcher) is setuid or setgid CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/5/../../switcher/switcher) is setuid or setgid Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/5/../../switcher/switcher) is setuid or setgid CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/5/../../switcher/switcher) is setuid or setgid Suspended CPDN Monitor - Suspend request from BOINC... 00:05:48 (16402): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/5/../../switcher/switcher) is setuid or setgid CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/5/../../switcher/switcher) is setuid or setgid Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/5/../../switcher/switcher) is setuid or setgid Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/5/../../switcher/switcher) is setuid or setgid Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/5/../../switcher/switcher) is setuid or setgid Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/5/../../switcher/switcher) is setuid or setgid Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/5/../../switcher/switcher) is setuid or setgid Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/5/../../switcher/switcher) is setuid or setgid Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/5/../../switcher/switcher) is setuid or setgid Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/5/../../switcher/switcher) is setuid or setgid Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/5/../../switcher/switcher) is setuid or setgid dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/5/../../switcher/switcher) is setuid or setgid SIGABRT: abort called dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.8.4 build 12E55 Wed Dec 11 14:12:55 2013 dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid Thread 0 Crashed: Thread 1: dyld: DYLD_ environment variables being ignored because main executable (/usr/bin/atos) has __RESTRICT/__restrict section Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffcdb8 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x90517000 - 0x90543fff /usr/lib/system/libsystem_info.dylib 0x90741000 - 0x90749fff /usr/lib/system/libcopyfile.dylib 0x908ca000 - 0x908cbfff /usr/lib/system/libquarantine.dylib 0x908cc000 - 0x908d3fff /usr/lib/system/libunwind.dylib 0x910b4000 - 0x910bbfff /usr/lib/system/liblaunch.dylib 0x91661000 - 0x91663fff /usr/lib/system/libdyld.dylib 0x91b10000 - 0x91b10fff /usr/lib/libSystem.B.dylib 0x91edb000 - 0x91edcfff /usr/lib/system/libunc.dylib 0x92692000 - 0x926a0fff /usr/lib/system/libsystem_network.dylib 0x92ea3000 - 0x92eaefff /usr/lib/system/libcommonCrypto.dylib 0x9392a000 - 0x93976fff /usr/lib/system/libcorecrypto.dylib 0x93dde000 - 0x93ddffff /usr/lib/system/libdnsinfo.dylib 0x94831000 - 0x94834fff /usr/lib/system/libcompiler_rt.dylib 0x94835000 - 0x94847fff /usr/lib/system/libdispatch.dylib 0x94b7c000 - 0x94b99fff /usr/lib/system/libxpc.dylib 0x9520a000 - 0x9520efff /usr/lib/system/libmacho.dylib 0x9520f000 - 0x95219fff /usr/lib/system/libsystem_notify.dylib 0x966c4000 - 0x966c5fff /usr/lib/system/libremovefile.dylib 0x969b9000 - 0x969e6fff /usr/lib/system/libsystem_m.dylib 0x96b59000 - 0x96b5afff /usr/lib/system/libsystem_sandbox.dylib 0x97691000 - 0x97691fff /usr/lib/system/libsystem_blocks.dylib 0x97692000 - 0x976acfff /usr/lib/system/libsystem_kernel.dylib 0x97c13000 - 0x97c13fff /usr/lib/system/libkeymgr.dylib 0x985ae000 - 0x985bcfff /usr/lib/libz.1.dylib 0x99755000 - 0x99759fff /usr/lib/system/libcache.dylib 0x9977b000 - 0x99838fff /usr/lib/system/libsystem_c.dylib 0x99839000 - 0x99840fff /usr/lib/system/libsystem_dnssd.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=280, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.8.4 build 12E55 Wed Dec 11 14:12:57 2013 dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid Thread 0 Crashed: Thread 1: dyld: DYLD_ environment variables being ignored because main executable (/usr/bin/atos) has __RESTRICT/__restrict section Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffcdb8 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x90517000 - 0x90543fff /usr/lib/system/libsystem_info.dylib 0x90741000 - 0x90749fff /usr/lib/system/libcopyfile.dylib 0x908ca000 - 0x908cbfff /usr/lib/system/libquarantine.dylib 0x908cc000 - 0x908d3fff /usr/lib/system/libunwind.dylib 0x910b4000 - 0x910bbfff /usr/lib/system/liblaunch.dylib 0x91661000 - 0x91663fff /usr/lib/system/libdyld.dylib 0x91b10000 - 0x91b10fff /usr/lib/libSystem.B.dylib 0x91edb000 - 0x91edcfff /usr/lib/system/libunc.dylib 0x92692000 - 0x926a0fff /usr/lib/system/libsystem_network.dylib 0x92ea3000 - 0x92eaefff /usr/lib/system/libcommonCrypto.dylib 0x9392a000 - 0x93976fff /usr/lib/system/libcorecrypto.dylib 0x93dde000 - 0x93ddffff /usr/lib/system/libdnsinfo.dylib 0x94831000 - 0x94834fff /usr/lib/system/libcompiler_rt.dylib 0x94835000 - 0x94847fff /usr/lib/system/libdispatch.dylib 0x94b7c000 - 0x94b99fff /usr/lib/system/libxpc.dylib 0x9520a000 - 0x9520efff /usr/lib/system/libmacho.dylib 0x9520f000 - 0x95219fff /usr/lib/system/libsystem_notify.dylib 0x966c4000 - 0x966c5fff /usr/lib/system/libremovefile.dylib 0x969b9000 - 0x969e6fff /usr/lib/system/libsystem_m.dylib 0x96b59000 - 0x96b5afff /usr/lib/system/libsystem_sandbox.dylib 0x97691000 - 0x97691fff /usr/lib/system/libsystem_blocks.dylib 0x97692000 - 0x976acfff /usr/lib/system/libsystem_kernel.dylib 0x97c13000 - 0x97c13fff /usr/lib/system/libkeymgr.dylib 0x985ae000 - 0x985bcfff /usr/lib/libz.1.dylib 0x99755000 - 0x99759fff /usr/lib/system/libcache.dylib 0x9977b000 - 0x99838fff /usr/lib/system/libsystem_c.dylib 0x99839000 - 0x99840fff /usr/lib/system/libsystem_dnssd.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=280, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.8.4 build 12E55 Wed Dec 11 14:13:00 2013 dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid Thread 0 Crashed: Thread 1: dyld: DYLD_ environment variables being ignored because main executable (/usr/bin/atos) has __RESTRICT/__restrict section Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffcdb8 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x90517000 - 0x90543fff /usr/lib/system/libsystem_info.dylib 0x90741000 - 0x90749fff /usr/lib/system/libcopyfile.dylib 0x908ca000 - 0x908cbfff /usr/lib/system/libquarantine.dylib 0x908cc000 - 0x908d3fff /usr/lib/system/libunwind.dylib 0x910b4000 - 0x910bbfff /usr/lib/system/liblaunch.dylib 0x91661000 - 0x91663fff /usr/lib/system/libdyld.dylib 0x91b10000 - 0x91b10fff /usr/lib/libSystem.B.dylib 0x91edb000 - 0x91edcfff /usr/lib/system/libunc.dylib 0x92692000 - 0x926a0fff /usr/lib/system/libsystem_network.dylib 0x92ea3000 - 0x92eaefff /usr/lib/system/libcommonCrypto.dylib 0x9392a000 - 0x93976fff /usr/lib/system/libcorecrypto.dylib 0x93dde000 - 0x93ddffff /usr/lib/system/libdnsinfo.dylib 0x94831000 - 0x94834fff /usr/lib/system/libcompiler_rt.dylib 0x94835000 - 0x94847fff /usr/lib/system/libdispatch.dylib 0x94b7c000 - 0x94b99fff /usr/lib/system/libxpc.dylib 0x9520a000 - 0x9520efff /usr/lib/system/libmacho.dylib 0x9520f000 - 0x95219fff /usr/lib/system/libsystem_notify.dylib 0x966c4000 - 0x966c5fff /usr/lib/system/libremovefile.dylib 0x969b9000 - 0x969e6fff /usr/lib/system/libsystem_m.dylib 0x96b59000 - 0x96b5afff /usr/lib/system/libsystem_sandbox.dylib 0x97691000 - 0x97691fff /usr/lib/system/libsystem_blocks.dylib 0x97692000 - 0x976acfff /usr/lib/system/libsystem_kernel.dylib 0x97c13000 - 0x97c13fff /usr/lib/system/libkeymgr.dylib 0x985ae000 - 0x985bcfff /usr/lib/libz.1.dylib 0x99755000 - 0x99759fff /usr/lib/system/libcache.dylib 0x9977b000 - 0x99838fff /usr/lib/system/libsystem_c.dylib 0x99839000 - 0x99840fff /usr/lib/system/libsystem_dnssd.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=280, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.8.4 build 12E55 Wed Dec 11 14:13:03 2013 dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid Thread 0 Crashed: Thread 1: dyld: DYLD_ environment variables being ignored because main executable (/usr/bin/atos) has __RESTRICT/__restrict section Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffcdb8 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x90517000 - 0x90543fff /usr/lib/system/libsystem_info.dylib 0x90741000 - 0x90749fff /usr/lib/system/libcopyfile.dylib 0x908ca000 - 0x908cbfff /usr/lib/system/libquarantine.dylib 0x908cc000 - 0x908d3fff /usr/lib/system/libunwind.dylib 0x910b4000 - 0x910bbfff /usr/lib/system/liblaunch.dylib 0x91661000 - 0x91663fff /usr/lib/system/libdyld.dylib 0x91b10000 - 0x91b10fff /usr/lib/libSystem.B.dylib 0x91edb000 - 0x91edcfff /usr/lib/system/libunc.dylib 0x92692000 - 0x926a0fff /usr/lib/system/libsystem_network.dylib 0x92ea3000 - 0x92eaefff /usr/lib/system/libcommonCrypto.dylib 0x9392a000 - 0x93976fff /usr/lib/system/libcorecrypto.dylib 0x93dde000 - 0x93ddffff /usr/lib/system/libdnsinfo.dylib 0x94831000 - 0x94834fff /usr/lib/system/libcompiler_rt.dylib 0x94835000 - 0x94847fff /usr/lib/system/libdispatch.dylib 0x94b7c000 - 0x94b99fff /usr/lib/system/libxpc.dylib 0x9520a000 - 0x9520efff /usr/lib/system/libmacho.dylib 0x9520f000 - 0x95219fff /usr/lib/system/libsystem_notify.dylib 0x966c4000 - 0x966c5fff /usr/lib/system/libremovefile.dylib 0x969b9000 - 0x969e6fff /usr/lib/system/libsystem_m.dylib 0x96b59000 - 0x96b5afff /usr/lib/system/libsystem_sandbox.dylib 0x97691000 - 0x97691fff /usr/lib/system/libsystem_blocks.dylib 0x97692000 - 0x976acfff /usr/lib/system/libsystem_kernel.dylib 0x97c13000 - 0x97c13fff /usr/lib/system/libkeymgr.dylib 0x985ae000 - 0x985bcfff /usr/lib/libz.1.dylib 0x99755000 - 0x99759fff /usr/lib/system/libcache.dylib 0x9977b000 - 0x99838fff /usr/lib/system/libsystem_c.dylib 0x99839000 - 0x99840fff /usr/lib/system/libsystem_dnssd.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=280, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.8.4 build 12E55 Wed Dec 11 14:13:06 2013 dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid Thread 0 Crashed: Thread 1: dyld: DYLD_ environment variables being ignored because main executable (/usr/bin/atos) has __RESTRICT/__restrict section Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffcdb8 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x90517000 - 0x90543fff /usr/lib/system/libsystem_info.dylib 0x90741000 - 0x90749fff /usr/lib/system/libcopyfile.dylib 0x908ca000 - 0x908cbfff /usr/lib/system/libquarantine.dylib 0x908cc000 - 0x908d3fff /usr/lib/system/libunwind.dylib 0x910b4000 - 0x910bbfff /usr/lib/system/liblaunch.dylib 0x91661000 - 0x91663fff /usr/lib/system/libdyld.dylib 0x91b10000 - 0x91b10fff /usr/lib/libSystem.B.dylib 0x91edb000 - 0x91edcfff /usr/lib/system/libunc.dylib 0x92692000 - 0x926a0fff /usr/lib/system/libsystem_network.dylib 0x92ea3000 - 0x92eaefff /usr/lib/system/libcommonCrypto.dylib 0x9392a000 - 0x93976fff /usr/lib/system/libcorecrypto.dylib 0x93dde000 - 0x93ddffff /usr/lib/system/libdnsinfo.dylib 0x94831000 - 0x94834fff /usr/lib/system/libcompiler_rt.dylib 0x94835000 - 0x94847fff /usr/lib/system/libdispatch.dylib 0x94b7c000 - 0x94b99fff /usr/lib/system/libxpc.dylib 0x9520a000 - 0x9520efff /usr/lib/system/libmacho.dylib 0x9520f000 - 0x95219fff /usr/lib/system/libsystem_notify.dylib 0x966c4000 - 0x966c5fff /usr/lib/system/libremovefile.dylib 0x969b9000 - 0x969e6fff /usr/lib/system/libsystem_m.dylib 0x96b59000 - 0x96b5afff /usr/lib/system/libsystem_sandbox.dylib 0x97691000 - 0x97691fff /usr/lib/system/libsystem_blocks.dylib 0x97692000 - 0x976acfff /usr/lib/system/libsystem_kernel.dylib 0x97c13000 - 0x97c13fff /usr/lib/system/libkeymgr.dylib 0x985ae000 - 0x985bcfff /usr/lib/libz.1.dylib 0x99755000 - 0x99759fff /usr/lib/system/libcache.dylib 0x9977b000 - 0x99838fff /usr/lib/system/libsystem_c.dylib 0x99839000 - 0x99840fff /usr/lib/system/libsystem_dnssd.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=280, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... SIGABRT: abort called dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.8.4 build 12E55 Wed Dec 11 14:13:19 2013 dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid Thread 0 Crashed: Thread 1: dyld: DYLD_ environment variables being ignored because main executable (/usr/bin/atos) has __RESTRICT/__restrict section Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffcdb8 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x90517000 - 0x90543fff /usr/lib/system/libsystem_info.dylib 0x90741000 - 0x90749fff /usr/lib/system/libcopyfile.dylib 0x908ca000 - 0x908cbfff /usr/lib/system/libquarantine.dylib 0x908cc000 - 0x908d3fff /usr/lib/system/libunwind.dylib 0x910b4000 - 0x910bbfff /usr/lib/system/liblaunch.dylib 0x91661000 - 0x91663fff /usr/lib/system/libdyld.dylib 0x91b10000 - 0x91b10fff /usr/lib/libSystem.B.dylib 0x91edb000 - 0x91edcfff /usr/lib/system/libunc.dylib 0x92692000 - 0x926a0fff /usr/lib/system/libsystem_network.dylib 0x92ea3000 - 0x92eaefff /usr/lib/system/libcommonCrypto.dylib 0x9392a000 - 0x93976fff /usr/lib/system/libcorecrypto.dylib 0x93dde000 - 0x93ddffff /usr/lib/system/libdnsinfo.dylib 0x94831000 - 0x94834fff /usr/lib/system/libcompiler_rt.dylib 0x94835000 - 0x94847fff /usr/lib/system/libdispatch.dylib 0x94b7c000 - 0x94b99fff /usr/lib/system/libxpc.dylib 0x9520a000 - 0x9520efff /usr/lib/system/libmacho.dylib 0x9520f000 - 0x95219fff /usr/lib/system/libsystem_notify.dylib 0x966c4000 - 0x966c5fff /usr/lib/system/libremovefile.dylib 0x969b9000 - 0x969e6fff /usr/lib/system/libsystem_m.dylib 0x96b59000 - 0x96b5afff /usr/lib/system/libsystem_sandbox.dylib 0x97691000 - 0x97691fff /usr/lib/system/libsystem_blocks.dylib 0x97692000 - 0x976acfff /usr/lib/system/libsystem_kernel.dylib 0x97c13000 - 0x97c13fff /usr/lib/system/libkeymgr.dylib 0x985ae000 - 0x985bcfff /usr/lib/libz.1.dylib 0x99755000 - 0x99759fff /usr/lib/system/libcache.dylib 0x9977b000 - 0x99838fff /usr/lib/system/libsystem_c.dylib 0x99839000 - 0x99840fff /usr/lib/system/libsystem_dnssd.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=280, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
28 Oct 2013 09:36:17	1290304	16066429	hadcm3n_o1vj_1940_40_008382810_3	855,360	793,646	0.9279
28 Oct 2013 01:47:32	1290304	16066429	hadcm3n_o1vj_1940_40_008382810_3	829,440	769,698	0.9280
27 Oct 2013 18:32:07	1290304	16066429	hadcm3n_o1vj_1940_40_008382810_3	803,520	745,889	0.9283
27 Oct 2013 11:14:28	1290304	16066429	hadcm3n_o1vj_1940_40_008382810_3	777,600	722,007	0.9285
27 Oct 2013 03:21:20	1290304	16066429	hadcm3n_o1vj_1940_40_008382810_3	751,680	698,147	0.9288
26 Oct 2013 20:08:17	1290304	16066429	hadcm3n_o1vj_1940_40_008382810_3	725,760	674,335	0.9291
26 Oct 2013 10:22:49	1290304	16066429	hadcm3n_o1vj_1940_40_008382810_3	699,840	650,311	0.9292
26 Oct 2013 02:29:16	1290304	16066429	hadcm3n_o1vj_1940_40_008382810_3	673,920	626,334	0.9294
25 Oct 2013 10:34:22	1290304	16066429	hadcm3n_o1vj_1940_40_008382810_3	648,000	602,218	0.9293
25 Oct 2013 02:35:15	1290304	16066429	hadcm3n_o1vj_1940_40_008382810_3	622,080	577,932	0.9290
24 Oct 2013 10:40:24	1290304	16066429	hadcm3n_o1vj_1940_40_008382810_3	596,160	553,837	0.9290
24 Oct 2013 02:46:10	1290304	16066429	hadcm3n_o1vj_1940_40_008382810_3	570,240	529,756	0.9290
23 Oct 2013 10:42:26	1290304	16066429	hadcm3n_o1vj_1940_40_008382810_3	544,320	505,295	0.9283
23 Oct 2013 02:49:13	1290304	16066429	hadcm3n_o1vj_1940_40_008382810_3	518,400	481,259	0.9284
22 Oct 2013 10:48:36	1290304	16066429	hadcm3n_o1vj_1940_40_008382810_3	492,480	457,468	0.9289
22 Oct 2013 02:45:48	1290304	16066429	hadcm3n_o1vj_1940_40_008382810_3	466,560	433,253	0.9286
21 Oct 2013 10:54:02	1290304	16066429	hadcm3n_o1vj_1940_40_008382810_3	440,640	409,101	0.9284
21 Oct 2013 03:01:42	1290304	16066429	hadcm3n_o1vj_1940_40_008382810_3	414,720	384,922	0.9281
20 Oct 2013 19:43:36	1290304	16066429	hadcm3n_o1vj_1940_40_008382810_3	388,800	360,898	0.9282
20 Oct 2013 12:21:04	1290304	16066429	hadcm3n_o1vj_1940_40_008382810_3	362,880	336,677	0.9278