Task 15655506

Name	hadcm3n_zck5_1960_40_008319437_2
Workunit	8470572
Created	9 Mar 2013, 23:52:59 UTC
Sent	9 Mar 2013, 23:53:23 UTC
Report deadline	9 Jun 2013, 7:20:34 UTC
Received	17 Apr 2013, 21:49:31 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1252172
Run time	17 days 21 hours 12 min 13 sec
CPU time	16 days 14 hours 41 min 57 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	2.20 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.0.31</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:52:50 (9816): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:14:47 (65386): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid 08:15:48 (92667): No heartbeat from core client for 30 sec - exiting 08:15:49 (92667): No heartbeat from core client for 30 sec - exiting 08:15:51 (92667): No heartbeat from core client for 30 sec - exiting 08:15:52 (92667): No heartbeat from core client for 30 sec - exiting 08:15:53 (92667): No heartbeat from core client for 30 sec - exiting 08:15:54 (92667): No heartbeat from core client for 30 sec - exiting 08:15:55 (92667): No heartbeat from core client for 30 sec - exiting 08:15:56 (92667): No heartbeat from core client for 30 sec - exiting 08:15:57 (92667): No heartbeat from core client for 30 sec - exiting 08:15:58 (92667): No heartbeat from core client for 30 sec - exiting 08:15:59 (92667): No heartbeat from core client for 30 sec - exiting 08:16:00 (92667): No heartbeat from core client for 30 sec - exiting 08:16:01 (92667): No heartbeat from core client for 30 sec - exiting 08:16:02 (92667): No heartbeat from core client for 30 sec - exiting 08:16:03 (92667): No heartbeat from core client for 30 sec - exiting 08:16:04 (92667): No heartbeat from core client for 30 sec - exiting 08:16:05 (92667): No heartbeat from core client for 30 sec - exiting 08:16:06 (92667): No heartbeat from core client for 30 sec - exiting 08:16:07 (92667): No heartbeat from core client for 30 sec - exiting 08:16:08 (92667): No heartbeat from core client for 30 sec - exiting 08:16:09 (92667): No heartbeat from core client for 30 sec - exiting 08:16:10 (92667): No heartbeat from core client for 30 sec - exiting 08:16:11 (92667): No heartbeat from core client for 30 sec - exiting 08:16:12 (92667): No heartbeat from core client for 30 sec - exiting 08:16:13 (92667): No heartbeat from core client for 30 sec - exiting 08:16:14 (92667): No heartbeat from core client for 30 sec - exiting 08:16:15 (92667): No heartbeat from core client for 30 sec - exiting 08:16:16 (92667): No heartbeat from core client for 30 sec - exiting 08:16:17 (92667): No heartbeat from core client for 30 sec - exiting 08:16:18 (92667): No heartbeat from core client for 30 sec - exiting 08:16:19 (92667): No heartbeat from core client for 30 sec - exiting 08:16:20 (92667): No heartbeat from core client for 30 sec - exiting 08:16:21 (92667): No heartbeat from core client for 30 sec - exiting 08:16:22 (92667): No heartbeat from core client for 30 sec - exiting 08:16:23 (92667): No heartbeat from core client for 30 sec - exiting 08:16:24 (92667): No heartbeat from core client for 30 sec - exiting 08:16:26 (92667): No heartbeat from core client for 30 sec - exiting 08:16:27 (92667): No heartbeat from core client for 30 sec - exiting 08:16:28 (92667): No heartbeat from core client for 30 sec - exiting 08:16:29 (92667): No heartbeat from core client for 30 sec - exiting 08:16:30 (92667): No heartbeat from core client for 30 sec - exiting 08:16:31 (92667): No heartbeat from core client for 30 sec - exiting 08:16:32 (92667): No heartbeat from core client for 30 sec - exiting 08:16:33 (92667): No heartbeat from core client for 30 sec - exiting 08:16:34 (92667): No heartbeat from core client for 30 sec - exiting 08:16:35 (92667): No heartbeat from core client for 30 sec - exiting 08:16:36 (92667): No heartbeat from core client for 30 sec - exiting 08:16:37 (92667): No heartbeat from core client for 30 sec - exiting 08:16:38 (92667): No heartbeat from core client for 30 sec - exiting 08:16:39 (92667): No heartbeat from core client for 30 sec - exiting 08:16:40 (92667): No heartbeat from core client for 30 sec - exiting 08:16:41 (92667): No heartbeat from core client for 30 sec - exiting 08:16:42 (92667): No heartbeat from core client for 30 sec - exiting 08:16:43 (92667): No heartbeat from core client for 30 sec - exiting 08:16:44 (92667): No heartbeat from core client for 30 sec - exiting 08:16:45 (92667): No heartbeat from core client for 30 sec - exiting 08:16:46 (92667): No heartbeat from core client for 30 sec - exiting 08:16:47 (92667): No heartbeat from core client for 30 sec - exiting 08:16:48 (92667): No heartbeat from core client for 30 sec - exiting 08:16:49 (92667): No heartbeat from core client for 30 sec - exiting 08:16:50 (92667): No heartbeat from core client for 30 sec - exiting 08:16:51 (92667): No heartbeat from core client for 30 sec - exiting 08:16:52 (92667): No heartbeat from core client for 30 sec - exiting 08:16:53 (92667): No heartbeat from core client for 30 sec - exiting 08:16:54 (92667): No heartbeat from core client for 30 sec - exiting 08:16:55 (92667): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... hadcm3n_6.07_i686-apple-darwin(92701,0xac221a28) malloc: * error for object 0x137ae04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(92701,0xac221a28) malloc: * error for object 0x137ae00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(92701,0xac221a28) malloc: * error for object 0x137ae04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(92701,0xac221a28) malloc: * error for object 0x137ae00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(92701,0xac221a28) malloc: * error for object 0x137ae04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(92701,0xac221a28) malloc: * error for object 0x137ae00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid Suspended CPDN Monitor - Suspend request from BOINC... hadcm3n_6.07_i686-apple-darwin(64341,0xac221a28) malloc: * error for object 0x19fc204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(64341,0xac221a28) malloc: * error for object 0x19fc200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(64341,0xac221a28) malloc: * error for object 0x19fc204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(64341,0xac221a28) malloc: * error for object 0x19fc200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(64341,0xac221a28) malloc: * error for object 0x19fc204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(64341,0xac221a28) malloc: * error for object 0x19fc200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(64341,0xac221a28) malloc: * error for object 0x19fc204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(64341,0xac221a28) malloc: * error for object 0x19fc200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(64341,0xac221a28) malloc: * error for object 0x19fc204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(64341,0xac221a28) malloc: * error for object 0x19fc200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(64341,0xac221a28) malloc: * error for object 0x19fc204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid hadcm3n_6.07_i686-apple-darwin(85094,0xac221a28) malloc: * error for object 0x8e8400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid hadcm3n_6.07_i686-apple-darwin(10003,0xac221a28) malloc: * error for object 0xa26e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(10003,0xac221a28) malloc: * error for object 0x1226a04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(10003,0xac221a28) malloc: * error for object 0xa26e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(10003,0xac221a28) malloc: * error for object 0xa24604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(10003,0xac221a28) malloc: * error for object 0xa24600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(10003,0xac221a28) malloc: * error for object 0xa24604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(10003,0xac221a28) malloc: * error for object 0xa24600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(10003,0xac221a28) malloc: * error for object 0xa24604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(10003,0xac221a28) malloc: * error for object 0xa24600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(10003,0xac221a28) malloc: * error for object 0xa24604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(10003,0xac221a28) malloc: * error for object 0xa24600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(10003,0xac221a28) malloc: * error for object 0xa24604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(10003,0xac221a28) malloc: * error for object 0xa24600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(10003,0xac221a28) malloc: * error for object 0xa24604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(10003,0xac221a28) malloc: * error for object 0xa24600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
14 Apr 2013 13:13:06	1252172	15655506	hadcm3n_zck5_1960_40_008319437_2	777,600	1,413,402	1.8176
13 Apr 2013 23:03:02	1252172	15655506	hadcm3n_zck5_1960_40_008319437_2	751,680	1,367,322	1.8190
13 Apr 2013 08:43:26	1252172	15655506	hadcm3n_zck5_1960_40_008319437_2	725,760	1,320,489	1.8195
12 Apr 2013 18:40:09	1252172	15655506	hadcm3n_zck5_1960_40_008319437_2	699,840	1,274,183	1.8207
12 Apr 2013 04:17:49	1252172	15655506	hadcm3n_zck5_1960_40_008319437_2	673,920	1,226,926	1.8206
10 Apr 2013 11:49:14	1252172	15655506	hadcm3n_zck5_1960_40_008319437_2	648,000	1,179,800	1.8207
09 Apr 2013 21:48:50	1252172	15655506	hadcm3n_zck5_1960_40_008319437_2	622,080	1,132,546	1.8206
09 Apr 2013 07:59:42	1252172	15655506	hadcm3n_zck5_1960_40_008319437_2	596,160	1,085,740	1.8212
05 Apr 2013 14:10:43	1252172	15655506	hadcm3n_zck5_1960_40_008319437_2	570,240	1,038,428	1.8210
05 Apr 2013 00:21:28	1252172	15655506	hadcm3n_zck5_1960_40_008319437_2	544,320	991,902	1.8223
04 Apr 2013 10:21:15	1252172	15655506	hadcm3n_zck5_1960_40_008319437_2	518,400	944,738	1.8224
03 Apr 2013 20:34:37	1252172	15655506	hadcm3n_zck5_1960_40_008319437_2	492,480	898,333	1.8241
27 Mar 2013 13:35:04	1252172	15655506	hadcm3n_zck5_1960_40_008319437_2	466,560	851,074	1.8241
26 Mar 2013 23:37:57	1252172	15655506	hadcm3n_zck5_1960_40_008319437_2	440,640	803,752	1.8241
26 Mar 2013 09:26:24	1252172	15655506	hadcm3n_zck5_1960_40_008319437_2	414,720	756,612	1.8244
25 Mar 2013 19:26:01	1252172	15655506	hadcm3n_zck5_1960_40_008319437_2	388,800	709,356	1.8245
25 Mar 2013 05:16:21	1252172	15655506	hadcm3n_zck5_1960_40_008319437_2	362,880	662,068	1.8245
24 Mar 2013 15:05:22	1252172	15655506	hadcm3n_zck5_1960_40_008319437_2	336,960	614,493	1.8236
24 Mar 2013 00:44:23	1252172	15655506	hadcm3n_zck5_1960_40_008319437_2	311,040	566,485	1.8213
23 Mar 2013 10:28:57	1252172	15655506	hadcm3n_zck5_1960_40_008319437_2	285,120	518,511	1.8186