Name | hadcm3n_zi2i_1880_40_008199012_1 |
Workunit | 8354136 |
Created | 12 Sep 2012, 22:21:03 UTC |
Sent | 14 Sep 2012, 23:37:19 UTC |
Report deadline | 15 Dec 2012, 7:04:30 UTC |
Received | 13 Oct 2012, 22:55:49 UTC |
Server state | Over |
Outcome | Computation error |
Client state | Compute error |
Exit status | 193 (0x000000C1) EXIT_SIGNAL |
Computer ID | 958046 |
Run time | 20 days 21 hours 26 min 48 sec |
CPU time | 18 days 21 hours 40 min 12 sec |
Validate state | Invalid |
Credit | 9,331.20 |
Device peak FLOPS | 2.99 GFLOPS |
Application version | UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin |
Stderr | <core_client_version>7.0.25</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 Error: Input file: dataout/zi2iko.pj81c10 is not a valid UM file. Error converting file to netcdf: dataout/zi2iko.pj81c10 Error: Input file: dataout/zi2iko.pi81c10 is not a valid UM file. Error converting file to netcdf: dataout/zi2iko.pi81c10 Error: Input file: dataout/zi2iko.pf81c10 is not a valid UM file. Error converting file to netcdf: dataout/zi2iko.pf81c10 Error: Input file: dataout/zi2ika.ph81c10 is not a valid UM file. Error converting file to netcdf: dataout/zi2ika.ph81c10 Error: Input file: dataout/zi2ika.pg81c10 is not a valid UM file. Error converting file to netcdf: dataout/zi2ika.pg81c10 Error: Input file: dataout/zi2ika.pe81c10 is not a valid UM file. Error converting file to netcdf: dataout/zi2ika.pe81c10 Error: Input file: dataout/zi2ika.pd81c10 is not a valid UM file. Error converting file to netcdf: dataout/zi2ika.pd81c10 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 01:10:41 (33784): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:10:43 (33784): No heartbeat from core client for 30 sec - exiting 01:10:44 (33784): No heartbeat from core client for 30 sec - exiting 01:10:45 (33784): No heartbeat from core client for 30 sec - exiting 01:10:46 (33784): No heartbeat from core client for 30 sec - exiting 01:10:47 (33784): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 16:25:20 (54616): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:25:22 (54616): No heartbeat from core client for 30 sec - exiting 16:25:23 (54616): No heartbeat from core client for 30 sec - exiting 16:25:24 (54616): No heartbeat from core client for 30 sec - exiting 16:25:25 (54616): No heartbeat from core client for 30 sec - exiting 16:25:26 (54616): No heartbeat from core client for 30 sec - exiting 16:25:27 (54616): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:21:48 (68550): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 09:45:37 (13001): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:36:55 (22789): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:42:29 (44826): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:42:31 (44826): No heartbeat from core client for 30 sec - exiting 13:42:32 (44826): No heartbeat from core client for 30 sec - exiting 13:42:33 (44826): No heartbeat from core client for 30 sec - exiting 13:47:29 (45104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:47:31 (45104): No heartbeat from core client for 30 sec - exiting 13:47:32 (45104): No heartbeat from core client for 30 sec - exiting 13:52:30 (45322): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:52:32 (45322): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:18:10 (45557): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:18:13 (45557): No heartbeat from core client for 30 sec - exiting 20:18:14 (45557): No heartbeat from core client for 30 sec - exiting 20:18:15 (45557): No heartbeat from core client for 30 sec - exiting 20:18:16 (45557): No heartbeat from core client for 30 sec - exiting 20:18:17 (45557): No heartbeat from core client for 30 sec - exiting 20:18:18 (45557): No heartbeat from core client for 30 sec - exiting 20:18:19 (45557): No heartbeat from core client for 30 sec - exiting 20:18:20 (45557): No heartbeat from core client for 30 sec - exiting 20:18:21 (45557): No heartbeat from core client for 30 sec - exiting 20:18:22 (45557): No heartbeat from core client for 30 sec - exiting 20:18:23 (45557): No heartbeat from core client for 30 sec - exiting 20:18:24 (45557): No heartbeat from core client for 30 sec - exiting 20:18:25 (45557): No heartbeat from core client for 30 sec - exiting 20:18:26 (45557): No heartbeat from core client for 30 sec - exiting 20:18:27 (45557): No heartbeat from core client for 30 sec - exiting 20:18:28 (45557): No heartbeat from core client for 30 sec - exiting 20:18:29 (45557): No heartbeat from core client for 30 sec - exiting 20:18:30 (45557): No heartbeat from core client for 30 sec - exiting 20:18:31 (45557): No heartbeat from core client for 30 sec - exiting 20:18:32 (45557): No heartbeat from core client for 30 sec - exiting 20:23:10 (74511): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:33:11 (74703): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:33:14 (74703): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:43:12 (75196): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:43:17 (75196): No heartbeat from core client for 30 sec - exiting 20:43:18 (75196): No heartbeat from core client for 30 sec - exiting 20:43:19 (75196): No heartbeat from core client for 30 sec - exiting 20:43:20 (75196): No heartbeat from core client for 30 sec - exiting 20:43:21 (75196): No heartbeat from core client for 30 sec - exiting 20:43:22 (75196): No heartbeat from core client for 30 sec - exiting 20:43:23 (75196): No heartbeat from core client for 30 sec - exiting 20:43:24 (75196): No heartbeat from core client for 30 sec - exiting 20:43:25 (75196): No heartbeat from core client for 30 sec - exiting 20:43:26 (75196): No heartbeat from core client for 30 sec - exiting 20:43:27 (75196): No heartbeat from core client for 30 sec - exiting 20:43:28 (75196): No heartbeat from core client for 30 sec - exiting 20:43:29 (75196): No heartbeat from core client for 30 sec - exiting 20:43:30 (75196): No heartbeat from core client for 30 sec - exiting 20:43:31 (75196): No heartbeat from core client for 30 sec - exiting 20:43:32 (75196): No heartbeat from core client for 30 sec - exiting 20:43:33 (75196): No heartbeat from core client for 30 sec - exiting 20:43:34 (75196): No heartbeat from core client for 30 sec - exiting 20:43:35 (75196): No heartbeat from core client for 30 sec - exiting 20:43:36 (75196): No heartbeat from core client for 30 sec - exiting 20:43:37 (75196): No heartbeat from core client for 30 sec - exiting 20:43:38 (75196): No heartbeat from core client for 30 sec - exiting 20:43:39 (75196): No heartbeat from core client for 30 sec - exiting 20:43:40 (75196): No heartbeat from core client for 30 sec - exiting 20:43:41 (75196): No heartbeat from core client for 30 sec - exiting 20:43:42 (75196): No heartbeat from core client for 30 sec - exiting 20:43:43 (75196): No heartbeat from core client for 30 sec - exiting 20:43:44 (75196): No heartbeat from core client for 30 sec - exiting 20:43:45 (75196): No heartbeat from core client for 30 sec - exiting 20:43:46 (75196): No heartbeat from core client for 30 sec - exiting 20:43:47 (75196): No heartbeat from core client for 30 sec - exiting 20:43:48 (75196): No heartbeat from core client for 30 sec - exiting 20:43:49 (75196): No heartbeat from core client for 30 sec - exiting 20:43:50 (75196): No heartbeat from core client for 30 sec - exiting 20:43:51 (75196): No heartbeat from core client for 30 sec - exiting 20:43:52 (75196): No heartbeat from core client for 30 sec - exiting 20:43:53 (75196): No heartbeat from core client for 30 sec - exiting 20:43:54 (75196): No heartbeat from core client for 30 sec - exiting 20:43:57 (75196): No heartbeat from core client for 30 sec - exiting 20:43:58 (75196): No heartbeat from core client for 30 sec - exiting 20:48:13 (75724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 23:42:27 (85863): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:48:34 (85907): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:48:36 (85907): No heartbeat from core client for 30 sec - exiting 23:48:37 (85907): No heartbeat from core client for 30 sec - exiting 23:48:38 (85907): No heartbeat from core client for 30 sec - exiting 23:48:39 (85907): No heartbeat from core client for 30 sec - exiting 23:48:40 (85907): No heartbeat from core client for 30 sec - exiting 23:48:41 (85907): No heartbeat from core client for 30 sec - exiting 23:48:42 (85907): No heartbeat from core client for 30 sec - exiting 23:48:43 (85907): No heartbeat from core client for 30 sec - exiting 23:48:44 (85907): No heartbeat from core client for 30 sec - exiting 23:48:45 (85907): No heartbeat from core client for 30 sec - exiting 23:48:46 (85907): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:41:04 (45455): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:16:05 (14956): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:16:06 (14956): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:05:08 (59726): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:52:17 (84969): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... hadcm3n_6.07_i686-apple-darwin(17103,0xa013d540) malloc: *** error for object 0x2000e04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(17103,0xa013d540) malloc: *** error for object 0x2001c04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(17103,0xa013d540) malloc: *** error for object 0x2001c00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(17103,0xa013d540) malloc: *** error for object 0x2001c04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(17103,0xa013d540) malloc: *** error for object 0x2001c00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(17103,0xa013d540) malloc: *** error for object 0x2001c04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(17103,0xa013d540) malloc: *** error for object 0x2001c00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(17103,0xa013d540) malloc: *** error for object 0x2001c04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(17103,0xa013d540) malloc: *** error for object 0x2001c00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(17103,0xa013d540) malloc: *** error for object 0x2001c04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(17103,0xa013d540) malloc: *** error for object 0x2001c00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug CPDN Monitor - Quit request from BOINC... 23:09:32 (37315): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 05:40:05 (85301): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:40:06 (85301): No heartbeat from core client for 30 sec - exiting 05:40:07 (85301): No heartbeat from core client for 30 sec - exiting 05:40:08 (85301): No heartbeat from core client for 30 sec - exiting 05:40:09 (85301): No heartbeat from core client for 30 sec - exiting 05:40:10 (85301): No heartbeat from core client for 30 sec - exiting 05:40:11 (85301): No heartbeat from core client for 30 sec - exiting 05:40:12 (85301): No heartbeat from core client for 30 sec - exiting 05:40:13 (85301): No heartbeat from core client for 30 sec - exiting 05:40:14 (85301): No heartbeat from core client for 30 sec - exiting 05:40:15 (85301): No heartbeat from core client for 30 sec - exiting 05:40:16 (85301): No heartbeat from core client for 30 sec - exiting 05:40:17 (85301): No heartbeat from core client for 30 sec - exiting 05:40:18 (85301): No heartbeat from core client for 30 sec - exiting 05:40:19 (85301): No heartbeat from core client for 30 sec - exiting 05:40:20 (85301): No heartbeat from core client for 30 sec - exiting 05:40:21 (85301): No heartbeat from core client for 30 sec - exiting 05:41:34 (87105): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:15:19 (89809): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:15:21 (89809): No heartbeat from core client for 30 sec - exiting 11:15:22 (89809): No heartbeat from core client for 30 sec - exiting 11:15:23 (89809): No heartbeat from core client for 30 sec - exiting 11:15:24 (89809): No heartbeat from core client for 30 sec - exiting 11:15:25 (89809): No heartbeat from core client for 30 sec - exiting 11:15:26 (89809): No heartbeat from core client for 30 sec - exiting 11:15:27 (89809): No heartbeat from core client for 30 sec - exiting 11:15:28 (89809): No heartbeat from core client for 30 sec - exiting 11:15:29 (89809): No heartbeat from core client for 30 sec - exiting 11:15:30 (89809): No heartbeat from core client for 30 sec - exiting 11:15:31 (89809): No heartbeat from core client for 30 sec - exiting 11:15:32 (89809): No heartbeat from core client for 30 sec - exiting 11:15:33 (89809): No heartbeat from core client for 30 sec - exiting 11:15:34 (89809): No heartbeat from core client for 30 sec - exiting 11:15:35 (89809): No heartbeat from core client for 30 sec - exiting 11:15:36 (89809): No heartbeat from core client for 30 sec - exiting 11:15:37 (89809): No heartbeat from core client for 30 sec - exiting 11:20:24 (93531): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:20:25 (93531): No heartbeat from core client for 30 sec - exiting 11:20:26 (93531): No heartbeat from core client for 30 sec - exiting 11:20:27 (93531): No heartbeat from core client for 30 sec - exiting 11:20:28 (93531): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:25:34 (93542): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:29:33 (93596): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:29:35 (93596): No heartbeat from core client for 30 sec - exiting 12:05:06 (93640): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:08:51 (95738): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:15:18 (98796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:21:22 (98809): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:21:24 (98809): No heartbeat from core client for 30 sec - exiting 13:21:25 (98809): No heartbeat from core client for 30 sec - exiting 13:21:26 (98809): No heartbeat from core client for 30 sec - exiting 13:21:27 (98809): No heartbeat from core client for 30 sec - exiting 13:21:28 (98809): No heartbeat from core client for 30 sec - exiting 13:21:29 (98809): No heartbeat from core client for 30 sec - exiting 13:21:30 (98809): No heartbeat from core client for 30 sec - exiting 13:21:31 (98809): No heartbeat from core client for 30 sec - exiting 13:21:32 (98809): No heartbeat from core client for 30 sec - exiting 13:21:33 (98809): No heartbeat from core client for 30 sec - exiting 13:21:34 (98809): No heartbeat from core client for 30 sec - exiting 13:21:35 (98809): No heartbeat from core client for 30 sec - exiting 13:21:36 (98809): No heartbeat from core client for 30 sec - exiting 13:21:37 (98809): No heartbeat from core client for 30 sec - exiting 13:21:38 (98809): No heartbeat from core client for 30 sec - exiting 13:21:39 (98809): No heartbeat from core client for 30 sec - exiting 13:21:40 (98809): No heartbeat from core client for 30 sec - exiting 13:21:41 (98809): No heartbeat from core client for 30 sec - exiting 13:21:42 (98809): No heartbeat from core client for 30 sec - exiting 13:21:43 (98809): No heartbeat from core client for 30 sec - exiting 13:21:44 (98809): No heartbeat from core client for 30 sec - exiting 13:21:45 (98809): No heartbeat from core client for 30 sec - exiting 13:21:46 (98809): No heartbeat from core client for 30 sec - exiting 13:21:47 (98809): No heartbeat from core client for 30 sec - exiting 13:21:48 (98809): No heartbeat from core client for 30 sec - exiting 13:21:49 (98809): No heartbeat from core client for 30 sec - exiting 13:21:50 (98809): No heartbeat from core client for 30 sec - exiting 13:21:51 (98809): No heartbeat from core client for 30 sec - exiting 13:21:52 (98809): No heartbeat from core client for 30 sec - exiting 13:21:53 (98809): No heartbeat from core client for 30 sec - exiting 13:21:54 (98809): No heartbeat from core client for 30 sec - exiting 13:21:55 (98809): No heartbeat from core client for 30 sec - exiting 13:21:56 (98809): No heartbeat from core client for 30 sec - exiting 13:21:57 (98809): No heartbeat from core client for 30 sec - exiting 13:21:58 (98809): No heartbeat from core client for 30 sec - exiting 13:21:59 (98809): No heartbeat from core client for 30 sec - exiting 13:22:00 (98809): No heartbeat from core client for 30 sec - exiting 13:22:01 (98809): No heartbeat from core client for 30 sec - exiting 13:22:02 (98809): No heartbeat from core client for 30 sec - exiting 13:22:03 (98809): No heartbeat from core client for 30 sec - exiting 13:22:04 (98809): No heartbeat from core client for 30 sec - exiting 13:22:05 (98809): No heartbeat from core client for 30 sec - exiting 13:22:06 (98809): No heartbeat from core client for 30 sec - exiting 13:22:07 (98809): No heartbeat from core client for 30 sec - exiting 13:22:08 (98809): No heartbeat from core client for 30 sec - exiting 13:22:09 (98809): No heartbeat from core client for 30 sec - exiting 13:23:40 (98867): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:27:40 (98871): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:28:40 (98936): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:39:52 (98946): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:39:54 (98946): No heartbeat from core client for 30 sec - exiting 13:39:55 (98946): No heartbeat from core client for 30 sec - exiting 13:39:56 (98946): No heartbeat from core client for 30 sec - exiting 13:39:57 (98946): No heartbeat from core client for 30 sec - exiting 13:39:58 (98946): No heartbeat from core client for 30 sec - exiting 13:39:59 (98946): No heartbeat from core client for 30 sec - exiting 13:40:00 (98946): No heartbeat from core client for 30 sec - exiting 13:40:01 (98946): No heartbeat from core client for 30 sec - exiting 13:40:02 (98946): No heartbeat from core client for 30 sec - exiting 13:40:03 (98946): No heartbeat from core client for 30 sec - exiting 13:40:04 (98946): No heartbeat from core client for 30 sec - exiting 13:40:05 (98946): No heartbeat from core client for 30 sec - exiting 13:40:06 (98946): No heartbeat from core client for 30 sec - exiting 13:40:07 (98946): No heartbeat from core client for 30 sec - exiting 13:40:08 (98946): No heartbeat from core client for 30 sec - exiting 13:40:09 (98946): No heartbeat from core client for 30 sec - exiting 13:40:10 (98946): No heartbeat from core client for 30 sec - exiting 13:40:11 (98946): No heartbeat from core client for 30 sec - exiting 13:40:12 (98946): No heartbeat from core client for 30 sec - exiting 13:40:13 (98946): No heartbeat from core client for 30 sec - exiting 13:40:14 (98946): No heartbeat from core client for 30 sec - exiting 13:40:15 (98946): No heartbeat from core client for 30 sec - exiting 13:40:16 (98946): No heartbeat from core client for 30 sec - exiting 13:40:17 (98946): No heartbeat from core client for 30 sec - exiting 13:40:18 (98946): No heartbeat from core client for 30 sec - exiting 13:40:19 (98946): No heartbeat from core client for 30 sec - exiting 13:40:20 (98946): No heartbeat from core client for 30 sec - exiting 13:40:21 (98946): No heartbeat from core client for 30 sec - exiting 13:40:22 (98946): No heartbeat from core client for 30 sec - exiting 13:40:23 (98946): No heartbeat from core client for 30 sec - exiting 13:40:24 (98946): No heartbeat from core client for 30 sec - exiting 13:40:25 (98946): No heartbeat from core client for 30 sec - exiting 13:40:26 (98946): No heartbeat from core client for 30 sec - exiting 13:40:27 (98946): No heartbeat from core client for 30 sec - exiting 13:40:28 (98946): No heartbeat from core client for 30 sec - exiting 13:40:29 (98946): No heartbeat from core client for 30 sec - exiting 13:40:30 (98946): No heartbeat from core client for 30 sec - exiting 13:40:31 (98946): No heartbeat from core client for 30 sec - exiting 13:40:32 (98946): No heartbeat from core client for 30 sec - exiting 13:40:33 (98946): No heartbeat from core client for 30 sec - exiting 13:40:34 (98946): No heartbeat from core client for 30 sec - exiting 13:40:35 (98946): No heartbeat from core client for 30 sec - exiting 13:40:36 (98946): No heartbeat from core client for 30 sec - exiting 13:40:37 (98946): No heartbeat from core client for 30 sec - exiting 13:40:38 (98946): No heartbeat from core client for 30 sec - exiting 13:40:39 (98946): No heartbeat from core client for 30 sec - exiting 13:40:40 (98946): No heartbeat from core client for 30 sec - exiting 13:40:41 (98946): No heartbeat from core client for 30 sec - exiting 13:40:42 (98946): No heartbeat from core client for 30 sec - exiting 13:40:43 (98946): No heartbeat from core client for 30 sec - exiting 13:40:44 (98946): No heartbeat from core client for 30 sec - exiting 13:40:45 (98946): No heartbeat from core client for 30 sec - exiting 13:40:46 (98946): No heartbeat from core client for 30 sec - exiting 13:40:47 (98946): No heartbeat from core client for 30 sec - exiting 13:40:48 (98946): No heartbeat from core client for 30 sec - exiting 13:40:49 (98946): No heartbeat from core client for 30 sec - exiting 13:40:50 (98946): No heartbeat from core client for 30 sec - exiting 13:40:51 (98946): No heartbeat from core client for 30 sec - exiting 13:40:52 (98946): No heartbeat from core client for 30 sec - exiting 13:40:53 (98946): No heartbeat from core client for 30 sec - exiting 13:40:54 (98946): No heartbeat from core client for 30 sec - exiting 13:40:55 (98946): No heartbeat from core client for 30 sec - exiting 13:40:56 (98946): No heartbeat from core client for 30 sec - exiting 13:40:57 (98946): No heartbeat from core client for 30 sec - exiting 13:40:58 (98946): No heartbeat from core client for 30 sec - exiting 13:40:59 (98946): No heartbeat from core client for 30 sec - exiting 13:41:00 (98946): No heartbeat from core client for 30 sec - exiting 13:41:01 (98946): No heartbeat from core client for 30 sec - exiting 13:41:02 (98946): No heartbeat from core client for 30 sec - exiting 13:41:03 (98946): No heartbeat from core client for 30 sec - exiting 13:41:04 (98946): No heartbeat from core client for 30 sec - exiting 13:41:05 (98946): No heartbeat from core client for 30 sec - exiting 13:41:06 (98946): No heartbeat from core client for 30 sec - exiting 13:41:07 (98946): No heartbeat from core client for 30 sec - exiting 13:41:08 (98946): No heartbeat from core client for 30 sec - exiting 13:49:23 (99054): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:56:49 (99066): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:56:51 (99066): No heartbeat from core client for 30 sec - exiting 13:56:52 (99066): No heartbeat from core client for 30 sec - exiting 13:56:53 (99066): No heartbeat from core client for 30 sec - exiting 13:56:54 (99066): No heartbeat from core client for 30 sec - exiting 13:56:55 (99066): No heartbeat from core client for 30 sec - exiting 13:56:56 (99066): No heartbeat from core client for 30 sec - exiting 13:56:57 (99066): No heartbeat from core client for 30 sec - exiting 14:01:26 (99151): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:01:28 (99151): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 14:10:56 (99199): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:10:58 (99199): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 14:30:59 (99283): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:31:01 (99283): No heartbeat from core client for 30 sec - exiting 14:31:02 (99283): No heartbeat from core client for 30 sec - exiting 14:31:03 (99283): No heartbeat from core client for 30 sec - exiting 14:31:34 (99283): No heartbeat from core client for 30 sec - exiting 14:31:35 (99283): No heartbeat from core client for 30 sec - exiting 14:31:36 (99283): No heartbeat from core client for 30 sec - exiting 14:31:37 (99283): No heartbeat from core client for 30 sec - exiting 14:31:38 (99283): No heartbeat from core client for 30 sec - exiting 14:31:39 (99283): No heartbeat from core client for 30 sec - exiting 14:31:40 (99283): No heartbeat from core client for 30 sec - exiting 14:31:41 (99283): No heartbeat from core client for 30 sec - exiting 14:31:42 (99283): No heartbeat from core client for 30 sec - exiting 14:31:43 (99283): No heartbeat from core client for 30 sec - exiting 14:31:44 (99283): No heartbeat from core client for 30 sec - exiting 14:31:45 (99283): No heartbeat from core client for 30 sec - exiting 14:31:46 (99283): No heartbeat from core client for 30 sec - exiting 14:31:47 (99283): No heartbeat from core client for 30 sec - exiting 14:31:48 (99283): No heartbeat from core client for 30 sec - exiting 14:31:49 (99283): No heartbeat from core client for 30 sec - exiting 14:31:50 (99283): No heartbeat from core client for 30 sec - exiting 14:31:51 (99283): No heartbeat from core client for 30 sec - exiting 14:31:52 (99283): No heartbeat from core client for 30 sec - exiting 14:31:53 (99283): No heartbeat from core client for 30 sec - exiting 14:31:54 (99283): No heartbeat from core client for 30 sec - exiting 14:31:55 (99283): No heartbeat from core client for 30 sec - exiting 14:31:56 (99283): No heartbeat from core client for 30 sec - exiting 14:31:57 (99283): No heartbeat from core client for 30 sec - exiting 14:31:58 (99283): No heartbeat from core client for 30 sec - exiting 14:31:59 (99283): No heartbeat from core client for 30 sec - exiting 14:32:00 (99283): No heartbeat from core client for 30 sec - exiting 14:32:01 (99283): No heartbeat from core client for 30 sec - exiting 14:32:02 (99283): No heartbeat from core client for 30 sec - exiting 14:32:03 (99283): No heartbeat from core client for 30 sec - exiting 14:32:04 (99283): No heartbeat from core client for 30 sec - exiting 14:32:05 (99283): No heartbeat from core client for 30 sec - exiting 14:32:06 (99283): No heartbeat from core client for 30 sec - exiting 14:32:07 (99283): No heartbeat from core client for 30 sec - exiting 14:32:08 (99283): No heartbeat from core client for 30 sec - exiting 14:32:09 (99283): No heartbeat from core client for 30 sec - exiting 14:32:10 (99283): No heartbeat from core client for 30 sec - exiting 14:32:11 (99283): No heartbeat from core client for 30 sec - exiting 14:32:12 (99283): No heartbeat from core client for 30 sec - exiting 14:32:13 (99283): No heartbeat from core client for 30 sec - exiting 14:32:14 (99283): No heartbeat from core client for 30 sec - exiting 14:32:15 (99283): No heartbeat from core client for 30 sec - exiting 14:32:16 (99283): No heartbeat from core client for 30 sec - exiting 14:32:17 (99283): No heartbeat from core client for 30 sec - exiting 14:32:18 (99283): No heartbeat from core client for 30 sec - exiting 14:32:19 (99283): No heartbeat from core client for 30 sec - exiting 14:32:20 (99283): No heartbeat from core client for 30 sec - exiting 14:32:21 (99283): No heartbeat from core client for 30 sec - exiting 14:32:22 (99283): No heartbeat from core client for 30 sec - exiting 14:32:23 (99283): No heartbeat from core client for 30 sec - exiting 14:32:24 (99283): No heartbeat from core client for 30 sec - exiting 14:32:25 (99283): No heartbeat from core client for 30 sec - exiting 14:32:26 (99283): No heartbeat from core client for 30 sec - exiting 14:32:27 (99283): No heartbeat from core client for 30 sec - exiting 14:32:28 (99283): No heartbeat from core client for 30 sec - exiting 14:32:29 (99283): No heartbeat from core client for 30 sec - exiting 14:32:30 (99283): No heartbeat from core client for 30 sec - exiting 14:32:31 (99283): No heartbeat from core client for 30 sec - exiting 14:32:32 (99283): No heartbeat from core client for 30 sec - exiting 14:32:33 (99283): No heartbeat from core client for 30 sec - exiting 14:32:34 (99283): No heartbeat from core client for 30 sec - exiting 14:32:35 (99283): No heartbeat from core client for 30 sec - exiting 14:32:36 (99283): No heartbeat from core client for 30 sec - exiting 14:32:37 (99283): No heartbeat from core client for 30 sec - exiting 14:32:38 (99283): No heartbeat from core client for 30 sec - exiting 14:32:39 (99283): No heartbeat from core client for 30 sec - exiting 14:32:40 (99283): No heartbeat from core client for 30 sec - exiting 14:32:41 (99283): No heartbeat from core client for 30 sec - exiting 14:32:42 (99283): No heartbeat from core client for 30 sec - exiting 14:32:43 (99283): No heartbeat from core client for 30 sec - exiting 14:32:44 (99283): No heartbeat from core client for 30 sec - exiting 14:32:45 (99283): No heartbeat from core client for 30 sec - exiting 14:32:46 (99283): No heartbeat from core client for 30 sec - exiting 14:32:47 (99283): No heartbeat from core client for 30 sec - exiting 14:32:48 (99283): No heartbeat from core client for 30 sec - exiting 14:32:49 (99283): No heartbeat from core client for 30 sec - exiting 14:32:50 (99283): No heartbeat from core client for 30 sec - exiting 14:32:51 (99283): No heartbeat from core client for 30 sec - exiting 14:32:52 (99283): No heartbeat from core client for 30 sec - exiting 14:32:53 (99283): No heartbeat from core client for 30 sec - exiting 14:32:54 (99283): No heartbeat from core client for 30 sec - exiting 14:32:55 (99283): No heartbeat from core client for 30 sec - exiting 14:32:56 (99283): No heartbeat from core client for 30 sec - exiting 14:48:40 (99466): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:54:17 (99546): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 19:51:17 (5522): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:51:19 (5522): No heartbeat from core client for 30 sec - exiting 19:51:20 (5522): No heartbeat from core client for 30 sec - exiting 19:51:21 (5522): No heartbeat from core client for 30 sec - exiting 19:51:22 (5522): No heartbeat from core client for 30 sec - exiting 19:51:23 (5522): No heartbeat from core client for 30 sec - exiting 19:51:24 (5522): No heartbeat from core client for 30 sec - exiting 19:51:25 (5522): No heartbeat from core client for 30 sec - exiting 19:51:26 (5522): No heartbeat from core client for 30 sec - exiting 19:51:27 (5522): No heartbeat from core client for 30 sec - exiting 19:51:28 (5522): No heartbeat from core client for 30 sec - exiting 19:51:29 (5522): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(58914,0xa013d540) malloc: *** error for object 0x2801c00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(90294,0xa013d540) malloc: *** error for object 0x101de04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(90294,0xa013d540) malloc: *** error for object 0x101de00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(90294,0xa013d540) malloc: *** error for object 0x2835204: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(90294,0xa013d540) malloc: *** error for object 0x2835200: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(90294,0xa013d540) malloc: *** error for object 0x2835204: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(90294,0xa013d540) malloc: *** error for object 0x2835200: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(90294,0xa013d540) malloc: *** error for object 0x2835204: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(90294,0xa013d540) malloc: *** error for object 0x2835200: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(90294,0xa013d540) malloc: *** error for object 0x2835204: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(90294,0xa013d540) malloc: *** error for object 0x2835200: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(90294,0xa013d540) malloc: *** error for object 0x2835200: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(6918,0xa013d540) malloc: *** error for object 0x4000e04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.6.8 build 10K549 Sat Oct 13 12:56:03 2012 Thread 0 Crashed: atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386. 0 libSystem.B.dylib 0x90a9cb03 small_free_list_remove_ptr + 234 1 libSystem.B.dylib 0x90a99546 szone_free_definite_size + 3323 2 libSystem.B.dylib 0x90a985e8 free + 244 3 hadcm3n_6.07_i686-apple-darwin 0x0000b99a annual_cycle(std::vector<std::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::allocator<std::basic_string<char, std::char_traits<char>, std::allocator<char> > > > const*, char const*, int, int) + 3292 4 hadcm3n_6.07_i686-apple-darwin 0x0000d36b decadalMeans(int, char const*) + 957 5 hadcm3n_6.07_i686-apple-darwin 0x000067ff doCM3Proc() + 185 6 hadcm3n_6.07_i686-apple-darwin 0x0000876a worker() + 2896 7 hadcm3n_6.07_i686-apple-darwin 0x00008aa9 main + 491 8 hadcm3n_6.07_i686-apple-darwin 0x00002676 start + 54 Thread 1: hadcm3n_6.07_i686-apple-darwin(8884,0xa013d540) malloc: *** error for object 0x4805c04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.6.8 build 10K549 Sat Oct 13 14:11:19 2012 Thread 0 Crashed: atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386. 0 libSystem.B.dylib 0x90a9cb03 small_free_list_remove_ptr + 234 1 libSystem.B.dylib 0x90a995cc szone_free_definite_size + 3457 2 libSystem.B.dylib 0x90a985e8 free + 244 3 hadcm3n_6.07_i686-apple-darwin 0x0000ba58 annual_cycle(std::vector<std::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::allocator<std::basic_string<char, std::char_traits<char>, std::allocator<char> > > > const*, char const*, int, int) + 3482 4 hadcm3n_6.07_i686-apple-darwin 0x0000d36b decadalMeans(int, char const*) + 957 5 hadcm3n_6.07_i686-apple-darwin 0x000067ff doCM3Proc() + 185 6 hadcm3n_6.07_i686-apple-darwin 0x0000876a worker() + 2896 7 hadcm3n_6.07_i686-apple-darwin 0x00008aa9 main + 491 8 hadcm3n_6.07_i686-apple-darwin 0x00002676 start + 54 Thread 1: 0 libSystem.B.dylib 0x90a91c0e mach_wait_until + 10 1 libSystem.B.dylib 0x90b19429 nanosleep + 345 2 libSystem.B.dylib 0x90b192ca usleep + 61 3 hadcm3n_6.07_i686-apple-darwin 0x00071a7c boinc_sleep(double) + 188 4 hadcm3n_6.07_i686-apple-darwin 0x00067282 timer_thread(void*) + 78 5 libSystem.B.dylib 0x90abf259 _pthread_start + 345 6 libSystem.B.dylib 0x90abf0de thread_start + 34 Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8f7e8 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x93fff /Library/Application Support/BOINC Data/slots/3/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin 0x90a91000 - 0x90c38fff /usr/lib/libSystem.B.dylib 0x92370000 - 0x923dafff /usr/lib/libstdc++.6.dylib 0x9291e000 - 0x9292cfff /usr/lib/libz.1.dylib 0x97054000 - 0x97057fff /usr/lib/system/libmathCommon.A.dylib Exiting... </stderr_txt> ]]> |
Latest Trickles Received | ||||||
---|---|---|---|---|---|---|
Time Sent (UTC) | Host ID | Result ID | Result Name | Timestep | CPU Time (sec) | Average (sec/TS) |
12 Oct 2012 05:09:39 | 958046 | 15275434 | hadcm3n_zi2i_1880_40_008199012_1 | 777,600 | 1,587,010 | 2.0409 |
11 Oct 2012 12:56:29 | 958046 | 15275434 | hadcm3n_zi2i_1880_40_008199012_1 | 751,680 | 1,538,702 | 2.0470 |
10 Oct 2012 17:42:03 | 958046 | 15275434 | hadcm3n_zi2i_1880_40_008199012_1 | 725,760 | 1,491,060 | 2.0545 |
09 Oct 2012 20:33:03 | 958046 | 15275434 | hadcm3n_zi2i_1880_40_008199012_1 | 699,840 | 1,441,001 | 2.0590 |
09 Oct 2012 03:34:26 | 958046 | 15275434 | hadcm3n_zi2i_1880_40_008199012_1 | 673,920 | 1,391,372 | 2.0646 |
08 Oct 2012 13:01:58 | 958046 | 15275434 | hadcm3n_zi2i_1880_40_008199012_1 | 648,000 | 1,342,828 | 2.0723 |
07 Oct 2012 22:13:19 | 958046 | 15275434 | hadcm3n_zi2i_1880_40_008199012_1 | 622,080 | 1,294,812 | 2.0814 |
07 Oct 2012 08:24:40 | 958046 | 15275434 | hadcm3n_zi2i_1880_40_008199012_1 | 596,160 | 1,247,412 | 2.0924 |
06 Oct 2012 04:46:32 | 958046 | 15275434 | hadcm3n_zi2i_1880_40_008199012_1 | 570,240 | 1,198,807 | 2.1023 |
05 Oct 2012 04:46:38 | 958046 | 15275434 | hadcm3n_zi2i_1880_40_008199012_1 | 544,320 | 1,154,718 | 2.1214 |
04 Oct 2012 12:39:01 | 958046 | 15275434 | hadcm3n_zi2i_1880_40_008199012_1 | 518,400 | 1,107,187 | 2.1358 |
03 Oct 2012 18:47:39 | 958046 | 15275434 | hadcm3n_zi2i_1880_40_008199012_1 | 492,480 | 1,058,088 | 2.1485 |
03 Oct 2012 00:24:49 | 958046 | 15275434 | hadcm3n_zi2i_1880_40_008199012_1 | 466,560 | 1,007,652 | 2.1597 |
02 Oct 2012 06:11:28 | 958046 | 15275434 | hadcm3n_zi2i_1880_40_008199012_1 | 440,640 | 956,854 | 2.1715 |
01 Oct 2012 14:11:29 | 958046 | 15275434 | hadcm3n_zi2i_1880_40_008199012_1 | 414,720 | 905,905 | 2.1844 |
30 Sep 2012 23:33:25 | 958046 | 15275434 | hadcm3n_zi2i_1880_40_008199012_1 | 388,800 | 858,824 | 2.2089 |
30 Sep 2012 06:01:03 | 958046 | 15275434 | hadcm3n_zi2i_1880_40_008199012_1 | 362,880 | 799,989 | 2.2046 |
29 Sep 2012 12:41:37 | 958046 | 15275434 | hadcm3n_zi2i_1880_40_008199012_1 | 336,960 | 744,159 | 2.2084 |
28 Sep 2012 10:06:37 | 958046 | 15275434 | hadcm3n_zi2i_1880_40_008199012_1 | 311,040 | 687,390 | 2.2100 |
27 Sep 2012 17:10:34 | 958046 | 15275434 | hadcm3n_zi2i_1880_40_008199012_1 | 285,120 | 629,488 | 2.2078 |
©2024 climateprediction.net