Task 16590913

Name	hadcm3n_8ctr_1980_40_008726042_0
Workunit	8872020
Created	23 Apr 2014, 13:35:56 UTC
Sent	29 Apr 2014, 19:34:15 UTC
Report deadline	30 Jul 2014, 3:01:26 UTC
Received	7 Jul 2014, 13:24:42 UTC
Server state	Over
Outcome	Computation error
Client state	Aborted by user
Exit status	203 (0x000000CB) EXIT_ABORTED_VIA_GUI
Computer ID	1295763
Run time	17 days 16 hours 41 min 16 sec
CPU time	15 days 3 hours 43 min 1 sec
Validate state	Invalid
Credit	12,441.60
Device peak FLOPS	3.12 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.2.33</core_client_version> <![CDATA[ <message> aborted by user </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 01:05:51 (30147): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 Error: Input file: dataout/8ctrko.pjj4c10 is not a valid UM file. Error converting file to netcdf: dataout/8ctrko.pjj4c10 Error: Input file: dataout/8ctrko.pij4c10 is not a valid UM file. Error converting file to netcdf: dataout/8ctrko.pij4c10 Error: Input file: dataout/8ctrko.pfj4c10 is not a valid UM file. Error converting file to netcdf: dataout/8ctrko.pfj4c10 Error: Input file: dataout/8ctrka.phj4c10 is not a valid UM file. Error converting file to netcdf: dataout/8ctrka.phj4c10 Error: Input file: dataout/8ctrka.pgj4c10 is not a valid UM file. Error converting file to netcdf: dataout/8ctrka.pgj4c10 Error: Input file: dataout/8ctrka.pej4c10 is not a valid UM file. Error converting file to netcdf: dataout/8ctrka.pej4c10 Error: Input file: dataout/8ctrka.pdj4c10 is not a valid UM file. Error converting file to netcdf: dataout/8ctrka.pdj4c10 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 23:02:09 (36103): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 23:04:02 (78591): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:46:04 (1658): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:28:18 (30736): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:33:28 (888): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:33:29 (888): No heartbeat from core client for 30 sec - exiting 12:33:30 (888): No heartbeat from core client for 30 sec - exiting 12:33:31 (888): No heartbeat from core client for 30 sec - exiting 12:33:32 (888): No heartbeat from core client for 30 sec - exiting 12:33:33 (888): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:45:16 (57609): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:55:35 (59557): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:05:48 (59984): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:56:49 (60439): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:07:14 (62658): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:48:37 (58710): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:48:38 (58710): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 23:05:44 (82103): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:05:45 (82103): No heartbeat from core client for 30 sec - exiting 23:05:46 (82103): No heartbeat from core client for 30 sec - exiting 23:05:47 (82103): No heartbeat from core client for 30 sec - exiting 23:05:48 (82103): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:05:54 (16181): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:15:27 (16536): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:56:10 (45102): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 23:42:45 (81152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 08:50:45 (8851): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 14:14:00 (25207): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:04:01 (33792): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:04:02 (33792): No heartbeat from core client for 30 sec - exiting 17:04:03 (33792): No heartbeat from core client for 30 sec - exiting 17:04:04 (33792): No heartbeat from core client for 30 sec - exiting 17:04:05 (33792): No heartbeat from core client for 30 sec - exiting 17:04:06 (33792): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 21:10:06 (45535): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:10:07 (45535): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 00:33:55 (58927): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 04:17:32 (68477): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:26:03 (39347): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(16504,0xa188d1a8) malloc: * error for object 0xb29400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(16768,0xa0b031a8) malloc: * error for object 0x960804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(16768,0xa0b031a8) malloc: * error for object 0x960800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(16768,0xa0b031a8) malloc: * error for object 0x960804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(16768,0xa0b031a8) malloc: * error for object 0x960800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(16768,0xa0b031a8) malloc: * error for object 0x960804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(16768,0xa0b031a8) malloc: * error for object 0x960800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(16768,0xa0b031a8) malloc: * error for object 0x960804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(16768,0xa0b031a8) malloc: * error for object 0x960800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(16768,0xa0b031a8) malloc: * error for object 0x960804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(16768,0xa0b031a8) malloc: * error for object 0x960800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(16768,0xa0b031a8) malloc: * error for object 0x960800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation 10:10:32 (16768): No heartbeat from core client for 30 sec - exiting 10:10:33 (16768): No heartbeat from core client for 30 sec - exiting 10:10:34 (16768): No heartbeat from core client for 30 sec - exiting 10:10:35 (16768): No heartbeat from core client for 30 sec - exiting 10:10:36 (16768): No heartbeat from core client for 30 sec - exiting 10:10:37 (16768): No heartbeat from core client for 30 sec - exiting Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish hadcm3n_6.07_i686-apple-darwin(69379,0xa0b031a8) malloc: * error for object 0x2400c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(69379,0xa0b031a8) malloc: * error for object 0x2400c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(69379,0xa0b031a8) malloc: * error for object 0x3414e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(69379,0xa0b031a8) malloc: * error for object 0x3414e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(69379,0xa0b031a8) malloc: * error for object 0x3414e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(69379,0xa0b031a8) malloc: * error for object 0x3414e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(69379,0xa0b031a8) malloc: * error for object 0x3414e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) 20:15:27 (69379): No heartbeat from core client for 30 sec - exiting 20:16:01 (69379): No heartbeat from core client for 30 sec - exiting 20:16:02 (69379): No heartbeat from core client for 30 sec - exiting 20:16:03 (69379): No heartbeat from core client for 30 sec - exiting 20:16:04 (69379): No heartbeat from core client for 30 sec - exiting 20:16:05 (69379): No heartbeat from core client for 30 sec - exiting 20:16:06 (69379): No heartbeat from core client for 30 sec - exiting 20:16:07 (69379): No heartbeat from core client for 30 sec - exiting 20:16:08 (69379): No heartbeat from core client for 30 sec - exiting 20:16:09 (69379): No heartbeat from core client for 30 sec - exiting 20:16:10 (69379): No heartbeat from core client for 30 sec - exiting 20:16:11 (69379): No heartbeat from core client for 30 sec - exiting 20:16:42 (69379): No heartbeat from core client for 30 sec - exiting 20:16:43 (69379): No heartbeat from core client for 30 sec - exiting 20:16:44 (69379): No heartbeat from core client for 30 sec - exiting 20:16:45 (69379): No heartbeat from core client for 30 sec - exiting 20:16:46 (69379): No heartbeat from core client for 30 sec - exiting 20:16:47 (69379): No heartbeat from core client for 30 sec - exiting 20:16:48 (69379): No heartbeat from core client for 30 sec - exiting 20:16:49 (69379): No heartbeat from core client for 30 sec - exiting 20:16:50 (69379): No heartbeat from core client for 30 sec - exiting 20:16:51 (69379): No heartbeat from core client for 30 sec - exiting 20:16:52 (69379): No heartbeat from core client for 30 sec - exiting 20:16:53 (69379): No heartbeat from core client for 30 sec - exiting 20:16:54 (69379): No heartbeat from core client for 30 sec - exiting 20:16:55 (69379): No heartbeat from core client for 30 sec - exiting 20:16:56 (69379): No heartbeat from core client for 30 sec - exiting 20:16:57 (69379): No heartbeat from core client for 30 sec - exiting 20:16:58 (69379): No heartbeat from core client for 30 sec - exiting 20:16:59 (69379): No heartbeat from core client for 30 sec - exiting 20:17:00 (69379): No heartbeat from core client for 30 sec - exiting 20:17:01 (69379): No heartbeat from core client for 30 sec - exiting 20:17:02 (69379): No heartbeat from core client for 30 sec - exiting 20:17:03 (69379): No heartbeat from core client for 30 sec - exiting 20:17:04 (69379): No heartbeat from core client for 30 sec - exiting 20:17:05 (69379): No heartbeat from core client for 30 sec - exiting 20:17:06 (69379): No heartbeat from core client for 30 sec - exiting 20:17:07 (69379): No heartbeat from core client for 30 sec - exiting 20:17:08 (69379): No heartbeat from core client for 30 sec - exiting 20:17:09 (69379): No heartbeat from core client for 30 sec - exiting 20:17:10 (69379): No heartbeat from core client for 30 sec - exiting 20:17:11 (69379): No heartbeat from core client for 30 sec - exiting 20:17:12 (69379): No heartbeat from core client for 30 sec - exiting 20:17:13 (69379): No heartbeat from core client for 30 sec - exiting 20:17:14 (69379): No heartbeat from core client for 30 sec - exiting 20:17:15 (69379): No heartbeat from core client for 30 sec - exiting 20:17:16 (69379): No heartbeat from core client for 30 sec - exiting 20:17:17 (69379): No heartbeat from core client for 30 sec - exiting 20:17:18 (69379): No heartbeat from core client for 30 sec - exiting 20:17:19 (69379): No heartbeat from core client for 30 sec - exiting 20:17:20 (69379): No heartbeat from core client for 30 sec - exiting 20:17:21 (69379): No heartbeat from core client for 30 sec - exiting 20:17:22 (69379): No heartbeat from core client for 30 sec - exiting 20:17:26 (69379): No heartbeat from core client for 30 sec - exiting 20:17:27 (69379): No heartbeat from core client for 30 sec - exiting 20:17:28 (69379): No heartbeat from core client for 30 sec - exiting 20:17:29 (69379): No heartbeat from core client for 30 sec - exiting 20:17:30 (69379): No heartbeat from core client for 30 sec - exiting 20:17:31 (69379): No heartbeat from core client for 30 sec - exiting 20:17:32 (69379): No heartbeat from core client for 30 sec - exiting 20:17:33 (69379): No heartbeat from core client for 30 sec - exiting 20:17:34 (69379): No heartbeat from core client for 30 sec - exiting 20:17:35 (69379): No heartbeat from core client for 30 sec - exiting 20:17:36 (69379): No heartbeat from core client for 30 sec - exiting 20:17:37 (69379): No heartbeat from core client for 30 sec - exiting 20:17:38 (69379): No heartbeat from core client for 30 sec - exiting 20:17:39 (69379): No heartbeat from core client for 30 sec - exiting 20:17:40 (69379): No heartbeat from core client for 30 sec - exiting 20:17:41 (69379): No heartbeat from core client for 30 sec - exiting 20:17:42 (69379): No heartbeat from core client for 30 sec - exiting 20:17:43 (69379): No heartbeat from core client for 30 sec - exiting 20:17:44 (69379): No heartbeat from core client for 30 sec - exiting 20:17:45 (69379): No heartbeat from core client for 30 sec - exiting 20:17:46 (69379): No heartbeat from core client for 30 sec - exiting 20:17:47 (69379): No heartbeat from core client for 30 sec - exiting 20:17:48 (69379): No heartbeat from core client for 30 sec - exiting 20:17:49 (69379): No heartbeat from core client for 30 sec - exiting 20:17:50 (69379): No heartbeat from core client for 30 sec - exiting 20:17:51 (69379): No heartbeat from core client for 30 sec - exiting 20:17:52 (69379): No heartbeat from core client for 30 sec - exiting 20:17:53 (69379): No heartbeat from core client for 30 sec - exiting 20:17:54 (69379): No heartbeat from core client for 30 sec - exiting 20:17:55 (69379): No heartbeat from core client for 30 sec - exiting 20:17:56 (69379): No heartbeat from core client for 30 sec - exiting 20:17:57 (69379): No heartbeat from core client for 30 sec - exiting 20:18:28 (69379): No heartbeat from core client for 30 sec - exiting 20:18:29 (69379): No heartbeat from core client for 30 sec - exiting 20:18:30 (69379): No heartbeat from core client for 30 sec - exiting 20:18:31 (69379): No heartbeat from core client for 30 sec - exiting 20:18:32 (69379): No heartbeat from core client for 30 sec - exiting 20:18:33 (69379): No heartbeat from core client for 30 sec - exiting 20:18:34 (69379): No heartbeat from core client for 30 sec - exiting 20:18:35 (69379): No heartbeat from core client for 30 sec - exiting 20:18:36 (69379): No heartbeat from core client for 30 sec - exiting 20:18:37 (69379): No heartbeat from core client for 30 sec - exiting 20:18:38 (69379): No heartbeat from core client for 30 sec - exiting 20:18:39 (69379): No heartbeat from core client for 30 sec - exiting 20:18:40 (69379): No heartbeat from core client for 30 sec - exiting 20:18:41 (69379): No heartbeat from core client for 30 sec - exiting 20:18:42 (69379): No heartbeat from core client for 30 sec - exiting 20:18:43 (69379): No heartbeat from core client for 30 sec - exiting 20:18:44 (69379): No heartbeat from core client for 30 sec - exiting 20:18:45 (69379): No heartbeat from core client for 30 sec - exiting 20:18:46 (69379): No heartbeat from core client for 30 sec - exiting 20:18:47 (69379): No heartbeat from core client for 30 sec - exiting 20:18:48 (69379): No heartbeat from core client for 30 sec - exiting 20:18:50 (69379): No heartbeat from core client for 30 sec - exiting 20:18:51 (69379): No heartbeat from core client for 30 sec - exiting 20:18:52 (69379): No heartbeat from core client for 30 sec - exiting 20:18:53 (69379): No heartbeat from core client for 30 sec - exiting 20:18:54 (69379): No heartbeat from core client for 30 sec - exiting 20:18:55 (69379): No heartbeat from core client for 30 sec - exiting 20:18:56 (69379): No heartbeat from core client for 30 sec - exiting 20:18:57 (69379): No heartbeat from core client for 30 sec - exiting 20:18:58 (69379): No heartbeat from core client for 30 sec - exiting 20:18:59 (69379): No heartbeat from core client for 30 sec - exiting 20:19:00 (69379): No heartbeat from core client for 30 sec - exiting 20:19:01 (69379): No heartbeat from core client for 30 sec - exiting 20:19:02 (69379): No heartbeat from core client for 30 sec - exiting 20:19:03 (69379): No heartbeat from core client for 30 sec - exiting 20:19:04 (69379): No heartbeat from core client for 30 sec - exiting 20:19:05 (69379): No heartbeat from core client for 30 sec - exiting 20:19:36 (69379): No heartbeat from core client for 30 sec - exiting 20:19:38 (69379): No heartbeat from core client for 30 sec - exiting 20:19:39 (69379): No heartbeat from core client for 30 sec - exiting 20:19:40 (69379): No heartbeat from core client for 30 sec - exiting 20:19:41 (69379): No heartbeat from core client for 30 sec - exiting 20:19:42 (69379): No heartbeat from core client for 30 sec - exiting 20:19:43 (69379): No heartbeat from core client for 30 sec - exiting 20:19:44 (69379): No heartbeat from core client for 30 sec - exiting 20:19:45 (69379): No heartbeat from core client for 30 sec - exiting 20:19:46 (69379): No heartbeat from core client for 30 sec - exiting 20:19:47 (69379): No heartbeat from core client for 30 sec - exiting 20:19:48 (69379): No heartbeat from core client for 30 sec - exiting 20:19:49 (69379): No heartbeat from core client for 30 sec - exiting 20:19:50 (69379): No heartbeat from core client for 30 sec - exiting 20:19:51 (69379): No heartbeat from core client for 30 sec - exiting 20:19:52 (69379): No heartbeat from core client for 30 sec - exiting 20:19:53 (69379): No heartbeat from core client for 30 sec - exiting 20:19:54 (69379): No heartbeat from core client for 30 sec - exiting 20:19:55 (69379): No heartbeat from core client for 30 sec - exiting 20:19:56 (69379): No heartbeat from core client for 30 sec - exiting 20:19:57 (69379): No heartbeat from core client for 30 sec - exiting 20:19:58 (69379): No heartbeat from core client for 30 sec - exiting 20:19:59 (69379): No heartbeat from core client for 30 sec - exiting 20:20:00 (69379): No heartbeat from core client for 30 sec - exiting 20:20:01 (69379): No heartbeat from core client for 30 sec - exiting 20:20:02 (69379): No heartbeat from core client for 30 sec - exiting 20:20:03 (69379): No heartbeat from core client for 30 sec - exiting 20:20:04 (69379): No heartbeat from core client for 30 sec - exiting 20:20:05 (69379): No heartbeat from core client for 30 sec - exiting 20:20:06 (69379): No heartbeat from core client for 30 sec - exiting 20:20:07 (69379): No heartbeat from core client for 30 sec - exiting 20:20:08 (69379): No heartbeat from core client for 30 sec - exiting 20:20:09 (69379): No heartbeat from core client for 30 sec - exiting 20:20:10 (69379): No heartbeat from core client for 30 sec - exiting 20:20:11 (69379): No heartbeat from core client for 30 sec - exiting 20:20:12 (69379): No heartbeat from core client for 30 sec - exiting 20:20:13 (69379): No heartbeat from core client for 30 sec - exiting 20:20:14 (69379): No heartbeat from core client for 30 sec - exiting 20:20:15 (69379): No heartbeat from core client for 30 sec - exiting 20:20:16 (69379): No heartbeat from core client for 30 sec - exiting 20:20:17 (69379): No heartbeat from core client for 30 sec - exiting 20:20:18 (69379): No heartbeat from core client for 30 sec - exiting 20:20:19 (69379): No heartbeat from core client for 30 sec - exiting 20:20:20 (69379): No heartbeat from core client for 30 sec - exiting 20:20:21 (69379): No heartbeat from core client for 30 sec - exiting 20:20:22 (69379): No heartbeat from core client for 30 sec - exiting 20:20:23 (69379): No heartbeat from core client for 30 sec - exiting 20:20:24 (69379): No heartbeat from core client for 30 sec - exiting 20:20:25 (69379): No heartbeat from core client for 30 sec - exiting 20:20:26 (69379): No heartbeat from core client for 30 sec - exiting 20:20:27 (69379): No heartbeat from core client for 30 sec - exiting 20:20:28 (69379): No heartbeat from core client for 30 sec - exiting 20:20:29 (69379): No heartbeat from core client for 30 sec - exiting 20:20:30 (69379): No heartbeat from core client for 30 sec - exiting 20:20:31 (69379): No heartbeat from core client for 30 sec - exiting 20:20:32 (69379): No heartbeat from core client for 30 sec - exiting 20:20:33 (69379): No heartbeat from core client for 30 sec - exiting 20:20:34 (69379): No heartbeat from core client for 30 sec - exiting 20:20:35 (69379): No heartbeat from core client for 30 sec - exiting 20:20:36 (69379): No heartbeat from core client for 30 sec - exiting 20:20:37 (69379): No heartbeat from core client for 30 sec - exiting 20:20:38 (69379): No heartbeat from core client for 30 sec - exiting 20:20:39 (69379): No heartbeat from core client for 30 sec - exiting 20:20:40 (69379): No heartbeat from core client for 30 sec - exiting 20:20:41 (69379): No heartbeat from core client for 30 sec - exiting 20:20:42 (69379): No heartbeat from core client for 30 sec - exiting 20:20:43 (69379): No heartbeat from core client for 30 sec - exiting 20:20:44 (69379): No heartbeat from core client for 30 sec - exiting 20:20:45 (69379): No heartbeat from core client for 30 sec - exiting 20:20:46 (69379): No heartbeat from core client for 30 sec - exiting 20:20:47 (69379): No heartbeat from core client for 30 sec - exiting 20:20:48 (69379): No heartbeat from core client for 30 sec - exiting 20:20:49 (69379): No heartbeat from core client for 30 sec - exiting 20:20:50 (69379): No heartbeat from core client for 30 sec - exiting 20:20:51 (69379): No heartbeat from core client for 30 sec - exiting 20:20:52 (69379): No heartbeat from core client for 30 sec - exiting 20:20:53 (69379): No heartbeat from core client for 30 sec - exiting 20:20:54 (69379): No heartbeat from core client for 30 sec - exiting 20:20:55 (69379): No heartbeat from core client for 30 sec - exiting 20:20:56 (69379): No heartbeat from core client for 30 sec - exiting 20:20:57 (69379): No heartbeat from core client for 30 sec - exiting 20:20:58 (69379): No heartbeat from core client for 30 sec - exiting 20:20:59 (69379): No heartbeat from core client for 30 sec - exiting 20:21:00 (69379): No heartbeat from core client for 30 sec - exiting 20:21:01 (69379): No heartbeat from core client for 30 sec - exiting 20:21:02 (69379): No heartbeat from core client for 30 sec - exiting 20:21:03 (69379): No heartbeat from core client for 30 sec - exiting 20:21:04 (69379): No heartbeat from core client for 30 sec - exiting 20:21:05 (69379): No heartbeat from core client for 30 sec - exiting 20:21:06 (69379): No heartbeat from core client for 30 sec - exiting 20:21:07 (69379): No heartbeat from core client for 30 sec - exiting 20:21:08 (69379): No heartbeat from core client for 30 sec - exiting 20:21:09 (69379): No heartbeat from core client for 30 sec - exiting 20:21:10 (69379): No heartbeat from core client for 30 sec - exiting 20:21:11 (69379): No heartbeat from core client for 30 sec - exiting 20:21:12 (69379): No heartbeat from core client for 30 sec - exiting 20:21:13 (69379): No heartbeat from core client for 30 sec - exiting 20:21:14 (69379): No heartbeat from core client for 30 sec - exiting 20:21:15 (69379): No heartbeat from core client for 30 sec - exiting 20:21:16 (69379): No heartbeat from core client for 30 sec - exiting 20:21:17 (69379): No heartbeat from core client for 30 sec - exiting 20:21:18 (69379): No heartbeat from core client for 30 sec - exiting 20:21:19 (69379): No heartbeat from core client for 30 sec - exiting 20:21:21 (69379): No heartbeat from core client for 30 sec - exiting 20:21:22 (69379): No heartbeat from core client for 30 sec - exiting 20:21:23 (69379): No heartbeat from core client for 30 sec - exiting 20:21:24 (69379): No heartbeat from core client for 30 sec - exiting 20:23:13 (69379): No heartbeat from core client for 30 sec - exiting 20:23:17 (69379): No heartbeat from core client for 30 sec - exiting 20:23:18 (69379): No heartbeat from core client for 30 sec - exiting 20:23:19 (69379): No heartbeat from core client for 30 sec - exiting 20:23:20 (69379): No heartbeat from core client for 30 sec - exiting 20:23:21 (69379): No heartbeat from core client for 30 sec - exiting 20:23:22 (69379): No heartbeat from core client for 30 sec - exiting 20:23:23 (69379): No heartbeat from core client for 30 sec - exiting 20:23:24 (69379): No heartbeat from core client for 30 sec - exiting 20:23:25 (69379): No heartbeat from core client for 30 sec - exiting 20:23:26 (69379): No heartbeat from core client for 30 sec - exiting 20:23:27 (69379): No heartbeat from core client for 30 sec - exiting 20:23:28 (69379): No heartbeat from core client for 30 sec - exiting 20:23:29 (69379): No heartbeat from core client for 30 sec - exiting 20:23:30 (69379): No heartbeat from core client for 30 sec - exiting 20:23:31 (69379): No heartbeat from core client for 30 sec - exiting 20:23:32 (69379): No heartbeat from core client for 30 sec - exiting 20:23:33 (69379): No heartbeat from core client for 30 sec - exiting 20:23:34 (69379): No heartbeat from core client for 30 sec - exiting 20:23:35 (69379): No heartbeat from core client for 30 sec - exiting 20:23:36 (69379): No heartbeat from core client for 30 sec - exiting 20:23:37 (69379): No heartbeat from core client for 30 sec - exiting 20:23:38 (69379): No heartbeat from core client for 30 sec - exiting 20:23:39 (69379): No heartbeat from core client for 30 sec - exiting 20:23:40 (69379): No heartbeat from core client for 30 sec - exiting 20:23:41 (69379): No heartbeat from core client for 30 sec - exiting 20:23:42 (69379): No heartbeat from core client for 30 sec - exiting 20:23:43 (69379): No heartbeat from core client for 30 sec - exiting 20:23:44 (69379): No heartbeat from core client for 30 sec - exiting 20:23:45 (69379): No heartbeat from core client for 30 sec - exiting 20:23:46 (69379): No heartbeat from core client for 30 sec - exiting 20:23:47 (69379): No heartbeat from core client for 30 sec - exiting 20:23:48 (69379): No heartbeat from core client for 30 sec - exiting 20:23:49 (69379): No heartbeat from core client for 30 sec - exiting 20:23:50 (69379): No heartbeat from core client for 30 sec - exiting 20:23:51 (69379): No heartbeat from core client for 30 sec - exiting 20:23:52 (69379): No heartbeat from core client for 30 sec - exiting 20:23:53 (69379): No heartbeat from core client for 30 sec - exiting 20:23:54 (69379): No heartbeat from core client for 30 sec - exiting 20:23:55 (69379): No heartbeat from core client for 30 sec - exiting 20:23:56 (69379): No heartbeat from core client for 30 sec - exiting 20:23:57 (69379): No heartbeat from core client for 30 sec - exiting 20:23:58 (69379): No heartbeat from core client for 30 sec - exiting 20:23:59 (69379): No heartbeat from core client for 30 sec - exiting 20:24:00 (69379): No heartbeat from core client for 30 sec - exiting 20:24:35 (69379): No heartbeat from core client for 30 sec - exiting 20:24:36 (69379): No heartbeat from core client for 30 sec - exiting 20:24:37 (69379): No heartbeat from core client for 30 sec - exiting 20:24:38 (69379): No heartbeat from core client for 30 sec - exiting 20:24:39 (69379): No heartbeat from core client for 30 sec - exiting 20:24:40 (69379): No heartbeat from core client for 30 sec - exiting 20:24:41 (69379): No heartbeat from core client for 30 sec - exiting 20:24:42 (69379): No heartbeat from core client for 30 sec - exiting 20:24:43 (69379): No heartbeat from core client for 30 sec - exiting 20:24:44 (69379): No heartbeat from core client for 30 sec - exiting 20:24:45 (69379): No heartbeat from core client for 30 sec - exiting 20:24:46 (69379): No heartbeat from core client for 30 sec - exiting 20:24:47 (69379): No heartbeat from core client for 30 sec - exiting 20:24:48 (69379): No heartbeat from core client for 30 sec - exiting 20:24:49 (69379): No heartbeat from core client for 30 sec - exiting 20:24:50 (69379): No heartbeat from core client for 30 sec - exiting 20:24:51 (69379): No heartbeat from core client for 30 sec - exiting 20:24:52 (69379): No heartbeat from core client for 30 sec - exiting 20:24:53 (69379): No heartbeat from core client for 30 sec - exiting 20:24:54 (69379): No heartbeat from core client for 30 sec - exiting 20:24:55 (69379): No heartbeat from core client for 30 sec - exiting 20:24:56 (69379): No heartbeat from core client for 30 sec - exiting 20:24:57 (69379): No heartbeat from core client for 30 sec - exiting 20:24:58 (69379): No heartbeat from core client for 30 sec - exiting 20:24:59 (69379): No heartbeat from core client for 30 sec - exiting 20:25:00 (69379): No heartbeat from core client for 30 sec - exiting 20:25:01 (69379): No heartbeat from core client for 30 sec - exiting 20:25:02 (69379): No heartbeat from core client for 30 sec - exiting 20:25:03 (69379): No heartbeat from core client for 30 sec - exiting 20:25:04 (69379): No heartbeat from core client for 30 sec - exiting 20:25:05 (69379): No heartbeat from core client for 30 sec - exiting 20:25:06 (69379): No heartbeat from core client for 30 sec - exiting 20:25:07 (69379): No heartbeat from core client for 30 sec - exiting 20:25:08 (69379): No heartbeat from core client for 30 sec - exiting 20:44:38 (69379): No heartbeat from core client for 30 sec - exiting 20:48:20 (69379): No heartbeat from core client for 30 sec - exiting 20:48:21 (69379): No heartbeat from core client for 30 sec - exiting 20:48:22 (69379): No heartbeat from core client for 30 sec - exiting 20:48:23 (69379): No heartbeat from core client for 30 sec - exiting 20:48:24 (69379): No heartbeat from core client for 30 sec - exiting 20:48:25 (69379): No heartbeat from core client for 30 sec - exiting 20:48:26 (69379): No heartbeat from core client for 30 sec - exiting 20:48:28 (69379): No heartbeat from core client for 30 sec - exiting 20:48:29 (69379): No heartbeat from core client for 30 sec - exiting 20:48:30 (69379): No heartbeat from core client for 30 sec - exiting 20:48:31 (69379): No heartbeat from core client for 30 sec - exiting 20:48:32 (69379): No heartbeat from core client for 30 sec - exiting 20:48:33 (69379): No heartbeat from core client for 30 sec - exiting 20:48:34 (69379): No heartbeat from core client for 30 sec - exiting 20:48:35 (69379): No heartbeat from core client for 30 sec - exiting 20:48:36 (69379): No heartbeat from core client for 30 sec - exiting 20:48:37 (69379): No heartbeat from core client for 30 sec - exiting 20:48:38 (69379): No heartbeat from core client for 30 sec - exiting 20:48:39 (69379): No heartbeat from core client for 30 sec - exiting 20:48:40 (69379): No heartbeat from core client for 30 sec - exiting 20:48:41 (69379): No heartbeat from core client for 30 sec - exiting 20:48:42 (69379): No heartbeat from core client for 30 sec - exiting 20:48:43 (69379): No heartbeat from core client for 30 sec - exiting 20:48:44 (69379): No heartbeat from core client for 30 sec - exiting 20:49:33 (69379): No heartbeat from core client for 30 sec - exiting 20:49:34 (69379): No heartbeat from core client for 30 sec - exiting 20:49:35 (69379): No heartbeat from core client for 30 sec - exiting 20:49:36 (69379): No heartbeat from core client for 30 sec - exiting 20:49:37 (69379): No heartbeat from core client for 30 sec - exiting 20:49:38 (69379): No heartbeat from core client for 30 sec - exiting 20:49:39 (69379): No heartbeat from core client for 30 sec - exiting 20:49:40 (69379): No heartbeat from core client for 30 sec - exiting 20:49:41 (69379): No heartbeat from core client for 30 sec - exiting 20:49:42 (69379): No heartbeat from core client for 30 sec - exiting 20:49:43 (69379): No heartbeat from core client for 30 sec - exiting 20:49:44 (69379): No heartbeat from core client for 30 sec - exiting 20:49:45 (69379): No heartbeat from core client for 30 sec - exiting 20:49:46 (69379): No heartbeat from core client for 30 sec - exiting 20:49:47 (69379): No heartbeat from core client for 30 sec - exiting 20:49:48 (69379): No heartbeat from core client for 30 sec - exiting 20:49:49 (69379): No heartbeat from core client for 30 sec - exiting 20:49:50 (69379): No heartbeat from core client for 30 sec - exiting 20:49:51 (69379): No heartbeat from core client for 30 sec - exiting 20:49:52 (69379): No heartbeat from core client for 30 sec - exiting 20:49:53 (69379): No heartbeat from core client for 30 sec - exiting 20:49:54 (69379): No heartbeat from core client for 30 sec - exiting 20:49:55 (69379): No heartbeat from core client for 30 sec - exiting 20:50:49 (69379): No heartbeat from core client for 30 sec - exiting 20:50:50 (69379): No heartbeat from core client for 30 sec - exiting 20:50:51 (69379): No heartbeat from core client for 30 sec - exiting 20:50:52 (69379): No heartbeat from core client for 30 sec - exiting 20:50:53 (69379): No heartbeat from core client for 30 sec - exiting 20:50:54 (69379): No heartbeat from core client for 30 sec - exiting 20:50:55 (69379): No heartbeat from core client for 30 sec - exiting 20:50:56 (69379): No heartbeat from core client for 30 sec - exiting 20:50:57 (69379): No heartbeat from core client for 30 sec - exiting 20:50:58 (69379): No heartbeat from core client for 30 sec - exiting 20:50:59 (69379): No heartbeat from core client for 30 sec - exiting 20:51:00 (69379): No heartbeat from core client for 30 sec - exiting 20:51:01 (69379): No heartbeat from core client for 30 sec - exiting 20:51:02 (69379): No heartbeat from core client for 30 sec - exiting 20:51:03 (69379): No heartbeat from core client for 30 sec - exiting 20:51:04 (69379): No heartbeat from core client for 30 sec - exiting 20:51:05 (69379): No heartbeat from core client for 30 sec - exiting 20:51:06 (69379): No heartbeat from core client for 30 sec - exiting 20:51:07 (69379): No heartbeat from core client for 30 sec - exiting 20:51:08 (69379): No heartbeat from core client for 30 sec - exiting 20:51:09 (69379): No heartbeat from core client for 30 sec - exiting 20:51:10 (69379): No heartbeat from core client for 30 sec - exiting 20:51:11 (69379): No heartbeat from core client for 30 sec - exiting 20:51:12 (69379): No heartbeat from core client for 30 sec - exiting 20:51:13 (69379): No heartbeat from core client for 30 sec - exiting 20:51:14 (69379): No heartbeat from core client for 30 sec - exiting 20:51:15 (69379): No heartbeat from core client for 30 sec - exiting 20:51:16 (69379): No heartbeat from core client for 30 sec - exiting 20:51:17 (69379): No heartbeat from core client for 30 sec - exiting 20:51:18 (69379): No heartbeat from core client for 30 sec - exiting 20:51:19 (69379): No heartbeat from core client for 30 sec - exiting 20:51:20 (69379): No heartbeat from core client for 30 sec - exiting 20:51:21 (69379): No heartbeat from core client for 30 sec - exiting 20:51:22 (69379): No heartbeat from core client for 30 sec - exiting 20:52:03 (69379): No heartbeat from core client for 30 sec - exiting 20:52:04 (69379): No heartbeat from core client for 30 sec - exiting 20:52:05 (69379): No heartbeat from core client for 30 sec - exiting 21:01:51 (69379): No heartbeat from core client for 30 sec - exiting 21:01:52 (69379): No heartbeat from core client for 30 sec - exiting 21:01:53 (69379): No heartbeat from core client for 30 sec - exiting 21:01:54 (69379): No heartbeat from core client for 30 sec - exiting 21:01:55 (69379): No heartbeat from core client for 30 sec - exiting 21:01:56 (69379): No heartbeat from core client for 30 sec - exiting 21:02:49 (69379): No heartbeat from core client for 30 sec - exiting 21:02:50 (69379): No heartbeat from core client for 30 sec - exiting 21:02:51 (69379): No heartbeat from core client for 30 sec - exiting 21:02:52 (69379): No heartbeat from core client for 30 sec - exiting 21:02:53 (69379): No heartbeat from core client for 30 sec - exiting 21:02:54 (69379): No heartbeat from core client for 30 sec - exiting 21:02:55 (69379): No heartbeat from core client for 30 sec - exiting 21:02:56 (69379): No heartbeat from core client for 30 sec - exiting 21:02:57 (69379): No heartbeat from core client for 30 sec - exiting 21:02:58 (69379): No heartbeat from core client for 30 sec - exiting 21:02:59 (69379): No heartbeat from core client for 30 sec - exiting 21:03:00 (69379): No heartbeat from core client for 30 sec - exiting 21:03:01 (69379): No heartbeat from core client for 30 sec - exiting 21:03:02 (69379): No heartbeat from core client for 30 sec - exiting 21:03:03 (69379): No heartbeat from core client for 30 sec - exiting 21:03:04 (69379): No heartbeat from core client for 30 sec - exiting 21:03:05 (69379): No heartbeat from core client for 30 sec - exiting 21:03:06 (69379): No heartbeat from core client for 30 sec - exiting 21:03:07 (69379): No heartbeat from core client for 30 sec - exiting 21:03:08 (69379): No heartbeat from core client for 30 sec - exiting 21:03:10 (69379): No heartbeat from core client for 30 sec - exiting 21:03:11 (69379): No heartbeat from core client for 30 sec - exiting 21:03:12 (69379): No heartbeat from core client for 30 sec - exiting 21:03:13 (69379): No heartbeat from core client for 30 sec - exiting 21:23:52 (69379): No heartbeat from core client for 30 sec - exiting 21:23:53 (69379): No heartbeat from core client for 30 sec - exiting 21:23:54 (69379): No heartbeat from core client for 30 sec - exiting 21:23:55 (69379): No heartbeat from core client for 30 sec - exiting 21:23:56 (69379): No heartbeat from core client for 30 sec - exiting 21:23:57 (69379): No heartbeat from core client for 30 sec - exiting 21:23:58 (69379): No heartbeat from core client for 30 sec - exiting 21:23:59 (69379): No heartbeat from core client for 30 sec - exiting 21:24:00 (69379): No heartbeat from core client for 30 sec - exiting 21:24:01 (69379): No heartbeat from core client for 30 sec - exiting 21:24:02 (69379): No heartbeat from core client for 30 sec - exiting 21:24:03 (69379): No heartbeat from core client for 30 sec - exiting 21:24:04 (69379): No heartbeat from core client for 30 sec - exiting 21:24:05 (69379): No heartbeat from core client for 30 sec - exiting 21:24:06 (69379): No heartbeat from core client for 30 sec - exiting 21:24:07 (69379): No heartbeat from core client for 30 sec - exiting 21:24:08 (69379): No heartbeat from core client for 30 sec - exiting 21:24:09 (69379): No heartbeat from core client for 30 sec - exiting 21:24:10 (69379): No heartbeat from core client for 30 sec - exiting 21:24:11 (69379): No heartbeat from core client for 30 sec - exiting 21:24:12 (69379): No heartbeat from core client for 30 sec - exiting 21:24:13 (69379): No heartbeat from core client for 30 sec - exiting 21:24:14 (69379): No heartbeat from core client for 30 sec - exiting 21:24:15 (69379): No heartbeat from core client for 30 sec - exiting 21:24:16 (69379): No heartbeat from core client for 30 sec - exiting 21:24:17 (69379): No heartbeat from core client for 30 sec - exiting 21:24:49 (69379): No heartbeat from core client for 30 sec - exiting 21:24:50 (69379): No heartbeat from core client for 30 sec - exiting 21:24:51 (69379): No heartbeat from core client for 30 sec - exiting 21:24:52 (69379): No heartbeat from core client for 30 sec - exiting 21:24:53 (69379): No heartbeat from core client for 30 sec - exiting 21:24:54 (69379): No heartbeat from core client for 30 sec - exiting 21:24:55 (69379): No heartbeat from core client for 30 sec - exiting 21:24:56 (69379): No heartbeat from core client for 30 sec - exiting 21:24:57 (69379): No heartbeat from core client for 30 sec - exiting 21:24:58 (69379): No heartbeat from core client for 30 sec - exiting 21:24:59 (69379): No heartbeat from core client for 30 sec - exiting 21:25:00 (69379): No heartbeat from core client for 30 sec - exiting 21:25:01 (69379): No heartbeat from core client for 30 sec - exiting 21:25:02 (69379): No heartbeat from core client for 30 sec - exiting 21:25:03 (69379): No heartbeat from core client for 30 sec - exiting 21:25:04 (69379): No heartbeat from core client for 30 sec - exiting 21:25:05 (69379): No heartbeat from core client for 30 sec - exiting 21:25:06 (69379): No heartbeat from core client for 30 sec - exiting 21:25:07 (69379): No heartbeat from core client for 30 sec - exiting 21:25:08 (69379): No heartbeat from core client for 30 sec - exiting 21:25:09 (69379): No heartbeat from core client for 30 sec - exiting 21:25:10 (69379): No heartbeat from core client for 30 sec - exiting 21:25:11 (69379): No heartbeat from core client for 30 sec - exiting 21:27:11 (69379): No heartbeat from core client for 30 sec - exiting 21:27:12 (69379): No heartbeat from core client for 30 sec - exiting 23:58:49 (69379): No heartbeat from core client for 30 sec - exiting 23:58:50 (69379): No heartbeat from core client for 30 sec - exiting 23:58:51 (69379): No heartbeat from core client for 30 sec - exiting 23:58:52 (69379): No heartbeat from core client for 30 sec - exiting 23:58:53 (69379): No heartbeat from core client for 30 sec - exiting 23:58:54 (69379): No heartbeat from core client for 30 sec - exiting 23:58:55 (69379): No heartbeat from core client for 30 sec - exiting 23:58:56 (69379): No heartbeat from core client for 30 sec - exiting 23:58:57 (69379): No heartbeat from core client for 30 sec - exiting 23:58:58 (69379): No heartbeat from core client for 30 sec - exiting 23:58:59 (69379): No heartbeat from core client for 30 sec - exiting 23:59:00 (69379): No heartbeat from core client for 30 sec - exiting 23:59:01 (69379): No heartbeat from core client for 30 sec - exiting 23:59:02 (69379): No heartbeat from core client for 30 sec - exiting 23:59:03 (69379): No heartbeat from core client for 30 sec - exiting 23:59:04 (69379): No heartbeat from core client for 30 sec - exiting 23:59:05 (69379): No heartbeat from core client for 30 sec - exiting 23:59:06 (69379): No heartbeat from core client for 30 sec - exiting 23:59:07 (69379): No heartbeat from core client for 30 sec - exiting 23:59:08 (69379): No heartbeat from core client for 30 sec - exiting 23:59:09 (69379): No heartbeat from core client for 30 sec - exiting 23:59:10 (69379): No heartbeat from core client for 30 sec - exiting 23:59:11 (69379): No heartbeat from core client for 30 sec - exiting 23:59:12 (69379): No heartbeat from core client for 30 sec - exiting 23:59:13 (69379): No heartbeat from core client for 30 sec - exiting 23:59:14 (69379): No heartbeat from core client for 30 sec - exiting 23:59:15 (69379): No heartbeat from core client for 30 sec - exiting 23:59:16 (69379): No heartbeat from core client for 30 sec - exiting 23:59:17 (69379): No heartbeat from core client for 30 sec - exiting 23:59:18 (69379): No heartbeat from core client for 30 sec - exiting 23:59:19 (69379): No heartbeat from core client for 30 sec - exiting 23:59:20 (69379): No heartbeat from core client for 30 sec - exiting 23:59:21 (69379): No heartbeat from core client for 30 sec - exiting 23:59:22 (69379): No heartbeat from core client for 30 sec - exiting 23:59:23 (69379): No heartbeat from core client for 30 sec - exiting 23:59:24 (69379): No heartbeat from core client for 30 sec - exiting 23:59:25 (69379): No heartbeat from core client for 30 sec - exiting 00:00:06 (69379): No heartbeat from core client for 30 sec - exiting 00:00:07 (69379): No heartbeat from core client for 30 sec - exiting 00:00:08 (69379): No heartbeat from core client for 30 sec - exiting 00:00:09 (69379): No heartbeat from core client for 30 sec - exiting 00:00:10 (69379): No heartbeat from core client for 30 sec - exiting 00:00:11 (69379): No heartbeat from core client for 30 sec - exiting 00:00:12 (69379): No heartbeat from core client for 30 sec - exiting 00:00:13 (69379): No heartbeat from core client for 30 sec - exiting 00:00:14 (69379): No heartbeat from core client for 30 sec - exiting 00:00:15 (69379): No heartbeat from core client for 30 sec - exiting 00:00:16 (69379): No heartbeat from core client for 30 sec - exiting 00:00:17 (69379): No heartbeat from core client for 30 sec - exiting 00:00:18 (69379): No heartbeat from core client for 30 sec - exiting 00:00:19 (69379): No heartbeat from core client for 30 sec - exiting 00:00:20 (69379): No heartbeat from core client for 30 sec - exiting 00:00:21 (69379): No heartbeat from core client for 30 sec - exiting 00:00:22 (69379): No heartbeat from core client for 30 sec - exiting 00:00:23 (69379): No heartbeat from core client for 30 sec - exiting 00:00:24 (69379): No heartbeat from core client for 30 sec - exiting 00:00:25 (69379): No heartbeat from core client for 30 sec - exiting 00:00:26 (69379): No heartbeat from core client for 30 sec - exiting 00:00:27 (69379): No heartbeat from core client for 30 sec - exiting 00:00:28 (69379): No heartbeat from core client for 30 sec - exiting 00:12:46 (69379): No heartbeat from core client for 30 sec - exiting 00:12:47 (69379): No heartbeat from core client for 30 sec - exiting 00:12:48 (69379): No heartbeat from core client for 30 sec - exiting 00:32:16 (69379): No heartbeat from core client for 30 sec - exiting 00:32:17 (69379): No heartbeat from core client for 30 sec - exiting 00:32:18 (69379): No heartbeat from core client for 30 sec - exiting 00:32:19 (69379): No heartbeat from core client for 30 sec - exiting 00:32:20 (69379): No heartbeat from core client for 30 sec - exiting 00:32:21 (69379): No heartbeat from core client for 30 sec - exiting 00:32:22 (69379): No heartbeat from core client for 30 sec - exiting 00:32:23 (69379): No heartbeat from core client for 30 sec - exiting 00:32:24 (69379): No heartbeat from core client for 30 sec - exiting 00:32:25 (69379): No heartbeat from core client for 30 sec - exiting 00:32:26 (69379): No heartbeat from core client for 30 sec - exiting 00:32:27 (69379): No heartbeat from core client for 30 sec - exiting 00:32:28 (69379): No heartbeat from core client for 30 sec - exiting 00:32:29 (69379): No heartbeat from core client for 30 sec - exiting 00:32:30 (69379): No heartbeat from core client for 30 sec - exiting 00:32:31 (69379): No heartbeat from core client for 30 sec - exiting 00:32:32 (69379): No heartbeat from core client for 30 sec - exiting 00:32:33 (69379): No heartbeat from core client for 30 sec - exiting 00:32:34 (69379): No heartbeat from core client for 30 sec - exiting </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
30 Jun 2014 15:07:33	1295763	16590913	hadcm3n_8ctr_1980_40_008726042_0	1,036,800	1,308,845	1.2624
28 Jun 2014 16:12:04	1295763	16590913	hadcm3n_8ctr_1980_40_008726042_0	1,010,880	1,280,522	1.2667
23 Jun 2014 18:14:52	1295763	16590913	hadcm3n_8ctr_1980_40_008726042_0	984,960	1,252,671	1.2718
23 Jun 2014 13:48:00	1295763	16590913	hadcm3n_8ctr_1980_40_008726042_0	959,040	1,222,691	1.2749
19 Jun 2014 16:13:00	1295763	16590913	hadcm3n_8ctr_1980_40_008726042_0	933,120	1,190,085	1.2754
16 Jun 2014 20:59:34	1295763	16590913	hadcm3n_8ctr_1980_40_008726042_0	907,200	1,159,193	1.2778
15 Jun 2014 09:41:20	1295763	16590913	hadcm3n_8ctr_1980_40_008726042_0	881,280	1,124,723	1.2762
14 Jun 2014 09:49:09	1295763	16590913	hadcm3n_8ctr_1980_40_008726042_0	855,360	1,092,599	1.2774
12 Jun 2014 23:11:03	1295763	16590913	hadcm3n_8ctr_1980_40_008726042_0	829,440	1,059,936	1.2779
11 Jun 2014 18:08:00	1295763	16590913	hadcm3n_8ctr_1980_40_008726042_0	803,520	1,024,353	1.2748
10 Jun 2014 10:59:48	1295763	16590913	hadcm3n_8ctr_1980_40_008726042_0	777,600	991,756	1.2754
10 Jun 2014 09:02:55	1295763	16590913	hadcm3n_8ctr_1980_40_008726042_0	751,680	955,846	1.2716
10 Jun 2014 04:37:12	1295763	16590913	hadcm3n_8ctr_1980_40_008726042_0	725,760	924,447	1.2738
07 Jun 2014 02:39:47	1295763	16590913	hadcm3n_8ctr_1980_40_008726042_0	699,840	892,740	1.2756
05 Jun 2014 11:40:14	1295763	16590913	hadcm3n_8ctr_1980_40_008726042_0	673,920	860,248	1.2765
03 Jun 2014 13:52:38	1295763	16590913	hadcm3n_8ctr_1980_40_008726042_0	648,000	824,606	1.2725
01 Jun 2014 20:54:32	1295763	16590913	hadcm3n_8ctr_1980_40_008726042_0	622,080	791,809	1.2728
31 May 2014 23:10:53	1295763	16590913	hadcm3n_8ctr_1980_40_008726042_0	596,160	759,102	1.2733
31 May 2014 08:01:18	1295763	16590913	hadcm3n_8ctr_1980_40_008726042_0	570,240	726,556	1.2741
30 May 2014 17:01:55	1295763	16590913	hadcm3n_8ctr_1980_40_008726042_0	544,320	694,605	1.2761