Task 13668473

Name	hadcm3n_o1yq_1980_40_007546094_1
Workunit	7743326
Created	29 Nov 2011, 2:04:22 UTC
Sent	29 Nov 2011, 2:09:10 UTC
Report deadline	28 Feb 2012, 9:36:21 UTC
Received	7 Dec 2011, 17:38:22 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	982085
Run time	4 days 14 hours 28 min 14 sec
CPU time	4 days 4 hours 1 min 30 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.95 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/o1yqko.pji1c10 Error converting file to netcdf: dataout/o1yqko.pii1c10 Error converting file to netcdf: dataout/o1yqko.pfi1c10 Error converting file to netcdf: dataout/o1yqka.phi1c10 Error converting file to netcdf: dataout/o1yqka.pgi1c10 Error converting file to netcdf: dataout/o1yqka.pei1c10 Error converting file to netcdf: dataout/o1yqka.pdi1c10 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:13:59 (3696): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:11:15 (3216): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:53:44 (460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 17:09:05 (1716): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 23:03:47 (3408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 01:02:03 (2492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 03:00:24 (4068): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 04:58:42 (2312): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 06:56:59 (1240): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 08:55:38 (3688): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:54:33 (1456): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFOUT: C I/O Error - Return code = 32 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x7C920CCE read attempt to address 0x00000000 Engaging BOINC Windows Runtime Debugger... BUFFOUT: C I/O Error - Return code = 32 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 16:53:22 (1820): No heartbeat from core client for 30 sec - exiting 16:53:23 (1820): No heartbeat from core client for 30 sec - exiting 16:53:24 (1820): No heartbeat from core client for 30 sec - exiting 16:53:25 (1820): No heartbeat from core client for 30 sec - exiting 16:53:26 (1820): No heartbeat from core client for 30 sec - exiting 16:53:27 (1820): No heartbeat from core client for 30 sec - exiting 16:53:28 (1820): No heartbeat from core client for 30 sec - exiting 16:53:29 (1820): No heartbeat from core client for 30 sec - exiting 16:53:30 (1820): No heartbeat from core client for 30 sec - exiting 16:53:31 (1820): No heartbeat from core client for 30 sec - exiting 16:53:32 (1820): No heartbeat from core client for 30 sec - exiting 16:53:33 (1820): No heartbeat from core client for 30 sec - exiting 16:53:34 (1820): No heartbeat from core client for 30 sec - exiting 16:53:35 (1820): No heartbeat from core client for 30 sec - exiting 16:53:37 (1820): No heartbeat from core client for 30 sec - exiting 16:53:38 (1820): No heartbeat from core client for 30 sec - exiting 16:53:39 (1820): No heartbeat from core client for 30 sec - exiting 16:53:40 (1820): No heartbeat from core client for 30 sec - exiting 16:53:41 (1820): No heartbeat from core client for 30 sec - exiting 16:53:42 (1820): No heartbeat from core client for 30 sec - exiting 16:53:43 (1820): No heartbeat from core client for 30 sec - exiting 16:53:44 (1820): No heartbeat from core client for 30 sec - exiting 16:53:45 (1820): No heartbeat from core client for 30 sec - exiting 16:53:46 (1820): No heartbeat from core client for 30 sec - exiting 16:53:47 (1820): No heartbeat from core client for 30 sec - exiting 16:53:48 (1820): No heartbeat from core client for 30 sec - exiting 16:53:49 (1820): No heartbeat from core client for 30 sec - exiting 16:53:50 (1820): No heartbeat from core client for 30 sec - exiting 16:53:51 (1820): No heartbeat from core client for 30 sec - exiting 16:53:52 (1820): No heartbeat from core client for 30 sec - exiting 16:53:53 (1820): No heartbeat from core client for 30 sec - exiting 16:53:54 (1820): No heartbeat from core client for 30 sec - exiting 16:53:55 (1820): No heartbeat from core client for 30 sec - exiting 16:53:56 (1820): No heartbeat from core client for 30 sec - exiting 16:53:57 (1820): No heartbeat from core client for 30 sec - exiting 16:53:58 (1820): No heartbeat from core client for 30 sec - exiting 16:53:59 (1820): No heartbeat from core client for 30 sec - exiting 16:54:00 (1820): No heartbeat from core client for 30 sec - exiting 16:54:01 (1820): No heartbeat from core client for 30 sec - exiting 16:54:02 (1820): No heartbeat from core client for 30 sec - exiting 18:51:50 (1820): No heartbeat from core client for 30 sec - exiting 18:51:51 (1820): No heartbeat from core client for 30 sec - exiting 18:51:52 (1820): No heartbeat from core client for 30 sec - exiting 18:51:53 (1820): No heartbeat from core client for 30 sec - exiting 18:51:54 (1820): No heartbeat from core client for 30 sec - exiting 18:51:55 (1820): No heartbeat from core client for 30 sec - exiting 18:51:56 (1820): No heartbeat from core client for 30 sec - exiting 18:51:57 (1820): No heartbeat from core client for 30 sec - exiting 18:51:58 (1820): No heartbeat from core client for 30 sec - exiting 18:51:59 (1820): No heartbeat from core client for 30 sec - exiting 18:52:00 (1820): No heartbeat from core client for 30 sec - exiting 18:52:01 (1820): No heartbeat from core client for 30 sec - exiting 18:52:02 (1820): No heartbeat from core client for 30 sec - exiting 18:52:03 (1820): No heartbeat from core client for 30 sec - exiting 18:52:04 (1820): No heartbeat from core client for 30 sec - exiting 18:52:05 (1820): No heartbeat from core client for 30 sec - exiting 18:52:06 (1820): No heartbeat from core client for 30 sec - exiting 18:52:07 (1820): No heartbeat from core client for 30 sec - exiting 18:52:08 (1820): No heartbeat from core client for 30 sec - exiting 18:52:09 (1820): No heartbeat from core client for 30 sec - exiting 18:52:10 (1820): No heartbeat from core client for 30 sec - exiting 18:52:11 (1820): No heartbeat from core client for 30 sec - exiting 18:52:12 (1820): No heartbeat from core client for 30 sec - exiting 18:52:13 (1820): No heartbeat from core client for 30 sec - exiting 18:52:14 (1820): No heartbeat from core client for 30 sec - exiting 18:52:16 (1820): No heartbeat from core client for 30 sec - exiting 18:52:17 (1820): No heartbeat from core client for 30 sec - exiting 18:52:18 (1820): No heartbeat from core client for 30 sec - exiting 18:52:19 (1820): No heartbeat from core client for 30 sec - exiting 18:52:20 (1820): No heartbeat from core client for 30 sec - exiting 18:52:21 (1820): No heartbeat from core client for 30 sec - exiting 18:52:22 (1820): No heartbeat from core client for 30 sec - exiting 18:52:23 (1820): No heartbeat from core client for 30 sec - exiting 18:52:24 (1820): No heartbeat from core client for 30 sec - exiting 18:52:25 (1820): No heartbeat from core client for 30 sec - exiting 18:52:26 (1820): No heartbeat from core client for 30 sec - exiting 18:52:27 (1820): No heartbeat from core client for 30 sec - exiting 18:52:28 (1820): No heartbeat from core client for 30 sec - exiting 18:52:29 (1820): No heartbeat from core client for 30 sec - exiting 18:52:30 (1820): No heartbeat from core client for 30 sec - exiting 18:52:31 (1820): No heartbeat from core client for 30 sec - exiting 18:52:32 (1820): No heartbeat from core client for 30 sec - exiting 18:52:33 (1820): No heartbeat from core client for 30 sec - exiting 18:52:34 (1820): No heartbeat from core client for 30 sec - exiting 18:52:35 (1820): No heartbeat from core client for 30 sec - exiting 18:52:36 (1820): No heartbeat from core client for 30 sec - exiting 18:52:37 (1820): No heartbeat from core client for 30 sec - exiting 18:52:38 (1820): No heartbeat from core client for 30 sec - exiting 18:52:39 (1820): No heartbeat from core client for 30 sec - exiting 18:52:40 (1820): No heartbeat from core client for 30 sec - exiting 18:52:41 (1820): No heartbeat from core client for 30 sec - exiting 18:52:42 (1820): No heartbeat from core client for 30 sec - exiting 18:52:43 (1820): No heartbeat from core client for 30 sec - exiting 18:52:44 (1820): No heartbeat from core client for 30 sec - exiting 18:52:45 (1820): No heartbeat from core client for 30 sec - exiting 18:52:46 (1820): No heartbeat from core client for 30 sec - exiting 18:52:47 (1820): No heartbeat from core client for 30 sec - exiting 18:52:48 (1820): No heartbeat from core client for 30 sec - exiting 18:52:49 (1820): No heartbeat from core client for 30 sec - exiting 18:52:50 (1820): No heartbeat from core client for 30 sec - exiting 20:50:16 (1820): No heartbeat from core client for 30 sec - exiting 20:50:17 (1820): No heartbeat from core client for 30 sec - exiting 20:50:18 (1820): No heartbeat from core client for 30 sec - exiting 20:50:19 (1820): No heartbeat from core client for 30 sec - exiting 20:50:20 (1820): No heartbeat from core client for 30 sec - exiting 20:50:21 (1820): No heartbeat from core client for 30 sec - exiting 20:50:22 (1820): No heartbeat from core client for 30 sec - exiting 20:50:23 (1820): No heartbeat from core client for 30 sec - exiting 20:50:24 (1820): No heartbeat from core client for 30 sec - exiting 20:50:25 (1820): No heartbeat from core client for 30 sec - exiting 20:50:26 (1820): No heartbeat from core client for 30 sec - exiting 20:50:27 (1820): No heartbeat from core client for 30 sec - exiting 20:50:28 (1820): No heartbeat from core client for 30 sec - exiting 20:50:30 (1820): No heartbeat from core client for 30 sec - exiting 20:50:31 (1820): No heartbeat from core client for 30 sec - exiting 20:50:32 (1820): No heartbeat from core client for 30 sec - exiting 20:50:33 (1820): No heartbeat from core client for 30 sec - exiting 20:50:34 (1820): No heartbeat from core client for 30 sec - exiting 20:50:35 (1820): No heartbeat from core client for 30 sec - exiting 20:50:36 (1820): No heartbeat from core client for 30 sec - exiting 20:50:37 (1820): No heartbeat from core client for 30 sec - exiting 20:50:38 (1820): No heartbeat from core client for 30 sec - exiting 20:50:39 (1820): No heartbeat from core client for 30 sec - exiting 20:50:40 (1820): No heartbeat from core client for 30 sec - exiting 20:50:41 (1820): No heartbeat from core client for 30 sec - exiting 20:50:42 (1820): No heartbeat from core client for 30 sec - exiting 20:50:43 (1820): No heartbeat from core client for 30 sec - exiting 20:50:44 (1820): No heartbeat from core client for 30 sec - exiting 20:50:45 (1820): No heartbeat from core client for 30 sec - exiting 20:50:46 (1820): No heartbeat from core client for 30 sec - exiting 20:50:47 (1820): No heartbeat from core client for 30 sec - exiting 20:50:48 (1820): No heartbeat from core client for 30 sec - exiting 20:50:49 (1820): No heartbeat from core client for 30 sec - exiting 20:50:50 (1820): No heartbeat from core client for 30 sec - exiting 20:50:51 (1820): No heartbeat from core client for 30 sec - exiting 20:50:52 (1820): No heartbeat from core client for 30 sec - exiting 20:50:53 (1820): No heartbeat from core client for 30 sec - exiting 20:50:54 (1820): No heartbeat from core client for 30 sec - exiting 20:50:55 (1820): No heartbeat from core client for 30 sec - exiting 20:50:56 (1820): No heartbeat from core client for 30 sec - exiting 20:50:57 (1820): No heartbeat from core client for 30 sec - exiting 20:50:58 (1820): No heartbeat from core client for 30 sec - exiting 20:50:59 (1820): No heartbeat from core client for 30 sec - exiting 20:51:00 (1820): No heartbeat from core client for 30 sec - exiting 20:51:01 (1820): No heartbeat from core client for 30 sec - exiting 20:51:02 (1820): No heartbeat from core client for 30 sec - exiting 20:51:03 (1820): No heartbeat from core client for 30 sec - exiting 20:51:04 (1820): No heartbeat from core client for 30 sec - exiting 20:51:05 (1820): No heartbeat from core client for 30 sec - exiting 20:51:06 (1820): No heartbeat from core client for 30 sec - exiting 20:51:07 (1820): No heartbeat from core client for 30 sec - exiting 20:51:09 (1820): No heartbeat from core client for 30 sec - exiting 20:51:10 (1820): No heartbeat from core client for 30 sec - exiting 20:51:11 (1820): No heartbeat from core client for 30 sec - exiting 20:51:12 (1820): No heartbeat from core client for 30 sec - exiting 20:51:13 (1820): No heartbeat from core client for 30 sec - exiting 20:51:14 (1820): No heartbeat from core client for 30 sec - exiting 20:51:15 (1820): No heartbeat from core client for 30 sec - exiting 20:51:16 (1820): No heartbeat from core client for 30 sec - exiting 20:51:17 (1820): No heartbeat from core client for 30 sec - exiting 20:51:18 (1820): No heartbeat from core client for 30 sec - exiting 20:51:19 (1820): No heartbeat from core client for 30 sec - exiting 20:51:20 (1820): No heartbeat from core client for 30 sec - exiting 22:48:39 (1820): No heartbeat from core client for 30 sec - exiting 22:48:40 (1820): No heartbeat from core client for 30 sec - exiting 22:48:41 (1820): No heartbeat from core client for 30 sec - exiting 22:48:42 (1820): No heartbeat from core client for 30 sec - exiting 22:48:43 (1820): No heartbeat from core client for 30 sec - exiting 22:48:44 (1820): No heartbeat from core client for 30 sec - exiting 22:48:45 (1820): No heartbeat from core client for 30 sec - exiting 22:48:46 (1820): No heartbeat from core client for 30 sec - exiting 22:48:47 (1820): No heartbeat from core client for 30 sec - exiting 22:48:48 (1820): No heartbeat from core client for 30 sec - exiting 22:48:49 (1820): No heartbeat from core client for 30 sec - exiting 22:48:50 (1820): No heartbeat from core client for 30 sec - exiting 22:48:51 (1820): No heartbeat from core client for 30 sec - exiting 22:48:52 (1820): No heartbeat from core client for 30 sec - exiting 22:48:53 (1820): No heartbeat from core client for 30 sec - exiting 22:48:54 (1820): No heartbeat from core client for 30 sec - exiting 22:48:55 (1820): No heartbeat from core client for 30 sec - exiting 22:48:56 (1820): No heartbeat from core client for 30 sec - exiting 22:48:57 (1820): No heartbeat from core client for 30 sec - exiting 22:48:58 (1820): No heartbeat from core client for 30 sec - exiting 22:48:59 (1820): No heartbeat from core client for 30 sec - exiting 22:49:00 (1820): No heartbeat from core client for 30 sec - exiting 22:49:01 (1820): No heartbeat from core client for 30 sec - exiting 22:49:02 (1820): No heartbeat from core client for 30 sec - exiting 22:49:03 (1820): No heartbeat from core client for 30 sec - exiting 22:49:04 (1820): No heartbeat from core client for 30 sec - exiting 22:49:05 (1820): No heartbeat from core client for 30 sec - exiting 22:49:07 (1820): No heartbeat from core client for 30 sec - exiting 22:49:08 (1820): No heartbeat from core client for 30 sec - exiting 22:49:09 (1820): No heartbeat from core client for 30 sec - exiting 22:49:10 (1820): No heartbeat from core client for 30 sec - exiting 22:49:11 (1820): No heartbeat from core client for 30 sec - exiting 22:49:12 (1820): No heartbeat from core client for 30 sec - exiting 22:49:13 (1820): No heartbeat from core client for 30 sec - exiting 22:49:14 (1820): No heartbeat from core client for 30 sec - exiting 22:49:15 (1820): No heartbeat from core client for 30 sec - exiting 22:49:16 (1820): No heartbeat from core client for 30 sec - exiting 22:49:17 (1820): No heartbeat from core client for 30 sec - exiting 22:49:18 (1820): No heartbeat from core client for 30 sec - exiting 22:49:19 (1820): No heartbeat from core client for 30 sec - exiting 22:49:20 (1820): No heartbeat from core client for 30 sec - exiting 22:49:21 (1820): No heartbeat from core client for 30 sec - exiting 22:49:22 (1820): No heartbeat from core client for 30 sec - exiting 22:49:23 (1820): No heartbeat from core client for 30 sec - exiting 22:49:24 (1820): No heartbeat from core client for 30 sec - exiting 22:49:25 (1820): No heartbeat from core client for 30 sec - exiting 22:49:26 (1820): No heartbeat from core client for 30 sec - exiting 22:49:27 (1820): No heartbeat from core client for 30 sec - exiting 22:49:28 (1820): No heartbeat from core client for 30 sec - exiting 22:49:29 (1820): No heartbeat from core client for 30 sec - exiting 22:49:30 (1820): No heartbeat from core client for 30 sec - exiting 22:49:31 (1820): No heartbeat from core client for 30 sec - exiting 22:49:32 (1820): No heartbeat from core client for 30 sec - exiting 22:49:33 (1820): No heartbeat from core client for 30 sec - exiting 22:49:34 (1820): No heartbeat from core client for 30 sec - exiting 22:49:35 (1820): No heartbeat from core client for 30 sec - exiting 22:49:36 (1820): No heartbeat from core client for 30 sec - exiting 22:49:37 (1820): No heartbeat from core client for 30 sec - exiting 22:49:38 (1820): No heartbeat from core client for 30 sec - exiting 22:49:39 (1820): No heartbeat from core client for 30 sec - exiting 22:49:40 (1820): No heartbeat from core client for 30 sec - exiting 22:49:41 (1820): No heartbeat from core client for 30 sec - exiting 22:49:42 (1820): No heartbeat from core client for 30 sec - exiting 22:49:43 (1820): No heartbeat from core client for 30 sec - exiting 22:49:44 (1820): No heartbeat from core client for 30 sec - exiting 00:47:03 (1820): No heartbeat from core client for 30 sec - exiting 00:47:04 (1820): No heartbeat from core client for 30 sec - exiting 00:47:05 (1820): No heartbeat from core client for 30 sec - exiting 00:47:06 (1820): No heartbeat from core client for 30 sec - exiting 00:47:07 (1820): No heartbeat from core client for 30 sec - exiting 00:47:08 (1820): No heartbeat from core client for 30 sec - exiting 00:47:09 (1820): No heartbeat from core client for 30 sec - exiting 00:47:10 (1820): No heartbeat from core client for 30 sec - exiting 00:47:11 (1820): No heartbeat from core client for 30 sec - exiting 00:47:12 (1820): No heartbeat from core client for 30 sec - exiting 00:47:14 (1820): No heartbeat from core client for 30 sec - exiting 00:47:15 (1820): No heartbeat from core client for 30 sec - exiting 00:47:16 (1820): No heartbeat from core client for 30 sec - exiting 00:47:17 (1820): No heartbeat from core client for 30 sec - exiting 00:47:18 (1820): No heartbeat from core client for 30 sec - exiting 00:47:19 (1820): No heartbeat from core client for 30 sec - exiting 00:47:20 (1820): No heartbeat from core client for 30 sec - exiting 00:47:21 (1820): No heartbeat from core client for 30 sec - exiting 00:47:22 (1820): No heartbeat from core client for 30 sec - exiting 00:47:23 (1820): No heartbeat from core client for 30 sec - exiting 00:47:24 (1820): No heartbeat from core client for 30 sec - exiting 00:47:25 (1820): No heartbeat from core client for 30 sec - exiting 00:47:26 (1820): No heartbeat from core client for 30 sec - exiting 00:47:27 (1820): No heartbeat from core client for 30 sec - exiting 00:47:28 (1820): No heartbeat from core client for 30 sec - exiting 00:47:29 (1820): No heartbeat from core client for 30 sec - exiting 00:47:30 (1820): No heartbeat from core client for 30 sec - exiting 00:47:31 (1820): No heartbeat from core client for 30 sec - exiting 00:47:32 (1820): No heartbeat from core client for 30 sec - exiting 00:47:33 (1820): No heartbeat from core client for 30 sec - exiting 00:47:34 (1820): No heartbeat from core client for 30 sec - exiting 00:47:35 (1820): No heartbeat from core client for 30 sec - exiting 00:47:36 (1820): No heartbeat from core client for 30 sec - exiting 00:47:37 (1820): No heartbeat from core client for 30 sec - exiting 00:47:38 (1820): No heartbeat from core client for 30 sec - exiting 00:47:39 (1820): No heartbeat from core client for 30 sec - exiting 00:47:40 (1820): No heartbeat from core client for 30 sec - exiting 00:47:41 (1820): No heartbeat from core client for 30 sec - exiting 00:47:42 (1820): No heartbeat from core client for 30 sec - exiting 00:47:43 (1820): No heartbeat from core client for 30 sec - exiting 00:47:44 (1820): No heartbeat from core client for 30 sec - exiting 00:47:45 (1820): No heartbeat from core client for 30 sec - exiting 00:47:46 (1820): No heartbeat from core client for 30 sec - exiting 00:47:47 (1820): No heartbeat from core client for 30 sec - exiting 00:47:48 (1820): No heartbeat from core client for 30 sec - exiting 00:47:49 (1820): No heartbeat from core client for 30 sec - exiting 00:47:50 (1820): No heartbeat from core client for 30 sec - exiting 00:47:51 (1820): No heartbeat from core client for 30 sec - exiting 00:47:52 (1820): No heartbeat from core client for 30 sec - exiting 00:47:53 (1820): No heartbeat from core client for 30 sec - exiting 00:47:55 (1820): No heartbeat from core client for 30 sec - exiting 00:47:56 (1820): No heartbeat from core client for 30 sec - exiting 00:47:57 (1820): No heartbeat from core client for 30 sec - exiting 00:47:58 (1820): No heartbeat from core client for 30 sec - exiting 00:47:59 (1820): No heartbeat from core client for 30 sec - exiting 00:48:00 (1820): No heartbeat from core client for 30 sec - exiting 00:48:01 (1820): No heartbeat from core client for 30 sec - exiting 00:48:02 (1820): No heartbeat from core client for 30 sec - exiting 00:48:03 (1820): No heartbeat from core client for 30 sec - exiting 00:48:04 (1820): No heartbeat from core client for 30 sec - exiting 00:48:05 (1820): No heartbeat from core client for 30 sec - exiting 00:48:06 (1820): No heartbeat from core client for 30 sec - exiting 00:48:07 (1820): No heartbeat from core client for 30 sec - exiting 00:48:08 (1820): No heartbeat from core client for 30 sec - exiting 02:45:30 (1820): No heartbeat from core client for 30 sec - exiting 02:45:31 (1820): No heartbeat from core client for 30 sec - exiting 02:45:32 (1820): No heartbeat from core client for 30 sec - exiting 02:45:33 (1820): No heartbeat from core client for 30 sec - exiting 02:45:34 (1820): No heartbeat from core client for 30 sec - exiting 02:45:35 (1820): No heartbeat from core client for 30 sec - exiting 02:45:36 (1820): No heartbeat from core client for 30 sec - exiting 02:45:37 (1820): No heartbeat from core client for 30 sec - exiting 02:45:38 (1820): No heartbeat from core client for 30 sec - exiting 02:45:39 (1820): No heartbeat from core client for 30 sec - exiting 02:45:40 (1820): No heartbeat from core client for 30 sec - exiting 02:45:41 (1820): No heartbeat from core client for 30 sec - exiting 02:45:42 (1820): No heartbeat from core client for 30 sec - exiting 02:45:43 (1820): No heartbeat from core client for 30 sec - exiting 02:45:44 (1820): No heartbeat from core client for 30 sec - exiting 02:45:45 (1820): No heartbeat from core client for 30 sec - exiting 02:45:46 (1820): No heartbeat from core client for 30 sec - exiting 02:45:47 (1820): No heartbeat from core client for 30 sec - exiting 02:45:48 (1820): No heartbeat from core client for 30 sec - exiting 02:45:49 (1820): No heartbeat from core client for 30 sec - exiting 02:45:50 (1820): No heartbeat from core client for 30 sec - exiting 02:45:51 (1820): No heartbeat from core client for 30 sec - exiting 02:45:52 (1820): No heartbeat from core client for 30 sec - exiting 02:45:53 (1820): No heartbeat from core client for 30 sec - exiting 02:45:54 (1820): No heartbeat from core client for 30 sec - exiting 02:45:55 (1820): No heartbeat from core client for 30 sec - exiting 02:45:56 (1820): No heartbeat from core client for 30 sec - exiting 02:45:57 (1820): No heartbeat from core client for 30 sec - exiting 02:45:58 (1820): No heartbeat from core client for 30 sec - exiting 02:45:59 (1820): No heartbeat from core client for 30 sec - exiting 02:46:00 (1820): No heartbeat from core client for 30 sec - exiting 02:46:01 (1820): No heartbeat from core client for 30 sec - exiting 02:46:02 (1820): No heartbeat from core client for 30 sec - exiting 02:46:04 (1820): No heartbeat from core client for 30 sec - exiting 02:46:05 (1820): No heartbeat from core client for 30 sec - exiting 02:46:06 (1820): No heartbeat from core client for 30 sec - exiting 02:46:07 (1820): No heartbeat from core client for 30 sec - exiting 02:46:08 (1820): No heartbeat from core client for 30 sec - exiting 02:46:09 (1820): No heartbeat from core client for 30 sec - exiting 02:46:10 (1820): No heartbeat from core client for 30 sec - exiting 02:46:11 (1820): No heartbeat from core client for 30 sec - exiting 02:46:12 (1820): No heartbeat from core client for 30 sec - exiting 02:46:13 (1820): No heartbeat from core client for 30 sec - exiting 02:46:14 (1820): No heartbeat from core client for 30 sec - exiting 02:46:15 (1820): No heartbeat from core client for 30 sec - exiting 02:46:16 (1820): No heartbeat from core client for 30 sec - exiting 02:46:17 (1820): No heartbeat from core client for 30 sec - exiting 02:46:18 (1820): No heartbeat from core client for 30 sec - exiting 02:46:19 (1820): No heartbeat from core client for 30 sec - exiting 02:46:20 (1820): No heartbeat from core client for 30 sec - exiting 02:46:21 (1820): No heartbeat from core client for 30 sec - exiting 02:46:22 (1820): No heartbeat from core client for 30 sec - exiting 02:46:23 (1820): No heartbeat from core client for 30 sec - exiting 02:46:24 (1820): No heartbeat from core client for 30 sec - exiting 02:46:25 (1820): No heartbeat from core client for 30 sec - exiting 02:46:26 (1820): No heartbeat from core client for 30 sec - exiting 02:46:27 (1820): No heartbeat from core client for 30 sec - exiting 02:46:28 (1820): No heartbeat from core client for 30 sec - exiting 02:46:29 (1820): No heartbeat from core client for 30 sec - exiting 02:46:30 (1820): No heartbeat from core client for 30 sec - exiting 02:46:31 (1820): No heartbeat from core client for 30 sec - exiting 02:46:32 (1820): No heartbeat from core client for 30 sec - exiting 04:43:58 (1820): No heartbeat from core client for 30 sec - exiting 04:43:59 (1820): No heartbeat from core client for 30 sec - exiting 04:44:00 (1820): No heartbeat from core client for 30 sec - exiting 04:44:01 (1820): No heartbeat from core client for 30 sec - exiting 04:44:02 (1820): No heartbeat from core client for 30 sec - exiting 04:44:03 (1820): No heartbeat from core client for 30 sec - exiting 04:44:04 (1820): No heartbeat from core client for 30 sec - exiting 04:44:05 (1820): No heartbeat from core client for 30 sec - exiting 04:44:06 (1820): No heartbeat from core client for 30 sec - exiting 04:44:07 (1820): No heartbeat from core client for 30 sec - exiting 04:44:08 (1820): No heartbeat from core client for 30 sec - exiting 04:44:09 (1820): No heartbeat from core client for 30 sec - exiting 04:44:10 (1820): No heartbeat from core client for 30 sec - exiting 04:44:11 (1820): No heartbeat from core client for 30 sec - exiting 04:44:12 (1820): No heartbeat from core client for 30 sec - exiting 04:44:13 (1820): No heartbeat from core client for 30 sec - exiting 04:44:14 (1820): No heartbeat from core client for 30 sec - exiting 04:44:15 (1820): No heartbeat from core client for 30 sec - exiting 04:44:16 (1820): No heartbeat from core client for 30 sec - exiting 04:44:17 (1820): No heartbeat from core client for 30 sec - exiting 04:44:18 (1820): No heartbeat from core client for 30 sec - exiting 04:44:19 (1820): No heartbeat from core client for 30 sec - exiting 04:44:20 (1820): No heartbeat from core client for 30 sec - exiting 04:44:21 (1820): No heartbeat from core client for 30 sec - exiting 04:44:22 (1820): No heartbeat from core client for 30 sec - exiting 04:44:23 (1820): No heartbeat from core client for 30 sec - exiting 04:44:24 (1820): No heartbeat from core client for 30 sec - exiting 04:44:25 (1820): No heartbeat from core client for 30 sec - exiting 04:44:26 (1820): No heartbeat from core client for 30 sec - exiting 04:44:27 (1820): No heartbeat from core client for 30 sec - exiting 04:44:28 (1820): No heartbeat from core client for 30 sec - exiting 04:44:29 (1820): No heartbeat from core client for 30 sec - exiting 04:44:31 (1820): No heartbeat from core client for 30 sec - exiting 04:44:32 (1820): No heartbeat from core client for 30 sec - exiting 04:44:33 (1820): No heartbeat from core client for 30 sec - exiting 04:44:34 (1820): No heartbeat from core client for 30 sec - exiting 04:44:35 (1820): No heartbeat from core client for 30 sec - exiting 04:44:36 (1820): No heartbeat from core client for 30 sec - exiting 04:44:37 (1820): No heartbeat from core client for 30 sec - exiting 04:44:38 (1820): No heartbeat from core client for 30 sec - exiting 04:44:39 (1820): No heartbeat from core client for 30 sec - exiting 04:44:40 (1820): No heartbeat from core client for 30 sec - exiting 04:44:41 (1820): No heartbeat from core client for 30 sec - exiting 04:44:42 (1820): No heartbeat from core client for 30 sec - exiting 04:44:43 (1820): No heartbeat from core client for 30 sec - exiting 04:44:44 (1820): No heartbeat from core client for 30 sec - exiting 04:44:45 (1820): No heartbeat from core client for 30 sec - exiting 04:44:46 (1820): No heartbeat from core client for 30 sec - exiting 04:44:47 (1820): No heartbeat from core client for 30 sec - exiting 04:44:48 (1820): No heartbeat from core client for 30 sec - exiting 04:44:49 (1820): No heartbeat from core client for 30 sec - exiting 04:44:50 (1820): No heartbeat from core client for 30 sec - exiting 04:44:51 (1820): No heartbeat from core client for 30 sec - exiting 04:44:52 (1820): No heartbeat from core client for 30 sec - exiting 04:44:53 (1820): No heartbeat from core client for 30 sec - exiting 04:44:54 (1820): No heartbeat from core client for 30 sec - exiting 04:44:55 (1820): No heartbeat from core client for 30 sec - exiting 04:44:56 (1820): No heartbeat from core client for 30 sec - exiting 04:44:57 (1820): No heartbeat from core client for 30 sec - exiting 04:44:58 (1820): No heartbeat from core client for 30 sec - exiting 04:44:59 (1820): No heartbeat from core client for 30 sec - exiting 06:42:24 (1820): No heartbeat from core client for 30 sec - exiting 06:42:25 (1820): No heartbeat from core client for 30 sec - exiting 06:42:26 (1820): No heartbeat from core client for 30 sec - exiting 06:42:27 (1820): No heartbeat from core client for 30 sec - exiting 06:42:28 (1820): No heartbeat from core client for 30 sec - exiting 06:42:29 (1820): No heartbeat from core client for 30 sec - exiting 06:42:30 (1820): No heartbeat from core client for 30 sec - exiting 06:42:31 (1820): No heartbeat from core client for 30 sec - exiting 06:42:32 (1820): No heartbeat from core client for 30 sec - exiting 06:42:33 (1820): No heartbeat from core client for 30 sec - exiting 06:42:34 (1820): No heartbeat from core client for 30 sec - exiting 06:42:35 (1820): No heartbeat from core client for 30 sec - exiting 06:42:36 (1820): No heartbeat from core client for 30 sec - exiting 06:42:37 (1820): No heartbeat from core client for 30 sec - exiting 06:42:38 (1820): No heartbeat from core client for 30 sec - exiting 06:42:39 (1820): No heartbeat from core client for 30 sec - exiting 06:42:40 (1820): No heartbeat from core client for 30 sec - exiting 06:42:41 (1820): No heartbeat from core client for 30 sec - exiting 06:42:42 (1820): No heartbeat from core client for 30 sec - exiting 06:42:44 (1820): No heartbeat from core client for 30 sec - exiting 06:42:45 (1820): No heartbeat from core client for 30 sec - exiting 06:42:46 (1820): No heartbeat from core client for 30 sec - exiting 06:42:47 (1820): No heartbeat from core client for 30 sec - exiting 06:42:48 (1820): No heartbeat from core client for 30 sec - exiting 06:42:49 (1820): No heartbeat from core client for 30 sec - exiting 06:42:50 (1820): No heartbeat from core client for 30 sec - exiting 06:42:51 (1820): No heartbeat from core client for 30 sec - exiting 06:42:52 (1820): No heartbeat from core client for 30 sec - exiting 06:42:53 (1820): No heartbeat from core client for 30 sec - exiting 06:42:54 (1820): No heartbeat from core client for 30 sec - exiting 06:42:55 (1820): No heartbeat from core client for 30 sec - exiting 06:42:56 (1820): No heartbeat from core client for 30 sec - exiting 06:42:57 (1820): No heartbeat from core client for 30 sec - exiting 06:42:58 (1820): No heartbeat from core client for 30 sec - exiting 06:42:59 (1820): No heartbeat from core client for 30 sec - exiting 06:43:00 (1820): No heartbeat from core client for 30 sec - exiting 06:43:01 (1820): No heartbeat from core client for 30 sec - exiting 06:43:02 (1820): No heartbeat from core client for 30 sec - exiting 06:43:03 (1820): No heartbeat from core client for 30 sec - exiting 06:43:04 (1820): No heartbeat from core client for 30 sec - exiting 06:43:05 (1820): No heartbeat from core client for 30 sec - exiting 06:43:06 (1820): No heartbeat from core client for 30 sec - exiting 06:43:07 (1820): No heartbeat from core client for 30 sec - exiting 06:43:08 (1820): No heartbeat from core client for 30 sec - exiting 06:43:09 (1820): No heartbeat from core client for 30 sec - exiting 06:43:10 (1820): No heartbeat from core client for 30 sec - exiting 06:43:11 (1820): No heartbeat from core client for 30 sec - exiting 06:43:12 (1820): No heartbeat from core client for 30 sec - exiting 06:43:13 (1820): No heartbeat from core client for 30 sec - exiting 06:43:14 (1820): No heartbeat from core client for 30 sec - exiting 06:43:15 (1820): No heartbeat from core client for 30 sec - exiting 06:43:16 (1820): No heartbeat from core client for 30 sec - exiting 06:43:17 (1820): No heartbeat from core client for 30 sec - exiting 06:43:18 (1820): No heartbeat from core client for 30 sec - exiting 06:43:19 (1820): No heartbeat from core client for 30 sec - exiting 06:43:20 (1820): No heartbeat from core client for 30 sec - exiting 06:43:21 (1820): No heartbeat from core client for 30 sec - exiting 06:43:22 (1820): No heartbeat from core client for 30 sec - exiting 06:43:23 (1820): No heartbeat from core client for 30 sec - exiting 06:43:25 (1820): No heartbeat from core client for 30 sec - exiting 06:43:26 (1820): No heartbeat from core client for 30 sec - exiting 06:43:27 (1820): No heartbeat from core client for 30 sec - exiting 08:40:54 (1820): No heartbeat from core client for 30 sec - exiting 08:40:55 (1820): No heartbeat from core client for 30 sec - exiting 08:40:56 (1820): No heartbeat from core client for 30 sec - exiting 08:40:57 (1820): No heartbeat from core client for 30 sec - exiting 08:40:58 (1820): No heartbeat from core client for 30 sec - exiting 08:40:59 (1820): No heartbeat from core client for 30 sec - exiting 08:41:00 (1820): No heartbeat from core client for 30 sec - exiting 08:41:01 (1820): No heartbeat from core client for 30 sec - exiting 08:41:02 (1820): No heartbeat from core client for 30 sec - exiting 08:41:03 (1820): No heartbeat from core client for 30 sec - exiting 08:41:04 (1820): No heartbeat from core client for 30 sec - exiting 08:41:05 (1820): No heartbeat from core client for 30 sec - exiting 08:41:06 (1820): No heartbeat from core client for 30 sec - exiting 08:41:07 (1820): No heartbeat from core client for 30 sec - exiting 08:41:08 (1820): No heartbeat from core client for 30 sec - exiting 08:41:09 (1820): No heartbeat from core client for 30 sec - exiting 08:41:10 (1820): No heartbeat from core client for 30 sec - exiting 08:41:11 (1820): No heartbeat from core client for 30 sec - exiting 08:41:12 (1820): No heartbeat from core client for 30 sec - exiting 08:41:13 (1820): No heartbeat from core client for 30 sec - exiting 08:41:14 (1820): No heartbeat from core client for 30 sec - exiting 08:41:15 (1820): No heartbeat from core client for 30 sec - exiting 08:41:16 (1820): No heartbeat from core client for 30 sec - exiting 08:41:17 (1820): No heartbeat from core client for 30 sec - exiting 08:41:19 (1820): No heartbeat from core client for 30 sec - exiting 08:41:20 (1820): No heartbeat from core client for 30 sec - exiting 08:41:21 (1820): No heartbeat from core client for 30 sec - exiting 08:41:22 (1820): No heartbeat from core client for 30 sec - exiting 08:41:23 (1820): No heartbeat from core client for 30 sec - exiting 08:41:24 (1820): No heartbeat from core client for 30 sec - exiting 08:41:25 (1820): No heartbeat from core client for 30 sec - exiting 08:41:26 (1820): No heartbeat from core client for 30 sec - exiting 08:41:27 (1820): No heartbeat from core client for 30 sec - exiting 08:41:28 (1820): No heartbeat from core client for 30 sec - exiting 08:41:29 (1820): No heartbeat from core client for 30 sec - exiting 08:41:30 (1820): No heartbeat from core client for 30 sec - exiting 08:41:31 (1820): No heartbeat from core client for 30 sec - exiting 08:41:32 (1820): No heartbeat from core client for 30 sec - exiting 08:41:33 (1820): No heartbeat from core client for 30 sec - exiting 08:41:34 (1820): No heartbeat from core client for 30 sec - exiting 08:41:35 (1820): No heartbeat from core client for 30 sec - exiting 08:41:36 (1820): No heartbeat from core client for 30 sec - exiting 08:41:37 (1820): No heartbeat from core client for 30 sec - exiting 08:41:38 (1820): No heartbeat from core client for 30 sec - exiting 08:41:39 (1820): No heartbeat from core client for 30 sec - exiting 08:41:40 (1820): No heartbeat from core client for 30 sec - exiting 08:41:41 (1820): No heartbeat from core client for 30 sec - exiting 08:41:42 (1820): No heartbeat from core client for 30 sec - exiting 08:41:43 (1820): No heartbeat from core client for 30 sec - exiting 08:41:44 (1820): No heartbeat from core client for 30 sec - exiting 08:41:45 (1820): No heartbeat from core client for 30 sec - exiting 08:41:46 (1820): No heartbeat from core client for 30 sec - exiting 08:41:47 (1820): No heartbeat from core client for 30 sec - exiting 08:41:48 (1820): No heartbeat from core client for 30 sec - exiting 08:41:49 (1820): No heartbeat from core client for 30 sec - exiting 08:41:50 (1820): No heartbeat from core client for 30 sec - exiting 08:41:51 (1820): No heartbeat from core client for 30 sec - exiting 08:41:52 (1820): No heartbeat from core client for 30 sec - exiting 08:41:53 (1820): No heartbeat from core client for 30 sec - exiting 08:41:54 (1820): No heartbeat from core client for 30 sec - exiting 14:39:35 (1820): No heartbeat from core client for 30 sec - exiting 14:39:36 (1820): No heartbeat from core client for 30 sec - exiting 14:39:37 (1820): No heartbeat from core client for 30 sec - exiting 14:39:38 (1820): No heartbeat from core client for 30 sec - exiting 14:39:39 (1820): No heartbeat from core client for 30 sec - exiting 14:39:40 (1820): No heartbeat from core client for 30 sec - exiting 14:39:41 (1820): No heartbeat from core client for 30 sec - exiting 14:39:42 (1820): No heartbeat from core client for 30 sec - exiting 14:39:43 (1820): No heartbeat from core client for 30 sec - exiting 14:39:44 (1820): No heartbeat from core client for 30 sec - exiting 14:39:45 (1820): No heartbeat from core client for 30 sec - exiting 14:39:47 (1820): No heartbeat from core client for 30 sec - exiting 14:39:48 (1820): No heartbeat from core client for 30 sec - exiting 14:39:49 (1820): No heartbeat from core client for 30 sec - exiting 14:39:50 (1820): No heartbeat from core client for 30 sec - exiting 14:39:51 (1820): No heartbeat from core client for 30 sec - exiting 14:39:52 (1820): No heartbeat from core client for 30 sec - exiting 14:39:53 (1820): No heartbeat from core client for 30 sec - exiting 14:39:54 (1820): No heartbeat from core client for 30 sec - exiting 14:39:55 (1820): No heartbeat from core client for 30 sec - exiting 14:39:56 (1820): No heartbeat from core client for 30 sec - exiting 14:39:57 (1820): No heartbeat from core client for 30 sec - exiting 14:39:58 (1820): No heartbeat from core client for 30 sec - exiting 14:39:59 (1820): No heartbeat from core client for 30 sec - exiting 14:40:00 (1820): No heartbeat from core client for 30 sec - exiting 14:40:01 (1820): No heartbeat from core client for 30 sec - exiting 14:40:02 (1820): No heartbeat from core client for 30 sec - exiting 14:40:03 (1820): No heartbeat from core client for 30 sec - exiting 14:40:04 (1820): No heartbeat from core client for 30 sec - exiting 14:40:05 (1820): No heartbeat from core client for 30 sec - exiting 14:40:06 (1820): No heartbeat from core client for 30 sec - exiting 14:40:07 (1820): No heartbeat from core client for 30 sec - exiting 14:40:08 (1820): No heartbeat from core client for 30 sec - exiting 14:40:10 (1820): No heartbeat from core client for 30 sec - exiting 14:40:11 (1820): No heartbeat from core client for 30 sec - exiting 14:40:12 (1820): No heartbeat from core client for 30 sec - exiting 14:40:13 (1820): No heartbeat from core client for 30 sec - exiting 14:40:14 (1820): No heartbeat from core client for 30 sec - exiting 14:40:15 (1820): No heartbeat from core client for 30 sec - exiting 14:40:16 (1820): No heartbeat from core client for 30 sec - exiting 14:40:17 (1820): No heartbeat from core client for 30 sec - exiting 14:40:18 (1820): No heartbeat from core client for 30 sec - exiting 14:40:19 (1820): No heartbeat from core client for 30 sec - exiting 14:40:20 (1820): No heartbeat from core client for 30 sec - exiting 14:40:21 (1820): No heartbeat from core client for 30 sec - exiting 14:40:22 (1820): No heartbeat from core client for 30 sec - exiting 14:40:23 (1820): No heartbeat from core client for 30 sec - exiting 14:40:24 (1820): No heartbeat from core client for 30 sec - exiting Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x7C921295 read attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x7C921295 read attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x7C921295 read attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
05 Dec 2011 19:34:40	982085	13668473	hadcm3n_o1yq_1980_40_007546094_1	259,200	356,390	1.3750
05 Dec 2011 08:20:49	982085	13668473	hadcm3n_o1yq_1980_40_007546094_1	233,280	321,905	1.3799
04 Dec 2011 21:17:52	982085	13668473	hadcm3n_o1yq_1980_40_007546094_1	207,360	286,237	1.3804
04 Dec 2011 07:39:40	982085	13668473	hadcm3n_o1yq_1980_40_007546094_1	181,440	250,167	1.3788
03 Dec 2011 12:42:09	982085	13668473	hadcm3n_o1yq_1980_40_007546094_1	155,520	213,804	1.3748
02 Dec 2011 20:32:14	982085	13668473	hadcm3n_o1yq_1980_40_007546094_1	129,600	177,773	1.3717
02 Dec 2011 04:45:49	982085	13668473	hadcm3n_o1yq_1980_40_007546094_1	103,680	141,728	1.3670
30 Nov 2011 20:20:42	982085	13668473	hadcm3n_o1yq_1980_40_007546094_1	77,760	107,113	1.3775
30 Nov 2011 09:16:45	982085	13668473	hadcm3n_o1yq_1980_40_007546094_1	51,840	71,872	1.3864
29 Nov 2011 19:57:05	982085	13668473	hadcm3n_o1yq_1980_40_007546094_1	25,920	35,367	1.3645