Task 15469067

Name	hadcm3n_zf4p_1880_40_008248764_3
Workunit	8403888
Created	2 Dec 2012, 15:42:19 UTC
Sent	2 Dec 2012, 15:42:22 UTC
Report deadline	3 Mar 2013, 23:09:33 UTC
Received	22 Jan 2013, 10:49:48 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1255193
Run time	8 days 1 hours 36 min 3 sec
CPU time	7 days 16 hours 10 min 37 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.89 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:22:40 (6668): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:49:12 (5824): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 23:09:36 (4240): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:03:32 (4248): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:23:58 (6860): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 16:29:38 (10864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 17:02:54 (8588): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 17:07:54 (10672): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 17:22:24 (11156): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 17:49:44 (9332): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:03:32 (9592): No heartbeat from core client for 30 sec - exiting 22:03:33 (9592): No heartbeat from core client for 30 sec - exiting 22:03:34 (9592): No heartbeat from core client for 30 sec - exiting 22:03:35 (9592): No heartbeat from core client for 30 sec - exiting 22:03:36 (9592): No heartbeat from core client for 30 sec - exiting 22:03:38 (9592): No heartbeat from core client for 30 sec - exiting 22:03:39 (9592): No heartbeat from core client for 30 sec - exiting 22:03:40 (9592): No heartbeat from core client for 30 sec - exiting 22:03:41 (9592): No heartbeat from core client for 30 sec - exiting 22:03:42 (9592): No heartbeat from core client for 30 sec - exiting 22:03:43 (9592): No heartbeat from core client for 30 sec - exiting 22:03:44 (9592): No heartbeat from core client for 30 sec - exiting 22:03:45 (9592): No heartbeat from core client for 30 sec - exiting 22:03:46 (9592): No heartbeat from core client for 30 sec - exiting 22:03:47 (9592): No heartbeat from core client for 30 sec - exiting 22:03:48 (9592): No heartbeat from core client for 30 sec - exiting 22:03:50 (9592): No heartbeat from core client for 30 sec - exiting 22:03:51 (9592): No heartbeat from core client for 30 sec - exiting 22:03:52 (9592): No heartbeat from core client for 30 sec - exiting 22:03:53 (9592): No heartbeat from core client for 30 sec - exiting 22:03:54 (9592): No heartbeat from core client for 30 sec - exiting 22:03:55 (9592): No heartbeat from core client for 30 sec - exiting 22:03:56 (9592): No heartbeat from core client for 30 sec - exiting 22:03:57 (9592): No heartbeat from core client for 30 sec - exiting 22:03:58 (9592): No heartbeat from core client for 30 sec - exiting 22:03:59 (9592): No heartbeat from core client for 30 sec - exiting 22:04:00 (9592): No heartbeat from core client for 30 sec - exiting 22:04:02 (9592): No heartbeat from core client for 30 sec - exiting 22:04:03 (9592): No heartbeat from core client for 30 sec - exiting 22:04:04 (9592): No heartbeat from core client for 30 sec - exiting 22:04:05 (9592): No heartbeat from core client for 30 sec - exiting 22:04:06 (9592): No heartbeat from core client for 30 sec - exiting 22:04:07 (9592): No heartbeat from core client for 30 sec - exiting 22:04:08 (9592): No heartbeat from core client for 30 sec - exiting 22:04:09 (9592): No heartbeat from core client for 30 sec - exiting 22:04:10 (9592): No heartbeat from core client for 30 sec - exiting 22:04:11 (9592): No heartbeat from core client for 30 sec - exiting 22:04:12 (9592): No heartbeat from core client for 30 sec - exiting 22:04:14 (9592): No heartbeat from core client for 30 sec - exiting 22:04:15 (9592): No heartbeat from core client for 30 sec - exiting 22:04:16 (9592): No heartbeat from core client for 30 sec - exiting 22:04:17 (9592): No heartbeat from core client for 30 sec - exiting 22:04:18 (9592): No heartbeat from core client for 30 sec - exiting 22:04:19 (9592): No heartbeat from core client for 30 sec - exiting 22:04:20 (9592): No heartbeat from core client for 30 sec - exiting 22:04:21 (9592): No heartbeat from core client for 30 sec - exiting 22:04:22 (9592): No heartbeat from core client for 30 sec - exiting 22:04:23 (9592): No heartbeat from core client for 30 sec - exiting 22:04:24 (9592): No heartbeat from core client for 30 sec - exiting 22:04:26 (9592): No heartbeat from core client for 30 sec - exiting 22:04:27 (9592): No heartbeat from core client for 30 sec - exiting 22:04:28 (9592): No heartbeat from core client for 30 sec - exiting 22:04:29 (9592): No heartbeat from core client for 30 sec - exiting 22:04:30 (9592): No heartbeat from core client for 30 sec - exiting 22:04:31 (9592): No heartbeat from core client for 30 sec - exiting 22:04:32 (9592): No heartbeat from core client for 30 sec - exiting 22:04:33 (9592): No heartbeat from core client for 30 sec - exiting 22:04:34 (9592): No heartbeat from core client for 30 sec - exiting 22:04:35 (9592): No heartbeat from core client for 30 sec - exiting 22:04:36 (9592): No heartbeat from core client for 30 sec - exiting 22:04:38 (9592): No heartbeat from core client for 30 sec - exiting 22:04:39 (9592): No heartbeat from core client for 30 sec - exiting 22:04:40 (9592): No heartbeat from core client for 30 sec - exiting 22:04:41 (9592): No heartbeat from core client for 30 sec - exiting 22:04:42 (9592): No heartbeat from core client for 30 sec - exiting 22:04:43 (9592): No heartbeat from core client for 30 sec - exiting 22:04:44 (9592): No heartbeat from core client for 30 sec - exiting 22:04:45 (9592): No heartbeat from core client for 30 sec - exiting 22:04:46 (9592): No heartbeat from core client for 30 sec - exiting 22:04:47 (9592): No heartbeat from core client for 30 sec - exiting 22:04:48 (9592): No heartbeat from core client for 30 sec - exiting 22:04:50 (9592): No heartbeat from core client for 30 sec - exiting 22:04:51 (9592): No heartbeat from core client for 30 sec - exiting 22:04:52 (9592): No heartbeat from core client for 30 sec - exiting 22:04:53 (9592): No heartbeat from core client for 30 sec - exiting 22:04:54 (9592): No heartbeat from core client for 30 sec - exiting 22:04:55 (9592): No heartbeat from core client for 30 sec - exiting 22:04:56 (9592): No heartbeat from core client for 30 sec - exiting 22:04:57 (9592): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:04:58 (9592): No heartbeat from core client for 30 sec - exiting 22:18:50 (6028): No heartbeat from core client for 30 sec - exiting 22:18:51 (6028): No heartbeat from core client for 30 sec - exiting 22:18:52 (6028): No heartbeat from core client for 30 sec - exiting 22:18:53 (6028): No heartbeat from core client for 30 sec - exiting 22:18:55 (6028): No heartbeat from core client for 30 sec - exiting 22:18:56 (6028): No heartbeat from core client for 30 sec - exiting 22:18:57 (6028): No heartbeat from core client for 30 sec - exiting 22:18:58 (6028): No heartbeat from core client for 30 sec - exiting 22:18:59 (6028): No heartbeat from core client for 30 sec - exiting 22:19:00 (6028): No heartbeat from core client for 30 sec - exiting 22:19:01 (6028): No heartbeat from core client for 30 sec - exiting 22:19:02 (6028): No heartbeat from core client for 30 sec - exiting 22:19:03 (6028): No heartbeat from core client for 30 sec - exiting 22:19:04 (6028): No heartbeat from core client for 30 sec - exiting 22:19:05 (6028): No heartbeat from core client for 30 sec - exiting 22:19:07 (6028): No heartbeat from core client for 30 sec - exiting 22:19:08 (6028): No heartbeat from core client for 30 sec - exiting 22:19:09 (6028): No heartbeat from core client for 30 sec - exiting 22:19:10 (6028): No heartbeat from core client for 30 sec - exiting 22:19:11 (6028): No heartbeat from core client for 30 sec - exiting 22:19:12 (6028): No heartbeat from core client for 30 sec - exiting 22:19:13 (6028): No heartbeat from core client for 30 sec - exiting 22:19:14 (6028): No heartbeat from core client for 30 sec - exiting 22:19:15 (6028): No heartbeat from core client for 30 sec - exiting 22:19:16 (6028): No heartbeat from core client for 30 sec - exiting 22:19:17 (6028): No heartbeat from core client for 30 sec - exiting 22:19:19 (6028): No heartbeat from core client for 30 sec - exiting 22:19:20 (6028): No heartbeat from core client for 30 sec - exiting 22:19:21 (6028): No heartbeat from core client for 30 sec - exiting 22:19:22 (6028): No heartbeat from core client for 30 sec - exiting 22:19:23 (6028): No heartbeat from core client for 30 sec - exiting 22:19:24 (6028): No heartbeat from core client for 30 sec - exiting 22:19:25 (6028): No heartbeat from core client for 30 sec - exiting 22:19:26 (6028): No heartbeat from core client for 30 sec - exiting 22:19:27 (6028): No heartbeat from core client for 30 sec - exiting 22:19:28 (6028): No heartbeat from core client for 30 sec - exiting 22:19:29 (6028): No heartbeat from core client for 30 sec - exiting 22:19:31 (6028): No heartbeat from core client for 30 sec - exiting 22:19:32 (6028): No heartbeat from core client for 30 sec - exiting 22:19:33 (6028): No heartbeat from core client for 30 sec - exiting 22:19:34 (6028): No heartbeat from core client for 30 sec - exiting 22:19:35 (6028): No heartbeat from core client for 30 sec - exiting 22:19:36 (6028): No heartbeat from core client for 30 sec - exiting 22:19:37 (6028): No heartbeat from core client for 30 sec - exiting 22:19:38 (6028): No heartbeat from core client for 30 sec - exiting 22:19:39 (6028): No heartbeat from core client for 30 sec - exiting 22:19:40 (6028): No heartbeat from core client for 30 sec - exiting 22:19:41 (6028): No heartbeat from core client for 30 sec - exiting 22:19:43 (6028): No heartbeat from core client for 30 sec - exiting 22:19:44 (6028): No heartbeat from core client for 30 sec - exiting 22:19:45 (6028): No heartbeat from core client for 30 sec - exiting 22:19:46 (6028): No heartbeat from core client for 30 sec - exiting 22:19:47 (6028): No heartbeat from core client for 30 sec - exiting 22:19:48 (6028): No heartbeat from core client for 30 sec - exiting 22:19:49 (6028): No heartbeat from core client for 30 sec - exiting 22:19:50 (6028): No heartbeat from core client for 30 sec - exiting 22:19:51 (6028): No heartbeat from core client for 30 sec - exiting 22:19:52 (6028): No heartbeat from core client for 30 sec - exiting 22:19:53 (6028): No heartbeat from core client for 30 sec - exiting 22:19:55 (6028): No heartbeat from core client for 30 sec - exiting 22:19:56 (6028): No heartbeat from core client for 30 sec - exiting 22:19:57 (6028): No heartbeat from core client for 30 sec - exiting 22:19:58 (6028): No heartbeat from core client for 30 sec - exiting 22:19:59 (6028): No heartbeat from core client for 30 sec - exiting 22:20:00 (6028): No heartbeat from core client for 30 sec - exiting 22:20:01 (6028): No heartbeat from core client for 30 sec - exiting 22:20:02 (6028): No heartbeat from core client for 30 sec - exiting 22:20:03 (6028): No heartbeat from core client for 30 sec - exiting 22:20:04 (6028): No heartbeat from core client for 30 sec - exiting 22:20:05 (6028): No heartbeat from core client for 30 sec - exiting 22:20:07 (6028): No heartbeat from core client for 30 sec - exiting 22:20:08 (6028): No heartbeat from core client for 30 sec - exiting 22:20:09 (6028): No heartbeat from core client for 30 sec - exiting 22:20:10 (6028): No heartbeat from core client for 30 sec - exiting 22:20:11 (6028): No heartbeat from core client for 30 sec - exiting 22:20:12 (6028): No heartbeat from core client for 30 sec - exiting 22:20:13 (6028): No heartbeat from core client for 30 sec - exiting 22:20:14 (6028): No heartbeat from core client for 30 sec - exiting 22:20:15 (6028): No heartbeat from core client for 30 sec - exiting 22:20:16 (6028): No heartbeat from core client for 30 sec - exiting 22:20:18 (6028): No heartbeat from core client for 30 sec - exiting 22:20:19 (6028): No heartbeat from core client for 30 sec - exiting 22:20:20 (6028): No heartbeat from core client for 30 sec - exiting 22:20:21 (6028): No heartbeat from core client for 30 sec - exiting 22:20:22 (6028): No heartbeat from core client for 30 sec - exiting 22:20:23 (6028): No heartbeat from core client for 30 sec - exiting 22:20:24 (6028): No heartbeat from core client for 30 sec - exiting 22:20:25 (6028): No heartbeat from core client for 30 sec - exiting 22:20:26 (6028): No heartbeat from core client for 30 sec - exiting 22:20:27 (6028): No heartbeat from core client for 30 sec - exiting 22:20:28 (6028): No heartbeat from core client for 30 sec - exiting 22:20:30 (6028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:23:52 (12576): No heartbeat from core client for 30 sec - exiting 22:23:53 (12576): No heartbeat from core client for 30 sec - exiting 22:23:54 (12576): No heartbeat from core client for 30 sec - exiting 22:23:55 (12576): No heartbeat from core client for 30 sec - exiting 22:23:57 (12576): No heartbeat from core client for 30 sec - exiting 22:23:58 (12576): No heartbeat from core client for 30 sec - exiting 22:23:59 (12576): No heartbeat from core client for 30 sec - exiting 22:24:00 (12576): No heartbeat from core client for 30 sec - exiting 22:24:01 (12576): No heartbeat from core client for 30 sec - exiting 22:24:02 (12576): No heartbeat from core client for 30 sec - exiting 22:24:03 (12576): No heartbeat from core client for 30 sec - exiting 22:24:04 (12576): No heartbeat from core client for 30 sec - exiting 22:24:05 (12576): No heartbeat from core client for 30 sec - exiting 22:24:06 (12576): No heartbeat from core client for 30 sec - exiting 22:24:08 (12576): No heartbeat from core client for 30 sec - exiting 22:24:09 (12576): No heartbeat from core client for 30 sec - exiting 22:24:10 (12576): No heartbeat from core client for 30 sec - exiting 22:24:11 (12576): No heartbeat from core client for 30 sec - exiting 22:24:12 (12576): No heartbeat from core client for 30 sec - exiting 22:24:13 (12576): No heartbeat from core client for 30 sec - exiting 22:24:14 (12576): No heartbeat from core client for 30 sec - exiting 22:24:15 (12576): No heartbeat from core client for 30 sec - exiting 22:24:16 (12576): No heartbeat from core client for 30 sec - exiting 22:24:17 (12576): No heartbeat from core client for 30 sec - exiting 22:24:18 (12576): No heartbeat from core client for 30 sec - exiting 22:24:20 (12576): No heartbeat from core client for 30 sec - exiting 22:24:21 (12576): No heartbeat from core client for 30 sec - exiting 22:24:22 (12576): No heartbeat from core client for 30 sec - exiting 22:24:23 (12576): No heartbeat from core client for 30 sec - exiting 22:24:24 (12576): No heartbeat from core client for 30 sec - exiting 22:24:25 (12576): No heartbeat from core client for 30 sec - exiting 22:24:26 (12576): No heartbeat from core client for 30 sec - exiting 22:24:27 (12576): No heartbeat from core client for 30 sec - exiting 22:24:28 (12576): No heartbeat from core client for 30 sec - exiting 22:24:29 (12576): No heartbeat from core client for 30 sec - exiting 22:24:30 (12576): No heartbeat from core client for 30 sec - exiting 22:24:32 (12576): No heartbeat from core client for 30 sec - exiting 22:24:33 (12576): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 22:46:23 (11660): No heartbeat from core client for 30 sec - exiting 22:46:24 (11660): No heartbeat from core client for 30 sec - exiting 22:46:25 (11660): No heartbeat from core client for 30 sec - exiting 22:46:27 (11660): No heartbeat from core client for 30 sec - exiting 22:46:28 (11660): No heartbeat from core client for 30 sec - exiting 22:46:29 (11660): No heartbeat from core client for 30 sec - exiting 22:46:30 (11660): No heartbeat from core client for 30 sec - exiting 22:46:31 (11660): No heartbeat from core client for 30 sec - exiting 22:46:32 (11660): No heartbeat from core client for 30 sec - exiting 22:46:33 (11660): No heartbeat from core client for 30 sec - exiting 22:46:34 (11660): No heartbeat from core client for 30 sec - exiting 22:46:35 (11660): No heartbeat from core client for 30 sec - exiting 22:46:36 (11660): No heartbeat from core client for 30 sec - exiting 22:46:37 (11660): No heartbeat from core client for 30 sec - exiting 22:46:39 (11660): No heartbeat from core client for 30 sec - exiting 22:46:40 (11660): No heartbeat from core client for 30 sec - exiting 22:46:41 (11660): No heartbeat from core client for 30 sec - exiting 22:46:42 (11660): No heartbeat from core client for 30 sec - exiting 22:46:43 (11660): No heartbeat from core client for 30 sec - exiting 22:46:44 (11660): No heartbeat from core client for 30 sec - exiting 22:46:45 (11660): No heartbeat from core client for 30 sec - exiting 22:46:46 (11660): No heartbeat from core client for 30 sec - exiting 22:46:47 (11660): No heartbeat from core client for 30 sec - exiting 22:46:48 (11660): No heartbeat from core client for 30 sec - exiting 22:46:49 (11660): No heartbeat from core client for 30 sec - exiting 22:46:51 (11660): No heartbeat from core client for 30 sec - exiting 22:46:52 (11660): No heartbeat from core client for 30 sec - exiting 22:46:53 (11660): No heartbeat from core client for 30 sec - exiting 22:46:54 (11660): No heartbeat from core client for 30 sec - exiting 22:46:55 (11660): No heartbeat from core client for 30 sec - exiting 22:46:56 (11660): No heartbeat from core client for 30 sec - exiting 22:46:57 (11660): No heartbeat from core client for 30 sec - exiting 22:46:58 (11660): No heartbeat from core client for 30 sec - exiting 22:46:59 (11660): No heartbeat from core client for 30 sec - exiting 22:47:00 (11660): No heartbeat from core client for 30 sec - exiting 22:47:01 (11660): No heartbeat from core client for 30 sec - exiting 22:47:03 (11660): No heartbeat from core client for 30 sec - exiting 22:47:04 (11660): No heartbeat from core client for 30 sec - exiting 22:47:05 (11660): No heartbeat from core client for 30 sec - exiting 22:47:06 (11660): No heartbeat from core client for 30 sec - exiting 22:47:07 (11660): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:47:08 (11660): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 23:10:27 (11376): No heartbeat from core client for 30 sec - exiting 23:10:29 (11376): No heartbeat from core client for 30 sec - exiting 23:10:30 (11376): No heartbeat from core client for 30 sec - exiting 23:10:31 (11376): No heartbeat from core client for 30 sec - exiting 23:10:32 (11376): No heartbeat from core client for 30 sec - exiting 23:10:33 (11376): No heartbeat from core client for 30 sec - exiting 23:10:34 (11376): No heartbeat from core client for 30 sec - exiting 23:10:35 (11376): No heartbeat from core client for 30 sec - exiting 23:10:36 (11376): No heartbeat from core client for 30 sec - exiting 23:10:38 (11376): No heartbeat from core client for 30 sec - exiting 23:10:39 (11376): No heartbeat from core client for 30 sec - exiting 23:10:40 (11376): No heartbeat from core client for 30 sec - exiting 23:10:41 (11376): No heartbeat from core client for 30 sec - exiting 23:10:42 (11376): No heartbeat from core client for 30 sec - exiting 23:10:43 (11376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:10:44 (11376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 06:45:40 (10500): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 06:51:18 (12596): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 16:36:13 (14432): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 17:06:14 (14320): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/zf4pko.pj87c10 Error converting file to netcdf: dataout/zf4pko.pi87c10 Error converting file to netcdf: dataout/zf4pko.pf87c10 Error converting file to netcdf: dataout/zf4pka.ph87c10 Error converting file to netcdf: dataout/zf4pka.pg87c10 Error converting file to netcdf: dataout/zf4pka.pe87c10 Error converting file to netcdf: dataout/zf4pka.pd87c10 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:27:52 (4720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3776, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x775A331F read attempt to address 0x00000010 Engaging BOINC Windows Runtime Debugger... Cannot serialize file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_zf4p_1880_40_008248764/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
22 Jan 2013 10:50:52	1255193	15469067	hadcm3n_zf4p_1880_40_008248764_3	259,200	663,030	2.5580
05 Jan 2013 18:41:25	1255193	15469067	hadcm3n_zf4p_1880_40_008248764_3	233,280	301,798	1.2937
04 Jan 2013 17:43:14	1255193	15469067	hadcm3n_zf4p_1880_40_008248764_3	207,360	269,060	1.2976
14 Dec 2012 15:39:00	1255193	15469067	hadcm3n_zf4p_1880_40_008248764_3	181,440	235,639	1.2987
07 Dec 2012 16:53:23	1255193	15469067	hadcm3n_zf4p_1880_40_008248764_3	155,520	202,613	1.3028
04 Dec 2012 18:08:08	1255193	15469067	hadcm3n_zf4p_1880_40_008248764_3	129,600	169,622	1.3088
04 Dec 2012 08:22:03	1255193	15469067	hadcm3n_zf4p_1880_40_008248764_3	103,680	135,901	1.3108
03 Dec 2012 20:43:16	1255193	15469067	hadcm3n_zf4p_1880_40_008248764_3	77,760	102,275	1.3153
03 Dec 2012 11:04:49	1255193	15469067	hadcm3n_zf4p_1880_40_008248764_3	51,840	68,372	1.3189
03 Dec 2012 01:32:58	1255193	15469067	hadcm3n_zf4p_1880_40_008248764_3	25,920	34,386	1.3266