Task 14648942

Name	hadcm3n_102z_1980_40_007957443_1
Workunit	8112555
Created	9 May 2012, 13:43:07 UTC
Sent	9 May 2012, 13:55:12 UTC
Report deadline	8 Aug 2012, 21:22:23 UTC
Received	9 Jun 2012, 5:59:03 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1141356
Run time	12 days 22 hours 36 min 12 sec
CPU time	11 days 16 hours 52 min 34 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	3.07 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.60</core_client_version> <![CDATA[ <message> - exit code -1073741819 (0xc0000005) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2552, selfPID=2552, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:52:59 (9080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:53:00 (9080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5892, selfPID=5892, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:12:59 (6168): No heartbeat from core client for 30 sec - exiting 15:13:01 (6168): No heartbeat from core client for 30 sec - exiting 15:13:02 (6168): No heartbeat from core client for 30 sec - exiting 15:13:03 (6168): No heartbeat from core client for 30 sec - exiting 15:13:04 (6168): No heartbeat from core client for 30 sec - exiting 15:13:05 (6168): No heartbeat from core client for 30 sec - exiting 15:13:06 (6168): No heartbeat from core client for 30 sec - exiting 15:13:07 (6168): No heartbeat from core client for 30 sec - exiting 15:13:08 (6168): No heartbeat from core client for 30 sec - exiting 15:13:09 (6168): No heartbeat from core client for 30 sec - exiting 15:13:10 (6168): No heartbeat from core client for 30 sec - exiting 15:13:11 (6168): No heartbeat from core client for 30 sec - exiting 15:13:12 (6168): No heartbeat from core client for 30 sec - exiting 15:13:13 (6168): No heartbeat from core client for 30 sec - exiting 15:13:14 (6168): No heartbeat from core client for 30 sec - exiting 15:13:15 (6168): No heartbeat from core client for 30 sec - exiting 15:13:16 (6168): No heartbeat from core client for 30 sec - exiting 15:13:17 (6168): No heartbeat from core client for 30 sec - exiting 15:13:18 (6168): No heartbeat from core client for 30 sec - exiting 15:13:19 (6168): No heartbeat from core client for 30 sec - exiting 15:13:20 (6168): No heartbeat from core client for 30 sec - exiting 15:13:21 (6168): No heartbeat from core client for 30 sec - exiting 15:13:22 (6168): No heartbeat from core client for 30 sec - exiting 15:13:23 (6168): No heartbeat from core client for 30 sec - exiting 15:13:24 (6168): No heartbeat from core client for 30 sec - exiting 15:13:25 (6168): No heartbeat from core client for 30 sec - exiting 15:13:26 (6168): No heartbeat from core client for 30 sec - exiting 15:13:27 (6168): No heartbeat from core client for 30 sec - exiting 15:13:28 (6168): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:13:29 (6168): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 15:22:29 (8140): No heartbeat from core client for 30 sec - exiting 15:22:30 (8140): No heartbeat from core client for 30 sec - exiting 15:22:31 (8140): No heartbeat from core client for 30 sec - exiting 15:22:32 (8140): No heartbeat from core client for 30 sec - exiting 15:22:33 (8140): No heartbeat from core client for 30 sec - exiting 15:22:34 (8140): No heartbeat from core client for 30 sec - exiting 15:22:35 (8140): No heartbeat from core client for 30 sec - exiting 15:22:36 (8140): No heartbeat from core client for 30 sec - exiting 15:22:37 (8140): No heartbeat from core client for 30 sec - exiting 15:22:38 (8140): No heartbeat from core client for 30 sec - exiting 15:22:39 (8140): No heartbeat from core client for 30 sec - exiting 15:22:40 (8140): No heartbeat from core client for 30 sec - exiting 15:22:41 (8140): No heartbeat from core client for 30 sec - exiting 15:22:42 (8140): No heartbeat from core client for 30 sec - exiting 15:22:43 (8140): No heartbeat from core client for 30 sec - exiting 15:22:44 (8140): No heartbeat from core client for 30 sec - exiting 15:22:45 (8140): No heartbeat from core client for 30 sec - exiting 15:22:46 (8140): No heartbeat from core client for 30 sec - exiting 15:22:47 (8140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:23:38 (6640): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:26:51 (5012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 12:28:37 (6428): No heartbeat from core client for 30 sec - exiting 12:28:38 (6428): No heartbeat from core client for 30 sec - exiting 12:28:39 (6428): No heartbeat from core client for 30 sec - exiting 12:28:40 (6428): No heartbeat from core client for 30 sec - exiting 12:28:41 (6428): No heartbeat from core client for 30 sec - exiting 12:28:42 (6428): No heartbeat from core client for 30 sec - exiting 12:28:43 (6428): No heartbeat from core client for 30 sec - exiting 12:28:45 (6428): No heartbeat from core client for 30 sec - exiting 12:28:46 (6428): No heartbeat from core client for 30 sec - exiting 12:28:47 (6428): No heartbeat from core client for 30 sec - exiting 12:28:48 (6428): No heartbeat from core client for 30 sec - exiting 12:28:49 (6428): No heartbeat from core client for 30 sec - exiting 12:28:50 (6428): No heartbeat from core client for 30 sec - exiting 12:28:51 (6428): No heartbeat from core client for 30 sec - exiting 12:28:52 (6428): No heartbeat from core client for 30 sec - exiting 12:28:53 (6428): No heartbeat from core client for 30 sec - exiting 12:28:54 (6428): No heartbeat from core client for 30 sec - exiting 12:28:55 (6428): No heartbeat from core client for 30 sec - exiting 12:28:57 (6428): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7716, selfPID=7716, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:08:13 (8332): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2448, selfPID=2448, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:35:51 (3436): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3024, selfPID=3024, iMonCtr=1 Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x76EF71F3 read attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5712, selfPID=5712, iMonCtr=1 Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x76EF3AB3 read attempt to address 0x00000000 Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
08 Jun 2012 23:10:30	1141356	14648942	hadcm3n_102z_1980_40_007957443_1	777,600	1,008,042	1.2964
08 Jun 2012 03:48:03	1141356	14648942	hadcm3n_102z_1980_40_007957443_1	751,680	974,547	1.2965
07 Jun 2012 04:29:31	1141356	14648942	hadcm3n_102z_1980_40_007957443_1	725,760	941,608	1.2974
06 Jun 2012 01:47:30	1141356	14648942	hadcm3n_102z_1980_40_007957443_1	699,840	908,459	1.2981
05 Jun 2012 09:27:45	1141356	14648942	hadcm3n_102z_1980_40_007957443_1	673,920	874,359	1.2974
04 Jun 2012 13:41:31	1141356	14648942	hadcm3n_102z_1980_40_007957443_1	648,000	840,426	1.2970
03 Jun 2012 21:18:18	1141356	14648942	hadcm3n_102z_1980_40_007957443_1	622,080	806,087	1.2958
02 Jun 2012 19:27:30	1141356	14648942	hadcm3n_102z_1980_40_007957443_1	596,160	772,799	1.2963
02 Jun 2012 06:29:40	1141356	14648942	hadcm3n_102z_1980_40_007957443_1	570,240	738,663	1.2954
01 Jun 2012 13:49:59	1141356	14648942	hadcm3n_102z_1980_40_007957443_1	544,320	704,428	1.2941
31 May 2012 23:49:34	1141356	14648942	hadcm3n_102z_1980_40_007957443_1	518,400	670,010	1.2925
31 May 2012 05:10:32	1141356	14648942	hadcm3n_102z_1980_40_007957443_1	492,480	636,822	1.2931
30 May 2012 07:27:39	1141356	14648942	hadcm3n_102z_1980_40_007957443_1	466,560	603,354	1.2932
29 May 2012 11:48:22	1141356	14648942	hadcm3n_102z_1980_40_007957443_1	440,640	570,165	1.2939
28 May 2012 18:32:12	1141356	14648942	hadcm3n_102z_1980_40_007957443_1	414,720	536,595	1.2939
27 May 2012 13:35:34	1141356	14648942	hadcm3n_102z_1980_40_007957443_1	388,800	502,813	1.2932
26 May 2012 16:34:07	1141356	14648942	hadcm3n_102z_1980_40_007957443_1	362,880	469,230	1.2931
25 May 2012 17:02:32	1141356	14648942	hadcm3n_102z_1980_40_007957443_1	336,960	436,051	1.2941
24 May 2012 17:03:00	1141356	14648942	hadcm3n_102z_1980_40_007957443_1	311,040	402,881	1.2953
23 May 2012 22:56:39	1141356	14648942	hadcm3n_102z_1980_40_007957443_1	285,120	369,751	1.2968