Task 13630591

Name	hadcm3n_t2ai_1940_40_007544707_1
Workunit	7741939
Created	10 Nov 2011, 6:30:35 UTC
Sent	15 Nov 2011, 19:00:20 UTC
Report deadline	15 Feb 2012, 2:27:31 UTC
Received	13 Dec 2011, 2:44:10 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1179495
Run time	10 days 10 hours 50 min 57 sec
CPU time	10 days 3 hours 24 min 10 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	0.93 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... 05:31:45 (3488): No heartbeat from core client for 30 sec - exiting 05:31:46 (3488): No heartbeat from core client for 30 sec - exiting 05:31:48 (3488): No heartbeat from core client for 30 sec - exiting 05:31:49 (3488): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 05:56:12 (2688): No heartbeat from core client for 30 sec - exiting 05:56:13 (2688): No heartbeat from core client for 30 sec - exiting 05:56:14 (2688): No heartbeat from core client for 30 sec - exiting 05:56:15 (2688): No heartbeat from core client for 30 sec - exiting 05:56:16 (2688): No heartbeat from core client for 30 sec - exiting 05:56:17 (2688): No heartbeat from core client for 30 sec - exiting 05:56:19 (2688): No heartbeat from core client for 30 sec - exiting 05:56:20 (2688): No heartbeat from core client for 30 sec - exiting 05:56:21 (2688): No heartbeat from core client for 30 sec - exiting 05:56:22 (2688): No heartbeat from core client for 30 sec - exiting 05:56:23 (2688): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:25:19 (3068): No heartbeat from core client for 30 sec - exiting 18:25:21 (3068): No heartbeat from core client for 30 sec - exiting 18:25:22 (3068): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 05:38:13 (948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:44:18 (2508): No heartbeat from core client for 30 sec - exiting 18:44:19 (2508): No heartbeat from core client for 30 sec - exiting 18:44:20 (2508): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 20:04:50 (5624): No heartbeat from core client for 30 sec - exiting 20:04:51 (5624): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:02:52 (3096): No heartbeat from core client for 30 sec - exiting 17:02:53 (3096): No heartbeat from core client for 30 sec - exiting 17:02:55 (3096): No heartbeat from core client for 30 sec - exiting 17:02:56 (3096): No heartbeat from core client for 30 sec - exiting 17:02:57 (3096): No heartbeat from core client for 30 sec - exiting 17:02:58 (3096): No heartbeat from core client for 30 sec - exiting 17:02:59 (3096): No heartbeat from core client for 30 sec - exiting 17:03:00 (3096): No heartbeat from core client for 30 sec - exiting 17:03:01 (3096): No heartbeat from core client for 30 sec - exiting 17:03:02 (3096): No heartbeat from core client for 30 sec - exiting 17:03:03 (3096): No heartbeat from core client for 30 sec - exiting 17:03:04 (3096): No heartbeat from core client for 30 sec - exiting 17:03:05 (3096): No heartbeat from core client for 30 sec - exiting 17:03:06 (3096): No heartbeat from core client for 30 sec - exiting 17:03:07 (3096): No heartbeat from core client for 30 sec - exiting 17:03:08 (3096): No heartbeat from core client for 30 sec - exiting 17:03:09 (3096): No heartbeat from core client for 30 sec - exiting 17:03:10 (3096): No heartbeat from core client for 30 sec - exiting 17:03:11 (3096): No heartbeat from core client for 30 sec - exiting 17:03:12 (3096): No heartbeat from core client for 30 sec - exiting 17:03:13 (3096): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:08:50 (4000): No heartbeat from core client for 30 sec - exiting 06:08:53 (4000): No heartbeat from core client for 30 sec - exiting 06:08:54 (4000): No heartbeat from core client for 30 sec - exiting 06:08:55 (4000): No heartbeat from core client for 30 sec - exiting 06:08:56 (4000): No heartbeat from core client for 30 sec - exiting 06:08:57 (4000): No heartbeat from core client for 30 sec - exiting 06:08:58 (4000): No heartbeat from core client for 30 sec - exiting 06:08:59 (4000): No heartbeat from core client for 30 sec - exiting 06:09:00 (4000): No heartbeat from core client for 30 sec - exiting 06:09:01 (4000): No heartbeat from core client for 30 sec - exiting 06:09:02 (4000): No heartbeat from core client for 30 sec - exiting 06:09:03 (4000): No heartbeat from core client for 30 sec - exiting 06:09:05 (4000): No heartbeat from core client for 30 sec - exiting 06:09:06 (4000): No heartbeat from core client for 30 sec - exiting 06:09:07 (4000): No heartbeat from core client for 30 sec - exiting 06:09:08 (4000): No heartbeat from core client for 30 sec - exiting 06:09:09 (4000): No heartbeat from core client for 30 sec - exiting 06:09:10 (4000): No heartbeat from core client for 30 sec - exiting 06:09:11 (4000): No heartbeat from core client for 30 sec - exiting 06:09:12 (4000): No heartbeat from core client for 30 sec - exiting 06:09:13 (4000): No heartbeat from core client for 30 sec - exiting 06:09:14 (4000): No heartbeat from core client for 30 sec - exiting 06:09:16 (4000): No heartbeat from core client for 30 sec - exiting 06:09:17 (4000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 15:03:28 (1296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 05:12:42 (4480): No heartbeat from core client for 30 sec - exiting 05:12:44 (4480): No heartbeat from core client for 30 sec - exiting 05:12:45 (4480): No heartbeat from core client for 30 sec - exiting 05:12:46 (4480): No heartbeat from core client for 30 sec - exiting 05:12:47 (4480): No heartbeat from core client for 30 sec - exiting 05:12:48 (4480): No heartbeat from core client for 30 sec - exiting 05:12:49 (4480): No heartbeat from core client for 30 sec - exiting 05:12:50 (4480): No heartbeat from core client for 30 sec - exiting 05:12:51 (4480): No heartbeat from core client for 30 sec - exiting 05:12:52 (4480): No heartbeat from core client for 30 sec - exiting 05:12:53 (4480): No heartbeat from core client for 30 sec - exiting 05:12:55 (4480): No heartbeat from core client for 30 sec - exiting 05:12:56 (4480): No heartbeat from core client for 30 sec - exiting 05:12:57 (4480): No heartbeat from core client for 30 sec - exiting 05:12:58 (4480): No heartbeat from core client for 30 sec - exiting 05:12:59 (4480): No heartbeat from core client for 30 sec - exiting 05:13:00 (4480): No heartbeat from core client for 30 sec - exiting 05:13:01 (4480): No heartbeat from core client for 30 sec - exiting 05:13:02 (4480): No heartbeat from core client for 30 sec - exiting 05:13:03 (4480): No heartbeat from core client for 30 sec - exiting 05:13:04 (4480): No heartbeat from core client for 30 sec - exiting 05:13:05 (4480): No heartbeat from core client for 30 sec - exiting 05:13:07 (4480): No heartbeat from core client for 30 sec - exiting 05:13:08 (4480): No heartbeat from core client for 30 sec - exiting 05:13:09 (4480): No heartbeat from core client for 30 sec - exiting 05:13:10 (4480): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:14:58 (2372): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold ControCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4464, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:18:05 (708): No heartbeat from core client for 30 sec - exiting 19:18:07 (708): No heartbeat from core client for 30 sec - exiting 19:18:08 (708): No heartbeat from core client for 30 sec - exiting 19:18:09 (708): No heartbeat from core client for 30 sec - exiting 19:18:11 (708): No heartbeat from core client for 30 sec - exiting 19:18:12 (708): No heartbeat from core client for 30 sec - exiting 19:18:13 (708): No heartbeat from core client for 30 sec - exiting 19:18:14 (708): No heartbeat from core client for 30 sec - exiting 19:18:15 (708): No heartbeat from core client for 30 sec - exiting 19:18:16 (708): No heartbeat from core client for 30 sec - exiting 19:18:17 (708): No heartbeat from core client for 30 sec - exiting 19:18:18 (708): No heartbeat from core client for 30 sec - exiting 19:18:19 (708): No heartbeat from core client for 30 sec - exiting 19:18:20 (708): No heartbeat from core client for 30 sec - exiting 19:18:22 (708): No heartbeat from core client for 30 sec - exiting 19:18:23 (708): No heartbeat from core client for 30 sec - exiting 19:18:24 (708): No heartbeat from core client for 30 sec - exiting 19:18:25 (708): No heartbeat from core client for 30 sec - exiting 19:18:26 (708): No heartbeat from core client for 30 sec - exiting 19:18:27 (708): No heartbeat from core client for 30 sec - exiting 19:18:28 (708): No heartbeat from core client for 30 sec - exiting 19:18:29 (708): No heartbeat from core client for 30 sec - exiting 19:18:30 (708): No heartbeat from core client for 30 sec - exiting 19:18:31 (708): No heartbeat from core client for 30 sec - exiting 19:18:32 (708): No heartbeat from core client for 30 sec - exiting 19:18:34 (708): No heartbeat from core client for 30 sec - exiting 19:18:35 (708): No heartbeat from core client for 30 sec - exiting 19:18:36 (708): No heartbeat from core client for 30 sec - exiting 19:18:37 (708): No heartbeat from core client for 30 sec - exiting 19:18:38 (708): No heartbeat from core client for 30 sec - exiting 19:18:39 (708): No heartbeat from core client for 30 sec - exiting 19:18:40 (708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 21:51:01 (4120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 19:22:05 (4596): No heartbeat from core client for 30 sec - exiting 19:22:06 (4596): No heartbeat from core client for 30 sec - exiting 19:22:07 (4596): No heartbeat from core client for 30 sec - exiting 19:22:09 (4596): No heartbeat from core client for 30 sec - exiting 19:22:10 (4596): No heartbeat from core client for 30 sec - exiting 19:22:11 (4596): No heartbeat from core client for 30 sec - exiting 19:22:12 (4596): No heartbeat from core client for 30 sec - exiting 19:22:13 (4596): No heartbeat from core client for 30 sec - exiting 19:22:14 (4596): No heartbeat from core client for 30 sec - exiting 19:22:15 (4596): No heartbeat from core client for 30 sec - exiting 19:22:16 (4596): No heartbeat from core client for 30 sec - exiting 19:22:17 (4596): No heartbeat from core client for 30 sec - exiting 19:22:18 (4596): No heartbeat from core client for 30 sec - exiting 19:22:19 (4596): No heartbeat from core client for 30 sec - exiting 19:22:21 (4596): No heartbeat from core client for 30 sec - exiting 19:22:22 (4596): No heartbeat from core client for 30 sec - exiting 19:22:23 (4596): No heartbeat from core client for 30 sec - exiting 19:22:24 (4596): No heartbeat from core client for 30 sec - exiting 19:22:25 (4596): No heartbeat from core client for 30 sec - exiting 19:22:26 (4596): No heartbeat from core client for 30 sec - exiting 19:22:27 (4596): No heartbeat from core client for 30 sec - exiting 19:22:28 (4596): No heartbeat from core client for 30 sec - exiting 19:22:29 (4596): No heartbeat from core client for 30 sec - exiting 19:22:30 (4596): No heartbeat from core client for 30 sec - exiting 19:22:31 (4596): No heartbeat from core client for 30 sec - exiting 19:22:33 (4596): No heartbeat from core client for 30 sec - exiting 19:22:34 (4596): No heartbeat from core client for 30 sec - exiting 19:22:35 (4596): No heartbeat from core client for 30 sec - exiting 19:22:36 (4596): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 03:26:38 (5792): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:18:42 (5060): No heartbeat from core client for 30 sec - exiting 17:18:44 (5060): No heartbeat from core client for 30 sec - exiting 17:18:45 (5060): No heartbeat from core client for 30 sec - exiting 17:18:46 (5060): No heartbeat from core client for 30 sec - exiting 17:18:47 (5060): No heartbeat from core client for 30 sec - exiting 17:18:48 (5060): No heartbeat from core client for 30 sec - exiting 17:18:49 (5060): No heartbeat from core client for 30 sec - exiting 17:18:50 (5060): No heartbeat from core client for 30 sec - exiting 17:18:51 (5060): No heartbeat from core client for 30 sec - exiting 17:18:52 (5060): No heartbeat from core client for 30 sec - exiting 17:18:53 (5060): No heartbeat from core client for 30 sec - exiting 17:18:55 (5060): No heartbeat from core client for 30 sec - exiting 17:18:56 (5060): No heartbeat from core client for 30 sec - exiting 17:18:57 (5060): No heartbeat from core client for 30 sec - exiting 17:18:58 (5060): No heartbeat from core client for 30 sec - exiting 17:18:59 (5060): No heartbeat from core client for 30 sec - exiting 17:19:00 (5060): No heartbeat from core client for 30 sec - exiting 17:19:01 (5060): No heartbeat from core client for 30 sec - exiting 17:19:02 (5060): No heartbeat from core client for 30 sec - exiting 17:19:03 (5060): No heartbeat from core client for 30 sec - exiting 17:19:04 (5060): No heartbeat from core client for 30 sec - exiting 17:19:05 (5060): No heartbeat from core client for 30 sec - exiting 17:19:07 (5060): No heartbeat from core client for 30 sec - exiting 17:19:08 (5060): No heartbeat from core client for 30 sec - exiting 17:19:09 (5060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:19:10 (5060): No heartbeat from core client for 30 sec - exiting 17:19:11 (5060): No heartbeat from core client for 30 sec - exiting 17:19:12 (5060): No heartbeat from core client for 30 sec - exiting 17:19:13 (5060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:45:01 (1732): No heartbeat from core client for 30 sec - exiting 15:45:02 (1732): No heartbeat from core client for 30 sec - exiting 15:45:03 (1732): No heartbeat from core client for 30 sec - exiting 15:45:04 (1732): No heartbeat from core client for 30 sec - exiting 15:45:05 (1732): No heartbeat from core client for 30 sec - exiting 15:45:06 (1732): No heartbeat from core client for 30 sec - exiting 15:45:07 (1732): No heartbeat from core client for 30 sec - exiting 15:45:08 (1732): No heartbeat from core client for 30 sec - exiting 15:45:09 (1732): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:55:13 (2956): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x770471D3 read attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4488, selfPID=4488, iMonCtr=1 Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77047353 read attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77043A93 read attempt to address 0x00000000 Engaging BOINC Windows Runtime Debugger... Cannot serialize file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_t2ai_1940_40_007544707/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
12 Dec 2011 08:13:14	1179495	13630591	hadcm3n_t2ai_1940_40_007544707_1	518,400	872,130	1.6823
11 Dec 2011 07:41:33	1179495	13630591	hadcm3n_t2ai_1940_40_007544707_1	492,480	831,003	1.6874
10 Dec 2011 11:56:46	1179495	13630591	hadcm3n_t2ai_1940_40_007544707_1	466,560	789,566	1.6923
09 Dec 2011 03:56:30	1179495	13630591	hadcm3n_t2ai_1940_40_007544707_1	440,640	746,943	1.6951
08 Dec 2011 15:29:50	1179495	13630591	hadcm3n_t2ai_1940_40_007544707_1	414,720	702,837	1.6947
07 Dec 2011 19:22:24	1179495	13630591	hadcm3n_t2ai_1940_40_007544707_1	388,800	661,139	1.7005
06 Dec 2011 04:43:34	1179495	13630591	hadcm3n_t2ai_1940_40_007544707_1	362,880	617,152	1.7007
05 Dec 2011 03:29:42	1179495	13630591	hadcm3n_t2ai_1940_40_007544707_1	336,960	573,614	1.7023
04 Dec 2011 15:11:32	1179495	13630591	hadcm3n_t2ai_1940_40_007544707_1	311,040	530,892	1.7068
03 Dec 2011 12:17:02	1179495	13630591	hadcm3n_t2ai_1940_40_007544707_1	285,120	487,977	1.7115
02 Dec 2011 22:38:34	1179495	13630591	hadcm3n_t2ai_1940_40_007544707_1	259,200	444,559	1.7151
01 Dec 2011 08:45:49	1179495	13630591	hadcm3n_t2ai_1940_40_007544707_1	233,280	400,778	1.7180
30 Nov 2011 16:37:17	1179495	13630591	hadcm3n_t2ai_1940_40_007544707_1	207,360	357,011	1.7217
28 Nov 2011 22:12:24	1179495	13630591	hadcm3n_t2ai_1940_40_007544707_1	181,440	313,416	1.7274
27 Nov 2011 18:08:28	1179495	13630591	hadcm3n_t2ai_1940_40_007544707_1	155,520	269,388	1.7322
27 Nov 2011 04:44:32	1179495	13630591	hadcm3n_t2ai_1940_40_007544707_1	129,600	225,913	1.7432
25 Nov 2011 07:45:43	1179495	13630591	hadcm3n_t2ai_1940_40_007544707_1	103,680	181,620	1.7517
24 Nov 2011 17:54:07	1179495	13630591	hadcm3n_t2ai_1940_40_007544707_1	77,760	136,290	1.7527
21 Nov 2011 07:18:04	1179495	13630591	hadcm3n_t2ai_1940_40_007544707_1	51,840	88,957	1.7160
20 Nov 2011 07:37:34	1179495	13630591	hadcm3n_t2ai_1940_40_007544707_1	25,920	42,970	1.6578