Task 13612506

Name	hadcm3n_y881_1900_40_007526263_2
Workunit	7723738
Created	6 Nov 2011, 9:53:02 UTC
Sent	19 Nov 2011, 6:02:15 UTC
Report deadline	18 Feb 2012, 13:29:26 UTC
Received	6 Dec 2011, 3:37:03 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	295995
Run time	6 days 23 hours 1 min 25 sec
CPU time	4 days 17 hours 10 min 43 sec
Validate state	Invalid
Credit	2,177.28
Device peak FLOPS	2.70 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.8.23</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... 01:24:53 (5060): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 02:26:07 (5640): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:16:05 (404): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 03:16:07 (404): No heartbeat from core client for 30 sec - exiting 03:16:08 (404): No heartbeat from core client for 30 sec - exiting 03:16:09 (404): No heartbeat from core client for 30 sec - exiting 03:16:10 (404): No heartbeat from core client for 30 sec - exiting 03:16:11 (404): No heartbeat from core client for 30 sec - exiting 03:16:12 (404): No heartbeat from core client for 30 sec - exiting 03:16:13 (404): No heartbeat from core client for 30 sec - exiting 03:16:14 (404): No heartbeat from core client for 30 sec - exiting 03:16:15 (404): No heartbeat from core client for 30 sec - exiting 03:16:16 (404): No heartbeat from core client for 30 sec - exiting 03:16:18 (404): No heartbeat from core client for 30 sec - exiting 03:16:19 (404): No heartbeat from core client for 30 sec - exiting 03:16:20 (404): No heartbeat from core client for 30 sec - exiting 03:16:21 (404): No heartbeat from core client for 30 sec - exiting 03:16:22 (404): No heartbeat from core client for 30 sec - exiting 03:16:23 (404): No heartbeat from core client for 30 sec - exiting 03:16:24 (404): No heartbeat from core client for 30 sec - exiting 03:16:25 (404): No heartbeat from core client for 30 sec - exiting 03:16:26 (404): No heartbeat from core client for 30 sec - exiting 03:16:27 (404): No heartbeat from core client for 30 sec - exiting 03:16:29 (404): No heartbeat from core client for 30 sec - exiting 03:16:30 (404): No heartbeat from core client for 30 sec - exiting 03:16:31 (404): No heartbeat from core client for 30 sec - exiting 03:16:32 (404): No heartbeat from core client for 30 sec - exiting 03:16:33 (404): No heartbeat from core client for 30 sec - exiting 03:16:34 (404): No heartbeat from core client for 30 sec - exiting 03:16:35 (404): No heartbeat from core client for 30 sec - exiting 03:16:36 (404): No heartbeat from core client for 30 sec - exiting 03:16:37 (404): No heartbeat from core client for 30 sec - exiting 03:16:38 (404): No heartbeat from core client for 30 sec - exiting 03:16:39 (404): No heartbeat from core client for 30 sec - exiting 03:16:41 (404): No heartbeat from core client for 30 sec - exiting 03:16:42 (404): No heartbeat from core client for 30 sec - exiting 03:16:43 (404): No heartbeat from core client for 30 sec - exiting 03:16:44 (404): No heartbeat from core client for 30 sec - exiting 03:16:45 (404): No heartbeat from core client for 30 sec - exiting 03:16:46 (404): No heartbeat from core client for 30 sec - exiting 03:16:47 (404): No heartbeat from core client for 30 sec - exiting 03:16:48 (404): No heartbeat from core client for 30 sec - exiting 03:16:49 (404): No heartbeat from core client for 30 sec - exiting 03:16:50 (404): No heartbeat from core client for 30 sec - exiting 03:16:51 (404): No heartbeat from core client for 30 sec - exiting 03:16:53 (404): No heartbeat from core client for 30 sec - exiting 03:16:54 (404): No heartbeat from core client for 30 sec - exiting 03:16:55 (404): No heartbeat from core client for 30 sec - exiting 03:16:56 (404): No heartbeat from core client for 30 sec - exiting 03:16:57 (404): No heartbeat from core client for 30 sec - exiting 03:16:58 (404): No heartbeat from core client for 30 sec - exiting 03:16:59 (404): No heartbeat from core client for 30 sec - exiting 03:17:00 (404): No heartbeat from core client for 30 sec - exiting 03:17:01 (404): No heartbeat from core client for 30 sec - exiting 03:17:02 (404): No heartbeat from core client for 30 sec - exiting 03:17:04 (404): No heartbeat from core client for 30 sec - exiting 03:17:05 (404): No heartbeat from core client for 30 sec - exiting 03:17:06 (404): No heartbeat from core client for 30 sec - exiting 03:17:07 (404): No heartbeat from core client for 30 sec - exiting 03:17:08 (404): No heartbeat from core client for 30 sec - exiting 03:17:09 (404): No heartbeat from core client for 30 sec - exiting 03:17:10 (404): No heartbeat from core client for 30 sec - exiting 03:17:11 (404): No heartbeat from core client for 30 sec - exiting 03:17:12 (404): No heartbeat from core client for 30 sec - exiting 03:17:13 (404): No heartbeat from core client for 30 sec - exiting 03:17:14 (404): No heartbeat from core client for 30 sec - exiting 03:17:16 (404): No heartbeat from core client for 30 sec - exiting 03:17:17 (404): No heartbeat from core client for 30 sec - exiting 03:17:18 (404): No heartbeat from core client for 30 sec - exiting 03:17:19 (404): No heartbeat from core client for 30 sec - exiting 03:17:20 (404): No heartbeat from core client for 30 sec - exiting 03:17:21 (404): No heartbeat from core client for 30 sec - exiting 03:17:22 (404): No heartbeat from core client for 30 sec - exiting 03:17:23 (404): No heartbeat from core client for 30 sec - exiting 03:17:24 (404): No heartbeat from core client for 30 sec - exiting 03:17:25 (404): No heartbeat from core client for 30 sec - exiting 03:17:26 (404): No heartbeat from core client for 30 sec - exiting 03:17:28 (404): No heartbeat from core client for 30 sec - exiting 03:17:29 (404): No heartbeat from core client for 30 sec - exiting 03:17:30 (404): No heartbeat from core client for 30 sec - exiting 03:17:31 (404): No heartbeat from core client for 30 sec - exiting 03:17:32 (404): No heartbeat from core client for 30 sec - exiting 03:17:33 (404): No heartbeat from core client for 30 sec - exiting 03:17:34 (404): No heartbeat from core client for 30 sec - exiting 03:17:35 (404): No heartbeat from core client for 30 sec - exiting 03:17:36 (404): No heartbeat from core client for 30 sec - exiting 03:17:37 (404): No heartbeat from core client for 30 sec - exiting 03:17:39 (404): No heartbeat from core client for 30 sec - exiting 03:17:40 (404): No heartbeat from core client for 30 sec - exiting 03:17:41 (404): No heartbeat from core client for 30 sec - exiting 03:17:42 (404): No heartbeat from core client for 30 sec - exiting 03:17:43 (404): No heartbeat from core client for 30 sec - exiting 03:17:44 (404): No heartbeat from core client for 30 sec - exiting 03:17:45 (404): No heartbeat from core client for 30 sec - exiting 03:17:46 (404): No heartbeat from core client for 30 sec - exiting 03:17:47 (404): No heartbeat from core client for 30 sec - exiting 03:17:48 (404): No heartbeat from core client for 30 sec - exiting 03:17:49 (404): No heartbeat from core client for 30 sec - exiting 03:17:51 (404): No heartbeat from core client for 30 sec - exiting 03:17:52 (404): No heartbeat from core client for 30 sec - exiting 03:17:53 (404): No heartbeat from core client for 30 sec - exiting 03:17:54 (404): No heartbeat from core client for 30 sec - exiting 03:17:55 (404): No heartbeat from core client for 30 sec - exiting 03:17:56 (404): No heartbeat from core client for 30 sec - exiting 03:17:57 (404): No heartbeat from core client for 30 sec - exiting 03:17:58 (404): No heartbeat from core client for 30 sec - exiting 03:17:59 (404): No heartbeat from core client for 30 sec - exiting 03:18:00 (404): No heartbeat from core client for 30 sec - exiting 03:18:01 (404): No heartbeat from core client for 30 sec - exiting 03:18:03 (404): No heartbeat from core client for 30 sec - exiting 03:18:04 (404): No heartbeat from core client for 30 sec - exiting 03:18:05 (404): No heartbeat from core client for 30 sec - exiting 03:18:06 (404): No heartbeat from core client for 30 sec - exiting 03:18:07 (404): No heartbeat from core client for 30 sec - exiting 03:18:08 (404): No heartbeat from core client for 30 sec - exiting 03:18:09 (404): No heartbeat from core client for 30 sec - exiting 03:18:10 (404): No heartbeat from core client for 30 sec - exiting 03:18:11 (404): No heartbeat from core client for 30 sec - exiting 03:18:12 (404): No heartbeat from core client for 30 sec - exiting 03:18:14 (404): No heartbeat from core client for 30 sec - exiting 03:18:15 (404): No heartbeat from core client for 30 sec - exiting 03:18:16 (404): No heartbeat from core client for 30 sec - exiting 03:18:17 (404): No heartbeat from core client for 30 sec - exiting 03:18:18 (404): No heartbeat from core client for 30 sec - exiting 03:18:19 (404): No heartbeat from core client for 30 sec - exiting 03:18:20 (404): No heartbeat from core client for 30 sec - exiting 03:18:21 (404): No heartbeat from core client for 30 sec - exiting 03:18:22 (404): No heartbeat from core client for 30 sec - exiting 03:18:23 (404): No heartbeat from core client for 30 sec - exiting 03:18:24 (404): No heartbeat from core client for 30 sec - exiting 03:18:26 (404): No heartbeat from core client for 30 sec - exiting 03:18:27 (404): No heartbeat from core client for 30 sec - exiting 03:18:28 (404): No heartbeat from core client for 30 sec - exiting 03:18:29 (404): No heartbeat from core client for 30 sec - exiting 03:18:30 (404): No heartbeat from core client for 30 sec - exiting 03:18:31 (404): No heartbeat from core client for 30 sec - exiting 03:18:32 (404): No heartbeat from core client for 30 sec - exiting 03:18:33 (404): No heartbeat from core client for 30 sec - exiting 03:18:34 (404): No heartbeat from core client for 30 sec - exiting 03:18:35 (404): No heartbeat from core client for 30 sec - exiting 03:18:36 (404): No heartbeat from core client for 30 sec - exiting 03:18:38 (404): No heartbeat from core client for 30 sec - exiting 03:18:39 (404): No heartbeat from core client for 30 sec - exiting 03:18:40 (404): No heartbeat from core client for 30 sec - exiting 03:18:41 (404): No heartbeat from core client for 30 sec - exiting 03:18:42 (404): No heartbeat from core client for 30 sec - exiting 03:18:43 (404): No heartbeat from core client for 30 sec - exiting 03:18:44 (404): No heartbeat from core client for 30 sec - exiting 03:18:46 (404): No heartbeat from core client for 30 sec - exiting 03:18:47 (404): No heartbeat from core client for 30 sec - exiting 03:18:48 (404): No heartbeat from core client for 30 sec - exiting 03:18:49 (404): No heartbeat from core client for 30 sec - exiting 03:18:50 (404): No heartbeat from core client for 30 sec - exiting 03:18:51 (404): No heartbeat from core client for 30 sec - exiting 03:18:52 (404): No heartbeat from core client for 30 sec - exiting 03:18:53 (404): No heartbeat from core client for 30 sec - exiting 03:18:54 (404): No heartbeat from core client for 30 sec - exiting 03:18:55 (404): No heartbeat from core client for 30 sec - exiting 03:18:56 (404): No heartbeat from core client for 30 sec - exiting 03:18:58 (404): No heartbeat from core client for 30 sec - exiting 03:18:59 (404): No heartbeat from core client for 30 sec - exiting 03:19:00 (404): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:20:01 (6692): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 03:20:02 (6692): No heartbeat from core client for 30 sec - exiting 03:20:03 (6692): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 01:07:38 (604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:07:39 (604): No heartbeat from core client for 30 sec - exiting 01:07:40 (604): No heartbeat from core client for 30 sec - exiting 01:07:41 (604): No heartbeat from core client for 30 sec - exiting 01:07:42 (604): No heartbeat from core client for 30 sec - exiting 01:07:43 (604): No heartbeat from core client for 30 sec - exiting 01:07:44 (604): No heartbeat from core client for 30 sec - exiting 01:07:45 (604): No heartbeat from core client for 30 sec - exiting 01:07:46 (604): No heartbeat from core client for 30 sec - exiting 01:07:47 (604): No heartbeat from core client for 30 sec - exiting 01:07:48 (604): No heartbeat from core client for 30 sec - exiting 01:07:49 (604): No heartbeat from core client for 30 sec - exiting 01:07:50 (604): No heartbeat from core client for 30 sec - exiting 01:07:51 (604): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 03:16:03 (932): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:19:24 (5056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:20:08 (5908): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 19:20:09 (5908): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 04:28:30 (1324): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7172, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7172, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7172, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7172, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7172, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7172, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
03 Dec 2011 23:32:43	295995	13612506	hadcm3n_y881_1900_40_007526263_2	181,440	370,517	2.0421
01 Dec 2011 10:36:51	295995	13612506	hadcm3n_y881_1900_40_007526263_2	155,520	316,894	2.0376
28 Nov 2011 17:27:56	295995	13612506	hadcm3n_y881_1900_40_007526263_2	129,600	262,683	2.0269
26 Nov 2011 14:51:02	295995	13612506	hadcm3n_y881_1900_40_007526263_2	103,680	207,987	2.0060
24 Nov 2011 20:41:40	295995	13612506	hadcm3n_y881_1900_40_007526263_2	77,760	155,686	2.0021
23 Nov 2011 06:12:05	295995	13612506	hadcm3n_y881_1900_40_007526263_2	51,840	104,104	2.0082
21 Nov 2011 10:33:59	295995	13612506	hadcm3n_y881_1900_40_007526263_2	25,920	52,651	2.0313