Task 16148135

Name	hadcm3n_n2vx_1880_40_008408847_3
Workunit	8559703
Created	19 Dec 2013, 20:24:58 UTC
Sent	19 Dec 2013, 20:25:29 UTC
Report deadline	21 Mar 2014, 3:52:40 UTC
Received	17 Jan 2014, 12:44:53 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1087624
Run time	5 days 15 hours 41 min 27 sec
CPU time	5 days 12 hours 47 min 20 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	3.22 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.2.33</core_client_version> <![CDATA[ <message> (unknown error) - exit code -1073741819 (0xc0000005) </message> <stderr_txt> 16:00:38 (9164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:29:06 (6740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:35:54 (7664): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:35:55 (7664): No heartbeat from core client for 30 sec - exiting 22:17:10 (6296): No heartbeat from core client for 30 sec - exiting 22:17:11 (6296): No heartbeat from core client for 30 sec - exiting 22:17:12 (6296): No heartbeat from core client for 30 sec - exiting 22:17:13 (6296): No heartbeat from core client for 30 sec - exiting 22:17:14 (6296): No heartbeat from core client for 30 sec - exiting 22:17:15 (6296): No heartbeat from core client for 30 sec - exiting 22:17:16 (6296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:32:02 (5636): No heartbeat from core client for 30 sec - exiting 12:32:03 (5636): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5480, iMonCtr=1 Model crash detected, will try to restart... 19:01:02 (7492): No heartbeat from core client for 30 sec - exiting 19:01:03 (7492): No heartbeat from core client for 30 sec - exiting 19:01:04 (7492): No heartbeat from core client for 30 sec - exiting 19:01:05 (7492): No heartbeat from core client for 30 sec - exiting 19:01:06 (7492): No heartbeat from core client for 30 sec - exiting 19:01:07 (7492): No heartbeat from core client for 30 sec - exiting 19:01:08 (7492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8552, iMonCtr=1 Model crash detected, will try to restart... 11:05:27 (4736): No heartbeat from core client for 30 sec - exiting 11:05:28 (4736): No heartbeat from core client for 30 sec - exiting 11:05:29 (4736): No heartbeat from core client for 30 sec - exiting 11:05:30 (4736): No heartbeat from core client for 30 sec - exiting 11:05:31 (4736): No heartbeat from core client for 30 sec - exiting 11:05:32 (4736): No heartbeat from core client for 30 sec - exiting 11:05:33 (4736): No heartbeat from core client for 30 sec - exiting 11:05:34 (4736): No heartbeat from core client for 30 sec - exiting 11:05:35 (4736): No heartbeat from core client for 30 sec - exiting 11:05:36 (4736): No heartbeat from core client for 30 sec - exiting 11:05:37 (4736): No heartbeat from core client for 30 sec - exiting 11:05:38 (4736): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5364, iMonCtr=1 Model crash detected, will try to restart... 18:23:42 (872): No heartbeat from core client for 30 sec - exiting 18:23:43 (872): No heartbeat from core client for 30 sec - exiting 18:23:44 (872): No heartbeat from core client for 30 sec - exiting 18:23:45 (872): No heartbeat from core client for 30 sec - exiting 18:23:46 (872): No heartbeat from core client for 30 sec - exiting 18:23:47 (872): No heartbeat from core client for 30 sec - exiting 18:23:48 (872): No heartbeat from core client for 30 sec - exiting 18:23:49 (872): No heartbeat from core client for 30 sec - exiting 18:23:50 (872): No heartbeat from core client for 30 sec - exiting 18:23:51 (872): No heartbeat from core client for 30 sec - exiting 18:23:52 (872): No heartbeat from core client for 30 sec - exiting 18:23:53 (872): No heartbeat from core client for 30 sec - exiting 18:23:54 (872): No heartbeat from core client for 30 sec - exiting 18:23:55 (872): No heartbeat from core client for 30 sec - exiting 18:23:56 (872): No heartbeat from core client for 30 sec - exiting 18:23:57 (872): No heartbeat from core client for 30 sec - exiting 18:23:58 (872): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:24:47 (6692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:18:26 (3276): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:18:27 (3276): No heartbeat from core client for 30 sec - exiting 23:41:01 (3892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 19:34:17 (204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7424, iMonCtr=1 Model crash detected, will try to restart... 11:09:43 (6928): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:06:02 (8024): No heartbeat from core client for 30 sec - exiting 16:06:03 (8024): No heartbeat from core client for 30 sec - exiting 16:06:04 (8024): No heartbeat from core client for 30 sec - exiting 16:06:05 (8024): No heartbeat from core client for 30 sec - exiting 16:06:06 (8024): No heartbeat from core client for 30 sec - exiting 16:06:07 (8024): No heartbeat from core client for 30 sec - exiting 16:06:08 (8024): No heartbeat from core client for 30 sec - exiting 16:06:09 (8024): No heartbeat from core client for 30 sec - exiting 16:06:10 (8024): No heartbeat from core client for 30 sec - exiting 16:06:11 (8024): No heartbeat from core client for 30 sec - exiting 16:06:12 (8024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:51:36 (6604): No heartbeat from core client for 30 sec - exiting 10:51:37 (6604): No heartbeat from core client for 30 sec - exiting 10:51:38 (6604): No heartbeat from core client for 30 sec - exiting 10:51:39 (6604): No heartbeat from core client for 30 sec - exiting 10:51:40 (6604): No heartbeat from core client for 30 sec - exiting 10:51:41 (6604): No heartbeat from core client for 30 sec - exiting 10:51:42 (6604): No heartbeat from core client for 30 sec - exiting 10:51:43 (6604): No heartbeat from core client for 30 sec - exiting 10:51:44 (6604): No heartbeat from core client for 30 sec - exiting 10:51:45 (6604): No heartbeat from core client for 30 sec - exiting 10:51:46 (6604): No heartbeat from core client for 30 sec - exiting 10:51:47 (6604): No heartbeat from core client for 30 sec - exiting 10:51:48 (6604): No heartbeat from core client for 30 sec - exiting 10:51:49 (6604): No heartbeat from core client for 30 sec - exiting 10:51:50 (6604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:51:51 (6604): No heartbeat from core client for 30 sec - exiting 11:01:33 (9784): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 19:17:34 (6304): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 19:31:47 (8120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:33:13 (5652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:36:48 (7436): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:05:30 (8912): No heartbeat from core client for 30 sec - exiting 21:05:31 (8912): No heartbeat from core client for 30 sec - exiting 21:05:32 (8912): No heartbeat from core client for 30 sec - exiting 21:05:33 (8912): No heartbeat from core client for 30 sec - exiting 21:05:34 (8912): No heartbeat from core client for 30 sec - exiting 21:05:35 (8912): No heartbeat from core client for 30 sec - exiting 21:05:36 (8912): No heartbeat from core client for 30 sec - exiting 21:05:37 (8912): No heartbeat from core client for 30 sec - exiting 21:05:38 (8912): No heartbeat from core client for 30 sec - exiting 21:05:39 (8912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:05:40 (8912): No heartbeat from core client for 30 sec - exiting 18:52:36 (944): No heartbeat from core client for 30 sec - exiting 18:52:37 (944): No heartbeat from core client for 30 sec - exiting 18:52:38 (944): No heartbeat from core client for 30 sec - exiting 18:52:39 (944): No heartbeat from core client for 30 sec - exiting 18:52:40 (944): No heartbeat from core client for 30 sec - exiting 18:52:41 (944): No heartbeat from core client for 30 sec - exiting 18:52:42 (944): No heartbeat from core client for 30 sec - exiting 18:52:43 (944): No heartbeat from core client for 30 sec - exiting 18:52:44 (944): No heartbeat from core client for 30 sec - exiting 18:52:45 (944): No heartbeat from core client for 30 sec - exiting 18:52:46 (944): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7904, iMonCtr=1 Model crash detected, will try to restart... 19:51:39 (8384): No heartbeat from core client for 30 sec - exiting 19:51:40 (8384): No heartbeat from core client for 30 sec - exiting 19:51:41 (8384): No heartbeat from core client for 30 sec - exiting 19:51:42 (8384): No heartbeat from core client for 30 sec - exiting 19:51:43 (8384): No heartbeat from core client for 30 sec - exiting 19:51:44 (8384): No heartbeat from core client for 30 sec - exiting 19:51:45 (8384): No heartbeat from core client for 30 sec - exiting 19:51:46 (8384): No heartbeat from core client for 30 sec - exiting 19:51:47 (8384): No heartbeat from core client for 30 sec - exiting 19:51:48 (8384): No heartbeat from core client for 30 sec - exiting 19:51:49 (8384): No heartbeat from core client for 30 sec - exiting 19:51:50 (8384): No heartbeat from core client for 30 sec - exiting 19:51:51 (8384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:51:52 (8384): No heartbeat from core client for 30 sec - exiting 22:12:23 (3976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:39:41 (8132): No heartbeat from core client for 30 sec - exiting 19:39:42 (8132): No heartbeat from core client for 30 sec - exiting 19:39:43 (8132): No heartbeat from core client for 30 sec - exiting 19:39:44 (8132): No heartbeat from core client for 30 sec - exiting 19:39:45 (8132): No heartbeat from core client for 30 sec - exiting 19:39:46 (8132): No heartbeat from core client for 30 sec - exiting 19:39:47 (8132): No heartbeat from core client for 30 sec - exiting 19:39:48 (8132): No heartbeat from core client for 30 sec - exiting 19:39:49 (8132): No heartbeat from core client for 30 sec - exiting 19:39:50 (8132): No heartbeat from core client for 30 sec - exiting 19:39:51 (8132): No heartbeat from core client for 30 sec - exiting 19:39:52 (8132): No heartbeat from core client for 30 sec - exiting 19:39:53 (8132): No heartbeat from core client for 30 sec - exiting 19:39:54 (8132): No heartbeat from core client for 30 sec - exiting 19:39:55 (8132): No heartbeat from core client for 30 sec - exiting 19:39:56 (8132): No heartbeat from core client for 30 sec - exiting 19:39:57 (8132): No heartbeat from core client for 30 sec - exiting 19:39:58 (8132): No heartbeat from core client for 30 sec - exiting 19:39:59 (8132): No heartbeat from core client for 30 sec - exiting 19:40:00 (8132): No heartbeat from core client for 30 sec - exiting 19:40:01 (8132): No heartbeat from core client for 30 sec - exiting 19:40:02 (8132): No heartbeat from core client for 30 sec - exiting 19:40:03 (8132): No heartbeat from core client for 30 sec - exiting 19:40:04 (8132): No heartbeat from core client for 30 sec - exiting 19:40:05 (8132): No heartbeat from core client for 30 sec - exiting 19:40:06 (8132): No heartbeat from core client for 30 sec - exiting 19:40:07 (8132): No heartbeat from core client for 30 sec - exiting 19:40:08 (8132): No heartbeat from core client for 30 sec - exiting 19:40:09 (8132): No heartbeat from core client for 30 sec - exiting 19:40:10 (8132): No heartbeat from core client for 30 sec - exiting 19:40:11 (8132): No heartbeat from core client for 30 sec - exiting 19:40:12 (8132): No heartbeat from core client for 30 sec - exiting 19:40:13 (8132): No heartbeat from core client for 30 sec - exiting 19:40:14 (8132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5256, iMonCtr=1 Model crash detected, will try to restart... 10:08:07 (3796): No heartbeat from core client for 30 sec - exiting 10:08:08 (3796): No heartbeat from core client for 30 sec - exiting 10:08:09 (3796): No heartbeat from core client for 30 sec - exiting 10:08:10 (3796): No heartbeat from core client for 30 sec - exiting 10:08:11 (3796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 18:43:12 (5024): No heartbeat from core client for 30 sec - exiting 18:43:14 (5024): No heartbeat from core client for 30 sec - exiting 18:43:15 (5024): No heartbeat from core client for 30 sec - exiting 18:43:16 (5024): No heartbeat from core client for 30 sec - exiting 18:43:17 (5024): No heartbeat from core client for 30 sec - exiting 18:43:18 (5024): No heartbeat from core client for 30 sec - exiting 18:43:19 (5024): No heartbeat from core client for 30 sec - exiting 18:43:20 (5024): No heartbeat from core client for 30 sec - exiting 18:43:21 (5024): No heartbeat from core client for 30 sec - exiting 18:43:22 (5024): No heartbeat from core client for 30 sec - exiting 18:43:23 (5024): No heartbeat from core client for 30 sec - exiting 18:43:24 (5024): No heartbeat from core client for 30 sec - exiting 18:43:25 (5024): No heartbeat from core client for 30 sec - exiting 18:43:26 (5024): No heartbeat from core client for 30 sec - exiting 18:43:27 (5024): No heartbeat from core client for 30 sec - exiting 18:43:28 (5024): No heartbeat from core client for 30 sec - exiting 18:43:29 (5024): No heartbeat from core client for 30 sec - exiting 18:43:30 (5024): No heartbeat from core client for 30 sec - exiting 18:43:31 (5024): No heartbeat from core client for 30 sec - exiting 18:43:32 (5024): No heartbeat from core client for 30 sec - exiting 18:43:33 (5024): No heartbeat from core client for 30 sec - exiting 18:43:34 (5024): No heartbeat from core client for 30 sec - exiting 18:43:35 (5024): No heartbeat from core client for 30 sec - exiting 18:43:36 (5024): No heartbeat from core client for 30 sec - exiting 18:43:37 (5024): No heartbeat from core client for 30 sec - exiting 18:43:38 (5024): No heartbeat from core client for 30 sec - exiting 18:43:39 (5024): No heartbeat from core client for 30 sec - exiting 18:43:40 (5024): No heartbeat from core client for 30 sec - exiting 18:43:41 (5024): No heartbeat from core client for 30 sec - exiting 18:43:42 (5024): No heartbeat from core client for 30 sec - exiting 18:43:43 (5024): No heartbeat from core client for 30 sec - exiting 18:43:44 (5024): No heartbeat from core client for 30 sec - exiting 18:43:45 (5024): No heartbeat from core client for 30 sec - exiting 18:43:46 (5024): No heartbeat from core client for 30 sec - exiting 18:43:47 (5024): No heartbeat from core client for 30 sec - exiting 18:43:48 (5024): No heartbeat from core client for 30 sec - exiting 18:43:49 (5024): No heartbeat from core client for 30 sec - exiting 18:43:50 (5024): No heartbeat from core client for 30 sec - exiting 18:43:51 (5024): No heartbeat from core client for 30 sec - exiting 18:43:52 (5024): No heartbeat from core client for 30 sec - exiting 18:43:53 (5024): No heartbeat from core client for 30 sec - exiting 18:43:54 (5024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 18:59:12 (736): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 14:53:05 (2536): No heartbeat from core client for 30 sec - exiting 14:53:06 (2536): No heartbeat from core client for 30 sec - exiting 14:53:07 (2536): No heartbeat from core client for 30 sec - exiting 14:53:08 (2536): No heartbeat from core client for 30 sec - exiting 14:53:09 (2536): No heartbeat from core client for 30 sec - exiting 14:53:10 (2536): No heartbeat from core client for 30 sec - exiting 14:53:11 (2536): No heartbeat from core client for 30 sec - exiting 14:53:12 (2536): No heartbeat from core client for 30 sec - exiting 14:53:13 (2536): No heartbeat from core client for 30 sec - exiting 14:53:14 (2536): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:53:15 (2536): No heartbeat from core client for 30 sec - exiting 14:54:04 (2544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:43:43 (5380): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:22:43 (7824): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:32:41 (5524): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:33:19 (9584): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 23:03:37 (8620): No heartbeat from core client for 30 sec - exiting 23:03:38 (8620): No heartbeat from core client for 30 sec - exiting 23:03:39 (8620): No heartbeat from core client for 30 sec - exiting 23:03:40 (8620): No heartbeat from core client for 30 sec - exiting 23:03:41 (8620): No heartbeat from core client for 30 sec - exiting 23:03:42 (8620): No heartbeat from core client for 30 sec - exiting 23:03:43 (8620): No heartbeat from core client for 30 sec - exiting 23:03:44 (8620): No heartbeat from core client for 30 sec - exiting 23:03:45 (8620): No heartbeat from core client for 30 sec - exiting 23:03:46 (8620): No heartbeat from core client for 30 sec - exiting 23:03:47 (8620): No heartbeat from core client for 30 sec - exiting 23:03:48 (8620): No heartbeat from core client for 30 sec - exiting 23:03:49 (8620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:03:50 (8620): No heartbeat from core client for 30 sec - exiting 12:41:29 (2220): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:00:52 (5412): No heartbeat from core client for 30 sec - exiting 18:00:53 (5412): No heartbeat from core client for 30 sec - exiting 18:00:54 (5412): No heartbeat from core client for 30 sec - exiting 18:00:55 (5412): No heartbeat from core client for 30 sec - exiting 18:00:56 (5412): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:00:04 (5464): No heartbeat from core client for 30 sec - exiting 09:00:05 (5464): No heartbeat from core client for 30 sec - exiting 09:00:06 (5464): No heartbeat from core client for 30 sec - exiting 09:00:07 (5464): No heartbeat from core client for 30 sec - exiting 09:00:08 (5464): No heartbeat from core client for 30 sec - exiting 09:00:09 (5464): No heartbeat from core client for 30 sec - exiting 09:00:10 (5464): No heartbeat from core client for 30 sec - exiting 09:00:11 (5464): No heartbeat from core client for 30 sec - exiting 09:00:12 (5464): No heartbeat from core client for 30 sec - exiting 09:00:13 (5464): No heartbeat from core client for 30 sec - exiting 09:00:14 (5464): No heartbeat from core client for 30 sec - exiting 09:00:15 (5464): No heartbeat from core client for 30 sec - exiting 09:00:16 (5464): No heartbeat from core client for 30 sec - exiting 09:00:17 (5464): No heartbeat from core client for 30 sec - exiting 09:00:18 (5464): No heartbeat from core client for 30 sec - exiting 09:00:19 (5464): No heartbeat from core client for 30 sec - exiting 09:00:20 (5464): No heartbeat from core client for 30 sec - exiting 09:00:21 (5464): No heartbeat from core client for 30 sec - exiting 09:00:22 (5464): No heartbeat from core client for 30 sec - exiting 09:00:23 (5464): No heartbeat from core client for 30 sec - exiting 09:00:24 (5464): No heartbeat from core client for 30 sec - exiting 09:00:25 (5464): No heartbeat from core client for 30 sec - exiting 09:00:26 (5464): No heartbeat from core client for 30 sec - exiting 09:00:27 (5464): No heartbeat from core client for 30 sec - exiting 09:00:28 (5464): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:04:40 (3592): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8204, iMonCtr=1 Model crash detected, will try to restart... 19:50:10 (2120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:51:04 (7204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x76F65F1B read attempt to address 0x40A651C7 Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x779F5F1B read attempt to address 0x40A651C7 Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
15 Jan 2014 21:50:50	1087624	16148135	hadcm3n_n2vx_1880_40_008408847_3	259,200	475,641	1.8350
14 Jan 2014 20:20:44	1087624	16148135	hadcm3n_n2vx_1880_40_008408847_3	233,280	425,516	1.8241
11 Jan 2014 16:08:10	1087624	16148135	hadcm3n_n2vx_1880_40_008408847_3	207,360	378,395	1.8248
08 Jan 2014 20:28:28	1087624	16148135	hadcm3n_n2vx_1880_40_008408847_3	181,440	330,661	1.8224
05 Jan 2014 20:50:13	1087624	16148135	hadcm3n_n2vx_1880_40_008408847_3	155,520	283,393	1.8222
03 Jan 2014 12:51:45	1087624	16148135	hadcm3n_n2vx_1880_40_008408847_3	129,600	236,604	1.8256
26 Dec 2013 22:44:28	1087624	16148135	hadcm3n_n2vx_1880_40_008408847_3	103,680	188,799	1.8210
24 Dec 2013 22:07:57	1087624	16148135	hadcm3n_n2vx_1880_40_008408847_3	77,760	140,782	1.8105
23 Dec 2013 20:00:15	1087624	16148135	hadcm3n_n2vx_1880_40_008408847_3	51,840	93,953	1.8124
21 Dec 2013 18:00:46	1087624	16148135	hadcm3n_n2vx_1880_40_008408847_3	25,920	46,887	1.8089