Task 16008695

Name	hadcm3n_4f2h_1940_40_008302579_4
Workunit	8453714
Created	8 Sep 2013, 21:22:34 UTC
Sent	8 Sep 2013, 21:48:44 UTC
Report deadline	9 Dec 2013, 5:15:55 UTC
Received	19 Oct 2013, 19:57:21 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1129647
Run time	22 days 9 hours 58 min 36 sec
CPU time	21 days 7 hours 56 min 32 sec
Validate state	Invalid
Credit	12,441.60
Device peak FLOPS	2.90 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> (unknown error) - exit code -1073741819 (0xc0000005) </message> <stderr_txt> Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1260, iMonCtr=1 Model crash detected, will try to restart... 16:49:17 (5824): No heartbeat from core client for 30 sec - exiting 16:49:18 (5824): No heartbeat from core client for 30 sec - exiting 16:49:19 (5824): No heartbeat from core client for 30 sec - exiting 16:49:20 (5824): No heartbeat from core client for 30 sec - exiting 16:49:21 (5824): No heartbeat from core client for 30 sec - exiting 16:49:22 (5824): No heartbeat from core client for 30 sec - exiting 16:49:23 (5824): No heartbeat from core client for 30 sec - exiting 16:49:24 (5824): No heartbeat from core client for 30 sec - exiting 16:49:25 (5824): No heartbeat from core client for 30 sec - exiting 16:49:26 (5824): No heartbeat from core client for 30 sec - exiting 16:49:27 (5824): No heartbeat from core client for 30 sec - exiting 16:49:28 (5824): No heartbeat from core client for 30 sec - exiting 16:49:29 (5824): No heartbeat from core client for 30 sec - exiting 16:49:30 (5824): No heartbeat from core client for 30 sec - exiting 16:49:31 (5824): No heartbeat from core client for 30 sec - exiting 16:49:32 (5824): No heartbeat from core client for 30 sec - exiting 16:49:33 (5824): No heartbeat from core client for 30 sec - exiting 16:49:34 (5824): No heartbeat from core client for 30 sec - exiting 16:49:35 (5824): No heartbeat from core client for 30 sec - exiting 16:49:36 (5824): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... C16:56:24 (3972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5540, iMonCtr=1 Model crash detected, will try to restart... 14:21:23 (1288): No heartbeat from core client for 30 sec - exiting 14:21:24 (1288): No heartbeat from core client for 30 sec - exiting 14:21:25 (1288): No heartbeat from core client for 30 sec - exiting 14:21:26 (1288): No heartbeat from core client for 30 sec - exiting 14:21:27 (1288): No heartbeat from core client for 30 sec - exiting 14:21:28 (1288): No heartbeat from core client for 30 sec - exiting 14:21:29 (1288): No heartbeat from core client for 30 sec - exiting 14:21:30 (1288): No heartbeat from core client for 30 sec - exiting 14:21:31 (1288): No heartbeat from core client for 30 sec - exiting 14:21:32 (1288): No heartbeat from core client for 30 sec - exiting 14:21:33 (1288): No heartbeat from core client for 30 sec - exiting 14:21:34 (1288): No heartbeat from core client for 30 sec - exiting 14:21:35 (1288): No heartbeat from core client for 30 sec - exiting 14:21:36 (1288): No heartbeat from core client for 30 sec - exiting 14:21:37 (1288): No heartbeat from core client for 30 sec - exiting 14:21:38 (1288): No heartbeat from core client for 30 sec - exiting 14:21:39 (1288): No heartbeat from core client for 30 sec - exiting 14:21:40 (1288): No heartbeat from core client for 30 sec - exiting 14:21:41 (1288): No heartbeat from core client for 30 sec - exiting 14:21:42 (1288): No heartbeat from core client for 30 sec - exiting 14:21:43 (1288): No heartbeat from core client for 30 sec - exiting 14:21:44 (1288): No heartbeat from core client for 30 sec - exiting 14:21:45 (1288): No heartbeat from core client for 30 sec - exiting 14:21:46 (1288): No heartbeat from core client for 30 sec - exiting 14:21:47 (1288): No heartbeat from core client for 30 sec - exiting 14:21:48 (1288): No heartbeat from core client for 30 sec - exiting 14:21:49 (1288): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:11:31 (5948): No heartbeat from core client for 30 sec - exiting 12:11:32 (5948): No heartbeat from core client for 30 sec - exiting 12:11:33 (5948): No heartbeat from core client for 30 sec - exiting 12:11:34 (5948): No heartbeat from core client for 30 sec - exiting 12:11:35 (5948): No heartbeat from core client for 30 sec - exiting 12:11:36 (5948): No heartbeat from core client for 30 sec - exiting 12:11:37 (5948): No heartbeat from core client for 30 sec - exiting 12:11:38 (5948): No heartbeat from core client for 30 sec - exiting 12:11:39 (5948): No heartbeat from core client for 30 sec - exiting 12:11:40 (5948): No heartbeat from core client for 30 sec - exiting 12:11:41 (5948): No heartbeat from core client for 30 sec - exiting 12:11:42 (5948): No heartbeat from core client for 30 sec - exiting 12:11:43 (5948): No heartbeat from core client for 30 sec - exiting 12:11:44 (5948): No heartbeat from core client for 30 sec - exiting 12:11:45 (5948): No heartbeat from core client for 30 sec - exiting 12:11:46 (5948): No heartbeat from core client for 30 sec - exiting 12:11:47 (5948): No heartbeat from core client for 30 sec - exiting 12:11:48 (5948): No heartbeat from core client for 30 sec - exiting 12:11:49 (5948): No heartbeat from core client for 30 sec - exiting 12:11:50 (5948): No heartbeat from core client for 30 sec - exiting 12:11:51 (5948): No heartbeat from core client for 30 sec - exiting 12:11:52 (5948): No heartbeat from core client for 30 sec - exiting 12:11:53 (5948): No heartbeat from core client for 30 sec - exiting 12:11:54 (5948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7016, iMonCtr=1 Model crash detected, will try to restart... 05:23:12 (5852): No heartbeat from core client for 30 sec - exiting 05:23:13 (5852): No heartbeat from core client for 30 sec - exiting 05:23:14 (5852): No heartbeat from core client for 30 sec - exiting 05:23:15 (5852): No heartbeat from core client for 30 sec - exiting 05:23:16 (5852): No heartbeat from core client for 30 sec - exiting 05:23:17 (5852): No heartbeat from core client for 30 sec - exiting 05:23:18 (5852): No heartbeat from core client for 30 sec - exiting 05:23:19 (5852): No heartbeat from core client for 30 sec - exiting 05:23:20 (5852): No heartbeat from core client for 30 sec - exiting 05:23:21 (5852): No heartbeat from core client for 30 sec - exiting 05:23:22 (5852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:23:23 (5852): No heartbeat from core client for 30 sec - exiting 16:45:22 (5744): No heartbeat from core client for 30 sec - exiting 16:45:23 (5744): No heartbeat from core client for 30 sec - exiting 16:45:24 (5744): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5572, iMonCtr=1 Model crash detected, will try to restart... 05:36:00 (5832): No heartbeat from core client for 30 sec - exiting 05:36:01 (5832): No heartbeat from core client for 30 sec - exiting 05:36:02 (5832): No heartbeat from core client for 30 sec - exiting 05:36:03 (5832): No heartbeat from core client for 30 sec - exiting 05:36:04 (5832): No heartbeat from core client for 30 sec - exiting 05:36:05 (5832): No heartbeat from core client for 30 sec - exiting 05:36:06 (5832): No heartbeat from core client for 30 sec - exiting 05:36:07 (5832): No heartbeat from core client for 30 sec - exiting 05:36:08 (5832): No heartbeat from core client for 30 sec - exiting 05:36:09 (5832): No heartbeat from core client for 30 sec - exiting 05:36:10 (5832): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:42:44 (5268): No heartbeat from core client for 30 sec - exiting 16:42:45 (5268): No heartbeat from core client for 30 sec - exiting 16:42:46 (5268): No heartbeat from core client for 30 sec - exiting 16:42:47 (5268): No heartbeat from core client for 30 sec - exiting 16:42:48 (5268): No heartbeat from core client for 30 sec - exiting 16:42:49 (5268): No heartbeat from core client for 30 sec - exiting 16:42:50 (5268): No heartbeat from core client for 30 sec - exiting 16:42:51 (5268): No heartbeat from core client for 30 sec - exiting 16:42:52 (5268): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:00:54 (5916): No heartbeat from core client for 30 sec - exiting 13:00:55 (5916): No heartbeat from core client for 30 sec - exiting 13:00:56 (5916): No heartbeat from core client for 30 sec - exiting 13:00:57 (5916): No heartbeat from core client for 30 sec - exiting 13:00:58 (5916): No heartbeat from core client for 30 sec - exiting 13:00:59 (5916): No heartbeat from core client for 30 sec - exiting 13:01:00 (5916): No heartbeat from core client for 30 sec - exiting 13:01:01 (5916): No heartbeat from core client for 30 sec - exiting 13:01:02 (5916): No heartbeat from core client for 30 sec - exiting 13:01:03 (5916): No heartbeat from core client for 30 sec - exiting 13:01:04 (5916): No heartbeat from core client for 30 sec - exiting 13:01:05 (5916): No heartbeat from core client for 30 sec - exiting 13:01:06 (5916): No heartbeat from core client for 30 sec - exiting 13:01:07 (5916): No heartbeat from core client for 30 sec - exiting 13:01:08 (5916): No heartbeat from core client for 30 sec - exiting 13:01:09 (5916): No heartbeat from core client for 30 sec - exiting 13:01:10 (5916): No heartbeat from core client for 30 sec - exiting 13:01:11 (5916): No heartbeat from core client for 30 sec - exiting 13:01:12 (5916): No heartbeat from core client for 30 sec - exiting 13:01:13 (5916): No heartbeat from core client for 30 sec - exiting 13:01:14 (5916): No heartbeat from core client for 30 sec - exiting 13:01:15 (5916): No heartbeat from core client for 30 sec - exiting 13:01:16 (5916): No heartbeat from core client for 30 sec - exiting 13:01:17 (5916): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:18:19 (3104): No heartbeat from core client for 30 sec - exiting 12:18:20 (3104): No heartbeat from core client for 30 sec - exiting 12:18:21 (3104): No heartbeat from core client for 30 sec - exiting 12:18:22 (3104): No heartbeat from core client for 30 sec - exiting 12:18:23 (3104): No heartbeat from core client for 30 sec - exiting 12:18:24 (3104): No heartbeat from core client for 30 sec - exiting 12:18:25 (3104): No heartbeat from core client for 30 sec - exiting 12:18:26 (3104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 05:32:24 (5840): No heartbeat from core client for 30 sec - exiting 05:32:26 (5840): No heartbeat from core client for 30 sec - exiting 05:32:27 (5840): No heartbeat from core client for 30 sec - exiting 05:32:28 (5840): No heartbeat from core client for 30 sec - exiting 05:32:29 (5840): No heartbeat from core client for 30 sec - exiting 05:32:30 (5840): No heartbeat from core client for 30 sec - exiting 05:32:31 (5840): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:40:03 (4116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 05:32:28 (5532): No heartbeat from core client for 30 sec - exiting 05:32:29 (5532): No heartbeat from core client for 30 sec - exiting 05:32:30 (5532): No heartbeat from core client for 30 sec - exiting 05:32:31 (5532): No heartbeat from core client for 30 sec - exiting 05:32:32 (5532): No heartbeat from core client for 30 sec - exiting 05:32:33 (5532): No heartbeat from core client for 30 sec - exiting 05:32:34 (5532): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:43:52 (4668): No heartbeat from core client for 30 sec - exiting 16:43:53 (4668): No heartbeat from core client for 30 sec - exiting 16:43:54 (4668): No heartbeat from core client for 30 sec - exiting 16:43:55 (4668): No heartbeat from core client for 30 sec - exiting 16:43:56 (4668): No heartbeat from core client for 30 sec - exiting 16:43:57 (4668): No heartbeat from core client for 30 sec - exiting 16:43:58 (4668): No heartbeat from core client for 30 sec - exiting 16:43:59 (4668): No heartbeat from core client for 30 sec - exiting 16:44:00 (4668): No heartbeat from core client for 30 sec - exiting 16:44:01 (4668): No heartbeat from core client for 30 sec - exiting 16:44:02 (4668): No heartbeat from core client for 30 sec - exiting 16:44:03 (4668): No heartbeat from core client for 30 sec - exiting 16:44:04 (4668): No heartbeat from core client for 30 sec - exiting 16:44:05 (4668): No heartbeat from core client for 30 sec - exiting 16:44:06 (4668): No heartbeat from core client for 30 sec - exiting 16:44:07 (4668): No heartbeat from core client for 30 sec - exiting 16:44:08 (4668): No heartbeat from core client for 30 sec - exiting 16:44:09 (4668): No heartbeat from core client for 30 sec - exiting 16:44:10 (4668): No heartbeat from core client for 30 sec - exiting 16:44:11 (4668): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:38:10 (628): No heartbeat from core client for 30 sec - exiting 05:38:12 (628): No heartbeat from core client for 30 sec - exiting 05:38:13 (628): No heartbeat from core client for 30 sec - exiting 05:38:14 (628): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:42:22 (5132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:23:11 (5728): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:23:44 (6104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:45:31 (988): No heartbeat from core client for 30 sec - exiting 16:45:32 (988): No heartbeat from core client for 30 sec - exiting 16:45:33 (988): No heartbeat from core client for 30 sec - exiting 16:45:34 (988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:46:10 (4528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 04:31:58 (5448): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7148, iMonCtr=1 Model crash detected, will try to restart... 12:33:41 (2824): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 05:25:35 (5676): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:19:58 (5220): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:28:04 (5680): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:08:41 (5220): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77B4FF6B write attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... Signal 11 received, exiting... Called boinc_finish Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77BF3770 read attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... Signal 11 received, exiting... Called boinc_finish Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77BF3770 read attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77BF3AC3 read attempt to address 0x00000000 Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
19 Oct 2013 00:32:18	1129647	16008695	hadcm3n_4f2h_1940_40_008302579_4	1,036,800	1,842,416	1.7770
17 Oct 2013 23:00:58	1129647	16008695	hadcm3n_4f2h_1940_40_008302579_4	1,010,880	1,800,231	1.7809
16 Oct 2013 17:05:33	1129647	16008695	hadcm3n_4f2h_1940_40_008302579_4	984,960	1,757,965	1.7848
16 Oct 2013 04:33:20	1129647	16008695	hadcm3n_4f2h_1940_40_008302579_4	959,040	1,715,401	1.7887
15 Oct 2013 16:37:48	1129647	16008695	hadcm3n_4f2h_1940_40_008302579_4	933,120	1,672,571	1.7925
14 Oct 2013 16:25:42	1129647	16008695	hadcm3n_4f2h_1940_40_008302579_4	907,200	1,628,962	1.7956
14 Oct 2013 02:54:22	1129647	16008695	hadcm3n_4f2h_1940_40_008302579_4	881,280	1,585,046	1.7986
13 Oct 2013 13:23:10	1129647	16008695	hadcm3n_4f2h_1940_40_008302579_4	855,360	1,542,408	1.8032
12 Oct 2013 23:40:18	1129647	16008695	hadcm3n_4f2h_1940_40_008302579_4	829,440	1,498,898	1.8071
12 Oct 2013 10:35:41	1129647	16008695	hadcm3n_4f2h_1940_40_008302579_4	803,520	1,456,563	1.8127
11 Oct 2013 20:58:49	1129647	16008695	hadcm3n_4f2h_1940_40_008302579_4	777,600	1,414,171	1.8186
11 Oct 2013 07:48:51	1129647	16008695	hadcm3n_4f2h_1940_40_008302579_4	751,680	1,371,621	1.8247
10 Oct 2013 18:02:45	1129647	16008695	hadcm3n_4f2h_1940_40_008302579_4	725,760	1,328,558	1.8306
09 Oct 2013 11:24:15	1129647	16008695	hadcm3n_4f2h_1940_40_008302579_4	699,840	1,286,242	1.8379
06 Oct 2013 12:56:51	1129647	16008695	hadcm3n_4f2h_1940_40_008302579_4	673,920	1,244,176	1.8462
05 Oct 2013 21:33:58	1129647	16008695	hadcm3n_4f2h_1940_40_008302579_4	648,000	1,201,002	1.8534
04 Oct 2013 22:39:17	1129647	16008695	hadcm3n_4f2h_1940_40_008302579_4	622,080	1,156,553	1.8592
04 Oct 2013 07:40:47	1129647	16008695	hadcm3n_4f2h_1940_40_008302579_4	596,160	1,113,068	1.8671
03 Oct 2013 17:22:18	1129647	16008695	hadcm3n_4f2h_1940_40_008302579_4	570,240	1,068,055	1.8730
02 Oct 2013 19:54:49	1129647	16008695	hadcm3n_4f2h_1940_40_008302579_4	544,320	1,024,090	1.8814