Task 15916247

Name	hadcm3n_zi4k_1960_40_008367425_1
Workunit	8518284
Created	14 Aug 2013, 11:41:41 UTC
Sent	14 Aug 2013, 16:33:00 UTC
Report deadline	14 Nov 2013, 0:00:11 UTC
Received	19 Sep 2013, 7:15:31 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	25 (0x00000019) Unknown error code
Computer ID	1206515
Run time	29 days 6 hours 44 min 13 sec
CPU time	16 days 20 hours 19 min 43 sec
Validate state	Invalid
Credit	11,508.48
Device peak FLOPS	2.60 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> The drive cannot locate a specific area or track on the disk. (0x19) - exit code 25 (0x19) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:05:37 (4748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4896, iMonCtr=1 Model crash detected, will try to restart... 03:26:02 (5712): No heartbeat from core client for 30 sec - exiting 03:26:03 (5712): No heartbeat from core client for 30 sec - exiting 03:26:04 (5712): No heartbeat from core client for 30 sec - exiting 03:26:05 (5712): No heartbeat from core client for 30 sec - exiting 03:26:06 (5712): No heartbeat from core client for 30 sec - exiting 03:26:07 (5712): No heartbeat from core client for 30 sec - exiting 03:26:08 (5712): No heartbeat from core client for 30 sec - exiting 03:26:09 (5712): No heartbeat from core client for 30 sec - exiting 03:26:10 (5712): No heartbeat from core client for 30 sec - exiting 03:26:11 (5712): No heartbeat from core client for 30 sec - exiting 03:26:12 (5712): No heartbeat from core client for 30 sec - exiting 03:26:13 (5712): No heartbeat from core client for 30 sec - exiting 03:26:14 (5712): No heartbeat from core client for 30 sec - exiting 03:26:15 (5712): No heartbeat from core client for 30 sec - exiting 03:26:16 (5712): No heartbeat from core client for 30 sec - exiting 03:26:17 (5712): No heartbeat from core client for 30 sec - exiting 03:26:18 (5712): No heartbeat from core client for 30 sec - exiting 03:26:19 (5712): No heartbeat from core client for 30 sec - exiting 03:26:20 (5712): No heartbeat from core client for 30 sec - exiting 03:26:21 (5712): No heartbeat from core client for 30 sec - exiting 03:26:22 (5712): No heartbeat from core client for 30 sec - exiting 03:26:23 (5712): No heartbeat from core client for 30 sec - exiting 03:26:24 (5712): No heartbeat from core client for 30 sec - exiting 03:26:25 (5712): No heartbeat from core client for 30 sec - exiting 03:26:26 (5712): No heartbeat from core client for 30 sec - exiting 03:26:27 (5712): No heartbeat from core client for 30 sec - exiting 03:26:28 (5712): No heartbeat from core client for 30 sec - exiting 03:26:29 (5712): No heartbeat from core client for 30 sec - exiting 03:26:30 (5712): No heartbeat from core client for 30 sec - exiting 03:26:31 (5712): No heartbeat from core client for 30 sec - exiting 03:26:32 (5712): No heartbeat from core client for 30 sec - exiting 03:26:33 (5712): No heartbeat from core client for 30 sec - exiting 03:26:34 (5712): No heartbeat from core client for 30 sec - exiting 03:26:35 (5712): No heartbeat from core client for 30 sec - exiting 03:26:36 (5712): No heartbeat from core client for 30 sec - exiting 03:26:37 (5712): No heartbeat from core client for 30 sec - exiting 03:26:38 (5712): No heartbeat from core client for 30 sec - exiting 03:26:39 (5712): No heartbeat from core client for 30 sec - exiting 03:26:40 (5712): No heartbeat from core client for 30 sec - exiting 03:26:41 (5712): No heartbeat from core client for 30 sec - exiting 03:26:42 (5712): No heartbeat from core client for 30 sec - exiting 03:26:43 (5712): No heartbeat from core client for 30 sec - exiting 03:26:44 (5712): No heartbeat from core client for 30 sec - exiting 03:26:45 (5712): No heartbeat from core client for 30 sec - exiting 03:26:46 (5712): No heartbeat from core client for 30 sec - exiting 03:26:47 (5712): No heartbeat from core client for 30 sec - exiting 03:26:48 (5712): No heartbeat from core client for 30 sec - exiting 03:26:49 (5712): No heartbeat from core client for 30 sec - exiting 03:26:50 (5712): No heartbeat from core client for 30 sec - exiting 03:26:51 (5712): No heartbeat from core client for 30 sec - exiting 03:26:52 (5712): No heartbeat from core client for 30 sec - exiting 03:26:53 (5712): No heartbeat from core client for 30 sec - exiting 03:26:54 (5712): No heartbeat from core client for 30 sec - exiting 03:26:55 (5712): No heartbeat from core client for 30 sec - exiting 03:26:56 (5712): No heartbeat from core client for 30 sec - exiting 03:26:57 (5712): No heartbeat from core client for 30 sec - exiting 03:26:58 (5712): No heartbeat from core client for 30 sec - exiting 03:26:59 (5712): No heartbeat from core client for 30 sec - exiting 03:27:00 (5712): No heartbeat from core client for 30 sec - exiting 03:27:01 (5712): No heartbeat from core client for 30 sec - exiting 03:27:02 (5712): No heartbeat from core client for 30 sec - exiting 03:27:03 (5712): No heartbeat from core client for 30 sec - exiting 03:27:04 (5712): No heartbeat from core client for 30 sec - exiting 03:27:05 (5712): No heartbeat from core client for 30 sec - exiting 03:27:06 (5712): No heartbeat from core client for 30 sec - exiting 03:27:07 (5712): No heartbeat from core client for 30 sec - exiting 03:27:08 (5712): No heartbeat from core client for 30 sec - exiting 03:27:09 (5712): No heartbeat from core client for 30 sec - exiting 03:27:10 (5712): No heartbeat from core client for 30 sec - exiting 03:27:11 (5712): No heartbeat from core client for 30 sec - exiting 03:27:12 (5712): No heartbeat from core client for 30 sec - exiting 03:27:13 (5712): No heartbeat from core client for 30 sec - exiting 03:27:14 (5712): No heartbeat from core client for 30 sec - exiting 03:27:15 (5712): No heartbeat from core client for 30 sec - exiting 03:27:16 (5712): No heartbeat from core client for 30 sec - exiting 03:27:17 (5712): No heartbeat from core client for 30 sec - exiting 03:27:18 (5712): No heartbeat from core client for 30 sec - exiting 03:27:19 (5712): No heartbeat from core client for 30 sec - exiting 03:27:20 (5712): No heartbeat from core client for 30 sec - exiting 03:27:21 (5712): No heartbeat from core client for 30 sec - exiting 03:27:22 (5712): No heartbeat from core client for 30 sec - exiting 03:27:23 (5712): No heartbeat from core client for 30 sec - exiting 03:27:24 (5712): No heartbeat from core client for 30 sec - exiting 03:27:25 (5712): No heartbeat from core client for 30 sec - exiting 03:27:26 (5712): No heartbeat from core client for 30 sec - exiting 03:27:27 (5712): No heartbeat from core client for 30 sec - exiting 03:27:28 (5712): No heartbeat from core client for 30 sec - exiting 03:27:29 (5712): No heartbeat from core client for 30 sec - exiting 03:27:30 (5712): No heartbeat from core client for 30 sec - exiting 03:27:31 (5712): No heartbeat from core client for 30 sec - exiting 03:27:32 (5712): No heartbeat from core client for 30 sec - exiting 03:27:33 (5712): No heartbeat from core client for 30 sec - exiting 03:27:34 (5712): No heartbeat from core client for 30 sec - exiting 03:27:35 (5712): No heartbeat from core client for 30 sec - exiting 03:27:36 (5712): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:29:50 (3320): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:32:11 (1316): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:21:27 (3428): No heartbeat from core client for 30 sec - exiting 18:21:28 (3428): No heartbeat from core client for 30 sec - exiting 18:21:29 (3428): No heartbeat from core client for 30 sec - exiting 18:21:30 (3428): No heartbeat from core client for 30 sec - exiting 18:21:31 (3428): No heartbeat from core client for 30 sec - exiting 18:21:32 (3428): No heartbeat from core client for 30 sec - exiting 18:21:33 (3428): No heartbeat from core client for 30 sec - exiting 18:21:34 (3428): No heartbeat from core client for 30 sec - exiting 18:21:35 (3428): No heartbeat from core client for 30 sec - exiting 18:21:36 (3428): No heartbeat from core client for 30 sec - exiting 18:21:37 (3428): No heartbeat from core client for 30 sec - exiting 18:21:38 (3428): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:27:35 (464): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3964, iMonCtr=1 Model crash detected, will try to restart... 10:05:13 (5704): No heartbeat from core client for 30 sec - exiting 10:05:14 (5704): No heartbeat from core client for 30 sec - exiting 10:05:15 (5704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 04:43:29 (3424): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:29:43 (5112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:36:57 (7192): No heartbeat from core client for 30 sec - exiting 03:36:58 (7192): No heartbeat from core client for 30 sec - exiting 03:36:59 (7192): No heartbeat from core client for 30 sec - exiting 03:37:00 (7192): No heartbeat from core client for 30 sec - exiting 03:37:01 (7192): No heartbeat from core client for 30 sec - exiting 03:37:02 (7192): No heartbeat from core client for 30 sec - exiting 03:37:03 (7192): No heartbeat from core client for 30 sec - exiting 03:37:04 (7192): No heartbeat from core client for 30 sec - exiting 03:37:05 (7192): No heartbeat from core client for 30 sec - exiting 03:37:06 (7192): No heartbeat from core client for 30 sec - exiting 03:37:07 (7192): No heartbeat from core client for 30 sec - exiting 03:37:08 (7192): No heartbeat from core client for 30 sec - exiting 03:37:09 (7192): No heartbeat from core client for 30 sec - exiting 03:37:10 (7192): No heartbeat from core client for 30 sec - exiting 03:37:11 (7192): No heartbeat from core client for 30 sec - exiting 03:37:12 (7192): No heartbeat from core client for 30 sec - exiting 03:37:13 (7192): No heartbeat from core client for 30 sec - exiting 03:37:14 (7192): No heartbeat from core client for 30 sec - exiting 03:37:15 (7192): No heartbeat from core client for 30 sec - exiting 03:37:16 (7192): No heartbeat from core client for 30 sec - exiting 03:37:17 (7192): No heartbeat from core client for 30 sec - exiting 03:37:18 (7192): No heartbeat from core client for 30 sec - exiting 03:37:19 (7192): No heartbeat from core client for 30 sec - exiting 03:37:20 (7192): No heartbeat from core client for 30 sec - exiting 03:37:21 (7192): No heartbeat from core client for 30 sec - exiting 03:37:22 (7192): No heartbeat from core client for 30 sec - exiting 03:37:23 (7192): No heartbeat from core client for 30 sec - exiting 03:37:24 (7192): No heartbeat from core client for 30 sec - exiting 03:37:25 (7192): No heartbeat from core client for 30 sec - exiting 03:37:26 (7192): No heartbeat from core client for 30 sec - exiting 03:37:27 (7192): No heartbeat from core client for 30 sec - exiting 03:37:28 (7192): No heartbeat from core client for 30 sec - exiting 03:37:29 (7192): No heartbeat from core client for 30 sec - exiting 03:37:30 (7192): No heartbeat from core client for 30 sec - exiting 03:37:31 (7192): No heartbeat from core client for 30 sec - exiting 03:37:32 (7192): No heartbeat from core client for 30 sec - exiting 03:37:33 (7192): No heartbeat from core client for 30 sec - exiting 03:37:34 (7192): No heartbeat from core client for 30 sec - exiting 03:37:35 (7192): No heartbeat from core client for 30 sec - exiting 03:37:36 (7192): No heartbeat from core client for 30 sec - exiting 03:37:37 (7192): No heartbeat from core client for 30 sec - exiting 03:37:38 (7192): No heartbeat from core client for 30 sec - exiting 03:37:39 (7192): No heartbeat from core client for 30 sec - exiting 03:37:40 (7192): No heartbeat from core client for 30 sec - exiting 03:37:41 (7192): No heartbeat from core client for 30 sec - exiting 03:37:42 (7192): No heartbeat from core client for 30 sec - exiting 03:37:43 (7192): No heartbeat from core client for 30 sec - exiting 03:37:44 (7192): No heartbeat from core client for 30 sec - exiting 03:37:45 (7192): No heartbeat from core client for 30 sec - exiting 03:37:46 (7192): No heartbeat from core client for 30 sec - exiting 03:37:47 (7192): No heartbeat from core client for 30 sec - exiting 03:37:48 (7192): No heartbeat from core client for 30 sec - exiting 03:37:49 (7192): No heartbeat from core client for 30 sec - exiting 03:37:50 (7192): No heartbeat from core client for 30 sec - exiting 03:37:51 (7192): No heartbeat from core client for 30 sec - exiting 03:37:52 (7192): No heartbeat from core client for 30 sec - exiting 03:37:53 (7192): No heartbeat from core client for 30 sec - exiting 03:37:54 (7192): No heartbeat from core client for 30 sec - exiting 03:37:55 (7192): No heartbeat from core client for 30 sec - exiting 03:37:56 (7192): No heartbeat from core client for 30 sec - exiting 03:37:57 (7192): No heartbeat from core client for 30 sec - exiting 03:37:58 (7192): No heartbeat from core client for 30 sec - exiting 03:37:59 (7192): No heartbeat from core client for 30 sec - exiting 03:38:00 (7192): No heartbeat from core client for 30 sec - exiting 03:38:01 (7192): No heartbeat from core client for 30 sec - exiting 03:38:02 (7192): No heartbeat from core client for 30 sec - exiting 03:38:03 (7192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:41:30 (4860): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:44:42 (5892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
17 Sep 2013 13:22:11	1206515	15916247	hadcm3n_zi4k_1960_40_008367425_1	959,040	1,430,729	1.4918
15 Sep 2013 16:31:21	1206515	15916247	hadcm3n_zi4k_1960_40_008367425_1	933,120	1,392,174	1.4920
14 Sep 2013 10:13:26	1206515	15916247	hadcm3n_zi4k_1960_40_008367425_1	907,200	1,349,584	1.4876
13 Sep 2013 05:55:23	1206515	15916247	hadcm3n_zi4k_1960_40_008367425_1	881,280	1,309,888	1.4863
12 Sep 2013 02:47:09	1206515	15916247	hadcm3n_zi4k_1960_40_008367425_1	855,360	1,264,852	1.4787
11 Sep 2013 05:20:16	1206515	15916247	hadcm3n_zi4k_1960_40_008367425_1	829,440	1,220,743	1.4718
10 Sep 2013 10:04:49	1206515	15916247	hadcm3n_zi4k_1960_40_008367425_1	803,520	1,183,265	1.4726
09 Sep 2013 19:33:43	1206515	15916247	hadcm3n_zi4k_1960_40_008367425_1	777,600	1,148,379	1.4768
09 Sep 2013 04:37:06	1206515	15916247	hadcm3n_zi4k_1960_40_008367425_1	751,680	1,112,805	1.4804
08 Sep 2013 12:28:11	1206515	15916247	hadcm3n_zi4k_1960_40_008367425_1	725,760	1,074,817	1.4810
07 Sep 2013 16:16:02	1206515	15916247	hadcm3n_zi4k_1960_40_008367425_1	699,840	1,039,790	1.4858
06 Sep 2013 19:40:41	1206515	15916247	hadcm3n_zi4k_1960_40_008367425_1	673,920	1,003,998	1.4898
05 Sep 2013 17:41:32	1206515	15916247	hadcm3n_zi4k_1960_40_008367425_1	648,000	966,991	1.4923
04 Sep 2013 23:20:57	1206515	15916247	hadcm3n_zi4k_1960_40_008367425_1	622,080	931,846	1.4980
04 Sep 2013 07:05:59	1206515	15916247	hadcm3n_zi4k_1960_40_008367425_1	596,160	897,221	1.5050
03 Sep 2013 14:27:51	1206515	15916247	hadcm3n_zi4k_1960_40_008367425_1	570,240	862,441	1.5124
02 Sep 2013 16:23:13	1206515	15916247	hadcm3n_zi4k_1960_40_008367425_1	544,320	826,707	1.5188
02 Sep 2013 02:56:53	1206515	15916247	hadcm3n_zi4k_1960_40_008367425_1	518,400	792,387	1.5285
01 Sep 2013 17:12:40	1206515	15916247	hadcm3n_zi4k_1960_40_008367425_1	492,480	758,280	1.5397
31 Aug 2013 22:20:48	1206515	15916247	hadcm3n_zi4k_1960_40_008367425_1	466,560	724,029	1.5518