Task 16408335

Name	hadam3p_anz_n1di_2012_1_008591139_0
Workunit	8737651
Created	26 Mar 2014, 17:53:45 UTC
Sent	30 Mar 2014, 18:01:43 UTC
Report deadline	12 Mar 2015, 23:21:43 UTC
Received	29 Apr 2014, 21:15:38 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1318404
Run time	3 days 20 hours 53 min 14 sec
CPU time	3 days 11 hours 39 min 53 sec
Validate state	Invalid
Credit	2,497.00
Device peak FLOPS	3.03 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.2.42</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 12:01:13 (4916): No heartbeat from core client for 30 sec - exiting 12:01:14 (4916): No heartbeat from core client for 30 sec - exiting 12:01:15 (4916): No heartbeat from core client for 30 sec - exiting 12:01:16 (4916): No heartbeat from core client for 30 sec - exiting 12:01:18 (4916): No heartbeat from core client for 30 sec - exiting 12:01:19 (4916): No heartbeat from core client for 30 sec - exiting 12:01:20 (4916): No heartbeat from core client for 30 sec - exiting 12:01:21 (4916): No heartbeat from core client for 30 sec - exiting 12:01:22 (4916): No heartbeat from core client for 30 sec - exiting 12:01:23 (4916): No heartbeat from core client for 30 sec - exiting 12:01:24 (4916): No heartbeat from core client for 30 sec - exiting 12:01:25 (4916): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4952, selfPID=5420, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5556, selfPID=4552, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 17:00:31 (4232): No heartbeat from core client for 30 sec - exiting 17:00:32 (4232): No heartbeat from core client for 30 sec - exiting 17:00:33 (4232): No heartbeat from core client for 30 sec - exiting 17:00:34 (4232): No heartbeat from core client for 30 sec - exiting 17:00:36 (4232): No heartbeat from core client for 30 sec - exiting 17:00:37 (4232): No heartbeat from core client for 30 sec - exiting 17:00:38 (4232): No heartbeat from core client for 30 sec - exiting 17:00:39 (4232): No heartbeat from core client for 30 sec - exiting 17:00:40 (4232): No heartbeat from core client for 30 sec - exiting 17:00:41 (4232): No heartbeat from core client for 30 sec - exiting 17:00:42 (4232): No heartbeat from core client for 30 sec - exiting 17:00:43 (4232): No heartbeat from core client for 30 sec - exiting 17:00:44 (4232): No heartbeat from core client for 30 sec - exiting 17:00:45 (4232): No heartbeat from core client for 30 sec - exiting 17:00:46 (4232): No heartbeat from core client for 30 sec - exiting 17:00:48 (4232): No heartbeat from core client for 30 sec - exiting 17:00:49 (4232): No heartbeat from core client for 30 sec - exiting 17:00:50 (4232): No heartbeat from core client for 30 sec - exiting 17:00:51 (4232): No heartbeat from core client for 30 sec - exiting 17:00:52 (4232): No heartbeat from core client for 30 sec - exiting 17:00:53 (4232): No heartbeat from core client for 30 sec - exiting 17:00:54 (4232): No heartbeat from core client for 30 sec - exiting 17:00:55 (4232): No heartbeat from core client for 30 sec - exiting 17:00:56 (4232): No heartbeat from core client for 30 sec - exiting 17:00:57 (4232): No heartbeat from core client for 30 sec - exiting 17:00:58 (4232): No heartbeat from core client for 30 sec - exiting 17:01:00 (4232): No heartbeat from core client for 30 sec - exiting 17:01:01 (4232): No heartbeat from core client for 30 sec - exiting 17:01:02 (4232): No heartbeat from core client for 30 sec - exiting 17:01:03 (4232): No heartbeat from core client for 30 sec - exiting 17:01:04 (4232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5440, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3368, selfPID=3368, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 17:15:54 (4480): No heartbeat from core client for 30 sec - exiting 17:15:56 (4480): No heartbeat from core client for 30 sec - exiting 17:15:57 (4480): No heartbeat from core client for 30 sec - exiting 17:15:58 (4480): No heartbeat from core client for 30 sec - exiting 17:15:59 (4480): No heartbeat from core client for 30 sec - exiting 17:16:00 (4480): No heartbeat from core client for 30 sec - exiting 17:16:01 (4480): No heartbeat from core client for 30 sec - exiting 17:16:02 (4480): No heartbeat from core client for 30 sec - exiting 17:16:03 (4480): No heartbeat from core client for 30 sec - exiting 17:16:04 (4480): No heartbeat from core client for 30 sec - exiting 17:16:05 (4480): No heartbeat from core client for 30 sec - exiting 17:16:06 (4480): No heartbeat from core client for 30 sec - exiting 17:16:08 (4480): No heartbeat from core client for 30 sec - exiting 17:16:09 (4480): No heartbeat from core client for 30 sec - exiting 17:16:10 (4480): No heartbeat from core client for 30 sec - exiting 17:16:11 (4480): No heartbeat from core client for 30 sec - exiting 17:16:12 (4480): No heartbeat from core client for 30 sec - exiting 17:16:13 (4480): No heartbeat from core client for 30 sec - exiting 17:16:14 (4480): No heartbeat from core client for 30 sec - exiting 17:16:15 (4480): No heartbeat from core client for 30 sec - exiting 17:16:16 (4480): No heartbeat from core client for 30 sec - exiting 17:18:00 (4480): No heartbeat from core client for 30 sec - exiting 17:18:01 (4480): No heartbeat from core client for 30 sec - exiting 17:18:02 (4480): No heartbeat from core client for 30 sec - exiting 17:18:03 (4480): No heartbeat from core client for 30 sec - exiting 17:18:04 (4480): No heartbeat from core client for 30 sec - exiting 17:18:05 (4480): No heartbeat from core client for 30 sec - exiting 17:18:07 (4480): No heartbeat from core client for 30 sec - exiting 17:18:08 (4480): No heartbeat from core client for 30 sec - exiting 17:18:09 (4480): No heartbeat from core client for 30 sec - exiting 17:18:10 (4480): No heartbeat from core client for 30 sec - exiting 17:18:11 (4480): No heartbeat from core client for 30 sec - exiting 17:18:12 (4480): No heartbeat from core client for 30 sec - exiting 17:18:13 (4480): No heartbeat from core client for 30 sec - exiting 17:18:14 (4480): No heartbeat from core client for 30 sec - exiting 17:18:15 (4480): No heartbeat from core client for 30 sec - exiting 17:18:16 (4480): No heartbeat from core client for 30 sec - exiting 17:18:17 (4480): No heartbeat from core client for 30 sec - exiting 17:18:19 (4480): No heartbeat from core client for 30 sec - exiting 17:18:20 (4480): No heartbeat from core client for 30 sec - exiting 17:18:21 (4480): No heartbeat from core client for 30 sec - exiting 17:18:22 (4480): No heartbeat from core client for 30 sec - exiting 17:18:23 (4480): No heartbeat from core client for 30 sec - exiting 17:18:24 (4480): No heartbeat from core client for 30 sec - exiting 17:18:25 (4480): No heartbeat from core client for 30 sec - exiting 17:18:26 (4480): No heartbeat from core client for 30 sec - exiting 17:18:27 (4480): No heartbeat from core client for 30 sec - exiting 17:18:28 (4480): No heartbeat from core client for 30 sec - exiting 17:18:29 (4480): No heartbeat from core client for 30 sec - exiting 17:18:31 (4480): No heartbeat from core client for 30 sec - exiting 17:18:32 (4480): No heartbeat from core client for 30 sec - exiting 17:18:33 (4480): No heartbeat from core client for 30 sec - exiting 17:18:34 (4480): No heartbeat from core client for 30 sec - exiting 17:18:35 (4480): No heartbeat from core client for 30 sec - exiting 17:18:36 (4480): No heartbeat from core client for 30 sec - exiting 17:18:37 (4480): No heartbeat from core client for 30 sec - exiting 17:18:38 (4480): No heartbeat from core client for 30 sec - exiting 17:18:39 (4480): No heartbeat from core client for 30 sec - exiting 17:18:40 (4480): No heartbeat from core client for 30 sec - exiting 17:18:42 (4480): No heartbeat from core client for 30 sec - exiting 17:18:43 (4480): No heartbeat from core client for 30 sec - exiting 17:18:44 (4480): No heartbeat from core client for 30 sec - exiting 17:18:45 (4480): No heartbeat from core client for 30 sec - exiting 17:18:46 (4480): No heartbeat from core client for 30 sec - exiting 17:18:47 (4480): No heartbeat from core client for 30 sec - exiting 17:18:48 (4480): No heartbeat from core client for 30 sec - exiting 17:18:49 (4480): No heartbeat from core client for 30 sec - exiting 17:18:50 (4480): No heartbeat from core client for 30 sec - exiting 17:18:51 (4480): No heartbeat from core client for 30 sec - exiting 17:18:52 (4480): No heartbeat from core client for 30 sec - exiting 17:18:54 (4480): No heartbeat from core client for 30 sec - exiting 17:18:55 (4480): No heartbeat from core client for 30 sec - exiting 17:18:56 (4480): No heartbeat from core client for 30 sec - exiting 17:18:57 (4480): No heartbeat from core client for 30 sec - exiting 17:18:58 (4480): No heartbeat from core client for 30 sec - exiting 17:18:59 (4480): No heartbeat from core client for 30 sec - exiting 17:19:00 (4480): No heartbeat from core client for 30 sec - exiting 17:19:01 (4480): No heartbeat from core client for 30 sec - exiting 17:19:02 (4480): No heartbeat from core client for 30 sec - exiting 17:19:03 (4480): No heartbeat from core client for 30 sec - exiting 17:19:04 (4480): No heartbeat from core client for 30 sec - exiting 17:19:06 (4480): No heartbeat from core client for 30 sec - exiting 17:19:07 (4480): No heartbeat from core client for 30 sec - exiting 17:19:08 (4480): No heartbeat from core client for 30 sec - exiting 17:19:09 (4480): No heartbeat from core client for 30 sec - exiting 17:19:10 (4480): No heartbeat from core client for 30 sec - exiting 17:19:11 (4480): No heartbeat from core client for 30 sec - exiting 17:19:12 (4480): No heartbeat from core client for 30 sec - exiting 17:19:13 (4480): No heartbeat from core client for 30 sec - exiting 17:19:14 (4480): No heartbeat from core client for 30 sec - exiting 17:19:15 (4480): No heartbeat from core client for 30 sec - exiting 17:19:16 (4480): No heartbeat from core client for 30 sec - exiting 17:19:18 (4480): No heartbeat from core client for 30 sec - exiting 17:19:19 (4480): No heartbeat from core client for 30 sec - exiting 17:19:20 (4480): No heartbeat from core client for 30 sec - exiting 17:19:21 (4480): No heartbeat from core client for 30 sec - exiting 17:19:22 (4480): No heartbeat from core client for 30 sec - exiting 17:19:23 (4480): No heartbeat from core client for 30 sec - exiting 17:19:24 (4480): No heartbeat from core client for 30 sec - exiting 17:19:25 (4480): No heartbeat from core client for 30 sec - exiting 17:19:26 (4480): No heartbeat from core client for 30 sec - exiting 17:19:27 (4480): No heartbeat from core client for 30 sec - exiting 17:19:28 (4480): No heartbeat from core client for 30 sec - exiting 17:19:30 (4480): No heartbeat from core client for 30 sec - exiting 17:19:31 (4480): No heartbeat from core client for 30 sec - exiting 17:19:32 (4480): No heartbeat from core client for 30 sec - exiting 17:19:33 (4480): No heartbeat from core client for 30 sec - exiting 17:19:34 (4480): No heartbeat from core client for 30 sec - exiting 17:19:35 (4480): No heartbeat from core client for 30 sec - exiting 17:19:36 (4480): No heartbeat from core client for 30 sec - exiting 17:19:37 (4480): No heartbeat from core client for 30 sec - exiting 17:19:38 (4480): No heartbeat from core client for 30 sec - exiting 17:19:39 (4480): No heartbeat from core client for 30 sec - exiting 17:19:40 (4480): No heartbeat from core client for 30 sec - exiting 17:19:42 (4480): No heartbeat from core client for 30 sec - exiting 17:19:43 (4480): No heartbeat from core client for 30 sec - exiting 17:19:44 (4480): No heartbeat from core client for 30 sec - exiting 17:19:45 (4480): No heartbeat from core client for 30 sec - exiting 17:19:46 (4480): No heartbeat from core client for 30 sec - exiting 17:19:47 (4480): No heartbeat from core client for 30 sec - exiting 17:19:48 (4480): No heartbeat from core client for 30 sec - exiting 17:19:49 (4480): No heartbeat from core client for 30 sec - exiting 17:19:50 (4480): No heartbeat from core client for 30 sec - exiting 17:19:51 (4480): No heartbeat from core client for 30 sec - exiting 17:19:52 (4480): No heartbeat from core client for 30 sec - exiting 17:19:54 (4480): No heartbeat from core client for 30 sec - exiting 17:19:55 (4480): No heartbeat from core client for 30 sec - exiting 17:19:56 (4480): No heartbeat from core client for 30 sec - exiting 17:19:57 (4480): No heartbeat from core client for 30 sec - exiting 17:19:58 (4480): No heartbeat from core client for 30 sec - exiting 17:19:59 (4480): No heartbeat from core client for 30 sec - exiting 17:20:00 (4480): No heartbeat from core client for 30 sec - exiting 17:20:01 (4480): No heartbeat from core client for 30 sec - exiting 17:20:02 (4480): No heartbeat from core client for 30 sec - exiting 17:20:03 (4480): No heartbeat from core client for 30 sec - exiting 17:20:04 (4480): No heartbeat from core client for 30 sec - exiting 17:20:06 (4480): No heartbeat from core client for 30 sec - exiting 17:20:07 (4480): No heartbeat from core client for 30 sec - exiting 17:20:08 (4480): No heartbeat from core client for 30 sec - exiting 17:20:09 (4480): No heartbeat from core client for 30 sec - exiting 17:20:10 (4480): No heartbeat from core client for 30 sec - exiting 17:20:11 (4480): No heartbeat from core client for 30 sec - exiting 17:20:12 (4480): No heartbeat from core client for 30 sec - exiting 17:20:13 (4480): No heartbeat from core client for 30 sec - exiting 17:20:14 (4480): No heartbeat from core client for 30 sec - exiting 17:20:15 (4480): No heartbeat from core client for 30 sec - exiting 17:20:17 (4480): No heartbeat from core client for 30 sec - exiting 17:20:18 (4480): No heartbeat from core client for 30 sec - exiting 17:20:19 (4480): No heartbeat from core client for 30 sec - exiting 17:20:20 (4480): No heartbeat from core client for 30 sec - exiting 17:20:21 (4480): No heartbeat from core client for 30 sec - exiting 17:20:22 (4480): No heartbeat from core client for 30 sec - exiting 17:20:23 (4480): No heartbeat from core client for 30 sec - exiting 17:20:24 (4480): No heartbeat from core client for 30 sec - exiting 17:20:25 (4480): No heartbeat from core client for 30 sec - exiting 17:20:26 (4480): No heartbeat from core client for 30 sec - exiting 17:20:27 (4480): No heartbeat from core client for 30 sec - exiting 17:20:29 (4480): No heartbeat from core client for 30 sec - exiting 17:20:30 (4480): No heartbeat from core client for 30 sec - exiting 17:20:31 (4480): No heartbeat from core client for 30 sec - exiting 17:20:32 (4480): No heartbeat from core client for 30 sec - exiting 17:20:33 (4480): No heartbeat from core client for 30 sec - exiting 17:20:34 (4480): No heartbeat from core client for 30 sec - exiting 17:20:35 (4480): No heartbeat from core client for 30 sec - exiting 17:20:36 (4480): No heartbeat from core client for 30 sec - exiting 17:20:37 (4480): No heartbeat from core client for 30 sec - exiting 17:20:38 (4480): No heartbeat from core client for 30 sec - exiting 17:20:39 (4480): No heartbeat from core client for 30 sec - exiting 17:20:41 (4480): No heartbeat from core client for 30 sec - exiting 17:20:42 (4480): No heartbeat from core client for 30 sec - exiting 17:20:43 (4480): No heartbeat from core client for 30 sec - exiting 17:20:44 (4480): No heartbeat from core client for 30 sec - exiting 17:20:45 (4480): No heartbeat from core client for 30 sec - exiting 17:20:46 (4480): No heartbeat from core client for 30 sec - exiting 17:20:47 (4480): No heartbeat from core client for 30 sec - exiting 17:20:48 (4480): No heartbeat from core client for 30 sec - exiting 17:20:49 (4480): No heartbeat from core client for 30 sec - exiting 17:20:50 (4480): No heartbeat from core client for 30 sec - exiting 17:20:51 (4480): No heartbeat from core client for 30 sec - exiting 17:20:53 (4480): No heartbeat from core client for 30 sec - exiting 17:20:54 (4480): No heartbeat from core client for 30 sec - exiting 17:20:55 (4480): No heartbeat from core client for 30 sec - exiting 17:20:56 (4480): No heartbeat from core client for 30 sec - exiting 17:20:57 (4480): No heartbeat from core client for 30 sec - exiting 17:20:58 (4480): No heartbeat from core client for 30 sec - exiting 17:20:59 (4480): No heartbeat from core client for 30 sec - exiting 17:21:00 (4480): No heartbeat from core client for 30 sec - exiting 17:21:01 (4480): No heartbeat from core client for 30 sec - exiting 17:21:02 (4480): No heartbeat from core client for 30 sec - exiting 17:21:04 (4480): No heartbeat from core client for 30 sec - exiting 17:21:05 (4480): No heartbeat from core client for 30 sec - exiting 17:21:06 (4480): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3732, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4796, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4692, selfPID=5384, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5920, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6100, selfPID=4844, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3720, selfPID=3720, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5420, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4268, iMonCtr=2 Leaving CPDN_Main::Monitor... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4884, selfPID=908, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5424, selfPID=4376, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadam3p_anz_n1di_2012_1_008591139/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadam3p_anz_n1di_2012_1_008591139/dataout/region_restart.day after 11 attempts Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/xaakm.pipe_dummy 2048 Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/xaakg.pipe_dummy 2048 Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_anz_n1di_2012_1_008591139_0_6.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_n1di_2012_1_008591139_0_7.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_n1di_2012_1_008591139_0_8.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_n1di_2012_1_008591139_0_9.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_n1di_2012_1_008591139_0_10.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_n1di_2012_1_008591139_0_11.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_n1di_2012_1_008591139_0_12.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
27 Apr 2014 14:56:57	1318404	16408335	hadam3p_anz_n1di_2012_1_008591139_0	57,899	273,578	4.7251
21 Apr 2014 16:15:23	1318404	16408335	hadam3p_anz_n1di_2012_1_008591139_0	46,379	218,563	4.7125
11 Apr 2014 02:17:01	1318404	16408335	hadam3p_anz_n1di_2012_1_008591139_0	34,859	162,879	4.6725
06 Apr 2014 20:20:37	1318404	16408335	hadam3p_anz_n1di_2012_1_008591139_0	23,339	108,295	4.6401
31 Mar 2014 11:44:09	1318404	16408335	hadam3p_anz_n1di_2012_1_008591139_0	11,819	54,623	4.6216