Task 17585243

Name	hadam3p_anz_f6eg_2012_1_009299044_0
Workunit	9383232
Created	17 Dec 2014, 18:47:52 UTC
Sent	31 Dec 2014, 16:32:29 UTC
Report deadline	13 Dec 2015, 21:52:29 UTC
Received	2 Mar 2015, 22:32:37 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1349289
Run time	7 days 7 hours 43 min 33 sec
CPU time	7 hours 18 min 44 sec
Validate state	Invalid
Credit	4,484.28
Device peak FLOPS	3.38 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.4.27</core_client_version> <![CDATA[ <stderr_txt> Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1672, selfPID=4808, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4856, selfPID=5060, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5164, selfPID=3728, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... 08:23:38 (3816): No heartbeat from core client for 30 sec - exiting 08:23:39 (3816): No heartbeat from core client for 30 sec - exiting 08:23:40 (3816): No heartbeat from core client for 30 sec - exiting 08:23:41 (3816): No heartbeat from core client for 30 sec - exiting 08:23:42 (3816): No heartbeat from core client for 30 sec - exiting 08:23:44 (3816): No heartbeat from core client for 30 sec - exiting 08:23:45 (3816): No heartbeat from core client for 30 sec - exiting 08:23:46 (3816): No heartbeat from core client for 30 sec - exiting 08:23:47 (3816): No heartbeat from core client for 30 sec - exiting 08:23:48 (3816): No heartbeat from core client for 30 sec - exiting 08:23:49 (3816): No heartbeat from core client for 30 sec - exiting 08:23:50 (3816): No heartbeat from core client for 30 sec - exiting 08:23:51 (3816): No heartbeat from core client for 30 sec - exiting 08:23:52 (3816): No heartbeat from core client for 30 sec - exiting 08:23:53 (3816): No heartbeat from core client for 30 sec - exiting 08:23:54 (3816): No heartbeat from core client for 30 sec - exiting 08:23:56 (3816): No heartbeat from core client for 30 sec - exiting 08:23:57 (3816): No heartbeat from core client for 30 sec - exiting 08:23:58 (3816): No heartbeat from core client for 30 sec - exiting 08:23:59 (3816): No heartbeat from core client for 30 sec - exiting 08:24:00 (3816): No heartbeat from core client for 30 sec - exiting 08:24:01 (3816): No heartbeat from core client for 30 sec - exiting 08:24:02 (3816): No heartbeat from core client for 30 sec - exiting 08:24:03 (3816): No heartbeat from core client for 30 sec - exiting 08:24:04 (3816): No heartbeat from core client for 30 sec - exiting 08:24:05 (3816): No heartbeat from core client for 30 sec - exiting 08:24:06 (3816): No heartbeat from core client for 30 sec - exiting 08:24:08 (3816): No heartbeat from core client for 30 sec - exiting 08:24:09 (3816): No heartbeat from core client for 30 sec - exiting 08:24:10 (3816): No heartbeat from core client for 30 sec - exiting 08:24:11 (3816): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:24:12 (3816): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... G22:09:13 (5036): No heartbeat from core client for 30 sec - exiting 22:09:14 (5036): No heartbeat from core client for 30 sec - exiting 22:09:15 (5036): No heartbeat from core client for 30 sec - exiting 22:09:16 (5036): No heartbeat from core client for 30 sec - exiting 22:09:17 (5036): No heartbeat from core client for 30 sec - exiting 22:09:18 (5036): No heartbeat from core client for 30 sec - exiting 22:09:19 (5036): No heartbeat from core client for 30 sec - exiting 22:09:20 (5036): No heartbeat from core client for 30 sec - exiting 22:09:21 (5036): No heartbeat from core client for 30 sec - exiting 22:09:22 (5036): No heartbeat from core client for 30 sec - exiting 22:09:23 (5036): No heartbeat from core client for 30 sec - exiting 22:09:24 (5036): No heartbeat from core client for 30 sec - exiting 22:09:25 (5036): No heartbeat from core client for 30 sec - exiting 22:09:26 (5036): No heartbeat from core client for 30 sec - exiting 22:09:27 (5036): No heartbeat from core client for 30 sec - exiting 22:09:28 (5036): No heartbeat from core client for 30 sec - exiting 22:09:29 (5036): No heartbeat from core client for 30 sec - exiting 22:09:30 (5036): No heartbeat from core client for 30 sec - exiting 22:09:31 (5036): No heartbeat from core client for 30 sec - exiting 22:09:32 (5036): No heartbeat from core client for 30 sec - exiting 22:09:34 (5036): No heartbeat from core client for 30 sec - exiting 22:09:35 (5036): No heartbeat from core client for 30 sec - exiting 22:09:36 (5036): No heartbeat from core client for 30 sec - exiting 22:09:37 (5036): No heartbeat from core client for 30 sec - exiting 22:09:38 (5036): No heartbeat from core client for 30 sec - exiting 22:09:39 (5036): No heartbeat from core client for 30 sec - exiting 22:09:40 (5036): No heartbeat from core client for 30 sec - exiting 22:09:41 (5036): No heartbeat from core client for 30 sec - exiting 22:09:42 (5036): No heartbeat from core client for 30 sec - exiting 22:09:43 (5036): No heartbeat from core client for 30 sec - exiting 22:09:44 (5036): No heartbeat from core client for 30 sec - exiting 22:09:46 (5036): No heartbeat from core client for 30 sec - exiting 22:09:47 (5036): No heartbeat from core client for 30 sec - exiting 22:09:48 (5036): No heartbeat from core client for 30 sec - exiting 22:09:49 (5036): No heartbeat from core client for 30 sec - exiting 22:09:50 (5036): No heartbeat from core client for 30 sec - exiting 22:09:51 (5036): No heartbeat from core client for 30 sec - exiting 22:09:52 (5036): No heartbeat from core client for 30 sec - exiting 22:09:53 (5036): No heartbeat from core client for 30 sec - exiting 22:09:54 (5036): No heartbeat from core client for 30 sec - exiting 22:09:55 (5036): No heartbeat from core client for 30 sec - exiting 22:09:57 (5036): No heartbeat from core client for 30 sec - exiting 22:09:58 (5036): No heartbeat from core client for 30 sec - exiting 22:09:59 (5036): No heartbeat from core client for 30 sec - exiting 22:10:00 (5036): No heartbeat from core client for 30 sec - exiting 22:10:01 (5036): No heartbeat from core client for 30 sec - exiting 22:10:02 (5036): No heartbeat from core client for 30 sec - exiting 22:10:03 (5036): No heartbeat from core client for 30 sec - exiting 22:10:04 (5036): No heartbeat from core client for 30 sec - exiting 22:10:05 (5036): No heartbeat from core client for 30 sec - exiting 22:10:06 (5036): No heartbeat from core client for 30 sec - exiting 22:10:07 (5036): No heartbeat from core client for 30 sec - exiting 22:10:09 (5036): No heartbeat from core client for 30 sec - exiting 22:10:10 (5036): No heartbeat from core client for 30 sec - exiting 22:10:11 (5036): No heartbeat from core client for 30 sec - exiting 22:10:12 (5036): No heartbeat from core client for 30 sec - exiting 22:10:13 (5036): No heartbeat from core client for 30 sec - exiting 22:10:14 (5036): No heartbeat from core client for 30 sec - exiting 22:10:15 (5036): No heartbeat from core client for 30 sec - exiting 22:10:16 (5036): No heartbeat from core client for 30 sec - exiting 22:10:17 (5036): No heartbeat from core client for 30 sec - exiting 22:10:18 (5036): No heartbeat from core client for 30 sec - exiting 22:10:19 (5036): No heartbeat from core client for 30 sec - exiting 22:10:21 (5036): No heartbeat from core client for 30 sec - exiting 22:10:22 (5036): No heartbeat from core client for 30 sec - exiting 22:10:23 (5036): No heartbeat from core client for 30 sec - exiting 22:10:24 (5036): No heartbeat from core client for 30 sec - exiting 22:10:25 (5036): No heartbeat from core client for 30 sec - exiting 22:10:26 (5036): No heartbeat from core client for 30 sec - exiting 22:10:27 (5036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3764, iMonCtr=2 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:30:01 (4692): No heartbeat from core client for 30 sec - exiting 07:30:08 (4692): No heartbeat from core client for 30 sec - exiting 07:30:09 (4692): No heartbeat from core client for 30 sec - exiting 07:30:10 (4692): No heartbeat from core client for 30 sec - exiting 07:30:11 (4692): No heartbeat from core client for 30 sec - exiting 07:30:12 (4692): No heartbeat from core client for 30 sec - exiting 07:30:13 (4692): No heartbeat from core client for 30 sec - exiting 07:30:14 (4692): No heartbeat from core client for 30 sec - exiting 07:30:15 (4692): No heartbeat from core client for 30 sec - exiting 07:30:16 (4692): No heartbeat from core client for 30 sec - exiting 07:30:18 (4692): No heartbeat from core client for 30 sec - exiting 07:30:19 (4692): No heartbeat from core client for 30 sec - exiting 07:30:20 (4692): No heartbeat from core client for 30 sec - exiting 07:30:21 (4692): No heartbeat from core client for 30 sec - exiting 07:30:22 (4692): No heartbeat from core client for 30 sec - exiting 07:30:23 (4692): No heartbeat from core client for 30 sec - exiting 07:30:24 (4692): No heartbeat from core client for 30 sec - exiting 07:30:25 (4692): No heartbeat from core client for 30 sec - exiting 07:30:26 (4692): No heartbeat from core client for 30 sec - exiting 07:30:27 (4692): No heartbeat from core client for 30 sec - exiting 07:30:28 (4692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... G15:29:16 (5880): No heartbeat from core client for 30 sec - exiting 15:29:17 (5880): No heartbeat from core client for 30 sec - exiting 15:29:18 (5880): No heartbeat from core client for 30 sec - exiting 15:29:20 (5880): No heartbeat from core client for 30 sec - exiting 15:29:21 (5880): No heartbeat from core client for 30 sec - exiting 15:29:22 (5880): No heartbeat from core client for 30 sec - exiting 15:29:23 (5880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:29:24 (5880): No heartbeat from core client for 30 sec - exiting 15:29:25 (5880): No heartbeat from core client for 30 sec - exiting 15:29:26 (5880): No heartbeat from core client for 30 sec - exiting 15:29:27 (5880): No heartbeat from core client for 30 sec - exiting 15:29:28 (5880): No heartbeat from core client for 30 sec - exiting 15:29:29 (5880): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 21:16:09 (4512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9164, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:34:34 (2936): No heartbeat from core client for 30 sec - exiting 13:34:36 (2936): No heartbeat from core client for 30 sec - exiting 13:34:38 (2936): No heartbeat from core client for 30 sec - exiting 13:34:39 (2936): No heartbeat from core client for 30 sec - exiting 13:34:40 (2936): No heartbeat from core client for 30 sec - exiting 13:34:41 (2936): No heartbeat from core client for 30 sec - exiting 13:34:42 (2936): No heartbeat from core client for 30 sec - exiting 13:34:43 (2936): No heartbeat from core client for 30 sec - exiting 13:34:44 (2936): No heartbeat from core client for 30 sec - exiting 13:34:45 (2936): No heartbeat from core client for 30 sec - exiting 13:34:46 (2936): No heartbeat from core client for 30 sec - exiting 13:34:47 (2936): No heartbeat from core client for 30 sec - exiting 13:34:48 (2936): No heartbeat from core client for 30 sec - exiting 13:34:50 (2936): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5560, selfPID=5560, iMonCtr=2 13:34:51 (2936): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:16:23 (4340): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:33:48 (6176): No heartbeat from core client for 30 sec - exiting 13:33:49 (6176): No heartbeat from core client for 30 sec - exiting 13:33:50 (6176): No heartbeat from core client for 30 sec - exiting 13:33:51 (6176): No heartbeat from core client for 30 sec - exiting 13:33:52 (6176): No heartbeat from core client for 30 sec - exiting 13:33:53 (6176): No heartbeat from core client for 30 sec - exiting 13:33:54 (6176): No heartbeat from core client for 30 sec - exiting 13:33:55 (6176): No heartbeat from core client for 30 sec - exiting 13:33:56 (6176): No heartbeat from core client for 30 sec - exiting 13:33:57 (6176): No heartbeat from core client for 30 sec - exiting 13:33:58 (6176): No heartbeat from core client for 30 sec - exiting 13:33:59 (6176): No heartbeat from core client for 30 sec - exiting 13:34:00 (6176): No heartbeat from core client for 30 sec - exiting 13:34:01 (6176): No heartbeat from core client for 30 sec - exiting 13:34:02 (6176): No heartbeat from core client for 30 sec - exiting 13:34:03 (6176): No heartbeat from core client for 30 sec - exiting 13:34:04 (6176): No heartbeat from core client for 30 sec - exiting 13:34:05 (6176): No heartbeat from core client for 30 sec - exiting 13:34:06 (6176): No heartbeat from core client for 30 sec - exiting 13:34:07 (6176): No heartbeat from core client for 30 sec - exiting 13:34:08 (6176): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:23:24 (4428): No heartbeat from core client for 30 sec - exiting 07:23:25 (4428): No heartbeat from core client for 30 sec - exiting 07:23:26 (4428): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:21:03 (4940): No heartbeat from core client for 30 sec - exiting 13:21:04 (4940): No heartbeat from core client for 30 sec - exiting 13:21:05 (4940): No heartbeat from core client for 30 sec - exiting 13:21:06 (4940): No heartbeat from core client for 30 sec - exiting 13:21:07 (4940): No heartbeat from core client for 30 sec - exiting 13:21:08 (4940): No heartbeat from core client for 30 sec - exiting 13:21:09 (4940): No heartbeat from core client for 30 sec - exiting 13:21:10 (4940): No heartbeat from core client for 30 sec - exiting 13:21:11 (4940): No heartbeat from core client for 30 sec - exiting 13:21:12 (4940): No heartbeat from core client for 30 sec - exiting 13:21:13 (4940): No heartbeat from core client for 30 sec - exiting 13:21:14 (4940): No heartbeat from core client for 30 sec - exiting 13:21:15 (4940): No heartbeat from core client for 30 sec - exiting 13:21:16 (4940): No heartbeat from core client for 30 sec - exiting 13:21:17 (4940): No heartbeat from core client for 30 sec - exiting 13:21:18 (4940): No heartbeat from core client for 30 sec - exiting 13:21:19 (4940): No heartbeat from core client for 30 sec - exiting 13:21:20 (4940): No heartbeat from core client for 30 sec - exiting 13:21:21 (4940): No heartbeat from core client for 30 sec - exiting 13:21:22 (4940): No heartbeat from core client for 30 sec - exiting 13:21:23 (4940): No heartbeat from core client for 30 sec - exiting 13:21:24 (4940): No heartbeat from core client for 30 sec - exiting 13:21:25 (4940): No heartbeat from core client for 30 sec - exiting 13:21:26 (4940): No heartbeat from core client for 30 sec - exiting 13:21:27 (4940): No heartbeat from core client for 30 sec - exiting 13:21:28 (4940): No heartbeat from core client for 30 sec - exiting 13:21:29 (4940): No heartbeat from core client for 30 sec - exiting 13:21:30 (4940): No heartbeat from core client for 30 sec - exiting 13:21:31 (4940): No heartbeat from core client for 30 sec - exiting 13:21:32 (4940): No heartbeat from core client for 30 sec - exiting 13:21:33 (4940): No heartbeat from core client for 30 sec - exiting 13:21:34 (4940): No heartbeat from core client for 30 sec - exiting 13:21:35 (4940): No heartbeat from core client for 30 sec - exiting 13:21:36 (4940): No heartbeat from core client for 30 sec - exiting 13:21:37 (4940): No heartbeat from core client for 30 sec - exiting 13:21:38 (4940): No heartbeat from core client for 30 sec - exiting 13:21:39 (4940): No heartbeat from core client for 30 sec - exiting 13:21:40 (4940): No heartbeat from core client for 30 sec - exiting 13:21:41 (4940): No heartbeat from core client for 30 sec - exiting 13:21:42 (4940): No heartbeat from core client for 30 sec - exiting 13:21:43 (4940): No heartbeat from core client for 30 sec - exiting 13:21:44 (4940): No heartbeat from core client for 30 sec - exiting 13:21:45 (4940): No heartbeat from core client for 30 sec - exiting 13:21:46 (4940): No heartbeat from core client for 30 sec - exiting 13:21:47 (4940): No heartbeat from core client for 30 sec - exiting 13:21:48 (4940): No heartbeat from core client for 30 sec - exiting 13:21:49 (4940): No heartbeat from core client for 30 sec - exiting 13:21:50 (4940): No heartbeat from core client for 30 sec - exiting 13:21:51 (4940): No heartbeat from core client for 30 sec - exiting 13:21:52 (4940): No heartbeat from core client for 30 sec - exiting 13:21:53 (4940): No heartbeat from core client for 30 sec - exiting 13:21:54 (4940): No heartbeat from core client for 30 sec - exiting 13:21:55 (4940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:52:22 (3880): No heartbeat from core client for 30 sec - exiting 20:52:23 (3880): No heartbeat from core client for 30 sec - exiting 20:52:24 (3880): No heartbeat from core client for 30 sec - exiting 20:52:25 (3880): No heartbeat from core client for 30 sec - exiting 20:52:26 (3880): No heartbeat from core client for 30 sec - exiting 20:52:27 (3880): No heartbeat from core client for 30 sec - exiting 20:52:28 (3880): No heartbeat from core client for 30 sec - exiting 20:52:29 (3880): No heartbeat from core client for 30 sec - exiting 20:52:31 (3880): No heartbeat from core client for 30 sec - exiting 20:52:32 (3880): No heartbeat from core client for 30 sec - exiting 20:52:33 (3880): No heartbeat from core client for 30 sec - exiting 20:52:34 (3880): No heartbeat from core client for 30 sec - exiting 20:52:35 (3880): No heartbeat from core client for 30 sec - exiting 20:52:36 (3880): No heartbeat from core client for 30 sec - exiting 20:52:37 (3880): No heartbeat from core client for 30 sec - exiting 20:52:38 (3880): No heartbeat from core client for 30 sec - exiting 20:52:39 (3880): No heartbeat from core client for 30 sec - exiting 20:52:40 (3880): No heartbeat from core client for 30 sec - exiting 20:52:42 (3880): No heartbeat from core client for 30 sec - exiting 20:52:43 (3880): No heartbeat from core client for 30 sec - exiting 20:52:44 (3880): No heartbeat from core client for 30 sec - exiting 20:52:45 (3880): No heartbeat from core client for 30 sec - exiting 20:52:46 (3880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5168, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4380, selfPID=4328, iMonCtr=1 Model crash detected, will try to restart... 07:03:17 (5892): No heartbeat from core client for 30 sec - exiting 07:03:18 (5892): No heartbeat from core client for 30 sec - exiting 07:03:19 (5892): No heartbeat from core client for 30 sec - exiting 07:03:20 (5892): No heartbeat from core client for 30 sec - exiting 07:03:21 (5892): No heartbeat from core client for 30 sec - exiting 07:03:22 (5892): No heartbeat from core client for 30 sec - exiting 07:03:23 (5892): No heartbeat from core client for 30 sec - exiting 07:03:24 (5892): No heartbeat from core client for 30 sec - exiting 07:03:25 (5892): No heartbeat from core client for 30 sec - exiting 07:03:26 (5892): No heartbeat from core client for 30 sec - exiting 07:03:27 (5892): No heartbeat from core client for 30 sec - exiting 07:03:28 (5892): No heartbeat from core client for 30 sec - exiting 07:03:29 (5892): No heartbeat from core client for 30 sec - exiting 07:03:30 (5892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:03:31 (5892): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 21:17:38 (4292): No heartbeat from core client for 30 sec - exiting 21:17:39 (4292): No heartbeat from core client for 30 sec - exiting 21:17:40 (4292): No heartbeat from core client for 30 sec - exiting 21:17:41 (4292): No heartbeat from core client for 30 sec - exiting 21:17:42 (4292): No heartbeat from core client for 30 sec - exiting 21:17:43 (4292): No heartbeat from core client for 30 sec - exiting 21:17:44 (4292): No heartbeat from core client for 30 sec - exiting 21:17:45 (4292): No heartbeat from core client for 30 sec - exiting 21:17:46 (4292): No heartbeat from core client for 30 sec - exiting 21:17:47 (4292): No heartbeat from core client for 30 sec - exiting 21:17:48 (4292): No heartbeat from core client for 30 sec - exiting 21:17:49 (4292): No heartbeat from core client for 30 sec - exiting 21:17:50 (4292): No heartbeat from core client for 30 sec - exiting 21:17:51 (4292): No heartbeat from core client for 30 sec - exiting 21:17:52 (4292): No heartbeat from core client for 30 sec - exiting 21:17:53 (4292): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:17:54 (4292): No heartbeat from core client for 30 sec - exiting 21:17:55 (4292): No heartbeat from core client for 30 sec - exiting 21:17:56 (4292): No heartbeat from core client for 30 sec - exiting 21:17:57 (4292): No heartbeat from core client for 30 sec - exiting 21:17:58 (4292): No heartbeat from core client for 30 sec - exiting 07:17:31 (4964): No heartbeat from core client for 30 sec - exiting 07:17:32 (4964): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:00:40 (5300): No heartbeat from core client for 30 sec - exiting 04:00:42 (5300): No heartbeat from core client for 30 sec - exiting 04:00:43 (5300): No heartbeat from core client for 30 sec - exiting 04:00:44 (5300): No heartbeat from core client for 30 sec - exiting 04:00:45 (5300): No heartbeat from core client for 30 sec - exiting 04:00:46 (5300): No heartbeat from core client for 30 sec - exiting 04:00:47 (5300): No heartbeat from core client for 30 sec - exiting 04:00:48 (5300): No heartbeat from core client for 30 sec - exiting 04:00:49 (5300): No heartbeat from core client for 30 sec - exiting 04:00:50 (5300): No heartbeat from core client for 30 sec - exiting 04:00:51 (5300): No heartbeat from core client for 30 sec - exiting 04:00:52 (5300): No heartbeat from core client for 30 sec - exiting 04:00:53 (5300): No heartbeat from core client for 30 sec - exiting 04:00:54 (5300): No heartbeat from core client for 30 sec - exiting 04:00:55 (5300): No heartbeat from core client for 30 sec - exiting 04:00:56 (5300): No heartbeat from core client for 30 sec - exiting 04:00:57 (5300): No heartbeat from core client for 30 sec - exiting 04:00:58 (5300): No heartbeat from core client for 30 sec - exiting 04:00:59 (5300): No heartbeat from core client for 30 sec - exiting 04:01:00 (5300): No heartbeat from core client for 30 sec - exiting 04:01:01 (5300): No heartbeat from core client for 30 sec - exiting 04:01:02 (5300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:01:03 (5300): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 21:29:57 (5736): No heartbeat from core client for 30 sec - exiting 21:29:58 (5736): No heartbeat from core client for 30 sec - exiting 21:29:59 (5736): No heartbeat from core client for 30 sec - exiting 21:30:00 (5736): No heartbeat from core client for 30 sec - exiting 21:30:01 (5736): No heartbeat from core client for 30 sec - exiting 21:30:02 (5736): No heartbeat from core client for 30 sec - exiting 21:30:03 (5736): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5288, selfPID=5288, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:33:39 (4264): No heartbeat from core client for 30 sec - exiting 20:33:40 (4264): No heartbeat from core client for 30 sec - exiting 20:33:41 (4264): No heartbeat from core client for 30 sec - exiting 20:33:42 (4264): No heartbeat from core client for 30 sec - exiting 20:33:44 (4264): No heartbeat from core client for 30 sec - exiting 20:33:45 (4264): No heartbeat from core client for 30 sec - exiting 20:33:46 (4264): No heartbeat from core client for 30 sec - exiting 20:33:47 (4264): No heartbeat from core client for 30 sec - exiting 20:33:48 (4264): No heartbeat from core client for 30 sec - exiting 20:33:49 (4264): No heartbeat from core client for 30 sec - exiting 20:33:50 (4264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:33:51 (4264): No heartbeat from core client for 30 sec - exiting 07:49:12 (1924): No heartbeat from core client for 30 sec - exiting 07:49:13 (1924): No heartbeat from core client for 30 sec - exiting 07:49:14 (1924): No heartbeat from core client for 30 sec - exiting 07:49:15 (1924): No heartbeat from core client for 30 sec - exiting 07:49:16 (1924): No heartbeat from core client for 30 sec - exiting 07:49:17 (1924): No heartbeat from core client for 30 sec - exiting 07:49:18 (1924): No heartbeat from core client for 30 sec - exiting 07:49:19 (1924): No heartbeat from core client for 30 sec - exiting 07:49:20 (1924): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5884, iMonCtr=2 Model crash detected, will try to restart... 13:35:32 (4700): No heartbeat from core client for 30 sec - exiting 13:35:33 (4700): No heartbeat from core client for 30 sec - exiting 13:35:35 (4700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:30:54 (4804): No heartbeat from core client for 30 sec - exiting 20:30:55 (4804): No heartbeat from core client for 30 sec - exiting 20:30:56 (4804): No heartbeat from core client for 30 sec - exiting 20:30:57 (4804): No heartbeat from core client for 30 sec - exiting 20:30:59 (4804): No heartbeat from core client for 30 sec - exiting 20:31:00 (4804): No heartbeat from core client for 30 sec - exiting 20:31:01 (4804): No heartbeat from core client for 30 sec - exiting 20:31:02 (4804): No heartbeat from core client for 30 sec - exiting 20:31:03 (4804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Go06:06:01 (5064): No heartbeat from core client for 30 sec - exiting 06:06:02 (5064): No heartbeat from core client for 30 sec - exiting 06:06:03 (5064): No heartbeat from core client for 30 sec - exiting 06:06:05 (5064): No heartbeat from core client for 30 sec - exiting 06:06:06 (5064): No heartbeat from core client for 30 sec - exiting 06:06:07 (5064): No heartbeat from core client for 30 sec - exiting 06:06:08 (5064): No heartbeat from core client for 30 sec - exiting 06:06:09 (5064): No heartbeat from core client for 30 sec - exiting 06:06:10 (5064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:06:11 (5064): No heartbeat from core client for 30 sec - exiting 06:06:12 (5064): No heartbeat from core client for 30 sec - exiting 06:06:13 (5064): No heartbeat from core client for 30 sec - exiting 06:06:14 (5064): No heartbeat from core client for 30 sec - exiting 06:06:15 (5064): No heartbeat from core client for 30 sec - exiting Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6648, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4508, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish 09:28:54 (5376): No heartbeat from core client for 30 sec - exiting 09:28:55 (5376): No heartbeat from core client for 30 sec - exiting 09:28:56 (5376): No heartbeat from core client for 30 sec - exiting 09:28:57 (5376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5200, selfPID=4656, iMonCtr=1 Model crash detected, will try to restart... 22:42:20 (1244): No heartbeat from core client for 30 sec - exiting 22:42:22 (1244): No heartbeat from core client for 30 sec - exiting 22:42:23 (1244): No heartbeat from core client for 30 sec - exiting 22:42:24 (1244): No heartbeat from core client for 30 sec - exiting 22:42:25 (1244): No heartbeat from core client for 30 sec - exiting 22:42:26 (1244): No heartbeat from core client for 30 sec - exiting 22:42:27 (1244): No heartbeat from core client for 30 sec - exiting 22:42:28 (1244): No heartbeat from core client for 30 sec - exiting 22:42:29 (1244): No heartbeat from core client for 30 sec - exiting 22:42:30 (1244): No heartbeat from core client for 30 sec - exiting 22:42:32 (1244): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:12:47 (4488): No heartbeat from core client for 30 sec - exiting 07:12:49 (4488): No heartbeat from core client for 30 sec - exiting 07:12:50 (4488): No heartbeat from core client for 30 sec - exiting 07:12:51 (4488): No heartbeat from core client for 30 sec - exiting 07:12:52 (4488): No heartbeat from core client for 30 sec - exiting 07:12:53 (4488): No heartbeat from core client for 30 sec - exiting 07:12:54 (4488): No heartbeat from core client for 30 sec - exiting 07:12:55 (4488): No heartbeat from core client for 30 sec - exiting 07:12:56 (4488): No heartbeat from core client for 30 sec - exiting 07:12:57 (4488): No heartbeat from core client for 30 sec - exiting 07:12:58 (4488): No heartbeat from core client for 30 sec - exiting 07:12:59 (4488): No heartbeat from core client for 30 sec - exiting 07:13:00 (4488): No heartbeat from core client for 30 sec - exiting 07:13:01 (4488): No heartbeat from core client for 30 sec - exiting 07:13:02 (4488): No heartbeat from core client for 30 sec - exiting 07:13:03 (4488): No heartbeat from core client for 30 sec - exiting 07:13:04 (4488): No heartbeat from core client for 30 sec - exiting 07:13:05 (4488): No heartbeat from core client for 30 sec - exiting 07:13:06 (4488): No heartbeat from core client for 30 sec - exiting 07:13:07 (4488): No heartbeat from core client for 30 sec - exiting 07:13:08 (4488): No heartbeat from core client for 30 sec - exiting 07:13:09 (4488): No heartbeat from core client for 30 sec - exiting 07:13:10 (4488): No heartbeat from core client for 30 sec - exiting 07:13:11 (4488): No heartbeat from core client for 30 sec - exiting 07:13:12 (4488): No heartbeat from core client for 30 sec - exiting 07:13:13 (4488): No heartbeat from core client for 30 sec - exiting 07:13:14 (4488): No heartbeat from core client for 30 sec - exiting 07:13:15 (4488): No heartbeat from core client for 30 sec - exiting 07:13:16 (4488): No heartbeat from core client for 30 sec - exiting 07:13:17 (4488): No heartbeat from core client for 30 sec - exiting 07:13:18 (4488): No heartbeat from core client for 30 sec - exiting 07:13:19 (4488): No heartbeat from core client for 30 sec - exiting 07:13:20 (4488): No heartbeat from core client for 30 sec - exiting 07:13:21 (4488): No heartbeat from core client for 30 sec - exiting 07:13:22 (4488): No heartbeat from core client for 30 sec - exiting 07:13:23 (4488): No heartbeat from core client for 30 sec - exiting 07:13:24 (4488): No heartbeat from core client for 30 sec - exiting 07:13:25 (4488): No heartbeat from core client for 30 sec - exiting 07:13:26 (4488): No heartbeat from core client for 30 sec - exiting 07:13:27 (4488): No heartbeat from core client for 30 sec - exiting 07:13:28 (4488): No heartbeat from core client for 30 sec - exiting 07:13:29 (4488): No heartbeat from core client for 30 sec - exiting 07:13:30 (4488): No heartbeat from core client for 30 sec - exiting 07:13:31 (4488): No heartbeat from core client for 30 sec - exiting 07:13:32 (4488): No heartbeat from core client for 30 sec - exiting 07:13:33 (4488): No heartbeat from core client for 30 sec - exiting 07:13:34 (4488): No heartbeat from core client for 30 sec - exiting 07:13:35 (4488): No heartbeat from core client for 30 sec - exiting 07:13:36 (4488): No heartbeat from core client for 30 sec - exiting 07:13:37 (4488): No heartbeat from core client for 30 sec - exiting 07:13:38 (4488): No heartbeat from core client for 30 sec - exiting 07:13:39 (4488): No heartbeat from core client for 30 sec - exiting 07:13:40 (4488): No heartbeat from core client for 30 sec - exiting 07:13:41 (4488): No heartbeat from core client for 30 sec - exiting 07:13:42 (4488): No heartbeat from core client for 30 sec - exiting 07:13:43 (4488): No heartbeat from core client for 30 sec - exiting 07:13:44 (4488): No heartbeat from core client for 30 sec - exiting 07:13:45 (4488): No heartbeat from core client for 30 sec - exiting 07:13:46 (4488): No heartbeat from core client for 30 sec - exiting 07:13:47 (4488): No heartbeat from core client for 30 sec - exiting 07:13:48 (4488): No heartbeat from core client for 30 sec - exiting 07:13:49 (4488): No heartbeat from core client for 30 sec - exiting 07:13:50 (4488): No heartbeat from core client for 30 sec - exiting 07:13:51 (4488): No heartbeat from core client for 30 sec - exiting 07:13:52 (4488): No heartbeat from core client for 30 sec - exiting 07:13:53 (4488): No heartbeat from core client for 30 sec - exiting 07:13:54 (4488): No heartbeat from core client for 30 sec - exiting 07:13:55 (4488): No heartbeat from core client for 30 sec - exiting 07:13:56 (4488): No heartbeat from core client for 30 sec - exiting 07:13:57 (4488): No heartbeat from core client for 30 sec - exiting 07:13:58 (4488): No heartbeat from core client for 30 sec - exiting 07:13:59 (4488): No heartbeat from core client for 30 sec - exiting 07:14:00 (4488): No heartbeat from core client for 30 sec - exiting 07:14:01 (4488): No heartbeat from core client for 30 sec - exiting 07:14:02 (4488): No heartbeat from core client for 30 sec - exiting 07:14:03 (4488): No heartbeat from core client for 30 sec - exiting 07:14:04 (4488): No heartbeat from core client for 30 sec - exiting 07:14:05 (4488): No heartbeat from core client for 30 sec - exiting 07:14:06 (4488): No heartbeat from core client for 30 sec - exiting 07:14:07 (4488): No heartbeat from core client for 30 sec - exiting 07:14:08 (4488): No heartbeat from core client for 30 sec - exiting 07:14:09 (4488): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6716, selfPID=4248, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish 13:31:31 (3428): No heartbeat from core client for 30 sec - exiting 13:31:32 (3428): No heartbeat from core client for 30 sec - exiting 13:31:33 (3428): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_anz_f6eg_2012_1_009299044_0_10.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_f6eg_2012_1_009299044_0_11.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_f6eg_2012_1_009299044_0_12.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
26 Feb 2015 00:20:34	1349289	17585243	hadam3p_anz_f6eg_2012_1_009299044_0	103,979	510,064	4.9055
23 Feb 2015 18:03:00	1349289	17585243	hadam3p_anz_f6eg_2012_1_009299044_0	92,459	454,362	4.9142
19 Feb 2015 17:55:20	1349289	17585243	hadam3p_anz_f6eg_2012_1_009299044_0	80,939	398,284	4.9208
17 Feb 2015 05:51:52	1349289	17585243	hadam3p_anz_f6eg_2012_1_009299044_0	69,419	341,749	4.9230
11 Feb 2015 00:11:22	1349289	17585243	hadam3p_anz_f6eg_2012_1_009299044_0	57,899	285,131	4.9246
30 Jan 2015 00:20:40	1349289	17585243	hadam3p_anz_f6eg_2012_1_009299044_0	46,379	228,002	4.9161
23 Jan 2015 17:34:58	1349289	17585243	hadam3p_anz_f6eg_2012_1_009299044_0	34,859	172,007	4.9344
15 Jan 2015 19:10:48	1349289	17585243	hadam3p_anz_f6eg_2012_1_009299044_0	23,339	115,549	4.9509
08 Jan 2015 17:49:30	1349289	17585243	hadam3p_anz_f6eg_2012_1_009299044_0	11,819	59,438	5.0290