Task 18334320

Name	hadam3p_anz_e3it_2013_1_009760473_0
Workunit	9831511
Created	20 Apr 2015, 22:08:24 UTC
Sent	20 Apr 2015, 23:12:21 UTC
Report deadline	2 Apr 2016, 4:32:21 UTC
Received	13 Jul 2015, 23:28:14 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1359687
Run time	13 days 12 hours 13 min 34 sec
CPU time	8 hours 38 min 47 sec
Validate state	Invalid
Credit	4,484.28
Device peak FLOPS	2.37 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.4.42</core_client_version> <![CDATA[ <stderr_txt> 11:54 (2296): No heartbeat from core client for 30 sec - exiting 13:11:55 (2296): No heartbeat from core client for 30 sec - exiting 13:11:56 (2296): No heartbeat from core client for 30 sec - exiting 13:11:57 (2296): No heartbeat from core client for 30 sec - exiting 13:11:58 (2296): No heartbeat from core client for 30 sec - exiting 13:11:59 (2296): No heartbeat from core client for 30 sec - exiting 13:12:00 (2296): No heartbeat from core client for 30 sec - exiting 13:12:01 (2296): No heartbeat from core client for 30 sec - exiting 13:12:02 (2296): No heartbeat from core client for 30 sec - exiting 13:12:03 (2296): No heartbeat from core client for 30 sec - exiting 13:12:04 (2296): No heartbeat from core client for 30 sec - exiting 13:12:05 (2296): No heartbeat from core client for 30 sec - exiting 13:12:06 (2296): No heartbeat from core client for 30 sec - exiting 13:12:07 (2296): No heartbeat from core client for 30 sec - exiting 13:12:08 (2296): No heartbeat from core client for 30 sec - exiting 13:12:09 (2296): No heartbeat from core client for 30 sec - exiting 13:12:10 (2296): No heartbeat from core client for 30 sec - exiting 13:12:11 (2296): No heartbeat from core client for 30 sec - exiting 13:13:01 (2296): No heartbeat from core client for 30 sec - exiting 13:13:02 (2296): No heartbeat from core client for 30 sec - exiting 13:13:03 (2296): No heartbeat from core client for 30 sec - exiting 13:13:04 (2296): No heartbeat from core client for 30 sec - exiting 13:13:05 (2296): No heartbeat from core client for 30 sec - exiting 13:13:06 (2296): No heartbeat from core client for 30 sec - exiting 13:13:07 (2296): No heartbeat from core client for 30 sec - exiting 13:13:08 (2296): No heartbeat from core client for 30 sec - exiting 13:13:09 (2296): No heartbeat from core client for 30 sec - exiting 13:13:10 (2296): No heartbeat from core client for 30 sec - exiting 13:13:11 (2296): No heartbeat from core client for 30 sec - exiting 13:13:13 (2296): No heartbeat from core client for 30 sec - exiting 13:13:14 (2296): No heartbeat from core client for 30 sec - exiting 13:13:15 (2296): No heartbeat from core client for 30 sec - exiting 13:13:16 (2296): No heartbeat from core client for 30 sec - exiting 13:13:17 (2296): No heartbeat from core client for 30 sec - exiting 13:13:18 (2296): No heartbeat from core client for 30 sec - exiting 13:13:19 (2296): No heartbeat from core client for 30 sec - exiting 13:13:20 (2296): No heartbeat from core client for 30 sec - exiting 13:13:21 (2296): No heartbeat from core client for 30 sec - exiting 13:13:22 (2296): No heartbeat from core client for 30 sec - exiting 13:13:23 (2296): No heartbeat from core client for 30 sec - exiting 13:13:24 (2296): No heartbeat from core client for 30 sec - exiting 13:13:25 (2296): No heartbeat from core client for 30 sec - exiting 13:13:27 (2296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1068, selfPID=8028, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7884, iMonCtr=2 Model crash detected, will try to restart... 15:09:30 (5896): No heartbeat from core client for 30 sec - exiting 15:09:31 (5896): No heartbeat from core client for 30 sec - exiting 15:09:32 (5896): No heartbeat from core client for 30 sec - exiting 15:09:33 (5896): No heartbeat from core client for 30 sec - exiting 15:09:34 (5896): No heartbeat from core client for 30 sec - exiting 15:09:35 (5896): No heartbeat from core client for 30 sec - exiting 15:09:36 (5896): No heartbeat from core client for 30 sec - exiting 15:09:37 (5896): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... C15:47:51 (6160): No heartbeat from core client for 30 sec - exiting 15:47:52 (6160): No heartbeat from core client for 30 sec - exiting 15:47:53 (6160): No heartbeat from core client for 30 sec - exiting 15:47:54 (6160): No heartbeat from core client for 30 sec - exiting 15:47:55 (6160): No heartbeat from core client for 30 sec - exiting 15:47:56 (6160): No heartbeat from core client for 30 sec - exiting 15:47:57 (6160): No heartbeat from core client for 30 sec - exiting 15:47:58 (6160): No heartbeat from core client for 30 sec - exiting 15:47:59 (6160): No heartbeat from core client for 30 sec - exiting 15:48:00 (6160): No heartbeat from core client for 30 sec - exiting 15:48:01 (6160): No heartbeat from core client for 30 sec - exiting 15:48:02 (6160): No heartbeat from core client for 30 sec - exiting 15:48:03 (6160): No heartbeat from core client for 30 sec - exiting 15:48:04 (6160): No heartbeat from core client for 30 sec - exiting 15:48:05 (6160): No heartbeat from core client for 30 sec - exiting 15:48:06 (6160): No heartbeat from core client for 30 sec - exiting 15:48:07 (6160): No heartbeat from core client for 30 sec - exiting 15:48:08 (6160): No heartbeat from core client for 30 sec - exiting 15:48:09 (6160): No heartbeat from core client for 30 sec - exiting 15:48:10 (6160): No heartbeat from core client for 30 sec - exiting 15:48:11 (6160): No heartbeat from core client for 30 sec - exiting 15:48:12 (6160): No heartbeat from core client for 30 sec - exiting 15:48:13 (6160): No heartbeat from core client for 30 sec - exiting 15:48:14 (6160): No heartbeat from core client for 30 sec - exiting 15:48:15 (6160): No heartbeat from core client for 30 sec - exiting 15:48:17 (6160): No heartbeat from core client for 30 sec - exiting 15:48:18 (6160): No heartbeat from core client for 30 sec - exiting 15:48:19 (6160): No heartbeat from core client for 30 sec - exiting 15:48:20 (6160): No heartbeat from core client for 30 sec - exiting 15:48:21 (6160): No heartbeat from core client for 30 sec - exiting 15:48:22 (6160): No heartbeat from core client for 30 sec - exiting 15:48:23 (6160): No heartbeat from core client for 30 sec - exiting 15:48:24 (6160): No heartbeat from core client for 30 sec - exiting 15:48:25 (6160): No heartbeat from core client for 30 sec - exiting 15:48:26 (6160): No heartbeat from core client for 30 sec - exiting 15:48:27 (6160): No heartbeat from core client for 30 sec - exiting 15:48:28 (6160): No heartbeat from core client for 30 sec - exiting 15:48:29 (6160): No heartbeat from core client for 30 sec - exiting 15:48:30 (6160): No heartbeat from core client for 30 sec - exiting 15:48:31 (6160): No heartbeat from core client for 30 sec - exiting 15:48:32 (6160): No heartbeat from core client for 30 sec - exiting 15:48:33 (6160): No heartbeat from core client for 30 sec - exiting 15:48:34 (6160): No heartbeat from core client for 30 sec - exiting 15:48:35 (6160): No heartbeat from core client for 30 sec - exiting 15:48:36 (6160): No heartbeat from core client for 30 sec - exiting 15:48:37 (6160): No heartbeat from core client for 30 sec - exiting 15:48:38 (6160): No heartbeat from core client for 30 sec - exiting 15:48:39 (6160): No heartbeat from core client for 30 sec - exiting 15:48:40 (6160): No heartbeat from core client for 30 sec - exiting 15:48:41 (6160): No heartbeat from core client for 30 sec - exiting 15:48:42 (6160): No heartbeat from core client for 30 sec - exiting 15:48:43 (6160): No heartbeat from core client for 30 sec - exiting 15:48:44 (6160): No heartbeat from core client for 30 sec - exiting 15:48:45 (6160): No heartbeat from core client for 30 sec - exiting 15:48:46 (6160): No heartbeat from core client for 30 sec - exiting 15:48:47 (6160): No heartbeat from core client for 30 sec - exiting 15:48:48 (6160): No heartbeat from core client for 30 sec - exiting 15:48:49 (6160): No heartbeat from core client for 30 sec - exiting 15:48:50 (6160): No heartbeat from core client for 30 sec - exiting 15:48:51 (6160): No heartbeat from core client for 30 sec - exiting 15:48:52 (6160): No heartbeat from core client for 30 sec - exiting 15:48:53 (6160): No heartbeat from core client for 30 sec - exiting 15:48:54 (6160): No heartbeat from core client for 30 sec - exiting 15:48:55 (6160): No heartbeat from core client for 30 sec - exiting 15:48:56 (6160): No heartbeat from core client for 30 sec - exiting 15:48:57 (6160): No heartbeat from core client for 30 sec - exiting 15:48:59 (6160): No heartbeat from core client for 30 sec - exiting 15:49:00 (6160): No heartbeat from core client for 30 sec - exiting 15:49:01 (6160): No heartbeat from core client for 30 sec - exiting 15:49:02 (6160): No heartbeat from core client for 30 sec - exiting 15:49:03 (6160): No heartbeat from core client for 30 sec - exiting 15:49:04 (6160): No heartbeat from core client for 30 sec - exiting 15:49:05 (6160): No heartbeat from core client for 30 sec - exiting 15:49:06 (6160): No heartbeat from core client for 30 sec - exiting 15:49:07 (6160): No heartbeat from core client for 30 sec - exiting 15:49:08 (6160): No heartbeat from core client for 30 sec - exiting 15:49:09 (6160): No heartbeat from core client for 30 sec - exiting 15:49:10 (6160): No heartbeat from core client for 30 sec - exiting 15:49:11 (6160): No heartbeat from core client for 30 sec - exiting 15:49:12 (6160): No heartbeat from core client for 30 sec - exiting 15:49:13 (6160): No heartbeat from core client for 30 sec - exiting 15:49:14 (6160): No heartbeat from core client for 30 sec - exiting 15:49:15 (6160): No heartbeat from core client for 30 sec - exiting 15:49:16 (6160): No heartbeat from core client for 30 sec - exiting 15:49:17 (6160): No heartbeat from core client for 30 sec - exiting 15:49:18 (6160): No heartbeat from core client for 30 sec - exiting 15:49:19 (6160): No heartbeat from core client for 30 sec - exiting 15:49:20 (6160): No heartbeat from core client for 30 sec - exiting 15:49:22 (6160): No heartbeat from core client for 30 sec - exiting 15:49:23 (6160): No heartbeat from core client for 30 sec - exiting 15:49:24 (6160): No heartbeat from core client for 30 sec - exiting 15:49:25 (6160): No heartbeat from core client for 30 sec - exiting 15:49:26 (6160): No heartbeat from core client for 30 sec - exiting 15:49:27 (6160): No heartbeat from core client for 30 sec - exiting 15:49:28 (6160): No heartbeat from core client for 30 sec - exiting 15:49:29 (6160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:27:37 (5112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7060, iMonCtr=2 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8188, selfPID=3192, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 08:24:51 (6480): No heartbeat from core client for 30 sec - exiting 08:24:52 (6480): No heartbeat from core client for 30 sec - exiting 08:24:53 (6480): No heartbeat from core client for 30 sec - exiting 08:24:54 (6480): No heartbeat from core client for 30 sec - exiting 08:24:55 (6480): No heartbeat from core client for 30 sec - exiting 08:24:56 (6480): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6820, selfPID=6820, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7528, iMonCtr=2 08:29:23 (1788): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7348, selfPID=6468, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2596, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7712, selfPID=7216, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 08:28:47 (5172): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:19:28 (6216): No heartbeat from core client for 30 sec - exiting 06:19:29 (6216): No heartbeat from core client for 30 sec - exiting 06:19:30 (6216): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6540, selfPID=7836, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 08:27:53 (6328): No heartbeat from core client for 30 sec - exiting 08:27:54 (6328): No heartbeat from core client for 30 sec - exiting 08:27:55 (6328): No heartbeat from core client for 30 sec - exiting 08:27:56 (6328): No heartbeat from core client for 30 sec - exiting 08:27:57 (6328): No heartbeat from core client for 30 sec - exiting 08:27:58 (6328): No heartbeat from core client for 30 sec - exiting 08:27:59 (6328): No heartbeat from core client for 30 sec - exiting 08:28:00 (6328): No heartbeat from core client for 30 sec - exiting 08:28:01 (6328): No heartbeat from core client for 30 sec - exiting 08:28:02 (6328): No heartbeat from core client for 30 sec - exiting 08:28:03 (6328): No heartbeat from core client for 30 sec - exiting 08:28:04 (6328): No heartbeat from core client for 30 sec - exiting 08:28:05 (6328): No heartbeat from core client for 30 sec - exiting 08:28:06 (6328): No heartbeat from core client for 30 sec - exiting 08:28:07 (6328): No heartbeat from core client for 30 sec - exiting 08:28:08 (6328): No heartbeat from core client for 30 sec - exiting 08:28:09 (6328): No heartbeat from core client for 30 sec - exiting 08:29:02 (6328): No heartbeat from core client for 30 sec - exiting 08:29:03 (6328): No heartbeat from core client for 30 sec - exiting 08:29:04 (6328): No heartbeat from core client for 30 sec - exiting 08:29:05 (6328): No heartbeat from core client for 30 sec - exiting 08:29:06 (6328): No heartbeat from core client for 30 sec - exiting 08:29:07 (6328): No heartbeat from core client for 30 sec - exiting 08:29:08 (6328): No heartbeat from core client for 30 sec - exiting 08:29:09 (6328): No heartbeat from core client for 30 sec - exiting 08:29:10 (6328): No heartbeat from core client for 30 sec - exiting 08:29:11 (6328): No heartbeat from core client for 30 sec - exiting 08:29:12 (6328): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:25:01 (6604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7532, selfPID=7532, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... 15:44:44 (6340): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5248, selfPID=5248, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1120, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:28:36 (7096): No heartbeat from core client for 30 sec - exiting 08:28:38 (7096): No heartbeat from core client for 30 sec - exiting 08:28:39 (7096): No heartbeat from core client for 30 sec - exiting 08:28:40 (7096): No heartbeat from core client for 30 sec - exiting 08:28:41 (7096): No heartbeat from core client for 30 sec - exiting 08:28:42 (7096): No heartbeat from core client for 30 sec - exiting 08:28:43 (7096): No heartbeat from core client for 30 sec - exiting 08:28:44 (7096): No heartbeat from core client for 30 sec - exiting 08:28:45 (7096): No heartbeat from core client for 30 sec - exiting 08:28:46 (7096): No heartbeat from core client for 30 sec - exiting 08:28:47 (7096): No heartbeat from core client for 30 sec - exiting 08:28:48 (7096): No heartbeat from core client for 30 sec - exiting 08:28:49 (7096): No heartbeat from core client for 30 sec - exiting 08:28:50 (7096): No heartbeat from core client for 30 sec - exiting 08:28:51 (7096): No heartbeat from core client for 30 sec - exiting 08:28:52 (7096): No heartbeat from core client for 30 sec - exiting 08:28:53 (7096): No heartbeat from core client for 30 sec - exiting 08:28:54 (7096): No heartbeat from core client for 30 sec - exiting 08:28:55 (7096): No heartbeat from core client for 30 sec - exiting 08:28:56 (7096): No heartbeat from core client for 30 sec - exiting 08:28:57 (7096): No heartbeat from core client for 30 sec - exiting 08:28:58 (7096): No heartbeat from core client for 30 sec - exiting 08:28:59 (7096): No heartbeat from core client for 30 sec - exiting 08:29:00 (7096): No heartbeat from core client for 30 sec - exiting 08:29:01 (7096): No heartbeat from core client for 30 sec - exiting 08:29:03 (7096): No heartbeat from core client for 30 sec - exiting 08:29:04 (7096): No heartbeat from core client for 30 sec - exiting 08:29:05 (7096): No heartbeat from core client for 30 sec - exiting 08:29:06 (7096): No heartbeat from core client for 30 sec - exiting 08:29:07 (7096): No heartbeat from core client for 30 sec - exiting 08:29:08 (7096): No heartbeat from core client for 30 sec - exiting 08:29:09 (7096): No heartbeat from core client for 30 sec - exiting 08:29:10 (7096): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:29:24 (7680): No heartbeat from core client for 30 sec - exiting 09:29:26 (7680): No heartbeat from core client for 30 sec - exiting 09:29:27 (7680): No heartbeat from core client for 30 sec - exiting 09:29:28 (7680): No heartbeat from core client for 30 sec - exiting 09:29:29 (7680): No heartbeat from core client for 30 sec - exiting 09:29:30 (7680): No heartbeat from core client for 30 sec - exiting 09:29:31 (7680): No heartbeat from core client for 30 sec - exiting 09:29:32 (7680): No heartbeat from core client for 30 sec - exiting 09:29:33 (7680): No heartbeat from core client for 30 sec - exiting 09:29:34 (7680): No heartbeat from core client for 30 sec - exiting 09:29:35 (7680): No heartbeat from core client for 30 sec - exiting 09:29:36 (7680): No heartbeat from core client for 30 sec - exiting 09:29:37 (7680): No heartbeat from core client for 30 sec - exiting 09:29:38 (7680): No heartbeat from core client for 30 sec - exiting 09:29:39 (7680): No heartbeat from core client for 30 sec - exiting 09:29:40 (7680): No heartbeat from core client for 30 sec - exiting 09:29:41 (7680): No heartbeat from core client for 30 sec - exiting 09:29:42 (7680): No heartbeat from core client for 30 sec - exiting 09:29:43 (7680): No heartbeat from core client for 30 sec - exiting 09:29:44 (7680): No heartbeat from core client for 30 sec - exiting 09:29:45 (7680): No heartbeat from core client for 30 sec - exiting 09:29:46 (7680): No heartbeat from core client for 30 sec - exiting 09:29:47 (7680): No heartbeat from core client for 30 sec - exiting 09:29:48 (7680): No heartbeat from core client for 30 sec - exiting 09:29:49 (7680): No heartbeat from core client for 30 sec - exiting 09:29:50 (7680): No heartbeat from core client for 30 sec - exiting 09:29:51 (7680): No heartbeat from core client for 30 sec - exiting 09:29:52 (7680): No heartbeat from core client for 30 sec - exiting 09:29:53 (7680): No heartbeat from core client for 30 sec - exiting 09:29:54 (7680): No heartbeat from core client for 30 sec - exiting 09:29:55 (7680): No heartbeat from core client for 30 sec - exiting 09:29:56 (7680): No heartbeat from core client for 30 sec - exiting 09:29:57 (7680): No heartbeat from core client for 30 sec - exiting 09:29:58 (7680): No heartbeat from core client for 30 sec - exiting 09:29:59 (7680): No heartbeat from core client for 30 sec - exiting 09:30:00 (7680): No heartbeat from core client for 30 sec - exiting 09:30:01 (7680): No heartbeat from core client for 30 sec - exiting 09:30:02 (7680): No heartbeat from core client for 30 sec - exiting 09:30:03 (7680): No heartbeat from core client for 30 sec - exiting 09:30:04 (7680): No heartbeat from core client for 30 sec - exiting 09:30:05 (7680): No heartbeat from core client for 30 sec - exiting 09:30:06 (7680): No heartbeat from core client for 30 sec - exiting 09:30:07 (7680): No heartbeat from core client for 30 sec - exiting 09:30:08 (7680): No heartbeat from core client for 30 sec - exiting 09:30:10 (7680): No heartbeat from core client for 30 sec - exiting 09:30:11 (7680): No heartbeat from core client for 30 sec - exiting 09:30:12 (7680): No heartbeat from core client for 30 sec - exiting 09:30:13 (7680): No heartbeat from core client for 30 sec - exiting 09:30:14 (7680): No heartbeat from core client for 30 sec - exiting 09:30:15 (7680): No heartbeat from core client for 30 sec - exiting 09:30:16 (7680): No heartbeat from core client for 30 sec - exiting 09:30:17 (7680): No heartbeat from core client for 30 sec - exiting 09:30:18 (7680): No heartbeat from core client for 30 sec - exiting 09:30:19 (7680): No heartbeat from core client for 30 sec - exiting 09:30:20 (7680): No heartbeat from core client for 30 sec - exiting 09:30:21 (7680): No heartbeat from core client for 30 sec - exiting 09:30:22 (7680): No heartbeat from core client for 30 sec - exiting 09:30:24 (7680): No heartbeat from core client for 30 sec - exiting 09:30:25 (7680): No heartbeat from core client for 30 sec - exiting 09:30:26 (7680): No heartbeat from core client for 30 sec - exiting 09:30:27 (7680): No heartbeat from core client for 30 sec - exiting 09:30:28 (7680): No heartbeat from core client for 30 sec - exiting 09:30:29 (7680): No heartbeat from core client for 30 sec - exiting 09:30:30 (7680): No heartbeat from core client for 30 sec - exiting 09:30:31 (7680): No heartbeat from core client for 30 sec - exiting 09:30:32 (7680): No heartbeat from core client for 30 sec - exiting 09:30:33 (7680): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5584, selfPID=8108, iMonCtr=1 Model crash detected, will try to restart... 08:26:45 (7364): No heartbeat from core client for 30 sec - exiting 08:26:46 (7364): No heartbeat from core client for 30 sec - exiting 08:26:47 (7364): No heartbeat from core client for 30 sec - exiting 08:26:48 (7364): No heartbeat from core client for 30 sec - exiting 08:26:49 (7364): No heartbeat from core client for 30 sec - exiting 08:26:50 (7364): No heartbeat from core client for 30 sec - exiting 08:26:51 (7364): No heartbeat from core client for 30 sec - exiting 08:26:52 (7364): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:28:51 (7912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7952, selfPID=7952, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:27:54 (3308): No heartbeat from core client for 30 sec - exiting 08:27:55 (3308): No heartbeat from core client for 30 sec - exiting 08:27:56 (3308): No heartbeat from core client for 30 sec - exiting 08:27:57 (3308): No heartbeat from core client for 30 sec - exiting 08:27:58 (3308): No heartbeat from core client for 30 sec - exiting 08:27:59 (3308): No heartbeat from core client for 30 sec - exiting 08:28:00 (3308): No heartbeat from core client for 30 sec - exiting 08:28:01 (3308): No heartbeat from core client for 30 sec - exiting 08:28:02 (3308): No heartbeat from core client for 30 sec - exiting 08:28:03 (3308): No heartbeat from core client for 30 sec - exiting 08:28:04 (3308): No heartbeat from core client for 30 sec - exiting 08:28:05 (3308): No heartbeat from core client for 30 sec - exiting 08:28:06 (3308): No heartbeat from core client for 30 sec - exiting 08:28:07 (3308): No heartbeat from core client for 30 sec - exiting 08:28:08 (3308): No heartbeat from core client for 30 sec - exiting 08:28:09 (3308): No heartbeat from core client for 30 sec - exiting 08:28:10 (3308): No heartbeat from core client for 30 sec - exiting 08:28:11 (3308): No heartbeat from core client for 30 sec - exiting 08:28:13 (3308): No heartbeat from core client for 30 sec - exiting 08:28:14 (3308): No heartbeat from core client for 30 sec - exiting 08:28:15 (3308): No heartbeat from core client for 30 sec - exiting 08:28:16 (3308): No heartbeat from core client for 30 sec - exiting 08:28:17 (3308): No heartbeat from core client for 30 sec - exiting 08:28:18 (3308): No heartbeat from core client for 30 sec - exiting 08:28:19 (3308): No heartbeat from core client for 30 sec - exiting 08:28:20 (3308): No heartbeat from core client for 30 sec - exiting 08:28:21 (3308): No heartbeat from core client for 30 sec - exiting 08:28:22 (3308): No heartbeat from core client for 30 sec - exiting 08:28:23 (3308): No heartbeat from core client for 30 sec - exiting 08:28:24 (3308): No heartbeat from core client for 30 sec - exiting 08:28:25 (3308): No heartbeat from core client for 30 sec - exiting 08:28:26 (3308): No heartbeat from core client for 30 sec - exiting 08:28:27 (3308): No heartbeat from core client for 30 sec - exiting 08:28:28 (3308): No heartbeat from core client for 30 sec - exiting 08:28:29 (3308): No heartbeat from core client for 30 sec - exiting 08:28:30 (3308): No heartbeat from core client for 30 sec - exiting 08:28:31 (3308): No heartbeat from core client for 30 sec - exiting 08:28:32 (3308): No heartbeat from core client for 30 sec - exiting 08:28:33 (3308): No heartbeat from core client for 30 sec - exiting 08:28:34 (3308): No heartbeat from core client for 30 sec - exiting 08:28:35 (3308): No heartbeat from core client for 30 sec - exiting 08:28:36 (3308): No heartbeat from core client for 30 sec - exiting 08:28:37 (3308): No heartbeat from core client for 30 sec - exiting 08:28:38 (3308): No heartbeat from core client for 30 sec - exiting 08:28:39 (3308): No heartbeat from core client for 30 sec - exiting 08:28:40 (3308): No heartbeat from core client for 30 sec - exiting 08:28:41 (3308): No heartbeat from core client for 30 sec - exiting 08:28:42 (3308): No heartbeat from core client for 30 sec - exiting 08:28:43 (3308): No heartbeat from core client for 30 sec - exiting 08:28:44 (3308): No heartbeat from core client for 30 sec - exiting 08:28:45 (3308): No heartbeat from core client for 30 sec - exiting 08:28:46 (3308): No heartbeat from core client for 30 sec - exiting 08:28:47 (3308): No heartbeat from core client for 30 sec - exiting 08:28:48 (3308): No heartbeat from core client for 30 sec - exiting 08:28:49 (3308): No heartbeat from core client for 30 sec - exiting 08:28:50 (3308): No heartbeat from core client for 30 sec - exiting 08:28:51 (3308): No heartbeat from core client for 30 sec - exiting 08:28:52 (3308): No heartbeat from core client for 30 sec - exiting 08:28:53 (3308): No heartbeat from core client for 30 sec - exiting 08:28:54 (3308): No heartbeat from core client for 30 sec - exiting 08:29:25 (3308): No heartbeat from core client for 30 sec - exiting 08:29:26 (3308): No heartbeat from core client for 30 sec - exiting 08:29:27 (3308): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7008, selfPID=7008, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7904, iMonCtr=2 Model crash detected, will try to restart... 16:25:37 (2276): No heartbeat from core client for 30 sec - exiting 16:25:38 (2276): No heartbeat from core client for 30 sec - exiting 16:25:39 (2276): No heartbeat from core client for 30 sec - exiting 16:25:40 (2276): No heartbeat from core client for 30 sec - exiting 16:25:41 (2276): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:27:00 (4836): No heartbeat from core client for 30 sec - exiting 08:27:01 (4836): No heartbeat from core client for 30 sec - exiting 08:27:02 (4836): No heartbeat from core client for 30 sec - exiting 08:27:03 (4836): No heartbeat from core client for 30 sec - exiting 08:27:04 (4836): No heartbeat from core client for 30 sec - exiting 08:27:05 (4836): No heartbeat from core client for 30 sec - exiting 08:27:06 (4836): No heartbeat from core client for 30 sec - exiting 08:27:07 (4836): No heartbeat from core client for 30 sec - exiting 08:27:08 (4836): No heartbeat from core client for 30 sec - exiting 08:27:09 (4836): No heartbeat from core client for 30 sec - exiting 08:27:10 (4836): No heartbeat from core client for 30 sec - exiting 08:27:11 (4836): No heartbeat from core client for 30 sec - exiting 08:27:12 (4836): No heartbeat from core client for 30 sec - exiting 08:27:13 (4836): No heartbeat from core client for 30 sec - exiting 08:27:15 (4836): No heartbeat from core client for 30 sec - exiting 08:27:16 (4836): No heartbeat from core client for 30 sec - exiting 08:27:17 (4836): No heartbeat from core client for 30 sec - exiting 08:27:19 (4836): No heartbeat from core client for 30 sec - exiting 08:27:20 (4836): No heartbeat from core client for 30 sec - exiting 08:27:21 (4836): No heartbeat from core client for 30 sec - exiting 08:27:22 (4836): No heartbeat from core client for 30 sec - exiting 08:27:23 (4836): No heartbeat from core client for 30 sec - exiting 08:27:24 (4836): No heartbeat from core client for 30 sec - exiting 08:27:25 (4836): No heartbeat from core client for 30 sec - exiting 08:27:26 (4836): No heartbeat from core client for 30 sec - exiting 08:27:27 (4836): No heartbeat from core client for 30 sec - exiting 08:27:28 (4836): No heartbeat from core client for 30 sec - exiting 08:27:29 (4836): No heartbeat from core client for 30 sec - exiting 08:27:30 (4836): No heartbeat from core client for 30 sec - exiting 08:27:31 (4836): No heartbeat from core client for 30 sec - exiting 08:27:32 (4836): No heartbeat from core client for 30 sec - exiting 08:27:33 (4836): No heartbeat from core client for 30 sec - exiting 08:27:34 (4836): No heartbeat from core client for 30 sec - exiting 08:27:35 (4836): No heartbeat from core client for 30 sec - exiting 08:27:37 (4836): No heartbeat from core client for 30 sec - exiting 08:27:38 (4836): No heartbeat from core client for 30 sec - exiting 08:27:39 (4836): No heartbeat from core client for 30 sec - exiting 08:27:40 (4836): No heartbeat from core client for 30 sec - exiting 08:27:41 (4836): No heartbeat from core client for 30 sec - exiting 08:27:42 (4836): No heartbeat from core client for 30 sec - exiting 08:27:43 (4836): No heartbeat from core client for 30 sec - exiting 08:27:44 (4836): No heartbeat from core client for 30 sec - exiting 08:27:45 (4836): No heartbeat from core client for 30 sec - exiting 08:27:46 (4836): No heartbeat from core client for 30 sec - exiting 08:27:47 (4836): No heartbeat from core client for 30 sec - exiting 08:27:48 (4836): No heartbeat from core client for 30 sec - exiting 08:27:49 (4836): No heartbeat from core client for 30 sec - exiting 08:27:50 (4836): No heartbeat from core client for 30 sec - exiting 08:27:51 (4836): No heartbeat from core client for 30 sec - exiting 08:27:52 (4836): No heartbeat from core client for 30 sec - exiting 08:27:53 (4836): No heartbeat from core client for 30 sec - exiting 08:27:54 (4836): No heartbeat from core client for 30 sec - exiting 08:27:55 (4836): No heartbeat from core client for 30 sec - exiting 08:27:56 (4836): No heartbeat from core client for 30 sec - exiting 08:27:57 (4836): No heartbeat from core client for 30 sec - exiting 08:27:58 (4836): No heartbeat from core client for 30 sec - exiting 08:27:59 (4836): No heartbeat from core client for 30 sec - exiting 08:28:00 (4836): No heartbeat from core client for 30 sec - exiting 08:28:01 (4836): No heartbeat from core client for 30 sec - exiting 08:28:02 (4836): No heartbeat from core client for 30 sec - exiting 08:28:03 (4836): No heartbeat from core client for 30 sec - exiting 08:28:04 (4836): No heartbeat from core client for 30 sec - exiting 08:28:05 (4836): No heartbeat from core client for 30 sec - exiting 08:28:06 (4836): No heartbeat from core client for 30 sec - exiting 08:28:07 (4836): No heartbeat from core client for 30 sec - exiting 08:28:08 (4836): No heartbeat from core client for 30 sec - exiting 08:28:09 (4836): No heartbeat from core client for 30 sec - exiting 08:28:10 (4836): No heartbeat from core client for 30 sec - exiting 08:28:11 (4836): No heartbeat from core client for 30 sec - exiting 08:28:12 (4836): No heartbeat from core client for 30 sec - exiting 08:28:13 (4836): No heartbeat from core client for 30 sec - exiting 08:28:14 (4836): No heartbeat from core client for 30 sec - exiting 08:28:15 (4836): No heartbeat from core client for 30 sec - exiting 08:28:16 (4836): No heartbeat from core client for 30 sec - exiting 08:28:17 (4836): No heartbeat from core client for 30 sec - exiting 08:28:18 (4836): No heartbeat from core client for 30 sec - exiting 08:28:19 (4836): No heartbeat from core client for 30 sec - exiting 08:28:20 (4836): No heartbeat from core client for 30 sec - exiting 08:28:21 (4836): No heartbeat from core client for 30 sec - exiting 08:28:22 (4836): No heartbeat from core client for 30 sec - exiting 08:28:23 (4836): No heartbeat from core client for 30 sec - exiting 08:28:24 (4836): No heartbeat from core client for 30 sec - exiting 08:28:25 (4836): No heartbeat from core client for 30 sec - exiting 08:28:26 (4836): No heartbeat from core client for 30 sec - exiting 08:28:27 (4836): No heartbeat from core client for 30 sec - exiting 08:28:29 (4836): No heartbeat from core client for 30 sec - exiting 08:28:30 (4836): No heartbeat from core client for 30 sec - exiting 08:28:31 (4836): No heartbeat from core client for 30 sec - exiting 08:28:32 (4836): No heartbeat from core client for 30 sec - exiting 08:28:33 (4836): No heartbeat from core client for 30 sec - exiting 08:28:34 (4836): No heartbeat from core client for 30 sec - exiting 08:28:35 (4836): No heartbeat from core client for 30 sec - exiting 08:28:36 (4836): No heartbeat from core client for 30 sec - exiting 08:28:37 (4836): No heartbeat from core client for 30 sec - exiting 08:28:38 (4836): No heartbeat from core client for 30 sec - exiting 08:28:39 (4836): No heartbeat from core client for 30 sec - exiting 08:28:40 (4836): No heartbeat from core client for 30 sec - exiting 08:28:41 (4836): No heartbeat from core client for 30 sec - exiting 08:28:42 (4836): No heartbeat from core client for 30 sec - exiting 08:28:43 (4836): No heartbeat from core client for 30 sec - exiting 08:28:44 (4836): No heartbeat from core client for 30 sec - exiting 08:28:45 (4836): No heartbeat from core client for 30 sec - exiting 08:28:46 (4836): No heartbeat from core client for 30 sec - exiting 08:28:47 (4836): No heartbeat from core client for 30 sec - exiting 08:28:48 (4836): No heartbeat from core client for 30 sec - exiting 08:28:50 (4836): No heartbeat from core client for 30 sec - exiting 08:28:51 (4836): No heartbeat from core client for 30 sec - exiting 08:28:52 (4836): No heartbeat from core client for 30 sec - exiting 08:28:53 (4836): No heartbeat from core client for 30 sec - exiting 08:28:54 (4836): No heartbeat from core client for 30 sec - exiting 08:28:55 (4836): No heartbeat from core client for 30 sec - exiting 08:28:56 (4836): No heartbeat from core client for 30 sec - exiting 08:28:57 (4836): No heartbeat from core client for 30 sec - exiting 08:28:58 (4836): No heartbeat from core client for 30 sec - exiting 08:29:00 (4836): No heartbeat from core client for 30 sec - exiting 08:29:01 (4836): No heartbeat from core client for 30 sec - exiting 08:29:02 (4836): No heartbeat from core client for 30 sec - exiting 08:29:03 (4836): No heartbeat from core client for 30 sec - exiting 08:29:04 (4836): No heartbeat from core client for 30 sec - exiting 08:29:05 (4836): No heartbeat from core client for 30 sec - exiting 08:29:06 (4836): No heartbeat from core client for 30 sec - exiting 08:29:07 (4836): No heartbeat from core client for 30 sec - exiting 08:29:08 (4836): No heartbeat from core client for 30 sec - exiting 08:29:09 (4836): No heartbeat from core client for 30 sec - exiting 08:29:10 (4836): No heartbeat from core client for 30 sec - exiting 08:29:11 (4836): No heartbeat from core client for 30 sec - exiting 08:29:12 (4836): No heartbeat from core client for 30 sec - exiting 08:29:13 (4836): No heartbeat from core client for 30 sec - exiting 08:29:14 (4836): No heartbeat from core client for 30 sec - exiting 08:29:15 (4836): No heartbeat from core client for 30 sec - exiting 08:29:16 (4836): No heartbeat from core client for 30 sec - exiting 08:29:17 (4836): No heartbeat from core client for 30 sec - exiting 08:29:18 (4836): No heartbeat from core client for 30 sec - exiting 08:29:19 (4836): No heartbeat from core client for 30 sec - exiting 08:29:20 (4836): No heartbeat from core client for 30 sec - exiting 08:29:21 (4836): No heartbeat from core client for 30 sec - exiting 08:29:22 (4836): No heartbeat from core client for 30 sec - exiting 08:29:23 (4836): No heartbeat from core client for 30 sec - exiting 08:29:24 (4836): No heartbeat from core client for 30 sec - exiting 08:29:25 (4836): No heartbeat from core client for 30 sec - exiting 08:29:26 (4836): No heartbeat from core client for 30 sec - exiting 08:29:27 (4836): No heartbeat from core client for 30 sec - exiting 08:29:28 (4836): No heartbeat from core client for 30 sec - exiting 08:29:29 (4836): No heartbeat from core client for 30 sec - exiting 08:29:30 (4836): No heartbeat from core client for 30 sec - exiting 08:29:31 (4836): No heartbeat from core client for 30 sec - exiting 08:29:32 (4836): No heartbeat from core client for 30 sec - exiting 08:29:33 (4836): No heartbeat from core client for 30 sec - exiting 08:29:34 (4836): No heartbeat from core client for 30 sec - exiting 08:29:35 (4836): No heartbeat from core client for 30 sec - exiting 08:29:36 (4836): No heartbeat from core client for 30 sec - exiting 08:29:37 (4836): No heartbeat from core client for 30 sec - exiting 08:29:38 (4836): No heartbeat from core client for 30 sec - exiting 08:29:39 (4836): No heartbeat from core client for 30 sec - exiting 08:29:40 (4836): No heartbeat from core client for 30 sec - exiting 08:29:41 (4836): No heartbeat from core client for 30 sec - exiting 08:29:42 (4836): No heartbeat from core client for 30 sec - exiting 08:29:43 (4836): No heartbeat from core client for 30 sec - exiting 08:29:44 (4836): No heartbeat from core client for 30 sec - exiting 08:29:45 (4836): No heartbeat from core client for 30 sec - exiting 08:29:46 (4836): No heartbeat from core client for 30 sec - exiting 08:29:47 (4836): No heartbeat from core client for 30 sec - exiting 08:29:48 (4836): No heartbeat from core client for 30 sec - exiting 08:29:49 (4836): No heartbeat from core client for 30 sec - exiting 08:29:50 (4836): No heartbeat from core client for 30 sec - exiting 08:29:51 (4836): No heartbeat from core client for 30 sec - exiting 08:29:52 (4836): No heartbeat from core client for 30 sec - exiting 08:29:53 (4836): No heartbeat from core client for 30 sec - exiting 08:29:54 (4836): No heartbeat from core client for 30 sec - exiting 08:29:55 (4836): No heartbeat from core client for 30 sec - exiting 08:29:56 (4836): No heartbeat from core client for 30 sec - exiting 08:29:57 (4836): No heartbeat from core client for 30 sec - exiting 08:29:58 (4836): No heartbeat from core client for 30 sec - exiting 08:29:59 (4836): No heartbeat from core client for 30 sec - exiting 08:30:00 (4836): No heartbeat from core client for 30 sec - exiting 08:30:01 (4836): No heartbeat from core client for 30 sec - exiting 08:30:02 (4836): No heartbeat from core client for 30 sec - exiting 08:30:03 (4836): No heartbeat from core client for 30 sec - exiting 08:30:04 (4836): No heartbeat from core client for 30 sec - exiting 08:30:05 (4836): No heartbeat from core client for 30 sec - exiting 08:30:07 (4836): No heartbeat from core client for 30 sec - exiting 08:30:07 (4836): No heartbeat from core client for 30 sec - exiting 08:30:08 (4836): No heartbeat from core client for 30 sec - exiting 08:30:09 (4836): No heartbeat from core client for 30 sec - exiting 08:30:10 (4836): No heartbeat from core client for 30 sec - exiting 08:30:12 (4836): No heartbeat from core client for 30 sec - exiting 08:30:13 (4836): No heartbeat from core client for 30 sec - exiting 08:30:14 (4836): No heartbeat from core client for 30 sec - exiting 08:30:15 (4836): No heartbeat from core client for 30 sec - exiting 08:30:16 (4836): No heartbeat from core client for 30 sec - exiting 08:30:17 (4836): No heartbeat from core client for 30 sec - exiting 08:30:18 (4836): No heartbeat from core client for 30 sec - exiting 08:30:19 (4836): No heartbeat from core client for 30 sec - exiting 08:30:20 (4836): No heartbeat from core client for 30 sec - exiting 08:30:21 (4836): No heartbeat from core client for 30 sec - exiting 08:30:22 (4836): No heartbeat from core client for 30 sec - exiting 08:30:23 (4836): No heartbeat from core client for 30 sec - exiting 08:30:24 (4836): No heartbeat from core client for 30 sec - exiting 08:30:25 (4836): No heartbeat from core client for 30 sec - exiting 08:30:26 (4836): No heartbeat from core client for 30 sec - exiting 08:30:27 (4836): No heartbeat from core client for 30 sec - exiting 08:30:28 (4836): No heartbeat from core client for 30 sec - exiting 08:30:29 (4836): No heartbeat from core client for 30 sec - exiting 08:30:30 (4836): No heartbeat from core client for 30 sec - exiting 08:30:31 (4836): No heartbeat from core client for 30 sec - exiting 08:30:32 (4836): No heartbeat from core client for 30 sec - exiting 08:30:33 (4836): No heartbeat from core client for 30 sec - exiting 08:30:34 (4836): No heartbeat from core client for 30 sec - exiting 08:30:35 (4836): No heartbeat from core client for 30 sec - exiting 08:30:36 (4836): No heartbeat from core client for 30 sec - exiting 08:30:37 (4836): No heartbeat from core client for 30 sec - exiting 08:30:38 (4836): No heartbeat from core client for 30 sec - exiting 08:30:39 (4836): No heartbeat from core client for 30 sec - exiting 08:30:40 (4836): No heartbeat from core client for 30 sec - exiting 08:30:41 (4836): No heartbeat from core client for 30 sec - exiting 08:30:42 (4836): No heartbeat from core client for 30 sec - exiting 08:30:43 (4836): No heartbeat from core client for 30 sec - exiting 08:30:44 (4836): No heartbeat from core client for 30 sec - exiting 08:30:45 (4836): No heartbeat from core client for 30 sec - exiting 08:30:46 (4836): No heartbeat from core client for 30 sec - exiting 08:30:47 (4836): No heartbeat from core client for 30 sec - exiting 08:30:48 (4836): No heartbeat from core client for 30 sec - exiting 08:30:49 (4836): No heartbeat from core client for 30 sec - exiting 08:30:50 (4836): No heartbeat from core client for 30 sec - exiting 08:30:51 (4836): No heartbeat from core client for 30 sec - exiting 08:30:52 (4836): No heartbeat from core client for 30 sec - exiting 08:30:53 (4836): No heartbeat from core client for 30 sec - exiting 08:30:54 (4836): No heartbeat from core client for 30 sec - exiting 08:30:55 (4836): No heartbeat from core client for 30 sec - exiting 08:30:56 (4836): No heartbeat from core client for 30 sec - exiting 08:30:57 (4836): No heartbeat from core client for 30 sec - exiting 08:30:58 (4836): No heartbeat from core client for 30 sec - exiting 08:30:59 (4836): No heartbeat from core client for 30 sec - exiting 08:31:00 (4836): No heartbeat from core client for 30 sec - exiting 08:31:01 (4836): No heartbeat from core client for 30 sec - exiting 08:31:02 (4836): No heartbeat from core client for 30 sec - exiting 08:31:03 (4836): No heartbeat from core client for 30 sec - exiting 08:31:04 (4836): No heartbeat from core client for 30 sec - exiting 08:31:05 (4836): No heartbeat from core client for 30 sec - exiting 08:31:06 (4836): No heartbeat from core client for 30 sec - exiting 08:31:07 (4836): No heartbeat from core client for 30 sec - exiting 08:31:08 (4836): No heartbeat from core client for 30 sec - exiting 08:31:09 (4836): No heartbeat from core client for 30 sec - exiting 08:31:10 (4836): No heartbeat from core client for 30 sec - exiting 08:31:11 (4836): No heartbeat from core client for 30 sec - exiting 08:31:12 (4836): No heartbeat from core client for 30 sec - exiting 08:31:13 (4836): No heartbeat from core client for 30 sec - exiting 08:31:14 (4836): No heartbeat from core client for 30 sec - exiting 08:31:15 (4836): No heartbeat from core client for 30 sec - exiting 08:31:16 (4836): No heartbeat from core client for 30 sec - exiting 08:31:17 (4836): No heartbeat from core client for 30 sec - exiting 08:31:18 (4836): No heartbeat from core client for 30 sec - exiting 08:31:19 (4836): No heartbeat from core client for 30 sec - exiting 08:31:20 (4836): No heartbeat from core client for 30 sec - exiting 08:31:21 (4836): No heartbeat from core client for 30 sec - exiting 08:31:22 (4836): No heartbeat from core client for 30 sec - exiting 08:31:23 (4836): No heartbeat from core client for 30 sec - exiting 08:31:24 (4836): No heartbeat from core client for 30 sec - exiting 08:31:25 (4836): No heartbeat from core client for 30 sec - exiting 08:31:26 (4836): No heartbeat from core client for 30 sec - exiting 08:31:27 (4836): No heartbeat from core client for 30 sec - exiting 08:31:28 (4836): No heartbeat from core client for 30 sec - exiting 08:31:29 (4836): No heartbeat from core client for 30 sec - exiting 08:31:30 (4836): No heartbeat from core client for 30 sec - exiting 08:31:31 (4836): No heartbeat from core client for 30 sec - exiting 08:31:32 (4836): No heartbeat from core client for 30 sec - exiting 08:31:33 (4836): No heartbeat from core client for 30 sec - exiting 08:31:34 (4836): No heartbeat from core client for 30 sec - exiting 08:31:35 (4836): No heartbeat from core client for 30 sec - exiting 08:31:36 (4836): No heartbeat from core client for 30 sec - exiting 08:31:37 (4836): No heartbeat from core client for 30 sec - exiting 08:31:38 (4836): No heartbeat from core client for 30 sec - exiting 08:31:39 (4836): No heartbeat from core client for 30 sec - exiting 08:31:40 (4836): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:54:34 (3500): No heartbeat from core client for 30 sec - exiting 08:54:36 (3500): No heartbeat from core client for 30 sec - exiting 08:54:37 (3500): No heartbeat from core client for 30 sec - exiting 08:54:38 (3500): No heartbeat from core client for 30 sec - exiting 08:54:39 (3500): No heartbeat from core client for 30 sec - exiting 08:54:40 (3500): No heartbeat from core client for 30 sec - exiting 08:54:41 (3500): No heartbeat from core client for 30 sec - exiting 08:54:42 (3500): No heartbeat from core client for 30 sec - exiting 08:54:43 (3500): No heartbeat from core client for 30 sec - exiting 08:54:44 (3500): No heartbeat from core client for 30 sec - exiting 08:54:45 (3500): No heartbeat from core client for 30 sec - exiting 08:54:46 (3500): No heartbeat from core client for 30 sec - exiting 08:54:47 (3500): No heartbeat from core client for 30 sec - exiting 08:54:48 (3500): No heartbeat from core client for 30 sec - exiting 08:54:49 (3500): No heartbeat from core client for 30 sec - exiting 08:54:50 (3500): No heartbeat from core client for 30 sec - exiting 08:54:52 (3500): No heartbeat from core client for 30 sec - exiting 08:54:53 (3500): No heartbeat from core client for 30 sec - exiting 08:54:54 (3500): No heartbeat from core client for 30 sec - exiting 08:54:55 (3500): No heartbeat from core client for 30 sec - exiting 08:54:56 (3500): No heartbeat from core client for 30 sec - exiting 08:54:57 (3500): No heartbeat from core client for 30 sec - exiting 08:54:58 (3500): No heartbeat from core client for 30 sec - exiting 08:54:59 (3500): No heartbeat from core client for 30 sec - exiting 08:55:00 (3500): No heartbeat from core client for 30 sec - exiting 08:55:01 (3500): No heartbeat from core client for 30 sec - exiting 08:55:02 (3500): No heartbeat from core client for 30 sec - exiting 08:55:03 (3500): No heartbeat from core client for 30 sec - exiting 08:55:04 (3500): No heartbeat from core client for 30 sec - exiting 08:55:05 (3500): No heartbeat from core client for 30 sec - exiting 08:55:06 (3500): No heartbeat from core client for 30 sec - exiting 08:55:07 (3500): No heartbeat from core client for 30 sec - exiting 08:55:08 (3500): No heartbeat from core client for 30 sec - exiting 08:55:09 (3500): No heartbeat from core client for 30 sec - exiting 08:55:10 (3500): No heartbeat from core client for 30 sec - exiting 08:55:11 (3500): No heartbeat from core client for 30 sec - exiting 08:55:12 (3500): No heartbeat from core client for 30 sec - exiting 08:55:13 (3500): No heartbeat from core client for 30 sec - exiting 08:55:14 (3500): No heartbeat from core client for 30 sec - exiting 08:55:15 (3500): No heartbeat from core client for 30 sec - exiting 08:55:16 (3500): No heartbeat from core client for 30 sec - exiting 08:55:17 (3500): No heartbeat from core client for 30 sec - exiting 08:55:18 (3500): No heartbeat from core client for 30 sec - exiting 08:55:19 (3500): No heartbeat from core client for 30 sec - exiting 08:55:20 (3500): No heartbeat from core client for 30 sec - exiting 08:55:21 (3500): No heartbeat from core client for 30 sec - exiting 08:55:22 (3500): No heartbeat from core client for 30 sec - exiting 08:55:23 (3500): No heartbeat from core client for 30 sec - exiting 08:55:24 (3500): No heartbeat from core client for 30 sec - exiting 08:55:25 (3500): No heartbeat from core client for 30 sec - exiting 08:55:26 (3500): No heartbeat from core client for 30 sec - exiting 08:55:27 (3500): No heartbeat from core client for 30 sec - exiting 08:55:28 (3500): No heartbeat from core client for 30 sec - exiting 08:55:29 (3500): No heartbeat from core client for 30 sec - exiting 08:55:30 (3500): No heartbeat from core client for 30 sec - exiting 08:55:31 (3500): No heartbeat from core client for 30 sec - exiting 08:55:32 (3500): No heartbeat from core client for 30 sec - exiting 08:55:33 (3500): No heartbeat from core client for 30 sec - exiting 08:55:34 (3500): No heartbeat from core client for 30 sec - exiting 08:55:35 (3500): No heartbeat from core client for 30 sec - exiting 08:55:36 (3500): No heartbeat from core client for 30 sec - exiting 08:55:37 (3500): No heartbeat from core client for 30 sec - exiting 08:55:38 (3500): No heartbeat from core client for 30 sec - exiting 08:55:39 (3500): No heartbeat from core client for 30 sec - exiting 08:55:40 (3500): No heartbeat from core client for 30 sec - exiting 08:55:41 (3500): No heartbeat from core client for 30 sec - exiting 08:55:42 (3500): No heartbeat from core client for 30 sec - exiting 08:55:43 (3500): No heartbeat from core client for 30 sec - exiting 08:55:44 (3500): No heartbeat from core client for 30 sec - exiting 08:55:45 (3500): No heartbeat from core client for 30 sec - exiting 08:55:46 (3500): No heartbeat from core client for 30 sec - exiting 08:55:47 (3500): No heartbeat from core client for 30 sec - exiting 08:55:48 (3500): No heartbeat from core client for 30 sec - exiting 08:55:49 (3500): No heartbeat from core client for 30 sec - exiting 08:55:50 (3500): No heartbeat from core client for 30 sec - exiting 08:55:51 (3500): No heartbeat from core client for 30 sec - exiting 08:55:52 (3500): No heartbeat from core client for 30 sec - exiting 08:55:53 (3500): No heartbeat from core client for 30 sec - exiting 08:55:54 (3500): No heartbeat from core client for 30 sec - exiting 08:55:55 (3500): No heartbeat from core client for 30 sec - exiting 08:55:56 (3500): No heartbeat from core client for 30 sec - exiting 08:55:57 (3500): No heartbeat from core client for 30 sec - exiting 08:55:58 (3500): No heartbeat from core client for 30 sec - exiting 08:55:59 (3500): No heartbeat from core client for 30 sec - exiting 08:56:00 (3500): No heartbeat from core client for 30 sec - exiting 08:56:01 (3500): No heartbeat from core client for 30 sec - exiting 08:56:02 (3500): No heartbeat from core client for 30 sec - exiting 08:56:03 (3500): No heartbeat from core client for 30 sec - exiting 08:56:04 (3500): No heartbeat from core client for 30 sec - exiting 08:56:05 (3500): No heartbeat from core client for 30 sec - exiting 08:56:06 (3500): No heartbeat from core client for 30 sec - exiting 08:56:07 (3500): No heartbeat from core client for 30 sec - exiting 08:56:08 (3500): No heartbeat from core client for 30 sec - exiting 08:56:09 (3500): No heartbeat from core client for 30 sec - exiting 08:56:10 (3500): No heartbeat from core client for 30 sec - exiting 08:56:11 (3500): No heartbeat from core client for 30 sec - exiting 08:56:12 (3500): No heartbeat from core client for 30 sec - exiting 08:56:13 (3500): No heartbeat from core client for 30 sec - exiting 08:56:14 (3500): No heartbeat from core client for 30 sec - exiting 08:56:16 (3500): No heartbeat from core client for 30 sec - exiting 08:56:17 (3500): No heartbeat from core client for 30 sec - exiting 08:56:18 (3500): No heartbeat from core client for 30 sec - exiting 08:56:19 (3500): No heartbeat from core client for 30 sec - exiting 08:56:20 (3500): No heartbeat from core client for 30 sec - exiting 08:56:21 (3500): No heartbeat from core client for 30 sec - exiting 08:56:22 (3500): No heartbeat from core client for 30 sec - exiting 08:56:23 (3500): No heartbeat from core client for 30 sec - exiting 08:56:24 (3500): No heartbeat from core client for 30 sec - exiting 08:56:25 (3500): No heartbeat from core client for 30 sec - exiting 08:56:27 (3500): No heartbeat from core client for 30 sec - exiting 08:56:28 (3500): No heartbeat from core client for 30 sec - exiting 08:56:29 (3500): No heartbeat from core client for 30 sec - exiting 08:56:30 (3500): No heartbeat from core client for 30 sec - exiting 08:56:31 (3500): No heartbeat from core client for 30 sec - exiting 08:56:32 (3500): No heartbeat from core client for 30 sec - exiting 08:56:33 (3500): No heartbeat from core client for 30 sec - exiting 08:56:34 (3500): No heartbeat from core client for 30 sec - exiting 08:56:35 (3500): No heartbeat from core client for 30 sec - exiting 08:56:36 (3500): No heartbeat from core client for 30 sec - exiting 08:56:37 (3500): No heartbeat from core client for 30 sec - exiting 08:56:38 (3500): No heartbeat from core client for 30 sec - exiting 08:56:39 (3500): No heartbeat from core client for 30 sec - exiting 08:56:40 (3500): No heartbeat from core client for 30 sec - exiting 08:56:41 (3500): No heartbeat from core client for 30 sec - exiting 08:56:42 (3500): No heartbeat from core client for 30 sec - exiting 08:56:43 (3500): No heartbeat from core client for 30 sec - exiting 08:56:44 (3500): No heartbeat from core client for 30 sec - exiting 08:56:45 (3500): No heartbeat from core client for 30 sec - exiting 08:57:21 (3500): No heartbeat from core client for 30 sec - exiting 08:57:22 (3500): No heartbeat from core client for 30 sec - exiting 08:57:23 (3500): No heartbeat from core client for 30 sec - exiting 08:57:24 (3500): No heartbeat from core client for 30 sec - exiting 08:57:25 (3500): No heartbeat from core client for 30 sec - exiting 08:57:26 (3500): No heartbeat from core client for 30 sec - exiting 08:57:27 (3500): No heartbeat from core client for 30 sec - exiting 08:57:28 (3500): No heartbeat from core client for 30 sec - exiting 08:57:29 (3500): No heartbeat from core client for 30 sec - exiting 08:57:30 (3500): No heartbeat from core client for 30 sec - exiting 08:57:31 (3500): No heartbeat from core client for 30 sec - exiting 08:57:32 (3500): No heartbeat from core client for 30 sec - exiting 08:57:33 (3500): No heartbeat from core client for 30 sec - exiting 08:57:34 (3500): No heartbeat from core client for 30 sec - exiting 08:57:35 (3500): No heartbeat from core client for 30 sec - exiting 08:57:36 (3500): No heartbeat from core client for 30 sec - exiting 08:57:37 (3500): No heartbeat from core client for 30 sec - exiting 08:57:38 (3500): No heartbeat from core client for 30 sec - exiting 08:57:39 (3500): No heartbeat from core client for 30 sec - exiting 08:57:41 (3500): No heartbeat from core client for 30 sec - exiting 08:57:42 (3500): No heartbeat from core client for 30 sec - exiting 08:57:43 (3500): No heartbeat from core client for 30 sec - exiting 08:57:44 (3500): No heartbeat from core client for 30 sec - exiting 08:57:45 (3500): No heartbeat from core client for 30 sec - exiting 08:57:46 (3500): No heartbeat from core client for 30 sec - exiting 08:57:47 (3500): No heartbeat from core client for 30 sec - exiting 08:57:48 (3500): No heartbeat from core client for 30 sec - exiting 08:57:49 (3500): No heartbeat from core client for 30 sec - exiting 08:57:50 (3500): No heartbeat from core client for 30 sec - exiting 08:57:51 (3500): No heartbeat from core client for 30 sec - exiting 08:57:52 (3500): No heartbeat from core client for 30 sec - exiting 08:57:53 (3500): No heartbeat from core client for 30 sec - exiting 08:57:54 (3500): No heartbeat from core client for 30 sec - exiting 08:57:55 (3500): No heartbeat from core client for 30 sec - exiting 08:57:56 (3500): No heartbeat from core client for 30 sec - exiting 08:57:57 (3500): No heartbeat from core client for 30 sec - exiting 08:57:58 (3500): No heartbeat from core client for 30 sec - exiting 08:57:59 (3500): No heartbeat from core client for 30 sec - exiting 08:58:00 (3500): No heartbeat from core client for 30 sec - exiting 08:58:01 (3500): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3852, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6564, selfPID=8092, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 08:24:21 (6540): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3096, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6220, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=288, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5532, selfPID=4072, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6600, selfPID=4300, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_anz_e3it_2013_1_009760473_0_10.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_e3it_2013_1_009760473_0_11.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_e3it_2013_1_009760473_0_12.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
08 Jul 2015 03:05:09	1359687	18334320	hadam3p_anz_e3it_2013_1_009760473_0	103,979	960,449	9.2370
30 Jun 2015 03:01:49	1359687	18334320	hadam3p_anz_e3it_2013_1_009760473_0	92,459	849,868	9.1918
24 Jun 2015 07:42:51	1359687	18334320	hadam3p_anz_e3it_2013_1_009760473_0	80,939	748,299	9.2452
17 Jun 2015 02:43:31	1359687	18334320	hadam3p_anz_e3it_2013_1_009760473_0	69,419	649,067	9.3500
11 Jun 2015 06:35:08	1359687	18334320	hadam3p_anz_e3it_2013_1_009760473_0	57,899	539,874	9.3244
05 Jun 2015 03:46:34	1359687	18334320	hadam3p_anz_e3it_2013_1_009760473_0	46,379	448,796	9.6767
03 Jun 2015 23:29:55	1359687	18334320	hadam3p_anz_e3it_2013_1_009760473_0	34,859	387,695	11.1218
26 May 2015 05:01:53	1359687	18334320	hadam3p_anz_e3it_2013_1_009760473_0	23,339	296,599	12.7083
18 May 2015 23:25:37	1359687	18334320	hadam3p_anz_e3it_2013_1_009760473_0	11,819	152,282	12.8845