Task 16619927

Name	hadam3p_anz_r587_2012_1_008736389_0
Workunit	8882367
Created	8 May 2014, 18:56:15 UTC
Sent	17 May 2014, 9:25:04 UTC
Report deadline	29 Apr 2015, 14:45:04 UTC
Received	18 Jun 2014, 16:12:28 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1189308
Run time	10 days 6 hours 31 min 58 sec
CPU time	4 days 2 hours 23 min 41 sec
Validate state	Invalid
Credit	3,987.46
Device peak FLOPS	2.38 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.2.42</core_client_version> <![CDATA[ <stderr_txt> r - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4076, selfPID=3356, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3644, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3292, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3504, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3332, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:53:06 (2628): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5012, selfPID=2624, iMonCtr=1 Model crash detected, will try to restart... 08:15:04 (3592): No heartbeat from core client for 30 sec - exiting 08:15:05 (3592): No heartbeat from core client for 30 sec - exiting 08:15:06 (3592): No heartbeat from core client for 30 sec - exiting 08:15:08 (3592): No heartbeat from core client for 30 sec - exiting 08:15:09 (3592): No heartbeat from core client for 30 sec - exiting 08:15:10 (3592): No heartbeat from core client for 30 sec - exiting 08:15:11 (3592): No heartbeat from core client for 30 sec - exiting 08:15:12 (3592): No heartbeat from core client for 30 sec - exiting 08:15:13 (3592): No heartbeat from core client for 30 sec - exiting 08:15:14 (3592): No heartbeat from core client for 30 sec - exiting 08:15:15 (3592): No heartbeat from core client for 30 sec - exiting 08:15:16 (3592): No heartbeat from core client for 30 sec - exiting 08:15:17 (3592): No heartbeat from core client for 30 sec - exiting 08:15:19 (3592): No heartbeat from core client for 30 sec - exiting 08:15:20 (3592): No heartbeat from core client for 30 sec - exiting 08:15:21 (3592): No heartbeat from core client for 30 sec - exiting 08:15:22 (3592): No heartbeat from core client for 30 sec - exiting 08:15:23 (3592): No heartbeat from core client for 30 sec - exiting 08:15:24 (3592): No heartbeat from core client for 30 sec - exiting 08:15:25 (3592): No heartbeat from core client for 30 sec - exiting 08:15:26 (3592): No heartbeat from core client for 30 sec - exiting 08:15:27 (3592): No heartbeat from core client for 30 sec - exiting 08:15:28 (3592): No heartbeat from core client for 30 sec - exiting 08:15:29 (3592): No heartbeat from core client for 30 sec - exiting 08:15:31 (3592): No heartbeat from core client for 30 sec - exiting 08:15:32 (3592): No heartbeat from core client for 30 sec - exiting 08:15:33 (3592): No heartbeat from core client for 30 sec - exiting 08:15:34 (3592): No heartbeat from core client for 30 sec - exiting 08:15:35 (3592): No heartbeat from core client for 30 sec - exiting 08:15:36 (3592): No heartbeat from core client for 30 sec - exiting 08:15:37 (3592): No heartbeat from core client for 30 sec - exiting 08:15:38 (3592): No heartbeat from core client for 30 sec - exiting 08:15:39 (3592): No heartbeat from core client for 30 sec - exiting 08:15:40 (3592): No heartbeat from core client for 30 sec - exiting 08:15:41 (3592): No heartbeat from core client for 30 sec - exiting 08:15:43 (3592): No heartbeat from core client for 30 sec - exiting 08:15:44 (3592): No heartbeat from core client for 30 sec - exiting 08:15:45 (3592): No heartbeat from core client for 30 sec - exiting 08:15:46 (3592): No heartbeat from core client for 30 sec - exiting 08:15:47 (3592): No heartbeat from core client for 30 sec - exiting 08:15:48 (3592): No heartbeat from core client for 30 sec - exiting 08:15:49 (3592): No heartbeat from core client for 30 sec - exiting 08:15:50 (3592): No heartbeat from core client for 30 sec - exiting 08:15:51 (3592): No heartbeat from core client for 30 sec - exiting 08:15:52 (3592): No heartbeat from core client for 30 sec - exiting 08:15:53 (3592): No heartbeat from core client for 30 sec - exiting 08:15:55 (3592): No heartbeat from core client for 30 sec - exiting 08:15:56 (3592): No heartbeat from core client for 30 sec - exiting 08:15:57 (3592): No heartbeat from core client for 30 sec - exiting 08:15:58 (3592): No heartbeat from core client for 30 sec - exiting 08:15:59 (3592): No heartbeat from core client for 30 sec - exiting 08:16:00 (3592): No heartbeat from core client for 30 sec - exiting 08:16:01 (3592): No heartbeat from core client for 30 sec - exiting 08:16:02 (3592): No heartbeat from core client for 30 sec - exiting 08:16:03 (3592): No heartbeat from core client for 30 sec - exiting 08:16:04 (3592): No heartbeat from core client for 30 sec - exiting 08:16:05 (3592): No heartbeat from core client for 30 sec - exiting 08:16:07 (3592): No heartbeat from core client for 30 sec - exiting 08:16:08 (3592): No heartbeat from core client for 30 sec - exiting 08:16:09 (3592): No heartbeat from core client for 30 sec - exiting 08:16:10 (3592): No heartbeat from core client for 30 sec - exiting 08:16:11 (3592): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:59:03 (1604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:30:02 (4180): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:47:54 (4976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:08:47 (3096): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:14:48 (4620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:32:15 (676): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:53:55 (1944): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=976, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2180, iMonCtr=2 Leaving CPDN_Main::Monitor... 20:58:42 (2692): No heartbeat from core client for 30 sec - exiting 20:58:43 (2692): No heartbeat from core client for 30 sec - exiting 20:58:44 (2692): No heartbeat from core client for 30 sec - exiting 20:58:45 (2692): No heartbeat from core client for 30 sec - exiting 20:58:46 (2692): No heartbeat from core client for 30 sec - exiting 20:58:47 (2692): No heartbeat from core client for 30 sec - exiting 20:58:48 (2692): No heartbeat from core client for 30 sec - exiting 20:58:49 (2692): No heartbeat from core client for 30 sec - exiting 20:58:50 (2692): No heartbeat from core client for 30 sec - exiting 20:58:51 (2692): No heartbeat from core client for 30 sec - exiting 20:58:53 (2692): No heartbeat from core client for 30 sec - exiting 20:58:54 (2692): No heartbeat from core client for 30 sec - exiting 20:58:55 (2692): No heartbeat from core client for 30 sec - exiting 20:58:56 (2692): No heartbeat from core client for 30 sec - exiting 20:58:57 (2692): No heartbeat from core client for 30 sec - exiting 20:58:58 (2692): No heartbeat from core client for 30 sec - exiting 20:58:59 (2692): No heartbeat from core client for 30 sec - exiting 20:59:00 (2692): No heartbeat from core client for 30 sec - exiting 20:59:01 (2692): No heartbeat from core client for 30 sec - exiting 20:59:02 (2692): No heartbeat from core client for 30 sec - exiting 20:59:03 (2692): No heartbeat from core client for 30 sec - exiting 20:59:05 (2692): No heartbeat from core client for 30 sec - exiting 20:59:06 (2692): No heartbeat from core client for 30 sec - exiting 20:59:07 (2692): No heartbeat from core client for 30 sec - exiting 20:59:08 (2692): No heartbeat from core client for 30 sec - exiting 20:59:09 (2692): No heartbeat from core client for 30 sec - exiting 20:59:10 (2692): No heartbeat from core client for 30 sec - exiting 20:59:11 (2692): No heartbeat from core client for 30 sec - exiting 20:59:12 (2692): No heartbeat from core client for 30 sec - exiting 20:59:13 (2692): No heartbeat from core client for 30 sec - exiting 20:59:14 (2692): No heartbeat from core client for 30 sec - exiting 20:59:15 (2692): No heartbeat from core client for 30 sec - exiting 20:59:17 (2692): No heartbeat from core client for 30 sec - exiting 20:59:18 (2692): No heartbeat from core client for 30 sec - exiting 20:59:19 (2692): No heartbeat from core client for 30 sec - exiting 20:59:20 (2692): No heartbeat from core client for 30 sec - exiting 20:59:21 (2692): No heartbeat from core client for 30 sec - exiting 20:59:22 (2692): No heartbeat from core client for 30 sec - exiting 20:59:23 (2692): No heartbeat from core client for 30 sec - exiting 20:59:24 (2692): No heartbeat from core client for 30 sec - exiting 20:59:25 (2692): No heartbeat from core client for 30 sec - exiting 20:59:26 (2692): No heartbeat from core client for 30 sec - exiting 20:59:27 (2692): No heartbeat from core client for 30 sec - exiting 20:59:29 (2692): No heartbeat from core client for 30 sec - exiting 20:59:30 (2692): No heartbeat from core client for 30 sec - exiting 20:59:31 (2692): No heartbeat from core client for 30 sec - exiting 20:59:32 (2692): No heartbeat from core client for 30 sec - exiting 20:59:33 (2692): No heartbeat from core client for 30 sec - exiting 20:59:34 (2692): No heartbeat from core client for 30 sec - exiting 20:59:35 (2692): No heartbeat from core client for 30 sec - exiting 20:59:36 (2692): No heartbeat from core client for 30 sec - exiting 20:59:37 (2692): No heartbeat from core client for 30 sec - exiting 20:59:38 (2692): No heartbeat from core client for 30 sec - exiting 20:59:39 (2692): No heartbeat from core client for 30 sec - exiting 20:59:40 (2692): No heartbeat from core client for 30 sec - exiting 20:59:41 (2692): No heartbeat from core client for 30 sec - exiting 20:59:42 (2692): No heartbeat from core client for 30 sec - exiting 20:59:43 (2692): No heartbeat from core client for 30 sec - exiting 20:59:44 (2692): No heartbeat from core client for 30 sec - exiting 20:59:46 (2692): No heartbeat from core client for 30 sec - exiting 20:59:47 (2692): No heartbeat from core client for 30 sec - exiting 20:59:48 (2692): No heartbeat from core client for 30 sec - exiting 20:59:49 (2692): No heartbeat from core client for 30 sec - exiting 20:59:50 (2692): No heartbeat from core client for 30 sec - exiting 20:59:51 (2692): No heartbeat from core client for 30 sec - exiting 20:59:52 (2692): No heartbeat from core client for 30 sec - exiting 20:59:53 (2692): No heartbeat from core client for 30 sec - exiting 20:59:54 (2692): No heartbeat from core client for 30 sec - exiting 20:59:55 (2692): No heartbeat from core client for 30 sec - exiting 20:59:56 (2692): No heartbeat from core client for 30 sec - exiting 20:59:58 (2692): No heartbeat from core client for 30 sec - exiting 20:59:59 (2692): No heartbeat from core client for 30 sec - exiting 21:00:00 (2692): No heartbeat from core client for 30 sec - exiting 21:00:01 (2692): No heartbeat from core client for 30 sec - exiting 21:00:02 (2692): No heartbeat from core client for 30 sec - exiting 21:00:03 (2692): No heartbeat from core client for 30 sec - exiting 21:00:04 (2692): No heartbeat from core client for 30 sec - exiting 21:00:05 (2692): No heartbeat from core client for 30 sec - exiting 21:00:06 (2692): No heartbeat from core client for 30 sec - exiting 21:00:07 (2692): No heartbeat from core client for 30 sec - exiting 21:00:08 (2692): No heartbeat from core client for 30 sec - exiting 21:00:10 (2692): No heartbeat from core client for 30 sec - exiting 21:00:11 (2692): No heartbeat from core client for 30 sec - exiting 21:00:12 (2692): No heartbeat from core client for 30 sec - exiting 21:00:13 (2692): No heartbeat from core client for 30 sec - exiting 21:00:14 (2692): No heartbeat from core client for 30 sec - exiting 21:00:15 (2692): No heartbeat from core client for 30 sec - exiting 21:00:16 (2692): No heartbeat from core client for 30 sec - exiting 21:00:17 (2692): No heartbeat from core client for 30 sec - exiting 21:00:18 (2692): No heartbeat from core client for 30 sec - exiting 21:00:19 (2692): No heartbeat from core client for 30 sec - exiting 21:00:21 (2692): No heartbeat from core client for 30 sec - exiting 21:00:22 (2692): No heartbeat from core client for 30 sec - exiting 21:00:23 (2692): No heartbeat from core client for 30 sec - exiting 21:00:24 (2692): No heartbeat from core client for 30 sec - exiting 21:00:25 (2692): No heartbeat from core client for 30 sec - exiting 21:00:26 (2692): No heartbeat from core client for 30 sec - exiting 21:00:27 (2692): No heartbeat from core client for 30 sec - exiting 21:00:28 (2692): No heartbeat from core client for 30 sec - exiting 21:00:29 (2692): No heartbeat from core client for 30 sec - exiting 21:00:30 (2692): No heartbeat from core client for 30 sec - exiting 21:00:31 (2692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:00:33 (2692): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:50:18 (5016): No heartbeat from core client for 30 sec - exiting 08:50:19 (5016): No heartbeat from core client for 30 sec - exiting 08:50:20 (5016): No heartbeat from core client for 30 sec - exiting 08:50:21 (5016): No heartbeat from core client for 30 sec - exiting 08:50:22 (5016): No heartbeat from core client for 30 sec - exiting 08:50:23 (5016): No heartbeat from core client for 30 sec - exiting 08:50:25 (5016): No heartbeat from core client for 30 sec - exiting 08:50:26 (5016): No heartbeat from core client for 30 sec - exiting 08:50:27 (5016): No heartbeat from core client for 30 sec - exiting 08:50:28 (5016): No heartbeat from core client for 30 sec - exiting 08:50:29 (5016): No heartbeat from core client for 30 sec - exiting 08:50:30 (5016): No heartbeat from core client for 30 sec - exiting 08:50:31 (5016): No heartbeat from core client for 30 sec - exiting 08:50:32 (5016): No heartbeat from core client for 30 sec - exiting 08:50:33 (5016): No heartbeat from core client for 30 sec - exiting 08:50:34 (5016): No heartbeat from core client for 30 sec - exiting 08:50:35 (5016): No heartbeat from core client for 30 sec - exiting 08:50:37 (5016): No heartbeat from core client for 30 sec - exiting 08:50:38 (5016): No heartbeat from core client for 30 sec - exiting 08:50:39 (5016): No heartbeat from core client for 30 sec - exiting 08:50:40 (5016): No heartbeat from core client for 30 sec - exiting 08:50:41 (5016): No heartbeat from core client for 30 sec - exiting 08:50:42 (5016): No heartbeat from core client for 30 sec - exiting 08:50:43 (5016): No heartbeat from core client for 30 sec - exiting 08:50:44 (5016): No heartbeat from core client for 30 sec - exiting 08:50:45 (5016): No heartbeat from core client for 30 sec - exiting 08:50:46 (5016): No heartbeat from core client for 30 sec - exiting 08:50:47 (5016): No heartbeat from core client for 30 sec - exiting 08:50:49 (5016): No heartbeat from core client for 30 sec - exiting 08:50:50 (5016): No heartbeat from core client for 30 sec - exiting 08:50:51 (5016): No heartbeat from core client for 30 sec - exiting 08:50:52 (5016): No heartbeat from core client for 30 sec - exiting 08:50:53 (5016): No heartbeat from core client for 30 sec - exiting 08:50:54 (5016): No heartbeat from core client for 30 sec - exiting 08:50:55 (5016): No heartbeat from core client for 30 sec - exiting 08:50:56 (5016): No heartbeat from core client for 30 sec - exiting 08:50:57 (5016): No heartbeat from core client for 30 sec - exiting 08:50:58 (5016): No heartbeat from core client for 30 sec - exiting 08:50:59 (5016): No heartbeat from core client for 30 sec - exiting 08:51:01 (5016): No heartbeat from core client for 30 sec - exiting 08:51:02 (5016): No heartbeat from core client for 30 sec - exiting 08:51:03 (5016): No heartbeat from core client for 30 sec - exiting 08:51:04 (5016): No heartbeat from core client for 30 sec - exiting 08:51:05 (5016): No heartbeat from core client for 30 sec - exiting 08:51:06 (5016): No heartbeat from core client for 30 sec - exiting 08:51:07 (5016): No heartbeat from core client for 30 sec - exiting 08:51:08 (5016): No heartbeat from core client for 30 sec - exiting 08:51:09 (5016): No heartbeat from core client for 30 sec - exiting 08:51:10 (5016): No heartbeat from core client for 30 sec - exiting 08:51:11 (5016): No heartbeat from core client for 30 sec - exiting 08:51:13 (5016): No heartbeat from core client for 30 sec - exiting 08:51:14 (5016): No heartbeat from core client for 30 sec - exiting 08:51:15 (5016): No heartbeat from core client for 30 sec - exiting 08:51:16 (5016): No heartbeat from core client for 30 sec - exiting 08:51:17 (5016): No heartbeat from core client for 30 sec - exiting 08:51:18 (5016): No heartbeat from core client for 30 sec - exiting 08:51:19 (5016): No heartbeat from core client for 30 sec - exiting 08:51:20 (5016): No heartbeat from core client for 30 sec - exiting 08:51:21 (5016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4248, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1296, selfPID=3180, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5016, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3076, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5008, selfPID=1180, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:15:53 (2812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3896, selfPID=3584, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3672, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4160, selfPID=5104, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4696, selfPID=3316, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:09:33 (3112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:30:16 (3396): No heartbeat from core client for 30 sec - exiting 09:30:17 (3396): No heartbeat from core client for 30 sec - exiting 09:30:18 (3396): No heartbeat from core client for 30 sec - exiting 09:30:19 (3396): No heartbeat from core client for 30 sec - exiting 09:30:21 (3396): No heartbeat from core client for 30 sec - exiting 09:30:22 (3396): No heartbeat from core client for 30 sec - exiting 09:30:23 (3396): No heartbeat from core client for 30 sec - exiting 09:30:24 (3396): No heartbeat from core client for 30 sec - exiting 09:30:25 (3396): No heartbeat from core client for 30 sec - exiting 09:30:26 (3396): No heartbeat from core client for 30 sec - exiting 09:30:27 (3396): No heartbeat from core client for 30 sec - exiting 09:30:28 (3396): No heartbeat from core client for 30 sec - exiting 09:30:29 (3396): No heartbeat from core client for 30 sec - exiting 09:30:30 (3396): No heartbeat from core client for 30 sec - exiting 09:30:31 (3396): No heartbeat from core client for 30 sec - exiting 09:30:33 (3396): No heartbeat from core client for 30 sec - exiting 09:30:34 (3396): No heartbeat from core client for 30 sec - exiting 09:30:35 (3396): No heartbeat from core client for 30 sec - exiting 09:30:36 (3396): No heartbeat from core client for 30 sec - exiting 09:30:37 (3396): No heartbeat from core client for 30 sec - exiting 09:30:38 (3396): No heartbeat from core client for 30 sec - exiting 09:30:39 (3396): No heartbeat from core client for 30 sec - exiting 09:30:40 (3396): No heartbeat from core client for 30 sec - exiting 09:30:41 (3396): No heartbeat from core client for 30 sec - exiting 09:30:42 (3396): No heartbeat from core client for 30 sec - exiting 09:30:43 (3396): No heartbeat from core client for 30 sec - exiting 09:30:45 (3396): No heartbeat from core client for 30 sec - exiting 09:30:46 (3396): No heartbeat from core client for 30 sec - exiting 09:30:47 (3396): No heartbeat from core client for 30 sec - exiting 09:30:48 (3396): No heartbeat from core client for 30 sec - exiting 09:30:49 (3396): No heartbeat from core client for 30 sec - exiting 09:30:50 (3396): No heartbeat from core client for 30 sec - exiting 09:30:51 (3396): No heartbeat from core client for 30 sec - exiting 09:30:52 (3396): No heartbeat from core client for 30 sec - exiting 09:30:53 (3396): No heartbeat from core client for 30 sec - exiting 09:30:54 (3396): No heartbeat from core client for 30 sec - exiting 09:30:56 (3396): No heartbeat from core client for 30 sec - exiting 09:30:57 (3396): No heartbeat from core client for 30 sec - exiting 09:30:58 (3396): No heartbeat from core client for 30 sec - exiting 09:30:59 (3396): No heartbeat from core client for 30 sec - exiting 09:31:00 (3396): No heartbeat from core client for 30 sec - exiting 09:31:01 (3396): No heartbeat from core client for 30 sec - exiting 09:31:02 (3396): No heartbeat from core client for 30 sec - exiting 09:31:03 (3396): No heartbeat from core client for 30 sec - exiting 09:31:04 (3396): No heartbeat from core client for 30 sec - exiting 09:31:05 (3396): No heartbeat from core client for 30 sec - exiting 09:31:06 (3396): No heartbeat from core client for 30 sec - exiting 09:31:08 (3396): No heartbeat from core client for 30 sec - exiting 09:31:09 (3396): No heartbeat from core client for 30 sec - exiting 09:31:10 (3396): No heartbeat from core client for 30 sec - exiting 09:31:11 (3396): No heartbeat from core client for 30 sec - exiting 09:31:12 (3396): No heartbeat from core client for 30 sec - exiting 09:31:13 (3396): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:31:14 (3396): No heartbeat from core client for 30 sec - exiting 09:31:15 (3396): No heartbeat from core client for 30 sec - exiting 09:31:16 (3396): No heartbeat from core client for 30 sec - exiting 09:31:17 (3396): No heartbeat from core client for 30 sec - exiting 09:31:18 (3396): No heartbeat from core client for 30 sec - exiting 09:31:20 (3396): No heartbeat from core client for 30 sec - exiting 09:31:21 (3396): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:37:31 (3636): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:35:06 (620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:19:02 (3700): No heartbeat from core client for 30 sec - exiting 09:19:03 (3700): No heartbeat from core client for 30 sec - exiting 09:19:04 (3700): No heartbeat from core client for 30 sec - exiting 09:19:05 (3700): No heartbeat from core client for 30 sec - exiting 09:19:06 (3700): No heartbeat from core client for 30 sec - exiting 09:19:07 (3700): No heartbeat from core client for 30 sec - exiting 09:19:08 (3700): No heartbeat from core client for 30 sec - exiting 09:19:09 (3700): No heartbeat from core client for 30 sec - exiting 09:19:10 (3700): No heartbeat from core client for 30 sec - exiting 09:19:11 (3700): No heartbeat from core client for 30 sec - exiting 09:19:12 (3700): No heartbeat from core client for 30 sec - exiting 09:19:13 (3700): No heartbeat from core client for 30 sec - exiting 09:19:14 (3700): No heartbeat from core client for 30 sec - exiting 09:19:15 (3700): No heartbeat from core client for 30 sec - exiting 09:19:17 (3700): No heartbeat from core client for 30 sec - exiting 09:19:18 (3700): No heartbeat from core client for 30 sec - exiting 09:19:19 (3700): No heartbeat from core client for 30 sec - exiting 09:19:20 (3700): No heartbeat from core client for 30 sec - exiting 09:19:21 (3700): No heartbeat from core client for 30 sec - exiting 09:19:22 (3700): No heartbeat from core client for 30 sec - exiting 09:19:23 (3700): No heartbeat from core client for 30 sec - exiting 09:19:24 (3700): No heartbeat from core client for 30 sec - exiting 09:19:25 (3700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:19:26 (3700): No heartbeat from core client for 30 sec - exiting 09:19:27 (3700): No heartbeat from core client for 30 sec - exiting 09:19:29 (3700): No heartbeat from core client for 30 sec - exiting 09:19:30 (3700): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:18:25 (4236): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... C09:04:23 (4940): No heartbeat from core client for 30 sec - exiting 09:04:24 (4940): No heartbeat from core client for 30 sec - exiting 09:04:25 (4940): No heartbeat from core client for 30 sec - exiting 09:04:26 (4940): No heartbeat from core client for 30 sec - exiting 09:04:27 (4940): No heartbeat from core client for 30 sec - exiting 09:04:28 (4940): No heartbeat from core client for 30 sec - exiting 09:04:29 (4940): No heartbeat from core client for 30 sec - exiting 09:04:31 (4940): No heartbeat from core client for 30 sec - exiting 09:04:32 (4940): No heartbeat from core client for 30 sec - exiting 09:04:33 (4940): No heartbeat from core client for 30 sec - exiting 09:04:34 (4940): No heartbeat from core client for 30 sec - exiting 09:04:35 (4940): No heartbeat from core client for 30 sec - exiting 09:04:36 (4940): No heartbeat from core client for 30 sec - exiting 09:04:37 (4940): No heartbeat from core client for 30 sec - exiting 09:04:38 (4940): No heartbeat from core client for 30 sec - exiting 09:04:39 (4940): No heartbeat from core client for 30 sec - exiting 09:04:40 (4940): No heartbeat from core client for 30 sec - exiting 09:04:41 (4940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:04:43 (4940): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5076, selfPID=5076, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:46:32 (2800): No heartbeat from core client for 30 sec - exiting 08:46:33 (2800): No heartbeat from core client for 30 sec - exiting 08:46:34 (2800): No heartbeat from core client for 30 sec - exiting 08:46:35 (2800): No heartbeat from core client for 30 sec - exiting 08:46:37 (2800): No heartbeat from core client for 30 sec - exiting 08:46:38 (2800): No heartbeat from core client for 30 sec - exiting 08:46:39 (2800): No heartbeat from core client for 30 sec - exiting 08:46:40 (2800): No heartbeat from core client for 30 sec - exiting 08:46:41 (2800): No heartbeat from core client for 30 sec - exiting 08:46:42 (2800): No heartbeat from core client for 30 sec - exiting 08:46:43 (2800): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:18:36 (4380): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6372, iMonCtr=2 21:52:47 (3684): No heartbeat from core client for 30 sec - exiting 21:52:48 (3684): No heartbeat from core client for 30 sec - exiting 21:52:49 (3684): No heartbeat from core client for 30 sec - exiting 21:52:50 (3684): No heartbeat from core client for 30 sec - exiting 21:52:52 (3684): No heartbeat from core client for 30 sec - exiting 21:52:53 (3684): No heartbeat from core client for 30 sec - exiting 21:52:54 (3684): No heartbeat from core client for 30 sec - exiting 21:52:55 (3684): No heartbeat from core client for 30 sec - exiting 21:52:56 (3684): No heartbeat from core client for 30 sec - exiting 21:52:57 (3684): No heartbeat from core client for 30 sec - exiting 21:52:58 (3684): No heartbeat from core client for 30 sec - exiting 21:52:59 (3684): No heartbeat from core client for 30 sec - exiting 21:53:00 (3684): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2872, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_anz_r587_2012_1_008736389_0_9.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_r587_2012_1_008736389_0_10.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_r587_2012_1_008736389_0_11.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_r587_2012_1_008736389_0_12.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
04 Jun 2014 16:17:17	1189308	16619927	hadam3p_anz_r587_2012_1_008736389_0	92,459	496,133	5.3660
03 Jun 2014 12:57:29	1189308	16619927	hadam3p_anz_r587_2012_1_008736389_0	80,939	434,596	5.3694
01 Jun 2014 13:29:35	1189308	16619927	hadam3p_anz_r587_2012_1_008736389_0	69,419	373,443	5.3796
30 May 2014 19:33:27	1189308	16619927	hadam3p_anz_r587_2012_1_008736389_0	57,899	312,420	5.3959
28 May 2014 12:34:59	1189308	16619927	hadam3p_anz_r587_2012_1_008736389_0	46,379	250,708	5.4056
25 May 2014 12:52:27	1189308	16619927	hadam3p_anz_r587_2012_1_008736389_0	34,859	188,304	5.4019
23 May 2014 21:34:04	1189308	16619927	hadam3p_anz_r587_2012_1_008736389_0	23,339	125,901	5.3944
18 May 2014 15:41:55	1189308	16619927	hadam3p_anz_r587_2012_1_008736389_0	11,819	63,440	5.3676