Task 19021335

Name	hadam3p_pnw_xdzb_2007_1_010346929_0
Workunit	10167854
Created	28 Sep 2015, 12:43:55 UTC
Sent	5 Oct 2015, 9:57:17 UTC
Report deadline	16 Sep 2016, 15:17:17 UTC
Received	29 Oct 2015, 7:31:36 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1330950
Run time	2 days 22 hours 6 min 11 sec
CPU time	2 days 18 hours 8 min 31 sec
Validate state	Invalid
Credit	2,259.34
Device peak FLOPS	3.30 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v7.27 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6440, selfPID=6440, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6984, selfPID=5584, iMonCtr=1 Model crash detected, will try to restart... 09:37:48 (7140): No heartbeat from client for 30 sec - exiting 09:37:48 (7140): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:43:28 (6316): No heartbeat from client for 30 sec - exiting 09:43:29 (6316): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:45:35 (6772): No heartbeat from client for 30 sec - exiting 09:45:35 (6772): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:52:26 (3256): No heartbeat from client for 30 sec - exiting 09:52:26 (3256): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9772, selfPID=9772, iMonCtr=2 11:33:54 (7748): No heartbeat from client for 30 sec - exiting 11:33:54 (7748): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:33:55 (7748): No heartbeat from client for 30 sec - exiting 11:33:55 (7748): timer handler: client dead, exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=12252, selfPID=12252, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 03:23:46 (7672): No heartbeat from client for 30 sec - exiting 03:23:46 (7672): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:43:10 (6544): No heartbeat from client for 30 sec - exiting 03:43:11 (6544): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:12:31 (5552): No heartbeat from client for 30 sec - exiting 04:12:31 (5552): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:39:08 (5080): No heartbeat from client for 30 sec - exiting 05:39:08 (5080): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 01:10:44 (2420): No heartbeat from client for 30 sec - exiting 01:10:44 (2420): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:21:22 (11976): No heartbeat from client for 30 sec - exiting 01:21:22 (11976): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 04:30:28 (9624): No heartbeat from client for 30 sec - exiting 04:30:29 (9624): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=10900, selfPID=10900, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=13808, selfPID=13808, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=10500, selfPID=10500, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=13256, selfPID=13256, iMonCtr=2 02:41:52 (15244): No heartbeat from client for 30 sec - exiting 02:41:53 (15244): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:00:37 (9440): No heartbeat from client for 30 sec - exiting 04:00:37 (9440): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:00:38 (9440): No heartbeat from client for 30 sec - exiting 04:00:38 (9440): timer handler: client dead, exiting CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7468, selfPID=7468, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 07:20:35 (15768): No heartbeat from client for 30 sec - exiting 07:20:36 (15768): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:20:37 (15768): No heartbeat from client for 30 sec - exiting 07:20:37 (15768): timer handler: client dead, exiting Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7588, selfPID=7588, iMonCtr=2 07:20:38 (15768): No heartbeat from client for 30 sec - exiting 07:20:38 (15768): timer handler: client dead, exiting 07:20:39 (15768): No heartbeat from client for 30 sec - exiting 07:20:39 (15768): timer handler: client dead, exiting 07:20:40 (15768): No heartbeat from client for 30 sec - exiting 07:20:40 (15768): timer handler: client dead, exiting 07:47:18 (15840): No heartbeat from client for 30 sec - exiting 07:47:18 (15840): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:47:19 (15840): No heartbeat from client for 30 sec - exiting 07:47:19 (15840): timer handler: client dead, exiting 08:04:30 (13640): No heartbeat from client for 30 sec - exiting 08:04:32 (13640): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:04:33 (13640): No heartbeat from client for 30 sec - exiting 08:04:33 (13640): timer handler: client dead, exiting 08:04:34 (13640): No heartbeat from client for 30 sec - exiting 08:04:34 (13640): timer handler: client dead, exiting 08:04:35 (13640): No heartbeat from client for 30 sec - exiting 08:04:35 (13640): timer handler: client dead, exiting 08:04:36 (13640): No heartbeat from client for 30 sec - exiting 08:04:36 (13640): timer handler: client dead, exiting 08:04:37 (13640): No heartbeat from client for 30 sec - exiting 08:04:37 (13640): timer handler: client dead, exiting 08:04:38 (13640): No heartbeat from client for 30 sec - exiting 08:04:38 (13640): timer handler: client dead, exiting 08:04:39 (13640): No heartbeat from client for 30 sec - exiting 08:04:39 (13640): timer handler: client dead, exiting 08:04:40 (13640): No heartbeat from client for 30 sec - exiting 08:04:40 (13640): timer handler: client dead, exiting 08:04:41 (13640): No heartbeat from client for 30 sec - exiting 08:04:41 (13640): timer handler: client dead, exiting 08:06:50 (15944): No heartbeat from client for 30 sec - exiting 08:06:50 (15944): timer handler: client dead, exiting 08:06:51 (15944): No heartbeat from client for 30 sec - exiting 08:06:51 (15944): timer handler: client dead, exiting 08:06:52 (15944): No heartbeat from client for 30 sec - exiting 08:06:52 (15944): timer handler: client dead, exiting 08:06:53 (15944): No heartbeat from client for 30 sec - exiting 08:06:53 (15944): timer handler: client dead, exiting 08:06:54 (15944): No heartbeat from client for 30 sec - exiting 08:06:54 (15944): timer handler: client dead, exiting 08:06:55 (15944): No heartbeat from client for 30 sec - exiting 08:06:55 (15944): timer handler: client dead, exiting 08:06:56 (15944): No heartbeat from client for 30 sec - exiting 08:06:56 (15944): timer handler: client dead, exiting 08:06:57 (15944): No heartbeat from client for 30 sec - exiting 08:06:57 (15944): timer handler: client dead, exiting 08:06:58 (15944): No heartbeat from client for 30 sec - exiting 08:06:58 (15944): timer handler: client dead, exiting 08:06:59 (15944): No heartbeat from client for 30 sec - exiting 08:06:59 (15944): timer handler: client dead, exiting 08:07:00 (15944): No heartbeat from client for 30 sec - exiting 08:07:00 (15944): timer handler: client dead, exiting 08:07:01 (15944): No heartbeat from client for 30 sec - exiting 08:07:01 (15944): timer handler: client dead, exiting 08:07:02 (15944): No heartbeat from client for 30 sec - exiting 08:07:02 (15944): timer handler: client dead, exiting 08:07:03 (15944): No heartbeat from client for 30 sec - exiting 08:07:03 (15944): timer handler: client dead, exiting 08:07:04 (15944): No heartbeat from client for 30 sec - exiting 08:07:04 (15944): timer handler: client dead, exiting 08:07:05 (15944): No heartbeat from client for 30 sec - exiting 08:07:05 (15944): timer handler: client dead, exiting 08:07:06 (15944): No heartbeat from client for 30 sec - exiting 08:07:06 (15944): timer handler: client dead, exiting 08:07:07 (15944): No heartbeat from client for 30 sec - exiting 08:07:07 (15944): timer handler: client dead, exiting 08:07:08 (15944): No heartbeat from client for 30 sec - exiting 08:07:08 (15944): timer handler: client dead, exiting 08:07:09 (15944): No heartbeat from client for 30 sec - exiting 08:07:09 (15944): timer handler: client dead, exiting 08:07:10 (15944): No heartbeat from client for 30 sec - exiting 08:07:10 (15944): timer handler: client dead, exiting 08:07:11 (15944): No heartbeat from client for 30 sec - exiting 08:07:11 (15944): timer handler: client dead, exiting 08:07:12 (15944): No heartbeat from client for 30 sec - exiting 08:07:12 (15944): timer handler: client dead, exiting 08:07:13 (15944): No heartbeat from client for 30 sec - exiting 08:07:13 (15944): timer handler: client dead, exiting 08:07:14 (15944): No heartbeat from client for 30 sec - exiting 08:07:14 (15944): timer handler: client dead, exiting 08:07:15 (15944): No heartbeat from client for 30 sec - exiting 08:07:15 (15944): timer handler: client dead, exiting 08:07:16 (15944): No heartbeat from client for 30 sec - exiting 08:07:16 (15944): timer handler: client dead, exiting 08:07:17 (15944): No heartbeat from client for 30 sec - exiting 08:07:17 (15944): timer handler: client dead, exiting 08:07:18 (15944): No heartbeat from client for 30 sec - exiting 08:07:18 (15944): timer handler: client dead, exiting 08:07:19 (15944): No heartbeat from client for 30 sec - exiting 08:07:19 (15944): timer handler: client dead, exiting 08:07:20 (15944): No heartbeat from client for 30 sec - exiting 08:07:20 (15944): timer handler: client dead, exiting 08:07:21 (15944): No heartbeat from client for 30 sec - exiting 08:07:21 (15944): timer handler: client dead, exiting 08:07:22 (15944): No heartbeat from client for 30 sec - exiting 08:07:22 (15944): timer handler: client dead, exiting 08:07:23 (15944): No heartbeat from client for 30 sec - exiting 08:07:23 (15944): timer handler: client dead, exiting 08:07:24 (15944): No heartbeat from client for 30 sec - exiting 08:07:24 (15944): timer handler: client dead, exiting 08:07:25 (15944): No heartbeat from client for 30 sec - exiting 08:07:25 (15944): timer handler: client dead, exiting 08:07:26 (15944): No heartbeat from client for 30 sec - exiting 08:07:26 (15944): timer handler: client dead, exiting 08:07:27 (15944): No heartbeat from client for 30 sec - exiting 08:07:27 (15944): timer handler: client dead, exiting 08:07:28 (15944): No heartbeat from client for 30 sec - exiting 08:07:28 (15944): timer handler: client dead, exiting 08:07:29 (15944): No heartbeat from client for 30 sec - exiting 08:07:29 (15944): timer handler: client dead, exiting 08:07:30 (15944): No heartbeat from client for 30 sec - exiting 08:07:30 (15944): timer handler: client dead, exiting 08:07:31 (15944): No heartbeat from client for 30 sec - exiting 08:07:31 (15944): timer handler: client dead, exiting 08:07:32 (15944): No heartbeat from client for 30 sec - exiting 08:07:32 (15944): timer handler: client dead, exiting 08:07:33 (15944): No heartbeat from client for 30 sec - exiting 08:07:33 (15944): timer handler: client dead, exiting 08:07:34 (15944): No heartbeat from client for 30 sec - exiting 08:07:34 (15944): timer handler: client dead, exiting 08:07:35 (15944): No heartbeat from client for 30 sec - exiting 08:07:35 (15944): timer handler: client dead, exiting 08:07:36 (15944): No heartbeat from client for 30 sec - exiting 08:07:37 (15944): timer handler: client dead, exiting 08:07:38 (15944): No heartbeat from client for 30 sec - exiting 08:07:38 (15944): timer handler: client dead, exiting 08:07:39 (15944): No heartbeat from client for 30 sec - exiting 08:07:39 (15944): timer handler: client dead, exiting 08:07:40 (15944): No heartbeat from client for 30 sec - exiting 08:07:40 (15944): timer handler: client dead, exiting 08:07:41 (15944): No heartbeat from client for 30 sec - exiting 08:07:41 (15944): timer handler: client dead, exiting 08:07:42 (15944): No heartbeat from client for 30 sec - exiting 08:07:42 (15944): timer handler: client dead, exiting 08:07:43 (15944): No heartbeat from client for 30 sec - exiting 08:07:43 (15944): timer handler: client dead, exiting 08:07:44 (15944): No heartbeat from client for 30 sec - exiting 08:07:44 (15944): timer handler: client dead, exiting 08:07:45 (15944): No heartbeat from client for 30 sec - exiting 08:07:45 (15944): timer handler: client dead, exiting 08:07:46 (15944): No heartbeat from client for 30 sec - exiting 08:07:46 (15944): timer handler: client dead, exiting 08:07:47 (15944): No heartbeat from client for 30 sec - exiting 08:07:47 (15944): timer handler: client dead, exiting 08:07:48 (15944): No heartbeat from client for 30 sec - exiting 08:07:48 (15944): timer handler: client dead, exiting 08:07:49 (15944): No heartbeat from client for 30 sec - exiting 08:07:49 (15944): timer handler: client dead, exiting 08:07:50 (15944): No heartbeat from client for 30 sec - exiting 08:07:50 (15944): timer handler: client dead, exiting 08:07:51 (15944): No heartbeat from client for 30 sec - exiting 08:07:51 (15944): timer handler: client dead, exiting 08:07:52 (15944): No heartbeat from client for 30 sec - exiting 08:07:52 (15944): timer handler: client dead, exiting 08:07:53 (15944): No heartbeat from client for 30 sec - exiting 08:07:53 (15944): timer handler: client dead, exiting 08:07:54 (15944): No heartbeat from client for 30 sec - exiting 08:07:54 (15944): timer handler: client dead, exiting 08:07:55 (15944): No heartbeat from client for 30 sec - exiting 08:07:55 (15944): timer handler: client dead, exiting 08:07:56 (15944): No heartbeat from client for 30 sec - exiting 08:07:56 (15944): timer handler: client dead, exiting 08:07:57 (15944): No heartbeat from client for 30 sec - exiting 08:07:57 (15944): timer handler: client dead, exiting 08:07:58 (15944): No heartbeat from client for 30 sec - exiting 08:07:58 (15944): timer handler: client dead, exiting 08:07:59 (15944): No heartbeat from client for 30 sec - exiting 08:07:59 (15944): timer handler: client dead, exiting 08:08:00 (15944): No heartbeat from client for 30 sec - exiting 08:08:00 (15944): timer handler: client dead, exiting 08:08:01 (15944): No heartbeat from client for 30 sec - exiting 08:08:01 (15944): timer handler: client dead, exiting 08:08:02 (15944): No heartbeat from client for 30 sec - exiting 08:08:02 (15944): timer handler: client dead, exiting 08:08:03 (15944): No heartbeat from client for 30 sec - exiting 08:08:03 (15944): timer handler: client dead, exiting 08:08:04 (15944): No heartbeat from client for 30 sec - exiting 08:08:04 (15944): timer handler: client dead, exiting 08:08:05 (15944): No heartbeat from client for 30 sec - exiting 08:08:05 (15944): timer handler: client dead, exiting 08:08:06 (15944): No heartbeat from client for 30 sec - exiting 08:08:06 (15944): timer handler: client dead, exiting 08:08:07 (15944): No heartbeat from client for 30 sec - exiting 08:08:07 (15944): timer handler: client dead, exiting 08:08:08 (15944): No heartbeat from client for 30 sec - exiting 08:08:08 (15944): timer handler: client dead, exiting 08:08:09 (15944): No heartbeat from client for 30 sec - exiting 08:08:09 (15944): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 14:52:28 (13320): No heartbeat from client for 30 sec - exiting 14:52:28 (13320): timer handler: client dead, exiting 14:52:29 (13320): No heartbeat from client for 30 sec - exiting 14:52:29 (13320): timer handler: client dead, exiting 14:52:30 (13320): No heartbeat from client for 30 sec - exiting 14:52:30 (13320): timer handler: client dead, exiting 14:52:31 (13320): No heartbeat from client for 30 sec - exiting 14:52:31 (13320): timer handler: client dead, exiting 14:52:32 (13320): No heartbeat from client for 30 sec - exiting 14:52:32 (13320): timer handler: client dead, exiting 14:52:33 (13320): No heartbeat from client for 30 sec - exiting 14:52:33 (13320): timer handler: client dead, exiting 14:52:34 (13320): No heartbeat from client for 30 sec - exiting 14:52:34 (13320): timer handler: client dead, exiting 14:52:35 (13320): No heartbeat from client for 30 sec - exiting 14:52:35 (13320): timer handler: client dead, exiting 14:52:36 (13320): No heartbeat from client for 30 sec - exiting 14:52:36 (13320): timer handler: client dead, exiting 14:52:37 (13320): No heartbeat from client for 30 sec - exiting 14:52:37 (13320): timer handler: client dead, exiting 14:52:38 (13320): No heartbeat from client for 30 sec - exiting 14:52:38 (13320): timer handler: client dead, exiting 14:52:39 (13320): No heartbeat from client for 30 sec - exiting 14:52:39 (13320): timer handler: client dead, exiting 14:52:40 (13320): No heartbeat from client for 30 sec - exiting 14:52:40 (13320): timer handler: client dead, exiting 14:52:41 (13320): No heartbeat from client for 30 sec - exiting 14:52:41 (13320): timer handler: client dead, exiting 14:52:42 (13320): No heartbeat from client for 30 sec - exiting 14:52:42 (13320): timer handler: client dead, exiting 14:52:43 (13320): No heartbeat from client for 30 sec - exiting 14:52:43 (13320): timer handler: client dead, exiting 14:52:44 (13320): No heartbeat from client for 30 sec - exiting 14:52:44 (13320): timer handler: client dead, exiting 14:52:45 (13320): No heartbeat from client for 30 sec - exiting 14:52:45 (13320): timer handler: client dead, exiting 14:52:46 (13320): No heartbeat from client for 30 sec - exiting 14:52:46 (13320): timer handler: client dead, exiting 14:52:47 (13320): No heartbeat from client for 30 sec - exiting 14:52:47 (13320): timer handler: client dead, exiting 14:52:48 (13320): No heartbeat from client for 30 sec - exiting 14:52:48 (13320): timer handler: client dead, exiting 14:52:49 (13320): No heartbeat from client for 30 sec - exiting 14:52:49 (13320): timer handler: client dead, exiting 14:52:50 (13320): No heartbeat from client for 30 sec - exiting 14:52:50 (13320): timer handler: client dead, exiting 14:52:51 (13320): No heartbeat from client for 30 sec - exiting 14:52:51 (13320): timer handler: client dead, exiting 14:52:52 (13320): No heartbeat from client for 30 sec - exiting 14:52:52 (13320): timer handler: client dead, exiting 14:52:53 (13320): No heartbeat from client for 30 sec - exiting 14:52:53 (13320): timer handler: client dead, exiting 14:52:54 (13320): No heartbeat from client for 30 sec - exiting 14:52:54 (13320): timer handler: client dead, exiting 14:52:55 (13320): No heartbeat from client for 30 sec - exiting 14:52:55 (13320): timer handler: client dead, exiting 14:52:56 (13320): No heartbeat from client for 30 sec - exiting 14:52:56 (13320): timer handler: client dead, exiting 14:52:57 (13320): No heartbeat from client for 30 sec - exiting 14:52:57 (13320): timer handler: client dead, exiting 14:52:58 (13320): No heartbeat from client for 30 sec - exiting 14:52:58 (13320): timer handler: client dead, exiting 14:52:59 (13320): No heartbeat from client for 30 sec - exiting 14:53:00 (13320): timer handler: client dead, exiting 14:53:01 (13320): No heartbeat from client for 30 sec - exiting 14:53:01 (13320): timer handler: client dead, exiting 14:53:02 (13320): No heartbeat from client for 30 sec - exiting 14:53:02 (13320): timer handler: client dead, exiting 14:53:03 (13320): No heartbeat from client for 30 sec - exiting 14:53:03 (13320): timer handler: client dead, exiting 14:53:04 (13320): No heartbeat from client for 30 sec - exiting 14:53:04 (13320): timer handler: client dead, exiting 14:53:05 (13320): No heartbeat from client for 30 sec - exiting 14:53:05 (13320): timer handler: client dead, exiting 14:53:06 (13320): No heartbeat from client for 30 sec - exiting 14:53:06 (13320): timer handler: client dead, exiting 14:53:07 (13320): No heartbeat from client for 30 sec - exiting 14:53:07 (13320): timer handler: client dead, exiting 14:53:08 (13320): No heartbeat from client for 30 sec - exiting 14:53:08 (13320): timer handler: client dead, exiting 14:53:09 (13320): No heartbeat from client for 30 sec - exiting 14:53:09 (13320): timer handler: client dead, exiting 14:53:10 (13320): No heartbeat from client for 30 sec - exiting 14:53:10 (13320): timer handler: client dead, exiting 14:53:11 (13320): No heartbeat from client for 30 sec - exiting 14:53:11 (13320): timer handler: client dead, exiting 14:53:12 (13320): No heartbeat from client for 30 sec - exiting 14:53:12 (13320): timer handler: client dead, exiting 14:53:13 (13320): No heartbeat from client for 30 sec - exiting 14:53:13 (13320): timer handler: client dead, exiting 14:53:14 (13320): No heartbeat from client for 30 sec - exiting 14:53:14 (13320): timer handler: client dead, exiting 14:53:15 (13320): No heartbeat from client for 30 sec - exiting 14:53:15 (13320): timer handler: client dead, exiting 14:53:16 (13320): No heartbeat from client for 30 sec - exiting 14:53:16 (13320): timer handler: client dead, exiting 14:53:17 (13320): No heartbeat from client for 30 sec - exiting 14:53:17 (13320): timer handler: client dead, exiting 14:53:18 (13320): No heartbeat from client for 30 sec - exiting 14:53:18 (13320): timer handler: client dead, exiting 14:53:19 (13320): No heartbeat from client for 30 sec - exiting 14:53:19 (13320): timer handler: client dead, exiting 14:53:20 (13320): No heartbeat from client for 30 sec - exiting 14:53:20 (13320): timer handler: client dead, exiting 14:53:21 (13320): No heartbeat from client for 30 sec - exiting 14:53:21 (13320): timer handler: client dead, exiting 14:53:22 (13320): No heartbeat from client for 30 sec - exiting 14:53:22 (13320): timer handler: client dead, exiting 14:53:23 (13320): No heartbeat from client for 30 sec - exiting 14:53:23 (13320): timer handler: client dead, exiting 14:53:24 (13320): No heartbeat from client for 30 sec - exiting 14:53:24 (13320): timer handler: client dead, exiting 14:53:25 (13320): No heartbeat from client for 30 sec - exiting 14:53:25 (13320): timer handler: client dead, exiting 14:53:26 (13320): No heartbeat from client for 30 sec - exiting 14:53:26 (13320): timer handler: client dead, exiting 14:53:27 (13320): No heartbeat from client for 30 sec - exiting 14:53:27 (13320): timer handler: client dead, exiting 14:53:28 (13320): No heartbeat from client for 30 sec - exiting 14:53:28 (13320): timer handler: client dead, exiting 14:53:29 (13320): No heartbeat from client for 30 sec - exiting 14:53:29 (13320): timer handler: client dead, exiting 14:53:30 (13320): No heartbeat from client for 30 sec - exiting 14:53:30 (13320): timer handler: client dead, exiting 14:53:31 (13320): No heartbeat from client for 30 sec - exiting 14:53:31 (13320): timer handler: client dead, exiting 14:53:32 (13320): No heartbeat from client for 30 sec - exiting 14:53:32 (13320): timer handler: client dead, exiting 14:53:33 (13320): No heartbeat from client for 30 sec - exiting 14:53:33 (13320): timer handler: client dead, exiting 14:53:34 (13320): No heartbeat from client for 30 sec - exiting 14:53:34 (13320): timer handler: client dead, exiting 14:53:35 (13320): No heartbeat from client for 30 sec - exiting 14:53:35 (13320): timer handler: client dead, exiting 14:53:36 (13320): No heartbeat from client for 30 sec - exiting 14:53:36 (13320): timer handler: client dead, exiting 14:53:37 (13320): No heartbeat from client for 30 sec - exiting 14:53:38 (13320): timer handler: client dead, exiting 14:53:39 (13320): No heartbeat from client for 30 sec - exiting 14:53:39 (13320): timer handler: client dead, exiting 14:53:40 (13320): No heartbeat from client for 30 sec - exiting 14:53:40 (13320): timer handler: client dead, exiting 14:53:41 (13320): No heartbeat from client for 30 sec - exiting 14:53:41 (13320): timer handler: client dead, exiting 14:53:42 (13320): No heartbeat from client for 30 sec - exiting 14:53:42 (13320): timer handler: client dead, exiting 14:53:43 (13320): No heartbeat from client for 30 sec - exiting 14:53:43 (13320): timer handler: client dead, exiting 14:53:44 (13320): No heartbeat from client for 30 sec - exiting 14:53:44 (13320): timer handler: client dead, exiting 14:53:45 (13320): No heartbeat from client for 30 sec - exiting 14:53:46 (13320): timer handler: client dead, exiting 14:53:47 (13320): No heartbeat from client for 30 sec - exiting 14:53:47 (13320): timer handler: client dead, exiting 14:53:48 (13320): No heartbeat from client for 30 sec - exiting 14:53:48 (13320): timer handler: client dead, exiting 14:53:49 (13320): No heartbeat from client for 30 sec - exiting 14:53:49 (13320): timer handler: client dead, exiting 14:53:50 (13320): No heartbeat from client for 30 sec - exiting 14:53:50 (13320): timer handler: client dead, exiting 14:53:51 (13320): No heartbeat from client for 30 sec - exiting 14:53:51 (13320): timer handler: client dead, exiting 14:53:52 (13320): No heartbeat from client for 30 sec - exiting 14:53:52 (13320): timer handler: client dead, exiting 14:53:53 (13320): No heartbeat from client for 30 sec - exiting 14:53:53 (13320): timer handler: client dead, exiting 14:53:54 (13320): No heartbeat from client for 30 sec - exiting 14:53:54 (13320): timer handler: client dead, exiting 14:53:55 (13320): No heartbeat from client for 30 sec - exiting 14:53:55 (13320): timer handler: client dead, exiting 14:53:56 (13320): No heartbeat from client for 30 sec - exiting 14:53:56 (13320): timer handler: client dead, exiting 14:53:57 (13320): No heartbeat from client for 30 sec - exiting 14:53:57 (13320): timer handler: client dead, exiting 14:53:58 (13320): No heartbeat from client for 30 sec - exiting 14:53:58 (13320): timer handler: client dead, exiting 14:53:59 (13320): No heartbeat from client for 30 sec - exiting 14:53:59 (13320): timer handler: client dead, exiting 14:54:00 (13320): No heartbeat from client for 30 sec - exiting 14:54:00 (13320): timer handler: client dead, exiting 14:54:01 (13320): No heartbeat from client for 30 sec - exiting 14:54:01 (13320): timer handler: client dead, exiting 14:54:02 (13320): No heartbeat from client for 30 sec - exiting 14:54:02 (13320): timer handler: client dead, exiting 14:54:03 (13320): No heartbeat from client for 30 sec - exiting 14:54:03 (13320): timer handler: client dead, exiting 14:54:04 (13320): No heartbeat from client for 30 sec - exiting 14:54:04 (13320): timer handler: client dead, exiting 14:54:05 (13320): No heartbeat from client for 30 sec - exiting 14:54:05 (13320): timer handler: client dead, exiting 14:54:06 (13320): No heartbeat from client for 30 sec - exiting 14:54:06 (13320): timer handler: client dead, exiting 14:54:07 (13320): No heartbeat from client for 30 sec - exiting 14:54:07 (13320): timer handler: client dead, exiting 14:54:08 (13320): No heartbeat from client for 30 sec - exiting 14:54:08 (13320): timer handler: client dead, exiting 14:54:09 (13320): No heartbeat from client for 30 sec - exiting 14:54:09 (13320): timer handler: client dead, exiting 14:54:10 (13320): No heartbeat from client for 30 sec - exiting 14:54:10 (13320): timer handler: client dead, exiting 14:54:11 (13320): No heartbeat from client for 30 sec - exiting 14:54:11 (13320): timer handler: client dead, exiting 14:54:12 (13320): No heartbeat from client for 30 sec - exiting 14:54:12 (13320): timer handler: client dead, exiting 14:54:13 (13320): No heartbeat from client for 30 sec - exiting 14:54:13 (13320): timer handler: client dead, exiting 14:54:14 (13320): No heartbeat from client for 30 sec - exiting 14:54:14 (13320): timer handler: client dead, exiting 14:54:15 (13320): No heartbeat from client for 30 sec - exiting 14:54:15 (13320): timer handler: client dead, exiting 14:54:16 (13320): No heartbeat from client for 30 sec - exiting 14:54:16 (13320): timer handler: client dead, exiting 14:54:17 (13320): No heartbeat from client for 30 sec - exiting 14:54:17 (13320): timer handler: client dead, exiting 14:54:18 (13320): No heartbeat from client for 30 sec - exiting 14:54:18 (13320): timer handler: client dead, exiting 14:54:19 (13320): No heartbeat from client for 30 sec - exiting 14:54:19 (13320): timer handler: client dead, exiting 14:54:20 (13320): No heartbeat from client for 30 sec - exiting 14:54:20 (13320): timer handler: client dead, exiting 14:54:21 (13320): No heartbeat from client for 30 sec - exiting 14:54:21 (13320): timer handler: client dead, exiting 14:54:22 (13320): No heartbeat from client for 30 sec - exiting 14:54:22 (13320): timer handler: client dead, exiting 14:54:23 (13320): No heartbeat from client for 30 sec - exiting 14:54:23 (13320): timer handler: client dead, exiting 14:54:24 (13320): No heartbeat from client for 30 sec - exiting 14:54:24 (13320): timer handler: client dead, exiting 14:54:25 (13320): No heartbeat from client for 30 sec - exiting 14:54:25 (13320): timer handler: client dead, exiting 14:54:26 (13320): No heartbeat from client for 30 sec - exiting 14:54:26 (13320): timer handler: client dead, exiting 14:54:27 (13320): No heartbeat from client for 30 sec - exiting 14:54:27 (13320): timer handler: client dead, exiting 14:54:28 (13320): No heartbeat from client for 30 sec - exiting 14:54:28 (13320): timer handler: client dead, exiting 14:54:29 (13320): No heartbeat from client for 30 sec - exiting 14:54:29 (13320): timer handler: client dead, exiting 14:54:30 (13320): No heartbeat from client for 30 sec - exiting 14:54:30 (13320): timer handler: client dead, exiting 14:54:31 (13320): No heartbeat from client for 30 sec - exiting 14:54:31 (13320): timer handler: client dead, exiting 14:54:32 (13320): No heartbeat from client for 30 sec - exiting 14:54:32 (13320): timer handler: client dead, exiting 14:54:33 (13320): No heartbeat from client for 30 sec - exiting 14:54:33 (13320): timer handler: client dead, exiting 14:54:34 (13320): No heartbeat from client for 30 sec - exiting 14:54:34 (13320): timer handler: client dead, exiting 14:54:35 (13320): No heartbeat from client for 30 sec - exiting 14:54:35 (13320): timer handler: client dead, exiting 14:54:36 (13320): No heartbeat from client for 30 sec - exiting 14:54:36 (13320): timer handler: client dead, exiting 14:54:37 (13320): No heartbeat from client for 30 sec - exiting 14:54:37 (13320): timer handler: client dead, exiting 14:54:38 (13320): No heartbeat from client for 30 sec - exiting 14:54:38 (13320): timer handler: client dead, exiting 14:54:39 (13320): No heartbeat from client for 30 sec - exiting 14:54:39 (13320): timer handler: client dead, exiting 14:54:40 (13320): No heartbeat from client for 30 sec - exiting 14:54:40 (13320): timer handler: client dead, exiting 14:54:41 (13320): No heartbeat from client for 30 sec - exiting 14:54:41 (13320): timer handler: client dead, exiting 14:54:42 (13320): No heartbeat from client for 30 sec - exiting 14:54:42 (13320): timer handler: client dead, exiting 14:54:43 (13320): No heartbeat from client for 30 sec - exiting 14:54:43 (13320): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:57:01 (13980): No heartbeat from client for 30 sec - exiting 14:57:01 (13980): timer handler: client dead, exiting 14:57:02 (13980): No heartbeat from client for 30 sec - exiting 14:57:02 (13980): timer handler: client dead, exiting 14:57:03 (13980): No heartbeat from client for 30 sec - exiting 14:57:03 (13980): timer handler: client dead, exiting 14:57:04 (13980): No heartbeat from client for 30 sec - exiting 14:57:04 (13980): timer handler: client dead, exiting 14:58:31 (13980): No heartbeat from client for 30 sec - exiting 14:58:31 (13980): timer handler: client dead, exiting 14:58:32 (13980): No heartbeat from client for 30 sec - exiting 14:58:32 (13980): timer handler: client dead, exiting Signal 11 received, exiting... 15:03:28 (11312): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=11928, selfPID=9980, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 15:04:27 (9980): called boinc_finish(0) </stderr_txt> <message> <file_xfer_error> <file_name>hadam3p_pnw_xdzb_2007_1_010346929_0_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_xdzb_2007_1_010346929_0_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_xdzb_2007_1_010346929_0_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
26 Oct 2015 16:52:37	1330950	19021335	hadam3p_pnw_xdzb_2007_1_010346929_0	103,979	219,384	2.1099
26 Oct 2015 16:52:37	1330950	19021335	hadam3p_pnw_xdzb_2007_1_010346929_0	92,459	195,210	2.1113
26 Oct 2015 16:52:37	1330950	19021335	hadam3p_pnw_xdzb_2007_1_010346929_0	80,939	171,076	2.1136
26 Oct 2015 16:52:37	1330950	19021335	hadam3p_pnw_xdzb_2007_1_010346929_0	69,419	146,912	2.1163
26 Oct 2015 16:52:37	1330950	19021335	hadam3p_pnw_xdzb_2007_1_010346929_0	57,899	122,169	2.1100
26 Oct 2015 16:52:37	1330950	19021335	hadam3p_pnw_xdzb_2007_1_010346929_0	46,379	97,571	2.1038
26 Oct 2015 16:52:37	1330950	19021335	hadam3p_pnw_xdzb_2007_1_010346929_0	34,859	73,957	2.1216
26 Oct 2015 16:52:37	1330950	19021335	hadam3p_pnw_xdzb_2007_1_010346929_0	23,339	49,936	2.1396
13 Oct 2015 20:49:29	1330950	19021335	hadam3p_pnw_xdzb_2007_1_010346929_0	11,819	25,123	2.1256