Task 15737331

Name	hadam3p_pnw_q7ud_2047_1_008353566_0
Workunit	8504425
Created	19 Apr 2013, 16:27:26 UTC
Sent	20 Apr 2013, 9:37:25 UTC
Report deadline	2 Apr 2014, 14:57:25 UTC
Received	30 Jul 2013, 9:26:02 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1229569
Run time	6 days 8 hours 53 min 29 sec
CPU time	4 days 11 hours 9 min 35 sec
Validate state	Workunit error - check skipped
Credit	3,005.88
Device peak FLOPS	2.36 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v6.09 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:04:26 (7940): No heartbeat from core client for 30 sec - exiting 06:04:27 (7940): No heartbeat from core client for 30 sec - exiting 06:04:28 (7940): No heartbeat from core client for 30 sec - exiting 06:04:29 (7940): No heartbeat from core client for 30 sec - exiting 06:04:30 (7940): No heartbeat from core client for 30 sec - exiting 06:04:31 (7940): No heartbeat from core client for 30 sec - exiting 06:04:32 (7940): No heartbeat from core client for 30 sec - exiting 06:04:33 (7940): No heartbeat from core client for 30 sec - exiting 06:04:34 (7940): No heartbeat from core client for 30 sec - exiting 06:04:35 (7940): No heartbeat from core client for 30 sec - exiting 06:04:36 (7940): No heartbeat from core client for 30 sec - exiting 06:04:38 (7940): No heartbeat from core client for 30 sec - exiting 06:04:39 (7940): No heartbeat from core client for 30 sec - exiting 06:04:40 (7940): No heartbeat from core client for 30 sec - exiting 06:04:41 (7940): No heartbeat from core client for 30 sec - exiting 06:04:42 (7940): No heartbeat from core client for 30 sec - exiting 06:04:43 (7940): No heartbeat from core client for 30 sec - exiting 06:04:44 (7940): No heartbeat from core client for 30 sec - exiting 06:04:46 (7940): No heartbeat from core client for 30 sec - exiting 06:04:47 (7940): No heartbeat from core client for 30 sec - exiting 06:04:48 (7940): No heartbeat from core client for 30 sec - exiting 06:04:49 (7940): No heartbeat from core client for 30 sec - exiting 06:04:50 (7940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 02:38:46 (12660): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8156, selfPID=7304, iMonCtr=1 Model crash detected, will try to restart... 06:50:51 (2356): No heartbeat from core client for 30 sec - exiting 06:50:52 (2356): No heartbeat from core client for 30 sec - exiting 06:50:53 (2356): No heartbeat from core client for 30 sec - exiting 06:50:55 (2356): No heartbeat from core client for 30 sec - exiting 06:50:56 (2356): No heartbeat from core client for 30 sec - exiting 06:50:57 (2356): No heartbeat from core client for 30 sec - exiting 06:50:58 (2356): No heartbeat from core client for 30 sec - exiting 06:50:59 (2356): No heartbeat from core client for 30 sec - exiting 06:51:00 (2356): No heartbeat from core client for 30 sec - exiting 06:51:01 (2356): No heartbeat from core client for 30 sec - exiting 06:51:02 (2356): No heartbeat from core client for 30 sec - exiting 06:51:03 (2356): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:33:56 (2344): No heartbeat from core client for 30 sec - exiting 00:33:57 (2344): No heartbeat from core client for 30 sec - exiting 00:33:58 (2344): No heartbeat from core client for 30 sec - exiting 00:33:59 (2344): No heartbeat from core client for 30 sec - exiting 00:34:00 (2344): No heartbeat from core client for 30 sec - exiting 00:34:01 (2344): No heartbeat from core client for 30 sec - exiting 00:34:02 (2344): No heartbeat from core client for 30 sec - exiting 00:34:03 (2344): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4576, iMonCtr=2 Model crash detected, will try to restart... 06:00:35 (8016): No heartbeat from core client for 30 sec - exiting 06:00:37 (8016): No heartbeat from core client for 30 sec - exiting 06:00:38 (8016): No heartbeat from core client for 30 sec - exiting 06:00:39 (8016): No heartbeat from core client for 30 sec - exiting 06:00:40 (8016): No heartbeat from core client for 30 sec - exiting 06:00:41 (8016): No heartbeat from core client for 30 sec - exiting 06:00:42 (8016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 01:50:32 (10100): No heartbeat from core client for 30 sec - exiting 01:50:33 (10100): No heartbeat from core client for 30 sec - exiting 01:50:34 (10100): No heartbeat from core client for 30 sec - exiting 01:50:35 (10100): No heartbeat from core client for 30 sec - exiting 01:50:36 (10100): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:33:29 (4068): No heartbeat from core client for 30 sec - exiting 00:33:30 (4068): No heartbeat from core client for 30 sec - exiting 00:33:31 (4068): No heartbeat from core client for 30 sec - exiting 00:33:32 (4068): No heartbeat from core client for 30 sec - exiting 00:33:33 (4068): No heartbeat from core client for 30 sec - exiting 00:33:34 (4068): No heartbeat from core client for 30 sec - exiting 00:33:35 (4068): No heartbeat from core client for 30 sec - exiting 00:33:36 (4068): No heartbeat from core client for 30 sec - exiting 00:33:37 (4068): No heartbeat from core client for 30 sec - exiting 00:33:38 (4068): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... GCPDN Monitor - Quit request from BOINC... 02:10:15 (7244): No heartbeat from core client for 30 sec - exiting 02:10:16 (7244): No heartbeat from core client for 30 sec - exiting 02:10:17 (7244): No heartbeat from core client for 30 sec - exiting 02:10:18 (7244): No heartbeat from core client for 30 sec - exiting 02:10:19 (7244): No heartbeat from core client for 30 sec - exiting 02:10:20 (7244): No heartbeat from core client for 30 sec - exiting 02:10:21 (7244): No heartbeat from core client for 30 sec - exiting 02:10:22 (7244): No heartbeat from core client for 30 sec - exiting 02:10:23 (7244): No heartbeat from core client for 30 sec - exiting 02:10:24 (7244): No heartbeat from core client for 30 sec - exiting 02:10:25 (7244): No heartbeat from core client for 30 sec - exiting 02:10:26 (7244): No heartbeat from core client for 30 sec - exiting 02:10:27 (7244): No heartbeat from core client for 30 sec - exiting 02:10:28 (7244): No heartbeat from core client for 30 sec - exiting 02:10:29 (7244): No heartbeat from core client for 30 sec - exiting 02:10:30 (7244): No heartbeat from core client for 30 sec - exiting 02:10:31 (7244): No heartbeat from core client for 30 sec - exiting 02:10:32 (7244): No heartbeat from core client for 30 sec - exiting 02:10:33 (7244): No heartbeat from core client for 30 sec - exiting 02:10:34 (7244): No heartbeat from core client for 30 sec - exiting 02:10:35 (7244): No heartbeat from core client for 30 sec - exiting 02:10:36 (7244): No heartbeat from core client for 30 sec - exiting 02:10:37 (7244): No heartbeat from core client for 30 sec - exiting 02:10:38 (7244): No heartbeat from core client for 30 sec - exiting 02:10:39 (7244): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:10:40 (7244): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4436, selfPID=7432, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7096, selfPID=7096, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8532, selfPID=8152, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 04:34:44 (6568): No heartbeat from core client for 30 sec - exiting 04:34:45 (6568): No heartbeat from core client for 30 sec - exiting 04:34:46 (6568): No heartbeat from core client for 30 sec - exiting 04:34:47 (6568): No heartbeat from core client for 30 sec - exiting 04:34:48 (6568): No heartbeat from core client for 30 sec - exiting 04:34:49 (6568): No heartbeat from core client for 30 sec - exiting 04:34:51 (6568): No heartbeat from core client for 30 sec - exiting 04:34:52 (6568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1412, selfPID=4500, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=12136, selfPID=12136, iMonCtr=2 01:06:52 (6716): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 05:00:15 (7104): No heartbeat from core client for 30 sec - exiting 05:00:16 (7104): No heartbeat from core client for 30 sec - exiting 05:00:17 (7104): No heartbeat from core client for 30 sec - exiting 05:00:18 (7104): No heartbeat from core client for 30 sec - exiting 05:00:19 (7104): No heartbeat from core client for 30 sec - exiting 05:00:20 (7104): No heartbeat from core client for 30 sec - exiting 05:00:22 (7104): No heartbeat from core client for 30 sec - exiting 05:00:23 (7104): No heartbeat from core client for 30 sec - exiting 05:00:24 (7104): No heartbeat from core client for 30 sec - exiting 05:00:25 (7104): No heartbeat from core client for 30 sec - exiting 05:00:26 (7104): No heartbeat from core client for 30 sec - exiting 05:00:27 (7104): No heartbeat from core client for 30 sec - exiting 05:00:28 (7104): No heartbeat from core client for 30 sec - exiting 05:00:29 (7104): No heartbeat from core client for 30 sec - exiting 05:00:30 (7104): No heartbeat from core client for 30 sec - exiting 05:00:31 (7104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 00:28:47 (3884): No heartbeat from core client for 30 sec - exiting 00:28:48 (3884): No heartbeat from core client for 30 sec - exiting 00:28:49 (3884): No heartbeat from core client for 30 sec - exiting 00:28:50 (3884): No heartbeat from core client for 30 sec - exiting 00:28:51 (3884): No heartbeat from core client for 30 sec - exiting 00:28:52 (3884): No heartbeat from core client for 30 sec - exiting 00:28:54 (3884): No heartbeat from core client for 30 sec - exiting 00:28:55 (3884): No heartbeat from core client for 30 sec - exiting 00:28:56 (3884): No heartbeat from core client for 30 sec - exiting 00:28:57 (3884): No heartbeat from core client for 30 sec - exiting 00:28:58 (3884): No heartbeat from core client for 30 sec - exiting 00:28:59 (3884): No heartbeat from core client for 30 sec - exiting 00:29:00 (3884): No heartbeat from core client for 30 sec - exiting 00:29:01 (3884): No heartbeat from core client for 30 sec - exiting 00:29:02 (3884): No heartbeat from core client for 30 sec - exiting 00:29:03 (3884): No heartbeat from core client for 30 sec - exiting 00:29:04 (3884): No heartbeat from core client for 30 sec - exiting 00:29:06 (3884): No heartbeat from core client for 30 sec - exiting 00:29:07 (3884): No heartbeat from core client for 30 sec - exiting 00:29:08 (3884): No heartbeat from core client for 30 sec - exiting 00:29:09 (3884): No heartbeat from core client for 30 sec - exiting 00:29:10 (3884): No heartbeat from core client for 30 sec - exiting 00:29:11 (3884): No heartbeat from core client for 30 sec - exiting 00:29:12 (3884): No heartbeat from core client for 30 sec - exiting 00:29:13 (3884): No heartbeat from core client for 30 sec - exiting 00:29:14 (3884): No heartbeat from core client for 30 sec - exiting 00:29:15 (3884): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 04:23:28 (6640): No heartbeat from core client for 30 sec - exiting 04:23:29 (6640): No heartbeat from core client for 30 sec - exiting 04:23:30 (6640): No heartbeat from core client for 30 sec - exiting 04:23:31 (6640): No heartbeat from core client for 30 sec - exiting 04:23:32 (6640): No heartbeat from core client for 30 sec - exiting 04:23:33 (6640): No heartbeat from core client for 30 sec - exiting 04:23:34 (6640): No heartbeat from core client for 30 sec - exiting 04:23:35 (6640): No heartbeat from core client for 30 sec - exiting 04:23:37 (6640): No heartbeat from core client for 30 sec - exiting 04:23:38 (6640): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4464, selfPID=4464, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7048, selfPID=4852, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 03:23:47 (5980): No heartbeat from core client for 30 sec - exiting 03:23:49 (5980): No heartbeat from core client for 30 sec - exiting 03:23:50 (5980): No heartbeat from core client for 30 sec - exiting 03:23:51 (5980): No heartbeat from core client for 30 sec - exiting 03:23:52 (5980): No heartbeat from core client for 30 sec - exiting 03:23:53 (5980): No heartbeat from core client for 30 sec - exiting 03:23:54 (5980): No heartbeat from core client for 30 sec - exiting 03:23:55 (5980): No heartbeat from core client for 30 sec - exiting 03:23:56 (5980): No heartbeat from core client for 30 sec - exiting 03:23:57 (5980): No heartbeat from core client for 30 sec - exiting 03:23:58 (5980): No heartbeat from core client for 30 sec - exiting 03:23:59 (5980): No heartbeat from core client for 30 sec - exiting 03:24:01 (5980): No heartbeat from core client for 30 sec - exiting 03:24:02 (5980): No heartbeat from core client for 30 sec - exiting 03:24:03 (5980): No heartbeat from core client for 30 sec - exiting 03:24:04 (5980): No heartbeat from core client for 30 sec - exiting 03:24:05 (5980): No heartbeat from core client for 30 sec - exiting 03:24:06 (5980): No heartbeat from core client for 30 sec - exiting 03:24:07 (5980): No heartbeat from core client for 30 sec - exiting 03:24:08 (5980): No heartbeat from core client for 30 sec - exiting 03:24:09 (5980): No heartbeat from core client for 30 sec - exiting 03:24:10 (5980): No heartbeat from core client for 30 sec - exiting 03:24:12 (5980): No heartbeat from core client for 30 sec - exiting 03:24:13 (5980): No heartbeat from core client for 30 sec - exiting 03:24:14 (5980): No heartbeat from core client for 30 sec - exiting 03:24:15 (5980): No heartbeat from core client for 30 sec - exiting 03:24:16 (5980): No heartbeat from core client for 30 sec - exiting 03:24:17 (5980): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 02:24:54 (7796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:25:41 (8008): No heartbeat from core client for 30 sec - exiting 02:25:43 (8008): No heartbeat from core client for 30 sec - exiting 02:25:44 (8008): No heartbeat from core client for 30 sec - exiting 02:25:45 (8008): No heartbeat from core client for 30 sec - exiting 02:25:46 (8008): No heartbeat from core client for 30 sec - exiting 02:25:47 (8008): No heartbeat from core client for 30 sec - exiting 02:25:48 (8008): No heartbeat from core client for 30 sec - exiting 02:25:49 (8008): No heartbeat from core client for 30 sec - exiting 02:25:50 (8008): No heartbeat from core client for 30 sec - exiting 02:25:51 (8008): No heartbeat from core client for 30 sec - exiting 02:25:52 (8008): No heartbeat from core client for 30 sec - exiting 02:25:53 (8008): No heartbeat from core client for 30 sec - exiting 02:25:54 (8008): No heartbeat from core client for 30 sec - exiting 02:25:55 (8008): No heartbeat from core client for 30 sec - exiting 02:25:56 (8008): No heartbeat from core client for 30 sec - exiting 02:25:57 (8008): No heartbeat from core client for 30 sec - exiting 02:25:58 (8008): No heartbeat from core client for 30 sec - exiting 02:25:59 (8008): No heartbeat from core client for 30 sec - exiting 02:26:00 (8008): No heartbeat from core client for 30 sec - exiting 02:26:01 (8008): No heartbeat from core client for 30 sec - exiting 02:26:02 (8008): No heartbeat from core client for 30 sec - exiting 02:26:03 (8008): No heartbeat from core client for 30 sec - exiting 02:26:04 (8008): No heartbeat from core client for 30 sec - exiting 02:26:05 (8008): No heartbeat from core client for 30 sec - exiting 02:26:06 (8008): No heartbeat from core client for 30 sec - exiting 02:26:07 (8008): No heartbeat from core client for 30 sec - exiting 02:26:08 (8008): No heartbeat from core client for 30 sec - exiting 02:26:09 (8008): No heartbeat from core client for 30 sec - exiting 02:26:10 (8008): No heartbeat from core client for 30 sec - exiting 02:26:11 (8008): No heartbeat from core client for 30 sec - exiting 02:26:12 (8008): No heartbeat from core client for 30 sec - exiting 02:26:13 (8008): No heartbeat from core client for 30 sec - exiting 02:26:14 (8008): No heartbeat from core client for 30 sec - exiting 02:26:15 (8008): No heartbeat from core client for 30 sec - exiting 02:26:16 (8008): No heartbeat from core client for 30 sec - exiting 02:26:17 (8008): No heartbeat from core client for 30 sec - exiting 02:26:18 (8008): No heartbeat from core client for 30 sec - exiting 02:26:19 (8008): No heartbeat from core client for 30 sec - exiting 02:26:20 (8008): No heartbeat from core client for 30 sec - exiting 02:26:21 (8008): No heartbeat from core client for 30 sec - exiting 02:26:22 (8008): No heartbeat from core client for 30 sec - exiting 02:26:23 (8008): No heartbeat from core client for 30 sec - exiting 02:26:24 (8008): No heartbeat from core client for 30 sec - exiting 02:26:25 (8008): No heartbeat from core client for 30 sec - exiting 02:26:26 (8008): No heartbeat from core client for 30 sec - exiting 02:26:27 (8008): No heartbeat from core client for 30 sec - exiting 02:26:28 (8008): No heartbeat from core client for 30 sec - exiting 02:26:29 (8008): No heartbeat from core client for 30 sec - exiting 02:26:30 (8008): No heartbeat from core client for 30 sec - exiting 02:26:31 (8008): No heartbeat from core client for 30 sec - exiting 02:26:32 (8008): No heartbeat from core client for 30 sec - exiting 02:26:33 (8008): No heartbeat from core client for 30 sec - exiting 02:26:34 (8008): No heartbeat from core client for 30 sec - exiting 02:26:35 (8008): No heartbeat from core client for 30 sec - exiting 02:26:36 (8008): No heartbeat from core client for 30 sec - exiting 02:26:37 (8008): No heartbeat from core client for 30 sec - exiting 02:26:38 (8008): No heartbeat from core client for 30 sec - exiting 02:26:39 (8008): No heartbeat from core client for 30 sec - exiting 02:26:40 (8008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:37:35 (7660): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8132, selfPID=8132, iMonCtr=2 02:38:17 (4652): No heartbeat from core client for 30 sec - exiting 02:38:18 (4652): No heartbeat from core client for 30 sec - exiting 02:38:19 (4652): No heartbeat from core client for 30 sec - exiting 02:38:20 (4652): No heartbeat from core client for 30 sec - exiting 02:38:21 (4652): No heartbeat from core client for 30 sec - exiting 02:38:22 (4652): No heartbeat from core client for 30 sec - exiting 02:38:23 (4652): No heartbeat from core client for 30 sec - exiting 02:38:24 (4652): No heartbeat from core client for 30 sec - exiting 02:38:25 (4652): No heartbeat from core client for 30 sec - exiting 02:38:26 (4652): No heartbeat from core client for 30 sec - exiting 02:38:27 (4652): No heartbeat from core client for 30 sec - exiting 02:38:28 (4652): No heartbeat from core client for 30 sec - exiting 02:38:29 (4652): No heartbeat from core client for 30 sec - exiting 02:38:30 (4652): No heartbeat from core client for 30 sec - exiting 02:38:31 (4652): No heartbeat from core client for 30 sec - exiting 02:38:32 (4652): No heartbeat from core client for 30 sec - exiting 02:38:33 (4652): No heartbeat from core client for 30 sec - exiting 02:38:34 (4652): No heartbeat from core client for 30 sec - exiting 02:38:35 (4652): No heartbeat from core client for 30 sec - exiting 02:38:36 (4652): No heartbeat from core client for 30 sec - exiting 02:38:37 (4652): No heartbeat from core client for 30 sec - exiting 02:38:38 (4652): No heartbeat from core client for 30 sec - exiting 02:38:39 (4652): No heartbeat from core client for 30 sec - exiting 02:38:40 (4652): No heartbeat from core client for 30 sec - exiting 02:38:41 (4652): No heartbeat from core client for 30 sec - exiting 02:38:42 (4652): No heartbeat from core client for 30 sec - exiting 02:38:43 (4652): No heartbeat from core client for 30 sec - exiting 02:38:44 (4652): No heartbeat from core client for 30 sec - exiting 02:38:45 (4652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:31:32 (5040): No heartbeat from core client for 30 sec - exiting 00:31:33 (5040): No heartbeat from core client for 30 sec - exiting 00:31:34 (5040): No heartbeat from core client for 30 sec - exiting 00:31:35 (5040): No heartbeat from core client for 30 sec - exiting 00:31:37 (5040): No heartbeat from core client for 30 sec - exiting 00:31:38 (5040): No heartbeat from core client for 30 sec - exiting 00:31:39 (5040): No heartbeat from core client for 30 sec - exiting 00:31:40 (5040): No heartbeat from core client for 30 sec - exiting 00:31:41 (5040): No heartbeat from core client for 30 sec - exiting 00:31:42 (5040): No heartbeat from core client for 30 sec - exiting 00:31:43 (5040): No heartbeat from core client for 30 sec - exiting 00:31:44 (5040): No heartbeat from core client for 30 sec - exiting 00:31:45 (5040): No heartbeat from core client for 30 sec - exiting 00:31:46 (5040): No heartbeat from core client for 30 sec - exiting 00:31:47 (5040): No heartbeat from core client for 30 sec - exiting 00:31:49 (5040): No heartbeat from core client for 30 sec - exiting 00:31:50 (5040): No heartbeat from core client for 30 sec - exiting 00:31:51 (5040): No heartbeat from core client for 30 sec - exiting 00:31:52 (5040): No heartbeat from core client for 30 sec - exiting 00:31:53 (5040): No heartbeat from core client for 30 sec - exiting 00:31:54 (5040): No heartbeat from core client for 30 sec - exiting 00:31:55 (5040): No heartbeat from core client for 30 sec - exiting 00:31:56 (5040): No heartbeat from core client for 30 sec - exiting 00:31:57 (5040): No heartbeat from core client for 30 sec - exiting 00:31:58 (5040): No heartbeat from core client for 30 sec - exiting 00:31:59 (5040): No heartbeat from core client for 30 sec - exiting 00:32:01 (5040): No heartbeat from core client for 30 sec - exiting 00:32:02 (5040): No heartbeat from core client for 30 sec - exiting 00:32:03 (5040): No heartbeat from core client for 30 sec - exiting 00:32:04 (5040): No heartbeat from core client for 30 sec - exiting 00:32:05 (5040): No heartbeat from core client for 30 sec - exiting 00:32:06 (5040): No heartbeat from core client for 30 sec - exiting 00:32:07 (5040): No heartbeat from core client for 30 sec - exiting 00:32:08 (5040): No heartbeat from core client for 30 sec - exiting 00:32:09 (5040): No heartbeat from core client for 30 sec - exiting 00:32:10 (5040): No heartbeat from core client for 30 sec - exiting 00:32:11 (5040): No heartbeat from core client for 30 sec - exiting 00:32:12 (5040): No heartbeat from core client for 30 sec - exiting 00:32:13 (5040): No heartbeat from core client for 30 sec - exiting 00:32:14 (5040): No heartbeat from core client for 30 sec - exiting 00:32:15 (5040): No heartbeat from core client for 30 sec - exiting 00:32:16 (5040): No heartbeat from core client for 30 sec - exiting 00:32:17 (5040): No heartbeat from core client for 30 sec - exiting 00:32:18 (5040): No heartbeat from core client for 30 sec - exiting 00:32:19 (5040): No heartbeat from core client for 30 sec - exiting 00:32:20 (5040): No heartbeat from core client for 30 sec - exiting 00:32:21 (5040): No heartbeat from core client for 30 sec - exiting 00:32:23 (5040): No heartbeat from core client for 30 sec - exiting 00:32:24 (5040): No heartbeat from core client for 30 sec - exiting 00:32:25 (5040): No heartbeat from core client for 30 sec - exiting 00:32:26 (5040): No heartbeat from core client for 30 sec - exiting 00:32:27 (5040): No heartbeat from core client for 30 sec - exiting 00:32:28 (5040): No heartbeat from core client for 30 sec - exiting 00:32:29 (5040): No heartbeat from core client for 30 sec - exiting 00:32:30 (5040): No heartbeat from core client for 30 sec - exiting 00:32:31 (5040): No heartbeat from core client for 30 sec - exiting 00:32:32 (5040): No heartbeat from core client for 30 sec - exiting 00:32:34 (5040): No heartbeat from core client for 30 sec - exiting 00:32:35 (5040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=11016, selfPID=11016, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1CPDN Monitor - Quit request from BOINC... 00:31:56 (11064): No heartbeat from core client for 30 sec - exiting 00:31:57 (11064): No heartbeat from core client for 30 sec - exiting 00:31:58 (11064): No heartbeat from core client for 30 sec - exiting 00:31:59 (11064): No heartbeat from core client for 30 sec - exiting 00:32:00 (11064): No heartbeat from core client for 30 sec - exiting 00:32:01 (11064): No heartbeat from core client for 30 sec - exiting 00:32:02 (11064): No heartbeat from core client for 30 sec - exiting 00:32:03 (11064): No heartbeat from core client for 30 sec - exiting 00:32:05 (11064): No heartbeat from core client for 30 sec - exiting 00:32:06 (11064): No heartbeat from core client for 30 sec - exiting 00:32:07 (11064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:34:19 (5500): No heartbeat from core client for 30 sec - exiting 00:34:22 (5500): No heartbeat from core client for 30 sec - exiting 00:34:24 (5500): No heartbeat from core client for 30 sec - exiting 00:34:25 (5500): No heartbeat from core client for 30 sec - exiting 00:34:26 (5500): No heartbeat from core client for 30 sec - exiting 00:34:27 (5500): No heartbeat from core client for 30 sec - exiting 00:34:28 (5500): No heartbeat from core client for 30 sec - exiting 00:34:29 (5500): No heartbeat from core client for 30 sec - exiting 00:34:30 (5500): No heartbeat from core client for 30 sec - exiting 00:34:31 (5500): No heartbeat from core client for 30 sec - exiting 00:34:33 (5500): No heartbeat from core client for 30 sec - exiting 00:34:34 (5500): No heartbeat from core client for 30 sec - exiting 00:34:35 (5500): No heartbeat from core client for 30 sec - exiting 00:34:36 (5500): No heartbeat from core client for 30 sec - exiting 00:34:37 (5500): No heartbeat from core client for 30 sec - exiting 00:34:38 (5500): No heartbeat from core client for 30 sec - exiting 00:34:39 (5500): No heartbeat from core client for 30 sec - exiting 00:34:40 (5500): No heartbeat from core client for 30 sec - exiting 00:34:41 (5500): No heartbeat from core client for 30 sec - exiting 00:34:42 (5500): No heartbeat from core client for 30 sec - exiting 00:34:43 (5500): No heartbeat from core client for 30 sec - exiting 00:34:44 (5500): No heartbeat from core client for 30 sec - exiting 00:34:45 (5500): No heartbeat from core client for 30 sec - exiting 00:34:46 (5500): No heartbeat from core client for 30 sec - exiting 00:34:47 (5500): No heartbeat from core client for 30 sec - exiting 00:34:48 (5500): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:35:37 (3744): Can't acquire lockfile (32) - waiting 35s CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7896, selfPID=7896, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 02:46:29 (7464): No heartbeat from core client for 30 sec - exiting 02:46:30 (7464): No heartbeat from core client for 30 sec - exiting 02:46:31 (7464): No heartbeat from core client for 30 sec - exiting 02:46:32 (7464): No heartbeat from core client for 30 sec - exiting 02:46:33 (7464): No heartbeat from core client for 30 sec - exiting 02:46:34 (7464): No heartbeat from core client for 30 sec - exiting 02:46:35 (7464): No heartbeat from core client for 30 sec - exiting 02:46:37 (7464): No heartbeat from core client for 30 sec - exiting 02:46:38 (7464): No heartbeat from core client for 30 sec - exiting 02:46:39 (7464): No heartbeat from core client for 30 sec - exiting 02:46:40 (7464): No heartbeat from core client for 30 sec - exiting 02:46:41 (7464): No heartbeat from core client for 30 sec - exiting 02:46:42 (7464): No heartbeat from core client for 30 sec - exiting 02:46:43 (7464): No heartbeat from core client for 30 sec - exiting 02:46:44 (7464): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8288, selfPID=8288, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7696, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6772, iMonCtr=2 Model crash detected, will try to restart... 00:39:05 (6764): No heartbeat from core client for 30 sec - exiting 00:39:06 (6764): No heartbeat from core client for 30 sec - exiting 00:39:08 (6764): No heartbeat from core client for 30 sec - exiting 00:39:09 (6764): No heartbeat from core client for 30 sec - exiting 00:39:10 (6764): No heartbeat from core client for 30 sec - exiting 00:39:11 (6764): No heartbeat from core client for 30 sec - exiting 00:39:12 (6764): No heartbeat from core client for 30 sec - exiting 00:39:13 (6764): No heartbeat from core client for 30 sec - exiting 00:39:14 (6764): No heartbeat from core client for 30 sec - exiting 00:39:15 (6764): No heartbeat from core client for 30 sec - exiting 00:39:16 (6764): No heartbeat from core client for 30 sec - exiting 00:39:17 (6764): No heartbeat from core client for 30 sec - exiting 00:39:18 (6764): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4648, selfPID=4648, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:35:57 (9968): No heartbeat from core client for 30 sec - exiting 00:35:58 (9968): No heartbeat from core client for 30 sec - exiting 00:35:59 (9968): No heartbeat from core client for 30 sec - exiting 00:36:00 (9968): No heartbeat from core client for 30 sec - exiting 00:36:01 (9968): No heartbeat from core client for 30 sec - exiting 00:36:02 (9968): No heartbeat from core client for 30 sec - exiting 00:36:03 (9968): No heartbeat from core client for 30 sec - exiting 00:36:05 (9968): No heartbeat from core client for 30 sec - exiting 00:36:06 (9968): No heartbeat from core client for 30 sec - exiting 00:36:07 (9968): No heartbeat from core client for 30 sec - exiting 00:36:08 (9968): No heartbeat from core client for 30 sec - exiting 00:36:09 (9968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6940, selfPID=6940, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6852, selfPID=6852, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8408, selfPID=8408, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=12208, selfPID=12208, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4124, selfPID=4124, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
30 Jul 2013 09:34:42	1229569	15737331	hadam3p_pnw_q7ud_2047_1_008353566_0	138,336	384,996	2.7830
24 Jul 2013 06:00:35	1229569	15737331	hadam3p_pnw_q7ud_2047_1_008353566_0	126,816	353,594	2.7882
23 Jul 2013 20:22:14	1229569	15737331	hadam3p_pnw_q7ud_2047_1_008353566_0	115,296	322,940	2.8010
23 Jul 2013 19:25:22	1229569	15737331	hadam3p_pnw_q7ud_2047_1_008353566_0	103,780	292,454	2.8180
23 Jul 2013 19:25:22	1229569	15737331	hadam3p_pnw_q7ud_2047_1_008353566_0	103,776	292,082	2.8145
10 Jul 2013 10:41:18	1229569	15737331	hadam3p_pnw_q7ud_2047_1_008353566_0	92,256	260,157	2.8199
06 Jul 2013 06:04:30	1229569	15737331	hadam3p_pnw_q7ud_2047_1_008353566_0	80,742	216,704	2.6839
06 Jul 2013 05:00:00	1229569	15737331	hadam3p_pnw_q7ud_2047_1_008353566_0	80,739	216,363	2.6798
06 Jul 2013 04:49:25	1229569	15737331	hadam3p_pnw_q7ud_2047_1_008353566_0	80,736	216,044	2.6759
28 Jun 2013 07:07:44	1229569	15737331	hadam3p_pnw_q7ud_2047_1_008353566_0	69,216	185,930	2.6862
24 Jun 2013 11:31:08	1229569	15737331	hadam3p_pnw_q7ud_2047_1_008353566_0	57,696	155,145	2.6890
19 Jun 2013 11:02:26	1229569	15737331	hadam3p_pnw_q7ud_2047_1_008353566_0	46,176	126,104	2.7309
17 Jun 2013 10:16:37	1229569	15737331	hadam3p_pnw_q7ud_2047_1_008353566_0	34,656	94,387	2.7235
27 May 2013 06:13:04	1229569	15737331	hadam3p_pnw_q7ud_2047_1_008353566_0	23,140	63,214	2.7318
27 May 2013 05:12:44	1229569	15737331	hadam3p_pnw_q7ud_2047_1_008353566_0	23,136	62,881	2.7179
24 May 2013 10:23:24	1229569	15737331	hadam3p_pnw_q7ud_2047_1_008353566_0	11,616	31,955	2.7509