Task 14733043

Name	hadcm3n_o0fx_2060_40_007998291_3
Workunit	8153405
Created	22 May 2012, 21:11:56 UTC
Sent	22 May 2012, 21:12:07 UTC
Report deadline	22 Aug 2012, 4:39:18 UTC
Received	24 Aug 2012, 18:15:44 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1219282
Run time	20 days 20 hours 28 min 16 sec
CPU time	18 days 12 hours 24 min 4 sec
Validate state	Valid
Credit	12,441.60
Device peak FLOPS	2.48 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4024, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4340, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3200, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1764, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2332, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4216, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3720, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4964, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3784, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:50:31 (1076): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 03:50:32 (1076): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 18:18:08 (3932): No heartbeat from core client for 30 sec - exiting 18:18:09 (3932): No heartbeat from core client for 30 sec - exiting 18:18:10 (3932): No heartbeat from core client for 30 sec - exiting 18:18:11 (3932): No heartbeat from core client for 30 sec - exiting 18:18:12 (3932): No heartbeat from core client for 30 sec - exiting 18:18:13 (3932): No heartbeat from core client for 30 sec - exiting 18:18:14 (3932): No heartbeat from core client for 30 sec - exiting 18:18:15 (3932): No heartbeat from core client for 30 sec - exiting 18:18:16 (3932): No heartbeat from core client for 30 sec - exiting 18:18:17 (3932): No heartbeat from core client for 30 sec - exiting 18:18:18 (3932): No heartbeat from core client for 30 sec - exiting 18:18:19 (3932): No heartbeat from core client for 30 sec - exiting 18:18:20 (3932): No heartbeat from core client for 30 sec - exiting 18:18:21 (3932): No heartbeat from core client for 30 sec - exiting 18:18:22 (3932): No heartbeat from core client for 30 sec - exiting 18:18:23 (3932): No heartbeat from core client for 30 sec - exiting 18:18:24 (3932): No heartbeat from core client for 30 sec - exiting 18:18:25 (3932): No heartbeat from core client for 30 sec - exiting 18:18:26 (3932): No heartbeat from core client for 30 sec - exiting 18:18:27 (3932): No heartbeat from core client for 30 sec - exiting 18:18:28 (3932): No heartbeat from core client for 30 sec - exiting 18:18:29 (3932): No heartbeat from core client for 30 sec - exiting 18:18:30 (3932): No heartbeat from core client for 30 sec - exiting 18:18:31 (3932): No heartbeat from core client for 30 sec - exiting 18:18:33 (3932): No heartbeat from core client for 30 sec - exiting 18:18:34 (3932): No heartbeat from core client for 30 sec - exiting 18:18:35 (3932): No heartbeat from core client for 30 sec - exiting 18:18:36 (3932): No heartbeat from core client for 30 sec - exiting 18:18:37 (3932): No heartbeat from core client for 30 sec - exiting 18:18:38 (3932): No heartbeat from core client for 30 sec - exiting 18:18:39 (3932): No heartbeat from core client for 30 sec - exiting 18:18:40 (3932): No heartbeat from core client for 30 sec - exiting 18:18:41 (3932): No heartbeat from core client for 30 sec - exiting 18:18:42 (3932): No heartbeat from core client for 30 sec - exiting 18:18:43 (3932): No heartbeat from core client for 30 sec - exiting 18:18:44 (3932): No heartbeat from core client for 30 sec - exiting 18:18:45 (3932): No heartbeat from core client for 30 sec - exiting 18:18:46 (3932): No heartbeat from core client for 30 sec - exiting 18:18:47 (3932): No heartbeat from core client for 30 sec - exiting 18:18:48 (3932): No heartbeat from core client for 30 sec - exiting 18:18:49 (3932): No heartbeat from core client for 30 sec - exiting 18:18:50 (3932): No heartbeat from core client for 30 sec - exiting 18:18:51 (3932): No heartbeat from core client for 30 sec - exiting 18:18:52 (3932): No heartbeat from core client for 30 sec - exiting 18:18:53 (3932): No heartbeat from core client for 30 sec - exiting 18:18:54 (3932): No heartbeat from core client for 30 sec - exiting 18:18:55 (3932): No heartbeat from core client for 30 sec - exiting 18:18:56 (3932): No heartbeat from core client for 30 sec - exiting 18:18:57 (3932): No heartbeat from core client for 30 sec - exiting 18:18:58 (3932): No heartbeat from core client for 30 sec - exiting 18:18:59 (3932): No heartbeat from core client for 30 sec - exiting 18:19:00 (3932): No heartbeat from core client for 30 sec - exiting 18:19:01 (3932): No heartbeat from core client for 30 sec - exiting 18:19:02 (3932): No heartbeat from core client for 30 sec - exiting 18:19:03 (3932): No heartbeat from core client for 30 sec - exiting 18:19:04 (3932): No heartbeat from core client for 30 sec - exiting 18:19:05 (3932): No heartbeat from core client for 30 sec - exiting 18:19:06 (3932): No heartbeat from core client for 30 sec - exiting 18:19:07 (3932): No heartbeat from core client for 30 sec - exiting 18:19:08 (3932): No heartbeat from core client for 30 sec - exiting 18:19:10 (3932): No heartbeat from core client for 30 sec - exiting 18:19:11 (3932): No heartbeat from core client for 30 sec - exiting 18:19:12 (3932): No heartbeat from core client for 30 sec - exiting 18:19:13 (3932): No heartbeat from core client for 30 sec - exiting 18:19:14 (3932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:19:15 (3932): No heartbeat from core client for 30 sec - exiting 18:19:16 (3932): No heartbeat from core client for 30 sec - exiting 18:19:17 (3932): No heartbeat from core client for 30 sec - exiting 18:19:18 (3932): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2040, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... 07:43:40 (4600): No heartbeat from core client for 30 sec - exiting 07:43:41 (4600): No heartbeat from core client for 30 sec - exiting 07:43:42 (4600): No heartbeat from core client for 30 sec - exiting 07:43:43 (4600): No heartbeat from core client for 30 sec - exiting 07:43:44 (4600): No heartbeat from core client for 30 sec - exiting 07:43:45 (4600): No heartbeat from core client for 30 sec - exiting 07:43:46 (4600): No heartbeat from core client for 30 sec - exiting 07:43:47 (4600): No heartbeat from core client for 30 sec - exiting 07:43:48 (4600): No heartbeat from core client for 30 sec - exiting 07:43:49 (4600): No heartbeat from core client for 30 sec - exiting 07:43:50 (4600): No heartbeat from core client for 30 sec - exiting 07:43:51 (4600): No heartbeat from core client for 30 sec - exiting 07:43:52 (4600): No heartbeat from core client for 30 sec - exiting 07:43:53 (4600): No heartbeat from core client for 30 sec - exiting 07:43:54 (4600): No heartbeat from core client for 30 sec - exiting 07:43:55 (4600): No heartbeat from core client for 30 sec - exiting 07:43:56 (4600): No heartbeat from core client for 30 sec - exiting 07:43:57 (4600): No heartbeat from core client for 30 sec - exiting 07:43:58 (4600): No heartbeat from core client for 30 sec - exiting 07:43:59 (4600): No heartbeat from core client for 30 sec - exiting 07:44:00 (4600): No heartbeat from core client for 30 sec - exiting 07:44:01 (4600): No heartbeat from core client for 30 sec - exiting 07:44:02 (4600): No heartbeat from core client for 30 sec - exiting 07:44:03 (4600): No heartbeat from core client for 30 sec - exiting 07:44:04 (4600): No heartbeat from core client for 30 sec - exiting 07:44:05 (4600): No heartbeat from core client for 30 sec - exiting 07:44:06 (4600): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5744, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4172, iMonCtr=1 Model crash detected, will try to restart... 20:15:34 (3016): No heartbeat from core client for 30 sec - exiting 20:15:35 (3016): No heartbeat from core client for 30 sec - exiting 20:15:36 (3016): No heartbeat from core client for 30 sec - exiting 20:15:37 (3016): No heartbeat from core client for 30 sec - exiting 20:15:38 (3016): No heartbeat from core client for 30 sec - exiting 20:15:39 (3016): No heartbeat from core client for 30 sec - exiting 20:15:40 (3016): No heartbeat from core client for 30 sec - exiting 20:15:41 (3016): No heartbeat from core client for 30 sec - exiting 20:15:43 (3016): No heartbeat from core client for 30 sec - exiting 20:15:44 (3016): No heartbeat from core client for 30 sec - exiting 20:15:45 (3016): No heartbeat from core client for 30 sec - exiting 20:15:46 (3016): No heartbeat from core client for 30 sec - exiting 20:15:47 (3016): No heartbeat from core client for 30 sec - exiting 20:15:48 (3016): No heartbeat from core client for 30 sec - exiting 20:15:49 (3016): No heartbeat from core client for 30 sec - exiting 20:15:50 (3016): No heartbeat from core client for 30 sec - exiting 20:15:51 (3016): No heartbeat from core client for 30 sec - exiting 20:15:52 (3016): No heartbeat from core client for 30 sec - exiting 20:15:53 (3016): No heartbeat from core client for 30 sec - exiting 20:15:55 (3016): No heartbeat from core client for 30 sec - exiting 20:15:56 (3016): No heartbeat from core client for 30 sec - exiting 20:15:57 (3016): No heartbeat from core client for 30 sec - exiting 20:15:58 (3016): No heartbeat from core client for 30 sec - exiting 20:15:59 (3016): No heartbeat from core client for 30 sec - exiting 20:16:00 (3016): No heartbeat from core client for 30 sec - exiting 20:16:01 (3016): No heartbeat from core client for 30 sec - exiting 20:16:02 (3016): No heartbeat from core client for 30 sec - exiting 20:16:03 (3016): No heartbeat from core client for 30 sec - exiting 20:16:04 (3016): No heartbeat from core client for 30 sec - exiting 20:16:06 (3016): No heartbeat from core client for 30 sec - exiting 20:16:07 (3016): No heartbeat from core client for 30 sec - exiting 20:16:08 (3016): No heartbeat from core client for 30 sec - exiting 20:16:09 (3016): No heartbeat from core client for 30 sec - exiting 20:16:10 (3016): No heartbeat from core client for 30 sec - exiting 20:16:11 (3016): No heartbeat from core client for 30 sec - exiting 20:16:12 (3016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:31:34 (4912): No heartbeat from core client for 30 sec - exiting 07:31:35 (4912): No heartbeat from core client for 30 sec - exiting 07:31:37 (4912): No heartbeat from core client for 30 sec - exiting 07:31:38 (4912): No heartbeat from core client for 30 sec - exiting 07:31:39 (4912): No heartbeat from core client for 30 sec - exiting 07:31:40 (4912): No heartbeat from core client for 30 sec - exiting 07:31:41 (4912): No heartbeat from core client for 30 sec - exiting 07:31:42 (4912): No heartbeat from core client for 30 sec - exiting 07:31:43 (4912): No heartbeat from core client for 30 sec - exiting 07:31:44 (4912): No heartbeat from core client for 30 sec - exiting 07:31:45 (4912): No heartbeat from core client for 30 sec - exiting 07:31:46 (4912): No heartbeat from core client for 30 sec - exiting 07:31:47 (4912): No heartbeat from core client for 30 sec - exiting 07:31:49 (4912): No heartbeat from core client for 30 sec - exiting 07:31:50 (4912): No heartbeat from core client for 30 sec - exiting 07:31:51 (4912): No heartbeat from core client for 30 sec - exiting 07:31:52 (4912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:31:53 (4912): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5684, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4896, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4916, iMonCtr=1 Model crash detected, will try to restart... 17:24:06 (5672): No heartbeat from core client for 30 sec - exiting 17:24:08 (5672): No heartbeat from core client for 30 sec - exiting 17:24:09 (5672): No heartbeat from core client for 30 sec - exiting 17:24:10 (5672): No heartbeat from core client for 30 sec - exiting 17:24:11 (5672): No heartbeat from core client for 30 sec - exiting 17:24:12 (5672): No heartbeat from core client for 30 sec - exiting 17:24:13 (5672): No heartbeat from core client for 30 sec - exiting 17:24:14 (5672): No heartbeat from core client for 30 sec - exiting 17:24:15 (5672): No heartbeat from core client for 30 sec - exiting 17:24:16 (5672): No heartbeat from core client for 30 sec - exiting 17:24:17 (5672): No heartbeat from core client for 30 sec - exiting 17:24:18 (5672): No heartbeat from core client for 30 sec - exiting 17:24:19 (5672): No heartbeat from core client for 30 sec - exiting 17:24:20 (5672): No heartbeat from core client for 30 sec - exiting 17:24:21 (5672): No heartbeat from core client for 30 sec - exiting 17:24:22 (5672): No heartbeat from core client for 30 sec - exiting 17:24:23 (5672): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3116, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:58:00 (5940): No heartbeat from core client for 30 sec - exiting 19:58:01 (5940): No heartbeat from core client for 30 sec - exiting 19:58:02 (5940): No heartbeat from core client for 30 sec - exiting 19:58:03 (5940): No heartbeat from core client for 30 sec - exiting 19:58:04 (5940): No heartbeat from core client for 30 sec - exiting 19:58:05 (5940): No heartbeat from core client for 30 sec - exiting 19:58:06 (5940): No heartbeat from core client for 30 sec - exiting 19:58:07 (5940): No heartbeat from core client for 30 sec - exiting 19:58:08 (5940): No heartbeat from core client for 30 sec - exiting 19:58:09 (5940): No heartbeat from core client for 30 sec - exiting 19:58:10 (5940): No heartbeat from core client for 30 sec - exiting 19:58:11 (5940): No heartbeat from core client for 30 sec - exiting 19:58:12 (5940): No heartbeat from core client for 30 sec - exiting 19:58:13 (5940): No heartbeat from core client for 30 sec - exiting 19:58:14 (5940): No heartbeat from core client for 30 sec - exiting 19:58:15 (5940): No heartbeat from core client for 30 sec - exiting 19:58:16 (5940): No heartbeat from core client for 30 sec - exiting 19:58:17 (5940): No heartbeat from core client for 30 sec - exiting 19:58:18 (5940): No heartbeat from core client for 30 sec - exiting 19:58:19 (5940): No heartbeat from core client for 30 sec - exiting 19:58:20 (5940): No heartbeat from core client for 30 sec - exiting 19:58:21 (5940): No heartbeat from core client for 30 sec - exiting 19:58:22 (5940): No heartbeat from core client for 30 sec - exiting 19:58:23 (5940): No heartbeat from core client for 30 sec - exiting 19:58:24 (5940): No heartbeat from core client for 30 sec - exiting 19:58:25 (5940): No heartbeat from core client for 30 sec - exiting 19:58:26 (5940): No heartbeat from core client for 30 sec - exiting 19:58:27 (5940): No heartbeat from core client for 30 sec - exiting 19:58:28 (5940): No heartbeat from core client for 30 sec - exiting 19:58:29 (5940): No heartbeat from core client for 30 sec - exiting 19:58:30 (5940): No heartbeat from core client for 30 sec - exiting 19:58:31 (5940): No heartbeat from core client for 30 sec - exiting 19:58:32 (5940): No heartbeat from core client for 30 sec - exiting 19:58:33 (5940): No heartbeat from core client for 30 sec - exiting 19:58:34 (5940): No heartbeat from core client for 30 sec - exiting 19:58:35 (5940): No heartbeat from core client for 30 sec - exiting 19:58:36 (5940): No heartbeat from core client for 30 sec - exiting 19:58:37 (5940): No heartbeat from core client for 30 sec - exiting 19:58:38 (5940): No heartbeat from core client for 30 sec - exiting 19:58:39 (5940): No heartbeat from core client for 30 sec - exiting 19:58:40 (5940): No heartbeat from core client for 30 sec - exiting 19:58:41 (5940): No heartbeat from core client for 30 sec - exiting 19:58:42 (5940): No heartbeat from core client for 30 sec - exiting 19:58:43 (5940): No heartbeat from core client for 30 sec - exiting 19:58:44 (5940): No heartbeat from core client for 30 sec - exiting 19:58:45 (5940): No heartbeat from core client for 30 sec - exiting 19:58:46 (5940): No heartbeat from core client for 30 sec - exiting 19:58:47 (5940): No heartbeat from core client for 30 sec - exiting 19:58:48 (5940): No heartbeat from core client for 30 sec - exiting 19:58:49 (5940): No heartbeat from core client for 30 sec - exiting 19:58:50 (5940): No heartbeat from core client for 30 sec - exiting 19:58:51 (5940): No heartbeat from core client for 30 sec - exiting 19:58:52 (5940): No heartbeat from core client for 30 sec - exiting 19:58:53 (5940): No heartbeat from core client for 30 sec - exiting 19:58:54 (5940): No heartbeat from core client for 30 sec - exiting 19:58:55 (5940): No heartbeat from core client for 30 sec - exiting 19:58:56 (5940): No heartbeat from core client for 30 sec - exiting 19:58:57 (5940): No heartbeat from core client for 30 sec - exiting 19:58:58 (5940): No heartbeat from core client for 30 sec - exiting 19:58:59 (5940): No heartbeat from core client for 30 sec - exiting 19:59:00 (5940): No heartbeat from core client for 30 sec - exiting 19:59:01 (5940): No heartbeat from core client for 30 sec - exiting 19:59:02 (5940): No heartbeat from core client for 30 sec - exiting 19:59:03 (5940): No heartbeat from core client for 30 sec - exiting 19:59:04 (5940): No heartbeat from core client for 30 sec - exiting 19:59:05 (5940): No heartbeat from core client for 30 sec - exiting 19:59:06 (5940): No heartbeat from core client for 30 sec - exiting 19:59:07 (5940): No heartbeat from core client for 30 sec - exiting 19:59:08 (5940): No heartbeat from core client for 30 sec - exiting 19:59:09 (5940): No heartbeat from core client for 30 sec - exiting 19:59:10 (5940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:13:06 (5816): No heartbeat from core client for 30 sec - exiting 07:13:07 (5816): No heartbeat from core client for 30 sec - exiting 07:13:08 (5816): No heartbeat from core client for 30 sec - exiting 07:13:09 (5816): No heartbeat from core client for 30 sec - exiting 07:13:10 (5816): No heartbeat from core client for 30 sec - exiting 07:13:11 (5816): No heartbeat from core client for 30 sec - exiting 07:13:12 (5816): No heartbeat from core client for 30 sec - exiting 07:13:13 (5816): No heartbeat from core client for 30 sec - exiting 07:13:14 (5816): No heartbeat from core client for 30 sec - exiting 07:13:15 (5816): No heartbeat from core client for 30 sec - exiting 07:13:16 (5816): No heartbeat from core client for 30 sec - exiting 07:13:17 (5816): No heartbeat from core client for 30 sec - exiting 07:13:18 (5816): No heartbeat from core client for 30 sec - exiting 07:13:19 (5816): No heartbeat from core client for 30 sec - exiting 07:13:20 (5816): No heartbeat from core client for 30 sec - exiting 07:13:21 (5816): No heartbeat from core client for 30 sec - exiting 07:13:22 (5816): No heartbeat from core client for 30 sec - exiting 07:13:23 (5816): No heartbeat from core client for 30 sec - exiting 07:13:24 (5816): No heartbeat from core client for 30 sec - exiting 07:13:25 (5816): No heartbeat from core client for 30 sec - exiting 07:13:26 (5816): No heartbeat from core client for 30 sec - exiting 07:13:27 (5816): No heartbeat from core client for 30 sec - exiting 07:13:28 (5816): No heartbeat from core client for 30 sec - exiting 07:13:29 (5816): No heartbeat from core client for 30 sec - exiting 07:13:30 (5816): No heartbeat from core client for 30 sec - exiting 07:13:31 (5816): No heartbeat from core client for 30 sec - exiting 07:13:32 (5816): No heartbeat from core client for 30 sec - exiting 07:13:33 (5816): No heartbeat from core client for 30 sec - exiting 07:13:34 (5816): No heartbeat from core client for 30 sec - exiting 07:13:35 (5816): No heartbeat from core client for 30 sec - exiting 07:13:36 (5816): No heartbeat from core client for 30 sec - exiting 07:13:37 (5816): No heartbeat from core client for 30 sec - exiting 07:13:38 (5816): No heartbeat from core client for 30 sec - exiting 07:13:39 (5816): No heartbeat from core client for 30 sec - exiting 07:13:40 (5816): No heartbeat from core client for 30 sec - exiting 07:13:41 (5816): No heartbeat from core client for 30 sec - exiting 07:13:42 (5816): No heartbeat from core client for 30 sec - exiting 07:13:43 (5816): No heartbeat from core client for 30 sec - exiting 07:13:44 (5816): No heartbeat from core client for 30 sec - exiting 07:13:45 (5816): No heartbeat from core client for 30 sec - exiting 07:13:46 (5816): No heartbeat from core client for 30 sec - exiting 07:13:47 (5816): No heartbeat from core client for 30 sec - exiting 07:13:48 (5816): No heartbeat from core client for 30 sec - exiting 07:13:49 (5816): No heartbeat from core client for 30 sec - exiting 07:13:50 (5816): No heartbeat from core client for 30 sec - exiting 07:13:51 (5816): No heartbeat from core client for 30 sec - exiting 07:13:52 (5816): No heartbeat from core client for 30 sec - exiting 07:13:53 (5816): No heartbeat from core client for 30 sec - exiting 07:13:54 (5816): No heartbeat from core client for 30 sec - exiting 07:13:55 (5816): No heartbeat from core client for 30 sec - exiting 07:13:56 (5816): No heartbeat from core client for 30 sec - exiting 07:13:57 (5816): No heartbeat from core client for 30 sec - exiting 07:13:58 (5816): No heartbeat from core client for 30 sec - exiting 07:13:59 (5816): No heartbeat from core client for 30 sec - exiting 07:14:00 (5816): No heartbeat from core client for 30 sec - exiting 07:14:01 (5816): No heartbeat from core client for 30 sec - exiting 07:14:02 (5816): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:14:03 (5816): No heartbeat from core client for 30 sec - exiting 07:14:04 (5816): No heartbeat from core client for 30 sec - exiting 07:14:05 (5816): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:29:55 (4052): No heartbeat from core client for 30 sec - exiting 08:29:56 (4052): No heartbeat from core client for 30 sec - exiting 08:29:57 (4052): No heartbeat from core client for 30 sec - exiting 08:29:58 (4052): No heartbeat from core client for 30 sec - exiting 08:29:59 (4052): No heartbeat from core client for 30 sec - exiting 08:30:00 (4052): No heartbeat from core client for 30 sec - exiting 08:30:01 (4052): No heartbeat from core client for 30 sec - exiting 08:30:02 (4052): No heartbeat from core client for 30 sec - exiting 08:30:03 (4052): No heartbeat from core client for 30 sec - exiting 08:30:04 (4052): No heartbeat from core client for 30 sec - exiting 08:30:05 (4052): No heartbeat from core client for 30 sec - exiting 08:30:06 (4052): No heartbeat from core client for 30 sec - exiting 08:30:07 (4052): No heartbeat from core client for 30 sec - exiting 08:30:08 (4052): No heartbeat from core client for 30 sec - exiting 08:30:09 (4052): No heartbeat from core client for 30 sec - exiting 08:30:10 (4052): No heartbeat from core client for 30 sec - exiting 08:30:11 (4052): No heartbeat from core client for 30 sec - exiting 08:30:12 (4052): No heartbeat from core client for 30 sec - exiting 08:30:13 (4052): No heartbeat from core client for 30 sec - exiting 08:30:14 (4052): No heartbeat from core client for 30 sec - exiting 08:30:15 (4052): No heartbeat from core client for 30 sec - exiting 08:30:16 (4052): No heartbeat from core client for 30 sec - exiting 08:30:17 (4052): No heartbeat from core client for 30 sec - exiting 08:30:18 (4052): No heartbeat from core client for 30 sec - exiting 08:30:19 (4052): No heartbeat from core client for 30 sec - exiting 08:30:20 (4052): No heartbeat from core client for 30 sec - exiting 08:30:21 (4052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:30:22 (4052): No heartbeat from core client for 30 sec - exiting 08:30:23 (4052): No heartbeat from core client for 30 sec - exiting 08:30:24 (4052): No heartbeat from core client for 30 sec - exiting 08:30:25 (4052): No heartbeat from core client for 30 sec - exiting 08:30:26 (4052): No heartbeat from core client for 30 sec - exiting 08:30:27 (4052): No heartbeat from core client for 30 sec - exiting 08:30:28 (4052): No heartbeat from core client for 30 sec - exiting 08:30:29 (4052): No heartbeat from core client for 30 sec - exiting 08:30:30 (4052): No heartbeat from core client for 30 sec - exiting 08:32:10 (5308): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:53:45 (3152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:13:00 (6284): No heartbeat from core client for 30 sec - exiting 06:13:01 (6284): No heartbeat from core client for 30 sec - exiting 06:13:02 (6284): No heartbeat from core client for 30 sec - exiting 06:13:03 (6284): No heartbeat from core client for 30 sec - exiting 06:13:04 (6284): No heartbeat from core client for 30 sec - exiting 06:13:05 (6284): No heartbeat from core client for 30 sec - exiting 06:13:06 (6284): No heartbeat from core client for 30 sec - exiting 06:13:07 (6284): No heartbeat from core client for 30 sec - exiting 06:13:08 (6284): No heartbeat from core client for 30 sec - exiting 06:13:09 (6284): No heartbeat from core client for 30 sec - exiting 06:13:10 (6284): No heartbeat from core client for 30 sec - exiting 06:13:11 (6284): No heartbeat from core client for 30 sec - exiting 06:13:12 (6284): No heartbeat from core client for 30 sec - exiting 06:13:13 (6284): No heartbeat from core client for 30 sec - exiting 06:13:14 (6284): No heartbeat from core client for 30 sec - exiting 06:13:15 (6284): No heartbeat from core client for 30 sec - exiting 06:13:16 (6284): No heartbeat from core client for 30 sec - exiting 06:13:17 (6284): No heartbeat from core client for 30 sec - exiting 06:13:18 (6284): No heartbeat from core client for 30 sec - exiting 06:13:19 (6284): No heartbeat from core client for 30 sec - exiting 06:13:20 (6284): No heartbeat from core client for 30 sec - exiting 06:13:21 (6284): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:13:22 (6284): No heartbeat from core client for 30 sec - exiting 08:21:15 (4968): No heartbeat from core client for 30 sec - exiting 08:21:17 (4968): No heartbeat from core client for 30 sec - exiting 08:21:18 (4968): No heartbeat from core client for 30 sec - exiting 08:21:19 (4968): No heartbeat from core client for 30 sec - exiting 08:21:20 (4968): No heartbeat from core client for 30 sec - exiting 08:21:21 (4968): No heartbeat from core client for 30 sec - exiting 08:21:22 (4968): No heartbeat from core client for 30 sec - exiting 08:21:23 (4968): No heartbeat from core client for 30 sec - exiting 08:21:24 (4968): No heartbeat from core client for 30 sec - exiting 08:21:25 (4968): No heartbeat from core client for 30 sec - exiting 08:21:26 (4968): No heartbeat from core client for 30 sec - exiting 08:21:27 (4968): No heartbeat from core client for 30 sec - exiting 08:21:29 (4968): No heartbeat from core client for 30 sec - exiting 08:21:30 (4968): No heartbeat from core client for 30 sec - exiting 08:21:31 (4968): No heartbeat from core client for 30 sec - exiting 08:21:32 (4968): No heartbeat from core client for 30 sec - exiting 08:21:33 (4968): No heartbeat from core client for 30 sec - exiting 08:21:34 (4968): No heartbeat from core client for 30 sec - exiting 08:21:35 (4968): No heartbeat from core client for 30 sec - exiting 08:21:36 (4968): No heartbeat from core client for 30 sec - exiting 08:21:37 (4968): No heartbeat from core client for 30 sec - exiting 08:21:38 (4968): No heartbeat from core client for 30 sec - exiting 08:21:39 (4968): No heartbeat from core client for 30 sec - exiting 08:21:41 (4968): No heartbeat from core client for 30 sec - exiting 08:21:42 (4968): No heartbeat from core client for 30 sec - exiting 08:21:43 (4968): No heartbeat from core client for 30 sec - exiting 08:21:44 (4968): No heartbeat from core client for 30 sec - exiting 08:21:45 (4968): No heartbeat from core client for 30 sec - exiting 08:21:46 (4968): No heartbeat from core client for 30 sec - exiting 08:21:47 (4968): No heartbeat from core client for 30 sec - exiting 08:21:48 (4968): No heartbeat from core client for 30 sec - exiting 08:21:49 (4968): No heartbeat from core client for 30 sec - exiting 08:21:50 (4968): No heartbeat from core client for 30 sec - exiting 08:21:52 (4968): No heartbeat from core client for 30 sec - exiting 08:21:53 (4968): No heartbeat from core client for 30 sec - exiting 08:21:54 (4968): No heartbeat from core client for 30 sec - exiting 08:21:55 (4968): No heartbeat from core client for 30 sec - exiting 08:21:56 (4968): No heartbeat from core client for 30 sec - exiting 08:21:57 (4968): No heartbeat from core client for 30 sec - exiting 08:21:58 (4968): No heartbeat from core client for 30 sec - exiting 08:21:59 (4968): No heartbeat from core client for 30 sec - exiting 08:22:00 (4968): No heartbeat from core client for 30 sec - exiting 08:22:01 (4968): No heartbeat from core client for 30 sec - exiting 08:22:02 (4968): No heartbeat from core client for 30 sec - exiting 08:22:04 (4968): No heartbeat from core client for 30 sec - exiting 08:22:05 (4968): No heartbeat from core client for 30 sec - exiting 08:22:06 (4968): No heartbeat from core client for 30 sec - exiting 08:22:07 (4968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:22:08 (4968): No heartbeat from core client for 30 sec - exiting 08:22:09 (4968): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2292, iMonCtr=1 Model crash detected, will try to restart... 17:17:41 (5124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1228, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4384, iMonCtr=1 Model crash detected, will try to restart... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
24 Aug 2012 18:32:54	1219282	14733043	hadcm3n_o0fx_2060_40_007998291_3	1,036,800	1,599,302	1.5425
24 Aug 2012 08:21:09	1219282	14733043	hadcm3n_o0fx_2060_40_007998291_3	1,010,880	1,562,213	1.5454
23 Aug 2012 20:22:34	1219282	14733043	hadcm3n_o0fx_2060_40_007998291_3	984,960	1,524,306	1.5476
23 Aug 2012 00:19:28	1219282	14733043	hadcm3n_o0fx_2060_40_007998291_3	959,040	1,486,744	1.5502
22 Aug 2012 14:42:46	1219282	14733043	hadcm3n_o0fx_2060_40_007998291_3	933,120	1,449,990	1.5539
21 Aug 2012 18:02:15	1219282	14733043	hadcm3n_o0fx_2060_40_007998291_3	907,200	1,412,593	1.5571
21 Aug 2012 05:34:11	1219282	14733043	hadcm3n_o0fx_2060_40_007998291_3	881,280	1,374,858	1.5601
20 Aug 2012 19:04:02	1219282	14733043	hadcm3n_o0fx_2060_40_007998291_3	855,360	1,337,660	1.5639
20 Aug 2012 07:09:10	1219282	14733043	hadcm3n_o0fx_2060_40_007998291_3	829,440	1,300,065	1.5674
19 Aug 2012 04:03:18	1219282	14733043	hadcm3n_o0fx_2060_40_007998291_3	803,520	1,262,721	1.5715
18 Aug 2012 01:57:53	1219282	14733043	hadcm3n_o0fx_2060_40_007998291_3	777,600	1,225,081	1.5755
17 Aug 2012 03:23:51	1219282	14733043	hadcm3n_o0fx_2060_40_007998291_3	751,680	1,187,641	1.5800
09 Aug 2012 14:37:21	1219282	14733043	hadcm3n_o0fx_2060_40_007998291_3	725,760	1,148,262	1.5822
08 Aug 2012 16:17:39	1219282	14733043	hadcm3n_o0fx_2060_40_007998291_3	699,840	1,107,545	1.5826
07 Aug 2012 07:04:08	1219282	14733043	hadcm3n_o0fx_2060_40_007998291_3	673,920	1,066,598	1.5827
06 Aug 2012 19:31:19	1219282	14733043	hadcm3n_o0fx_2060_40_007998291_3	648,000	1,025,742	1.5829
06 Aug 2012 05:18:17	1219282	14733043	hadcm3n_o0fx_2060_40_007998291_3	622,080	985,540	1.5843
05 Aug 2012 17:12:12	1219282	14733043	hadcm3n_o0fx_2060_40_007998291_3	596,160	947,728	1.5897
04 Aug 2012 10:10:43	1219282	14733043	hadcm3n_o0fx_2060_40_007998291_3	570,240	909,311	1.5946
02 Aug 2012 13:17:32	1219282	14733043	hadcm3n_o0fx_2060_40_007998291_3	544,320	871,468	1.6010