Task 15812467

Name	hadcm3n_o43d_1940_40_008381231_0
Workunit	8532090
Created	1 Jun 2013, 0:39:20 UTC
Sent	15 Jun 2013, 6:24:46 UTC
Report deadline	14 Sep 2013, 13:51:57 UTC
Received	14 Aug 2013, 17:08:33 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1231345
Run time	21 days 12 hours 22 min 59 sec
CPU time	20 days 4 hours 2 min 33 sec
Validate state	Valid
Credit	12,441.60
Device peak FLOPS	2.30 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:07:14 (1384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:07:15 (1384): No heartbeat from core client for 30 sec - exiting 21:07:16 (1384): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:55:42 (8428): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:01:16 (12328): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 00:01:17 (12328): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 07:26:33 (12044): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 20:23:11 (11768): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:20:34 (348): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:41:57 (4152): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 11:41:59 (4152): No heartbeat from core client for 30 sec - exiting 11:42:00 (4152): No heartbeat from core client for 30 sec - exiting 11:42:01 (4152): No heartbeat from core client for 30 sec - exiting 11:42:02 (4152): No heartbeat from core client for 30 sec - exiting 11:42:03 (4152): No heartbeat from core client for 30 sec - exiting 11:42:04 (4152): No heartbeat from core client for 30 sec - exiting 11:42:05 (4152): No heartbeat from core client for 30 sec - exiting 11:42:06 (4152): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:05:43 (8012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:05:44 (8012): No heartbeat from core client for 30 sec - exiting 06:05:45 (8012): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 02:00:38 (4308): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 02:00:39 (4308): No heartbeat from core client for 30 sec - exiting 02:00:40 (4308): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:06:42 (4204): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 22:06:43 (4204): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 03:12:51 (4276): No heartbeat from core client for 30 sec - exiting 03:12:53 (4276): No heartbeat from core client for 30 sec - exiting 03:12:54 (4276): No heartbeat from core client for 30 sec - exiting 03:12:55 (4276): No heartbeat from core client for 30 sec - exiting 03:12:56 (4276): No heartbeat from core client for 30 sec - exiting 03:12:57 (4276): No heartbeat from core client for 30 sec - exiting 03:12:58 (4276): No heartbeat from core client for 30 sec - exiting 03:12:59 (4276): No heartbeat from core client for 30 sec - exiting 03:13:00 (4276): No heartbeat from core client for 30 sec - exiting 03:13:01 (4276): No heartbeat from core client for 30 sec - exiting 03:13:02 (4276): No heartbeat from core client for 30 sec - exiting 03:13:03 (4276): No heartbeat from core client for 30 sec - exiting 03:13:05 (4276): No heartbeat from core client for 30 sec - exiting 03:13:06 (4276): No heartbeat from core client for 30 sec - exiting 03:13:07 (4276): No heartbeat from core client for 30 sec - exiting 03:13:08 (4276): No heartbeat from core client for 30 sec - exiting 03:13:09 (4276): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:16:27 (3208): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:06:09 (5664): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9720, iMonCtr=1 Model crash detected, will try to restart... 03:16:55 (5120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:18:00 (5596): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:21:10 (5792): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:14:20 (3496): No heartbeat from core client for 30 sec - exiting 03:14:21 (3496): No heartbeat from core client for 30 sec - exiting 03:14:22 (3496): No heartbeat from core client for 30 sec - exiting 03:14:23 (3496): No heartbeat from core client for 30 sec - exiting 03:14:24 (3496): No heartbeat from core client for 30 sec - exiting 03:14:26 (3496): No heartbeat from core client for 30 sec - exiting 03:14:27 (3496): No heartbeat from core client for 30 sec - exiting 03:14:28 (3496): No heartbeat from core client for 30 sec - exiting 03:14:29 (3496): No heartbeat from core client for 30 sec - exiting 03:14:30 (3496): No heartbeat from core client for 30 sec - exiting 03:14:31 (3496): No heartbeat from core client for 30 sec - exiting 03:14:32 (3496): No heartbeat from core client for 30 sec - exiting 03:14:33 (3496): No heartbeat from core client for 30 sec - exiting 03:14:34 (3496): No heartbeat from core client for 30 sec - exiting 03:14:35 (3496): No heartbeat from core client for 30 sec - exiting 03:14:36 (3496): No heartbeat from core client for 30 sec - exiting 03:14:38 (3496): No heartbeat from core client for 30 sec - exiting 03:14:39 (3496): No heartbeat from core client for 30 sec - exiting 03:14:40 (3496): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:14:41 (3496): No heartbeat from core client for 30 sec - exiting 03:14:42 (3496): No heartbeat from core client for 30 sec - exiting 03:14:43 (3496): No heartbeat from core client for 30 sec - exiting 03:14:44 (3496): No heartbeat from core client for 30 sec - exiting 03:14:45 (3496): No heartbeat from core client for 30 sec - exiting 03:14:46 (3496): No heartbeat from core client for 30 sec - exiting 03:14:47 (3496): No heartbeat from core client for 30 sec - exiting 03:14:48 (3496): No heartbeat from core client for 30 sec - exiting 03:16:48 (4444): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:20:32 (4284): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:20:33 (4284): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:03:30 (6280): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5272, iMonCtr=1 Model crash detected, will try to restart... 03:14:27 (5564): No heartbeat from core client for 30 sec - exiting 03:14:28 (5564): No heartbeat from core client for 30 sec - exiting 03:14:30 (5564): No heartbeat from core client for 30 sec - exiting 03:14:31 (5564): No heartbeat from core client for 30 sec - exiting 03:14:32 (5564): No heartbeat from core client for 30 sec - exiting 03:14:33 (5564): No heartbeat from core client for 30 sec - exiting 03:14:34 (5564): No heartbeat from core client for 30 sec - exiting 03:14:35 (5564): No heartbeat from core client for 30 sec - exiting 03:14:36 (5564): No heartbeat from core client for 30 sec - exiting 03:14:37 (5564): No heartbeat from core client for 30 sec - exiting 03:14:38 (5564): No heartbeat from core client for 30 sec - exiting 03:14:39 (5564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:19:23 (4412): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:40:38 (4232): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 19:40:39 (4232): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:12:46 (5512): No heartbeat from core client for 30 sec - exiting 03:12:47 (5512): No heartbeat from core client for 30 sec - exiting 03:12:48 (5512): No heartbeat from core client for 30 sec - exiting 03:12:49 (5512): No heartbeat from core client for 30 sec - exiting 03:12:50 (5512): No heartbeat from core client for 30 sec - exiting 03:12:51 (5512): No heartbeat from core client for 30 sec - exiting 03:12:52 (5512): No heartbeat from core client for 30 sec - exiting 03:12:53 (5512): No heartbeat from core client for 30 sec - exiting 03:12:54 (5512): No heartbeat from core client for 30 sec - exiting 03:12:55 (5512): No heartbeat from core client for 30 sec - exiting 03:12:56 (5512): No heartbeat from core client for 30 sec - exiting 03:12:58 (5512): No heartbeat from core client for 30 sec - exiting 03:12:59 (5512): No heartbeat from core client for 30 sec - exiting 03:13:00 (5512): No heartbeat from core client for 30 sec - exiting 03:13:01 (5512): No heartbeat from core client for 30 sec - exiting 03:13:02 (5512): No heartbeat from core client for 30 sec - exiting 03:13:03 (5512): No heartbeat from core client for 30 sec - exiting 03:13:04 (5512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:16:40 (1072): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:04:27 (6056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:04:28 (6056): No heartbeat from core client for 30 sec - exiting 22:04:29 (6056): No heartbeat from core client for 30 sec - exiting 22:05:51 (2892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CSuspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:20:34 (4712): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:20:35 (4712): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:18:21 (976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:20:34 (756): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:13:06 (4784): No heartbeat from core client for 30 sec - exiting 03:13:07 (4784): No heartbeat from core client for 30 sec - exiting 03:13:08 (4784): No heartbeat from core client for 30 sec - exiting 03:13:09 (4784): No heartbeat from core client for 30 sec - exiting 03:13:10 (4784): No heartbeat from core client for 30 sec - exiting 03:13:11 (4784): No heartbeat from core client for 30 sec - exiting 03:13:12 (4784): No heartbeat from core client for 30 sec - exiting 03:13:13 (4784): No heartbeat from core client for 30 sec - exiting 03:13:15 (4784): No heartbeat from core client for 30 sec - exiting 03:13:16 (4784): No heartbeat from core client for 30 sec - exiting 03:13:17 (4784): No heartbeat from core client for 30 sec - exiting 03:13:18 (4784): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:13:19 (4784): No heartbeat from core client for 30 sec - exiting 03:15:20 (5796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:42:36 (6536): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 23:42:37 (6536): No heartbeat from core client for 30 sec - exiting 23:42:38 (6536): No heartbeat from core client for 30 sec - exiting 23:42:39 (6536):Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7796, iMonCtr=1 Model crash detected, will try to restart... 03:16:50 (2448): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:19:14 (3932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:01:06 (3776): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 03:01:07 (3776): No heartbeat from core client for 30 sec - exiting 03:13:57 (6108): No heartbeat from core client for 30 sec - exiting 03:13:58 (6108): No heartbeat from core client for 30 sec - exiting 03:13:59 (6108): No heartbeat from core client for 30 sec - exiting 03:14:00 (6108): No heartbeat from core client for 30 sec - exiting 03:14:01 (6108): No heartbeat from core client for 30 sec - exiting 03:14:02 (6108): No heartbeat from core client for 30 sec - exiting 03:14:03 (6108): No heartbeat from core client for 30 sec - exiting 03:14:04 (6108): No heartbeat from core client for 30 sec - exiting 03:14:06 (6108): No heartbeat from core client for 30 sec - exiting 03:14:07 (6108): No heartbeat from core client for 30 sec - exiting 03:14:08 (6108): No heartbeat from core client for 30 sec - exiting 03:14:09 (6108): No heartbeat from core client for 30 sec - exiting 03:14:10 (6108): No heartbeat from core client for 30 sec - exiting 03:14:11 (6108): No heartbeat from core client for 30 sec - exiting 03:14:12 (6108): No heartbeat from core client for 30 sec - exiting 03:14:13 (6108): No heartbeat from core client for 30 sec - exiting 03:14:14 (6108): No heartbeat from core client for 30 sec - exiting 03:14:15 (6108): No heartbeat from core client for 30 sec - exiting 03:14:17 (6108): No heartbeat from core client for 30 sec - exiting 03:14:18 (6108): No heartbeat from core client for 30 sec - exiting 03:14:19 (6108): No heartbeat from core client for 30 sec - exiting 03:14:20 (6108): No heartbeat from core client for 30 sec - exiting 03:14:21 (6108): No heartbeat from core client for 30 sec - exiting 03:14:22 (6108): No heartbeat from core client for 30 sec - exiting 03:14:23 (6108): No heartbeat from core client for 30 sec - exiting 03:14:24 (6108): No heartbeat from core client for 30 sec - exiting 03:14:25 (6108): No heartbeat from core client for 30 sec - exiting 03:14:26 (6108): No heartbeat from core client for 30 sec - exiting 03:14:28 (6108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:14:29 (6108): No heartbeat from core client for 30 sec - exiting 03:16:58 (6036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4476, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5852, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5852, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5852, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5948, iMonCtr=1 Model crash detected, will try to restart... 03:12:57 (4956): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:15:50 (2396): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:05:59 (5360): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:06:01 (5360): No heartbeat from core client for 30 sec - exiting 14:06:02 (5360): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:57:28 (4448): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:57:29 (4448): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3124, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2572, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:09:13 (2892): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 11:09:15 (2892): No heartbeat from core client for 30 sec - exiting 11:09:16 (2892): No heartbeat from core client for 30 sec - exiting 11:09:17 (2892): No heartbeat from core client for 30 sec - exiting Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
14 Aug 2013 17:14:49	1231345	15812467	hadcm3n_o43d_1940_40_008381231_0	1,036,800	1,741,934	1.6801
14 Aug 2013 17:14:49	1231345	15812467	hadcm3n_o43d_1940_40_008381231_0	1,010,880	1,699,001	1.6807
14 Aug 2013 17:14:48	1231345	15812467	hadcm3n_o43d_1940_40_008381231_0	984,960	1,656,504	1.6818
14 Aug 2013 17:14:48	1231345	15812467	hadcm3n_o43d_1940_40_008381231_0	959,040	1,613,853	1.6828
14 Aug 2013 17:14:48	1231345	15812467	hadcm3n_o43d_1940_40_008381231_0	933,120	1,571,187	1.6838
14 Aug 2013 17:14:48	1231345	15812467	hadcm3n_o43d_1940_40_008381231_0	907,200	1,527,655	1.6839
14 Aug 2013 17:14:48	1231345	15812467	hadcm3n_o43d_1940_40_008381231_0	881,280	1,484,389	1.6844
14 Aug 2013 17:14:48	1231345	15812467	hadcm3n_o43d_1940_40_008381231_0	855,360	1,440,229	1.6838
14 Aug 2013 17:14:48	1231345	15812467	hadcm3n_o43d_1940_40_008381231_0	829,440	1,395,953	1.6830
14 Aug 2013 17:14:48	1231345	15812467	hadcm3n_o43d_1940_40_008381231_0	803,520	1,351,852	1.6824
14 Aug 2013 17:14:48	1231345	15812467	hadcm3n_o43d_1940_40_008381231_0	777,600	1,307,559	1.6815
14 Aug 2013 17:14:48	1231345	15812467	hadcm3n_o43d_1940_40_008381231_0	751,680	1,264,317	1.6820
14 Aug 2013 17:14:48	1231345	15812467	hadcm3n_o43d_1940_40_008381231_0	725,760	1,221,699	1.6833
26 Jul 2013 05:46:23	1231345	15812467	hadcm3n_o43d_1940_40_008381231_0	699,840	1,179,178	1.6849
24 Jul 2013 22:45:07	1231345	15812467	hadcm3n_o43d_1940_40_008381231_0	673,920	1,135,347	1.6847
23 Jul 2013 21:58:45	1231345	15812467	hadcm3n_o43d_1940_40_008381231_0	648,000	1,090,561	1.6830
23 Jul 2013 21:22:11	1231345	15812467	hadcm3n_o43d_1940_40_008381231_0	622,080	1,045,765	1.6811
23 Jul 2013 20:19:11	1231345	15812467	hadcm3n_o43d_1940_40_008381231_0	596,160	1,001,883	1.6806
23 Jul 2013 14:43:45	1231345	15812467	hadcm3n_o43d_1940_40_008381231_0	570,240	958,561	1.6810
23 Jul 2013 14:43:45	1231345	15812467	hadcm3n_o43d_1940_40_008381231_0	544,320	913,429	1.6781