Task 15689823

Name	hadcm3n_u3jq_2020_40_008339314_0
Workunit	8490175
Created	28 Mar 2013, 17:54:39 UTC
Sent	28 Mar 2013, 17:56:45 UTC
Report deadline	28 Jun 2013, 1:23:56 UTC
Received	16 May 2013, 15:30:08 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1186953
Run time	10 days 2 hours 24 min 36 sec
CPU time	9 days 9 hours 1 min 6 sec
Validate state	Invalid
Credit	5,598.72
Device peak FLOPS	2.35 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> N Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5280, iMonCtr=1 Model crash detected, will try to restart... 16:52:53 (5008): No heartbeat from core client for 30 sec - exiting 16:52:54 (5008): No heartbeat from core client for 30 sec - exiting 16:52:55 (5008): No heartbeat from core client for 30 sec - exiting 16:52:56 (5008): No heartbeat from core client for 30 sec - exiting 16:52:57 (5008): No heartbeat from core client for 30 sec - exiting 16:52:58 (5008): No heartbeat from core client for 30 sec - exiting 16:52:59 (5008): No heartbeat from core client for 30 sec - exiting 16:53:00 (5008): No heartbeat from core client for 30 sec - exiting 16:53:01 (5008): No heartbeat from core client for 30 sec - exiting 16:53:02 (5008): No heartbeat from core client for 30 sec - exiting 16:53:03 (5008): No heartbeat from core client for 30 sec - exiting 16:53:04 (5008): No heartbeat from core client for 30 sec - exiting 16:53:05 (5008): No heartbeat from core client for 30 sec - exiting 16:53:06 (5008): No heartbeat from core client for 30 sec - exiting 16:53:07 (5008): No heartbeat from core client for 30 sec - exiting 16:53:08 (5008): No heartbeat from core client for 30 sec - exiting 16:53:09 (5008): No heartbeat from core client for 30 sec - exiting 16:53:10 (5008): No heartbeat from core client for 30 sec - exiting 16:53:11 (5008): No heartbeat from core client for 30 sec - exiting 16:53:12 (5008): No heartbeat from core client for 30 sec - exiting 16:53:13 (5008): No heartbeat from core client for 30 sec - exiting 16:53:14 (5008): No heartbeat from core client for 30 sec - exiting 16:53:15 (5008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:56:24 (5940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:47:53 (5156): No heartbeat from core client for 30 sec - exiting 18:47:54 (5156): No heartbeat from core client for 30 sec - exiting 18:47:55 (5156): No heartbeat from core client for 30 sec - exiting 18:47:56 (5156): No heartbeat from core client for 30 sec - exiting 18:47:57 (5156): No heartbeat from core client for 30 sec - exiting 18:47:58 (5156): No heartbeat from core client for 30 sec - exiting 18:47:59 (5156): No heartbeat from core client for 30 sec - exiting 18:48:00 (5156): No heartbeat from core client for 30 sec - exiting 18:48:01 (5156): No heartbeat from core client for 30 sec - exiting 18:48:02 (5156): No heartbeat from core client for 30 sec - exiting 18:48:03 (5156): No heartbeat from core client for 30 sec - exiting 18:48:04 (5156): No heartbeat from core client for 30 sec - exiting 18:48:05 (5156): No heartbeat from core client for 30 sec - exiting 18:48:06 (5156): No heartbeat from core client for 30 sec - exiting 18:48:07 (5156): No heartbeat from core client for 30 sec - exiting 18:48:08 (5156): No heartbeat from core client for 30 sec - exiting 18:48:09 (5156): No heartbeat from core client for 30 sec - exiting 18:48:10 (5156): No heartbeat from core client for 30 sec - exiting 18:48:11 (5156): No heartbeat from core client for 30 sec - exiting 18:48:12 (5156): No heartbeat from core client for 30 sec - exiting 18:48:13 (5156): No heartbeat from core client for 30 sec - exiting 18:48:14 (5156): No heartbeat from core client for 30 sec - exiting 18:48:15 (5156): No heartbeat from core client for 30 sec - exiting 18:48:16 (5156): No heartbeat from core client for 30 sec - exiting 18:48:17 (5156): No heartbeat from core client for 30 sec - exiting 18:48:18 (5156): No heartbeat from core client for 30 sec - exiting 18:48:19 (5156): No heartbeat from core client for 30 sec - exiting 18:48:20 (5156): No heartbeat from core client for 30 sec - exiting 18:48:21 (5156): No heartbeat from core client for 30 sec - exiting 18:48:22 (5156): No heartbeat from core client for 30 sec - exiting 18:48:23 (5156): No heartbeat from core client for 30 sec - exiting 18:48:24 (5156): No heartbeat from core client for 30 sec - exiting 18:48:25 (5156): No heartbeat from core client for 30 sec - exiting 18:48:26 (5156): No heartbeat from core client for 30 sec - exiting 18:48:27 (5156): No heartbeat from core client for 30 sec - exiting 18:48:28 (5156): No heartbeat from core client for 30 sec - exiting 18:48:29 (5156): No heartbeat from core client for 30 sec - exiting 18:48:30 (5156): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:45:27 (5636): No heartbeat from core client for 30 sec - exiting 19:45:28 (5636): No heartbeat from core client for 30 sec - exiting 19:45:29 (5636): No heartbeat from core client for 30 sec - exiting 19:45:30 (5636): No heartbeat from core client for 30 sec - exiting 19:45:31 (5636): No heartbeat from core client for 30 sec - exiting 19:45:32 (5636): No heartbeat from core client for 30 sec - exiting 19:45:33 (5636): No heartbeat from core client for 30 sec - exiting 19:45:34 (5636): No heartbeat from core client for 30 sec - exiting 19:45:35 (5636): No heartbeat from core client for 30 sec - exiting 19:45:36 (5636): No heartbeat from core client for 30 sec - exiting 19:45:37 (5636): No heartbeat from core client for 30 sec - exiting 19:45:38 (5636): No heartbeat from core client for 30 sec - exiting 19:45:39 (5636): No heartbeat from core client for 30 sec - exiting 19:45:40 (5636): No heartbeat from core client for 30 sec - exiting 19:45:41 (5636): No heartbeat from core client for 30 sec - exiting 19:45:42 (5636): No heartbeat from core client for 30 sec - exiting 19:45:43 (5636): No heartbeat from core client for 30 sec - exiting 19:45:44 (5636): No heartbeat from core client for 30 sec - exiting 19:45:45 (5636): No heartbeat from core client for 30 sec - exiting 19:45:46 (5636): No heartbeat from core client for 30 sec - exiting 19:45:47 (5636): No heartbeat from core client for 30 sec - exiting 19:45:48 (5636): No heartbeat from core client for 30 sec - exiting 19:45:49 (5636): No heartbeat from core client for 30 sec - exiting 19:45:50 (5636): No heartbeat from core client for 30 sec - exiting 19:45:51 (5636): No heartbeat from core client for 30 sec - exiting 19:45:52 (5636): No heartbeat from core client for 30 sec - exiting 19:45:53 (5636): No heartbeat from core client for 30 sec - exiting 19:45:54 (5636): No heartbeat from core client for 30 sec - exiting 19:45:55 (5636): No heartbeat from core client for 30 sec - exiting 19:45:56 (5636): No heartbeat from core client for 30 sec - exiting 19:45:57 (5636): No heartbeat from core client for 30 sec - exiting 19:45:58 (5636): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:48:06 (1140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=488, iMonCtr=1 Model crash detected, will try to restart... 17:22:51 (5820): No heartbeat from core client for 30 sec - exiting 17:22:52 (5820): No heartbeat from core client for 30 sec - exiting 17:22:53 (5820): No heartbeat from core client for 30 sec - exiting 17:22:54 (5820): No heartbeat from core client for 30 sec - exiting 17:22:55 (5820): No heartbeat from core client for 30 sec - exiting 17:22:56 (5820): No heartbeat from core client for 30 sec - exiting 17:22:57 (5820): No heartbeat from core client for 30 sec - exiting 17:22:58 (5820): No heartbeat from core client for 30 sec - exiting 17:22:59 (5820): No heartbeat from core client for 30 sec - exiting 17:23:00 (5820): No heartbeat from core client for 30 sec - exiting 17:23:01 (5820): No heartbeat from core client for 30 sec - exiting 17:23:02 (5820): No heartbeat from core client for 30 sec - exiting 17:23:03 (5820): No heartbeat from core client for 30 sec - exiting 17:23:04 (5820): No heartbeat from core client for 30 sec - exiting 17:23:05 (5820): No heartbeat from core client for 30 sec - exiting 17:23:06 (5820): No heartbeat from core client for 30 sec - exiting 17:23:07 (5820): No heartbeat from core client for 30 sec - exiting 17:23:08 (5820): No heartbeat from core client for 30 sec - exiting 17:23:09 (5820): No heartbeat from core client for 30 sec - exiting 17:23:10 (5820): No heartbeat from core client for 30 sec - exiting 17:23:11 (5820): No heartbeat from core client for 30 sec - exiting 17:23:12 (5820): No heartbeat from core client for 30 sec - exiting 17:23:13 (5820): No heartbeat from core client for 30 sec - exiting 17:23:14 (5820): No heartbeat from core client for 30 sec - exiting 17:23:15 (5820): No heartbeat from core client for 30 sec - exiting 17:23:16 (5820): No heartbeat from core client for 30 sec - exiting 17:23:17 (5820): No heartbeat from core client for 30 sec - exiting 17:23:18 (5820): No heartbeat from core client for 30 sec - exiting 17:23:19 (5820): No heartbeat from core client for 30 sec - exiting 17:23:20 (5820): No heartbeat from core client for 30 sec - exiting 17:23:21 (5820): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:24:13 (4600): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exi08:13:38 (5144): No heartbeat from core client for 30 sec - exiting 08:13:39 (5144): No heartbeat from core client for 30 sec - exiting 08:13:40 (5144): No heartbeat from core client for 30 sec - exiting 08:13:41 (5144): No heartbeat from core client for 30 sec - exiting 08:13:42 (5144): No heartbeat from core client for 30 sec - exiting 08:13:43 (5144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:42:23 (5052): No heartbeat from core client for 30 sec - exiting 13:42:24 (5052): No heartbeat from core client for 30 sec - exiting 13:42:25 (5052): No heartbeat from core client for 30 sec - exiting 13:42:26 (5052): No heartbeat from core client for 30 sec - exiting 13:42:27 (5052): No heartbeat from core client for 30 sec - exiting 13:42:28 (5052): No heartbeat from core client for 30 sec - exiting 13:42:29 (5052): No heartbeat from core client for 30 sec - exiting 13:42:30 (5052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:44:43 (5888): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:03:49 (4680): No heartbeat from core client for 30 sec - exiting 19:03:50 (4680): No heartbeat from core client for 30 sec - exiting 19:03:51 (4680): No heartbeat from core client for 30 sec - exiting 19:03:52 (4680): No heartbeat from core client for 30 sec - exiting 19:03:53 (4680): No heartbeat from core client for 30 sec - exiting 19:03:54 (4680): No heartbeat from core client for 30 sec - exiting 19:03:55 (4680): No heartbeat from core client for 30 sec - exiting 19:03:56 (4680): No heartbeat from core client for 30 sec - exiting 19:03:57 (4680): No heartbeat from core client for 30 sec - exiting 19:03:58 (4680): No heartbeat from core client for 30 sec - exiting 19:03:59 (4680): No heartbeat from core client for 30 sec - exiting 19:04:00 (4680): No heartbeat from core client for 30 sec - exiting 19:04:01 (4680): No heartbeat from core client for 30 sec - exiting 19:04:02 (4680): No heartbeat from core client for 30 sec - exiting 19:04:03 (4680): No heartbeat from core client for 30 sec - exiting 19:04:04 (4680): No heartbeat from core client for 30 sec - exiting 19:04:05 (4680): No heartbeat from core client for 30 sec - exiting 19:04:06 (4680): No heartbeat from core client for 30 sec - exiting 19:04:07 (4680): No heartbeat from core client for 30 sec - exiting 19:04:08 (4680): No heartbeat from core client for 30 sec - exiting 19:04:09 (4680): No heartbeat from core client for 30 sec - exiting 19:04:10 (4680): No heartbeat from core client for 30 sec - exiting 19:04:11 (4680): No heartbeat from core client for 30 sec - exiting 19:04:12 (4680): No heartbeat from core client for 30 sec - exiting 19:04:13 (4680): No heartbeat from core client for 30 sec - exiting 19:04:14 (4680): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:06:03 (4984): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:08:28 (1700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6124, iMonCtr=1 Model crash detected, will try to restart... 17:19:13 (5040): No heartbeat from core client for 30 sec - exiting 17:19:15 (5040): No heartbeat from core client for 30 sec - exiting 17:19:16 (5040): No heartbeat from core client for 30 sec - exiting 17:19:17 (5040): No heartbeat from core client for 30 sec - exiting 17:19:18 (5040): No heartbeat from core client for 30 sec - exiting 17:19:19 (5040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:21:41 (4332): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... C17:13:39 (5380): No heartbeat from core client for 30 sec - exiting 17:13:40 (5380): No heartbeat from core client for 30 sec - exiting 17:13:41 (5380): No heartbeat from core client for 30 sec - exiting 17:13:42 (5380): No heartbeat from core client for 30 sec - exiting 17:13:43 (5380): No heartbeat from core client for 30 sec - exiting 17:13:44 (5380): No heartbeat from core client for 30 sec - exiting 17:13:45 (5380): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4348, iMonCtr=1 Model crash detected, will try to restart... 22:39:00 (5760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:41:35 (4212): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5856, iMonCtr=1 Model crash detected, will try to restart... 06:27:37 (4872): No heartbeat from core client for 30 sec - exiting 06:27:38 (4872): No heartbeat from core client for 30 sec - exiting 06:27:39 (4872): No heartbeat from core client for 30 sec - exiting 06:27:40 (4872): No heartbeat from core client for 30 sec - exiting 06:27:41 (4872): No heartbeat from core client for 30 sec - exiting 06:27:42 (4872): No heartbeat from core client for 30 sec - exiting 06:27:43 (4872): No heartbeat from core client for 30 sec - exiting 06:27:44 (4872): No heartbeat from core client for 30 sec - exiting 06:27:45 (4872): No heartbeat from core client for 30 sec - exiting 06:27:46 (4872): No heartbeat from core client for 30 sec - exiting 06:27:47 (4872): No heartbeat from core client for 30 sec - exiting 06:27:48 (4872): No heartbeat from core client for 30 sec - exiting 06:27:49 (4872): No heartbeat from core client for 30 sec - exiting 06:27:50 (4872): No heartbeat from core client for 30 sec - exiting 06:27:51 (4872): No heartbeat from core client for 30 sec - exiting 06:27:52 (4872): No heartbeat from core client for 30 sec - exiting 06:27:53 (4872): No heartbeat from core client for 30 sec - exiting 06:27:54 (4872): No heartbeat from core client for 30 sec - exiting 06:27:55 (4872): No heartbeat from core client for 30 sec - exiting 06:27:56 (4872): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:29:53 (5920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2740, iMonCtr=1 Model crash detected, will try to restart... 13:28:05 (5028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5500, iMonCtr=1 Model crash detected, will try to restart... 17:49:30 (5112): No heartbeat from core client for 30 sec - exiting 17:49:31 (5112): No heartbeat from core client for 30 sec - exiting 17:49:32 (5112): No heartbeat from core client for 30 sec - exiting 17:49:33 (5112): No heartbeat from core client for 30 sec - exiting 17:49:34 (5112): No heartbeat from core client for 30 sec - exiting 17:49:35 (5112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5272, iMonCtr=1 Model crash detected, will try to restart... 18:38:39 (5720): No heartbeat from core client for 30 sec - exiting 18:38:40 (5720): No heartbeat from core client for 30 sec - exiting 18:38:41 (5720): No heartbeat from core client for 30 sec - exiting 18:38:42 (5720): No heartbeat from core client for 30 sec - exiting 18:38:43 (5720): No heartbeat from core client for 30 sec - exiting 18:38:44 (5720): No heartbeat from core client for 30 sec - exiting 18:38:45 (5720): No heartbeat from core client for 30 sec - exiting 18:38:46 (5720): No heartbeat from core client for 30 sec - exiting 18:38:47 (5720): No heartbeat from core client for 30 sec - exiting 18:38:48 (5720): No heartbeat from core client for 30 sec - exiting 18:38:49 (5720): No heartbeat from core client for 30 sec - exiting 18:38:50 (5720): No heartbeat from core client for 30 sec - exiting 18:38:51 (5720): No heartbeat from core client for 30 sec - exiting 18:38:52 (5720): No heartbeat from core client for 30 sec - exiting 18:38:53 (5720): No heartbeat from core client for 30 sec - exiting 18:38:54 (5720): No heartbeat from core client for 30 sec - exiting 18:38:55 (5720): No heartbeat from core client for 30 sec - exiting 18:38:56 (5720): No heartbeat from core client for 30 sec - exiting 18:38:57 (5720): No heartbeat from core client for 30 sec - exiting 18:38:58 (5720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:41:05 (3328): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:05:06 (5168): No heartbeat from core client for 30 sec - exiting 07:05:07 (5168): No heartbeat from core client for 30 sec - exiting 07:05:08 (5168): No heartbeat from core client for 30 sec - exiting 07:05:09 (5168): No heartbeat from core client for 30 sec - exiting 07:05:10 (5168): No heartbeat from core client for 30 sec - exiting 07:05:11 (5168): No heartbeat from core client for 30 sec - exiting 07:05:12 (5168): No heartbeat from core client for 30 sec - exiting 07:05:13 (5168): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:07:27 (5800): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3864, iMonCtr=1 Model crash detected, will try to restart... 14:29:09 (4556): No heartbeat from core client for 30 sec - exiting 14:29:10 (4556): No heartbeat from core client for 30 sec - exiting 14:29:11 (4556): No heartbeat from core client for 30 sec - exiting 14:29:12 (4556): No heartbeat from core client for 30 sec - exiting 14:29:13 (4556): No heartbeat from core client for 30 sec - exiting 14:29:14 (4556): No heartbeat from core client for 30 sec - exiting 14:29:15 (4556): No heartbeat from core client for 30 sec - exiting 14:29:16 (4556): No heartbeat from core client for 30 sec - exiting 14:29:17 (4556): No heartbeat from core client for 30 sec - exiting 14:29:18 (4556): No heartbeat from core client for 30 sec - exiting 14:29:19 (4556): No heartbeat from core client for 30 sec - exiting 14:29:20 (4556): No heartbeat from core client for 30 sec - exiting 14:29:21 (4556): No heartbeat from core client for 30 sec - exiting 14:29:22 (4556): No heartbeat from core client for 30 sec - exiting 14:29:23 (4556): No heartbeat from core client for 30 sec - exiting 14:29:24 (4556): No heartbeat from core client for 30 sec - exiting 14:29:25 (4556): No heartbeat from core client for 30 sec - exiting 14:29:26 (4556): No heartbeat from core client for 30 sec - exiting 14:29:27 (4556): No heartbeat from core client for 30 sec - exiting 14:29:28 (4556): No heartbeat from core client for 30 sec - exiting 14:29:29 (4556): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:30:45 (5440): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:46:51 (5216): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:49:10 (5980): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4272, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4272, iMonCtr=1 Model crash detected, will try to restart... 18:46:22 (5092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:48:41 (5352): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:02:17 (5748): No heartbeat from core client for 30 sec - exiting 19:02:18 (5748): No heartbeat from core client for 30 sec - exiting 19:02:19 (5748): No heartbeat from core client for 30 sec - exiting 19:02:20 (5748): No heartbeat from core client for 30 sec - exiting 19:02:21 (5748): No heartbeat from core client for 30 sec - exiting 19:02:22 (5748): No heartbeat from core client for 30 sec - exiting 19:02:23 (5748): No heartbeat from core client for 30 sec - exiting 19:02:24 (5748): No heartbeat from core client for 30 sec - exiting 19:02:26 (5748): No heartbeat from core client for 30 sec - exiting 19:02:27 (5748): No heartbeat from core client for 30 sec - exiting 19:02:28 (5748): No heartbeat from core client for 30 sec - exiting 19:02:29 (5748): No heartbeat from core client for 30 sec - exiting 19:02:30 (5748): No heartbeat from core client for 30 sec - exiting 19:02:31 (5748): No heartbeat from core client for 30 sec - exiting 19:02:32 (5748): No heartbeat from core client for 30 sec - exiting 19:02:33 (5748): No heartbeat from core client for 30 sec - exiting 19:02:34 (5748): No heartbeat from core client for 30 sec - exiting 19:02:35 (5748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5132, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5132, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5132, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5132, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... 19:33:56 (5872): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=752, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:38:31 (752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=616, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
13 May 2013 20:46:33	1186953	15689823	hadcm3n_u3jq_2020_40_008339314_0	466,560	800,995	1.7168
10 May 2013 10:57:05	1186953	15689823	hadcm3n_u3jq_2020_40_008339314_0	440,640	757,543	1.7192
06 May 2013 17:50:50	1186953	15689823	hadcm3n_u3jq_2020_40_008339314_0	414,720	713,522	1.7205
05 May 2013 14:15:13	1186953	15689823	hadcm3n_u3jq_2020_40_008339314_0	388,800	669,438	1.7218
02 May 2013 21:44:56	1186953	15689823	hadcm3n_u3jq_2020_40_008339314_0	362,880	626,295	1.7259
28 Apr 2013 14:05:25	1186953	15689823	hadcm3n_u3jq_2020_40_008339314_0	336,960	582,267	1.7280
27 Apr 2013 09:13:06	1186953	15689823	hadcm3n_u3jq_2020_40_008339314_0	311,040	539,079	1.7332
22 Apr 2013 16:51:25	1186953	15689823	hadcm3n_u3jq_2020_40_008339314_0	285,120	495,344	1.7373
14 Apr 2013 19:13:58	1186953	15689823	hadcm3n_u3jq_2020_40_008339314_0	259,200	450,163	1.7367
13 Apr 2013 19:45:42	1186953	15689823	hadcm3n_u3jq_2020_40_008339314_0	233,280	404,656	1.7346
12 Apr 2013 15:05:42	1186953	15689823	hadcm3n_u3jq_2020_40_008339314_0	207,360	358,770	1.7302
11 Apr 2013 16:05:41	1186953	15689823	hadcm3n_u3jq_2020_40_008339314_0	181,440	314,122	1.7313
10 Apr 2013 13:04:42	1186953	15689823	hadcm3n_u3jq_2020_40_008339314_0	155,520	269,284	1.7315
04 Apr 2013 18:17:37	1186953	15689823	hadcm3n_u3jq_2020_40_008339314_0	129,600	224,402	1.7315
02 Apr 2013 19:33:26	1186953	15689823	hadcm3n_u3jq_2020_40_008339314_0	103,680	180,853	1.7443
01 Apr 2013 07:54:08	1186953	15689823	hadcm3n_u3jq_2020_40_008339314_0	77,760	136,260	1.7523
30 Mar 2013 20:03:37	1186953	15689823	hadcm3n_u3jq_2020_40_008339314_0	51,840	89,720	1.7307
29 Mar 2013 18:50:26	1186953	15689823	hadcm3n_u3jq_2020_40_008339314_0	25,920	44,218	1.7059