Task 15674411

Name	hadcm3n_4gh8_1940_40_008309448_4
Workunit	8460583
Created	21 Mar 2013, 5:07:23 UTC
Sent	21 Mar 2013, 5:07:29 UTC
Report deadline	20 Jun 2013, 12:34:40 UTC
Received	20 Apr 2013, 23:31:17 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1265284
Run time	1 days 17 hours 45 min 18 sec
CPU time	1 days 15 hours 27 min 36 sec
Validate state	Invalid
Credit	311.04
Device peak FLOPS	3.46 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:51:25 (18384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:51:26 (18384): No heartbeat from core client for 30 sec - exiting 07:51:28 (18384): No heartbeat from core client for 30 sec - exiting 07:51:29 (18384): No heartbeat from core client for 30 sec - exiting 07:51:30 (18384): No heartbeat from core client for 30 sec - exiting 07:51:31 (18384): No heartbeat from core client for 30 sec - exiting 07:51:32 (18384): No heartbeat from core client for 30 sec - exiting 07:51:33 (18384): No heartbeat from core client for 30 sec - exiting 07:51:34 (18384): No heartbeat from core client for 30 sec - exiting 07:51:35 (18384): No heartbeat from core client for 30 sec - exiting 07:51:36 (18384): No heartbeat from core client for 30 sec - exiting 10:48:05 (17744): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:01:01 (16960): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:01:02 (16960): No heartbeat from core client for 30 sec - exiting 11:01:03 (16960): No heartbeat from core client for 30 sec - exiting 11:01:04 (16960): No heartbeat from core client for 30 sec - exiting 11:01:05 (16960): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:33:15 (3688): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:33:16 (3688): No heartbeat from core client for 30 sec - exiting 10:35:22 (15148): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:36:30 (18212): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:34:55 (15912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:45:42 (6768): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 16:34:54 (3828): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:50:39 (4608): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:50:40 (4608): No heartbeat from core client for 30 sec - exiting 22:50:41 (4608): No heartbeat from core client for 30 sec - exiting 03:03:55 (6236): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:05:15 (6108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:05:16 (6108): No heartbeat from core client for 30 sec - exiting 03:05:17 (6108): No heartbeat from core client for 30 sec - exiting 03:05:18 (6108): No heartbeat from core client for 30 sec - exiting 03:05:19 (6108): No heartbeat from core client for 30 sec - exiting 03:05:20 (6108): No heartbeat from core client for 30 sec - exiting 03:05:21 (6108): No heartbeat from core client for 30 sec - exiting 03:05:22 (6108): No heartbeat from core client for 30 sec - exiting 03:05:24 (6108): No heartbeat from core client for 30 sec - exiting 03:05:25 (6108): No heartbeat from core client for 30 sec - exiting 03:05:26 (6108): No heartbeat from core client for 30 sec - exiting 03:06:21 (4648): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:07:27 (5892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:16:36 (3496): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:25:39 (2600): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:25:40 (2600): No heartbeat from core client for 30 sec - exiting 03:25:42 (2600): No heartbeat from core client for 30 sec - exiting 03:25:43 (2600): No heartbeat from core client for 30 sec - exiting 03:25:44 (2600): No heartbeat from core client for 30 sec - exiting 03:25:45 (2600): No heartbeat from core client for 30 sec - exiting 03:25:46 (2600): No heartbeat from core client for 30 sec - exiting 03:25:47 (2600): No heartbeat from core client for 30 sec - exiting 03:25:48 (2600): No heartbeat from core client for 30 sec - exiting 03:25:49 (2600): No heartbeat from core client for 30 sec - exiting 03:25:50 (2600): No heartbeat from core client for 30 sec - exiting 03:26:42 (5424): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:26:43 (5424): No heartbeat from core client for 30 sec - exiting 03:26:44 (5424): No heartbeat from core client for 30 sec - exiting 03:26:45 (5424): No heartbeat from core client for 30 sec - exiting 03:26:47 (5424): No heartbeat from core client for 30 sec - exiting 03:26:48 (5424): No heartbeat from core client for 30 sec - exiting 03:26:49 (5424): No heartbeat from core client for 30 sec - exiting 03:26:50 (5424): No heartbeat from core client for 30 sec - exiting 03:26:51 (5424): No heartbeat from core client for 30 sec - exiting 03:26:52 (5424): No heartbeat from core client for 30 sec - exiting 03:26:53 (5424): No heartbeat from core client for 30 sec - exiting 03:27:46 (5936): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:35:51 (5740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:36:53 (7116): No heartbeat from core client for 30 sec - exiting 03:37:23 (7116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:37:24 (7116): No heartbeat from core client for 30 sec - exiting 03:37:25 (7116): No heartbeat from core client for 30 sec - exiting 03:37:26 (7116): No heartbeat from core client for 30 sec - exiting 03:37:27 (7116): No heartbeat from core client for 30 sec - exiting 03:37:28 (7116): No heartbeat from core client for 30 sec - exiting 03:37:30 (7116): No heartbeat from core client for 30 sec - exiting 03:37:31 (7116): No heartbeat from core client for 30 sec - exiting 03:37:32 (7116): No heartbeat from core client for 30 sec - exiting 03:37:33 (7116): No heartbeat from core client for 30 sec - exiting 03:37:34 (7116): No heartbeat from core client for 30 sec - exiting 03:38:58 (1776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:48:27 (5316): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:49:30 (4396): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:51:35 (3344): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:53:41 (6432): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:55:45 (6876): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:56:48 (2240): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:57:50 (3708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:59:53 (3364): No heartbeat from core client for 30 sec - exiting 03:59:54 (3364): No heartbeat from core client for 30 sec - exiting 03:59:55 (3364): No heartbeat from core client for 30 sec - exiting 03:59:56 (3364): No heartbeat from core client for 30 sec - exiting 03:59:57 (3364): No heartbeat from core client for 30 sec - exiting 03:59:59 (3364): No heartbeat from core client for 30 sec - exiting 04:00:00 (3364): No heartbeat from core client for 30 sec - exiting 04:00:01 (3364): No heartbeat from core client for 30 sec - exiting 04:00:02 (3364): No heartbeat from core client for 30 sec - exiting 04:00:03 (3364): No heartbeat from core client for 30 sec - exiting 04:00:04 (3364): No heartbeat from core client for 30 sec - exiting 04:00:05 (3364): No heartbeat from core client for 30 sec - exiting 04:00:06 (3364): No heartbeat from core client for 30 sec - exiting 04:00:07 (3364): No heartbeat from core client for 30 sec - exiting 04:00:08 (3364): No heartbeat from core client for 30 sec - exiting 04:00:09 (3364): No heartbeat from core client for 30 sec - exiting 04:00:11 (3364): No heartbeat from core client for 30 sec - exiting 04:00:12 (3364): No heartbeat from core client for 30 sec - exiting 04:00:13 (3364): No heartbeat from core client for 30 sec - exiting 04:00:14 (3364): No heartbeat from core client for 30 sec - exiting 04:00:15 (3364): No heartbeat from core client for 30 sec - exiting 04:00:16 (3364): No heartbeat from core client for 30 sec - exiting 04:00:17 (3364): No heartbeat from core client for 30 sec - exiting 04:00:18 (3364): No heartbeat from core client for 30 sec - exiting 04:00:19 (3364): No heartbeat from core client for 30 sec - exiting 04:00:20 (3364): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:54:13 (1748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:54:14 (1748): No heartbeat from core client for 30 sec - exiting 06:54:15 (1748): No heartbeat from core client for 30 sec - exiting 06:54:16 (1748): No heartbeat from core client for 30 sec - exiting 06:54:17 (1748): No heartbeat from core client for 30 sec - exiting 06:54:18 (1748): No heartbeat from core client for 30 sec - exiting 06:54:19 (1748): No heartbeat from core client for 30 sec - exiting 06:54:20 (1748): No heartbeat from core client for 30 sec - exiting 06:54:22 (1748): No heartbeat from core client for 30 sec - exiting 06:54:23 (1748): No heartbeat from core client for 30 sec - exiting 06:54:24 (1748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:41:30 (7264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 17:50:14 (2628): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:48:03 (23708): No heartbeat from core client for 30 sec - exiting 22:48:33 (23708): No heartbeat from core client for 30 sec - exiting 22:49:06 (23708): No heartbeat from core client for 30 sec - exiting 22:49:08 (23708): No heartbeat from core client for 30 sec - exiting 22:49:09 (23708): No heartbeat from core client for 30 sec - exiting 22:49:10 (23708): No heartbeat from core client for 30 sec - exiting 22:49:11 (23708): No heartbeat from core client for 30 sec - exiting 22:49:12 (23708): No heartbeat from core client for 30 sec - exiting 22:49:13 (23708): No heartbeat from core client for 30 sec - exiting 22:49:14 (23708): No heartbeat from core client for 30 sec - exiting 22:49:15 (23708): No heartbeat from core client for 30 sec - exiting 22:49:16 (23708): No heartbeat from core client for 30 sec - exiting 22:49:17 (23708): No heartbeat from core client for 30 sec - exiting 22:49:18 (23708): No heartbeat from core client for 30 sec - exiting 22:49:20 (23708): No heartbeat from core client for 30 sec - exiting 22:49:21 (23708): No heartbeat from core client for 30 sec - exiting 22:49:22 (23708): No heartbeat from core client for 30 sec - exiting 22:49:23 (23708): No heartbeat from core client for 30 sec - exiting 22:49:24 (23708): No heartbeat from core client for 30 sec - exiting 22:49:25 (23708): No heartbeat from core client for 30 sec - exiting 22:49:26 (23708): No heartbeat from core client for 30 sec - exiting 22:49:27 (23708): No heartbeat from core client for 30 sec - exiting 22:49:28 (23708): No heartbeat from core client for 30 sec - exiting 22:49:29 (23708): No heartbeat from core client for 30 sec - exiting 22:49:30 (23708): No heartbeat from core client for 30 sec - exiting 22:49:32 (23708): No heartbeat from core client for 30 sec - exiting 22:49:33 (23708): No heartbeat from core client for 30 sec - exiting 22:49:34 (23708): No heartbeat from core client for 30 sec - exiting 22:49:35 (23708): No heartbeat from core client for 30 sec - exiting 22:49:36 (23708): No heartbeat from core client for 30 sec - exiting 22:50:10 (23708): No heartbeat from core client for 30 sec - exiting 22:50:11 (23708): No heartbeat from core client for 30 sec - exiting 22:50:12 (23708): No heartbeat from core client for 30 sec - exiting 22:50:13 (23708): No heartbeat from core client for 30 sec - exiting 22:50:14 (23708): No heartbeat from core client for 30 sec - exiting 22:50:15 (23708): No heartbeat from core client for 30 sec - exiting 22:50:16 (23708): No heartbeat from core client for 30 sec - exiting 22:50:18 (23708): No heartbeat from core client for 30 sec - exiting 22:50:19 (23708): No heartbeat from core client for 30 sec - exiting 22:50:20 (23708): No heartbeat from core client for 30 sec - exiting 22:50:21 (23708): No heartbeat from core client for 30 sec - exiting 22:50:22 (23708): No heartbeat from core client for 30 sec - exiting 22:50:23 (23708): No heartbeat from core client for 30 sec - exiting 22:50:24 (23708): No heartbeat from core client for 30 sec - exiting 22:50:25 (23708): No heartbeat from core client for 30 sec - exiting 22:50:26 (23708): No heartbeat from core client for 30 sec - exiting 22:50:27 (23708): No heartbeat from core client for 30 sec - exiting 22:50:28 (23708): No heartbeat from core client for 30 sec - exiting 22:50:30 (23708): No heartbeat from core client for 30 sec - exiting 22:50:31 (23708): No heartbeat from core client for 30 sec - exiting 22:50:32 (23708): No heartbeat from core client for 30 sec - exiting 22:50:33 (23708): No heartbeat from core client for 30 sec - exiting 22:50:34 (23708): No heartbeat from core client for 30 sec - exiting 22:50:35 (23708): No heartbeat from core client for 30 sec - exiting 22:50:36 (23708): No heartbeat from core client for 30 sec - exiting 22:50:37 (23708): No heartbeat from core client for 30 sec - exiting 22:50:38 (23708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:58:27 (5592): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:00:31 (20780): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:02:35 (12968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:03:37 (14788): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:05:44 (11836): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:07:47 (22032): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:08:52 (6304): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:09:53 (11440): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:11:05 (13300): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 23:15:22 (9124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:19:11 (2056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 02:41:22 (28864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:11:54 (25228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:16:36 (41116): No heartbeat from core client for 30 sec - exiting 03:16:37 (41116): No heartbeat from core client for 30 sec - exiting 03:16:38 (41116): No heartbeat from core client for 30 sec - exiting 03:16:39 (41116): No heartbeat from core client for 30 sec - exiting 03:16:40 (41116): No heartbeat from core client for 30 sec - exiting 03:16:41 (41116): No heartbeat from core client for 30 sec - exiting 03:16:42 (41116): No heartbeat from core client for 30 sec - exiting 03:16:43 (41116): No heartbeat from core client for 30 sec - exiting 03:16:45 (41116): No heartbeat from core client for 30 sec - exiting 03:16:46 (41116): No heartbeat from core client for 30 sec - exiting 03:16:47 (41116): No heartbeat from core client for 30 sec - exiting 03:16:48 (41116): No heartbeat from core client for 30 sec - exiting 03:16:49 (41116): No heartbeat from core client for 30 sec - exiting 03:16:50 (41116): No heartbeat from core client for 30 sec - exiting 03:16:51 (41116): No heartbeat from core client for 30 sec - exiting 03:16:52 (41116): No heartbeat from core client for 30 sec - exiting 03:16:53 (41116): No heartbeat from core client for 30 sec - exiting 03:16:54 (41116): No heartbeat from core client for 30 sec - exiting 03:16:55 (41116): No heartbeat from core client for 30 sec - exiting 03:16:57 (41116): No heartbeat from core client for 30 sec - exiting 03:16:58 (41116): No heartbeat from core client for 30 sec - exiting 03:16:59 (41116): No heartbeat from core client for 30 sec - exiting 03:17:00 (41116): No heartbeat from core client for 30 sec - exiting 03:17:01 (41116): No heartbeat from core client for 30 sec - exiting 03:17:02 (41116): No heartbeat from core client for 30 sec - exiting 03:17:03 (41116): No heartbeat from core client for 30 sec - exiting 03:17:04 (41116): No heartbeat from core client for 30 sec - exiting 03:17:05 (41116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:20:10 (14884): No heartbeat from core client for 30 sec - exiting 03:20:11 (14884): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:20:12 (14884): No heartbeat from core client for 30 sec - exiting 03:20:13 (14884): No heartbeat from core client for 30 sec - exiting 03:20:14 (14884): No heartbeat from core client for 30 sec - exiting 03:20:15 (14884): No heartbeat from core client for 30 sec - exiting 03:20:17 (14884): No heartbeat from core client for 30 sec - exiting 03:20:18 (14884): No heartbeat from core client for 30 sec - exiting 03:20:19 (14884): No heartbeat from core client for 30 sec - exiting 03:20:20 (14884): No heartbeat from core client for 30 sec - exiting 03:21:45 (40460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:21:47 (40460): No heartbeat from core client for 30 sec - exiting 03:21:48 (40460): No heartbeat from core client for 30 sec - exiting 03:21:49 (40460): No heartbeat from core client for 30 sec - exiting 03:21:50 (40460): No heartbeat from core client for 30 sec - exiting 03:21:51 (40460): No heartbeat from core client for 30 sec - exiting 03:21:52 (40460): No heartbeat from core client for 30 sec - exiting 03:21:53 (40460): No heartbeat from core client for 30 sec - exiting 03:21:54 (40460): No heartbeat from core client for 30 sec - exiting 03:21:55 (40460): No heartbeat from core client for 30 sec - exiting 03:21:56 (40460): No heartbeat from core client for 30 sec - exiting 03:25:55 (6520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:28:00 (24196): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:30:02 (4712): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:44:56 (23288): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 05:22:36 (14324): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:02:08 (19312): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 11:12:29 (4100): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:45:17 (3204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:46:18 (2384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:48:22 (3464): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:50:26 (4360): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:51:29 (5928): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:52:31 (2132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:54:35 (1884): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:55:37 (2168): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:57:41 (4792): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:59:45 (6100): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:00:48 (4348): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:02:54 (3644): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:51:57 (3672): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:59:07 (4216): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:03:11 (2040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5320, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5320, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5320, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5320, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5320, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5320, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
26 Mar 2013 20:02:48	1265284	15674411	hadcm3n_4gh8_1940_40_008309448_4	25,920	89,512	3.4534