Task 15758812

Name	hadcm3n_u3zy_2020_40_008339447_1
Workunit	8490308
Created	1 May 2013, 21:24:49 UTC
Sent	1 May 2013, 21:25:21 UTC
Report deadline	1 Aug 2013, 4:52:32 UTC
Received	22 Jun 2013, 22:54:33 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1237173
Run time	5 days 17 hours 59 min 24 sec
CPU time	4 days 16 hours 35 min 3 sec
Validate state	Invalid
Credit	4,976.64
Device peak FLOPS	3.66 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> 08:44:26 (5592): No heartbeat from core client for 30 sec - exiting 08:44:28 (5592): No heartbeat from core client for 30 sec - exiting 08:44:29 (5592): No heartbeat from core client for 30 sec - exiting 08:44:30 (5592): No heartbeat from core client for 30 sec - exiting 08:44:31 (5592): No heartbeat from core client for 30 sec - exiting 08:44:32 (5592): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:06:45 (4268): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:06:48 (4268): No heartbeat from core client for 30 sec - exiting 11:06:49 (4268): No heartbeat from core client for 30 sec - exiting 11:06:50 (4268): No heartbeat from core client for 30 sec - exiting 11:06:51 (4268): No heartbeat from core client for 30 sec - exiting 11:06:52 (4268): No heartbeat from core client for 30 sec - exiting 12:04:51 (12944): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:08:39 (14776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:08:41 (14776): No heartbeat from core client for 30 sec - exiting 15:08:42 (14776): No heartbeat from core client for 30 sec - exiting 15:08:43 (14776): No heartbeat from core client for 30 sec - exiting 15:08:44 (14776): No heartbeat from core client for 30 sec - exiting 15:08:45 (14776): No heartbeat from core client for 30 sec - exiting 15:08:46 (14776): No heartbeat from core client for 30 sec - exiting 15:08:47 (14776): No heartbeat from core client for 30 sec - exiting 15:35:23 (18956): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:25:09 (18512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:04:06 (21156): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:52:21 (24856): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:52:23 (24856): No heartbeat from core client for 30 sec - exiting 04:52:24 (24856): No heartbeat from core client for 30 sec - exiting 04:52:25 (24856): No heartbeat from core client for 30 sec - exiting 04:52:26 (24856): No heartbeat from core client for 30 sec - exiting 04:52:27 (24856): No heartbeat from core client for 30 sec - exiting 04:52:28 (24856): No heartbeat from core client for 30 sec - exiting 04:52:29 (24856): No heartbeat from core client for 30 sec - exiting 04:52:30 (24856): No heartbeat from core client for 30 sec - exiting 04:52:31 (24856): No heartbeat from core client for 30 sec - exiting 04:52:32 (24856): No heartbeat from core client for 30 sec - exiting 04:52:34 (24856): No heartbeat from core client for 30 sec - exiting 05:28:28 (26220): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:46:49 (36312): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:46:53 (36312): No heartbeat from core client for 30 sec - exiting 10:46:54 (36312): No heartbeat from core client for 30 sec - exiting 10:46:55 (36312): No heartbeat from core client for 30 sec - exiting 10:46:56 (36312): No heartbeat from core client for 30 sec - exiting 10:46:57 (36312): No heartbeat from core client for 30 sec - exiting 10:46:58 (36312): No heartbeat from core client for 30 sec - exiting 15:01:44 (40228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:01:53 (40228): No heartbeat from core client for 30 sec - exiting 15:01:54 (40228): No heartbeat from core client for 30 sec - exiting 15:01:55 (40228): No heartbeat from core client for 30 sec - exiting 15:01:56 (40228): No heartbeat from core client for 30 sec - exiting 17:38:18 (43620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:39:48 (48600): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:39:49 (48600): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold 14:46:23 (47948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:46:29 (47948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 13:00:08 (23384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:03:09 (23992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:03:10 (23992): No heartbeat from core client for 30 sec - exiting 13:03:11 (23992): No heartbeat from core client for 30 sec - exiting 13:03:12 (23992): No heartbeat from core client for 30 sec - exiting 13:03:13 (23992): No heartbeat from core client for 30 sec - exiting 13:03:14 (23992): No heartbeat from core client for 30 sec - exiting 13:03:15 (23992): No heartbeat from core client for 30 sec - exiting 13:03:16 (23992): No heartbeat from core client for 30 sec - exiting 13:03:17 (23992): No heartbeat from core client for 30 sec - exiting 13:03:18 (23992): No heartbeat from core client for 30 sec - exiting 16:11:26 (23508): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:42:44 (24624): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:34:07 (20836): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold 20:13:46 (24736): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:45:16 (25628): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold 04:41:57 (28324): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:41:58 (28324): No heartbeat from core client for 30 sec - exiting 04:41:59 (28324): No heartbeat from core client for 30 sec - exiting 04:42:00 (28324): No heartbeat from core client for 30 sec - exiting 06:57:45 (30324): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:26:56 (30908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:52:06 (30992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:52:11 (30992): No heartbeat from core client for 30 sec - exiting 07:52:12 (30992): No heartbeat from core client for 30 sec - exiting 07:52:13 (30992): No heartbeat from core client for 30 sec - exiting 07:52:14 (30992): No heartbeat from core client for 30 sec - exiting 07:52:15 (30992): No heartbeat from core client for 30 sec - exiting 07:52:16 (30992): No heartbeat from core client for 30 sec - exiting 07:52:17 (30992): No heartbeat from core client for 30 sec - exiting 07:52:18 (30992): No heartbeat from core client for 30 sec - exiting 07:52:19 (30992): No heartbeat from core client for 30 sec - exiting 07:52:20 (30992): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold 08:09:15 (30560): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:09:16 (30560): No heartbeat from core client for 30 sec - exiting 10:06:42 (30456): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:06:43 (30456): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold 10:10:46 (30172): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:10:47 (30172): No heartbeat from core client for 30 sec - exiting 10:10:48 (30172): No heartbeat from core client for 30 sec - exiting 10:10:49 (30172): No heartbeat from core client for 30 sec - exiting 10:10:50 (30172): No heartbeat from core client for 30 sec - exiting 10:10:51 (30172): No heartbeat from core client for 30 sec - exiting 10:10:52 (30172): No heartbeat from core client for 30 sec - exiting 10:10:53 (30172): No heartbeat from core client for 30 sec - exiting 10:10:54 (30172): No heartbeat from core client for 30 sec - exiting 10:10:55 (30172): No heartbeat from core client for 30 sec - exiting 10:10:56 (30172): No heartbeat from core client for 30 sec - exiting 10:48:36 (32348): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:32:58 (31764): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:12:39 (22980): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:55:02 (32288): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:20:54 (34572): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:56:35 (6276): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:56:36 (6276): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 22:07:11 (7844): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:07:12 (7844): No heartbeat from core client for 30 sec - exiting 06:36:56 (9456): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:41:16 (6048): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:41:19 (6048): No heartbeat from core client for 30 sec - exiting 06:41:20 (6048): No heartbeat from core client for 30 sec - exiting 06:41:21 (6048): No heartbeat from core client for 30 sec - exiting 06:50:58 (9864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:54:34 (10652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:09:14 (2940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:09:21 (2940): No heartbeat from core client for 30 sec - exiting 07:09:23 (2940): No heartbeat from core client for 30 sec - exiting 07:09:24 (2940): No heartbeat from core client for 30 sec - exiting 07:09:26 (2940): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold 07:31:48 (13180): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:31:50 (13180): No heartbeat from core client for 30 sec - exiting 07:31:51 (13180): No heartbeat from core client for 30 sec - exiting 07:31:52 (13180): No heartbeat from core client for 30 sec - exiting 07:31:53 (13180): No heartbeat from core client for 30 sec - exiting 07:31:54 (13180): No heartbeat from core client for 30 sec - exiting 07:31:55 (13180): No heartbeat from core client for 30 sec - exiting 07:31:56 (13180): No heartbeat from core client for 30 sec - exiting 07:31:57 (13180): No heartbeat from core client for 30 sec - exiting 07:31:58 (13180): No heartbeat from core client for 30 sec - exiting 07:31:59 (13180): No heartbeat from core client for 30 sec - exiting 07:32:00 (13180): No heartbeat from core client for 30 sec - exiting 08:46:59 (11692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:47:03 (11692): No heartbeat from core client for 30 sec - exiting 08:47:04 (11692): No heartbeat from core client for 30 sec - exiting 08:47:05 (11692): No heartbeat from core client for 30 sec - exiting 08:47:06 (11692): No heartbeat from core client for 30 sec - exiting 09:01:09 (9032): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:01:11 (9032): No heartbeat from core client for 30 sec - exiting 09:13:14 (12340): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:13:22 (12340): No heartbeat from core client for 30 sec - exiting 09:13:23 (12340): No heartbeat from core client for 30 sec - exiting 09:13:24 (12340): No heartbeat from core client for 30 sec - exiting 09:13:25 (12340): No heartbeat from core client for 30 sec - exiting 09:13:26 (12340): No heartbeat from core client for 30 sec - exiting 09:13:27 (12340): No heartbeat from core client for 30 sec - exiting 09:13:28 (12340): No heartbeat from core client for 30 sec - exiting 09:19:54 (12832): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:20:02 (12832): No heartbeat from core client for 30 sec - exiting 09:20:03 (12832): No heartbeat from core client for 30 sec - exiting 09:20:04 (12832): No heartbeat from core client for 30 sec - exiting 09:20:05 (12832): No heartbeat from core client for 30 sec - exiting 09:20:06 (12832): No heartbeat from core client for 30 sec - exiting 09:20:07 (12832): No heartbeat from core client for 30 sec - exiting 09:20:08 (12832): No heartbeat from core client for 30 sec - exiting 09:20:09 (12832): No heartbeat from core client for 30 sec - exiting 09:20:10 (12832): No heartbeat from core client for 30 sec - exiting 09:20:11 (12832): No heartbeat from core client for 30 sec - exiting 11:07:02 (11380): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:50:17 (7572): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:28:29 (11228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:36:00 (14048): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 12:57:57 (13436): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:57:58 (13436): No heartbeat from core client for 30 sec - exiting 12:57:59 (13436): No heartbeat from core client for 30 sec - exiting 12:58:00 (13436): No heartbeat from core client for 30 sec - exiting 12:58:01 (13436): No heartbeat from core client for 30 sec - exiting 12:58:02 (13436): No heartbeat from core client for 30 sec - exiting 12:58:03 (13436): No heartbeat from core client for 30 sec - exiting 12:58:04 (13436): No heartbeat from core client for 30 sec - exiting 12:58:05 (13436): No heartbeat from core client for 30 sec - exiting 12:58:06 (13436): No heartbeat from core client for 30 sec - exiting 12:58:07 (13436): No heartbeat from core client for 30 sec - exiting 13:17:46 (13836): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:43:42 (5720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:13:44 (6672): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold 15:43:05 (15332): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:43:06 (15332): No heartbeat from core client for 30 sec - exiting 15:43:07 (15332): No heartbeat from core client for 30 sec - exiting 15:43:08 (15332): No heartbeat from core client for 30 sec - exiting 15:43:09 (15332): No heartbeat from core client for 30 sec - exiting 15:43:10 (15332): No heartbeat from core client for 30 sec - exiting 15:43:11 (15332): No heartbeat from core client for 30 sec - exiting 15:43:12 (15332): No heartbeat from core client for 30 sec - exiting 15:43:13 (15332): No heartbeat from core client for 30 sec - exiting 15:43:14 (15332): No heartbeat from core client for 30 sec - exiting 15:43:15 (15332): No heartbeat from core client for 30 sec - exiting 16:16:41 (14812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:55:46 (14816): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:55:48 (14816): No heartbeat from core client for 30 sec - exiting 17:53:38 (15940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:30:58 (16112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:31:00 (16112): No heartbeat from core client for 30 sec - exiting 18:31:01 (16112): No heartbeat from core client for 30 sec - exiting 18:31:02 (16112): No heartbeat from core client for 30 sec - exiting 18:31:03 (16112): No heartbeat from core client for 30 sec - exiting 18:31:04 (16112): No heartbeat from core client for 30 sec - exiting 19:27:03 (15520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold 21:13:32 (15848): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:13:33 (15848): No heartbeat from core client for 30 sec - exiting 21:13:34 (15848): No heartbeat from core client for 30 sec - exiting 21:13:35 (15848): No heartbeat from core client for 30 sec - exiting 21:13:36 (15848): No heartbeat from core client for 30 sec - exiting 21:13:37 (15848): No heartbeat from core client for 30 sec - exiting 21:13:38 (15848): No heartbeat from core client for 30 sec - exiting 21:13:39 (15848): No heartbeat from core client for 30 sec - exiting 21:13:40 (15848): No heartbeat from core client for 30 sec - exiting 21:13:41 (15848): No heartbeat from core client for 30 sec - exiting 21:13:42 (15848): No heartbeat from core client for 30 sec - exiting 21:44:56 (17508): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold 21:58:23 (17116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:58:24 (17116): No heartbeat from core client for 30 sec - exiting 21:58:25 (17116): No heartbeat from core client for 30 sec - exiting 21:58:26 (17116): No heartbeat from core client for 30 sec - exiting 21:58:27 (17116): No heartbeat from core client for 30 sec - exiting 21:58:28 (17116): No heartbeat from core client for 30 sec - exiting 21:58:29 (17116): No heartbeat from core client for 30 sec - exiting 21:58:30 (17116): No heartbeat from core client for 30 sec - exiting 21:58:31 (17116): No heartbeat from core client for 30 sec - exiting 23:48:02 (20084): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold 00:03:00 (18928): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:03:01 (18928): No heartbeat from core client for 30 sec - exiting 00:03:02 (18928): No heartbeat from core client for 30 sec - exiting 00:03:03 (18928): No heartbeat from core client for 30 sec - exiting 00:03:04 (18928): No heartbeat from core client for 30 sec - exiting 00:03:05 (18928): No heartbeat from core client for 30 sec - exiting 00:10:18 (13396): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:10:24 (13396): No heartbeat from core client for 30 sec - exiting 00:10:25 (13396): No heartbeat from core client for 30 sec - exiting 00:10:26 (13396): No heartbeat from core client for 30 sec - exiting 00:10:27 (13396): No heartbeat from core client for 30 sec - exiting 00:10:28 (13396): No heartbeat from core client for 30 sec - exiting 00:10:29 (13396): No heartbeat from core client for 30 sec - exiting 00:10:30 (13396): No heartbeat from core client for 30 sec - exiting 00:10:31 (13396): No heartbeat from core client for 30 sec - exiting 00:10:32 (13396): No heartbeat from core client for 30 sec - exiting 00:10:33 (13396): No heartbeat from core client for 30 sec - exiting 00:30:16 (20112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:18:17 (16552): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold 05:09:46 (17524): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:16:22 (18180): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold 11:17:26 (15760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:37:43 (21004): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:37:55 (21004): No heartbeat from core client for 30 sec - exiting 11:37:56 (21004): No heartbeat from core client for 30 sec - exiting 11:37:57 (21004): No heartbeat from core client for 30 sec - exiting 11:37:58 (21004): No heartbeat from core client for 30 sec - exiting 11:37:59 (21004): No heartbeat from core client for 30 sec - exiting 11:38:00 (21004): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold 13:36:00 (21008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:51:24 (20928): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:51:29 (20928): No heartbeat from core client for 30 sec - exiting 13:51:30 (20928): No heartbeat from core client for 30 sec - exiting 13:51:31 (20928): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold 14:44:53 (20808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:11:46 (19632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:11:49 (19632): No heartbeat from core client for 30 sec - exiting 17:11:50 (19632): No heartbeat from core client for 30 sec - exiting 17:11:51 (19632): No heartbeat from core client for 30 sec - exiting 17:11:52 (19632): No heartbeat from core client for 30 sec - exiting 17:20:28 (19384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:18:23 (18668): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:18:29 (18668): No heartbeat from core client for 30 sec - exiting 18:18:30 (18668): No heartbeat from core client for 30 sec - exiting 18:18:31 (18668): No heartbeat from core client for 30 sec - exiting 18:18:32 (18668): No heartbeat from core client for 30 sec - exiting Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6456, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6456, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6456, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6456, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6456, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6456, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
21 Jun 2013 16:03:40	1237173	15758812	hadcm3n_u3zy_2020_40_008339447_1	414,720	385,864	0.9304
21 Jun 2013 06:12:17	1237173	15758812	hadcm3n_u3zy_2020_40_008339447_1	388,800	356,192	0.9161
20 Jun 2013 20:40:40	1237173	15758812	hadcm3n_u3zy_2020_40_008339447_1	362,880	327,599	0.9028
20 Jun 2013 07:07:14	1237173	15758812	hadcm3n_u3zy_2020_40_008339447_1	336,960	298,482	0.8858
19 Jun 2013 18:43:03	1237173	15758812	hadcm3n_u3zy_2020_40_008339447_1	311,040	272,388	0.8757
19 Jun 2013 07:40:54	1237173	15758812	hadcm3n_u3zy_2020_40_008339447_1	285,120	243,625	0.8545
18 Jun 2013 19:42:50	1237173	15758812	hadcm3n_u3zy_2020_40_008339447_1	259,200	214,841	0.8289
19 May 2013 01:34:35	1237173	15758812	hadcm3n_u3zy_2020_40_008339447_1	233,280	191,790	0.8221
18 May 2013 20:47:16	1237173	15758812	hadcm3n_u3zy_2020_40_008339447_1	207,360	175,097	0.8444
18 May 2013 16:06:44	1237173	15758812	hadcm3n_u3zy_2020_40_008339447_1	181,440	158,409	0.8731
18 May 2013 10:49:24	1237173	15758812	hadcm3n_u3zy_2020_40_008339447_1	155,520	141,621	0.9106
18 May 2013 05:42:29	1237173	15758812	hadcm3n_u3zy_2020_40_008339447_1	129,600	123,832	0.9555
18 May 2013 00:40:33	1237173	15758812	hadcm3n_u3zy_2020_40_008339447_1	103,680	106,037	1.0227
17 May 2013 17:35:30	1237173	15758812	hadcm3n_u3zy_2020_40_008339447_1	77,760	80,711	1.0380
17 May 2013 07:44:54	1237173	15758812	hadcm3n_u3zy_2020_40_008339447_1	51,840	53,333	1.0288
16 May 2013 21:40:25	1237173	15758812	hadcm3n_u3zy_2020_40_008339447_1	25,920	26,490	1.0220