Task 13373519

Name	hadcm3n_yie4_1940_40_007453012_2
Workunit	7650515
Created	10 Sep 2011, 20:42:24 UTC
Sent	10 Sep 2011, 20:56:35 UTC
Report deadline	11 Dec 2011, 4:23:46 UTC
Received	29 Sep 2011, 14:12:36 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1126459
Run time	2 days 9 hours 52 min 22 sec
CPU time	2 days 3 hours 13 min 40 sec
Validate state	Invalid
Credit	933.12
Device peak FLOPS	2.62 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:52:58 (9044): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:53:02 (9044): No heartbeat from core client for 30 sec - exiting 13:53:03 (9044): No heartbeat from core client for 30 sec - exiting 13:53:04 (9044): No heartbeat from core client for 30 sec - exiting 15:36:08 (8240): No heartbeat from core client for 30 sec - exiting 15:36:10 (8240): No heartbeat from core client for 30 sec - exiting 15:36:11 (8240): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:58:02 (6160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:58:03 (6160): No heartbeat from core client for 30 sec - exiting 08:58:04 (6160): No heartbeat from core client for 30 sec - exiting 08:58:05 (6160): No heartbeat from core client for 30 sec - exiting 08:58:06 (6160): No heartbeat from core client for 30 sec - exiting 08:58:07 (6160): No heartbeat from core client for 30 sec - exiting 08:58:08 (6160): No heartbeat from core client for 30 sec - exiting 08:58:09 (6160): No heartbeat from core client for 30 sec - exiting 08:58:10 (6160): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:57:20 (9744): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:57:22 (9744): No heartbeat from core client for 30 sec - exiting 15:57:23 (9744): No heartbeat from core client for 30 sec - exiting 15:57:24 (9744): No heartbeat from core client for 30 sec - exiting 15:57:25 (9744): No heartbeat from core client for 30 sec - exiting 15:57:26 (9744): No heartbeat from core client for 30 sec - exiting 15:57:27 (9744): No heartbeat from core client for 30 sec - exiting 15:57:28 (9744): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:44:42 (4292): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:14:28 (5608): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:14:34 (5608): No heartbeat from core client for 30 sec - exiting 11:14:35 (5608): No heartbeat from core client for 30 sec - exiting 11:14:36 (5608): No heartbeat from core client for 30 sec - exiting 11:14:37 (5608): No heartbeat from core client for 30 sec - exiting 11:14:38 (5608): No heartbeat from core client for 30 sec - exiting 11:14:39 (5608): No heartbeat from core client for 30 sec - exiting 11:14:40 (5608): No heartbeat from core client for 30 sec - exiting 11:14:41 (5608): No heartbeat from core client for 30 sec - exiting 11:14:42 (5608): No heartbeat from core client for 30 sec - exiting 11:14:43 (5608): No heartbeat from core client for 30 sec - exiting 11:14:44 (5608): No heartbeat from core client for 30 sec - exiting 11:14:45 (5608): No heartbeat from core client for 30 sec - exiting 11:14:46 (5608): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:18:06 (6248): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:18:07 (6248): No heartbeat from core client for 30 sec - exiting 12:18:08 (6248): No heartbeat from core client for 30 sec - exiting 12:29:06 (10008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:39:14 (10212): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:39:17 (10212): No heartbeat from core client for 30 sec - exiting 12:39:18 (10212): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold Suspended CPDN Monitor - Suspend request from BOINC... 13:07:45 (4972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:08:01 (8528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:08:02 (8528): No heartbeat from core client for 30 sec - exiting 14:08:03 (8528): No heartbeat from core client for 30 sec - exiting 14:08:04 (8528): No heartbeat from core client for 30 sec - exiting 14:08:05 (8528): No heartbeat from core client for 30 sec - exiting 14:08:06 (8528): No heartbeat from core client for 30 sec - exiting 14:08:07 (8528): No heartbeat from core client for 30 sec - exiting 14:08:08 (8528): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:28:40 (9676): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:11:40 (4112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:11:42 (4112): No heartbeat from core client for 30 sec - exiting 12:11:43 (4112): No heartbeat from core client for 30 sec - exiting 12:11:44 (4112): No heartbeat from core client for 30 sec - exiting 12:11:45 (4112): No heartbeat from core client for 30 sec - exiting 12:11:46 (4112): No heartbeat from core client for 30 sec - exiting 12:11:47 (4112): No heartbeat from core client for 30 sec - exiting 12:11:48 (4112): No heartbeat from core client for 30 sec - exiting 12:11:49 (4112): No heartbeat from core client for 30 sec - exiting 12:11:50 (4112): No heartbeat from core client for 30 sec - exiting 12:11:51 (4112): No heartbeat from core client for 30 sec - exiting 12:11:52 (4112): No heartbeat from core client for 30 sec - exiting 12:11:53 (4112): No heartbeat from core client for 30 sec - exiting 12:11:54 (4112): No heartbeat from core client for 30 sec - exiting 12:11:56 (4112): No heartbeat from core client for 30 sec - exiting 12:11:57 (4112): No heartbeat from core client for 30 sec - exiting 12:11:58 (4112): No heartbeat from core client for 30 sec - exiting 12:11:59 (4112): No heartbeat from core client for 30 sec - exiting 12:12:00 (4112): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:15:07 (6700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:15:09 (6700): No heartbeat from core client for 30 sec - exiting 19:15:10 (6700): No heartbeat from core client for 30 sec - exiting 19:15:11 (6700): No heartbeat from core client for 30 sec - exiting 19:15:12 (6700): No heartbeat from core client for 30 sec - exiting 19:15:13 (6700): No heartbeat from core client for 30 sec - exiting 19:15:14 (6700): No heartbeat from core client for 30 sec - exiting 19:15:15 (6700): No heartbeat from core client for 30 sec - exiting 20:08:45 (5804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:08:46 (5804): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:20:57 (6864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:21:00 (6864): No heartbeat from core client for 30 sec - exiting 14:21:01 (6864): No heartbeat from core client for 30 sec - exiting 14:21:02 (6864): No heartbeat from core client for 30 sec - exiting 14:21:03 (6864): No heartbeat from core client for 30 sec - exiting 14:21:04 (6864): No heartbeat from core client for 30 sec - exiting 14:21:05 (6864): No heartbeat from core client for 30 sec - exiting 14:21:06 (6864): No heartbeat from core client for 30 sec - exiting 14:21:07 (6864): No heartbeat from core client for 30 sec - exiting 14:21:08 (6864): No heartbeat from core client for 30 sec - exiting 14:21:09 (6864): No heartbeat from core client for 30 sec - exiting 14:21:10 (6864): No heartbeat from core client for 30 sec - exiting 14:21:11 (6864): No heartbeat from core client for 30 sec - exiting 14:21:12 (6864): No heartbeat from core client for 30 sec - exiting 14:21:13 (6864): No heartbeat from core client for 30 sec - exiting 14:21:14 (6864): No heartbeat from core client for 30 sec - exiting 14:21:15 (6864): No heartbeat from core client for 30 sec - exiting 14:21:17 (6864): No heartbeat from core client for 30 sec - exiting 14:21:18 (6864): No heartbeat from core client for 30 sec - exiting 19:44:34 (5172): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:44:40 (5172): No heartbeat from core client for 30 sec - exiting 19:44:41 (5172): No heartbeat from core client for 30 sec - exiting 19:44:42 (5172): No heartbeat from core client for 30 sec - exiting 19:44:43 (5172): No heartbeat from core client for 30 sec - exiting 19:44:44 (5172): No heartbeat from core client for 30 sec - exiting 19:44:45 (5172): No heartbeat from core client for 30 sec - exiting 19:44:46 (5172): No heartbeat from core client for 30 sec - exiting 19:44:47 (5172): No heartbeat from core client for 30 sec - exiting 02:21:31 (11096): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:02:06 (2808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:13:54 (8720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:09:45 (5920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:34:42 (7000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:02:35 (11172): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:22:28 (3896): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:59:25 (1128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:59:26 (1128): No heartbeat from core client for 30 sec - exiting 08:59:27 (1128): No heartbeat from core client for 30 sec - exiting 08:59:28 (1128): No heartbeat from core client for 30 sec - exiting 08:59:29 (1128): No heartbeat from core client for 30 sec - exiting 08:59:30 (1128): No heartbeat from core client for 30 sec - exiting 08:59:31 (1128): No heartbeat from core client for 30 sec - exiting 08:59:32 (1128): No heartbeat from core client for 30 sec - exiting 08:59:33 (1128): No heartbeat from core client for 30 sec - exiting 08:59:34 (1128): No heartbeat from core client for 30 sec - exiting 08:59:38 (1128): No heartbeat from core client for 30 sec - exiting 09:11:31 (9184): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:11:32 (9184): No heartbeat from core client for 30 sec - exiting 09:11:33 (9184): No heartbeat from core client for 30 sec - exiting 09:11:34 (9184): No heartbeat from core client for 30 sec - exiting 09:11:35 (9184): No heartbeat from core client for 30 sec - exiting 09:24:18 (4352): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:24:19 (4352): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:53:07 (2484): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:33:25 (4708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:56:57 (10564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:56:58 (10564): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:06:24 (10040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:22:19 (12064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:22:24 (12064): No heartbeat from core client for 30 sec - exiting 20:22:25 (12064): No heartbeat from core client for 30 sec - exiting 20:22:26 (12064): No heartbeat from core client for 30 sec - exiting 20:22:27 (12064): No heartbeat from core client for 30 sec - exiting 20:22:28 (12064): No heartbeat from core client for 30 sec - exiting 20:22:29 (12064): No heartbeat from core client for 30 sec - exiting 20:22:30 (12064): No heartbeat from core client for 30 sec - exiting 20:22:31 (12064): No heartbeat from core client for 30 sec - exiting 20:22:32 (12064): No heartbeat from core client for 30 sec - exiting 20:44:58 (12468): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:40:00 (6256): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 08:40:05 (6256): No heartbeat from core client for 30 sec - exiting 08:40:07 (6256): No heartbeat from core client for 30 sec - exiting 08:40:08 (6256): No heartbeat from core client for 30 sec - exiting 08:40:09 (6256): No heartbeat from core client for 30 sec - exiting 08:40:10 (6256): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 08:08:10 (9192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:37:21 (8152): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:15:45 (4800): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:15:46 (4800): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 14:37:05 (5472): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:46:10 (3872): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:46:11 (3872): No heartbeat from core client for 30 sec - exiting 18:46:12 (3872): No heartbeat from core client for 30 sec - exiting 18:46:13 (3872): No heartbeat from core client for 30 sec - exiting 19:15:16 (4828): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:44:33 (9772): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:09:05 (2208): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:44:17 (9064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:44:18 (9064): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 12:50:43 (5392): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:50:48 (5392): No heartbeat from core client for 30 sec - exiting 12:50:49 (5392): No heartbeat from core client for 30 sec - exiting 12:50:50 (5392): No heartbeat from core client for 30 sec - exiting 12:50:51 (5392): No heartbeat from core client for 30 sec - exiting 13:25:48 (9296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:46:03 (9332): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:46:05 (9332): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:32:01 (9632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:32:02 (9632): No heartbeat from core client for 30 sec - exiting 17:32:03 (9632): No heartbeat from core client for 30 sec - exiting 17:59:00 (504): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:25:51 (2828): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:41:50 (3164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:07:56 (7940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:07:58 (7940): No heartbeat from core client for 30 sec - exiting 20:36:45 (1784): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8000, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8000, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:22:26 (8000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:22:27 (8000): No heartbeat from core client for 30 sec - exiting 11:22:28 (8000): No heartbeat from core client for 30 sec - exiting 11:22:29 (8000): No heartbeat from core client for 30 sec - exiting 11:22:30 (8000): No heartbeat from core client for 30 sec - exiting 11:22:31 (8000): No heartbeat from core client for 30 sec - exiting 11:22:32 (8000): No heartbeat from core client for 30 sec - exiting 11:22:33 (8000): No heartbeat from core client for 30 sec - exiting 11:22:34 (8000): No heartbeat from core client for 30 sec - exiting 11:22:35 (8000): No heartbeat from core client for 30 sec - exiting 11:22:36 (8000): No heartbeat from core client for 30 sec - exiting 11:22:37 (8000): No heartbeat from core client for 30 sec - exiting 11:22:39 (8000): No heartbeat from core client for 30 sec - exiting 11:22:40 (8000): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5772, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5772, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5772, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5772, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
19 Sep 2011 10:59:48	1126459	13373519	hadcm3n_yie4_1940_40_007453012_2	77,760	149,336	1.9205
17 Sep 2011 21:47:53	1126459	13373519	hadcm3n_yie4_1940_40_007453012_2	51,840	101,175	1.9517
14 Sep 2011 15:59:01	1126459	13373519	hadcm3n_yie4_1940_40_007453012_2	25,920	51,297	1.9791