Task 12993210

Name	hadcm3n_s6m9_1940_40_007301084_0
Workunit	7498508
Created	21 Jun 2011, 2:11:13 UTC
Sent	21 Jun 2011, 2:13:50 UTC
Report deadline	20 Sep 2011, 9:41:01 UTC
Received	30 Jun 2011, 10:24:55 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1062240
Run time	4 days 14 hours 12 min 40 sec
CPU time	4 days 9 hours 43 min 8 sec
Validate state	Invalid
Credit	2,799.36
Device peak FLOPS	2.88 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu
Stderr	<core_client_version>6.10.59</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:32:30 (1737): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:40:46 (1774): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:24:11 (6929): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:20:45 (10949): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:25:18 (11962): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:25:19 (11962): No heartbeat from core client for 30 sec - exiting 17:25:20 (11962): No heartbeat from core client for 30 sec - exiting 17:25:21 (11962): No heartbeat from core client for 30 sec - exiting 17:25:22 (11962): No heartbeat from core client for 30 sec - exiting 17:25:23 (11962): No heartbeat from core client for 30 sec - exiting 17:25:24 (11962): No heartbeat from core client for 30 sec - exiting 17:25:25 (11962): No heartbeat from core client for 30 sec - exiting 17:25:26 (11962): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:53:07 (12128): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 09:55:23 (12128): No heartbeat from core client for 30 sec - exiting 09:55:24 (12128): No heartbeat from core client for 30 sec - exiting 09:55:25 (12128): No heartbeat from core client for 30 sec - exiting 09:56:55 (2182): No heartbeat from core client for 30 sec - exiting 09:57:04 (2182): No heartbeat from core client for 30 sec - exiting 09:57:05 (2182): No heartbeat from core client for 30 sec - exiting 09:57:06 (2182): No heartbeat from core client for 30 sec - exiting 09:57:07 (2182): No heartbeat from core client for 30 sec - exiting 09:57:08 (2182): No heartbeat from core client for 30 sec - exiting 09:57:09 (2182): No heartbeat from core client for 30 sec - exiting 09:57:10 (2182): No heartbeat from core client for 30 sec - exiting 09:57:11 (2182): No heartbeat from core client for 30 sec - exiting 09:57:12 (2182): No heartbeat from core client for 30 sec - exiting 09:57:13 (2182): No heartbeat from core client for 30 sec - exiting 09:57:14 (2182): No heartbeat from core client for 30 sec - exiting 09:57:15 (2182): No heartbeat from core client for 30 sec - exiting 09:57:16 (2182): No heartbeat from core client for 30 sec - exiting 09:57:17 (2182): No heartbeat from core client for 30 sec - exiting 09:57:18 (2182): No heartbeat from core client for 30 sec - exiting 09:57:19 (2182): No heartbeat from core client for 30 sec - exiting 09:57:20 (2182): No heartbeat from core client for 30 sec - exiting 09:57:21 (2182): No heartbeat from core client for 30 sec - exiting 09:57:22 (2182): No heartbeat from core client for 30 sec - exiting 09:57:23 (2182): No heartbeat from core client for 30 sec - exiting 09:57:24 (2182): No heartbeat from core client for 30 sec - exiting 09:57:25 (2182): No heartbeat from core client for 30 sec - exiting 09:57:26 (2182): No heartbeat from core client for 30 sec - exiting 09:57:27 (2182): No heartbeat from core client for 30 sec - exiting 09:57:28 (2182): No heartbeat from core client for 30 sec - exiting 09:57:29 (2182): No heartbeat from core client for 30 sec - exiting 09:57:30 (2182): No heartbeat from core client for 30 sec - exiting 09:57:31 (2182): No heartbeat from core client for 30 sec - exiting 09:57:32 (2182): No heartbeat from core client for 30 sec - exiting 09:57:33 (2182): No heartbeat from core client for 30 sec - exiting 09:57:34 (2182): No heartbeat from core client for 30 sec - exiting 09:57:35 (2182): No heartbeat from core client for 30 sec - exiting 09:57:36 (2182): No heartbeat from core client for 30 sec - exiting 09:57:37 (2182): No heartbeat from core client for 30 sec - exiting 09:57:38 (2182): No heartbeat from core client for 30 sec - exiting 09:57:39 (2182): No heartbeat from core client for 30 sec - exiting 09:57:40 (2182): No heartbeat from core client for 30 sec - exiting 09:57:41 (2182): No heartbeat from core client for 30 sec - exiting 09:57:42 (2182): No heartbeat from core client for 30 sec - exiting 09:57:43 (2182): No heartbeat from core client for 30 sec - exiting 09:57:44 (2182): No heartbeat from core client for 30 sec - exiting 09:57:45 (2182): No heartbeat from core client for 30 sec - exiting 09:57:46 (2182): No heartbeat from core client for 30 sec - exiting 09:57:47 (2182): No heartbeat from core client for 30 sec - exiting 09:57:48 (2182): No heartbeat from core client for 30 sec - exiting 09:57:49 (2182): No heartbeat from core client for 30 sec - exiting 09:57:50 (2182): No heartbeat from core client for 30 sec - exiting 09:57:51 (2182): No heartbeat from core client for 30 sec - exiting 09:57:52 (2182): No heartbeat from core client for 30 sec - exiting 09:57:53 (2182): No heartbeat from core client for 30 sec - exiting 09:57:54 (2182): No heartbeat from core client for 30 sec - exiting 09:57:55 (2182): No heartbeat from core client for 30 sec - exiting 09:57:56 (2182): No heartbeat from core client for 30 sec - exiting 09:57:57 (2182): No heartbeat from core client for 30 sec - exiting 09:57:58 (2182): No heartbeat from core client for 30 sec - exiting 09:57:59 (2182): No heartbeat from core client for 30 sec - exiting 09:58:00 (2182): No heartbeat from core client for 30 sec - exiting 09:58:01 (2182): No heartbeat from core client for 30 sec - exiting 09:58:02 (2182): No heartbeat from core client for 30 sec - exiting 09:58:03 (2182): No heartbeat from core client for 30 sec - exiting 09:58:04 (2182): No heartbeat from core client for 30 sec - exiting 09:58:05 (2182): No heartbeat from core client for 30 sec - exiting 09:58:06 (2182): No heartbeat from core client for 30 sec - exiting 09:58:07 (2182): No heartbeat from core client for 30 sec - exiting 09:58:08 (2182): No heartbeat from core client for 30 sec - exiting 09:58:09 (2182): No heartbeat from core client for 30 sec - exiting 09:58:10 (2182): No heartbeat from core client for 30 sec - exiting 09:58:11 (2182): No heartbeat from core client for 30 sec - exiting 09:58:12 (2182): No heartbeat from core client for 30 sec - exiting 09:58:13 (2182): No heartbeat from core client for 30 sec - exiting 09:58:14 (2182): No heartbeat from core client for 30 sec - exiting 09:58:15 (2182): No heartbeat from core client for 30 sec - exiting 09:58:16 (2182): No heartbeat from core client for 30 sec - exiting 09:58:17 (2182): No heartbeat from core client for 30 sec - exiting 09:58:18 (2182): No heartbeat from core client for 30 sec - exiting 09:58:19 (2182): No heartbeat from core client for 30 sec - exiting 09:58:20 (2182): No heartbeat from core client for 30 sec - exiting 09:58:21 (2182): No heartbeat from core client for 30 sec - exiting 09:58:22 (2182): No heartbeat from core client for 30 sec - exiting 09:58:23 (2182): No heartbeat from core client for 30 sec - exiting 09:58:24 (2182): No heartbeat from core client for 30 sec - exiting 09:58:25 (2182): No heartbeat from core client for 30 sec - exiting 09:58:26 (2182): No heartbeat from core client for 30 sec - exiting 09:58:27 (2182): No heartbeat from core client for 30 sec - exiting 09:58:28 (2182): No heartbeat from core client for 30 sec - exiting 09:58:29 (2182): No heartbeat from core client for 30 sec - exiting 09:58:30 (2182): No heartbeat from core client for 30 sec - exiting 09:58:31 (2182): No heartbeat from core client for 30 sec - exiting 09:58:32 (2182): No heartbeat from core client for 30 sec - exiting 09:58:33 (2182): No heartbeat from core client for 30 sec - exiting 09:58:34 (2182): No heartbeat from core client for 30 sec - exiting 09:58:35 (2182): No heartbeat from core client for 30 sec - exiting 09:58:36 (2182): No heartbeat from core client for 30 sec - exiting 09:58:37 (2182): No heartbeat from core client for 30 sec - exiting 09:58:38 (2182): No heartbeat from core client for 30 sec - exiting 09:58:39 (2182): No heartbeat from core client for 30 sec - exiting 09:58:40 (2182): No heartbeat from core client for 30 sec - exiting 09:58:41 (2182): No heartbeat from core client for 30 sec - exiting 09:58:42 (2182): No heartbeat from core client for 30 sec - exiting 09:58:43 (2182): No heartbeat from core client for 30 sec - exiting 09:58:44 (2182): No heartbeat from core client for 30 sec - exiting 09:58:45 (2182): No heartbeat from core client for 30 sec - exiting 09:58:46 (2182): No heartbeat from core client for 30 sec - exiting 09:58:47 (2182): No heartbeat from core client for 30 sec - exiting 09:58:48 (2182): No heartbeat from core client for 30 sec - exiting 09:58:49 (2182): No heartbeat from core client for 30 sec - exiting 09:58:50 (2182): No heartbeat from core client for 30 sec - exiting 09:58:51 (2182): No heartbeat from core client for 30 sec - exiting 09:58:52 (2182): No heartbeat from core client for 30 sec - exiting 09:58:53 (2182): No heartbeat from core client for 30 sec - exiting 09:58:54 (2182): No heartbeat from core client for 30 sec - exiting 09:58:55 (2182): No heartbeat from core client for 30 sec - exiting 09:58:56 (2182): No heartbeat from core client for 30 sec - exiting 09:58:57 (2182): No heartbeat from core client for 30 sec - exiting 09:58:58 (2182): No heartbeat from core client for 30 sec - exiting 09:58:59 (2182): No heartbeat from core client for 30 sec - exiting 09:59:00 (2182): No heartbeat from core client for 30 sec - exiting 09:59:01 (2182): No heartbeat from core client for 30 sec - exiting 09:59:02 (2182): No heartbeat from core client for 30 sec - exiting 09:59:03 (2182): No heartbeat from core client for 30 sec - exiting 09:59:04 (2182): No heartbeat from core client for 30 sec - exiting 09:59:05 (2182): No heartbeat from core client for 30 sec - exiting 09:59:06 (2182): No heartbeat from core client for 30 sec - exiting 09:59:07 (2182): No heartbeat from core client for 30 sec - exiting 09:59:08 (2182): No heartbeat from core client for 30 sec - exiting 09:59:09 (2182): No heartbeat from core client for 30 sec - exiting 09:59:10 (2182): No heartbeat from core client for 30 sec - exiting 09:59:11 (2182): No heartbeat from core client for 30 sec - exiting 09:59:12 (2182): No heartbeat from core client for 30 sec - exiting 09:59:54 (2182): No heartbeat from core client for 30 sec - exiting 09:59:55 (2182): No heartbeat from core client for 30 sec - exiting 09:59:56 (2182): No heartbeat from core client for 30 sec - exiting 09:59:57 (2182): No heartbeat from core client for 30 sec - exiting 09:59:58 (2182): No heartbeat from core client for 30 sec - exiting 09:59:59 (2182): No heartbeat from core client for 30 sec - exiting 10:00:00 (2182): No heartbeat from core client for 30 sec - exiting 10:00:01 (2182): No heartbeat from core client for 30 sec - exiting 10:00:02 (2182): No heartbeat from core client for 30 sec - exiting 10:00:03 (2182): No heartbeat from core client for 30 sec - exiting 10:00:04 (2182): No heartbeat from core client for 30 sec - exiting 10:00:05 (2182): No heartbeat from core client for 30 sec - exiting 10:00:06 (2182): No heartbeat from core client for 30 sec - exiting 10:00:07 (2182): No heartbeat from core client for 30 sec - exiting 10:00:08 (2182): No heartbeat from core client for 30 sec - exiting 10:00:09 (2182): No heartbeat from core client for 30 sec - exiting 10:00:10 (2182): No heartbeat from core client for 30 sec - exiting 10:00:11 (2182): No heartbeat from core client for 30 sec - exiting 10:00:12 (2182): No heartbeat from core client for 30 sec - exiting 10:00:13 (2182): No heartbeat from core client for 30 sec - exiting 10:00:14 (2182): No heartbeat from core client for 30 sec - exiting 10:00:15 (2182): No heartbeat from core client for 30 sec - exiting 10:00:16 (2182): No heartbeat from core client for 30 sec - exiting 10:00:17 (2182): No heartbeat from core client for 30 sec - exiting 10:00:18 (2182): No heartbeat from core client for 30 sec - exiting 10:00:19 (2182): No heartbeat from core client for 30 sec - exiting 10:00:20 (2182): No heartbeat from core client for 30 sec - exiting 10:00:21 (2182): No heartbeat from core client for 30 sec - exiting 10:00:22 (2182): No heartbeat from core client for 30 sec - exiting 10:00:23 (2182): No heartbeat from core client for 30 sec - exiting 10:00:24 (2182): No heartbeat from core client for 30 sec - exiting 10:00:25 (2182): No heartbeat from core client for 30 sec - exiting 10:00:26 (2182): No heartbeat from core client for 30 sec - exiting 10:00:27 (2182): No heartbeat from core client for 30 sec - exiting 10:00:28 (2182): No heartbeat from core client for 30 sec - exiting 10:00:29 (2182): No heartbeat from core client for 30 sec - exiting 10:00:30 (2182): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:12:07 (2497): No heartbeat from core client for 30 sec - exiting 10:12:10 (2497): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:12:11 (2497): No heartbeat from core client for 30 sec - exiting 10:13:54 (2590): No heartbeat from core client for 30 sec - exiting 10:13:56 (2590): No heartbeat from core client for 30 sec - exiting 10:13:57 (2590): No heartbeat from core client for 30 sec - exiting 10:13:58 (2590): No heartbeat from core client for 30 sec - exiting 10:13:59 (2590): No heartbeat from core client for 30 sec - exiting 10:14:00 (2590): No heartbeat from core client for 30 sec - exiting 10:14:01 (2590): No heartbeat from core client for 30 sec - exiting 10:14:02 (2590): No heartbeat from core client for 30 sec - exiting 10:14:03 (2590): No heartbeat from core client for 30 sec - exiting 10:14:04 (2590): No heartbeat from core client for 30 sec - exiting 10:14:05 (2590): No heartbeat from core client for 30 sec - exiting 10:14:06 (2590): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:15:24 (2590): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 10:18:59 (2618): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:20:44 (2640): No heartbeat from core client for 30 sec - exiting 10:20:47 (2640): No heartbeat from core client for 30 sec - exiting 10:20:48 (2640): No heartbeat from core client for 30 sec - exiting 10:20:49 (2640): No heartbeat from core client for 30 sec - exiting 10:20:50 (2640): No heartbeat from core client for 30 sec - exiting 10:20:51 (2640): No heartbeat from core client for 30 sec - exiting 10:20:52 (2640): No heartbeat from core client for 30 sec - exiting 10:20:53 (2640): No heartbeat from core client for 30 sec - exiting 10:20:54 (2640): No heartbeat from core client for 30 sec - exiting 10:20:55 (2640): No heartbeat from core client for 30 sec - exiting 10:20:56 (2640): No heartbeat from core client for 30 sec - exiting 10:20:57 (2640): No heartbeat from core client for 30 sec - exiting 10:20:58 (2640): No heartbeat from core client for 30 sec - exiting 10:20:59 (2640): No heartbeat from core client for 30 sec - exiting 10:21:00 (2640): No heartbeat from core client for 30 sec - exiting 10:21:01 (2640): No heartbeat from core client for 30 sec - exiting 10:21:02 (2640): No heartbeat from core client for 30 sec - exiting 10:21:03 (2640): No heartbeat from core client for 30 sec - exiting 10:21:04 (2640): No heartbeat from core client for 30 sec - exiting 10:21:05 (2640): No heartbeat from core client for 30 sec - exiting 10:21:06 (2640): No heartbeat from core client for 30 sec - exiting 10:21:07 (2640): No heartbeat from core client for 30 sec - exiting 10:21:08 (2640): No heartbeat from core client for 30 sec - exiting 10:21:09 (2640): No heartbeat from core client for 30 sec - exiting 10:21:10 (2640): No heartbeat from core client for 30 sec - exiting 10:21:11 (2640): No heartbeat from core client for 30 sec - exiting 10:21:12 (2640): No heartbeat from core client for 30 sec - exiting 10:21:13 (2640): No heartbeat from core client for 30 sec - exiting 10:21:14 (2640): No heartbeat from core client for 30 sec - exiting 10:21:15 (2640): No heartbeat from core client for 30 sec - exiting 10:21:16 (2640): No heartbeat from core client for 30 sec - exiting 10:21:17 (2640): No heartbeat from core client for 30 sec - exiting 10:21:18 (2640): No heartbeat from core client for 30 sec - exiting 10:21:19 (2640): No heartbeat from core client for 30 sec - exiting 10:21:20 (2640): No heartbeat from core client for 30 sec - exiting 10:21:21 (2640): No heartbeat from core client for 30 sec - exiting 10:21:22 (2640): No heartbeat from core client for 30 sec - exiting 10:21:23 (2640): No heartbeat from core client for 30 sec - exiting 10:21:24 (2640): No heartbeat from core client for 30 sec - exiting 10:21:25 (2640): No heartbeat from core client for 30 sec - exiting 10:21:26 (2640): No heartbeat from core client for 30 sec - exiting 10:21:27 (2640): No heartbeat from core client for 30 sec - exiting 10:21:28 (2640): No heartbeat from core client for 30 sec - exiting 10:21:29 (2640): No heartbeat from core client for 30 sec - exiting 10:21:30 (2640): No heartbeat from core client for 30 sec - exiting 10:21:31 (2640): No heartbeat from core client for 30 sec - exiting 10:21:32 (2640): No heartbeat from core client for 30 sec - exiting 10:21:33 (2640): No heartbeat from core client for 30 sec - exiting 10:21:34 (2640): No heartbeat from core client for 30 sec - exiting 10:21:35 (2640): No heartbeat from core client for 30 sec - exiting 10:21:36 (2640): No heartbeat from core client for 30 sec - exiting 10:21:37 (2640): No heartbeat from core client for 30 sec - exiting 10:21:38 (2640): No heartbeat from core client for 30 sec - exiting 10:21:39 (2640): No heartbeat from core client for 30 sec - exiting 10:21:40 (2640): No heartbeat from core client for 30 sec - exiting 10:21:41 (2640): No heartbeat from core client for 30 sec - exiting 10:21:42 (2640): No heartbeat from core client for 30 sec - exiting 10:21:43 (2640): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:26:13 (2640): No heartbeat from core client for 30 sec - exiting 10:26:16 (2640): No heartbeat from core client for 30 sec - exiting 10:26:18 (2640): No heartbeat from core client for 30 sec - exiting 10:26:19 (2640): No heartbeat from core client for 30 sec - exiting 10:26:21 (2640): No heartbeat from core client for 30 sec - exiting 10:26:23 (2640): No heartbeat from core client for 30 sec - exiting 10:26:24 (2640): No heartbeat from core client for 30 sec - exiting 10:26:25 (2640): No heartbeat from core client for 30 sec - exiting 10:26:26 (2640): No heartbeat from core client for 30 sec - exiting 10:26:28 (2640): No heartbeat from core client for 30 sec - exiting 10:26:32 (2640): No heartbeat from core client for 30 sec - exiting 10:26:33 (2640): No heartbeat from core client for 30 sec - exiting 10:26:34 (2640): No heartbeat from core client for 30 sec - exiting 10:26:35 (2640): No heartbeat from core client for 30 sec - exiting 10:26:36 (2640): No heartbeat from core client for 30 sec - exiting 10:26:37 (2640): No heartbeat from core client for 30 sec - exiting 10:26:38 (2640): No heartbeat from core client for 30 sec - exiting 10:26:39 (2640): No heartbeat from core client for 30 sec - exiting 10:26:40 (2640): No heartbeat from core client for 30 sec - exiting 10:26:41 (2640): No heartbeat from core client for 30 sec - exiting 10:26:45 (2640): No heartbeat from core client for 30 sec - exiting 10:26:46 (2640): No heartbeat from core client for 30 sec - exiting 10:26:47 (2640): No heartbeat from core client for 30 sec - exiting 10:26:48 (2640): No heartbeat from core client for 30 sec - exiting 10:26:49 (2640): No heartbeat from core client for 30 sec - exiting 10:26:50 (2640): No heartbeat from core client for 30 sec - exiting 10:26:51 (2640): No heartbeat from core client for 30 sec - exiting 10:26:52 (2640): No heartbeat from core client for 30 sec - exiting 10:26:53 (2640): No heartbeat from core client for 30 sec - exiting 10:26:54 (2640): No heartbeat from core client for 30 sec - exiting 10:26:55 (2640): No heartbeat from core client for 30 sec - exiting 10:26:56 (2640): No heartbeat from core client for 30 sec - exiting 10:26:57 (2640): No heartbeat from core client for 30 sec - exiting 10:27:02 (2640): No heartbeat from core client for 30 sec - exiting 10:27:03 (2640): No heartbeat from core client for 30 sec - exiting 10:27:04 (2640): No heartbeat from core client for 30 sec - exiting 10:27:05 (2640): No heartbeat from core client for 30 sec - exiting 10:27:06 (2640): No heartbeat from core client for 30 sec - exiting 10:27:07 (2640): No heartbeat from core client for 30 sec - exiting 10:27:08 (2640): No heartbeat from core client for 30 sec - exiting 10:27:09 (2640): No heartbeat from core client for 30 sec - exiting 10:27:10 (2640): No heartbeat from core client for 30 sec - exiting 10:27:11 (2640): No heartbeat from core client for 30 sec - exiting 10:27:12 (2640): No heartbeat from core client for 30 sec - exiting 10:27:13 (2640): No heartbeat from core client for 30 sec - exiting 10:27:14 (2640): No heartbeat from core client for 30 sec - exiting 10:27:15 (2640): No heartbeat from core client for 30 sec - exiting 10:27:16 (2640): No heartbeat from core client for 30 sec - exiting 10:27:17 (2640): No heartbeat from core client for 30 sec - exiting 10:27:18 (2640): No heartbeat from core client for 30 sec - exiting 10:27:19 (2640): No heartbeat from core client for 30 sec - exiting 10:27:20 (2640): No heartbeat from core client for 30 sec - exiting 10:27:21 (2640): No heartbeat from core client for 30 sec - exiting 10:27:22 (2640): No heartbeat from core client for 30 sec - exiting 10:27:23 (2640): No heartbeat from core client for 30 sec - exiting 10:27:24 (2640): No heartbeat from core client for 30 sec - exiting 10:27:25 (2640): No heartbeat from core client for 30 sec - exiting 10:27:26 (2640): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
30 Jun 2011 09:09:40	1062240	12993210	hadcm3n_s6m9_1940_40_007301084_0	233,280	386,359	1.6562
26 Jun 2011 23:41:15	1062240	12993210	hadcm3n_s6m9_1940_40_007301084_0	207,360	343,667	1.6573
26 Jun 2011 12:35:52	1062240	12993210	hadcm3n_s6m9_1940_40_007301084_0	181,440	301,197	1.6600
25 Jun 2011 20:15:04	1062240	12993210	hadcm3n_s6m9_1940_40_007301084_0	155,520	258,397	1.6615
25 Jun 2011 07:37:07	1062240	12993210	hadcm3n_s6m9_1940_40_007301084_0	129,600	215,504	1.6628
24 Jun 2011 19:31:13	1062240	12993210	hadcm3n_s6m9_1940_40_007301084_0	103,680	172,400	1.6628
24 Jun 2011 07:25:16	1062240	12993210	hadcm3n_s6m9_1940_40_007301084_0	77,760	129,533	1.6658
23 Jun 2011 19:22:10	1062240	12993210	hadcm3n_s6m9_1940_40_007301084_0	51,840	86,689	1.6722
22 Jun 2011 11:02:54	1062240	12993210	hadcm3n_s6m9_1940_40_007301084_0	25,920	43,165	1.6653