Task 16477748

Name	hadam3p_anz_nav3_2012_1_008587767_1
Workunit	8734279
Created	3 Apr 2014, 16:58:49 UTC
Sent	3 Apr 2014, 17:24:45 UTC
Report deadline	16 Mar 2015, 22:44:45 UTC
Received	17 Apr 2014, 23:51:25 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1323270
Run time	5 days 20 hours 55 min 44 sec
CPU time	5 days 3 hours 36 min 8 sec
Validate state	Invalid
Credit	1,503.36
Device peak FLOPS	2.24 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 i686-pc-linux-gnu
Stderr	<core_client_version>7.0.27</core_client_version> <![CDATA[ <stderr_txt> 14:23:51 (2106): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 20:08:06 (2248): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:08:07 (2248): No heartbeat from core client for 30 sec - exiting 20:08:08 (2248): No heartbeat from core client for 30 sec - exiting 20:08:09 (2248): No heartbeat from core client for 30 sec - exiting 20:08:10 (2248): No heartbeat from core client for 30 sec - exiting 20:08:11 (2248): No heartbeat from core client for 30 sec - exiting 20:08:12 (2248): No heartbeat from core client for 30 sec - exiting 20:08:13 (2248): No heartbeat from core client for 30 sec - exiting 20:08:14 (2248): No heartbeat from core client for 30 sec - exiting 20:08:15 (2248): No heartbeat from core client for 30 sec - exiting 20:08:16 (2248): No heartbeat from core client for 30 sec - exiting 20:08:17 (2248): No heartbeat from core client for 30 sec - exiting 20:08:18 (2248): No heartbeat from core client for 30 sec - exiting 20:59:11 (2277): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:03:56 (2320): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 02:15:10 (1173): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:57:04 (1741): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:58:04 (1878): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:58:05 (1878): No heartbeat from core client for 30 sec - exiting 05:58:06 (1878): No heartbeat from core client for 30 sec - exiting 05:58:07 (1878): No heartbeat from core client for 30 sec - exiting 10:44:24 (1912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:46:33 (2312): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:46:34 (2312): No heartbeat from core client for 30 sec - exiting 10:46:35 (2312): No heartbeat from core client for 30 sec - exiting 10:46:36 (2312): No heartbeat from core client for 30 sec - exiting 10:46:37 (2312): No heartbeat from core client for 30 sec - exiting 10:46:38 (2312): No heartbeat from core client for 30 sec - exiting 10:46:39 (2312): No heartbeat from core client for 30 sec - exiting 11:29:38 (2351): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:29:09 (2411): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:29:10 (2411): No heartbeat from core client for 30 sec - exiting 15:29:11 (2411): No heartbeat from core client for 30 sec - exiting 15:29:12 (2411): No heartbeat from core client for 30 sec - exiting 15:29:13 (2411): No heartbeat from core client for 30 sec - exiting 15:29:14 (2411): No heartbeat from core client for 30 sec - exiting 15:29:15 (2411): No heartbeat from core client for 30 sec - exiting 15:29:16 (2411): No heartbeat from core client for 30 sec - exiting 15:29:17 (2411): No heartbeat from core client for 30 sec - exiting 15:29:18 (2411): No heartbeat from core client for 30 sec - exiting 15:29:19 (2411): No heartbeat from core client for 30 sec - exiting 15:29:20 (2411): No heartbeat from core client for 30 sec - exiting 15:32:57 (2710): No heartbeat from core client for 30 sec - exiting 15:33:03 (2710): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 18:21:05 (3242): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:21:06 (3242): No heartbeat from core client for 30 sec - exiting 18:21:07 (3242): No heartbeat from core client for 30 sec - exiting 18:21:08 (3242): No heartbeat from core client for 30 sec - exiting 18:21:09 (3242): No heartbeat from core client for 30 sec - exiting 18:21:10 (3242): No heartbeat from core client for 30 sec - exiting 18:21:11 (3242): No heartbeat from core client for 30 sec - exiting 18:21:12 (3242): No heartbeat from core client for 30 sec - exiting 18:21:13 (3242): No heartbeat from core client for 30 sec - exiting 18:21:14 (3242): No heartbeat from core client for 30 sec - exiting 18:21:15 (3242): No heartbeat from core client for 30 sec - exiting 18:21:16 (3242): No heartbeat from core client for 30 sec - exiting 18:21:17 (3242): No heartbeat from core client for 30 sec - exiting 18:21:18 (3242): No heartbeat from core client for 30 sec - exiting 18:21:19 (3242): No heartbeat from core client for 30 sec - exiting 18:21:20 (3242): No heartbeat from core client for 30 sec - exiting 18:21:21 (3242): No heartbeat from core client for 30 sec - exiting 18:21:22 (3242): No heartbeat from core client for 30 sec - exiting 18:21:23 (3242): No heartbeat from core client for 30 sec - exiting 18:23:19 (3299): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:37:42 (3340): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:37:52 (3340): No heartbeat from core client for 30 sec - exiting 18:52:32 (3393): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 19:11:07 (3664): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:11:08 (3664): No heartbeat from core client for 30 sec - exiting 19:11:09 (3664): No heartbeat from core client for 30 sec - exiting 19:11:10 (3664): No heartbeat from core client for 30 sec - exiting 19:11:11 (3664): No heartbeat from core client for 30 sec - exiting 19:11:12 (3664): No heartbeat from core client for 30 sec - exiting 19:11:13 (3664): No heartbeat from core client for 30 sec - exiting 19:11:14 (3664): No heartbeat from core client for 30 sec - exiting 19:11:15 (3664): No heartbeat from core client for 30 sec - exiting 19:11:16 (3664): No heartbeat from core client for 30 sec - exiting 19:11:17 (3664): No heartbeat from core client for 30 sec - exiting 19:11:18 (3664): No heartbeat from core client for 30 sec - exiting 19:11:19 (3664): No heartbeat from core client for 30 sec - exiting 19:11:20 (3664): No heartbeat from core client for 30 sec - exiting 19:11:21 (3664): No heartbeat from core client for 30 sec - exiting 19:11:22 (3664): No heartbeat from core client for 30 sec - exiting 19:11:23 (3664): No heartbeat from core client for 30 sec - exiting 19:11:24 (3664): No heartbeat from core client for 30 sec - exiting 19:11:25 (3664): No heartbeat from core client for 30 sec - exiting 19:11:26 (3664): No heartbeat from core client for 30 sec - exiting 19:11:27 (3664): No heartbeat from core client for 30 sec - exiting 19:11:28 (3664): No heartbeat from core client for 30 sec - exiting 19:11:29 (3664): No heartbeat from core client for 30 sec - exiting 19:11:30 (3664): No heartbeat from core client for 30 sec - exiting 19:11:31 (3664): No heartbeat from core client for 30 sec - exiting 19:11:32 (3664): No heartbeat from core client for 30 sec - exiting 19:11:33 (3664): No heartbeat from core client for 30 sec - exiting 19:11:34 (3664): No heartbeat from core client for 30 sec - exiting 19:11:35 (3664): No heartbeat from core client for 30 sec - exiting 19:11:36 (3664): No heartbeat from core client for 30 sec - exiting 19:11:37 (3664): No heartbeat from core client for 30 sec - exiting 19:11:38 (3664): No heartbeat from core client for 30 sec - exiting 19:11:39 (3664): No heartbeat from core client for 30 sec - exiting 19:11:40 (3664): No heartbeat from core client for 30 sec - exiting 19:11:41 (3664): No heartbeat from core client for 30 sec - exiting 19:11:42 (3664): No heartbeat from core client for 30 sec - exiting 19:11:43 (3664): No heartbeat from core client for 30 sec - exiting 19:11:44 (3664): No heartbeat from core client for 30 sec - exiting 19:11:45 (3664): No heartbeat from core client for 30 sec - exiting 19:11:46 (3664): No heartbeat from core client for 30 sec - exiting 19:11:47 (3664): No heartbeat from core client for 30 sec - exiting 19:11:48 (3664): No heartbeat from core client for 30 sec - exiting 19:11:49 (3664): No heartbeat from core client for 30 sec - exiting 19:11:50 (3664): No heartbeat from core client for 30 sec - exiting 19:11:51 (3664): No heartbeat from core client for 30 sec - exiting 19:11:52 (3664): No heartbeat from core client for 30 sec - exiting 19:11:53 (3664): No heartbeat from core client for 30 sec - exiting 19:11:54 (3664): No heartbeat from core client for 30 sec - exiting 19:11:55 (3664): No heartbeat from core client for 30 sec - exiting 19:11:56 (3664): No heartbeat from core client for 30 sec - exiting 19:11:57 (3664): No heartbeat from core client for 30 sec - exiting 19:11:58 (3664): No heartbeat from core client for 30 sec - exiting 19:11:59 (3664): No heartbeat from core client for 30 sec - exiting 19:12:00 (3664): No heartbeat from core client for 30 sec - exiting 19:16:49 (4483): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:17:40 (4578): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:33:47 (4625): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:34:57 (4675): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:34:58 (4675): No heartbeat from core client for 30 sec - exiting 19:34:59 (4675): No heartbeat from core client for 30 sec - exiting 19:35:00 (4675): No heartbeat from core client for 30 sec - exiting 19:35:01 (4675): No heartbeat from core client for 30 sec - exiting 19:35:02 (4675): No heartbeat from core client for 30 sec - exiting 21:01:57 (4722): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:04:35 (4843): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:19:34 (4897): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:50:48 (4945): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:12:05 (6914): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:27:24 (7007): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:27:25 (7007): No heartbeat from core client for 30 sec - exiting 03:27:26 (7007): No heartbeat from core client for 30 sec - exiting 03:27:27 (7007): No heartbeat from core client for 30 sec - exiting 03:27:28 (7007): No heartbeat from core client for 30 sec - exiting 03:27:29 (7007): No heartbeat from core client for 30 sec - exiting 03:27:30 (7007): No heartbeat from core client for 30 sec - exiting 03:27:31 (7007): No heartbeat from core client for 30 sec - exiting 03:27:32 (7007): No heartbeat from core client for 30 sec - exiting 03:27:33 (7007): No heartbeat from core client for 30 sec - exiting 03:27:34 (7007): No heartbeat from core client for 30 sec - exiting 03:27:35 (7007): No heartbeat from core client for 30 sec - exiting 03:27:36 (7007): No heartbeat from core client for 30 sec - exiting 03:27:37 (7007): No heartbeat from core client for 30 sec - exiting 03:27:38 (7007): No heartbeat from core client for 30 sec - exiting 03:27:39 (7007): No heartbeat from core client for 30 sec - exiting 03:27:40 (7007): No heartbeat from core client for 30 sec - exiting 03:27:41 (7007): No heartbeat from core client for 30 sec - exiting 03:27:42 (7007): No heartbeat from core client for 30 sec - exiting 03:42:35 (7080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:42:36 (7080): No heartbeat from core client for 30 sec - exiting 03:42:37 (7080): No heartbeat from core client for 30 sec - exiting 03:42:38 (7080): No heartbeat from core client for 30 sec - exiting 03:42:39 (7080): No heartbeat from core client for 30 sec - exiting 03:42:40 (7080): No heartbeat from core client for 30 sec - exiting 04:28:18 (7117): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:59:21 (7204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:14:34 (8910): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:14:40 (8910): No heartbeat from core client for 30 sec - exiting 01:30:11 (8954): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:30:12 (8954): No heartbeat from core client for 30 sec - exiting 01:30:13 (8954): No heartbeat from core client for 30 sec - exiting 01:30:14 (8954): No heartbeat from core client for 30 sec - exiting 01:30:15 (8954): No heartbeat from core client for 30 sec - exiting 01:30:16 (8954): No heartbeat from core client for 30 sec - exiting 01:30:17 (8954): No heartbeat from core client for 30 sec - exiting 01:30:18 (8954): No heartbeat from core client for 30 sec - exiting 01:30:19 (8954): No heartbeat from core client for 30 sec - exiting 01:30:20 (8954): No heartbeat from core client for 30 sec - exiting 01:30:25 (8954): No heartbeat from core client for 30 sec - exiting 01:30:26 (8954): No heartbeat from core client for 30 sec - exiting 01:30:27 (8954): No heartbeat from core client for 30 sec - exiting 01:30:28 (8954): No heartbeat from core client for 30 sec - exiting 01:30:29 (8954): No heartbeat from core client for 30 sec - exiting 01:30:30 (8954): No heartbeat from core client for 30 sec - exiting 01:30:31 (8954): No heartbeat from core client for 30 sec - exiting 01:30:32 (8954): No heartbeat from core client for 30 sec - exiting 01:30:33 (8954): No heartbeat from core client for 30 sec - exiting 01:30:34 (8954): No heartbeat from core client for 30 sec - exiting 01:30:35 (8954): No heartbeat from core client for 30 sec - exiting 01:30:36 (8954): No heartbeat from core client for 30 sec - exiting 01:30:37 (8954): No heartbeat from core client for 30 sec - exiting 01:30:38 (8954): No heartbeat from core client for 30 sec - exiting 01:30:39 (8954): No heartbeat from core client for 30 sec - exiting 01:30:40 (8954): No heartbeat from core client for 30 sec - exiting 01:30:41 (8954): No heartbeat from core client for 30 sec - exiting 01:30:42 (8954): No heartbeat from core client for 30 sec - exiting 01:30:43 (8954): No heartbeat from core client for 30 sec - exiting 01:30:44 (8954): No heartbeat from core client for 30 sec - exiting 01:30:45 (8954): No heartbeat from core client for 30 sec - exiting 01:30:46 (8954): No heartbeat from core client for 30 sec - exiting 01:30:47 (8954): No heartbeat from core client for 30 sec - exiting 01:30:48 (8954): No heartbeat from core client for 30 sec - exiting 01:30:49 (8954): No heartbeat from core client for 30 sec - exiting 01:30:50 (8954): No heartbeat from core client for 30 sec - exiting 01:30:51 (8954): No heartbeat from core client for 30 sec - exiting 01:30:52 (8954): No heartbeat from core client for 30 sec - exiting 01:30:53 (8954): No heartbeat from core client for 30 sec - exiting 01:30:54 (8954): No heartbeat from core client for 30 sec - exiting 01:30:55 (8954): No heartbeat from core client for 30 sec - exiting 01:30:56 (8954): No heartbeat from core client for 30 sec - exiting 01:30:57 (8954): No heartbeat from core client for 30 sec - exiting 01:30:58 (8954): No heartbeat from core client for 30 sec - exiting 01:30:59 (8954): No heartbeat from core client for 30 sec - exiting 01:31:00 (8954): No heartbeat from core client for 30 sec - exiting 01:31:01 (8954): No heartbeat from core client for 30 sec - exiting 01:31:02 (8954): No heartbeat from core client for 30 sec - exiting 01:31:03 (8954): No heartbeat from core client for 30 sec - exiting 01:31:04 (8954): No heartbeat from core client for 30 sec - exiting 01:31:05 (8954): No heartbeat from core client for 30 sec - exiting 01:31:06 (8954): No heartbeat from core client for 30 sec - exiting 01:31:07 (8954): No heartbeat from core client for 30 sec - exiting 01:31:08 (8954): No heartbeat from core client for 30 sec - exiting 01:45:22 (9003): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:45:23 (9003): No heartbeat from core client for 30 sec - exiting 01:45:24 (9003): No heartbeat from core client for 30 sec - exiting 01:45:25 (9003): No heartbeat from core client for 30 sec - exiting 01:45:26 (9003): No heartbeat from core client for 30 sec - exiting 01:45:27 (9003): No heartbeat from core client for 30 sec - exiting 01:45:28 (9003): No heartbeat from core client for 30 sec - exiting 01:45:29 (9003): No heartbeat from core client for 30 sec - exiting 01:45:30 (9003): No heartbeat from core client for 30 sec - exiting 01:45:31 (9003): No heartbeat from core client for 30 sec - exiting 01:45:32 (9003): No heartbeat from core client for 30 sec - exiting 01:45:33 (9003): No heartbeat from core client for 30 sec - exiting 01:45:34 (9003): No heartbeat from core client for 30 sec - exiting 01:45:35 (9003): No heartbeat from core client for 30 sec - exiting 01:45:36 (9003): No heartbeat from core client for 30 sec - exiting 01:45:37 (9003): No heartbeat from core client for 30 sec - exiting 01:45:38 (9003): No heartbeat from core client for 30 sec - exiting 01:45:39 (9003): No heartbeat from core client for 30 sec - exiting 01:45:40 (9003): No heartbeat from core client for 30 sec - exiting 01:45:41 (9003): No heartbeat from core client for 30 sec - exiting 01:45:42 (9003): No heartbeat from core client for 30 sec - exiting 01:45:43 (9003): No heartbeat from core client for 30 sec - exiting 01:45:44 (9003): No heartbeat from core client for 30 sec - exiting 01:45:45 (9003): No heartbeat from core client for 30 sec - exiting 01:45:46 (9003): No heartbeat from core client for 30 sec - exiting 01:45:47 (9003): No heartbeat from core client for 30 sec - exiting 01:45:48 (9003): No heartbeat from core client for 30 sec - exiting 01:45:49 (9003): No heartbeat from core client for 30 sec - exiting 01:45:50 (9003): No heartbeat from core client for 30 sec - exiting 01:45:51 (9003): No heartbeat from core client for 30 sec - exiting 01:45:52 (9003): No heartbeat from core client for 30 sec - exiting 01:45:53 (9003): No heartbeat from core client for 30 sec - exiting 01:45:54 (9003): No heartbeat from core client for 30 sec - exiting 01:45:55 (9003): No heartbeat from core client for 30 sec - exiting 01:45:56 (9003): No heartbeat from core client for 30 sec - exiting 01:45:57 (9003): No heartbeat from core client for 30 sec - exiting 01:45:58 (9003): No heartbeat from core client for 30 sec - exiting 01:45:59 (9003): No heartbeat from core client for 30 sec - exiting 01:46:00 (9003): No heartbeat from core client for 30 sec - exiting 01:46:01 (9003): No heartbeat from core client for 30 sec - exiting 01:46:13 (9003): No heartbeat from core client for 30 sec - exiting 01:46:14 (9003): No heartbeat from core client for 30 sec - exiting 01:46:15 (9003): No heartbeat from core client for 30 sec - exiting 01:46:16 (9003): No heartbeat from core client for 30 sec - exiting 01:46:17 (9003): No heartbeat from core client for 30 sec - exiting 01:46:18 (9003): No heartbeat from core client for 30 sec - exiting 01:46:19 (9003): No heartbeat from core client for 30 sec - exiting 01:46:20 (9003): No heartbeat from core client for 30 sec - exiting 01:46:21 (9003): No heartbeat from core client for 30 sec - exiting 01:46:22 (9003): No heartbeat from core client for 30 sec - exiting 01:46:23 (9003): No heartbeat from core client for 30 sec - exiting 01:46:24 (9003): No heartbeat from core client for 30 sec - exiting 01:46:25 (9003): No heartbeat from core client for 30 sec - exiting 01:46:26 (9003): No heartbeat from core client for 30 sec - exiting 01:46:27 (9003): No heartbeat from core client for 30 sec - exiting 01:46:28 (9003): No heartbeat from core client for 30 sec - exiting 01:46:29 (9003): No heartbeat from core client for 30 sec - exiting 01:46:30 (9003): No heartbeat from core client for 30 sec - exiting 01:46:31 (9003): No heartbeat from core client for 30 sec - exiting 01:46:32 (9003): No heartbeat from core client for 30 sec - exiting 01:46:33 (9003): No heartbeat from core client for 30 sec - exiting 01:46:34 (9003): No heartbeat from core client for 30 sec - exiting 01:46:35 (9003): No heartbeat from core client for 30 sec - exiting 01:46:36 (9003): No heartbeat from core client for 30 sec - exiting 03:13:48 (9076): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:51:15 (9179): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:51:16 (9179): No heartbeat from core client for 30 sec - exiting 06:51:17 (9179): No heartbeat from core client for 30 sec - exiting 06:51:18 (9179): No heartbeat from core client for 30 sec - exiting 06:52:02 (9570): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:53:30 (9611): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:58:53 (9651): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:14:21 (10088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:14:22 (10088): No heartbeat from core client for 30 sec - exiting 10:14:23 (10088): No heartbeat from core client for 30 sec - exiting 10:14:24 (10088): No heartbeat from core client for 30 sec - exiting 10:14:25 (10088): No heartbeat from core client for 30 sec - exiting 10:14:31 (10088): No heartbeat from core client for 30 sec - exiting 10:31:24 (10132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:33:41 (10185): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:34:41 (10228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:35:30 (10264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:35:31 (10264): No heartbeat from core client for 30 sec - exiting 10:35:32 (10264): No heartbeat from core client for 30 sec - exiting 10:35:33 (10264): No heartbeat from core client for 30 sec - exiting 10:35:34 (10264): No heartbeat from core client for 30 sec - exiting 10:35:35 (10264): No heartbeat from core client for 30 sec - exiting 10:35:36 (10264): No heartbeat from core client for 30 sec - exiting 10:35:37 (10264): No heartbeat from core client for 30 sec - exiting 10:35:38 (10264): No heartbeat from core client for 30 sec - exiting 10:35:39 (10264): No heartbeat from core client for 30 sec - exiting 10:35:40 (10264): No heartbeat from core client for 30 sec - exiting 10:48:10 (10307): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:48:11 (10307): No heartbeat from core client for 30 sec - exiting 10:48:12 (10307): No heartbeat from core client for 30 sec - exiting 10:48:13 (10307): No heartbeat from core client for 30 sec - exiting 10:48:14 (10307): No heartbeat from core client for 30 sec - exiting 10:48:15 (10307): No heartbeat from core client for 30 sec - exiting 10:48:16 (10307): No heartbeat from core client for 30 sec - exiting 10:48:17 (10307): No heartbeat from core client for 30 sec - exiting 10:48:18 (10307): No heartbeat from core client for 30 sec - exiting 10:48:19 (10307): No heartbeat from core client for 30 sec - exiting 10:48:20 (10307): No heartbeat from core client for 30 sec - exiting 10:48:21 (10307): No heartbeat from core client for 30 sec - exiting 10:48:22 (10307): No heartbeat from core client for 30 sec - exiting 10:48:23 (10307): No heartbeat from core client for 30 sec - exiting 10:48:24 (10307): No heartbeat from core client for 30 sec - exiting 10:48:25 (10307): No heartbeat from core client for 30 sec - exiting 10:48:26 (10307): No heartbeat from core client for 30 sec - exiting 10:48:27 (10307): No heartbeat from core client for 30 sec - exiting 10:48:28 (10307): No heartbeat from core client for 30 sec - exiting 10:48:29 (10307): No heartbeat from core client for 30 sec - exiting 10:48:30 (10307): No heartbeat from core client for 30 sec - exiting 10:48:31 (10307): No heartbeat from core client for 30 sec - exiting 10:48:32 (10307): No heartbeat from core client for 30 sec - exiting 10:48:33 (10307): No heartbeat from core client for 30 sec - exiting 10:48:34 (10307): No heartbeat from core client for 30 sec - exiting 10:48:35 (10307): No heartbeat from core client for 30 sec - exiting 10:48:36 (10307): No heartbeat from core client for 30 sec - exiting 10:48:37 (10307): No heartbeat from core client for 30 sec - exiting 11:03:17 (10363): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:03:18 (10363): No heartbeat from core client for 30 sec - exiting 11:03:19 (10363): No heartbeat from core client for 30 sec - exiting 11:03:20 (10363): No heartbeat from core client for 30 sec - exiting 11:03:21 (10363): No heartbeat from core client for 30 sec - exiting 11:03:22 (10363): No heartbeat from core client for 30 sec - exiting 16:10:12 (10432): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:10:15 (10432): No heartbeat from core client for 30 sec - exiting 16:11:15 (10728): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:11:16 (10728): No heartbeat from core client for 30 sec - exiting 16:11:17 (10728): No heartbeat from core client for 30 sec - exiting 16:11:18 (10728): No heartbeat from core client for 30 sec - exiting 16:11:19 (10728): No heartbeat from core client for 30 sec - exiting 18:08:32 (10768): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:24:25 (10903): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:24:47 (10903): No heartbeat from core client for 30 sec - exiting 02:53:23 (10959): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:07:53 (11418): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:08:04 (11418): No heartbeat from core client for 30 sec - exiting 03:08:37 (11418): No heartbeat from core client for 30 sec - exiting 03:08:38 (11418): No heartbeat from core client for 30 sec - exiting 04:31:44 (11460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:46:54 (11581): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:01:51 (11650): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:35:21 (11686): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:36:42 (12468): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:30:55 (12507): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:57:39 (14592): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:40:43 (14713): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:40:44 (14713): No heartbeat from core client for 30 sec - exiting 15:40:45 (14713): No heartbeat from core client for 30 sec - exiting 15:40:46 (14713): No heartbeat from core client for 30 sec - exiting 15:40:47 (14713): No heartbeat from core client for 30 sec - exiting 15:40:48 (14713): No heartbeat from core client for 30 sec - exiting 15:40:49 (14713): No heartbeat from core client for 30 sec - exiting 15:40:50 (14713): No heartbeat from core client for 30 sec - exiting 15:40:51 (14713): No heartbeat from core client for 30 sec - exiting 15:55:40 (15020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:58:56 (15088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:13:57 (15127): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:14:25 (15127): No heartbeat from core client for 30 sec - exiting 16:14:26 (15127): No heartbeat from core client for 30 sec - exiting 16:14:27 (15127): No heartbeat from core client for 30 sec - exiting 16:30:46 (15174): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:30:47 (15174): No heartbeat from core client for 30 sec - exiting 16:30:48 (15174): No heartbeat from core client for 30 sec - exiting 16:30:49 (15174): No heartbeat from core client for 30 sec - exiting 16:30:50 (15174): No heartbeat from core client for 30 sec - exiting 16:30:51 (15174): No heartbeat from core client for 30 sec - exiting 16:30:52 (15174): No heartbeat from core client for 30 sec - exiting 16:30:53 (15174): No heartbeat from core client for 30 sec - exiting 16:30:54 (15174): No heartbeat from core client for 30 sec - exiting 04:21:28 (15220): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:42:10 (15835): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:15:09 (15931): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:29:25 (16639): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:29:26 (16639): No heartbeat from core client for 30 sec - exiting 13:29:27 (16639): No heartbeat from core client for 30 sec - exiting 13:29:28 (16639): No heartbeat from core client for 30 sec - exiting 13:29:29 (16639): No heartbeat from core client for 30 sec - exiting 13:29:30 (16639): No heartbeat from core client for 30 sec - exiting 13:29:31 (16639): No heartbeat from core client for 30 sec - exiting 13:29:32 (16639): No heartbeat from core client for 30 sec - exiting 13:29:33 (16639): No heartbeat from core client for 30 sec - exiting 13:29:34 (16639): No heartbeat from core client for 30 sec - exiting 13:29:35 (16639): No heartbeat from core client for 30 sec - exiting 13:29:36 (16639): No heartbeat from core client for 30 sec - exiting 13:29:37 (16639): No heartbeat from core client for 30 sec - exiting 13:29:38 (16639): No heartbeat from core client for 30 sec - exiting 13:29:39 (16639): No heartbeat from core client for 30 sec - exiting 13:29:40 (16639): No heartbeat from core client for 30 sec - exiting 13:29:41 (16639): No heartbeat from core client for 30 sec - exiting 13:29:42 (16639): No heartbeat from core client for 30 sec - exiting 13:29:43 (16639): No heartbeat from core client for 30 sec - exiting 13:29:44 (16639): No heartbeat from core client for 30 sec - exiting 13:29:45 (16639): No heartbeat from core client for 30 sec - exiting 13:29:46 (16639): No heartbeat from core client for 30 sec - exiting 13:29:47 (16639): No heartbeat from core client for 30 sec - exiting 13:29:48 (16639): No heartbeat from core client for 30 sec - exiting 13:29:49 (16639): No heartbeat from core client for 30 sec - exiting 13:29:50 (16639): No heartbeat from core client for 30 sec - exiting 13:29:51 (16639): No heartbeat from core client for 30 sec - exiting 13:29:52 (16639): No heartbeat from core client for 30 sec - exiting 13:29:53 (16639): No heartbeat from core client for 30 sec - exiting 13:29:54 (16639): No heartbeat from core client for 30 sec - exiting 18:36:26 (16685): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:52:42 (16969): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:53:11 (16969): No heartbeat from core client for 30 sec - exiting Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/xaakm.pipe_dummy 2048 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=17022, selfPID=17010, iMonCtr=1 Model crash detected, will try to restart... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=17022, selfPID=17022, iMonCtr=2 Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_anz_nav3_2012_1_008587767_1_4.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_nav3_2012_1_008587767_1_5.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_nav3_2012_1_008587767_1_6.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_nav3_2012_1_008587767_1_7.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_nav3_2012_1_008587767_1_8.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_nav3_2012_1_008587767_1_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_nav3_2012_1_008587767_1_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_nav3_2012_1_008587767_1_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_nav3_2012_1_008587767_1_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
16 Apr 2014 19:21:35	1323270	16477748	hadam3p_anz_nav3_2012_1_008587767_1	34,859	377,030	10.8159
14 Apr 2014 21:20:17	1323270	16477748	hadam3p_anz_nav3_2012_1_008587767_1	23,339	249,263	10.6801
12 Apr 2014 22:14:19	1323270	16477748	hadam3p_anz_nav3_2012_1_008587767_1	11,819	124,290	10.5161