Task 18808778

Name	hadam3p_anz_a2jd_2008_1_010098399_0
Workunit	10077989
Created	12 Aug 2015, 17:16:58 UTC
Sent	15 Aug 2015, 3:12:22 UTC
Report deadline	27 Jul 2016, 8:32:22 UTC
Received	20 Aug 2015, 22:01:44 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1303251
Run time	4 days 12 hours 36 min 9 sec
CPU time	3 days 8 hours 58 min 29 sec
Validate state	Invalid
Credit	4,981.10
Device peak FLOPS	3.22 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.4.42</core_client_version> <![CDATA[ <stderr_txt> 13:30:52 (7608): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:46:49 (10600): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:44:51 (8964): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:49:26 (2372): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:07:35 (14476): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:33:40 (18028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:57:16 (13508): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:13:44 (14420): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:14:59 (3636): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:56:48 (14944): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:39:04 (16348): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=14796, selfPID=14796, iMonCtr=2 03:03:45 (11948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:19:31 (11392): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:21:15 (7468): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:21:17 (7468): No heartbeat from core client for 30 sec - exiting 04:21:18 (7468): No heartbeat from core client for 30 sec - exiting 04:29:53 (20664): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:36:40 (21576): No heartbeat from core client for 30 sec - exiting 04:36:41 (21576): No heartbeat from core client for 30 sec - exiting 04:36:43 (21576): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:45:55 (20884): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:54:06 (20704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:36:41 (24408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:45:43 (22600): No heartbeat from core client for 30 sec - exiting 05:45:44 (22600): No heartbeat from core client for 30 sec - exiting 05:45:45 (22600): No heartbeat from core client for 30 sec - exiting 05:45:46 (22600): No heartbeat from core client for 30 sec - exiting 05:45:47 (22600): No heartbeat from core client for 30 sec - exiting 05:45:48 (22600): No heartbeat from core client for 30 sec - exiting 05:45:49 (22600): No heartbeat from core client for 30 sec - exiting 05:45:50 (22600): No heartbeat from core client for 30 sec - exiting 05:45:51 (22600): No heartbeat from core client for 30 sec - exiting 05:45:52 (22600): No heartbeat from core client for 30 sec - exiting 05:45:53 (22600): No heartbeat from core client for 30 sec - exiting 05:45:54 (22600): No heartbeat from core client for 30 sec - exiting 05:45:55 (22600): No heartbeat from core client for 30 sec - exiting 05:45:56 (22600): No heartbeat from core client for 30 sec - exiting 05:45:57 (22600): No heartbeat from core client for 30 sec - exiting 05:45:58 (22600): No heartbeat from core client for 30 sec - exiting 05:45:59 (22600): No heartbeat from core client for 30 sec - exiting 05:46:00 (22600): No heartbeat from core client for 30 sec - exiting 05:46:01 (22600): No heartbeat from core client for 30 sec - exiting 05:46:02 (22600): No heartbeat from core client for 30 sec - exiting 05:46:03 (22600): No heartbeat from core client for 30 sec - exiting 05:46:04 (22600): No heartbeat from core client for 30 sec - exiting 05:46:05 (22600): No heartbeat from core client for 30 sec - exiting 05:46:06 (22600): No heartbeat from core client for 30 sec - exiting 05:46:07 (22600): No heartbeat from core client for 30 sec - exiting 05:46:08 (22600): No heartbeat from core client for 30 sec - exiting 05:46:09 (22600): No heartbeat from core client for 30 sec - exiting 05:46:10 (22600): No heartbeat from core client for 30 sec - exiting 05:46:11 (22600): No heartbeat from core client for 30 sec - exiting 05:46:12 (22600): No heartbeat from core client for 30 sec - exiting 05:46:13 (22600): No heartbeat from core client for 30 sec - exiting 05:46:14 (22600): No heartbeat from core client for 30 sec - exiting 05:46:15 (22600): No heartbeat from core client for 30 sec - exiting 05:46:16 (22600): No heartbeat from core client for 30 sec - exiting 05:46:17 (22600): No heartbeat from core client for 30 sec - exiting 05:46:18 (22600): No heartbeat from core client for 30 sec - exiting 05:46:19 (22600): No heartbeat from core client for 30 sec - exiting 05:46:20 (22600): No heartbeat from core client for 30 sec - exiting 05:46:21 (22600): No heartbeat from core client for 30 sec - exiting 05:46:22 (22600): No heartbeat from core client for 30 sec - exiting 05:46:23 (22600): No heartbeat from core client for 30 sec - exiting 05:46:24 (22600): No heartbeat from core client for 30 sec - exiting 05:46:25 (22600): No heartbeat from core client for 30 sec - exiting 05:46:26 (22600): No heartbeat from core client for 30 sec - exiting 05:46:27 (22600): No heartbeat from core client for 30 sec - exiting 05:46:28 (22600): No heartbeat from core client for 30 sec - exiting 05:46:29 (22600): No heartbeat from core client for 30 sec - exiting 05:46:30 (22600): No heartbeat from core client for 30 sec - exiting 05:46:31 (22600): No heartbeat from core client for 30 sec - exiting 05:46:32 (22600): No heartbeat from core client for 30 sec - exiting 05:46:33 (22600): No heartbeat from core client for 30 sec - exiting 05:46:34 (22600): No heartbeat from core client for 30 sec - exiting 05:46:35 (22600): No heartbeat from core client for 30 sec - exiting 05:46:36 (22600): No heartbeat from core client for 30 sec - exiting 05:46:37 (22600): No heartbeat from core client for 30 sec - exiting 05:46:38 (22600): No heartbeat from core client for 30 sec - exiting 05:46:39 (22600): No heartbeat from core client for 30 sec - exiting 05:46:40 (22600): No heartbeat from core client for 30 sec - exiting 05:46:41 (22600): No heartbeat from core client for 30 sec - exiting 05:46:42 (22600): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:46:43 (22600): No heartbeat from core client for 30 sec - exiting 05:50:43 (23464): No heartbeat from core client for 30 sec - exiting 05:50:44 (23464): No heartbeat from core client for 30 sec - exiting 05:50:45 (23464): No heartbeat from core client for 30 sec - exiting 05:50:46 (23464): No heartbeat from core client for 30 sec - exiting 05:50:47 (23464): No heartbeat from core client for 30 sec - exiting 05:50:48 (23464): No heartbeat from core client for 30 sec - exiting 05:50:50 (23464): No heartbeat from core client for 30 sec - exiting 05:50:51 (23464): No heartbeat from core client for 30 sec - exiting 05:50:52 (23464): No heartbeat from core client for 30 sec - exiting 05:50:53 (23464): No heartbeat from core client for 30 sec - exiting 05:50:54 (23464): No heartbeat from core client for 30 sec - exiting 05:50:55 (23464): No heartbeat from core client for 30 sec - exiting 05:50:56 (23464): No heartbeat from core client for 30 sec - exiting 05:50:57 (23464): No heartbeat from core client for 30 sec - exiting 05:50:58 (23464): No heartbeat from core client for 30 sec - exiting 05:50:59 (23464): No heartbeat from core client for 30 sec - exiting 05:51:00 (23464): No heartbeat from core client for 30 sec - exiting 05:51:01 (23464): No heartbeat from core client for 30 sec - exiting 05:51:02 (23464): No heartbeat from core client for 30 sec - exiting 05:51:03 (23464): No heartbeat from core client for 30 sec - exiting 05:51:04 (23464): No heartbeat from core client for 30 sec - exiting 05:51:05 (23464): No heartbeat from core client for 30 sec - exiting 05:51:06 (23464): No heartbeat from core client for 30 sec - exiting 05:51:07 (23464): No heartbeat from core client for 30 sec - exiting 05:51:08 (23464): No heartbeat from core client for 30 sec - exiting 05:51:09 (23464): No heartbeat from core client for 30 sec - exiting 05:51:10 (23464): No heartbeat from core client for 30 sec - exiting 05:51:11 (23464): No heartbeat from core client for 30 sec - exiting 05:51:12 (23464): No heartbeat from core client for 30 sec - exiting 05:51:13 (23464): No heartbeat from core client for 30 sec - exiting 05:51:14 (23464): No heartbeat from core client for 30 sec - exiting 05:51:15 (23464): No heartbeat from core client for 30 sec - exiting 05:51:16 (23464): No heartbeat from core client for 30 sec - exiting 05:51:17 (23464): No heartbeat from core client for 30 sec - exiting 05:51:18 (23464): No heartbeat from core client for 30 sec - exiting 05:51:19 (23464): No heartbeat from core client for 30 sec - exiting 05:51:20 (23464): No heartbeat from core client for 30 sec - exiting 05:51:21 (23464): No heartbeat from core client for 30 sec - exiting 05:51:22 (23464): No heartbeat from core client for 30 sec - exiting 05:51:23 (23464): No heartbeat from core client for 30 sec - exiting 05:51:24 (23464): No heartbeat from core client for 30 sec - exiting 05:51:25 (23464): No heartbeat from core client for 30 sec - exiting 05:51:26 (23464): No heartbeat from core client for 30 sec - exiting 05:51:27 (23464): No heartbeat from core client for 30 sec - exiting 05:51:28 (23464): No heartbeat from core client for 30 sec - exiting 05:51:29 (23464): No heartbeat from core client for 30 sec - exiting 05:51:30 (23464): No heartbeat from core client for 30 sec - exiting 05:51:31 (23464): No heartbeat from core client for 30 sec - exiting 05:51:32 (23464): No heartbeat from core client for 30 sec - exiting 05:51:33 (23464): No heartbeat from core client for 30 sec - exiting 05:51:34 (23464): No heartbeat from core client for 30 sec - exiting 05:51:35 (23464): No heartbeat from core client for 30 sec - exiting 05:51:36 (23464): No heartbeat from core client for 30 sec - exiting 05:51:37 (23464): No heartbeat from core client for 30 sec - exiting 05:51:38 (23464): No heartbeat from core client for 30 sec - exiting 05:51:39 (23464): No heartbeat from core client for 30 sec - exiting 05:51:40 (23464): No heartbeat from core client for 30 sec - exiting 05:51:41 (23464): No heartbeat from core client for 30 sec - exiting 05:51:42 (23464): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:17:09 (22680): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:17:10 (22680): No heartbeat from core client for 30 sec - exiting 06:22:35 (23960): No heartbeat from core client for 30 sec - exiting 06:22:36 (23960): No heartbeat from core client for 30 sec - exiting 06:22:37 (23960): No heartbeat from core client for 30 sec - exiting 06:22:38 (23960): No heartbeat from core client for 30 sec - exiting 06:22:39 (23960): No heartbeat from core client for 30 sec - exiting 06:22:40 (23960): No heartbeat from core client for 30 sec - exiting 06:22:41 (23960): No heartbeat from core client for 30 sec - exiting 06:22:42 (23960): No heartbeat from core client for 30 sec - exiting 06:22:43 (23960): No heartbeat from core client for 30 sec - exiting 06:22:44 (23960): No heartbeat from core client for 30 sec - exiting 06:22:45 (23960): No heartbeat from core client for 30 sec - exiting 06:22:46 (23960): No heartbeat from core client for 30 sec - exiting 06:22:47 (23960): No heartbeat from core client for 30 sec - exiting 06:22:48 (23960): No heartbeat from core client for 30 sec - exiting 06:22:49 (23960): No heartbeat from core client for 30 sec - exiting 06:22:50 (23960): No heartbeat from core client for 30 sec - exiting 06:22:51 (23960): No heartbeat from core client for 30 sec - exiting 06:22:52 (23960): No heartbeat from core client for 30 sec - exiting 06:22:53 (23960): No heartbeat from core client for 30 sec - exiting 06:22:54 (23960): No heartbeat from core client for 30 sec - exiting 06:22:55 (23960): No heartbeat from core client for 30 sec - exiting 06:22:56 (23960): No heartbeat from core client for 30 sec - exiting 06:22:57 (23960): No heartbeat from core client for 30 sec - exiting 06:22:58 (23960): No heartbeat from core client for 30 sec - exiting 06:22:59 (23960): No heartbeat from core client for 30 sec - exiting 06:23:00 (23960): No heartbeat from core client for 30 sec - exiting 06:23:01 (23960): No heartbeat from core client for 30 sec - exiting 06:23:02 (23960): No heartbeat from core client for 30 sec - exiting 06:23:03 (23960): No heartbeat from core client for 30 sec - exiting 06:23:04 (23960): No heartbeat from core client for 30 sec - exiting 06:23:05 (23960): No heartbeat from core client for 30 sec - exiting 06:23:06 (23960): No heartbeat from core client for 30 sec - exiting 06:23:07 (23960): No heartbeat from core client for 30 sec - exiting 06:23:08 (23960): No heartbeat from core client for 30 sec - exiting 06:23:09 (23960): No heartbeat from core client for 30 sec - exiting 06:23:10 (23960): No heartbeat from core client for 30 sec - exiting 06:23:11 (23960): No heartbeat from core client for 30 sec - exiting 06:23:12 (23960): No heartbeat from core client for 30 sec - exiting 06:23:13 (23960): No heartbeat from core client for 30 sec - exiting 06:23:14 (23960): No heartbeat from core client for 30 sec - exiting 06:23:15 (23960): No heartbeat from core client for 30 sec - exiting 06:23:16 (23960): No heartbeat from core client for 30 sec - exiting 06:23:17 (23960): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:44:16 (20704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:49:39 (19152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=22644, selfPID=22644, iMonCtr=2 07:12:40 (20428): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:23:08 (26356): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:29:19 (2692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:43:03 (23896): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:48:42 (25208): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:52:29 (25392): No heartbeat from core client for 30 sec - exiting 07:52:30 (25392): No heartbeat from core client for 30 sec - exiting 07:52:32 (25392): No heartbeat from core client for 30 sec - exiting 07:52:33 (25392): No heartbeat from core client for 30 sec - exiting 07:52:34 (25392): No heartbeat from core client for 30 sec - exiting 07:52:35 (25392): No heartbeat from core client for 30 sec - exiting 07:52:36 (25392): No heartbeat from core client for 30 sec - exiting 07:52:37 (25392): No heartbeat from core client for 30 sec - exiting 07:52:38 (25392): No heartbeat from core client for 30 sec - exiting 07:52:39 (25392): No heartbeat from core client for 30 sec - exiting 07:52:40 (25392): No heartbeat from core client for 30 sec - exiting 07:52:41 (25392): No heartbeat from core client for 30 sec - exiting 07:52:42 (25392): No heartbeat from core client for 30 sec - exiting 07:52:43 (25392): No heartbeat from core client for 30 sec - exiting 07:52:44 (25392): No heartbeat from core client for 30 sec - exiting 07:52:45 (25392): No heartbeat from core client for 30 sec - exiting 07:52:46 (25392): No heartbeat from core client for 30 sec - exiting 07:52:47 (25392): No heartbeat from core client for 30 sec - exiting 07:52:48 (25392): No heartbeat from core client for 30 sec - exiting 07:52:49 (25392): No heartbeat from core client for 30 sec - exiting 07:52:50 (25392): No heartbeat from core client for 30 sec - exiting 07:52:51 (25392): No heartbeat from core client for 30 sec - exiting 07:52:52 (25392): No heartbeat from core client for 30 sec - exiting 07:52:53 (25392): No heartbeat from core client for 30 sec - exiting 07:52:54 (25392): No heartbeat from core client for 30 sec - exiting 07:52:55 (25392): No heartbeat from core client for 30 sec - exiting 07:52:56 (25392): No heartbeat from core client for 30 sec - exiting 07:52:57 (25392): No heartbeat from core client for 30 sec - exiting 07:52:58 (25392): No heartbeat from core client for 30 sec - exiting 07:52:59 (25392): No heartbeat from core client for 30 sec - exiting 07:53:00 (25392): No heartbeat from core client for 30 sec - exiting 07:53:01 (25392): No heartbeat from core client for 30 sec - exiting 07:53:02 (25392): No heartbeat from core client for 30 sec - exiting 07:53:04 (25392): No heartbeat from core client for 30 sec - exiting 07:53:05 (25392): No heartbeat from core client for 30 sec - exiting 07:53:06 (25392): No heartbeat from core client for 30 sec - exiting 07:53:07 (25392): No heartbeat from core client for 30 sec - exiting 07:53:08 (25392): No heartbeat from core client for 30 sec - exiting 07:53:09 (25392): No heartbeat from core client for 30 sec - exiting 07:53:10 (25392): No heartbeat from core client for 30 sec - exiting 07:53:11 (25392): No heartbeat from core client for 30 sec - exiting 07:53:12 (25392): No heartbeat from core client for 30 sec - exiting 07:53:13 (25392): No heartbeat from core client for 30 sec - exiting 07:53:14 (25392): No heartbeat from core client for 30 sec - exiting 07:53:15 (25392): No heartbeat from core client for 30 sec - exiting 07:53:16 (25392): No heartbeat from core client for 30 sec - exiting 07:53:17 (25392): No heartbeat from core client for 30 sec - exiting 07:53:18 (25392): No heartbeat from core client for 30 sec - exiting 07:53:19 (25392): No heartbeat from core client for 30 sec - exiting 07:53:20 (25392): No heartbeat from core client for 30 sec - exiting 07:53:21 (25392): No heartbeat from core client for 30 sec - exiting 07:53:22 (25392): No heartbeat from core client for 30 sec - exiting 07:53:23 (25392): No heartbeat from core client for 30 sec - exiting 07:53:24 (25392): No heartbeat from core client for 30 sec - exiting 07:53:25 (25392): No heartbeat from core client for 30 sec - exiting 07:53:26 (25392): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:53:27 (25392): No heartbeat from core client for 30 sec - exiting 07:57:37 (24032): No heartbeat from core client for 30 sec - exiting 07:57:39 (24032): No heartbeat from core client for 30 sec - exiting 07:57:40 (24032): No heartbeat from core client for 30 sec - exiting 07:57:41 (24032): No heartbeat from core client for 30 sec - exiting 07:57:42 (24032): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:09:15 (26600): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:16:31 (19928): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:29:05 (17292): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:29:06 (17292): No heartbeat from core client for 30 sec - exiting 08:38:46 (21076): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=22988, selfPID=22988, iMonCtr=2 08:46:02 (24620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:41:12 (25620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:41:13 (25620): No heartbeat from core client for 30 sec - exiting 10:44:21 (28028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:44:22 (28028): No heartbeat from core client for 30 sec - exiting 12:20:35 (26516): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:20:36 (26516): No heartbeat from core client for 30 sec - exiting 13:52:18 (4444): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:52:19 (4444): No heartbeat from core client for 30 sec - exiting 15:07:16 (25688): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:07:17 (25688): No heartbeat from core client for 30 sec - exiting 15:07:18 (25688): No heartbeat from core client for 30 sec - exiting 15:07:19 (25688): No heartbeat from core client for 30 sec - exiting 15:07:20 (25688): No heartbeat from core client for 30 sec - exiting 15:07:21 (25688): No heartbeat from core client for 30 sec - exiting 15:07:22 (25688): No heartbeat from core client for 30 sec - exiting 15:07:23 (25688): No heartbeat from core client for 30 sec - exiting 15:07:24 (25688): No heartbeat from core client for 30 sec - exiting Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=25896, selfPID=25896, iMonCtr=2 15:07:25 (25688): No heartbeat from core client for 30 sec - exiting 15:07:26 (25688): No heartbeat from core client for 30 sec - exiting 15:07:27 (25688): No heartbeat from core client for 30 sec - exiting 15:07:28 (25688): No heartbeat from core client for 30 sec - exiting 15:07:29 (25688): No heartbeat from core client for 30 sec - exiting 15:07:30 (25688): No heartbeat from core client for 30 sec - exiting 15:07:31 (25688): No heartbeat from core client for 30 sec - exiting 15:07:32 (25688): No heartbeat from core client for 30 sec - exiting 15:07:33 (25688): No heartbeat from core client for 30 sec - exiting 15:07:34 (25688): No heartbeat from core client for 30 sec - exiting 15:07:35 (25688): No heartbeat from core client for 30 sec - exiting 15:07:36 (25688): No heartbeat from core client for 30 sec - exiting 15:07:37 (25688): No heartbeat from core client for 30 sec - exiting 15:07:39 (25688): No heartbeat from core client for 30 sec - exiting 15:07:40 (25688): No heartbeat from core client for 30 sec - exiting 15:07:41 (25688): No heartbeat from core client for 30 sec - exiting 16:38:03 (28364): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:24:24 (28120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:25:00 (29664): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:25:01 (29664): No heartbeat from core client for 30 sec - exiting 20:25:02 (29664): No heartbeat from core client for 30 sec - exiting 20:25:03 (29664): No heartbeat from core client for 30 sec - exiting 20:25:04 (29664): No heartbeat from core client for 30 sec - exiting 20:25:05 (29664): No heartbeat from core client for 30 sec - exiting 20:25:06 (29664): No heartbeat from core client for 30 sec - exiting 20:25:07 (29664): No heartbeat from core client for 30 sec - exiting 20:25:08 (29664): No heartbeat from core client for 30 sec - exiting 20:25:09 (29664): No heartbeat from core client for 30 sec - exiting 20:25:10 (29664): No heartbeat from core client for 30 sec - exiting 20:25:11 (29664): No heartbeat from core client for 30 sec - exiting 20:25:12 (29664): No heartbeat from core client for 30 sec - exiting 20:25:13 (29664): No heartbeat from core client for 30 sec - exiting 20:25:14 (29664): No heartbeat from core client for 30 sec - exiting 20:25:15 (29664): No heartbeat from core client for 30 sec - exiting 20:25:16 (29664): No heartbeat from core client for 30 sec - exiting 20:45:09 (19420): No heartbeat from core client for 30 sec - exiting 20:45:11 (19420): No heartbeat from core client for 30 sec - exiting 20:45:12 (19420): No heartbeat from core client for 30 sec - exiting 20:45:13 (19420): No heartbeat from core client for 30 sec - exiting 20:45:14 (19420): No heartbeat from core client for 30 sec - exiting 20:45:15 (19420): No heartbeat from core client for 30 sec - exiting 20:45:16 (19420): No heartbeat from core client for 30 sec - exiting 20:45:17 (19420): No heartbeat from core client for 30 sec - exiting 20:45:18 (19420): No heartbeat from core client for 30 sec - exiting 20:45:19 (19420): No heartbeat from core client for 30 sec - exiting 20:45:20 (19420): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:53:50 (28980): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:17:53 (30412): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:35:32 (18732): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:35:33 (18732): No heartbeat from core client for 30 sec - exiting 01:11:33 (31152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:11:34 (31152): No heartbeat from core client for 30 sec - exiting 02:25:15 (17608): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:34:32 (30440): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:34:33 (30440): No heartbeat from core client for 30 sec - exiting 02:34:34 (30440): No heartbeat from core client for 30 sec - exiting 02:34:35 (30440): No heartbeat from core client for 30 sec - exiting 02:34:36 (30440): No heartbeat from core client for 30 sec - exiting 04:23:41 (32244): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:41:43 (31928): No heartbeat from core client for 30 sec - exiting 04:41:44 (31928): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:41:45 (31928): No heartbeat from core client for 30 sec - exiting 06:35:13 (29872): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:35:15 (29872): No heartbeat from core client for 30 sec - exiting 06:35:16 (29872): No heartbeat from core client for 30 sec - exiting 06:35:17 (29872): No heartbeat from core client for 30 sec - exiting 06:51:09 (29664): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:53:09 (21580): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:54:09 (32152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:54:10 (32152): No heartbeat from core client for 30 sec - exiting 09:23:52 (34228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:45:50 (36760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:46:47 (36232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:49:09 (35068): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:32:15 (32076): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:02:35 (29932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:17:40 (36340): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:20:44 (37408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:19:20 (20508): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... R19:16:23 (34140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:16:24 (34140): No heartbeat from core client for 30 sec - exiting 20:43:15 (18476): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:11:13 (36936): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:45:39 (38656): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:45:41 (38656): No heartbeat from core client for 30 sec - exiting 01:11:54 (41520): No heartbeat from core client for 30 sec - exiting 01:11:55 (41520): No heartbeat from core client for 30 sec - exiting 01:11:57 (41520): No heartbeat from core client for 30 sec - exiting 01:11:58 (41520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:25:24 (42244): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:14:06 (41860): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:17:31 (41800): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:29:07 (44788): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:37:49 (43924): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:11:34 (46060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:40:18 (42488): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:48:10 (39900): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:27:07 (45220): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:15:45 (47244): No heartbeat from core client for 30 sec - exiting 12:15:46 (47244): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:15:47 (47244): No heartbeat from core client for 30 sec - exiting 13:50:25 (48712): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:57:38 (48060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:00:41 (40444): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:05:14 (45300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=48456, selfPID=48456, iMonCtr=2 15:43:16 (45416): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:06:42 (45184): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:44:38 (47952): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:25:00 (49656): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:27:11 (51608): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:27:12 (51608): No heartbeat from core client for 30 sec - exiting 18:52:57 (51576): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:34:56 (45696): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:42:53 (51468): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:07:50 (50072): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:45:26 (43864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:43:05 (47260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:43:06 (47260): No heartbeat from core client for 30 sec - exiting 01:17:53 (48548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:17:54 (48548): No heartbeat from core client for 30 sec - exiting 03:15:45 (55068): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:15:46 (55068): No heartbeat from core client for 30 sec - exiting 05:43:42 (57320): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:43:43 (57320): No heartbeat from core client for 30 sec - exiting 05:43:44 (57320): No heartbeat from core client for 30 sec - exiting 07:27:03 (52692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:27:05 (52692): No heartbeat from core client for 30 sec - exiting 07:27:06 (52692): No heartbeat from core client for 30 sec - exiting 08:32:06 (52976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:48:22 (6988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... R10:32:00 (50980): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:32:01 (50980): No heartbeat from core client for 30 sec - exiting 10:32:02 (50980): No heartbeat from core client for 30 sec - exiting 11:18:02 (57896): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:22:46 (55284): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:11:02 (55748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:47:38 (61840): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:47:40 (61840): No heartbeat from core client for 30 sec - exiting 16:05:10 (20944): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:05:11 (20944): No heartbeat from core client for 30 sec - exiting 16:50:39 (57548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:48:32 (60124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:48:33 (60124): No heartbeat from core client for 30 sec - exiting 17:48:34 (60124): No heartbeat from core client for 30 sec - exiting 19:46:35 (60988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:46:36 (60988): No heartbeat from core client for 30 sec - exiting 19:58:29 (60168): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:58:30 (60168): No heartbeat from core client for 30 sec - exiting 20:37:39 (61340): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 21:00:59 (5916): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:03:00 (9612): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 23:04:09 (3392): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 12:45:54 (2188): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:57:28 (6984): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:15:47 (6064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:51:43 (9144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/xaakm.pipe_dummy 2048 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4396, selfPID=4396, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4396, selfPID=4224, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_anz_a2jd_2008_1_010098399_0_11.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_a2jd_2008_1_010098399_0_12.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
20 Aug 2015 19:55:41	1303251	18808778	hadam3p_anz_a2jd_2008_1_010098399_0	115,499	288,557	2.4984
20 Aug 2015 09:37:43	1303251	18808778	hadam3p_anz_a2jd_2008_1_010098399_0	103,979	261,464	2.5146
20 Aug 2015 01:26:25	1303251	18808778	hadam3p_anz_a2jd_2008_1_010098399_0	92,459	234,820	2.5397
19 Aug 2015 10:22:24	1303251	18808778	hadam3p_anz_a2jd_2008_1_010098399_0	80,939	204,718	2.5293
18 Aug 2015 16:28:17	1303251	18808778	hadam3p_anz_a2jd_2008_1_010098399_0	69,419	173,697	2.5022
18 Aug 2015 00:14:40	1303251	18808778	hadam3p_anz_a2jd_2008_1_010098399_0	57,899	142,927	2.4686
17 Aug 2015 11:50:31	1303251	18808778	hadam3p_anz_a2jd_2008_1_010098399_0	46,379	113,800	2.4537
16 Aug 2015 19:54:30	1303251	18808778	hadam3p_anz_a2jd_2008_1_010098399_0	34,859	84,404	2.4213
15 Aug 2015 23:14:37	1303251	18808778	hadam3p_anz_a2jd_2008_1_010098399_0	23,339	55,197	2.3650
15 Aug 2015 12:47:10	1303251	18808778	hadam3p_anz_a2jd_2008_1_010098399_0	11,819	27,293	2.3092