Task 18506722

Name	hadam3p_anz_n40a_2007_1_009861782_0
Workunit	9900279
Created	29 May 2015, 16:38:39 UTC
Sent	3 Jun 2015, 10:24:27 UTC
Report deadline	15 May 2016, 15:44:27 UTC
Received	7 Jun 2015, 14:00:02 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1305914
Run time	3 days 12 hours 28 min 7 sec
CPU time	3 days 10 hours 21 min 55 sec
Validate state	Invalid
Credit	4,484.28
Device peak FLOPS	4.01 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.4.42</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:40:02 (4240): No heartbeat from core client for 30 sec - exiting 10:40:03 (4240): No heartbeat from core client for 30 sec - exiting 10:40:04 (4240): No heartbeat from core client for 30 sec - exiting 10:40:05 (4240): No heartbeat from core client for 30 sec - exiting 10:40:06 (4240): No heartbeat from core client for 30 sec - exiting 10:40:07 (4240): No heartbeat from core client for 30 sec - exiting 10:40:08 (4240): No heartbeat from core client for 30 sec - exiting 10:40:09 (4240): No heartbeat from core client for 30 sec - exiting 10:40:10 (4240): No heartbeat from core client for 30 sec - exiting 10:40:11 (4240): No heartbeat from core client for 30 sec - exiting 10:40:12 (4240): No heartbeat from core client for 30 sec - exiting 10:40:13 (4240): No heartbeat from core client for 30 sec - exiting 10:40:14 (4240): No heartbeat from core client for 30 sec - exiting 10:40:15 (4240): No heartbeat from core client for 30 sec - exiting 10:40:16 (4240): No heartbeat from core client for 30 sec - exiting 10:40:17 (4240): No heartbeat from core client for 30 sec - exiting 10:40:18 (4240): No heartbeat from core client for 30 sec - exiting 10:40:19 (4240): No heartbeat from core client for 30 sec - exiting 10:40:20 (4240): No heartbeat from core client for 30 sec - exiting 10:40:21 (4240): No heartbeat from core client for 30 sec - exiting 10:40:22 (4240): No heartbeat from core client for 30 sec - exiting 10:40:23 (4240): No heartbeat from core client for 30 sec - exiting 10:40:24 (4240): No heartbeat from core client for 30 sec - exiting 10:40:25 (4240): No heartbeat from core client for 30 sec - exiting 10:40:26 (4240): No heartbeat from core client for 30 sec - exiting 10:40:27 (4240): No heartbeat from core client for 30 sec - exiting 10:40:28 (4240): No heartbeat from core client for 30 sec - exiting 10:40:29 (4240): No heartbeat from core client for 30 sec - exiting 10:40:30 (4240): No heartbeat from core client for 30 sec - exiting 10:40:31 (4240): No heartbeat from core client for 30 sec - exiting 10:40:32 (4240): No heartbeat from core client for 30 sec - exiting 10:40:33 (4240): No heartbeat from core client for 30 sec - exiting 10:40:34 (4240): No heartbeat from core client for 30 sec - exiting 10:40:35 (4240): No heartbeat from core client for 30 sec - exiting 10:40:36 (4240): No heartbeat from core client for 30 sec - exiting 10:40:37 (4240): No heartbeat from core client for 30 sec - exiting 10:40:38 (4240): No heartbeat from core client for 30 sec - exiting 10:40:39 (4240): No heartbeat from core client for 30 sec - exiting 10:40:40 (4240): No heartbeat from core client for 30 sec - exiting 10:40:41 (4240): No heartbeat from core client for 30 sec - exiting 10:40:42 (4240): No heartbeat from core client for 30 sec - exiting 10:40:43 (4240): No heartbeat from core client for 30 sec - exiting 10:40:44 (4240): No heartbeat from core client for 30 sec - exiting 10:40:45 (4240): No heartbeat from core client for 30 sec - exiting 10:40:46 (4240): No heartbeat from core client for 30 sec - exiting 10:40:47 (4240): No heartbeat from core client for 30 sec - exiting 10:40:48 (4240): No heartbeat from core client for 30 sec - exiting 10:40:49 (4240): No heartbeat from core client for 30 sec - exiting 10:40:50 (4240): No heartbeat from core client for 30 sec - exiting 10:40:51 (4240): No heartbeat from core client for 30 sec - exiting 10:40:52 (4240): No heartbeat from core client for 30 sec - exiting 10:40:53 (4240): No heartbeat from core client for 30 sec - exiting 10:40:54 (4240): No heartbeat from core client for 30 sec - exiting 10:40:55 (4240): No heartbeat from core client for 30 sec - exiting 10:40:56 (4240): No heartbeat from core client for 30 sec - exiting 10:40:57 (4240): No heartbeat from core client for 30 sec - exiting 10:40:58 (4240): No heartbeat from core client for 30 sec - exiting 10:40:59 (4240): No heartbeat from core client for 30 sec - exiting 10:41:00 (4240): No heartbeat from core client for 30 sec - exiting 10:41:01 (4240): No heartbeat from core client for 30 sec - exiting 10:41:02 (4240): No heartbeat from core client for 30 sec - exiting 10:41:03 (4240): No heartbeat from core client for 30 sec - exiting 10:41:04 (4240): No heartbeat from core client for 30 sec - exiting 10:41:05 (4240): No heartbeat from core client for 30 sec - exiting 10:41:06 (4240): No heartbeat from core client for 30 sec - exiting 10:41:07 (4240): No heartbeat from core client for 30 sec - exiting 10:41:08 (4240): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:44:37 (2088): No heartbeat from core client for 30 sec - exiting 12:44:39 (2088): No heartbeat from core client for 30 sec - exiting 12:44:40 (2088): No heartbeat from core client for 30 sec - exiting 12:44:41 (2088): No heartbeat from core client for 30 sec - exiting 12:44:42 (2088): No heartbeat from core client for 30 sec - exiting 12:44:43 (2088): No heartbeat from core client for 30 sec - exiting 12:44:44 (2088): No heartbeat from core client for 30 sec - exiting 12:44:45 (2088): No heartbeat from core client for 30 sec - exiting 12:44:46 (2088): No heartbeat from core client for 30 sec - exiting 12:44:47 (2088): No heartbeat from core client for 30 sec - exiting 12:44:48 (2088): No heartbeat from core client for 30 sec - exiting 12:44:49 (2088): No heartbeat from core client for 30 sec - exiting 12:44:50 (2088): No heartbeat from core client for 30 sec - exiting 12:44:51 (2088): No heartbeat from core client for 30 sec - exiting 12:44:52 (2088): No heartbeat from core client for 30 sec - exiting 12:44:53 (2088): No heartbeat from core client for 30 sec - exiting 12:44:54 (2088): No heartbeat from core client for 30 sec - exiting 12:44:55 (2088): No heartbeat from core client for 30 sec - exiting 12:44:56 (2088): No heartbeat from core client for 30 sec - exiting 12:44:57 (2088): No heartbeat from core client for 30 sec - exiting 12:44:58 (2088): No heartbeat from core client for 30 sec - exiting 12:44:59 (2088): No heartbeat from core client for 30 sec - exiting 12:45:00 (2088): No heartbeat from core client for 30 sec - exiting 12:45:01 (2088): No heartbeat from core client for 30 sec - exiting 12:45:02 (2088): No heartbeat from core client for 30 sec - exiting 12:45:03 (2088): No heartbeat from core client for 30 sec - exiting 12:45:04 (2088): No heartbeat from core client for 30 sec - exiting 12:45:05 (2088): No heartbeat from core client for 30 sec - exiting 12:45:06 (2088): No heartbeat from core client for 30 sec - exiting 12:45:07 (2088): No heartbeat from core client for 30 sec - exiting 12:45:08 (2088): No heartbeat from core client for 30 sec - exiting 12:45:09 (2088): No heartbeat from core client for 30 sec - exiting 12:45:10 (2088): No heartbeat from core client for 30 sec - exiting 12:45:11 (2088): No heartbeat from core client for 30 sec - exiting 12:45:12 (2088): No heartbeat from core client for 30 sec - exiting 12:45:13 (2088): No heartbeat from core client for 30 sec - exiting 12:45:14 (2088): No heartbeat from core client for 30 sec - exiting 12:45:15 (2088): No heartbeat from core client for 30 sec - exiting 12:45:16 (2088): No heartbeat from core client for 30 sec - exiting 12:45:17 (2088): No heartbeat from core client for 30 sec - exiting 12:45:18 (2088): No heartbeat from core client for 30 sec - exiting 12:45:19 (2088): No heartbeat from core client for 30 sec - exiting 12:45:20 (2088): No heartbeat from core client for 30 sec - exiting 12:45:21 (2088): No heartbeat from core client for 30 sec - exiting 12:45:22 (2088): No heartbeat from core client for 30 sec - exiting 12:45:23 (2088): No heartbeat from core client for 30 sec - exiting 12:45:24 (2088): No heartbeat from core client for 30 sec - exiting 12:45:25 (2088): No heartbeat from core client for 30 sec - exiting 12:45:26 (2088): No heartbeat from core client for 30 sec - exiting 12:45:27 (2088): No heartbeat from core client for 30 sec - exiting 12:45:28 (2088): No heartbeat from core client for 30 sec - exiting 12:45:29 (2088): No heartbeat from core client for 30 sec - exiting 12:45:30 (2088): No heartbeat from core client for 30 sec - exiting 12:45:31 (2088): No heartbeat from core client for 30 sec - exiting 12:45:32 (2088): No heartbeat from core client for 30 sec - exiting 12:45:33 (2088): No heartbeat from core client for 30 sec - exiting 12:45:34 (2088): No heartbeat from core client for 30 sec - exiting 12:45:35 (2088): No heartbeat from core client for 30 sec - exiting 12:45:36 (2088): No heartbeat from core client for 30 sec - exiting 12:45:37 (2088): No heartbeat from core client for 30 sec - exiting 12:45:38 (2088): No heartbeat from core client for 30 sec - exiting 12:45:39 (2088): No heartbeat from core client for 30 sec - exiting 12:45:40 (2088): No heartbeat from core client for 30 sec - exiting 12:45:41 (2088): No heartbeat from core client for 30 sec - exiting 12:45:42 (2088): No heartbeat from core client for 30 sec - exiting 12:45:43 (2088): No heartbeat from core client for 30 sec - exiting 12:45:44 (2088): No heartbeat from core client for 30 sec - exiting 12:45:45 (2088): No heartbeat from core client for 30 sec - exiting 12:45:46 (2088): No heartbeat from core client for 30 sec - exiting 12:45:47 (2088): No heartbeat from core client for 30 sec - exiting 12:45:48 (2088): No heartbeat from core client for 30 sec - exiting 12:45:49 (2088): No heartbeat from core client for 30 sec - exiting 12:45:50 (2088): No heartbeat from core client for 30 sec - exiting 12:45:51 (2088): No heartbeat from core client for 30 sec - exiting 12:45:52 (2088): No heartbeat from core client for 30 sec - exiting 12:45:53 (2088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:39:25 (7412): No heartbeat from core client for 30 sec - exiting 15:39:27 (7412): No heartbeat from core client for 30 sec - exiting 15:39:28 (7412): No heartbeat from core client for 30 sec - exiting 15:39:29 (7412): No heartbeat from core client for 30 sec - exiting 15:39:30 (7412): No heartbeat from core client for 30 sec - exiting 15:39:31 (7412): No heartbeat from core client for 30 sec - exiting 15:39:32 (7412): No heartbeat from core client for 30 sec - exiting 15:39:33 (7412): No heartbeat from core client for 30 sec - exiting 15:39:34 (7412): No heartbeat from core client for 30 sec - exiting 15:39:35 (7412): No heartbeat from core client for 30 sec - exiting 15:39:36 (7412): No heartbeat from core client for 30 sec - exiting 15:39:37 (7412): No heartbeat from core client for 30 sec - exiting 15:39:38 (7412): No heartbeat from core client for 30 sec - exiting 15:39:39 (7412): No heartbeat from core client for 30 sec - exiting 15:39:40 (7412): No heartbeat from core client for 30 sec - exiting 15:39:41 (7412): No heartbeat from core client for 30 sec - exiting 15:39:42 (7412): No heartbeat from core client for 30 sec - exiting 15:39:43 (7412): No heartbeat from core client for 30 sec - exiting 15:39:44 (7412): No heartbeat from core client for 30 sec - exiting 15:39:45 (7412): No heartbeat from core client for 30 sec - exiting 15:39:46 (7412): No heartbeat from core client for 30 sec - exiting 15:39:47 (7412): No heartbeat from core client for 30 sec - exiting 15:39:48 (7412): No heartbeat from core client for 30 sec - exiting 15:39:49 (7412): No heartbeat from core client for 30 sec - exiting 15:39:50 (7412): No heartbeat from core client for 30 sec - exiting 15:39:51 (7412): No heartbeat from core client for 30 sec - exiting 15:39:52 (7412): No heartbeat from core client for 30 sec - exiting 15:39:53 (7412): No heartbeat from core client for 30 sec - exiting 15:39:54 (7412): No heartbeat from core client for 30 sec - exiting 15:39:55 (7412): No heartbeat from core client for 30 sec - exiting 15:39:56 (7412): No heartbeat from core client for 30 sec - exiting 15:39:57 (7412): No heartbeat from core client for 30 sec - exiting 15:39:58 (7412): No heartbeat from core client for 30 sec - exiting 15:39:59 (7412): No heartbeat from core client for 30 sec - exiting 15:40:00 (7412): No heartbeat from core client for 30 sec - exiting 15:40:01 (7412): No heartbeat from core client for 30 sec - exiting 15:40:02 (7412): No heartbeat from core client for 30 sec - exiting 15:40:03 (7412): No heartbeat from core client for 30 sec - exiting 15:40:04 (7412): No heartbeat from core client for 30 sec - exiting 15:40:05 (7412): No heartbeat from core client for 30 sec - exiting 15:40:06 (7412): No heartbeat from core client for 30 sec - exiting 15:40:07 (7412): No heartbeat from core client for 30 sec - exiting 15:40:08 (7412): No heartbeat from core client for 30 sec - exiting 15:40:09 (7412): No heartbeat from core client for 30 sec - exiting 15:40:10 (7412): No heartbeat from core client for 30 sec - exiting 15:40:11 (7412): No heartbeat from core client for 30 sec - exiting 15:40:12 (7412): No heartbeat from core client for 30 sec - exiting 15:40:13 (7412): No heartbeat from core client for 30 sec - exiting 15:40:14 (7412): No heartbeat from core client for 30 sec - exiting 15:40:15 (7412): No heartbeat from core client for 30 sec - exiting 15:40:16 (7412): No heartbeat from core client for 30 sec - exiting 15:40:17 (7412): No heartbeat from core client for 30 sec - exiting 15:40:18 (7412): No heartbeat from core client for 30 sec - exiting 15:40:19 (7412): No heartbeat from core client for 30 sec - exiting 15:40:20 (7412): No heartbeat from core client for 30 sec - exiting 15:40:21 (7412): No heartbeat from core client for 30 sec - exiting 15:40:22 (7412): No heartbeat from core client for 30 sec - exiting 15:40:23 (7412): No heartbeat from core client for 30 sec - exiting 15:40:24 (7412): No heartbeat from core client for 30 sec - exiting 15:40:25 (7412): No heartbeat from core client for 30 sec - exiting 15:40:26 (7412): No heartbeat from core client for 30 sec - exiting 15:40:27 (7412): No heartbeat from core client for 30 sec - exiting 15:40:28 (7412): No heartbeat from core client for 30 sec - exiting 15:40:29 (7412): No heartbeat from core client for 30 sec - exiting 15:40:30 (7412): No heartbeat from core client for 30 sec - exiting 15:40:31 (7412): No heartbeat from core client for 30 sec - exiting 15:40:32 (7412): No heartbeat from core client for 30 sec - exiting 15:40:33 (7412): No heartbeat from core client for 30 sec - exiting 15:40:34 (7412): No heartbeat from core client for 30 sec - exiting 15:40:35 (7412): No heartbeat from core client for 30 sec - exiting 15:40:36 (7412): No heartbeat from core client for 30 sec - exiting 15:40:37 (7412): No heartbeat from core client for 30 sec - exiting 15:40:38 (7412): No heartbeat from core client for 30 sec - exiting 15:40:39 (7412): No heartbeat from core client for 30 sec - exiting 15:40:40 (7412): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:17:32 (1984): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:24:06 (4800): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:30:21 (3688): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6544, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8388, selfPID=4568, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_anz_n40a_2007_1_009861782_0_10.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_n40a_2007_1_009861782_0_11.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_n40a_2007_1_009861782_0_12.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
07 Jun 2015 04:21:01	1305914	18506722	hadam3p_anz_n40a_2007_1_009861782_0	103,979	269,295	2.5899
06 Jun 2015 15:59:48	1305914	18506722	hadam3p_anz_n40a_2007_1_009861782_0	92,459	237,761	2.5715
06 Jun 2015 05:33:29	1305914	18506722	hadam3p_anz_n40a_2007_1_009861782_0	80,939	207,855	2.5680
05 Jun 2015 21:09:26	1305914	18506722	hadam3p_anz_n40a_2007_1_009861782_0	69,419	178,183	2.5668
05 Jun 2015 09:26:29	1305914	18506722	hadam3p_anz_n40a_2007_1_009861782_0	57,899	148,566	2.5660
05 Jun 2015 00:29:56	1305914	18506722	hadam3p_anz_n40a_2007_1_009861782_0	46,379	118,837	2.5623
04 Jun 2015 15:51:31	1305914	18506722	hadam3p_anz_n40a_2007_1_009861782_0	34,859	89,277	2.5611
04 Jun 2015 06:16:31	1305914	18506722	hadam3p_anz_n40a_2007_1_009861782_0	23,339	59,734	2.5594
03 Jun 2015 20:25:25	1305914	18506722	hadam3p_anz_n40a_2007_1_009861782_0	11,819	29,960	2.5349