Task 17580350

Name	hadam3p_anz_e2u8_2012_1_009294181_0
Workunit	9378369
Created	17 Dec 2014, 18:10:44 UTC
Sent	10 Jan 2015, 22:28:29 UTC
Report deadline	24 Dec 2015, 3:48:29 UTC
Received	31 Jan 2015, 8:05:41 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1351088
Run time	2 days 11 hours 27 min 49 sec
CPU time	1 days 22 hours 43 min 50 sec
Validate state	Invalid
Credit	2,993.82
Device peak FLOPS	0.93 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.4.27</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 15:41:36 (5976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 07:00:32 (2152): No heartbeat from core client for 30 sec - exiting 07:00:33 (2152): No heartbeat from core client for 30 sec - exiting 07:00:34 (2152): No heartbeat from core client for 30 sec - exiting 07:00:35 (2152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 12:56:22 (1152): No heartbeat from core client for 30 sec - exiting 12:56:24 (1152): No heartbeat from core client for 30 sec - exiting 12:56:25 (1152): No heartbeat from core client for 30 sec - exiting 12:56:26 (1152): No heartbeat from core client for 30 sec - exiting 12:56:27 (1152): No heartbeat from core client for 30 sec - exiting 12:56:28 (1152): No heartbeat from core client for 30 sec - exiting 12:56:29 (1152): No heartbeat from core client for 30 sec - exiting 12:56:30 (1152): No heartbeat from core client for 30 sec - exiting 12:56:31 (1152): No heartbeat from core client for 30 sec - exiting 12:56:32 (1152): No heartbeat from core client for 30 sec - exiting 12:56:33 (1152): No heartbeat from core client for 30 sec - exiting 12:56:34 (1152): No heartbeat from core client for 30 sec - exiting 12:56:35 (1152): No heartbeat from core client for 30 sec - exiting 12:56:36 (1152): No heartbeat from core client for 30 sec - exiting 12:56:37 (1152): No heartbeat from core client for 30 sec - exiting 12:56:38 (1152): No heartbeat from core client for 30 sec - exiting 12:56:39 (1152): No heartbeat from core client for 30 sec - exiting 12:56:40 (1152): No heartbeat from core client for 30 sec - exiting 12:56:41 (1152): No heartbeat from core client for 30 sec - exiting 12:56:42 (1152): No heartbeat from core client for 30 sec - exiting 12:56:43 (1152): No heartbeat from core client for 30 sec - exiting 12:56:44 (1152): No heartbeat from core client for 30 sec - exiting 12:56:45 (1152): No heartbeat from core client for 30 sec - exiting 12:56:46 (1152): No heartbeat from core client for 30 sec - exiting 12:56:47 (1152): No heartbeat from core client for 30 sec - exiting 12:56:48 (1152): No heartbeat from core client for 30 sec - exiting 12:56:49 (1152): No heartbeat from core client for 30 sec - exiting 12:56:50 (1152): No heartbeat from core client for 30 sec - exiting 12:56:51 (1152): No heartbeat from core client for 30 sec - exiting 12:56:52 (1152): No heartbeat from core client for 30 sec - exiting 12:56:53 (1152): No heartbeat from core client for 30 sec - exiting 12:56:54 (1152): No heartbeat from core client for 30 sec - exiting 12:56:55 (1152): No heartbeat from core client for 30 sec - exiting 12:56:56 (1152): No heartbeat from core client for 30 sec - exiting 12:56:57 (1152): No heartbeat from core client for 30 sec - exiting 12:56:58 (1152): No heartbeat from core client for 30 sec - exiting 12:56:59 (1152): No heartbeat from core client for 30 sec - exiting 12:57:00 (1152): No heartbeat from core client for 30 sec - exiting 12:57:01 (1152): No heartbeat from core client for 30 sec - exiting 12:57:02 (1152): No heartbeat from core client for 30 sec - exiting 12:57:03 (1152): No heartbeat from core client for 30 sec - exiting 12:57:04 (1152): No heartbeat from core client for 30 sec - exiting 12:57:05 (1152): No heartbeat from core client for 30 sec - exiting 12:57:06 (1152): No heartbeat from core client for 30 sec - exiting 12:57:07 (1152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:07:02 (1624): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 09:55:31 (5488): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 16:32:51 (4712): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 15:22:55 (4588): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 18:58:07 (4396): No heartbeat from core client for 30 sec - exiting 18:58:08 (4396): No heartbeat from core client for 30 sec - exiting 18:58:09 (4396): No heartbeat from core client for 30 sec - exiting 18:58:10 (4396): No heartbeat from core client for 30 sec - exiting 18:58:11 (4396): No heartbeat from core client for 30 sec - exiting 18:58:12 (4396): No heartbeat from core client for 30 sec - exiting 18:58:13 (4396): No heartbeat from core client for 30 sec - exiting 18:58:15 (4396): No heartbeat from core client for 30 sec - exiting 18:58:16 (4396): No heartbeat from core client for 30 sec - exiting 18:58:17 (4396): No heartbeat from core client for 30 sec - exiting 18:58:18 (4396): No heartbeat from core client for 30 sec - exiting 18:58:19 (4396): No heartbeat from core client for 30 sec - exiting 18:58:20 (4396): No heartbeat from core client for 30 sec - exiting 18:58:21 (4396): No heartbeat from core client for 30 sec - exiting 18:58:22 (4396): No heartbeat from core client for 30 sec - exiting 18:58:23 (4396): No heartbeat from core client for 30 sec - exiting 18:58:24 (4396): No heartbeat from core client for 30 sec - exiting 18:58:26 (4396): No heartbeat from core client for 30 sec - exiting 18:58:27 (4396): No heartbeat from core client for 30 sec - exiting 18:58:28 (4396): No heartbeat from core client for 30 sec - exiting 18:58:29 (4396): No heartbeat from core client for 30 sec - exiting 18:58:30 (4396): No heartbeat from core client for 30 sec - exiting 18:58:31 (4396): No heartbeat from core client for 30 sec - exiting 18:58:32 (4396): No heartbeat from core client for 30 sec - exiting 18:58:33 (4396): No heartbeat from core client for 30 sec - exiting 18:58:34 (4396): No heartbeat from core client for 30 sec - exiting 18:58:35 (4396): No heartbeat from core client for 30 sec - exiting 18:58:36 (4396): No heartbeat from core client for 30 sec - exiting 18:58:38 (4396): No heartbeat from core client for 30 sec - exiting 18:58:39 (4396): No heartbeat from core client for 30 sec - exiting 18:58:40 (4396): No heartbeat from core client for 30 sec - exiting 18:58:41 (4396): No heartbeat from core client for 30 sec - exiting 18:58:42 (4396): No heartbeat from core client for 30 sec - exiting 18:58:43 (4396): No heartbeat from core client for 30 sec - exiting 18:58:44 (4396): No heartbeat from core client for 30 sec - exiting 18:58:45 (4396): No heartbeat from core client for 30 sec - exiting 18:58:46 (4396): No heartbeat from core client for 30 sec - exiting 18:58:47 (4396): No heartbeat from core client for 30 sec - exiting 18:58:50 (4396): No heartbeat from core client for 30 sec - exiting 18:58:51 (4396): No heartbeat from core client for 30 sec - exiting 18:58:52 (4396): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:46:45 (5368): No heartbeat from core client for 30 sec - exiting 19:46:46 (5368): No heartbeat from core client for 30 sec - exiting 19:46:47 (5368): No heartbeat from core client for 30 sec - exiting 19:46:48 (5368): No heartbeat from core client for 30 sec - exiting 19:46:49 (5368): No heartbeat from core client for 30 sec - exiting 19:46:50 (5368): No heartbeat from core client for 30 sec - exiting 19:46:51 (5368): No heartbeat from core client for 30 sec - exiting 19:46:52 (5368): No heartbeat from core client for 30 sec - exiting 19:46:53 (5368): No heartbeat from core client for 30 sec - exiting 19:46:54 (5368): No heartbeat from core client for 30 sec - exiting 19:46:55 (5368): No heartbeat from core client for 30 sec - exiting 19:46:56 (5368): No heartbeat from core client for 30 sec - exiting 19:46:57 (5368): No heartbeat from core client for 30 sec - exiting 19:46:58 (5368): No heartbeat from core client for 30 sec - exiting 19:46:59 (5368): No heartbeat from core client for 30 sec - exiting 19:47:00 (5368): No heartbeat from core client for 30 sec - exiting 19:47:01 (5368): No heartbeat from core client for 30 sec - exiting 19:47:02 (5368): No heartbeat from core client for 30 sec - exiting 19:47:03 (5368): No heartbeat from core client for 30 sec - exiting 19:47:04 (5368): No heartbeat from core client for 30 sec - exiting 19:47:05 (5368): No heartbeat from core client for 30 sec - exiting 19:47:06 (5368): No heartbeat from core client for 30 sec - exiting 19:47:07 (5368): No heartbeat from core client for 30 sec - exiting 19:47:08 (5368): No heartbeat from core client for 30 sec - exiting 19:47:09 (5368): No heartbeat from core client for 30 sec - exiting 19:47:10 (5368): No heartbeat from core client for 30 sec - exiting 19:47:11 (5368): No heartbeat from core client for 30 sec - exiting 19:47:12 (5368): No heartbeat from core client for 30 sec - exiting 19:47:13 (5368): No heartbeat from core client for 30 sec - exiting 19:47:14 (5368): No heartbeat from core client for 30 sec - exiting 19:47:15 (5368): No heartbeat from core client for 30 sec - exiting 19:47:16 (5368): No heartbeat from core client for 30 sec - exiting 19:47:17 (5368): No heartbeat from core client for 30 sec - exiting 19:47:18 (5368): No heartbeat from core client for 30 sec - exiting 19:47:19 (5368): No heartbeat from core client for 30 sec - exiting 19:47:20 (5368): No heartbeat from core client for 30 sec - exiting 19:47:21 (5368): No heartbeat from core client for 30 sec - exiting 19:47:22 (5368): No heartbeat from core client for 30 sec - exiting 19:47:23 (5368): No heartbeat from core client for 30 sec - exiting 19:47:24 (5368): No heartbeat from core client for 30 sec - exiting 19:47:25 (5368): No heartbeat from core client for 30 sec - exiting 19:47:26 (5368): No heartbeat from core client for 30 sec - exiting 19:47:27 (5368): No heartbeat from core client for 30 sec - exiting 19:47:28 (5368): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=3160, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=0, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=13648, selfPID=42816, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_anz_e2u8_2012_1_009294181_0_7.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_e2u8_2012_1_009294181_0_8.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_e2u8_2012_1_009294181_0_9.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_e2u8_2012_1_009294181_0_10.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_e2u8_2012_1_009294181_0_11.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_e2u8_2012_1_009294181_0_12.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
28 Jan 2015 03:09:29	1351088	17580350	hadam3p_anz_e2u8_2012_1_009294181_0	69,419	165,262	2.3806
26 Jan 2015 19:05:06	1351088	17580350	hadam3p_anz_e2u8_2012_1_009294181_0	57,899	138,062	2.3845
25 Jan 2015 00:18:40	1351088	17580350	hadam3p_anz_e2u8_2012_1_009294181_0	46,379	111,794	2.4104
20 Jan 2015 02:02:55	1351088	17580350	hadam3p_anz_e2u8_2012_1_009294181_0	34,859	84,888	2.4352
16 Jan 2015 03:26:15	1351088	17580350	hadam3p_anz_e2u8_2012_1_009294181_0	23,339	57,177	2.4498
13 Jan 2015 05:24:53	1351088	17580350	hadam3p_anz_e2u8_2012_1_009294181_0	11,819	30,308	2.5643