Task 17602815

Name	hadam3p_anz_d6qp_2012_1_009316449_0
Workunit	9400637
Created	17 Dec 2014, 21:07:59 UTC
Sent	18 Dec 2014, 0:17:50 UTC
Report deadline	30 Nov 2015, 5:37:50 UTC
Received	26 Dec 2014, 22:09:02 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1349386
Run time	2 days 8 hours 15 min 6 sec
CPU time	1 days 22 hours 55 min 53 sec
Validate state	Invalid
Credit	1,006.54
Device peak FLOPS	2.69 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.4.27</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... 06:39:48 (162212): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:39:49 (162212): No heartbeat from core client for 30 sec - exiting 06:39:50 (162212): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=165908, selfPID=165908, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 02:48:44 (174128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:48:45 (174128): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 05:43:21 (180828): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:43:22 (180828): No heartbeat from core client for 30 sec - exiting 05:43:23 (180828): No heartbeat from core client for 30 sec - exiting 05:56:24 (177324): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:11:00 (182616): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:56:35 (186544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:56:36 (186544): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 10:35:55 (187416): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=186760, selfPID=186760, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 04:12:14 (196184): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process iCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=203184, selfPID=203184, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 16:20:58 (176008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 18:15:54 (205768): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:15:55 (205768): No heartbeat from core client for 30 sec - exiting 19:10:32 (159316): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:09:29 (222972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:09:46 (222972): No heartbeat from core client for 30 sec - exiting 09:09:49 (222972): No heartbeat from core client for 30 sec - exiting 09:09:50 (222972): No heartbeat from core client for 30 sec - exiting 09:09:51 (222972): No heartbeat from core client for 30 sec - exiting 09:09:52 (222972): No heartbeat from core client for 30 sec - exiting 09:09:53 (222972): No heartbeat from core client for 30 sec - exiting 09:09:54 (222972): No heartbeat from core client for 30 sec - exiting 09:09:55 (222972): No heartbeat from core client for 30 sec - exiting 09:09:57 (222972): No heartbeat from core client for 30 sec - exiting 09:09:58 (222972): No heartbeat from core client for 30 sec - exiting 09:10:00 (222972): No heartbeat from core client for 30 sec - exiting 09:10:01 (222972): No heartbeat from core client for 30 sec - exiting 09:10:02 (222972): No heartbeat from core client for 30 sec - exiting 09:10:03 (222972): No heartbeat from core client for 30 sec - exiting 09:10:04 (222972): No heartbeat from core client for 30 sec - exiting 09:10:05 (222972): No heartbeat from core client for 30 sec - exiting 09:10:07 (222972): No heartbeat from core client for 30 sec - exiting 09:10:08 (222972): No heartbeat from core client for 30 sec - exiting 09:10:09 (222972): No heartbeat from core client for 30 sec - exiting 09:10:10 (222972): No heartbeat from core client for 30 sec - exiting 09:10:12 (222972): No heartbeat from core client for 30 sec - exiting 09:10:13 (222972): No heartbeat from core client for 30 sec - exiting 09:10:14 (222972): No heartbeat from core client for 30 sec - exiting 09:10:15 (222972): No heartbeat from core client for 30 sec - exiting 09:10:16 (222972): No heartbeat from core client for 30 sec - exiting 09:10:18 (222972): No heartbeat from core client for 30 sec - exiting 09:10:19 (222972): No heartbeat from core client for 30 sec - exiting 09:10:20 (222972): No heartbeat from core client for 30 sec - exiting 09:10:21 (222972): No heartbeat from core client for 30 sec - exiting 09:10:22 (222972): No heartbeat from core client for 30 sec - exiting 09:10:23 (222972): No heartbeat from core client for 30 sec - exiting 09:10:24 (222972): No heartbeat from core client for 30 sec - exiting 09:10:26 (222972): No heartbeat from core client for 30 sec - exiting 09:10:27 (222972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:50:00 (221628): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:50:01 (221628): No heartbeat from core client for 30 sec - exiting 10:50:02 (221628): No heartbeat from core client for 30 sec - exiting 10:50:03 (221628): No heartbeat from core client for 30 sec - exiting 10:50:05 (221628): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=226088, selfPID=226088, iMonCtr=2 11:20:16 (223468): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:48:11 (223688): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:55:51 (225036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:13:08 (211960): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:13:09 (211960): No heartbeat from core client for 30 sec - exiting 20:13:10 (211960): No heartbeat from core client for 30 sec - exiting 20:13:11 (211960): No heartbeat from core client for 30 sec - exiting 20:13:12 (211960): No heartbeat from core client for 30 sec - exiting 20:13:14 (211960): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 20:17:12 (229176): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:17:13 (229176): No heartbeat from core client for 30 sec - exiting 20:17:14 (229176): No heartbeat from core client for 30 sec - exiting 20:17:15 (229176): No heartbeat from core client for 30 sec - exiting 20:17:16 (229176): No heartbeat from core client for 30 sec - exiting 20:17:17 (229176): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 21:08:29 (212968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9480, selfPID=9480, iMonCtr=2 23:54:49 (13228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:45:26 (231852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:01:08 (237832): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:56:09 (239972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:08:23 (241692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:20:37 (240964): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:20:38 (240964): No heartbeat from core client for 30 sec - exiting 08:20:39 (240964): No heartbeat from core client for 30 sec - exiting 08:20:41 (240964): No heartbeat from core client for 30 sec - exiting 08:20:42 (240964): No heartbeat from core client for 30 sec - exiting 08:20:43 (240964): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=236884, selfPID=236884, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 05:52:07 (247940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 11 received, exiting... Called boinc_finish Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=264128, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=228700, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_anz_d6qp_2012_1_009316449_0_3.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_d6qp_2012_1_009316449_0_4.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_d6qp_2012_1_009316449_0_5.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_d6qp_2012_1_009316449_0_6.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_d6qp_2012_1_009316449_0_7.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_d6qp_2012_1_009316449_0_8.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_d6qp_2012_1_009316449_0_9.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_d6qp_2012_1_009316449_0_10.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_d6qp_2012_1_009316449_0_11.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_d6qp_2012_1_009316449_0_12.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
26 Dec 2014 05:37:27	1349386	17602815	hadam3p_anz_d6qp_2012_1_009316449_0	23,339	149,887	6.4222
23 Dec 2014 19:15:35	1349386	17602815	hadam3p_anz_d6qp_2012_1_009316449_0	11,819	76,062	6.4356