Task 16948795

Name	hadam3p_anz_rn6t_2012_1_008956632_0
Workunit	9100807
Created	27 Aug 2014, 12:09:23 UTC
Sent	1 Sep 2014, 7:47:50 UTC
Report deadline	14 Aug 2015, 13:07:50 UTC
Received	5 Sep 2014, 18:25:29 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1317793
Run time	19 hours 47 min 27 sec
CPU time	17 hours 35 min 46 sec
Validate state	Invalid
Credit	509.72
Device peak FLOPS	3.31 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.2.42</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:50:15 (16488): No heartbeat from core client for 30 sec - exiting 09:50:16 (16488): No heartbeat from core client for 30 sec - exiting 09:50:17 (16488): No heartbeat from core client for 30 sec - exiting 09:50:18 (16488): No heartbeat from core client for 30 sec - exiting 09:50:19 (16488): No heartbeat from core client for 30 sec - exiting 09:50:20 (16488): No heartbeat from core client for 30 sec - exiting 09:50:21 (16488): No heartbeat from core client for 30 sec - exiting 09:50:22 (16488): No heartbeat from core client for 30 sec - exiting 09:50:23 (16488): No heartbeat from core client for 30 sec - exiting 09:50:24 (16488): No heartbeat from core client for 30 sec - exiting 09:50:25 (16488): No heartbeat from core client for 30 sec - exiting 09:50:26 (16488): No heartbeat from core client for 30 sec - exiting 09:50:27 (16488): No heartbeat from core client for 30 sec - exiting 09:50:28 (16488): No heartbeat from core client for 30 sec - exiting 09:50:29 (16488): No heartbeat from core client for 30 sec - exiting 09:50:30 (16488): No heartbeat from core client for 30 sec - exiting 09:50:31 (16488): No heartbeat from core client for 30 sec - exiting 09:50:32 (16488): No heartbeat from core client for 30 sec - exiting 09:50:33 (16488): No heartbeat from core client for 30 sec - exiting 09:50:34 (16488): No heartbeat from core client for 30 sec - exiting 09:50:35 (16488): No heartbeat from core client for 30 sec - exiting 09:50:36 (16488): No heartbeat from core client for 30 sec - exiting 09:50:37 (16488): No heartbeat from core client for 30 sec - exiting 09:50:38 (16488): No heartbeat from core client for 30 sec - exiting 09:50:39 (16488): No heartbeat from core client for 30 sec - exiting 09:50:40 (16488): No heartbeat from core client for 30 sec - exiting 09:50:41 (16488): No heartbeat from core client for 30 sec - exiting 09:50:42 (16488): No heartbeat from core client for 30 sec - exiting 09:50:43 (16488): No heartbeat from core client for 30 sec - exiting 09:50:44 (16488): No heartbeat from core client for 30 sec - exiting 09:50:45 (16488): No heartbeat from core client for 30 sec - exiting 09:50:46 (16488): No heartbeat from core client for 30 sec - exiting 09:50:47 (16488): No heartbeat from core client for 30 sec - exiting 09:50:48 (16488): No heartbeat from core client for 30 sec - exiting 09:50:49 (16488): No heartbeat from core client for 30 sec - exiting 09:50:50 (16488): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 12:19:48 (17036): No heartbeat from core client for 30 sec - exiting 12:19:49 (17036): No heartbeat from core client for 30 sec - exiting 12:19:50 (17036): No heartbeat from core client for 30 sec - exiting 12:19:51 (17036): No heartbeat from core client for 30 sec - exiting 12:19:52 (17036): No heartbeat from core client for 30 sec - exiting 12:19:53 (17036): No heartbeat from core client for 30 sec - exiting 12:19:54 (17036): No heartbeat from core client for 30 sec - exiting 12:19:55 (17036): No heartbeat from core client for 30 sec - exiting 12:19:56 (17036): No heartbeat from core client for 30 sec - exiting 12:19:57 (17036): No heartbeat from core client for 30 sec - exiting 12:19:58 (17036): No heartbeat from core client for 30 sec - exiting 12:19:59 (17036): No heartbeat from core client for 30 sec - exiting 12:20:00 (17036): No heartbeat from core client for 30 sec - exiting 12:20:01 (17036): No heartbeat from core client for 30 sec - exiting 12:20:02 (17036): No heartbeat from core client for 30 sec - exiting 12:20:03 (17036): No heartbeat from core client for 30 sec - exiting 12:20:04 (17036): No heartbeat from core client for 30 sec - exiting 12:20:05 (17036): No heartbeat from core client for 30 sec - exiting 12:20:06 (17036): No heartbeat from core client for 30 sec - exiting 12:20:07 (17036): No heartbeat from core client for 30 sec - exiting 12:20:08 (17036): No heartbeat from core client for 30 sec - exiting 12:20:09 (17036): No heartbeat from core client for 30 sec - exiting 12:20:10 (17036): No heartbeat from core client for 30 sec - exiting 12:20:11 (17036): No heartbeat from core client for 30 sec - exiting 12:20:12 (17036): No heartbeat from core client for 30 sec - exiting 12:20:13 (17036): No heartbeat from core client for 30 sec - exiting 12:20:14 (17036): No heartbeat from core client for 30 sec - exiting 12:20:15 (17036): No heartbeat from core client for 30 sec - exiting 12:20:16 (17036): No heartbeat from core client for 30 sec - exiting 12:20:17 (17036): No heartbeat from core client for 30 sec - exiting 12:20:18 (17036): No heartbeat from core client for 30 sec - exiting 12:20:19 (17036): No heartbeat from core client for 30 sec - exiting 12:20:20 (17036): No heartbeat from core client for 30 sec - exiting 12:20:21 (17036): No heartbeat from core client for 30 sec - exiting 12:20:22 (17036): No heartbeat from core client for 30 sec - exiting 12:20:23 (17036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 14:45:54 (12960): No heartbeat from core client for 30 sec - exiting 14:45:55 (12960): No heartbeat from core client for 30 sec - exiting 14:45:56 (12960): No heartbeat from core client for 30 sec - exiting 14:45:57 (12960): No heartbeat from core client for 30 sec - exiting 14:45:58 (12960): No heartbeat from core client for 30 sec - exiting 14:45:59 (12960): No heartbeat from core client for 30 sec - exiting 14:46:00 (12960): No heartbeat from core client for 30 sec - exiting 14:46:01 (12960): No heartbeat from core client for 30 sec - exiting 14:46:02 (12960): No heartbeat from core client for 30 sec - exiting 14:46:03 (12960): No heartbeat from core client for 30 sec - exiting 14:46:04 (12960): No heartbeat from core client for 30 sec - exiting 14:46:05 (12960): No heartbeat from core client for 30 sec - exiting 14:46:06 (12960): No heartbeat from core client for 30 sec - exiting 14:46:07 (12960): No heartbeat from core client for 30 sec - exiting 14:46:08 (12960): No heartbeat from core client for 30 sec - exiting 14:46:09 (12960): No heartbeat from core client for 30 sec - exiting 14:46:10 (12960): No heartbeat from core client for 30 sec - exiting 14:46:11 (12960): No heartbeat from core client for 30 sec - exiting 14:46:12 (12960): No heartbeat from core client for 30 sec - exiting 14:46:13 (12960): No heartbeat from core client for 30 sec - exiting 14:46:14 (12960): No heartbeat from core client for 30 sec - exiting 14:46:15 (12960): No heartbeat from core client for 30 sec - exiting 14:46:16 (12960): No heartbeat from core client for 30 sec - exiting 14:46:17 (12960): No heartbeat from core client for 30 sec - exiting 14:46:18 (12960): No heartbeat from core client for 30 sec - exiting 14:46:19 (12960): No heartbeat from core client for 30 sec - exiting 14:46:20 (12960): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 16:19:34 (13212): No heartbeat from core client for 30 sec - exiting 16:19:36 (13212): No heartbeat from core client for 30 sec - exiting 16:19:37 (13212): No heartbeat from core client for 30 sec - exiting 16:19:38 (13212): No heartbeat from core client for 30 sec - exiting 16:19:39 (13212): No heartbeat from core client for 30 sec - exiting 16:19:40 (13212): No heartbeat from core client for 30 sec - exiting 16:19:41 (13212): No heartbeat from core client for 30 sec - exiting 16:19:42 (13212): No heartbeat from core client for 30 sec - exiting 16:19:43 (13212): No heartbeat from core client for 30 sec - exiting 16:19:44 (13212): No heartbeat from core client for 30 sec - exiting 16:19:45 (13212): No heartbeat from core client for 30 sec - exiting 16:19:46 (13212): No heartbeat from core client for 30 sec - exiting 16:19:47 (13212): No heartbeat from core client for 30 sec - exiting 16:19:48 (13212): No heartbeat from core client for 30 sec - exiting 16:19:49 (13212): No heartbeat from core client for 30 sec - exiting 16:19:50 (13212): No heartbeat from core client for 30 sec - exiting 16:19:51 (13212): No heartbeat from core client for 30 sec - exiting 16:19:52 (13212): No heartbeat from core client for 30 sec - exiting 16:19:53 (13212): No heartbeat from core client for 30 sec - exiting 16:19:54 (13212): No heartbeat from core client for 30 sec - exiting 16:19:55 (13212): No heartbeat from core client for 30 sec - exiting 16:19:56 (13212): No heartbeat from core client for 30 sec - exiting 16:19:57 (13212): No heartbeat from core client for 30 sec - exiting 16:19:58 (13212): No heartbeat from core client for 30 sec - exiting 16:19:59 (13212): No heartbeat from core client for 30 sec - exiting 16:20:00 (13212): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 17:34:46 (5004): No heartbeat from core client for 30 sec - exiting 17:34:48 (5004): No heartbeat from core client for 30 sec - exiting 17:34:49 (5004): No heartbeat from core client for 30 sec - exiting 17:34:50 (5004): No heartbeat from core client for 30 sec - exiting 17:34:51 (5004): No heartbeat from core client for 30 sec - exiting 17:34:52 (5004): No heartbeat from core client for 30 sec - exiting 17:34:53 (5004): No heartbeat from core client for 30 sec - exiting 17:34:54 (5004): No heartbeat from core client for 30 sec - exiting 17:34:55 (5004): No heartbeat from core client for 30 sec - exiting 17:34:56 (5004): No heartbeat from core client for 30 sec - exiting 17:34:57 (5004): No heartbeat from core client for 30 sec - exiting 17:34:58 (5004): No heartbeat from core client for 30 sec - exiting 17:34:59 (5004): No heartbeat from core client for 30 sec - exiting 17:35:00 (5004): No heartbeat from core client for 30 sec - exiting 17:35:01 (5004): No heartbeat from core client for 30 sec - exiting 17:35:02 (5004): No heartbeat from core client for 30 sec - exiting 17:35:03 (5004): No heartbeat from core client for 30 sec - exiting 17:35:04 (5004): No heartbeat from core client for 30 sec - exiting 17:35:05 (5004): No heartbeat from core client for 30 sec - exiting 17:35:06 (5004): No heartbeat from core client for 30 sec - exiting 17:35:07 (5004): No heartbeat from core client for 30 sec - exiting 17:35:08 (5004): No heartbeat from core client for 30 sec - exiting 17:35:09 (5004): No heartbeat from core client for 30 sec - exiting 17:35:10 (5004): No heartbeat from core client for 30 sec - exiting 17:35:11 (5004): No heartbeat from core client for 30 sec - exiting 17:35:12 (5004): No heartbeat from core client for 30 sec - exiting 17:35:13 (5004): No heartbeat from core client for 30 sec - exiting 17:35:14 (5004): No heartbeat from core client for 30 sec - exiting 17:35:15 (5004): No heartbeat from core client for 30 sec - exiting 17:35:16 (5004): No heartbeat from core client for 30 sec - exiting 17:35:17 (5004): No heartbeat from core client for 30 sec - exiting 17:35:18 (5004): No heartbeat from core client for 30 sec - exiting 17:35:19 (5004): No heartbeat from core client for 30 sec - exiting 17:35:20 (5004): No heartbeat from core client for 30 sec - exiting 17:35:21 (5004): No heartbeat from core client for 30 sec - exiting 17:35:22 (5004): No heartbeat from core client for 30 sec - exiting 17:35:23 (5004): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=16272, selfPID=16272, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5804, selfPID=5804, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=14280, selfPID=14280, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=14708, selfPID=14708, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=13608, selfPID=13608, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=7056, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=0, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=16760, selfPID=15308, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_anz_rn6t_2012_1_008956632_0_2.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_rn6t_2012_1_008956632_0_3.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_rn6t_2012_1_008956632_0_4.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_rn6t_2012_1_008956632_0_5.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_rn6t_2012_1_008956632_0_6.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_rn6t_2012_1_008956632_0_7.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_rn6t_2012_1_008956632_0_8.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_rn6t_2012_1_008956632_0_9.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_rn6t_2012_1_008956632_0_10.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_rn6t_2012_1_008956632_0_11.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_rn6t_2012_1_008956632_0_12.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
02 Sep 2014 17:42:20	1317793	16948795	hadam3p_anz_rn6t_2012_1_008956632_0	11,819	36,215	3.0641