Task 16416512

Name	hadam3p_anz_n8yc_2012_1_008599220_0
Workunit	8745732
Created	26 Mar 2014, 19:04:35 UTC
Sent	27 Mar 2014, 17:34:54 UTC
Report deadline	9 Mar 2015, 22:54:54 UTC
Received	7 Apr 2014, 1:14:17 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1315213
Run time	4 days 1 hours 52 min 29 sec
CPU time	3 days 20 hours 5 min 24 sec
Validate state	Invalid
Credit	1,006.54
Device peak FLOPS	1.80 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.2.42</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1792, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9716, selfPID=4292, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 11:19:04 (2112): No heartbeat from core client for 30 sec - exiting 11:19:05 (2112): No heartbeat from core client for 30 sec - exiting 11:19:06 (2112): No heartbeat from core client for 30 sec - exiting 11:19:07 (2112): No heartbeat from core client for 30 sec - exiting 11:19:08 (2112): No heartbeat from core client for 30 sec - exiting 11:19:09 (2112): No heartbeat from core client for 30 sec - exiting 11:19:10 (2112): No heartbeat from core client for 30 sec - exiting 11:19:58 (2112): No heartbeat from core client for 30 sec - exiting 11:19:59 (2112): No heartbeat from core client for 30 sec - exiting 11:20:00 (2112): No heartbeat from core client for 30 sec - exiting 11:20:01 (2112): No heartbeat from core client for 30 sec - exiting 11:20:02 (2112): No heartbeat from core client for 30 sec - exiting 11:20:03 (2112): No heartbeat from core client for 30 sec - exiting 11:20:04 (2112): No heartbeat from core client for 30 sec - exiting 11:20:05 (2112): No heartbeat from core client for 30 sec - exiting 11:20:06 (2112): No heartbeat from core client for 30 sec - exiting 11:20:07 (2112): No heartbeat from core client for 30 sec - exiting 11:20:08 (2112): No heartbeat from core client for 30 sec - exiting 11:20:09 (2112): No heartbeat from core client for 30 sec - exiting 11:20:10 (2112): No heartbeat from core client for 30 sec - exiting 11:20:11 (2112): No heartbeat from core client for 30 sec - exiting 11:20:12 (2112): No heartbeat from core client for 30 sec - exiting 11:20:13 (2112): No heartbeat from core client for 30 sec - exiting 11:20:14 (2112): No heartbeat from core client for 30 sec - exiting 11:20:15 (2112): No heartbeat from core client for 30 sec - exiting 11:20:16 (2112): No heartbeat from core client for 30 sec - exiting 11:20:17 (2112): No heartbeat from core client for 30 sec - exiting 11:20:18 (2112): No heartbeat from core client for 30 sec - exiting 11:20:19 (2112): No heartbeat from core client for 30 sec - exiting 11:20:20 (2112): No heartbeat from core client for 30 sec - exiting 11:20:21 (2112): No heartbeat from core client for 30 sec - exiting 11:20:22 (2112): No heartbeat from core client for 30 sec - exiting 11:20:23 (2112): No heartbeat from core client for 30 sec - exiting 11:20:24 (2112): No heartbeat from core client for 30 sec - exiting 11:20:25 (2112): No heartbeat from core client for 30 sec - exiting 11:20:26 (2112): No heartbeat from core client for 30 sec - exiting 11:20:27 (2112): No heartbeat from core client for 30 sec - exiting 11:20:28 (2112): No heartbeat from core client for 30 sec - exiting 11:20:29 (2112): No heartbeat from core client for 30 sec - exiting 11:20:30 (2112): No heartbeat from core client for 30 sec - exiting 11:20:31 (2112): No heartbeat from core client for 30 sec - exiting 11:20:32 (2112): No heartbeat from core client for 30 sec - exiting 11:20:33 (2112): No heartbeat from core client for 30 sec - exiting 11:20:34 (2112): No heartbeat from core client for 30 sec - exiting 11:20:35 (2112): No heartbeat from core client for 30 sec - exiting 11:20:36 (2112): No heartbeat from core client for 30 sec - exiting 11:20:37 (2112): No heartbeat from core client for 30 sec - exiting 11:20:38 (2112): No heartbeat from core client for 30 sec - exiting 11:20:39 (2112): No heartbeat from core client for 30 sec - exiting 11:20:40 (2112): No heartbeat from core client for 30 sec - exiting 11:20:41 (2112): No heartbeat from core client for 30 sec - exiting 11:20:42 (2112): No heartbeat from core client for 30 sec - exiting 11:20:43 (2112): No heartbeat from core client for 30 sec - exiting 11:20:44 (2112): No heartbeat from core client for 30 sec - exiting 11:20:45 (2112): No heartbeat from core client for 30 sec - exiting 11:20:46 (2112): No heartbeat from core client for 30 sec - exiting 11:20:47 (2112): No heartbeat from core client for 30 sec - exiting 11:20:48 (2112): No heartbeat from core client for 30 sec - exiting 11:20:49 (2112): No heartbeat from core client for 30 sec - exiting 11:20:50 (2112): No heartbeat from core client for 30 sec - exiting 11:20:51 (2112): No heartbeat from core client for 30 sec - exiting 11:20:52 (2112): No heartbeat from core client for 30 sec - exiting 11:20:53 (2112): No heartbeat from core client for 30 sec - exiting 11:20:54 (2112): No heartbeat from core client for 30 sec - exiting 11:20:55 (2112): No heartbeat from core client for 30 sec - exiting 11:20:56 (2112): No heartbeat from core client for 30 sec - exiting 11:20:57 (2112): No heartbeat from core client for 30 sec - exiting 11:20:58 (2112): No heartbeat from core client for 30 sec - exiting 11:20:59 (2112): No heartbeat from core client for 30 sec - exiting 11:21:00 (2112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2784, iMonCtr=2 09:47:29 (7404): No heartbeat from core client for 30 sec - exiting 09:47:30 (7404): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:50:12 (9244): No heartbeat from core client for 30 sec - exiting 09:50:13 (9244): No heartbeat from core client for 30 sec - exiting 09:50:14 (9244): No heartbeat from core client for 30 sec - exiting 09:50:15 (9244): No heartbeat from core client for 30 sec - exiting 09:50:16 (9244): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:23:39 (2932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:24:51 (1244): No heartbeat from core client for 30 sec - exiting 20:24:52 (1244): No heartbeat from core client for 30 sec - exiting 20:24:53 (1244): No heartbeat from core client for 30 sec - exiting 20:24:54 (1244): No heartbeat from core client for 30 sec - exiting 20:24:55 (1244): No heartbeat from core client for 30 sec - exiting 20:24:56 (1244): No heartbeat from core client for 30 sec - exiting 20:24:57 (1244): No heartbeat from core client for 30 sec - exiting 20:24:58 (1244): No heartbeat from core client for 30 sec - exiting 20:24:59 (1244): No heartbeat from core client for 30 sec - exiting 20:25:00 (1244): No heartbeat from core client for 30 sec - exiting 20:25:01 (1244): No heartbeat from core client for 30 sec - exiting 20:25:02 (1244): No heartbeat from core client for 30 sec - exiting 20:25:03 (1244): No heartbeat from core client for 30 sec - exiting 20:25:04 (1244): No heartbeat from core client for 30 sec - exiting 20:25:05 (1244): No heartbeat from core client for 30 sec - exiting 20:25:06 (1244): No heartbeat from core client for 30 sec - exiting 20:25:07 (1244): No heartbeat from core client for 30 sec - exiting 20:25:08 (1244): No heartbeat from core client for 30 sec - exiting 20:25:09 (1244): No heartbeat from core client for 30 sec - exiting 20:25:10 (1244): No heartbeat from core client for 30 sec - exiting 20:25:11 (1244): No heartbeat from core client for 30 sec - exiting 20:25:12 (1244): No heartbeat from core client for 30 sec - exiting 20:25:13 (1244): No heartbeat from core client for 30 sec - exiting 20:25:14 (1244): No heartbeat from core client for 30 sec - exiting 20:25:15 (1244): No heartbeat from core client for 30 sec - exiting 20:25:16 (1244): No heartbeat from core client for 30 sec - exiting 20:25:17 (1244): No heartbeat from core client for 30 sec - exiting 20:25:18 (1244): No heartbeat from core client for 30 sec - exiting 20:25:19 (1244): No heartbeat from core client for 30 sec - exiting 20:25:20 (1244): No heartbeat from core client for 30 sec - exiting 07:14:03 (8200): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 12:35:51 (10920): No heartbeat from core client for 30 sec - exiting 12:35:52 (10920): No heartbeat from core client for 30 sec - exiting 12:35:53 (10920): No heartbeat from core client for 30 sec - exiting 12:35:54 (10920): No heartbeat from core client for 30 sec - exiting 12:35:55 (10920): No heartbeat from core client for 30 sec - exiting 12:35:56 (10920): No heartbeat from core client for 30 sec - exiting 12:35:57 (10920): No heartbeat from core client for 30 sec - exiting 12:35:58 (10920): No heartbeat from core client for 30 sec - exiting 12:35:59 (10920): No heartbeat from core client for 30 sec - exiting 12:36:00 (10920): No heartbeat from core client for 30 sec - exiting 12:36:01 (10920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:09:44 (2748): No heartbeat from core client for 30 sec - exiting 20:09:45 (2748): No heartbeat from core client for 30 sec - exiting 20:09:46 (2748): No heartbeat from core client for 30 sec - exiting 20:09:47 (2748): No heartbeat from core client for 30 sec - exiting 20:09:48 (2748): No heartbeat from core client for 30 sec - exiting 20:09:49 (2748): No heartbeat from core client for 30 sec - exiting 20:09:50 (2748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4940, selfPID=4940, iMonCtr=2 20:09:51 (2748): No heartbeat from core client for 30 sec - exiting Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=8500, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8904, selfPID=8904, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8904, selfPID=7636, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 20:10:28 (7636): No heartbeat from core client for 30 sec - exiting 20:10:29 (7636): No heartbeat from core client for 30 sec - exiting 20:10:30 (7636): No heartbeat from core client for 30 sec - exiting 20:10:31 (7636): No heartbeat from core client for 30 sec - exiting 20:10:32 (7636): No heartbeat from core client for 30 sec - exiting 20:10:33 (7636): No heartbeat from core client for 30 sec - exiting 20:10:34 (7636): No heartbeat from core client for 30 sec - exiting 20:10:35 (7636): No heartbeat from core client for 30 sec - exiting 20:10:36 (7636): No heartbeat from core client for 30 sec - exiting Called boinc_finish 20:10:57 (7636): No heartbeat from core client for 30 sec - exiting 20:10:58 (7636): No heartbeat from core client for 30 sec - exiting </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_anz_n8yc_2012_1_008599220_0_3.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_n8yc_2012_1_008599220_0_4.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_n8yc_2012_1_008599220_0_5.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_n8yc_2012_1_008599220_0_6.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_n8yc_2012_1_008599220_0_7.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_n8yc_2012_1_008599220_0_8.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_n8yc_2012_1_008599220_0_9.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_n8yc_2012_1_008599220_0_10.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_n8yc_2012_1_008599220_0_11.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_n8yc_2012_1_008599220_0_12.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
05 Apr 2014 23:17:25	1315213	16416512	hadam3p_anz_n8yc_2012_1_008599220_0	23,339	278,013	11.9119
01 Apr 2014 01:18:53	1315213	16416512	hadam3p_anz_n8yc_2012_1_008599220_0	11,819	144,602	12.2347