Task 15285642

Name	hadam3p_eu_63tr_2008_1_007466972_1
Workunit	7664475
Created	14 Sep 2012, 19:33:13 UTC
Sent	14 Sep 2012, 20:06:14 UTC
Report deadline	28 Aug 2013, 1:26:14 UTC
Received	17 Oct 2012, 17:06:07 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1229877
Run time	1 days 20 hours 45 min 59 sec
CPU time	8 hours 57 min 47 sec
Validate state	Invalid
Credit	597.84
Device peak FLOPS	2.57 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Europe v6.09 windows_intelx86
Stderr	<core_client_version>7.0.25</core_client_version> <![CDATA[ <stderr_txt> 08:24:03 (11664): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:23:01 (13196): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 13:48:58 (2748): No heartbeat from core client for 30 sec - exiting 13:48:59 (2748): No heartbeat from core client for 30 sec - exiting 13:49:00 (2748): No heartbeat from core client for 30 sec - exiting 13:49:01 (2748): No heartbeat from core client for 30 sec - exiting 13:49:02 (2748): No heartbeat from core client for 30 sec - exiting 13:49:03 (2748): No heartbeat from core client for 30 sec - exiting 13:49:04 (2748): No heartbeat from core client for 30 sec - exiting 13:49:05 (2748): No heartbeat from core client for 30 sec - exiting 13:49:06 (2748): No heartbeat from core client for 30 sec - exiting 13:49:07 (2748): No heartbeat from core client for 30 sec - exiting 13:49:09 (2748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:46:36 (3892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:47:45 (3016): No heartbeat from core client for 30 sec - exiting 22:47:46 (3016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 05:45:35 (932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:44:32 (1784): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 14:32:39 (568): No heartbeat from core client for 30 sec - exiting 14:32:40 (568): No heartbeat from core client for 30 sec - exiting 14:32:42 (568): No heartbeat from core client for 30 sec - exiting 14:32:43 (568): No heartbeat from core client for 30 sec - exiting 14:32:44 (568): No heartbeat from core client for 30 sec - exiting 14:32:45 (568): No heartbeat from core client for 30 sec - exiting 14:32:46 (568): No heartbeat from core client for 30 sec - exiting 14:32:47 (568): No heartbeat from core client for 30 sec - exiting 14:32:48 (568): No heartbeat from core client for 30 sec - exiting 14:32:49 (568): No heartbeat from core client for 30 sec - exiting 14:32:50 (568): No heartbeat from core client for 30 sec - exiting 14:32:51 (568): No heartbeat from core client for 30 sec - exiting 14:32:53 (568): No heartbeat from core client for 30 sec - exiting 14:32:54 (568): No heartbeat from core client for 30 sec - exiting 14:32:55 (568): No heartbeat from core client for 30 sec - exiting 14:32:56 (568): No heartbeat from core client for 30 sec - exiting 14:32:57 (568): No heartbeat from core client for 30 sec - exiting 14:32:58 (568): No heartbeat from core client for 30 sec - exiting 14:32:59 (568): No heartbeat from core client for 30 sec - exiting 14:33:00 (568): No heartbeat from core client for 30 sec - exiting 14:33:01 (568): No heartbeat from core client for 30 sec - exiting 14:33:02 (568): No heartbeat from core client for 30 sec - exiting 14:33:03 (568): No heartbeat from core client for 30 sec - exiting 14:33:05 (568): No heartbeat from core client for 30 sec - exiting 14:33:06 (568): No heartbeat from core client for 30 sec - exiting 14:33:07 (568): No heartbeat from core client for 30 sec - exiting 14:33:08 (568): No heartbeat from core client for 30 sec - exiting 14:33:09 (568): No heartbeat from core client for 30 sec - exiting 14:33:10 (568): No heartbeat from core client for 30 sec - exiting 14:33:11 (568): No heartbeat from core client for 30 sec - exiting 14:33:12 (568): No heartbeat from core client for 30 sec - exiting 14:33:13 (568): No heartbeat from core client for 30 sec - exiting 14:33:14 (568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:05:39 (3996): No heartbeat from core client for 30 sec - exiting 15:05:40 (3996): No heartbeat from core client for 30 sec - exiting 15:05:42 (3996): No heartbeat from core client for 30 sec - exiting 15:05:43 (3996): No heartbeat from core client for 30 sec - exiting 15:05:44 (3996): No heartbeat from core client for 30 sec - exiting 15:05:45 (3996): No heartbeat from core client for 30 sec - exiting 15:05:46 (3996): No heartbeat from core client for 30 sec - exiting 15:05:47 (3996): No heartbeat from core client for 30 sec - exiting 15:05:48 (3996): No heartbeat from core client for 30 sec - exiting 15:05:49 (3996): No heartbeat from core client for 30 sec - exiting 15:05:50 (3996): No heartbeat from core client for 30 sec - exiting 15:05:51 (3996): No heartbeat from core client for 30 sec - exiting 15:05:52 (3996): No heartbeat from core client for 30 sec - exiting 15:05:54 (3996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3444, selfPID=3444, iMonCtr=2 14:26:54 (4028): No heartbeat from core client for 30 sec - exiting 14:26:55 (4028): No heartbeat from core client for 30 sec - exiting 14:26:56 (4028): No heartbeat from core client for 30 sec - exiting 14:26:57 (4028): No heartbeat from core client for 30 sec - exiting 14:26:58 (4028): No heartbeat from core client for 30 sec - exiting 14:26:59 (4028): No heartbeat from core client for 30 sec - exiting 14:27:00 (4028): No heartbeat from core client for 30 sec - exiting 14:27:01 (4028): No heartbeat from core client for 30 sec - exiting 14:27:02 (4028): No heartbeat from core client for 30 sec - exiting 14:27:03 (4028): No heartbeat from core client for 30 sec - exiting 14:27:04 (4028): No heartbeat from core client for 30 sec - exiting 14:27:06 (4028): No heartbeat from core client for 30 sec - exiting 14:27:07 (4028): No heartbeat from core client for 30 sec - exiting 14:27:08 (4028): No heartbeat from core client for 30 sec - exiting 14:27:09 (4028): No heartbeat from core client for 30 sec - exiting 14:27:10 (4028): No heartbeat from core client for 30 sec - exiting 14:27:11 (4028): No heartbeat from core client for 30 sec - exiting 14:27:12 (4028): No heartbeat from core client for 30 sec - exiting 14:27:13 (4028): No heartbeat from core client for 30 sec - exiting 14:27:14 (4028): No heartbeat from core client for 30 sec - exiting 14:27:15 (4028): No heartbeat from core client for 30 sec - exiting 14:27:16 (4028): No heartbeat from core client for 30 sec - exiting 14:27:18 (4028): No heartbeat from core client for 30 sec - exiting 14:27:19 (4028): No heartbeat from core client for 30 sec - exiting 14:27:20 (4028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2648, selfPID=2648, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3692, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:46:40 (3904): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_eu_63tr_2008_1_007466972_1_4.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_63tr_2008_1_007466972_1_5.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_63tr_2008_1_007466972_1_6.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_63tr_2008_1_007466972_1_7.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_63tr_2008_1_007466972_1_8.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_63tr_2008_1_007466972_1_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_63tr_2008_1_007466972_1_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_63tr_2008_1_007466972_1_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_63tr_2008_1_007466972_1_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
18 Sep 2012 01:48:56	1229877	15285642	hadam3p_eu_63tr_2008_1_007466972_1	34,656	104,028	3.0017
17 Sep 2012 15:56:58	1229877	15285642	hadam3p_eu_63tr_2008_1_007466972_1	23,136	70,326	3.0397
15 Sep 2012 07:02:10	1229877	15285642	hadam3p_eu_63tr_2008_1_007466972_1	11,616	37,233	3.2053