Task 15005691

Name	hadam3p_eu_2tgk_1972_1_007401773_1
Workunit	7599203
Created	26 Jul 2012, 18:10:26 UTC
Sent	26 Jul 2012, 18:11:58 UTC
Report deadline	8 Jul 2013, 23:31:58 UTC
Received	6 Aug 2012, 4:31:18 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1220697
Run time	18 hours 56 min 43 sec
CPU time	15 hours 25 min 6 sec
Validate state	Invalid
Credit	200.49
Device peak FLOPS	2.08 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Europe v6.09 windows_intelx86
Stderr	<core_client_version>7.0.25</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6200, selfPID=5284, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5596, selfPID=3116, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4320, selfPID=1876, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5984, selfPID=836, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Suspended CPDN Monitor - Suspend request from BOINC... 22:44:17 (3676): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:44:18 (3676): No heartbeat from core client for 30 sec - exiting 22:44:19 (3676): No heartbeat from core client for 30 sec - exiting 22:44:20 (3676): No heartbeat from core client for 30 sec - exiting 22:44:21 (3676): No heartbeat from core client for 30 sec - exiting 22:44:22 (3676): No heartbeat from core client for 30 sec - exiting 22:44:23 (3676): No heartbeat from core client for 30 sec - exiting 22:44:24 (3676): No heartbeat from core client for 30 sec - exiting 22:44:25 (3676): No heartbeat from core client for 30 sec - exiting 22:44:26 (3676): No heartbeat from core client for 30 sec - exiting 22:44:27 (3676): No heartbeat from core client for 30 sec - exiting 22:44:28 (3676): No heartbeat from core client for 30 sec - exiting 22:44:29 (3676): No heartbeat from core client for 30 sec - exiting 22:44:30 (3676): No heartbeat from core client for 30 sec - exiting 22:44:31 (3676): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7292, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5108, selfPID=3600, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 22:41:33 (3720): No heartbeat from core client for 30 sec - exiting 22:41:37 (3720): No heartbeat from core client for 30 sec - exiting 22:41:38 (3720): No heartbeat from core client for 30 sec - exiting 22:41:39 (3720): No heartbeat from core client for 30 sec - exiting 22:41:40 (3720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 16:07:36 (7616): No heartbeat from core client for 30 sec - exiting 16:07:37 (7616): No heartbeat from core client for 30 sec - exiting 16:07:38 (7616): No heartbeat from core client for 30 sec - exiting 16:07:39 (7616): No heartbeat from core client for 30 sec - exiting 16:07:40 (7616): No heartbeat from core client for 30 sec - exiting 16:07:41 (7616): No heartbeat from core client for 30 sec - exiting 16:07:42 (7616): No heartbeat from core client for 30 sec - exiting 16:07:43 (7616): No heartbeat from core client for 30 sec - exiting 16:07:44 (7616): No heartbeat from core client for 30 sec - exiting 16:07:45 (7616): No heartbeat from core client for 30 sec - exiting 16:07:46 (7616): No heartbeat from core client for 30 sec - exiting 16:07:47 (7616): No heartbeat from core client for 30 sec - exiting 16:07:48 (7616): No heartbeat from core client for 30 sec - exiting 16:07:49 (7616): No heartbeat from core client for 30 sec - exiting 16:07:50 (7616): No heartbeat from core client for 30 sec - exiting 16:07:51 (7616): No heartbeat from core client for 30 sec - exiting 16:07:52 (7616): No heartbeat from core client for 30 sec - exiting 16:07:53 (7616): No heartbeat from core client for 30 sec - exiting 16:07:54 (7616): No heartbeat from core client for 30 sec - exiting 16:07:55 (7616): No heartbeat from core client for 30 sec - exiting 16:07:56 (7616): No heartbeat from core client for 30 sec - exiting 16:07:57 (7616): No heartbeat from core client for 30 sec - exiting 16:07:58 (7616): No heartbeat from core client for 30 sec - exiting 16:07:59 (7616): No heartbeat from core client for 30 sec - exiting 16:08:00 (7616): No heartbeat from core client for 30 sec - exiting 16:08:01 (7616): No heartbeat from core client for 30 sec - exiting 16:08:02 (7616): No heartbeat from core client for 30 sec - exiting 16:08:03 (7616): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5452, selfPID=4308, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Suspended CPDN Monitor - Suspend request from BOINC... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadam3p_eu_2tgk_1972_1_007401773/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadam3p_eu_2tgk_1972_1_007401773/dataout/region_restart.day after 11 attempts Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/xaakm.pipe_dummy 2048 Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_eu_2tgk_1972_1_007401773_1_2.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_2tgk_1972_1_007401773_1_3.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_2tgk_1972_1_007401773_1_4.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_2tgk_1972_1_007401773_1_5.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_2tgk_1972_1_007401773_1_6.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_2tgk_1972_1_007401773_1_7.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_2tgk_1972_1_007401773_1_8.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_2tgk_1972_1_007401773_1_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_2tgk_1972_1_007401773_1_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_2tgk_1972_1_007401773_1_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_2tgk_1972_1_007401773_1_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
02 Aug 2012 04:41:12	1220697	15005691	hadam3p_eu_2tgk_1972_1_007401773_1	11,622	34,430	2.9625
02 Aug 2012 03:41:03	1220697	15005691	hadam3p_eu_2tgk_1972_1_007401773_1	11,616	33,820	2.9115