Task 15271539

Name	hadam3p_eu_wotv_1978_1_006865931_1
Workunit	7069247
Created	12 Sep 2012, 5:39:07 UTC
Sent	16 Sep 2012, 7:17:58 UTC
Report deadline	29 Aug 2013, 12:37:58 UTC
Received	17 Sep 2012, 20:22:04 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1106381
Run time	21 hours 47 min 30 sec
CPU time	20 hours 23 min 33 sec
Validate state	Invalid
Credit	200.38
Device peak FLOPS	2.14 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Europe v6.09 windows_intelx86
Stderr	<core_client_version>6.10.18</core_client_version> <![CDATA[ <stderr_txt> 05:35:33 (4964): No heartbeat from core client for 30 sec - exiting 05:35:34 (4964): No heartbeat from core client for 30 sec - exiting 05:35:35 (4964): No heartbeat from core client for 30 sec - exiting 05:35:36 (4964): No heartbeat from core client for 30 sec - exiting 05:35:37 (4964): No heartbeat from core client for 30 sec - exiting 05:35:38 (4964): No heartbeat from core client for 30 sec - exiting 05:35:39 (4964): No heartbeat from core client for 30 sec - exiting 05:35:40 (4964): No heartbeat from core client for 30 sec - exiting 05:35:41 (4964): No heartbeat from core client for 30 sec - exiting 05:35:42 (4964): No heartbeat from core client for 30 sec - exiting 05:35:43 (4964): No heartbeat from core client for 30 sec - exiting 05:35:44 (4964): No heartbeat from core client for 30 sec - exiting 05:35:45 (4964): No heartbeat from core client for 30 sec - exiting 05:35:46 (4964): No heartbeat from core client for 30 sec - exiting 05:35:47 (4964): No heartbeat from core client for 30 sec - exiting 05:35:48 (4964): No heartbeat from core client for 30 sec - exiting 05:35:49 (4964): No heartbeat from core client for 30 sec - exiting 05:35:50 (4964): No heartbeat from core client for 30 sec - exiting 05:35:51 (4964): No heartbeat from core client for 30 sec - exiting 05:35:52 (4964): No heartbeat from core client for 30 sec - exiting 05:35:53 (4964): No heartbeat from core client for 30 sec - exiting 05:35:54 (4964): No heartbeat from core client for 30 sec - exiting 05:35:55 (4964): No heartbeat from core client for 30 sec - exiting 05:35:56 (4964): No heartbeat from core client for 30 sec - exiting 05:35:57 (4964): No heartbeat from core client for 30 sec - exiting 05:35:58 (4964): No heartbeat from core client for 30 sec - exiting 05:35:59 (4964): No heartbeat from core client for 30 sec - exiting 05:36:00 (4964): No heartbeat from core client for 30 sec - exiting 05:36:01 (4964): No heartbeat from core client for 30 sec - exiting 05:36:02 (4964): No heartbeat from core client for 30 sec - exiting 05:36:03 (4964): No heartbeat from core client for 30 sec - exiting 05:36:04 (4964): No heartbeat from core client for 30 sec - exiting 05:36:05 (4964): No heartbeat from core client for 30 sec - exiting 05:36:06 (4964): No heartbeat from core client for 30 sec - exiting 05:36:07 (4964): No heartbeat from core client for 30 sec - exiting 05:36:08 (4964): No heartbeat from core client for 30 sec - exiting 05:36:09 (4964): No heartbeat from core client for 30 sec - exiting 05:36:10 (4964): No heartbeat from core client for 30 sec - exiting 05:36:11 (4964): No heartbeat from core client for 30 sec - exiting 05:36:12 (4964): No heartbeat from core client for 30 sec - exiting 05:36:13 (4964): No heartbeat from core client for 30 sec - exiting 05:36:14 (4964): No heartbeat from core client for 30 sec - exiting 05:36:15 (4964): No heartbeat from core client for 30 sec - exiting 05:36:16 (4964): No heartbeat from core client for 30 sec - exiting 05:36:17 (4964): No heartbeat from core client for 30 sec - exiting 05:36:18 (4964): No heartbeat from core client for 30 sec - exiting 05:36:19 (4964): No heartbeat from core client for 30 sec - exiting 05:36:20 (4964): No heartbeat from core client for 30 sec - exiting 05:36:21 (4964): No heartbeat from core client for 30 sec - exiting 05:36:22 (4964): No heartbeat from core client for 30 sec - exiting 05:36:23 (4964): No heartbeat from core client for 30 sec - exiting 05:36:24 (4964): No heartbeat from core client for 30 sec - exiting 05:36:25 (4964): No heartbeat from core client for 30 sec - exiting 05:36:26 (4964): No heartbeat from core client for 30 sec - exiting 05:36:27 (4964): No heartbeat from core client for 30 sec - exiting 05:36:28 (4964): No heartbeat from core client for 30 sec - exiting 05:36:29 (4964): No heartbeat from core client for 30 sec - exiting 05:36:30 (4964): No heartbeat from core client for 30 sec - exiting 05:36:31 (4964): No heartbeat from core client for 30 sec - exiting 05:36:32 (4964): No heartbeat from core client for 30 sec - exiting 05:36:33 (4964): No heartbeat from core client for 30 sec - exiting 05:36:34 (4964): No heartbeat from core client for 30 sec - exiting 05:36:35 (4964): No heartbeat from core client for 30 sec - exiting 05:36:36 (4964): No heartbeat from core client for 30 sec - exiting 05:36:37 (4964): No heartbeat from core client for 30 sec - exiting 05:36:38 (4964): No heartbeat from core client for 30 sec - exiting 05:36:39 (4964): No heartbeat from core client for 30 sec - exiting 05:36:40 (4964): No heartbeat from core client for 30 sec - exiting 05:36:41 (4964): No heartbeat from core client for 30 sec - exiting 05:36:42 (4964): No heartbeat from core client for 30 sec - exiting 05:36:43 (4964): No heartbeat from core client for 30 sec - exiting 05:36:44 (4964): No heartbeat from core client for 30 sec - exiting 05:36:45 (4964): No heartbeat from core client for 30 sec - exiting 05:36:46 (4964): No heartbeat from core client for 30 sec - exiting 05:36:47 (4964): No heartbeat from core client for 30 sec - exiting 05:36:48 (4964): No heartbeat from core client for 30 sec - exiting 05:36:49 (4964): No heartbeat from core client for 30 sec - exiting 05:36:50 (4964): No heartbeat from core client for 30 sec - exiting 05:36:51 (4964): No heartbeat from core client for 30 sec - exiting 05:36:52 (4964): No heartbeat from core client for 30 sec - exiting 05:36:53 (4964): No heartbeat from core client for 30 sec - exiting 05:36:54 (4964): No heartbeat from core client for 30 sec - exiting 05:36:55 (4964): No heartbeat from core client for 30 sec - exiting 05:36:56 (4964): No heartbeat from core client for 30 sec - exiting 05:36:57 (4964): No heartbeat from core client for 30 sec - exiting 05:36:58 (4964): No heartbeat from core client for 30 sec - exiting 05:36:59 (4964): No heartbeat from core client for 30 sec - exiting 05:37:00 (4964): No heartbeat from core client for 30 sec - exiting 05:37:01 (4964): No heartbeat from core client for 30 sec - exiting 05:37:02 (4964): No heartbeat from core client for 30 sec - exiting 05:37:03 (4964): No heartbeat from core client for 30 sec - exiting 05:37:04 (4964): No heartbeat from core client for 30 sec - exiting 05:37:05 (4964): No heartbeat from core client for 30 sec - exiting 05:37:06 (4964): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:37:07 (4964): No heartbeat from core client for 30 sec - exiting 05:37:08 (4964): No heartbeat from core client for 30 sec - exiting 05:37:09 (4964): No heartbeat from core client for 30 sec - exiting 05:37:10 (4964): No heartbeat from core client for 30 sec - exiting 05:37:11 (4964): No heartbeat from core client for 30 sec - exiting 05:37:12 (4964): No heartbeat from core client for 30 sec - exiting 05:37:13 (4964): No heartbeat from core client for 30 sec - exiting 05:37:14 (4964): No heartbeat from core client for 30 sec - exiting 05:37:15 (4964): No heartbeat from core client for 30 sec - exiting 05:37:16 (4964): No heartbeat from core client for 30 sec - exiting 05:37:17 (4964): No heartbeat from core client for 30 sec - exiting 05:37:18 (4964): No heartbeat from core client for 30 sec - exiting 05:37:19 (4964): No heartbeat from core client for 30 sec - exiting 05:37:20 (4964): No heartbeat from core client for 30 sec - exiting 05:37:21 (4964): No heartbeat from core client for 30 sec - exiting Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1208, selfPID=1208, iMonCtr=1 No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1208, selfPID=2396, iMonCtr=1 06:21:54 (184): No heartbeat from core client for 30 sec - exiting 06:21:55 (184): No heartbeat from core client for 30 sec - exiting 06:21:56 (184): No heartbeat from core client for 30 sec - exiting 06:21:57 (184): No heartbeat from core client for 30 sec - exiting 06:21:58 (184): No heartbeat from core client for 30 sec - exiting 06:21:59 (184): No heartbeat from core client for 30 sec - exiting 06:22:00 (184): No heartbeat from core client for 30 sec - exiting 06:22:01 (184): No heartbeat from core client for 30 sec - exiting 06:22:02 (184): No heartbeat from core client for 30 sec - exiting 06:22:03 (184): No heartbeat from core client for 30 sec - exiting 06:22:04 (184): No heartbeat from core client for 30 sec - exiting 06:22:05 (184): No heartbeat from core client for 30 sec - exiting 06:22:06 (184): No heartbeat from core client for 30 sec - exiting 06:22:07 (184): No heartbeat from core client for 30 sec - exiting 06:22:08 (184): No heartbeat from core client for 30 sec - exiting 06:22:09 (184): No heartbeat from core client for 30 sec - exiting 06:22:10 (184): No heartbeat from core client for 30 sec - exiting 06:22:11 (184): No heartbeat from core client for 30 sec - exiting 06:22:12 (184): No heartbeat from core client for 30 sec - exiting 06:22:13 (184): No heartbeat from core client for 30 sec - exiting 06:22:14 (184): No heartbeat from core client for 30 sec - exiting 06:22:15 (184): No heartbeat from core client for 30 sec - exiting 06:22:16 (184): No heartbeat from core client for 30 sec - exiting 06:22:17 (184): No heartbeat from core client for 30 sec - exiting 06:22:18 (184): No heartbeat from core client for 30 sec - exiting 06:22:19 (184): No heartbeat from core client for 30 sec - exiting 06:22:20 (184): No heartbeat from core client for 30 sec - exiting 06:22:21 (184): No heartbeat from core client for 30 sec - exiting 06:22:22 (184): No heartbeat from core client for 30 sec - exiting 06:22:23 (184): No heartbeat from core client for 30 sec - exiting 06:22:24 (184): No heartbeat from core client for 30 sec - exiting 06:22:25 (184): No heartbeat from core client for 30 sec - exiting 06:22:26 (184): No heartbeat from core client for 30 sec - exiting 06:22:27 (184): No heartbeat from core client for 30 sec - exiting 06:22:28 (184): No heartbeat from core client for 30 sec - exiting 06:22:29 (184): No heartbeat from core client for 30 sec - exiting 06:22:30 (184): No heartbeat from core client for 30 sec - exiting 06:22:31 (184): No heartbeat from core client for 30 sec - exiting 06:22:32 (184): No heartbeat from core client for 30 sec - exiting 06:22:33 (184): No heartbeat from core client for 30 sec - exiting 06:22:34 (184): No heartbeat from core client for 30 sec - exiting 06:22:35 (184): No heartbeat from core client for 30 sec - exiting 06:22:36 (184): No heartbeat from core client for 30 sec - exiting 06:22:37 (184): No heartbeat from core client for 30 sec - exiting 06:22:38 (184): No heartbeat from core client for 30 sec - exiting 06:22:39 (184): No heartbeat from core client for 30 sec - exiting 06:22:40 (184): No heartbeat from core client for 30 sec - exiting 06:22:41 (184): No heartbeat from core client for 30 sec - exiting 06:22:42 (184): No heartbeat from core client for 30 sec - exiting 06:22:43 (184): No heartbeat from core client for 30 sec - exiting 06:22:44 (184): No heartbeat from core client for 30 sec - exiting 06:22:45 (184): No heartbeat from core client for 30 sec - exiting 06:22:46 (184): No heartbeat from core client for 30 sec - exiting 06:22:47 (184): No heartbeat from core client for 30 sec - exiting 06:22:48 (184): No heartbeat from core client for 30 sec - exiting 06:22:49 (184): No heartbeat from core client for 30 sec - exiting 06:22:50 (184): No heartbeat from core client for 30 sec - exiting 06:22:51 (184): No heartbeat from core client for 30 sec - exiting 06:22:52 (184): No heartbeat from core client for 30 sec - exiting 06:22:53 (184): No heartbeat from core client for 30 sec - exiting 06:22:54 (184): No heartbeat from core client for 30 sec - exiting 06:22:55 (184): No heartbeat from core client for 30 sec - exiting 06:22:56 (184): No heartbeat from core client for 30 sec - exiting 06:22:57 (184): No heartbeat from core client for 30 sec - exiting 06:22:58 (184): No heartbeat from core client for 30 sec - exiting 06:22:59 (184): No heartbeat from core client for 30 sec - exiting 06:23:00 (184): No heartbeat from core client for 30 sec - exiting 06:23:01 (184): No heartbeat from core client for 30 sec - exiting 06:23:02 (184): No heartbeat from core client for 30 sec - exiting 06:23:03 (184): No heartbeat from core client for 30 sec - exiting 06:23:04 (184): No heartbeat from core client for 30 sec - exiting 06:23:05 (184): No heartbeat from core client for 30 sec - exiting 06:23:06 (184): No heartbeat from core client for 30 sec - exiting 06:23:07 (184): No heartbeat from core client for 30 sec - exiting 06:23:08 (184): No heartbeat from core client for 30 sec - exiting 06:23:09 (184): No heartbeat from core client for 30 sec - exiting 06:23:10 (184): No heartbeat from core client for 30 sec - exiting 06:23:11 (184): No heartbeat from core client for 30 sec - exiting 06:23:12 (184): No heartbeat from core client for 30 sec - exiting 06:23:13 (184): No heartbeat from core client for 30 sec - exiting 06:23:14 (184): No heartbeat from core client for 30 sec - exiting 06:23:15 (184): No heartbeat from core client for 30 sec - exiting 06:23:16 (184): No heartbeat from core client for 30 sec - exiting 06:23:17 (184): No heartbeat from core client for 30 sec - exiting 06:23:18 (184): No heartbeat from core client for 30 sec - exiting 06:23:19 (184): No heartbeat from core client for 30 sec - exiting 06:23:20 (184): No heartbeat from core client for 30 sec - exiting 06:23:21 (184): No heartbeat from core client for 30 sec - exiting 06:23:22 (184): No heartbeat from core client for 30 sec - exiting 06:23:23 (184): No heartbeat from core client for 30 sec - exiting 06:23:24 (184): No heartbeat from core client for 30 sec - exiting 06:23:25 (184): No heartbeat from core client for 30 sec - exiting 06:23:26 (184): No heartbeat from core client for 30 sec - exiting 06:23:27 (184): No heartbeat from core client for 30 sec - exiting 06:23:28 (184): No heartbeat from core client for 30 sec - exiting 06:23:29 (184): No heartbeat from core client for 30 sec - exiting 06:23:30 (184): No heartbeat from core client for 30 sec - exiting 06:23:31 (184): No heartbeat from core client for 30 sec - exiting 06:23:32 (184): No heartbeat from core client for 30 sec - exiting 06:23:33 (184): No heartbeat from core client for 30 sec - exiting 06:23:34 (184): No heartbeat from core client for 30 sec - exiting 06:23:35 (184): No heartbeat from core client for 30 sec - exiting 06:23:36 (184): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4952, selfPID=4952, iMonCtr=1 No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4952, selfPID=4960, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1352, selfPID=4152, iMonCtr=1 No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1352, selfPID=1352, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1532, selfPID=3784, iMonCtr=1 No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1532, selfPID=1532, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5104, selfPID=4400, iMonCtr=1 No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5104, selfPID=5104, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2244, selfPID=1272, iMonCtr=1 No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2244, selfPID=2244, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=212, selfPID=760, iMonCtr=1 No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=212, selfPID=212, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4952, selfPID=4932, iMonCtr=1 No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4952, selfPID=4952, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4968, selfPID=3280, iMonCtr=1 No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4968, selfPID=4968, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3940, selfPID=592, iMonCtr=1 No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3940, selfPID=3940, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4632, selfPID=4340, iMonCtr=1 forrtl: Access is denied. forrtl: severe (38): error during write, unit 8, file C:\ProgramData\BOINC\projects\climateprediction.net\hadam3p_eu_wotv_1978_1_006865931\tmp\xaakm.pipe_dummy Image PC Routine Line Source hadam3p_eu_um_6.0 005EA39A Unknown Unknown Unknown hadam3p_eu_um_6.0 00592CD0 Unknown Unknown Unknown hadam3p_eu_um_6.0 00591E9A Unknown Unknown Unknown hadam3p_eu_um_6.0 0056AA9D Unknown Unknown Unknown hadam3p_eu_um_6.0 0050F27C Unknown Unknown Unknown hadam3p_eu_um_6.0 00289BD2 Unknown Unknown Unknown hadam3p_eu_um_6.0 005CE638 Unknown Unknown Unknown kernel32.dll 763F339A Unknown Unknown Unknown ntdll.dll 775C9EF2 Unknown Unknown Unknown ntdll.dll 775C9EC5 Unknown Unknown Unknown Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3172, selfPID=412, iMonCtr=1 Model crash detected, will try to restart... No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3172, selfPID=3172, iMonCtr=2 Leaving CPDN_Main::Monitor... No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4480, iMonCtr=2 Called boinc_finish </stderr_txt> <message> <file_xfer_error> <file_name>hadam3p_eu_wotv_1978_1_006865931_1_2.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_wotv_1978_1_006865931_1_3.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_wotv_1978_1_006865931_1_4.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_wotv_1978_1_006865931_1_5.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_wotv_1978_1_006865931_1_6.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_wotv_1978_1_006865931_1_7.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_wotv_1978_1_006865931_1_8.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_wotv_1978_1_006865931_1_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_wotv_1978_1_006865931_1_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_wotv_1978_1_006865931_1_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_wotv_1978_1_006865931_1_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
17 Sep 2012 06:14:38	1106381	15271539	hadam3p_eu_wotv_1978_1_006865931_1	11,616	44,442	3.8259