Task 12971937

Name	hadam3p_eu_2q5b_1970_1_007229097_2
Workunit	7427337
Created	11 Jun 2011, 10:34:43 UTC
Sent	11 Jun 2011, 10:34:46 UTC
Report deadline	23 May 2012, 15:54:46 UTC
Received	23 Jul 2011, 6:29:44 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1055935
Run time	3 days 6 hours 58 min 45 sec
CPU time	2 days 18 hours 1 min 55 sec
Validate state	Invalid
Credit	995.30
Device peak FLOPS	1.85 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Europe v6.09 windows_intelx86
Stderr	<core_client_version>6.6.36</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5340, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5852, iMonCtr=2 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:38:03 (4992): No heartbeat from core client for 30 sec - exiting 03:38:04 (4992): No heartbeat from core client for 30 sec - exiting 03:38:05 (4992): No heartbeat from core client for 30 sec - exiting 03:38:06 (4992): No heartbeat from core client for 30 sec - exiting 03:38:08 (4992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:38:09 (4992): No heartbeat from core client for 30 sec - exiting 03:38:10 (4992): No heartbeat from core client for 30 sec - exiting 03:38:11 (4992): No heartbeat from core client for 30 sec - exiting Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4936, selfPID=5020, iMonCtr=1 No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4936, selfPID=4936, iMonCtr=1 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:08:23 (540): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:08:24 (540): No heartbeat from core client for 30 sec - exiting 14:08:25 (540): No heartbeat from core client for 30 sec - exiting 14:08:26 (540): No heartbeat from core client for 30 sec - exiting 14:08:27 (540): No heartbeat from core client for 30 sec - exiting 14:08:28 (540): No heartbeat from core client for 30 sec - exiting 14:08:29 (540): No heartbeat from core client for 30 sec - exiting 14:08:30 (540): No heartbeat from core client for 30 sec - exiting 14:08:32 (540): No heartbeat from core client for 30 sec - exiting 14:08:33 (540): No heartbeat from core client for 30 sec - exiting 14:08:34 (540): No heartbeat from core client for 30 sec - exiting 14:08:35 (540): No heartbeat from core client for 30 sec - exiting 14:08:36 (540): No heartbeat from core client for 30 sec - exiting 14:08:37 (540): No heartbeat from core client for 30 sec - exiting 14:08:38 (540): No heartbeat from core client for 30 sec - exiting 14:08:39 (540): No heartbeat from core client for 30 sec - exiting 14:08:40 (540): No heartbeat from core client for 30 sec - exiting 14:08:41 (540): No heartbeat from core client for 30 sec - exiting 14:08:42 (540): No heartbeat from core client for 30 sec - exiting 14:08:44 (540): No heartbeat from core client for 30 sec - exiting 14:08:45 (540): No heartbeat from core client for 30 sec - exiting Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5168, selfPID=5452, iMonCtr=1 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5168, selfPID=5168, iMonCtr=1 03:40:56 (5676): No heartbeat from core client for 30 sec - exiting 03:40:58 (5676): No heartbeat from core client for 30 sec - exiting 03:40:59 (5676): No heartbeat from core client for 30 sec - exiting 03:41:00 (5676): No heartbeat from core client for 30 sec - exiting 03:41:01 (5676): No heartbeat from core client for 30 sec - exiting 03:41:02 (5676): No heartbeat from core client for 30 sec - exiting 03:41:03 (5676): No heartbeat from core client for 30 sec - exiting 03:41:04 (5676): No heartbeat from core client for 30 sec - exiting 03:41:05 (5676): No heartbeat from core client for 30 sec - exiting 03:41:06 (5676): No heartbeat from core client for 30 sec - exiting 03:41:07 (5676): No heartbeat from core client for 30 sec - exiting 03:41:08 (5676): No heartbeat from core client for 30 sec - exiting 03:41:10 (5676): No heartbeat from core client for 30 sec - exiting 03:41:11 (5676): No heartbeat from core client for 30 sec - exiting 03:41:12 (5676): No heartbeat from core client for 30 sec - exiting 03:41:13 (5676): No heartbeat from core client for 30 sec - exiting 03:41:14 (5676): No heartbeat from core client for 30 sec - exiting 03:41:15 (5676): No heartbeat from core client for 30 sec - exiting 03:41:16 (5676): No heartbeat from core client for 30 sec - exiting 03:41:17 (5676): No heartbeat from core client for 30 sec - exiting 03:41:18 (5676): No heartbeat from core client for 30 sec - exiting 03:41:19 (5676): No heartbeat from core client for 30 sec - exiting 03:41:20 (5676): No heartbeat from core client for 30 sec - exiting 03:41:22 (5676): No heartbeat from core client for 30 sec - exiting 03:41:23 (5676): No heartbeat from core client for 30 sec - exiting 03:41:24 (5676): No heartbeat from core client for 30 sec - exiting 03:41:25 (5676): No heartbeat from core client for 30 sec - exiting 03:41:26 (5676): No heartbeat from core client for 30 sec - exiting 03:41:27 (5676): No heartbeat from core client for 30 sec - exiting 03:41:28 (5676): No heartbeat from core client for 30 sec - exiting 03:41:29 (5676): No heartbeat from core client for 30 sec - exiting 03:41:30 (5676): No heartbeat from core client for 30 sec - exiting 03:41:31 (5676): No heartbeat from core client for 30 sec - exiting 03:41:32 (5676): No heartbeat from core client for 30 sec - exiting 03:41:34 (5676): No heartbeat from core client for 30 sec - exiting 03:41:35 (5676): No heartbeat from core client for 30 sec - exiting 03:41:36 (5676): No heartbeat from core client for 30 sec - exiting 03:41:37 (5676): No heartbeat from core client for 30 sec - exiting 03:41:38 (5676): No heartbeat from core client for 30 sec - exiting 03:41:39 (5676): No heartbeat from core client for 30 sec - exiting 03:41:40 (5676): No heartbeat from core client for 30 sec - exiting 03:41:41 (5676): No heartbeat from core client for 30 sec - exiting 03:41:42 (5676): No heartbeat from core client for 30 sec - exiting 03:41:43 (5676): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2208, selfPID=912, iMonCtr=1 No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2208, selfPID=2208, iMonCtr=1 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4732, selfPID=3884, iMonCtr=1 Model crash detected, will try to restart... 02:05:52 (4408): No heartbeat from core client for 30 sec - exiting 02:05:53 (4408): No heartbeat from core client for 30 sec - exiting 02:05:55 (4408): No heartbeat from core client for 30 sec - exiting 02:05:56 (4408): No heartbeat from core client for 30 sec - exiting 02:05:57 (4408): No heartbeat from core client for 30 sec - exiting 02:05:58 (4408): No heartbeat from core client for 30 sec - exiting 02:05:59 (4408): No heartbeat from core client for 30 sec - exiting 02:06:00 (4408): No heartbeat from core client for 30 sec - exiting 02:06:01 (4408): No heartbeat from core client for 30 sec - exiting 02:06:02 (4408): No heartbeat from core client for 30 sec - exiting 02:06:03 (4408): No heartbeat from core client for 30 sec - exiting 02:06:04 (4408): No heartbeat from core client for 30 sec - exiting 02:06:05 (4408): No heartbeat from core client for 30 sec - exiting 02:06:07 (4408): No heartbeat from core client for 30 sec - exiting 02:06:08 (4408): No heartbeat from core client for 30 sec - exiting 02:06:09 (4408): No heartbeat from core client for 30 sec - exiting 02:06:10 (4408): No heartbeat from core client for 30 sec - exiting 02:06:11 (4408): No heartbeat from core client for 30 sec - exiting 02:06:12 (4408): No heartbeat from core client for 30 sec - exiting 02:06:13 (4408): No heartbeat from core client for 30 sec - exiting 02:06:14 (4408): No heartbeat from core client for 30 sec - exiting 02:06:15 (4408): No heartbeat from core client for 30 sec - exiting 02:06:16 (4408): No heartbeat from core client for 30 sec - exiting 02:06:18 (4408): No heartbeat from core client for 30 sec - exiting 02:06:19 (4408): No heartbeat from core client for 30 sec - exiting 02:06:20 (4408): No heartbeat from core client for 30 sec - exiting 02:06:21 (4408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... forrtl: Access is denied. forrtl: Access is denied. forrtl: severe (38): error during write, unit 8, file C:\ProgramData\BOINC\projects\climateprediction.net\hadam3p_eu_2q5b_1970_1_007229097\tmp\xaakm.pipe_dummy Image PC Routine Line Source hadam3p_eu_um_6.0 006DA39A Unknown Unknown Unknown hadam3p_eu_um_6.0 00682CD0 Unknown Unknown Unknown hadam3p_eu_um_6.0 00681E9A Unknown Unknown Unknown hadam3p_eu_um_6.0 0065AA9D Unknown Unknown Unknown hadam3p_eu_um_6.0 005FF27C Unknown Unknown Unknown hadam3p_eu_um_6.0 00379BD2 Unknown Unknown Unknown hadam3p_eu_um_6.0 006BE638 Unknown Unknown Unknown kernel32.dll 76C5ECCB Unknown Unknown Unknown ntdll.dll 7790D80D Unknown Unknown Unknown ntdll.dll 7790DA1F Unknown Unknown Unknown forrtl: severe (38): error during write, unit 8, file C:\ProgramData\BOINC\projects\climateprediction.net\hadam3p_eu_2q5b_1970_1_007229097\tmp\xaakg.pipe_dummy Image PC Routine Line Source hadrm3p_eu_um_6.0 0115C52A Unknown Unknown Unknown hadrm3p_eu_um_6.0 01104460 Unknown Unknown Unknown hadrm3p_eu_um_6.0 0110362A Unknown Unknown Unknown hadrm3p_eu_um_6.0 010DA6ED Unknown Unknown Unknown hadrm3p_eu_um_6.0 01083551 Unknown Unknown Unknown hadrm3p_eu_um_6.0 00E29860 Unknown Unknown Unknown hadrm3p_eu_um_6.0 01140893 Unknown Unknown Unknown kernel32.dll 76C5ECCB Unknown Unknown Unknown ntdll.dll 7790D80D Unknown Unknown Unknown ntdll.dll 7790DA1F Unknown Unknown Unknown Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1180, selfPID=4388, iMonCtr=1 Model crash detected, will try to restart... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1180, selfPID=1180, iMonCtr=2 Leaving CPDN_Main::Monitor... No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3756, iMonCtr=2 Called boinc_finish </stderr_txt> <message> <file_xfer_error> <file_name>hadam3p_eu_2q5b_1970_1_007229097_2_6.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_2q5b_1970_1_007229097_2_7.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_2q5b_1970_1_007229097_2_8.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_2q5b_1970_1_007229097_2_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_2q5b_1970_1_007229097_2_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_2q5b_1970_1_007229097_2_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_2q5b_1970_1_007229097_2_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
25 Jul 2011 16:19:41	1055935	12971937	hadam3p_eu_2q5b_1970_1_007229097_2	57,696	220,612	3.8237
03 Jul 2011 22:01:06	1055935	12971937	hadam3p_eu_2q5b_1970_1_007229097_2	46,176	178,776	3.8716
03 Jul 2011 11:25:57	1055935	12971937	hadam3p_eu_2q5b_1970_1_007229097_2	34,656	141,835	4.0927
26 Jun 2011 13:51:16	1055935	12971937	hadam3p_eu_2q5b_1970_1_007229097_2	23,136	94,749	4.0953
26 Jun 2011 04:54:47	1055935	12971937	hadam3p_eu_2q5b_1970_1_007229097_2	11,616	52,382	4.5095