Task 14635892

Name	hadam3p_pnw_bnb4_1967_1_007916511_2
Workunit	8071623
Created	7 May 2012, 1:46:38 UTC
Sent	7 May 2012, 1:54:17 UTC
Report deadline	19 Apr 2013, 7:14:17 UTC
Received	28 May 2012, 22:52:00 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1064131
Run time	2 days 3 hours 59 min 56 sec
CPU time	2 days 2 hours 38 min 50 sec
Validate state	Invalid
Credit	502.72
Device peak FLOPS	2.33 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v6.09 windows_intelx86
Stderr	<core_client_version>6.10.18</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:24:27 (3648): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 12:45:09 (2324): No heartbeat from core client for 30 sec - exiting 12:45:10 (2324): No heartbeat from core client for 30 sec - exiting 12:45:11 (2324): No heartbeat from core client for 30 sec - exiting 12:45:13 (2324): No heartbeat from core client for 30 sec - exiting 12:45:14 (2324): No heartbeat from core client for 30 sec - exiting 12:45:15 (2324): No heartbeat from core client for 30 sec - exiting 12:45:16 (2324): No heartbeat from core client for 30 sec - exiting 12:45:17 (2324): No heartbeat from core client for 30 sec - exiting 12:45:19 (2324): No heartbeat from core client for 30 sec - exiting 12:45:20 (2324): No heartbeat from core client for 30 sec - exiting 12:45:21 (2324): No heartbeat from core client for 30 sec - exiting 12:45:22 (2324): No heartbeat from core client for 30 sec - exiting 12:45:23 (2324): No heartbeat from core client for 30 sec - exiting 12:45:25 (2324): No heartbeat from core client for 30 sec - exiting 12:45:26 (2324): No heartbeat from core client for 30 sec - exiting 12:45:27 (2324): No heartbeat from core client for 30 sec - exiting 12:45:28 (2324): No heartbeat from core client for 30 sec - exiting 12:45:30 (2324): No heartbeat from core client for 30 sec - exiting 12:45:31 (2324): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:47:24 (420): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:48:32 (4940): No heartbeat from core client for 30 sec - exiting 12:48:33 (4940): No heartbeat from core client for 30 sec - exiting 12:48:34 (4940): No heartbeat from core client for 30 sec - exiting 12:48:36 (4940): No heartbeat from core client for 30 sec - exiting 12:48:37 (4940): No heartbeat from core client for 30 sec - exiting 12:48:38 (4940): No heartbeat from core client for 30 sec - exiting 12:48:39 (4940): No heartbeat from core client for 30 sec - exiting 12:48:41 (4940): No heartbeat from core client for 30 sec - exiting 12:48:42 (4940): No heartbeat from core client for 30 sec - exiting 12:48:43 (4940): No heartbeat from core client for 30 sec - exiting 12:48:45 (4940): No heartbeat from core client for 30 sec - exiting 12:48:46 (4940): No heartbeat from core client for 30 sec - exiting 12:48:47 (4940): No heartbeat from core client for 30 sec - exiting 12:48:48 (4940): No heartbeat from core client for 30 sec - exiting 12:48:50 (4940): No heartbeat from core client for 30 sec - exiting 12:48:51 (4940): No heartbeat from core client for 30 sec - exiting 12:48:52 (4940): No heartbeat from core client for 30 sec - exiting 12:48:56 (4940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:49:53 (5736): No heartbeat from core client for 30 sec - exiting 12:49:54 (5736): No heartbeat from core client for 30 sec - exiting 12:49:56 (5736): No heartbeat from core client for 30 sec - exiting 12:49:57 (5736): No heartbeat from core client for 30 sec - exiting 12:49:58 (5736): No heartbeat from core client for 30 sec - exiting 12:49:59 (5736): No heartbeat from core client for 30 sec - exiting 12:50:01 (5736): No heartbeat from core client for 30 sec - exiting 12:50:02 (5736): No heartbeat from core client for 30 sec - exiting 12:50:03 (5736): No heartbeat from core client for 30 sec - exiting 12:50:04 (5736): No heartbeat from core client for 30 sec - exiting 12:50:06 (5736): No heartbeat from core client for 30 sec - exiting 12:50:07 (5736): No heartbeat from core client for 30 sec - exiting 12:50:08 (5736): No heartbeat from core client for 30 sec - exiting 12:50:09 (5736): No heartbeat from core client for 30 sec - exiting 12:50:11 (5736): No heartbeat from core client for 30 sec - exiting 12:50:12 (5736): No heartbeat from core client for 30 sec - exiting 12:50:13 (5736): No heartbeat from core client for 30 sec - exiting 12:50:14 (5736): No heartbeat from core client for 30 sec - exiting 12:50:16 (5736): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:52:04 (896): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:52:07 (896): No heartbeat from core client for 30 sec - exiting 13:07:42 (4280): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not 13:09:30 (4256): No heartbeat from core client for 30 sec - exiting 13:09:31 (4256): No heartbeat from core client for 30 sec - exiting 13:09:33 (4256): No heartbeat from core client for 30 sec - exiting 13:09:34 (4256): No heartbeat from core client for 30 sec - exiting 13:09:36 (4256): No heartbeat from core client for 30 sec - exiting 13:09:37 (4256): No heartbeat from core client for 30 sec - exiting 13:09:38 (4256): No heartbeat from core client for 30 sec - exiting 13:09:40 (4256): No heartbeat from core client for 30 sec - exiting 13:09:42 (4256): No heartbeat from core client for 30 sec - exiting 13:09:43 (4256): No heartbeat from core client for 30 sec - exiting 13:09:45 (4256): No heartbeat from core client for 30 sec - exiting 13:09:46 (4256): No heartbeat from core client for 30 sec - exiting 13:09:47 (4256): No heartbeat from core client for 30 sec - exiting 13:09:49 (4256): No heartbeat from core client for 30 sec - exiting 13:09:51 (4256): No heartbeat from core client for 30 sec - exiting 13:09:52 (4256): No heartbeat from core client for 30 sec - exiting 13:09:53 (4256): No heartbeat from core client for 30 sec - exiting 13:09:55 (4256): No heartbeat from core client for 30 sec - exiting 13:09:57 (4256): No heartbeat from core client for 30 sec - exiting 13:09:58 (4256): No heartbeat from core client for 30 sec - exiting 13:10:00 (4256): No heartbeat from core client for 30 sec - exiting 13:10:01 (4256): No heartbeat from core client for 30 sec - exiting 13:10:02 (4256): No heartbeat from core client for 30 sec - exiting 13:10:04 (4256): No heartbeat from core client for 30 sec - exiting 13:10:05 (4256): No heartbeat from core client for 30 sec - exiting 13:10:07 (4256): No heartbeat from core client for 30 sec - exiting 13:10:08 (4256): No heartbeat from core client for 30 sec - exiting 13:10:09 (4256): No heartbeat from core client for 30 sec - exiting 13:10:11 (4256): No heartbeat from core client for 30 sec - exiting 13:10:13 (4256): No heartbeat from core client for 30 sec - exiting 13:10:14 (4256): No heartbeat from core client for 30 sec - exiting 13:10:16 (4256): No heartbeat from core client for 30 sec - exiting 13:10:17 (4256): No heartbeat from core client for 30 sec - exiting 13:10:18 (4256): No heartbeat from core client for 30 sec - exiting 13:10:20 (4256): No heartbeat from core client for 30 sec - exiting 13:10:22 (4256): No heartbeat from core client for 30 sec - exiting 13:10:23 (4256): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:24:22 (5972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Work13:26:50 (3392): No heartbeat from core client for 30 sec - exiting 13:26:52 (3392): No heartbeat from core client for 30 sec - exiting 13:26:55 (3392): No heartbeat from core client for 30 sec - exiting 13:26:59 (3392): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:27:10 (3392): No heartbeat from core client for 30 sec - exiting 13:35:09 (4944): No heartbeat from core client for 30 sec - exiting 13:35:11 (4944): No heartbeat from core client for 30 sec - exiting 13:35:13 (4944): No heartbeat from core client for 30 sec - exiting 13:35:15 (4944): No heartbeat from core client for 30 sec - exiting 13:35:16 (4944): No heartbeat from core client for 30 sec - exiting 13:35:18 (4944): No heartbeat from core client for 30 sec - exiting 13:35:20 (4944): No heartbeat from core client for 30 sec - exiting 13:35:22 (4944): No heartbeat from core client for 30 sec - exiting 13:35:23 (4944): No heartbeat from core client for 30 sec - exiting 13:35:25 (4944): No heartbeat from core client for 30 sec - exiting 13:35:27 (4944): No heartbeat from core client for 30 sec - exiting 13:35:29 (4944): No heartbeat from core client for 30 sec - exiting 13:35:31 (4944): No heartbeat from core client for 30 sec - exiting 13:35:32 (4944): No heartbeat from core client for 30 sec - exiting 13:41:53 (4944): No heartbeat from core client for 30 sec - exiting 13:41:54 (4944): No heartbeat from core client for 30 sec - exiting 13:41:56 (4944): No heartbeat from core client for 30 sec - exiting 13:41:58 (4944): No heartbeat from core client for 30 sec - exiting 13:41:59 (4944): No heartbeat from core client for 30 sec - exiting 13:42:01 (4944): No heartbeat from core client for 30 sec - exiting 13:42:02 (4944): No heartbeat from core client for 30 sec - exiting 13:42:05 (4944): No heartbeat from core client for 30 sec - exiting 13:42:06 (4944): No heartbeat from core client for 30 sec - exiting 13:42:08 (4944): No heartbeat from core client for 30 sec - exiting 13:42:09 (4944): No heartbeat from core client for 30 sec - exiting 13:42:11 (4944): No heartbeat from core client for 30 sec - exiting 13:42:13 (4944): No heartbeat from core client for 30 sec - exiting 13:42:15 (4944): No heartbeat from core client for 30 sec - exiting 13:42:18 (4944): No heartbeat from core client for 30 sec - exiting 13:42:21 (4944): No heartbeat from core client for 30 sec - exiting 13:42:22 (4944): No heartbeat from core client for 30 sec - exiting 13:42:23 (4944): No heartbeat from core client for 30 sec - exiting 13:42:25 (4944): No heartbeat from core client for 30 sec - exiting 13:42:26 (4944): No heartbeat from core client for 30 sec - exiting 13:42:29 (4944): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:47:18 (3348): No heartbeat from core client for 30 sec - exiting 13:47:20 (3348): No heartbeat from core client for 30 sec - exiting 13:47:21 (3348): No heartbeat from core client for 30 sec - exiting 13:47:23 (3348): No heartbeat from core client for 30 sec - exiting 13:47:24 (3348): No heartbeat from core client for 30 sec - exiting 13:47:29 (3348): No heartbeat from core client for 30 sec - exiting 13:47:31 (3348): No heartbeat from core client for 30 sec - exiting 13:47:32 (3348): No heartbeat from core client for 30 sec - exiting 13:47:34 (3348): No heartbeat from core client for 30 sec - exiting 13:47:36 (3348): No heartbeat from core client for 30 sec - exiting 13:47:38 (3348): No heartbeat from core client for 30 sec - exiting 13:47:40 (3348): No heartbeat from core client for 30 sec - exiting 13:48:41 (3348): No heartbeat from core client for 30 sec - exiting 13:48:43 (3348): No heartbeat from core client for 30 sec - exiting 13:48:44 (3348): No heartbeat from core client for 30 sec - exiting 13:48:46 (3348): No heartbeat from core client for 30 sec - exiting 13:48:47 (3348): No heartbeat from core client for 30 sec - exiting 13:48:50 (3348): No heartbeat from core client for 30 sec - exiting 13:48:51 (3348): No heartbeat from core client for 30 sec - exiting 13:48:53 (3348): No heartbeat from core client for 30 sec - exiting 13:48:54 (3348): No heartbeat from core client for 30 sec - exiting 13:52:00 (3348): No heartbeat from core client for 30 sec - exiting 13:52:01 (3348): No heartbeat from core client for 30 sec - exiting 13:52:08 (3348): No heartbeat from core client for 30 sec - exiting 13:52:14 (3348): No heartbeat from core client for 30 sec - exiting 13:52:16 (3348): No heartbeat from core client for 30 sec - exiting 13:52:21 (3348): No heartbeat from core client for 30 sec - exiting 13:52:28 (3348): No heartbeat from core client for 30 sec - exiting 13:52:35 (3348): No heartbeat from core client for 30 sec - exiting 13:55:04 (3348): No heartbeat from core client for 30 sec - exiting 13:55:06 (3348): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:03:06 (5704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5424, selfPID=5424, iMonC14:04:30 (5540): No heartbeat from core client for 30 sec - exiting 14:04:31 (5540): No heartbeat from core client for 30 sec - exiting 14:04:32 (5540): No heartbeat from core client for 30 sec - exiting 14:04:34 (5540): No heartbeat from core client for 30 sec - exiting 14:04:36 (5540): No heartbeat from core client for 30 sec - exiting 14:04:37 (5540): No heartbeat from core client for 30 sec - exiting 14:04:38 (5540): No heartbeat from core client for 30 sec - exiting 14:04:40 (5540): No heartbeat from core client for 30 sec - exiting 14:04:42 (5540): No heartbeat from core client for 30 sec - exiting 14:04:44 (5540): No heartbeat from core client for 30 sec - exiting 14:04:45 (5540): No heartbeat from core client for 30 sec - exiting 14:04:47 (5540): No heartbeat from core client for 30 sec - exiting 14:04:48 (5540): No heartbeat from core client for 30 sec - exiting 14:04:50 (5540): No heartbeat from core client for 30 sec - exiting 14:04:51 (5540): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:19:50 (5984): No heartbeat from core client for 30 sec - exiting 14:19:51 (5984): No heartbeat from core client for 30 sec - exiting 14:19:52 (5984): No heartbeat from core client for 30 sec - exiting 14:19:55 (5984): No heartbeat from core client for 30 sec - exiting 14:19:57 (5984): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... forrtl: The requested operation cannot be performed on a file with a user-mapped section open. forrtl: severe (38): error during write, unit 6, file C:\Documents and Settings\All Users\Application Data\BOINC\projects\climateprediction.net\hadam3p_pnw_bnb4_1967_1_007916511\dataout\xaakg.out Image PC Routine Line Source hadrm3p_pnw_um_6. 0073C52A Unknown Unknown Unknown hadrm3p_pnw_um_6. 00739858 Unknown Unknown Unknown hadrm3p_pnw_um_6. 006E4460 Unknown Unknown Unknown hadrm3p_pnw_um_6. 006E362A Unknown Unknown Unknown hadrm3p_pnw_um_6. 006B59F1 Unknown Unknown Unknown hadrm3p_pnw_um_6. 006B28F5 Unknown Unknown Unknown hadrm3p_pnw_um_6. 00662ACE Unknown Unknown Unknown hadrm3p_pnw_um_6. 006635AF Unknown Unknown Unknown hadrm3p_pnw_um_6. 00409860 Unknown Unknown Unknown hadrm3p_pnw_um_6. 00720893 Unknown Unknown Unknown kernel32.dll 7C817077 Unknown Unknown Unknown Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5488, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 2 Called boinc_finish </stderr_txt> <message> <file_xfer_error> <file_name>hadam3p_pnw_bnb4_1967_1_007916511_2_3.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_bnb4_1967_1_007916511_2_4.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_bnb4_1967_1_007916511_2_5.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_bnb4_1967_1_007916511_2_6.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_bnb4_1967_1_007916511_2_7.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_bnb4_1967_1_007916511_2_8.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_bnb4_1967_1_007916511_2_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_bnb4_1967_1_007916511_2_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_bnb4_1967_1_007916511_2_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_bnb4_1967_1_007916511_2_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
21 May 2012 02:50:26	1064131	14635892	hadam3p_pnw_bnb4_1967_1_007916511_2	23,136	126,089	5.4499
15 May 2012 21:39:25	1064131	14635892	hadam3p_pnw_bnb4_1967_1_007916511_2	11,616	65,268	5.6188