Task 15012108

Name	hadam3p_pnw_b31r_1992_1_008095637_0
Workunit	8250751
Created	27 Jul 2012, 7:41:10 UTC
Sent	27 Jul 2012, 7:46:01 UTC
Report deadline	9 Jul 2013, 13:06:01 UTC
Received	30 Jul 2012, 10:32:12 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1229481
Run time	19 hours 38 min 8 sec
CPU time	17 hours 22 min 37 sec
Validate state	Invalid
Credit	252.40
Device peak FLOPS	2.94 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v6.09 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:50:16 (3424): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:50:17 (3424): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5704, selfPID=205780, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 0 14:03:28 (4024): No heartbeat from core client for 30 sec - exiting 14:03:30 (4024): No heartbeat from core client for 30 sec - exiting 14:03:31 (4024): No heartbeat from core client for 30 sec - exiting 14:03:32 (4024): No heartbeat from core client for 30 sec - exiting 14:03:33 (4024): No heartbeat from core client for 30 sec - exiting 14:03:34 (4024): No heartbeat from core client for 30 sec - exiting 14:03:35 (4024): No heartbeat from core client for 30 sec - exiting 14:03:36 (4024): No heartbeat from core client for 30 sec - exiting 14:03:37 (4024): No heartbeat from core client for 30 sec - exiting 14:03:38 (4024): No heartbeat from core client for 30 sec - exiting 14:03:39 (4024): No heartbeat from core client for 30 sec - exiting 14:03:41 (4024): No heartbeat from core client for 30 sec - exiting 14:03:42 (4024): No heartbeat from core client for 30 sec - exiting 14:03:43 (4024): No heartbeat from core client for 30 sec - exiting 14:03:44 (4024): No heartbeat from core client for 30 sec - exiting 14:03:45 (4024): No heartbeat from core client for 30 sec - exiting 14:03:46 (4024): No heartbeat from core client for 30 sec - exiting 14:03:47 (4024): No heartbeat from core client for 30 sec - exiting 14:03:48 (4024): No heartbeat from core client for 30 sec - exiting 14:03:49 (4024): No heartbeat from core client for 30 sec - exiting 14:03:50 (4024): No heartbeat from core client for 30 sec - exiting 14:03:51 (4024): No heartbeat from core client for 30 sec - exiting 14:03:53 (4024): No heartbeat from core client for 30 sec - exiting 14:03:54 (4024): No heartbeat from core client for 30 sec - exiting 14:03:55 (4024): No heartbeat from core client for 30 sec - exiting 14:03:56 (4024): No heartbeat from core client for 30 sec - exiting 14:03:57 (4024): No heartbeat from core client for 30 sec - exiting 14:03:58 (4024): No heartbeat from core client for 30 sec - exiting 14:03:59 (4024): No heartbeat from core client for 30 sec - exiting 14:04:00 (4024): No heartbeat from core client for 30 sec - exiting 14:04:01 (4024): No heartbeat from core client for 30 sec - exiting 14:04:02 (4024): No heartbeat from core client for 30 sec - exiting 14:04:03 (4024): No heartbeat from core client for 30 sec - exiting 14:04:05 (4024): No heartbeat from core client for 30 sec - exiting 14:04:06 (4024): No heartbeat from core client for 30 sec - exiting 14:04:07 (4024): No heartbeat from core client for 30 sec - exiting 14:04:08 (4024): No heartbeat from core client for 30 sec - exiting 14:04:09 (4024): No heartbeat from core client for 30 sec - exiting 14:04:10 (4024): No heartbeat from core client for 30 sec - exiting 14:04:11 (4024): No heartbeat from core client for 30 sec - exiting 14:04:12 (4024): No heartbeat from core client for 30 sec - exiting 14:04:13 (4024): No heartbeat from core client for 30 sec - exiting 14:04:14 (4024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3388, selfPID=3392, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=208, selfPID=4552, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 1 08:30:52 (3512): No heartbeat from core client for 30 sec - exiting 08:30:53 (3512): No heartbeat from core client for 30 sec - exiting 08:30:55 (3512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:08:31 (3448): No heartbeat from core client for 30 sec - exiting 21:08:32 (3448): No heartbeat from core client for 30 sec - exiting 21:08:33 (3448): No heartbeat from core client for 30 sec - exiting 21:08:34 (3448): No heartbeat from core client for 30 sec - exiting 21:08:35 (3448): No heartbeat from core client for 30 sec - exiting 21:08:36 (3448): No heartbeat from core client for 30 sec - exiting 21:08:37 (3448): No heartbeat from core client for 30 sec - exiting 21:08:38 (3448): No heartbeat from core client for 30 sec - exiting 21:08:40 (3448): No heartbeat from core client for 30 sec - exiting 21:08:41 (3448): No heartbeat from core client for 30 sec - exiting 21:08:42 (3448): No heartbeat from core client for 30 sec - exiting 21:08:43 (3448): No heartbeat from core client for 30 sec - exiting 21:08:44 (3448): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:32:17 (3876): No heartbeat from core client for 30 sec - exiting 09:32:18 (3876): No heartbeat from core client for 30 sec - exiting 09:32:19 (3876): No heartbeat from core client for 30 sec - exiting 09:32:20 (3876): No heartbeat from core client for 30 sec - exiting 09:32:21 (3876): No heartbeat from core client for 30 sec - exiting 09:32:22 (3876): No heartbeat from core client for 30 sec - exiting 09:32:23 (3876): No heartbeat from core client for 30 sec - exiting 09:32:24 (3876): No heartbeat from core client for 30 sec - exiting 09:32:26 (3876): No heartbeat from core client for 30 sec - exiting 09:32:27 (3876): No heartbeat from core client for 30 sec - exiting 09:32:28 (3876): No heartbeat from core client for 30 sec - exiting 09:32:29 (3876): No heartbeat from core client for 30 sec - exiting 09:32:30 (3876): No heartbeat from core client for 30 sec - exiting 09:32:31 (3876): No heartbeat from core client for 30 sec - exiting 09:32:32 (3876): No heartbeat from core client for 30 sec - exiting 09:32:33 (3876): No heartbeat from core client for 30 sec - exiting 09:32:34 (3876): No heartbeat from core client for 30 sec - exiting 09:32:35 (3876): No heartbeat from core client for 30 sec - exiting 09:32:36 (3876): No heartbeat from core client for 30 sec - exiting 09:32:38 (3876): No heartbeat from core client for 30 sec - exiting 09:32:39 (3876): No heartbeat from core client for 30 sec - exiting 09:32:40 (3876): No heartbeat from core client for 30 sec - exiting 09:32:41 (3876): No heartbeat from core client for 30 sec - exiting 09:32:42 (3876): No heartbeat from core client for 30 sec - exiting 09:32:43 (3876): No heartbeat from core client for 30 sec - exiting 09:32:44 (3876): No heartbeat from core client for 30 sec - exiting 09:32:45 (3876): No heartbeat from core client for 30 sec - exiting 09:32:46 (3876): No heartbeat from core client for 30 sec - exiting 09:32:47 (3876): No heartbeat from core client for 30 sec - exiting 09:32:48 (3876): No heartbeat from core client for 30 sec - exiting 09:32:50 (3876): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:32:51 (3876): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Model crashed: REPLANCA: PP HEADERS ON ANCILLARY FILE DO NOT MATCH tmp/xaakm.pipe_dummy 2048 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4572, selfPID=4572, iMonCtr=2 Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 1 Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_pnw_b31r_1992_1_008095637_0_2.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_b31r_1992_1_008095637_0_3.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_b31r_1992_1_008095637_0_4.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_b31r_1992_1_008095637_0_5.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_b31r_1992_1_008095637_0_6.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_b31r_1992_1_008095637_0_7.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_b31r_1992_1_008095637_0_8.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_b31r_1992_1_008095637_0_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_b31r_1992_1_008095637_0_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_b31r_1992_1_008095637_0_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_b31r_1992_1_008095637_0_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
27 Jul 2012 23:32:18	1229481	15012108	hadam3p_pnw_b31r_1992_1_008095637_0	11,616	30,876	2.6581