Task 12300751

Name	hadam3p_pnw_zskh_1976_1_007015545_0
Workunit	7218861
Created	24 Nov 2010, 14:59:38 UTC
Sent	14 Jan 2011, 14:34:07 UTC
Report deadline	27 Dec 2011, 19:54:07 UTC
Received	20 Feb 2011, 2:02:34 UTC
Server state	Over
Outcome	No reply
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1090679
Run time	2 days 8 hours 19 min 55 sec
CPU time	2 days 2 hours 46 min 56 sec
Validate state	Invalid
Credit	1,003.46
Device peak FLOPS	3.39 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v6.08 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6116, selfPID=6116, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6372, selfPID=6372, iMonCtr=2 CPDN Monitor - Quit request from BOINC... No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4928, selfPID=0, iMonCtr=1 No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4928, selfPID=4928, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1464, selfPID=1464, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2600, selfPID=2600, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7380, selfPID=7380, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5308, selfPID=5308, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4840, selfPID=4840, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6176, selfPID=6176, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 18:02:53 (7380): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:03:34 (1924): No heartbeat from core client for 30 sec - exiting 18:03:38 (1924): No heartbeat from core client for 30 sec - exiting 18:03:39 (1924): No heartbeat from core client for 30 sec - exiting 18:03:40 (1924): No heartbeat from core client for 30 sec - exiting 18:03:41 (1924): No heartbeat from core client for 30 sec - exiting 18:03:42 (1924): No heartbeat from core client for 30 sec - exiting 18:04:28 (1924): No heartbeat from core client for 30 sec - exiting 18:04:29 (1924): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6904, selfPID=6904, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 07:41:41 (4592): No heartbeat from core client for 30 sec - exiting 07:41:43 (4592): No heartbeat from core client for 30 sec - exiting 07:41:44 (4592): No heartbeat from core client for 30 sec - exiting 07:41:45 (4592): No heartbeat from core client for 30 sec - exiting 07:41:46 (4592): No heartbeat from core client for 30 sec - exiting 07:41:47 (4592): No heartbeat from core client for 30 sec - exiting 07:41:48 (4592): No heartbeat from core client for 30 sec - exiting 07:41:49 (4592): No heartbeat from core client for 30 sec - exiting 07:41:50 (4592): No heartbeat from core client for 30 sec - exiting 07:41:51 (4592): No heartbeat from core client for 30 sec - exiting 07:41:52 (4592): No heartbeat from core client for 30 sec - exiting 07:41:53 (4592): No heartbeat from core client for 30 sec - exiting 07:41:54 (4592): No heartbeat from core client for 30 sec - exiting 07:41:55 (4592): No heartbeat from core client for 30 sec - exiting 07:41:56 (4592): No heartbeat from core client for 30 sec - exiting 07:41:57 (4592): No heartbeat from core client for 30 sec - exiting 07:41:58 (4592): No heartbeat from core client for 30 sec - exiting 07:41:59 (4592): No heartbeat from core client for 30 sec - exiting 07:42:00 (4592): No heartbeat from core client for 30 sec - exiting 07:42:01 (4592): No heartbeat from core client for 30 sec - exiting 07:42:02 (4592): No heartbeat from core client for 30 sec - exiting 07:42:03 (4592): No heartbeat from core client for 30 sec - exiting 07:42:04 (4592): No heartbeat from core client for 30 sec - exiting 07:42:05 (4592): No heartbeat from core client for 30 sec - exiting 07:42:06 (4592): No heartbeat from core client for 30 sec - exiting 07:42:07 (4592): No heartbeat from core client for 30 sec - exiting 07:42:08 (4592): No heartbeat from core client for 30 sec - exiting 07:42:09 (4592): No heartbeat from core client for 30 sec - exiting 07:42:10 (4592): No heartbeat from core client for 30 sec - exiting 07:42:11 (4592): No heartbeat from core client for 30 sec - exiting 07:42:12 (4592): No heartbeat from core client for 30 sec - exiting 07:42:13 (4592): No heartbeat from core client for 30 sec - exiting 07:42:14 (4592): No heartbeat from core client for 30 sec - exiting 07:42:15 (4592): No heartbeat from core client for 30 sec - exiting 07:42:16 (4592): No heartbeat from core client for 30 sec - exiting 07:42:17 (4592): No heartbeat from core client for 30 sec - exiting 07:42:18 (4592): No heartbeat from core client for 30 sec - exiting 07:42:19 (4592): No heartbeat from core client for 30 sec - exiting 07:42:20 (4592): No heartbeat from core client for 30 sec - exiting 07:42:21 (4592): No heartbeat from core client for 30 sec - exiting 07:42:22 (4592): No heartbeat from core client for 30 sec - exiting 07:42:23 (4592): No heartbeat from core client for 30 sec - exiting 07:42:24 (4592): No heartbeat from core client for 30 sec - exiting 07:42:25 (4592): No heartbeat from core client for 30 sec - exiting 07:42:26 (4592): No heartbeat from core client for 30 sec - exiting 07:42:27 (4592): No heartbeat from core client for 30 sec - exiting 07:42:28 (4592): No heartbeat from core client for 30 sec - exiting 07:42:29 (4592): No heartbeat from core client for 30 sec - exiting 07:42:30 (4592): No heartbeat from core client for 30 sec - exiting 07:42:31 (4592): No heartbeat from core client for 30 sec - exiting 07:42:32 (4592): No heartbeat from core client for 30 sec - exiting 07:42:33 (4592): No heartbeat from core client for 30 sec - exiting 07:42:34 (4592): No heartbeat from core client for 30 sec - exiting 07:42:35 (4592): No heartbeat from core client for 30 sec - exiting 07:42:36 (4592): No heartbeat from core client for 30 sec - exiting 07:42:37 (4592): No heartbeat from core client for 30 sec - exiting 07:42:38 (4592): No heartbeat from core client for 30 sec - exiting 07:42:39 (4592): No heartbeat from core client for 30 sec - exiting 07:42:40 (4592): No heartbeat from core client for 30 sec - exiting 07:42:41 (4592): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=624, selfPID=624, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3284, selfPID=3284, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:48:38 (8904): No heartbeat from core client for 30 sec - exiting 08:49:13 (8904): No heartbeat from core client for 30 sec - exiting 08:49:14 (8904): No heartbeat from core client for 30 sec - exiting 08:49:15 (8904): No heartbeat from core client for 30 sec - exiting 08:49:16 (8904): No heartbeat from core client for 30 sec - exiting 08:49:17 (8904): No heartbeat from core client for 30 sec - exiting 08:49:18 (8904): No heartbeat from core client for 30 sec - exiting 08:49:19 (8904): No heartbeat from core client for 30 sec - exiting 08:49:20 (8904): No heartbeat from core client for 30 sec - exiting 08:49:21 (8904): No heartbeat from core client for 30 sec - exiting 08:49:22 (8904): No heartbeat from core client for 30 sec - exiting 08:49:23 (8904): No heartbeat from core client for 30 sec - exiting 08:49:24 (8904): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7220, selfPID=7220, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1828, selfPID=1828, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4656, selfPID=4656, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7252, selfPID=7252, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4804, selfPID=4804, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1572, selfPID=1572, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5764, selfPID=5764, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=7224, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=0, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8956, selfPID=504, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 4 18:50:27 (504): called boinc_finish </stderr_txt> <message> <file_xfer_error> <file_name>hadam3p_pnw_zskh_1976_1_007015545_0_5.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_zskh_1976_1_007015545_0_6.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_zskh_1976_1_007015545_0_7.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_zskh_1976_1_007015545_0_8.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_zskh_1976_1_007015545_0_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_zskh_1976_1_007015545_0_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_zskh_1976_1_007015545_0_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_zskh_1976_1_007015545_0_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
20 Feb 2011 02:06:23	1090679	12300751	hadam3p_pnw_zskh_1976_1_007015545_0	46,181	161,716	3.5018
20 Feb 2011 02:06:22	1090679	12300751	hadam3p_pnw_zskh_1976_1_007015545_0	46,176	161,309	3.4934
20 Feb 2011 02:06:22	1090679	12300751	hadam3p_pnw_zskh_1976_1_007015545_0	34,656	121,267	3.4992
20 Feb 2011 02:06:22	1090679	12300751	hadam3p_pnw_zskh_1976_1_007015545_0	23,141	79,239	3.4242
20 Feb 2011 02:06:22	1090679	12300751	hadam3p_pnw_zskh_1976_1_007015545_0	23,136	78,879	3.4094
30 Jan 2011 05:45:14	1090679	12300751	hadam3p_pnw_zskh_1976_1_007015545_0	11,616	37,278	3.2092