Task 14720254

Name	hadam3p_eu_csx6_2003_1_007995627_1
Workunit	8150741
Created	18 May 2012, 22:51:08 UTC
Sent	18 May 2012, 22:56:59 UTC
Report deadline	1 May 2013, 4:16:59 UTC
Received	5 Jun 2012, 21:28:25 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1214423
Run time	9 days 16 hours 41 min 30 sec
CPU time	4 days 14 hours 22 min 26 sec
Validate state	Invalid
Credit	1,392.75
Device peak FLOPS	1.97 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Europe v6.09 windows_intelx86
Stderr	<core_client_version>7.0.25</core_client_version> <![CDATA[ <stderr_txt> Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5912, selfPID=4200, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... 23:37:36 (4384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:37:37 (4384): No heartbeat from core client for 30 sec - exiting 23:37:38 (4384): No heartbeat from core client for 30 sec - exiting 23:37:39 (4384): No heartbeat from core client for 30 sec - exiting 23:37:40 (4384): No heartbeat from core client for 30 sec - exiting 23:37:41 (4384): No heartbeat from core client for 30 sec - exiting 23:37:42 (4384): No heartbeat from core client for 30 sec - exiting 23:37:43 (4384): No heartbeat from core client for 30 sec - exiting 23:37:44 (4384): No heartbeat from core client for 30 sec - exiting 23:37:45 (4384): No heartbeat from core client for 30 sec - exiting 23:37:46 (4384): No heartbeat from core client for 30 sec - exiting 23:38:01 (5580): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:38:02 (5580): No heartbeat from core client for 30 sec - exiting 23:38:03 (5580): No heartbeat from core client for 30 sec - exiting 23:46:46 (3272): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3600, selfPID=3600, iMonCtr=2 23:54:25 (884): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:54:26 (884): No heartbeat from core client for 30 sec - exiting 23:54:27 (884): No heartbeat from core client for 30 sec - exiting Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3360, selfPID=3360, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6100, selfPID=4396, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4928, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 05:56:08 (3888): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:56:09 (3888): No heartbeat from core client for 30 sec - exiting 05:56:10 (3888): No heartbeat from core client for 30 sec - exiting 05:56:11 (3888): No heartbeat from core client for 30 sec - exiting 05:56:12 (3888): No heartbeat from core client for 30 sec - exiting 05:56:13 (3888): No heartbeat from core client for 30 sec - exiting 05:56:14 (3888): No heartbeat from core client for 30 sec - exiting 05:56:15 (3888): No heartbeat from core client for 30 sec - exiting 05:56:16 (3888): No heartbeat from core client for 30 sec - exiting 05:56:17 (3888): No heartbeat from core client for 30 sec - exiting 05:56:18 (3888): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2532, selfPID=4300, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Precis Restart file copy #1 failed on csx6ga.dak44p0 Atmos Restart file copy failed on atmos_restart.day Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4228, iMonCtr=2 Model crash detected, will try to restart... Atmos Restart file copy failed on csx6ma.dak44p0 Precis Restart file copy #1 failed on csx6ga.dak44p0 Atmos Restart file copy failed on atmos_restart.day Atmos Restart file copy failed on csx6ma.dak44q0 15:52:47 (4920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5556, selfPID=5556, iMonCtr=2 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3580, iMonCtr= 2 del crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4284, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3004, selfPID=4612, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4524, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6092, selfPID=6092, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3788, iMonCtr=2 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... 23:47:49 (4744): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 18:05:35 (2804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:05:36 (2804): No heartbeat from core client for 30 sec - exiting 18:05:37 (2804): No heartbeat from core client for 30 sec - exiting 18:05:38 (2804): No heartbeat from core client for 30 sec - exiting 18:05:39 (2804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 21:59:50 (4824): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3612, iMonCtr= 2 del crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4436, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_eu_csx6_2003_1_007995627_1_8.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_csx6_2003_1_007995627_1_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_csx6_2003_1_007995627_1_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_csx6_2003_1_007995627_1_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_csx6_2003_1_007995627_1_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
02 Jun 2012 22:38:53	1214423	14720254	hadam3p_eu_csx6_2003_1_007995627_1	80,736	386,598	4.7884
31 May 2012 08:09:20	1214423	14720254	hadam3p_eu_csx6_2003_1_007995627_1	69,216	331,167	4.7845
29 May 2012 18:56:07	1214423	14720254	hadam3p_eu_csx6_2003_1_007995627_1	57,696	275,424	4.7737
28 May 2012 12:24:15	1214423	14720254	hadam3p_eu_csx6_2003_1_007995627_1	46,176	220,901	4.7839
26 May 2012 14:07:30	1214423	14720254	hadam3p_eu_csx6_2003_1_007995627_1	34,656	160,169	4.6217
25 May 2012 12:28:05	1214423	14720254	hadam3p_eu_csx6_2003_1_007995627_1	23,136	106,569	4.6062
24 May 2012 01:14:26	1214423	14720254	hadam3p_eu_csx6_2003_1_007995627_1	11,616	53,028	4.5651