Task 16396253

Name	hadam3p_anz_n5t9_2012_1_008581221_0
Workunit	8727733
Created	25 Mar 2014, 19:06:23 UTC
Sent	26 Mar 2014, 12:34:40 UTC
Report deadline	8 Mar 2015, 17:54:40 UTC
Received	27 Apr 2014, 22:48:10 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1293439
Run time	5 days 2 hours 18 min 49 sec
CPU time	4 days 3 hours 55 min 23 sec
Validate state	Invalid
Credit	1,503.36
Device peak FLOPS	1.66 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <stderr_txt> Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2828, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3448, selfPID=2888, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2936, selfPID=2656, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 10:27:26 (5376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4180, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4080, selfPID=2548, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 09:43:31 (3032): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3288, selfPID=2392, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2844, selfPID=1000, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3792, selfPID=2204, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 22:03:42 (992): No heartbeat from core client for 30 sec - exiting 22:03:43 (992): No heartbeat from core client for 30 sec - exiting 22:03:44 (992): No heartbeat from core client for 30 sec - exiting 22:03:45 (992): No heartbeat from core client for 30 sec - exiting 22:03:46 (992): No heartbeat from core client for 30 sec - exiting 22:03:47 (992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:03:48 (992): No heartbeat from core client for 30 sec - exiting 22:03:49 (992): No heartbeat from core client for 30 sec - exiting 22:03:50 (992): No heartbeat from core client for 30 sec - exiting 22:03:51 (992): No heartbeat from core client for 30 sec - exiting 22:03:52 (992): No heartbeat from core client for 30 sec - exiting 22:03:53 (992): No heartbeat from core client for 30 sec - exiting Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5636, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5708, selfPID=4228, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2856, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2452, selfPID=4280, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3192, selfPID=2960, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4892, selfPID=4536, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1532, selfPID=3080, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 08:44:55 (4632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:44:56 (4632): No heartbeat from core client for 30 sec - exiting 08:44:57 (4632): No heartbeat from core client for 30 sec - exiting 08:44:58 (4632): No heartbeat from core client for 30 sec - exiting 08:44:59 (4632): No heartbeat from core client for 30 sec - exiting Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5476, selfPID=5476, iMonCtr=2 08:45:00 (4632): No heartbeat from core client for 30 sec - exiting 08:45:02 (4632): No heartbeat from core client for 30 sec - exiting GController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2772, selfPID=4820, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=304, selfPID=4004, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5264, selfPID=4424, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3592, selfPID=4672, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5388, selfPID=4468, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 18:25:23 (4356): No heartbeat from core client for 30 sec - exiting 18:25:24 (4356): No heartbeat from core client for 30 sec - exiting 18:25:25 (4356): No heartbeat from core client for 30 sec - exiting 18:25:26 (4356): No heartbeat from core client for 30 sec - exiting 18:25:28 (4356): No heartbeat from core client for 30 sec - exiting 18:25:29 (4356): No heartbeat from core client for 30 sec - exiting 18:25:30 (4356): No heartbeat from core client for 30 sec - exiting 18:25:31 (4356): No heartbeat from core client for 30 sec - exiting 18:25:33 (4356): No heartbeat from core client for 30 sec - exiting 18:25:34 (4356): No heartbeat from core client for 30 sec - exiting 18:25:35 (4356): No heartbeat from core client for 30 sec - exiting 18:25:36 (4356): No heartbeat from core client for 30 sec - exiting 18:25:37 (4356): No heartbeat from core client for 30 sec - exiting 18:25:38 (4356): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3912, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4932, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2488, selfPID=4912, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2724, selfPID=4664, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... GSuspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5008, selfPID=4804, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3336, selfPID=4440, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2792, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4848, selfPID=988, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1964, selfPID=4868, iMonCtr=1 Model crash detected, will try to restart... 12:29:12 (4376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4060, selfPID=4224, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5092, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=184, selfPID=5024, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_anz_n5t9_2012_1_008581221_0_4.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_n5t9_2012_1_008581221_0_5.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_n5t9_2012_1_008581221_0_6.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_n5t9_2012_1_008581221_0_7.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_n5t9_2012_1_008581221_0_8.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_n5t9_2012_1_008581221_0_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_n5t9_2012_1_008581221_0_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_n5t9_2012_1_008581221_0_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_n5t9_2012_1_008581221_0_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
22 Apr 2014 18:27:29	1293439	16396253	hadam3p_anz_n5t9_2012_1_008581221_0	34,859	298,550	8.5645
15 Apr 2014 07:23:45	1293439	16396253	hadam3p_anz_n5t9_2012_1_008581221_0	23,339	200,818	8.6044
02 Apr 2014 16:50:00	1293439	16396253	hadam3p_anz_n5t9_2012_1_008581221_0	11,819	104,162	8.8131