Task 17665824

Name	hadam3p_anz_f2gy_2012_1_009296734_1
Workunit	9380922
Created	3 Jan 2015, 17:04:58 UTC
Sent	3 Jan 2015, 17:43:11 UTC
Report deadline	16 Dec 2015, 23:03:11 UTC
Received	31 Jan 2015, 9:30:15 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1345795
Run time	4 days 20 hours 18 min 11 sec
CPU time	4 days 9 hours 59 min 59 sec
Validate state	Invalid
Credit	3,490.64
Device peak FLOPS	3.61 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.4.27</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7712, selfPID=14164, iMonCtr=1 Suspended CPDN Monitor - Suspend request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=10596, selfPID=10456, iMonCtr=1 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2924, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5680, selfPID=9804, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7656, selfPID=3480, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4236, selfPID=8264, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:42:26 (8028): No heartbeat from core client for 30 sec - exiting 19:42:27 (8028): No heartbeat from core client for 30 sec - exiting 19:42:28 (8028): No heartbeat from core client for 30 sec - exiting 19:42:29 (8028): No heartbeat from core client for 30 sec - exiting 19:42:30 (8028): No heartbeat from core client for 30 sec - exiting 19:42:31 (8028): No heartbeat from core client for 30 sec - exiting 19:42:32 (8028): No heartbeat from core client for 30 sec - exiting 19:42:33 (8028): No heartbeat from core client for 30 sec - exiting 19:42:34 (8028): No heartbeat from core client for 30 sec - exiting 19:42:35 (8028): No heartbeat from core client for 30 sec - exiting 19:42:37 (8028): No heartbeat from core client for 30 sec - exiting 19:42:38 (8028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:17:53 (16160): No heartbeat from core client for 30 sec - exiting 19:17:54 (16160): No heartbeat from core client for 30 sec - exiting 19:17:55 (16160): No heartbeat from core client for 30 sec - exiting 19:17:56 (16160): No heartbeat from core client for 30 sec - exiting 19:17:58 (16160): No heartbeat from core client for 30 sec - exiting 19:17:59 (16160): No heartbeat from core client for 30 sec - exiting 19:18:00 (16160): No heartbeat from core client for 30 sec - exiting 19:18:01 (16160): No heartbeat from core client for 30 sec - exiting 19:18:02 (16160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 19:33:57 (8492): No heartbeat from core client for 30 sec - exiting 19:33:58 (8492): No heartbeat from core client for 30 sec - exiting 19:33:59 (8492): No heartbeat from core client for 30 sec - exiting 19:34:00 (8492): No heartbeat from core client for 30 sec - exiting 19:34:01 (8492): No heartbeat from core client for 30 sec - exiting 19:34:03 (8492): No heartbeat from core client for 30 sec - exiting 19:34:04 (8492): No heartbeat from core client for 30 sec - exiting 19:34:05 (8492): No heartbeat from core client for 30 sec - exiting 19:34:06 (8492): No heartbeat from core client for 30 sec - exiting 19:34:07 (8492): No heartbeat from core client for 30 sec - exiting 19:34:08 (8492): No heartbeat from core client for 30 sec - exiting 19:34:09 (8492): No heartbeat from core client for 30 sec - exiting 19:34:10 (8492): No heartbeat from core client for 30 sec - exiting 19:34:11 (8492): No heartbeat from core client for 30 sec - exiting 19:34:12 (8492): No heartbeat from core client for 30 sec - exiting 19:34:13 (8492): No heartbeat from core client for 30 sec - exiting 19:34:15 (8492): No heartbeat from core client for 30 sec - exiting 19:34:16 (8492): No heartbeat from core client for 30 sec - exiting 19:34:17 (8492): No heartbeat from core client for 30 sec - exiting 19:34:18 (8492): No heartbeat from core client for 30 sec - exiting 19:34:19 (8492): No heartbeat from core client for 30 sec - exiting 19:34:20 (8492): No heartbeat from core client for 30 sec - exiting 19:34:21 (8492): No heartbeat from core client for 30 sec - exiting 19:34:22 (8492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:31:47 (9108): No heartbeat from core client for 30 sec - exiting 08:31:48 (9108): No heartbeat from core client for 30 sec - exiting 08:31:49 (9108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1744, selfPID=1744, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1744, selfPID=4764, iMonCtr=1 18:12:21 (10604): No heartbeat from core client for 30 sec - exiting 18:12:22 (10604): No heartbeat from core client for 30 sec - exiting 18:12:23 (10604): No heartbeat from core client for 30 sec - exiting 18:12:25 (10604): No heartbeat from core client for 30 sec - exiting 18:12:26 (10604): No heartbeat from core client for 30 sec - exiting 18:12:27 (10604): No heartbeat from core client for 30 sec - exiting 18:12:28 (10604): No heartbeat from core client for 30 sec - exiting 18:12:29 (10604): No heartbeat from core client for 30 sec - exiting 18:12:30 (10604): No heartbeat from core client for 30 sec - exiting 18:12:31 (10604): No heartbeat from core client for 30 sec - exiting 18:12:32 (10604): No heartbeat from core client for 30 sec - exiting 18:12:33 (10604): No heartbeat from core client for 30 sec - exiting 18:12:34 (10604): No heartbeat from core client for 30 sec - exiting 18:12:35 (10604): No heartbeat from core client for 30 sec - exiting 18:12:37 (10604): No heartbeat from core client for 30 sec - exiting 18:12:38 (10604): No heartbeat from core client for 30 sec - exiting 18:12:39 (10604): No heartbeat from core client for 30 sec - exiting 18:12:40 (10604): No heartbeat from core client for 30 sec - exiting 18:12:41 (10604): No heartbeat from core client for 30 sec - exiting 18:12:42 (10604): No heartbeat from core client for 30 sec - exiting 18:12:43 (10604): No heartbeat from core client for 30 sec - exiting 18:12:44 (10604): No heartbeat from core client for 30 sec - exiting 18:12:45 (10604): No heartbeat from core client for 30 sec - exiting 18:12:46 (10604): No heartbeat from core client for 30 sec - exiting 18:12:47 (10604): No heartbeat from core client for 30 sec - exiting 18:12:49 (10604): No heartbeat from core client for 30 sec - exiting 18:12:50 (10604): No heartbeat from core client for 30 sec - exiting 18:12:51 (10604): No heartbeat from core client for 30 sec - exiting 18:12:52 (10604): No heartbeat from core client for 30 sec - exiting 18:12:53 (10604): No heartbeat from core client for 30 sec - exiting 18:12:54 (10604): No heartbeat from core client for 30 sec - exiting 18:12:55 (10604): No heartbeat from core client for 30 sec - exiting 18:12:56 (10604): No heartbeat from core client for 30 sec - exiting 18:12:57 (10604): No heartbeat from core client for 30 sec - exiting 18:12:58 (10604): No heartbeat from core client for 30 sec - exiting 18:12:59 (10604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:22:36 (8484): No heartbeat from core client for 30 sec - exiting 12:22:37 (8484): No heartbeat from core client for 30 sec - exiting 12:22:38 (8484): No heartbeat from core client for 30 sec - exiting 12:22:39 (8484): No heartbeat from core client for 30 sec - exiting 12:22:40 (8484): No heartbeat from core client for 30 sec - exiting 12:22:41 (8484): No heartbeat from core client for 30 sec - exiting 12:22:42 (8484): No heartbeat from core client for 30 sec - exiting 12:22:44 (8484): No heartbeat from core client for 30 sec - exiting 12:22:45 (8484): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:47:23 (3984): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=10080, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:52:49 (9868): No heartbeat from core client for 30 sec - exiting 10:52:50 (9868): No heartbeat from core client for 30 sec - exiting 10:52:51 (9868): No heartbeat from core client for 30 sec - exiting 10:52:52 (9868): No heartbeat from core client for 30 sec - exiting 10:52:53 (9868): No heartbeat from core client for 30 sec - exiting 10:52:54 (9868): No heartbeat from core client for 30 sec - exiting 10:52:55 (9868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 13:36:09 (10192): No heartbeat from core client for 30 sec - exiting 13:36:10 (10192): No heartbeat from core client for 30 sec - exiting 13:36:11 (10192): No heartbeat from core client for 30 sec - exiting 13:36:12 (10192): No heartbeat from core client for 30 sec - exiting 13:36:13 (10192): No heartbeat from core client for 30 sec - exiting 13:36:14 (10192): No heartbeat from core client for 30 sec - exiting 13:36:15 (10192): No heartbeat from core client for 30 sec - exiting 13:36:16 (10192): No heartbeat from core client for 30 sec - exiting 13:36:17 (10192): No heartbeat from core client for 30 sec - exiting 13:36:18 (10192): No heartbeat from core client for 30 sec - exiting 13:36:19 (10192): No heartbeat from core client for 30 sec - exiting 13:36:20 (10192): No heartbeat from core client for 30 sec - exiting 13:36:21 (10192): No heartbeat from core client for 30 sec - exiting 13:36:22 (10192): No heartbeat from core client for 30 sec - exiting 13:36:23 (10192): No heartbeat from core client for 30 sec - exiting 13:36:24 (10192): No heartbeat from core client for 30 sec - exiting 13:36:25 (10192): No heartbeat from core client for 30 sec - exiting 13:36:26 (10192): No heartbeat from core client for 30 sec - exiting 13:36:27 (10192): No heartbeat from core client for 30 sec - exiting 13:36:28 (10192): No heartbeat from core client for 30 sec - exiting 13:36:29 (10192): No heartbeat from core client for 30 sec - exiting 13:36:30 (10192): No heartbeat from core client for 30 sec - exiting 13:36:31 (10192): No heartbeat from core client for 30 sec - exiting 13:36:32 (10192): No heartbeat from core client for 30 sec - exiting 13:36:33 (10192): No heartbeat from core client for 30 sec - exiting 13:36:34 (10192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:21:59 (13080): No heartbeat from core client for 30 sec - exiting 21:22:00 (13080): No heartbeat from core client for 30 sec - exiting 21:22:01 (13080): No heartbeat from core client for 30 sec - exiting 21:22:02 (13080): No heartbeat from core client for 30 sec - exiting 21:22:03 (13080): No heartbeat from core client for 30 sec - exiting 21:22:04 (13080): No heartbeat from core client for 30 sec - exiting 21:22:05 (13080): No heartbeat from core client for 30 sec - exiting 21:22:06 (13080): No heartbeat from core client for 30 sec - exiting 21:22:07 (13080): No heartbeat from core client for 30 sec - exiting 21:22:08 (13080): No heartbeat from core client for 30 sec - exiting 21:22:09 (13080): No heartbeat from core client for 30 sec - exiting 21:22:10 (13080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6136, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2120, selfPID=6148, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3880, selfPID=3880, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 11:13:56 (6412): No heartbeat from core client for 30 sec - exiting 11:13:58 (6412): No heartbeat from core client for 30 sec - exiting 11:13:59 (6412): No heartbeat from core client for 30 sec - exiting 11:14:00 (6412): No heartbeat from core client for 30 sec - exiting 11:14:01 (6412): No heartbeat from core client for 30 sec - exiting 11:14:02 (6412): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4304, selfPID=3184, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5136, selfPID=2772, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=8824, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=0, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6748, selfPID=180, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_anz_f2gy_2012_1_009296734_1_8.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_f2gy_2012_1_009296734_1_9.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_f2gy_2012_1_009296734_1_10.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_f2gy_2012_1_009296734_1_11.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_f2gy_2012_1_009296734_1_12.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
30 Jan 2015 21:07:38	1345795	17665824	hadam3p_anz_f2gy_2012_1_009296734_1	80,939	380,407	4.6999
26 Jan 2015 22:30:48	1345795	17665824	hadam3p_anz_f2gy_2012_1_009296734_1	69,419	322,545	4.6464
24 Jan 2015 18:41:59	1345795	17665824	hadam3p_anz_f2gy_2012_1_009296734_1	57,899	269,531	4.6552
21 Jan 2015 20:17:34	1345795	17665824	hadam3p_anz_f2gy_2012_1_009296734_1	46,379	214,434	4.6235
17 Jan 2015 23:27:49	1345795	17665824	hadam3p_anz_f2gy_2012_1_009296734_1	34,859	161,711	4.6390
16 Jan 2015 14:33:32	1345795	17665824	hadam3p_anz_f2gy_2012_1_009296734_1	23,339	109,342	4.6849
13 Jan 2015 20:54:21	1345795	17665824	hadam3p_anz_f2gy_2012_1_009296734_1	11,819	56,846	4.8097