Task 17594208

Name	hadam3p_anz_m6vp_2012_1_009307947_0
Workunit	9392135
Created	17 Dec 2014, 19:58:54 UTC
Sent	17 Dec 2014, 19:59:16 UTC
Report deadline	30 Nov 2015, 1:19:16 UTC
Received	7 Feb 2015, 12:13:22 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1298359
Run time	5 days 0 hours 26 min 38 sec
CPU time	4 days 0 hours 2 min 49 sec
Validate state	Invalid
Credit	3,486.50
Device peak FLOPS	3.51 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.2.47</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... 10:19:25 (81172): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:31:13 (6216): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:48:29 (5100): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:30:15 (2572): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2488, selfPID=5520, iMonCtr=1 Model crash detected, will try to restart... 17:02:55 (6268): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:56:16 (7808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:42:33 (5704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:02:14 (7080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:43:04 (5088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:03:31 (1620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:10:26 (10244): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:10:27 (10244): No heartbeat from core client for 30 sec - exiting 12:12:56 (9808): No heartbeat from core client for 30 sec - exiting 12:12:57 (9808): No heartbeat from core client for 30 sec - exiting 12:12:58 (9808): No heartbeat from core client for 30 sec - exiting 12:12:59 (9808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:18:03 (7616): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9928, selfPID=9928, iMonCtr=2 18:49:41 (11904): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:14:31 (10956): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:32:11 (2748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:58:54 (9684): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:55:22 (4440): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:55:23 (4440): No heartbeat from core client for 30 sec - exiting 04:55:24 (4440): No heartbeat from core client for 30 sec - exiting 06:15:39 (1484): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:34:54 (11668): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:24:50 (6468): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:24:51 (6468): No heartbeat from core client for 30 sec - exiting 11:31:27 (1984): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:31:28 (1984): No heartbeat from core client for 30 sec - exiting 11:31:31 (1984): No heartbeat from core client for 30 sec - exiting 11:31:32 (1984): No heartbeat from core client for 30 sec - exiting 11:31:34 (1984): No heartbeat from core client for 30 sec - exiting 11:31:37 (1984): No heartbeat from core client for 30 sec - exiting 11:31:38 (1984): No heartbeat from core client for 30 sec - exiting 13:47:48 (5360): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:33:18 (10852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:33:19 (10852): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 21:23:20 (3680): No heartbeat from core client for 30 sec - exiting 21:23:21 (3680): No heartbeat from core client for 30 sec - exiting 21:23:24 (3680): No heartbeat from core client for 30 sec - exiting 21:23:25 (3680): No heartbeat from core client for 30 sec - exiting 21:23:27 (3680): No heartbeat from core client for 30 sec - exiting 21:23:30 (3680): No heartbeat from core client for 30 sec - exiting 21:23:31 (3680): No heartbeat from core client for 30 sec - exiting 21:23:33 (3680): No heartbeat from core client for 30 sec - exiting 21:23:36 (3680): No heartbeat from core client for 30 sec - exiting 21:23:37 (3680): No heartbeat from core client for 30 sec - exiting 21:23:39 (3680): No heartbeat from core client for 30 sec - exiting 21:23:42 (3680): No heartbeat from core client for 30 sec - exiting 21:23:45 (3680): No heartbeat from core client for 30 sec - exiting 21:23:46 (3680): No heartbeat from core client for 30 sec - exiting 21:23:47 (3680): No heartbeat from core client for 30 sec - exiting 21:23:50 (3680): No heartbeat from core client for 30 sec - exiting 21:23:51 (3680): No heartbeat from core client for 30 sec - exiting 21:23:52 (3680): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:53:33 (12112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:05:43 (7556): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:02:19 (3408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:12:54 (11268): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:16:18 (13244): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:37:14 (8660): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:14:29 (12908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:37:50 (17884): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:55:58 (25920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:20:31 (19100): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:39:18 (4816): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:19:55 (24660): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:55:12 (14872): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:24:13 (2868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:00:40 (14796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:32:12 (25116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:23:42 (14216): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:02:36 (5620): No heartbeat from core client for 30 sec - exiting 11:02:38 (5620): No heartbeat from core client for 30 sec - exiting 11:02:39 (5620): No heartbeat from core client for 30 sec - exiting 11:02:40 (5620): No heartbeat from core client for 30 sec - exiting 11:02:41 (5620): No heartbeat from core client for 30 sec - exiting 11:02:42 (5620): No heartbeat from core client for 30 sec - exiting 11:02:43 (5620): No heartbeat from core client for 30 sec - exiting 11:02:44 (5620): No heartbeat from core client for 30 sec - exiting 11:02:45 (5620): No heartbeat from core client for 30 sec - exiting 11:02:46 (5620): No heartbeat from core client for 30 sec - exiting 11:02:47 (5620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:42:03 (14256): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:42:04 (14256): No heartbeat from core client for 30 sec - exiting 17:42:05 (14256): No heartbeat from core client for 30 sec - exiting 18:05:17 (9112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:30:24 (14712): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:25:29 (22368): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:25:49 (22368): No heartbeat from core client for 30 sec - exiting 23:36:49 (20732): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:07:25 (15924): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:07:26 (15924): No heartbeat from core client for 30 sec - exiting 01:27:41 (13888): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:40:34 (18652): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 08:18:38 (15876): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:53:29 (27428): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:36:39 (16132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:13:45 (12132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:21:21 (34624): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 07:49:14 (21744): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:06:49 (35312): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:25:00 (30872): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:07:08 (37296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=38132, iMonCtr=1 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=36476, selfPID=38396, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish 12:09:46 (38396): No heartbeat from core client for 30 sec - exiting </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_anz_m6vp_2012_1_009307947_0_8.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_m6vp_2012_1_009307947_0_9.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_m6vp_2012_1_009307947_0_10.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_m6vp_2012_1_009307947_0_11.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_m6vp_2012_1_009307947_0_12.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
06 Feb 2015 20:28:19	1298359	17594208	hadam3p_anz_m6vp_2012_1_009307947_0	80,843	309,558	3.8291
04 Feb 2015 11:05:43	1298359	17594208	hadam3p_anz_m6vp_2012_1_009307947_0	69,419	267,429	3.8524
03 Feb 2015 17:52:26	1298359	17594208	hadam3p_anz_m6vp_2012_1_009307947_0	57,899	224,162	3.8716
02 Feb 2015 21:30:10	1298359	17594208	hadam3p_anz_m6vp_2012_1_009307947_0	46,379	179,645	3.8734
02 Feb 2015 03:17:43	1298359	17594208	hadam3p_anz_m6vp_2012_1_009307947_0	34,859	135,480	3.8865
01 Feb 2015 12:18:44	1298359	17594208	hadam3p_anz_m6vp_2012_1_009307947_0	23,339	91,909	3.9380
31 Jan 2015 19:38:47	1298359	17594208	hadam3p_anz_m6vp_2012_1_009307947_0	11,819	48,518	4.1051