Task 17344994

Name	hadam3p_anz_rg4e_2012_1_008947473_2
Workunit	9091648
Created	4 Nov 2014, 11:04:01 UTC
Sent	4 Nov 2014, 11:04:30 UTC
Report deadline	17 Oct 2015, 16:24:30 UTC
Received	15 Nov 2014, 8:59:42 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1338045
Run time	4 days 2 hours 14 min 49 sec
CPU time	3 days 22 hours 56 min 16 sec
Validate state	Invalid
Credit	2,993.82
Device peak FLOPS	3.18 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.2.42</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:59:02 (54404): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:59:03 (54404): No heartbeat from core client for 30 sec - exiting 04:02:14 (51412): No heartbeat from core client for 30 sec - exiting 04:02:15 (51412): No heartbeat from core client for 30 sec - exiting 04:02:16 (51412): No heartbeat from core client for 30 sec - exiting 04:02:17 (51412): No heartbeat from core client for 30 sec - exiting 04:02:18 (51412): No heartbeat from core client for 30 sec - exiting 04:02:19 (51412): No heartbeat from core client for 30 sec - exiting 04:02:20 (51412): No heartbeat from core client for 30 sec - exiting 04:02:21 (51412): No heartbeat from core client for 30 sec - exiting 04:02:22 (51412): No heartbeat from core client for 30 sec - exiting 04:02:23 (51412): No heartbeat from core client for 30 sec - exiting 04:02:24 (51412): No heartbeat from core client for 30 sec - exiting 04:02:25 (51412): No heartbeat from core client for 30 sec - exiting 04:02:28 (51412): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:35:39 (49672): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:38:26 (57144): No heartbeat from core client for 30 sec - exiting 23:38:31 (57144): No heartbeat from core client for 30 sec - exiting 23:38:34 (57144): No heartbeat from core client for 30 sec - exiting 23:38:38 (57144): No heartbeat from core client for 30 sec - exiting 23:38:42 (57144): No heartbeat from core client for 30 sec - exiting 23:38:45 (57144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:40:56 (59504): No heartbeat from core client for 30 sec - exiting 23:41:33 (59504): No heartbeat from core client for 30 sec - exiting 23:41:36 (59504): No heartbeat from core client for 30 sec - exiting 23:41:40 (59504): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:51:39 (58376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 22:01:20 (1188): No heartbeat from core client for 30 sec - exiting 22:01:21 (1188): No heartbeat from core client for 30 sec - exiting 22:01:22 (1188): No heartbeat from core client for 30 sec - exiting 22:01:23 (1188): No heartbeat from core client for 30 sec - exiting 22:01:24 (1188): No heartbeat from core client for 30 sec - exiting 22:01:25 (1188): No heartbeat from core client for 30 sec - exiting 22:01:26 (1188): No heartbeat from core client for 30 sec - exiting 22:01:27 (1188): No heartbeat from core client for 30 sec - exiting 22:01:28 (1188): No heartbeat from core client for 30 sec - exiting 22:01:29 (1188): No heartbeat from core client for 30 sec - exiting 22:01:30 (1188): No heartbeat from core client for 30 sec - exiting 22:01:31 (1188): No heartbeat from core client for 30 sec - exiting 22:01:32 (1188): No heartbeat from core client for 30 sec - exiting 22:01:33 (1188): No heartbeat from core client for 30 sec - exiting 22:01:34 (1188): No heartbeat from core client for 30 sec - exiting 22:01:35 (1188): No heartbeat from core client for 30 sec - exiting 22:01:36 (1188): No heartbeat from core client for 30 sec - exiting 22:01:37 (1188): No heartbeat from core client for 30 sec - exiting 22:01:38 (1188): No heartbeat from core client for 30 sec - exiting 22:01:39 (1188): No heartbeat from core client for 30 sec - exiting 22:01:40 (1188): No heartbeat from core client for 30 sec - exiting 22:01:41 (1188): No heartbeat from core client for 30 sec - exiting 22:01:42 (1188): No heartbeat from core client for 30 sec - exiting 22:01:43 (1188): No heartbeat from core client for 30 sec - exiting 22:01:44 (1188): No heartbeat from core client for 30 sec - exiting 22:01:45 (1188): No heartbeat from core client for 30 sec - exiting 22:01:46 (1188): No heartbeat from core client for 30 sec - exiting 22:01:47 (1188): No heartbeat from core client for 30 sec - exiting 22:01:48 (1188): No heartbeat from core client for 30 sec - exiting 22:01:49 (1188): No heartbeat from core client for 30 sec - exiting 22:01:50 (1188): No heartbeat from core client for 30 sec - exiting 22:01:51 (1188): No heartbeat from core client for 30 sec - exiting 22:01:52 (1188): No heartbeat from core client for 30 sec - exiting 22:01:53 (1188): No heartbeat from core client for 30 sec - exiting 22:01:54 (1188): No heartbeat from core client for 30 sec - exiting 22:01:55 (1188): No heartbeat from core client for 30 sec - exiting 22:01:56 (1188): No heartbeat from core client for 30 sec - exiting 22:01:57 (1188): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 22:01:24 (12820): No heartbeat from core client for 30 sec - exiting 22:01:26 (12820): No heartbeat from core client for 30 sec - exiting 22:01:27 (12820): No heartbeat from core client for 30 sec - exiting 22:01:28 (12820): No heartbeat from core client for 30 sec - exiting 22:01:29 (12820): No heartbeat from core client for 30 sec - exiting 22:01:30 (12820): No heartbeat from core client for 30 sec - exiting 22:01:31 (12820): No heartbeat from core client for 30 sec - exiting 22:01:32 (12820): No heartbeat from core client for 30 sec - exiting 22:01:33 (12820): No heartbeat from core client for 30 sec - exiting 22:01:34 (12820): No heartbeat from core client for 30 sec - exiting 22:01:35 (12820): No heartbeat from core client for 30 sec - exiting 22:01:36 (12820): No heartbeat from core client for 30 sec - exiting 22:01:37 (12820): No heartbeat from core client for 30 sec - exiting 22:01:38 (12820): No heartbeat from core client for 30 sec - exiting 22:01:39 (12820): No heartbeat from core client for 30 sec - exiting 22:01:40 (12820): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 22:35:57 (29500): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:41:35 (27600): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:41:36 (27600): No heartbeat from core client for 30 sec - exiting 00:51:16 (29044): No heartbeat from core client for 30 sec - exiting 00:51:20 (29044): No heartbeat from core client for 30 sec - exiting 00:51:23 (29044): No heartbeat from core client for 30 sec - exiting 00:51:26 (29044): No heartbeat from core client for 30 sec - exiting 00:51:29 (29044): No heartbeat from core client for 30 sec - exiting 00:51:32 (29044): No heartbeat from core client for 30 sec - exiting 00:51:35 (29044): No heartbeat from core client for 30 sec - exiting 00:51:38 (29044): No heartbeat from core client for 30 sec - exiting 00:51:41 (29044): No heartbeat from core client for 30 sec - exiting 00:52:17 (29044): No heartbeat from core client for 30 sec - exiting 00:52:20 (29044): No heartbeat from core client for 30 sec - exiting 00:52:23 (29044): No heartbeat from core client for 30 sec - exiting 00:52:26 (29044): No heartbeat from core client for 30 sec - exiting 00:52:29 (29044): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:22:31 (28584): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:37:36 (28688): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:37:38 (28688): No heartbeat from core client for 30 sec - exiting 01:48:31 (27864): No heartbeat from core client for 30 sec - exiting 01:48:34 (27864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 02:49:26 (27928): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:54:27 (17400): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:54:30 (17400): No heartbeat from core client for 30 sec - exiting 03:14:31 (29788): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 04:51:07 (27544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:51:11 (27544): No heartbeat from core client for 30 sec - exiting 05:06:09 (30696): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:06:12 (30696): No heartbeat from core client for 30 sec - exiting 05:21:10 (27868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:21:12 (27868): No heartbeat from core client for 30 sec - exiting 05:34:34 (28324): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:34:35 (28324): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 22:36:11 (12696): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:36:12 (12696): No heartbeat from core client for 30 sec - exiting 00:53:44 (9988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/xaakg.pipe_dummy 2048 Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_anz_rg4e_2012_1_008947473_2_7.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_rg4e_2012_1_008947473_2_8.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_rg4e_2012_1_008947473_2_9.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_rg4e_2012_1_008947473_2_10.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_rg4e_2012_1_008947473_2_11.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_rg4e_2012_1_008947473_2_12.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
14 Nov 2014 12:08:26	1338045	17344994	hadam3p_anz_rg4e_2012_1_008947473_2	69,419	320,026	4.6101
12 Nov 2014 11:59:02	1338045	17344994	hadam3p_anz_rg4e_2012_1_008947473_2	57,899	267,143	4.6139
11 Nov 2014 07:04:18	1338045	17344994	hadam3p_anz_rg4e_2012_1_008947473_2	46,379	214,399	4.6228
09 Nov 2014 10:35:15	1338045	17344994	hadam3p_anz_rg4e_2012_1_008947473_2	34,859	161,337	4.6283
07 Nov 2014 14:19:28	1338045	17344994	hadam3p_anz_rg4e_2012_1_008947473_2	23,339	107,023	4.5856
06 Nov 2014 09:19:49	1338045	17344994	hadam3p_anz_rg4e_2012_1_008947473_2	11,819	54,270	4.5918