Task 16620283

Name	hadam3p_anz_r5i3_2012_1_008736745_0
Workunit	8882723
Created	8 May 2014, 18:58:54 UTC
Sent	17 May 2014, 2:00:46 UTC
Report deadline	29 Apr 2015, 7:20:46 UTC
Received	10 Jun 2014, 0:53:25 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1408374
Run time	5 days 9 hours 18 min 42 sec
CPU time	5 days 2 hours 37 min 7 sec
Validate state	Invalid
Credit	4,484.28
Device peak FLOPS	3.85 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 i686-pc-linux-gnu
Stderr	<core_client_version>7.2.42</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... 14:34:35 (5367): No heartbeat from core client for 30 sec - exiting 14:34:36 (5367): No heartbeat from core client for 30 sec - exiting 14:34:37 (5367): No heartbeat from core client for 30 sec - exiting 14:34:38 (5367): No heartbeat from core client for 30 sec - exiting 14:34:39 (5367): No heartbeat from core client for 30 sec - exiting 14:34:40 (5367): No heartbeat from core client for 30 sec - exiting 14:34:42 (5367): No heartbeat from core client for 30 sec - exiting 14:34:43 (5367): No heartbeat from core client for 30 sec - exiting 14:34:44 (5367): No heartbeat from core client for 30 sec - exiting 14:34:45 (5367): No heartbeat from core client for 30 sec - exiting 14:34:46 (5367): No heartbeat from core client for 30 sec - exiting 14:34:48 (5367): No heartbeat from core client for 30 sec - exiting 14:34:49 (5367): No heartbeat from core client for 30 sec - exiting 14:34:50 (5367): No heartbeat from core client for 30 sec - exiting 14:34:51 (5367): No heartbeat from core client for 30 sec - exiting 14:34:52 (5367): No heartbeat from core client for 30 sec - exiting 14:34:54 (5367): No heartbeat from core client for 30 sec - exiting 14:34:55 (5367): No heartbeat from core client for 30 sec - exiting 14:34:56 (5367): No heartbeat from core client for 30 sec - exiting 14:34:57 (5367): No heartbeat from core client for 30 sec - exiting 14:34:58 (5367): No heartbeat from core client for 30 sec - exiting 14:34:59 (5367): No heartbeat from core client for 30 sec - exiting 14:35:01 (5367): No heartbeat from core client for 30 sec - exiting 14:35:02 (5367): No heartbeat from core client for 30 sec - exiting 14:35:03 (5367): No heartbeat from core client for 30 sec - exiting 14:35:04 (5367): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:46:59 (5539): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:37:12 (5367): No heartbeat from core client for 30 sec - exiting 22:37:13 (5367): No heartbeat from core client for 30 sec - exiting 22:37:14 (5367): No heartbeat from core client for 30 sec - exiting 22:37:15 (5367): No heartbeat from core client for 30 sec - exiting 22:37:17 (5367): No heartbeat from core client for 30 sec - exiting 22:37:18 (5367): No heartbeat from core client for 30 sec - exiting 22:37:19 (5367): No heartbeat from core client for 30 sec - exiting 22:37:20 (5367): No heartbeat from core client for 30 sec - exiting 22:37:21 (5367): No heartbeat from core client for 30 sec - exiting 22:37:22 (5367): No heartbeat from core client for 30 sec - exiting 22:37:23 (5367): No heartbeat from core client for 30 sec - exiting 22:37:24 (5367): No heartbeat from core client for 30 sec - exiting 22:37:26 (5367): No heartbeat from core client for 30 sec - exiting 22:37:27 (5367): No heartbeat from core client for 30 sec - exiting 22:37:28 (5367): No heartbeat from core client for 30 sec - exiting 22:37:29 (5367): No heartbeat from core client for 30 sec - exiting 22:37:30 (5367): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 22:50:23 (5347): No heartbeat from core client for 30 sec - exiting 22:50:24 (5347): No heartbeat from core client for 30 sec - exiting 22:50:25 (5347): No heartbeat from core client for 30 sec - exiting 22:50:26 (5347): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:38:37 (9949): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 11:54:17 (5894): No heartbeat from core client for 30 sec - exiting 11:54:18 (5894): No heartbeat from core client for 30 sec - exiting 11:54:19 (5894): No heartbeat from core client for 30 sec - exiting 11:54:20 (5894): No heartbeat from core client for 30 sec - exiting 11:54:22 (5894): No heartbeat from core client for 30 sec - exiting 11:54:23 (5894): No heartbeat from core client for 30 sec - exiting 11:54:24 (5894): No heartbeat from core client for 30 sec - exiting 11:54:25 (5894): No heartbeat from core client for 30 sec - exiting 11:54:26 (5894): No heartbeat from core client for 30 sec - exiting 11:54:27 (5894): No heartbeat from core client for 30 sec - exiting 11:54:28 (5894): No heartbeat from core client for 30 sec - exiting 11:54:29 (5894): No heartbeat from core client for 30 sec - exiting 11:54:30 (5894): No heartbeat from core client for 30 sec - exiting 11:54:32 (5894): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:46:55 (7843): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 12:23:54 (5396): No heartbeat from core client for 30 sec - exiting 12:23:55 (5396): No heartbeat from core client for 30 sec - exiting 12:23:56 (5396): No heartbeat from core client for 30 sec - exiting 12:23:57 (5396): No heartbeat from core client for 30 sec - exiting 12:23:59 (5396): No heartbeat from core client for 30 sec - exiting 12:24:00 (5396): No heartbeat from core client for 30 sec - exiting 12:24:01 (5396): No heartbeat from core client for 30 sec - exiting 12:24:02 (5396): No heartbeat from core client for 30 sec - exiting 12:24:03 (5396): No heartbeat from core client for 30 sec - exiting 12:24:04 (5396): No heartbeat from core client for 30 sec - exiting 12:24:06 (5396): No heartbeat from core client for 30 sec - exiting 12:24:07 (5396): No heartbeat from core client for 30 sec - exiting 12:24:08 (5396): No heartbeat from core client for 30 sec - exiting 12:24:09 (5396): No heartbeat from core client for 30 sec - exiting 12:24:10 (5396): No heartbeat from core client for 30 sec - exiting 12:24:11 (5396): No heartbeat from core client for 30 sec - exiting 12:24:13 (5396): No heartbeat from core client for 30 sec - exiting 12:24:14 (5396): No heartbeat from core client for 30 sec - exiting 12:24:15 (5396): No heartbeat from core client for 30 sec - exiting 12:24:16 (5396): No heartbeat from core client for 30 sec - exiting 12:24:17 (5396): No heartbeat from core client for 30 sec - exiting 12:24:18 (5396): No heartbeat from core client for 30 sec - exiting 12:24:20 (5396): No heartbeat from core client for 30 sec - exiting 12:24:21 (5396): No heartbeat from core client for 30 sec - exiting 12:24:22 (5396): No heartbeat from core client for 30 sec - exiting 12:24:23 (5396): No heartbeat from core client for 30 sec - exiting 12:24:24 (5396): No heartbeat from core client for 30 sec - exiting 12:24:26 (5396): No heartbeat from core client for 30 sec - exiting 12:24:27 (5396): No heartbeat from core client for 30 sec - exiting 12:24:28 (5396): No heartbeat from core client for 30 sec - exiting 12:24:29 (5396): No heartbeat from core client for 30 sec - exiting 12:24:30 (5396): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 22:20:14 (6636): No heartbeat from core client for 30 sec - exiting 22:20:15 (6636): No heartbeat from core client for 30 sec - exiting 22:20:16 (6636): No heartbeat from core client for 30 sec - exiting 22:20:18 (6636): No heartbeat from core client for 30 sec - exiting 22:20:19 (6636): No heartbeat from core client for 30 sec - exiting 22:20:20 (6636): No heartbeat from core client for 30 sec - exiting 22:20:21 (6636): No heartbeat from core client for 30 sec - exiting 22:20:22 (6636): No heartbeat from core client for 30 sec - exiting 22:20:23 (6636): No heartbeat from core client for 30 sec - exiting 22:20:25 (6636): No heartbeat from core client for 30 sec - exiting 22:20:26 (6636): No heartbeat from core client for 30 sec - exiting 22:20:27 (6636): No heartbeat from core client for 30 sec - exiting 22:20:28 (6636): No heartbeat from core client for 30 sec - exiting 22:20:29 (6636): No heartbeat from core client for 30 sec - exiting 22:20:30 (6636): No heartbeat from core client for 30 sec - exiting 22:20:32 (6636): No heartbeat from core client for 30 sec - exiting 22:20:33 (6636): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... forrtl: Interrupted system call forrtl: severe (38): error during write, unit 6, file /media/WD600_5_26GB/BOINC/projects/climateprediction.net/hadam3p_anz_r5i3_2012_1_008736745/dataout/xaakg.out Image PC Routine Line Source hadrm3p_anz_um_6. 083C798D Unknown Unknown Unknown hadrm3p_anz_um_6. 083C6785 Unknown Unknown Unknown hadrm3p_anz_um_6. 083971DF Unknown Unknown Unknown hadrm3p_anz_um_6. 0835334D Unknown Unknown Unknown hadrm3p_anz_um_6. 08352C97 Unknown Unknown Unknown hadrm3p_anz_um_6. 0838D2CF Unknown Unknown Unknown hadrm3p_anz_um_6. 0804CEEF Unknown Unknown Unknown hadrm3p_anz_um_6. 08069392 Unknown Unknown Unknown hadrm3p_anz_um_6. 0806A310 Unknown Unknown Unknown hadrm3p_anz_um_6. 082CD2C2 Unknown Unknown Unknown libc.so.6 F0CFDA83 Unknown Unknown Unknown Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6756, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_anz_r5i3_2012_1_008736745_0_10.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_r5i3_2012_1_008736745_0_11.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_r5i3_2012_1_008736745_0_12.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
06 Jun 2014 06:42:27	1241544	16620283	hadam3p_anz_r5i3_2012_1_008736745_0	103,979	398,166	3.8293
02 Jun 2014 05:46:39	1241544	16620283	hadam3p_anz_r5i3_2012_1_008736745_0	92,459	354,632	3.8356
31 May 2014 03:05:18	1241544	16620283	hadam3p_anz_r5i3_2012_1_008736745_0	80,939	310,968	3.8420
28 May 2014 16:59:17	1241544	16620283	hadam3p_anz_r5i3_2012_1_008736745_0	69,419	267,117	3.8479
26 May 2014 16:18:01	1241544	16620283	hadam3p_anz_r5i3_2012_1_008736745_0	57,899	223,955	3.8680
23 May 2014 05:44:48	1241544	16620283	hadam3p_anz_r5i3_2012_1_008736745_0	46,379	179,932	3.8796
18 May 2014 18:38:52	1241544	16620283	hadam3p_anz_r5i3_2012_1_008736745_0	34,859	135,602	3.8900
18 May 2014 05:13:45	1241544	16620283	hadam3p_anz_r5i3_2012_1_008736745_0	23,339	90,566	3.8805
17 May 2014 15:58:57	1241544	16620283	hadam3p_anz_r5i3_2012_1_008736745_0	11,819	45,559	3.8547