Task 18312487

Name	hadam3p_anz_l1bo_2013_1_009735081_1
Workunit	9806926
Created	17 Apr 2015, 12:46:41 UTC
Sent	17 Apr 2015, 13:27:33 UTC
Report deadline	29 Mar 2016, 18:47:33 UTC
Received	15 Aug 2015, 17:22:49 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1328678
Run time	17 days 15 hours 46 min 54 sec
CPU time	14 days 2 hours 48 min 16 sec
Validate state	Invalid
Credit	3,987.46
Device peak FLOPS	1.41 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.4.42</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 04:40:59 (3992): No heartbeat from core client for 30 sec - exiting 04:41:00 (3992): No heartbeat from core client for 30 sec - exiting 04:41:01 (3992): No heartbeat from core client for 30 sec - exiting 04:41:02 (3992): No heartbeat from core client for 30 sec - exiting 04:41:04 (3992): No heartbeat from core client for 30 sec - exiting 04:41:05 (3992): No heartbeat from core client for 30 sec - exiting 04:41:06 (3992): No heartbeat from core client for 30 sec - exiting 04:41:07 (3992): No heartbeat from core client for 30 sec - exiting 04:41:08 (3992): No heartbeat from core client for 30 sec - exiting 04:41:09 (3992): No heartbeat from core client for 30 sec - exiting 04:41:10 (3992): No heartbeat from core client for 30 sec - exiting 04:41:11 (3992): No heartbeat from core client for 30 sec - exiting 04:41:12 (3992): No heartbeat from core client for 30 sec - exiting 04:41:13 (3992): No heartbeat from core client for 30 sec - exiting 04:41:15 (3992): No heartbeat from core client for 30 sec - exiting 04:41:16 (3992): No heartbeat from core client for 30 sec - exiting 04:41:17 (3992): No heartbeat from core client for 30 sec - exiting 04:41:18 (3992): No heartbeat from core client for 30 sec - exiting 04:41:19 (3992): No heartbeat from core client for 30 sec - exiting 04:41:20 (3992): No heartbeat from core client for 30 sec - exiting 04:41:21 (3992): No heartbeat from core client for 30 sec - exiting 04:41:22 (3992): No heartbeat from core client for 30 sec - exiting 04:41:23 (3992): No heartbeat from core client for 30 sec - exiting 04:41:24 (3992): No heartbeat from core client for 30 sec - exiting 04:41:25 (3992): No heartbeat from core client for 30 sec - exiting 04:41:27 (3992): No heartbeat from core client for 30 sec - exiting 04:41:28 (3992): No heartbeat from core client for 30 sec - exiting 04:41:29 (3992): No heartbeat from core client for 30 sec - exiting 04:41:30 (3992): No heartbeat from core client for 30 sec - exiting 04:41:31 (3992): No heartbeat from core client for 30 sec - exiting 04:41:32 (3992): No heartbeat from core client for 30 sec - exiting 04:41:33 (3992): No heartbeat from core client for 30 sec - exiting 04:41:34 (3992): No heartbeat from core client for 30 sec - exiting 04:41:35 (3992): No heartbeat from core client for 30 sec - exiting 04:41:36 (3992): No heartbeat from core client for 30 sec - exiting 04:41:38 (3992): No heartbeat from core client for 30 sec - exiting 04:41:39 (3992): No heartbeat from core client for 30 sec - exiting 04:41:40 (3992): No heartbeat from core client for 30 sec - exiting 04:41:41 (3992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:22:13 (5296): No heartbeat from core client for 30 sec - exiting 08:22:14 (5296): No heartbeat from core client for 30 sec - exiting 08:22:15 (5296): No heartbeat from core client for 30 sec - exiting 08:22:16 (5296): No heartbeat from core client for 30 sec - exiting 08:22:18 (5296): No heartbeat from core client for 30 sec - exiting 08:22:19 (5296): No heartbeat from core client for 30 sec - exiting 08:22:20 (5296): No heartbeat from core client for 30 sec - exiting 08:22:21 (5296): No heartbeat from core client for 30 sec - exiting 08:22:22 (5296): No heartbeat from core client for 30 sec - exiting 08:22:23 (5296): No heartbeat from core client for 30 sec - exiting 08:22:24 (5296): No heartbeat from core client for 30 sec - exiting 08:22:25 (5296): No heartbeat from core client for 30 sec - exiting 08:22:26 (5296): No heartbeat from core client for 30 sec - exiting 08:22:27 (5296): No heartbeat from core client for 30 sec - exiting 08:22:28 (5296): No heartbeat from core client for 30 sec - exiting 08:22:30 (5296): No heartbeat from core client for 30 sec - exiting 08:22:31 (5296): No heartbeat from core client for 30 sec - exiting 08:22:32 (5296): No heartbeat from core client for 30 sec - exiting 08:22:33 (5296): No heartbeat from core client for 30 sec - exiting 08:22:34 (5296): No heartbeat from core client for 30 sec - exiting 08:22:35 (5296): No heartbeat from core client for 30 sec - exiting 08:22:36 (5296): No heartbeat from core client for 30 sec - exiting 08:22:37 (5296): No heartbeat from core client for 30 sec - exiting 08:22:38 (5296): No heartbeat from core client for 30 sec - exiting 08:22:39 (5296): No heartbeat from core client for 30 sec - exiting 08:22:41 (5296): No heartbeat from core client for 30 sec - exiting 08:22:42 (5296): No heartbeat from core client for 30 sec - exiting 08:22:43 (5296): No heartbeat from core client for 30 sec - exiting 08:22:44 (5296): No heartbeat from core client for 30 sec - exiting 08:22:45 (5296): No heartbeat from core client for 30 sec - exiting 08:22:46 (5296): No heartbeat from core client for 30 sec - exiting 08:22:47 (5296): No heartbeat from core client for 30 sec - exiting 08:22:48 (5296): No heartbeat from core client for 30 sec - exiting 08:22:49 (5296): No heartbeat from core client for 30 sec - exiting 08:22:50 (5296): No heartbeat from core client for 30 sec - exiting 08:22:51 (5296): No heartbeat from core client for 30 sec - exiting 08:22:53 (5296): No heartbeat from core client for 30 sec - exiting 08:22:54 (5296): No heartbeat from core client for 30 sec - exiting 08:22:55 (5296): No heartbeat from core client for 30 sec - exiting 08:22:56 (5296): No heartbeat from core client for 30 sec - exiting 08:22:57 (5296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:39:38 (4968): No heartbeat from core client for 30 sec - exiting 10:39:40 (4968): No heartbeat from core client for 30 sec - exiting 10:39:41 (4968): No heartbeat from core client for 30 sec - exiting 10:39:42 (4968): No heartbeat from core client for 30 sec - exiting 10:39:43 (4968): No heartbeat from core client for 30 sec - exiting 10:39:45 (4968): No heartbeat from core client for 30 sec - exiting 10:39:46 (4968): No heartbeat from core client for 30 sec - exiting 10:39:47 (4968): No heartbeat from core client for 30 sec - exiting 10:39:48 (4968): No heartbeat from core client for 30 sec - exiting 10:39:49 (4968): No heartbeat from core client for 30 sec - exiting 10:39:50 (4968): No heartbeat from core client for 30 sec - exiting 10:39:51 (4968): No heartbeat from core client for 30 sec - exiting 10:39:52 (4968): No heartbeat from core client for 30 sec - exiting 10:39:53 (4968): No heartbeat from core client for 30 sec - exiting 10:39:54 (4968): No heartbeat from core client for 30 sec - exiting 10:39:56 (4968): No heartbeat from core client for 30 sec - exiting 10:39:57 (4968): No heartbeat from core client for 30 sec - exiting 10:39:58 (4968): No heartbeat from core client for 30 sec - exiting 10:39:59 (4968): No heartbeat from core client for 30 sec - exiting 10:40:00 (4968): No heartbeat from core client for 30 sec - exiting 10:40:01 (4968): No heartbeat from core client for 30 sec - exiting 10:40:02 (4968): No heartbeat from core client for 30 sec - exiting 10:40:03 (4968): No heartbeat from core client for 30 sec - exiting 10:40:04 (4968): No heartbeat from core client for 30 sec - exiting 10:40:05 (4968): No heartbeat from core client for 30 sec - exiting 10:40:07 (4968): No heartbeat from core client for 30 sec - exiting 10:40:08 (4968): No heartbeat from core client for 30 sec - exiting 10:40:09 (4968): No heartbeat from core client for 30 sec - exiting 10:40:10 (4968): No heartbeat from core client for 30 sec - exiting 10:40:11 (4968): No heartbeat from core client for 30 sec - exiting 10:40:12 (4968): No heartbeat from core client for 30 sec - exiting 10:40:13 (4968): No heartbeat from core client for 30 sec - exiting 10:40:14 (4968): No heartbeat from core client for 30 sec - exiting 10:40:15 (4968): No heartbeat from core client for 30 sec - exiting 10:40:16 (4968): No heartbeat from core client for 30 sec - exiting 10:40:17 (4968): No heartbeat from core client for 30 sec - exiting 10:40:19 (4968): No heartbeat from core client for 30 sec - exiting 10:40:20 (4968): No heartbeat from core client for 30 sec - exiting 10:40:21 (4968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 02:44:22 (3892): No heartbeat from core client for 30 sec - exiting 02:44:23 (3892): No heartbeat from core client for 30 sec - exiting 02:44:24 (3892): No heartbeat from core client for 30 sec - exiting 02:44:25 (3892): No heartbeat from core client for 30 sec - exiting 02:44:26 (3892): No heartbeat from core client for 30 sec - exiting 02:44:27 (3892): No heartbeat from core client for 30 sec - exiting 02:44:29 (3892): No heartbeat from core client for 30 sec - exiting 02:44:30 (3892): No heartbeat from core client for 30 sec - exiting 02:44:31 (3892): No heartbeat from core client for 30 sec - exiting 02:44:32 (3892): No heartbeat from core client for 30 sec - exiting 02:44:33 (3892): No heartbeat from core client for 30 sec - exiting 02:44:34 (3892): No heartbeat from core client for 30 sec - exiting 02:44:35 (3892): No heartbeat from core client for 30 sec - exiting 02:44:36 (3892): No heartbeat from core client for 30 sec - exiting 02:44:37 (3892): No heartbeat from core client for 30 sec - exiting 02:44:38 (3892): No heartbeat from core client for 30 sec - exiting 02:44:39 (3892): No heartbeat from core client for 30 sec - exiting 02:44:41 (3892): No heartbeat from core client for 30 sec - exiting 02:44:42 (3892): No heartbeat from core client for 30 sec - exiting 02:44:43 (3892): No heartbeat from core client for 30 sec - exiting 02:44:44 (3892): No heartbeat from core client for 30 sec - exiting 02:44:45 (3892): No heartbeat from core client for 30 sec - exiting 02:44:46 (3892): No heartbeat from core client for 30 sec - exiting 02:44:47 (3892): No heartbeat from core client for 30 sec - exiting 02:44:48 (3892): No heartbeat from core client for 30 sec - exiting 02:44:49 (3892): No heartbeat from core client for 30 sec - exiting 02:44:50 (3892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... forrtl: There is not enough space on the disk. Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5768, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4052, selfPID=4644, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_anz_l1bo_2013_1_009735081_1_9.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_l1bo_2013_1_009735081_1_10.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_l1bo_2013_1_009735081_1_11.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_l1bo_2013_1_009735081_1_12.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
11 Aug 2015 02:12:09	1328678	18312487	hadam3p_anz_l1bo_2013_1_009735081_1	92,459	1,133,352	12.2579
03 Aug 2015 19:48:17	1328678	18312487	hadam3p_anz_l1bo_2013_1_009735081_1	80,939	994,649	12.2889
18 Jul 2015 11:02:11	1328678	18312487	hadam3p_anz_l1bo_2013_1_009735081_1	69,419	854,724	12.3125
10 Jul 2015 05:57:26	1328678	18312487	hadam3p_anz_l1bo_2013_1_009735081_1	57,899	712,796	12.3110
07 Jul 2015 01:32:07	1328678	18312487	hadam3p_anz_l1bo_2013_1_009735081_1	46,379	573,543	12.3664
03 Jul 2015 08:39:03	1328678	18312487	hadam3p_anz_l1bo_2013_1_009735081_1	34,859	428,029	12.2789
06 Jun 2015 03:24:28	1328678	18312487	hadam3p_anz_l1bo_2013_1_009735081_1	23,339	287,165	12.3041
27 May 2015 15:20:16	1328678	18312487	hadam3p_anz_l1bo_2013_1_009735081_1	11,819	147,479	12.4781