Task 16944794

Name	hadam3p_anz_rk3o_2012_1_008952631_0
Workunit	9096806
Created	27 Aug 2014, 11:38:35 UTC
Sent	3 Sep 2014, 14:35:36 UTC
Report deadline	16 Aug 2015, 19:55:36 UTC
Received	26 Sep 2014, 16:18:31 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1302579
Run time	3 days 15 hours 28 min 58 sec
CPU time	3 days 13 hours 33 min 35 sec
Validate state	Invalid
Credit	4,981.10
Device peak FLOPS	3.45 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.2.42</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=10576, selfPID=10576, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=804, selfPID=804, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 17:29:34 (3544): No heartbeat from core client for 30 sec - exiting 17:29:35 (3544): No heartbeat from core client for 30 sec - exiting 17:29:36 (3544): No heartbeat from core client for 30 sec - exiting 17:29:37 (3544): No heartbeat from core client for 30 sec - exiting 17:29:38 (3544): No heartbeat from core client for 30 sec - exiting 17:29:39 (3544): No heartbeat from core client for 30 sec - exiting 17:29:40 (3544): No heartbeat from core client for 30 sec - exiting 17:29:41 (3544): No heartbeat from core client for 30 sec - exiting 17:29:42 (3544): No heartbeat from core client for 30 sec - exiting 17:29:43 (3544): No heartbeat from core client for 30 sec - exiting 17:29:44 (3544): No heartbeat from core client for 30 sec - exiting 17:29:45 (3544): No heartbeat from core client for 30 sec - exiting 17:29:46 (3544): No heartbeat from core client for 30 sec - exiting 17:29:47 (3544): No heartbeat from core client for 30 sec - exiting 17:29:48 (3544): No heartbeat from core client for 30 sec - exiting 17:29:49 (3544): No heartbeat from core client for 30 sec - exiting 17:29:50 (3544): No heartbeat from core client for 30 sec - exiting 17:29:51 (3544): No heartbeat from core client for 30 sec - exiting 17:29:52 (3544): No heartbeat from core client for 30 sec - exiting 17:29:53 (3544): No heartbeat from core client for 30 sec - exiting 17:29:54 (3544): No heartbeat from core client for 30 sec - exiting 17:29:55 (3544): No heartbeat from core client for 30 sec - exiting 17:29:56 (3544): No heartbeat from core client for 30 sec - exiting 17:29:57 (3544): No heartbeat from core client for 30 sec - exiting 17:29:58 (3544): No heartbeat from core client for 30 sec - exiting 17:29:59 (3544): No heartbeat from core client for 30 sec - exiting 17:30:00 (3544): No heartbeat from core client for 30 sec - exiting 17:30:01 (3544): No heartbeat from core client for 30 sec - exiting 17:30:02 (3544): No heartbeat from core client for 30 sec - exiting 17:30:03 (3544): No heartbeat from core client for 30 sec - exiting 17:30:04 (3544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:06:04 (6860): No heartbeat from core client for 30 sec - exiting 17:06:05 (6860): No heartbeat from core client for 30 sec - exiting 17:06:06 (6860): No heartbeat from core client for 30 sec - exiting 17:06:07 (6860): No heartbeat from core client for 30 sec - exiting 17:06:08 (6860): No heartbeat from core client for 30 sec - exiting 17:06:09 (6860): No heartbeat from core client for 30 sec - exiting 17:06:10 (6860): No heartbeat from core client for 30 sec - exiting 17:06:11 (6860): No heartbeat from core client for 30 sec - exiting 17:06:12 (6860): No heartbeat from core client for 30 sec - exiting 17:06:13 (6860): No heartbeat from core client for 30 sec - exiting 17:06:14 (6860): No heartbeat from core client for 30 sec - exiting 17:06:15 (6860): No heartbeat from core client for 30 sec - exiting 17:06:16 (6860): No heartbeat from core client for 30 sec - exiting 17:06:17 (6860): No heartbeat from core client for 30 sec - exiting 17:06:18 (6860): No heartbeat from core client for 30 sec - exiting 17:06:19 (6860): No heartbeat from core client for 30 sec - exiting 17:06:20 (6860): No heartbeat from core client for 30 sec - exiting 17:06:21 (6860): No heartbeat from core client for 30 sec - exiting 17:06:22 (6860): No heartbeat from core client for 30 sec - exiting 17:06:23 (6860): No heartbeat from core client for 30 sec - exiting 17:06:24 (6860): No heartbeat from core client for 30 sec - exiting 17:06:25 (6860): No heartbeat from core client for 30 sec - exiting 17:06:26 (6860): No heartbeat from core client for 30 sec - exiting 17:06:27 (6860): No heartbeat from core client for 30 sec - exiting 17:06:28 (6860): No heartbeat from core client for 30 sec - exiting 17:06:29 (6860): No heartbeat from core client for 30 sec - exiting 17:06:30 (6860): No heartbeat from core client for 30 sec - exiting 17:06:31 (6860): No heartbeat from core client for 30 sec - exiting 17:06:32 (6860): No heartbeat from core client for 30 sec - exiting 17:06:33 (6860): No heartbeat from core client for 30 sec - exiting 17:06:34 (6860): No heartbeat from core client for 30 sec - exiting 17:06:35 (6860): No heartbeat from core client for 30 sec - exiting 17:06:36 (6860): No heartbeat from core client for 30 sec - exiting 17:06:37 (6860): No heartbeat from core client for 30 sec - exiting 17:06:38 (6860): No heartbeat from core client for 30 sec - exiting 17:06:39 (6860): No heartbeat from core client for 30 sec - exiting 17:06:40 (6860): No heartbeat from core client for 30 sec - exiting 17:06:41 (6860): No heartbeat from core client for 30 sec - exiting 17:06:42 (6860): No heartbeat from core client for 30 sec - exiting 17:06:43 (6860): No heartbeat from core client for 30 sec - exiting 17:06:44 (6860): No heartbeat from core client for 30 sec - exiting 17:06:45 (6860): No heartbeat from core client for 30 sec - exiting 17:06:49 (6860): No heartbeat from core client for 30 sec - exiting 17:06:50 (6860): No heartbeat from core client for 30 sec - exiting 17:06:51 (6860): No heartbeat from core client for 30 sec - exiting 17:06:52 (6860): No heartbeat from core client for 30 sec - exiting 17:06:53 (6860): No heartbeat from core client for 30 sec - exiting 17:06:54 (6860): No heartbeat from core client for 30 sec - exiting 17:06:55 (6860): No heartbeat from core client for 30 sec - exiting 17:06:56 (6860): No heartbeat from core client for 30 sec - exiting 17:06:57 (6860): No heartbeat from core client for 30 sec - exiting 17:06:58 (6860): No heartbeat from core client for 30 sec - exiting 17:06:59 (6860): No heartbeat from core client for 30 sec - exiting 17:07:00 (6860): No heartbeat from core client for 30 sec - exiting 17:07:01 (6860): No heartbeat from core client for 30 sec - exiting 17:07:02 (6860): No heartbeat from core client for 30 sec - exiting 17:07:03 (6860): No heartbeat from core client for 30 sec - exiting 17:07:04 (6860): No heartbeat from core client for 30 sec - exiting 17:07:05 (6860): No heartbeat from core client for 30 sec - exiting 17:07:06 (6860): No heartbeat from core client for 30 sec - exiting 17:07:07 (6860): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7328, selfPID=7424, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8164, selfPID=8164, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5800, selfPID=5800, iMonCtr=2 Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=8268, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=0, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8668, selfPID=3132, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_anz_rk3o_2012_1_008952631_0_11.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_rk3o_2012_1_008952631_0_12.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
24 Sep 2014 17:49:23	1302579	16944794	hadam3p_anz_rk3o_2012_1_008952631_0	115,499	284,625	2.4643
21 Sep 2014 09:05:40	1302579	16944794	hadam3p_anz_rk3o_2012_1_008952631_0	103,979	256,788	2.4696
15 Sep 2014 21:09:49	1302579	16944794	hadam3p_anz_rk3o_2012_1_008952631_0	92,459	228,654	2.4730
13 Sep 2014 16:01:41	1302579	16944794	hadam3p_anz_rk3o_2012_1_008952631_0	80,939	200,129	2.4726
13 Sep 2014 02:50:26	1302579	16944794	hadam3p_anz_rk3o_2012_1_008952631_0	69,419	171,772	2.4744
11 Sep 2014 19:12:32	1302579	16944794	hadam3p_anz_rk3o_2012_1_008952631_0	57,899	143,333	2.4756
09 Sep 2014 09:21:54	1302579	16944794	hadam3p_anz_rk3o_2012_1_008952631_0	46,379	114,812	2.4755
08 Sep 2014 15:51:22	1302579	16944794	hadam3p_anz_rk3o_2012_1_008952631_0	34,859	86,530	2.4823
07 Sep 2014 11:45:24	1302579	16944794	hadam3p_anz_rk3o_2012_1_008952631_0	23,339	58,088	2.4889
06 Sep 2014 21:37:47	1302579	16944794	hadam3p_anz_rk3o_2012_1_008952631_0	11,819	29,160	2.4672