Task 16412757

Name	hadam3p_anz_n63q_2012_1_008595526_0
Workunit	8742038
Created	26 Mar 2014, 18:31:53 UTC
Sent	28 Mar 2014, 21:38:53 UTC
Report deadline	11 Mar 2015, 2:58:53 UTC
Received	25 May 2014, 17:26:00 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1314417
Run time	18 days 11 hours 39 min 50 sec
CPU time	17 days 11 hours 14 min 23 sec
Validate state	Invalid
Credit	4,981.10
Device peak FLOPS	1.69 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.2.42</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3476, selfPID=3476, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=688, selfPID=688, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 10:31:57 (6464): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:48:05 (10088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:19:43 (6000): No heartbeat from core client for 30 sec - exiting 11:19:44 (6000): No heartbeat from core client for 30 sec - exiting 11:19:45 (6000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... NCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=10500, selfPID=10500, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7624, selfPID=7624, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:54:18 (7260): No heartbeat from core client for 30 sec - exiting 11:54:19 (7260): No heartbeat from core client for 30 sec - exiting 11:54:20 (7260): No heartbeat from core client for 30 sec - exiting 11:54:21 (7260): No heartbeat from core client for 30 sec - exiting 11:54:22 (7260): No heartbeat from core client for 30 sec - exiting 11:54:23 (7260): No heartbeat from core client for 30 sec - exiting 11:54:24 (7260): No heartbeat from core client for 30 sec - exiting 11:54:26 (7260): No heartbeat from core client for 30 sec - exiting 11:54:27 (7260): No heartbeat from core client for 30 sec - exiting 11:54:28 (7260): No heartbeat from core client for 30 sec - exiting 11:54:29 (7260): No heartbeat from core client for 30 sec - exiting 11:54:30 (7260): No heartbeat from core client for 30 sec - exiting 11:54:31 (7260): No heartbeat from core client for 30 sec - exiting 11:54:32 (7260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 12:34:36 (9156): No heartbeat from core client for 30 sec - exiting 12:34:37 (9156): No heartbeat from core client for 30 sec - exiting 12:34:38 (9156): No heartbeat from core client for 30 sec - exiting 12:34:39 (9156): No heartbeat from core client for 30 sec - exiting 12:34:40 (9156): No heartbeat from core client for 30 sec - exiting 12:34:41 (9156): No heartbeat from core client for 30 sec - exiting 12:34:42 (9156): No heartbeat from core client for 30 sec - exiting 12:34:44 (9156): No heartbeat from core client for 30 sec - exiting 12:34:45 (9156): No heartbeat from core client for 30 sec - exiting 12:34:46 (9156): No heartbeat from core client for 30 sec - exiting 12:34:47 (9156): No heartbeat from core client for 30 sec - exiting 12:34:48 (9156): No heartbeat from core client for 30 sec - exiting 12:34:49 (9156): No heartbeat from core client for 30 sec - exiting 12:34:50 (9156): No heartbeat from core client for 30 sec - exiting 12:34:51 (9156): No heartbeat from core client for 30 sec - exiting 12:34:52 (9156): No heartbeat from core client for 30 sec - exiting 12:34:53 (9156): No heartbeat from core client for 30 sec - exiting 12:34:54 (9156): No heartbeat from core client for 30 sec - exiting 12:34:56 (9156): No heartbeat from core client for 30 sec - exiting 12:34:57 (9156): No heartbeat from core client for 30 sec - exiting 12:34:58 (9156): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7856, selfPID=7856, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7216, selfPID=7216, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3744, selfPID=3744, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 08:44:50 (4416): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 11:53:07 (5620): No heartbeat from core client for 30 sec - exiting 11:53:08 (5620): No heartbeat from core client for 30 sec - exiting 11:53:09 (5620): No heartbeat from core client for 30 sec - exiting 11:53:10 (5620): No heartbeat from core client for 30 sec - exiting 11:53:11 (5620): No heartbeat from core client for 30 sec - exiting 11:53:12 (5620): No heartbeat from core client for 30 sec - exiting 11:53:13 (5620): No heartbeat from core client for 30 sec - exiting 11:53:14 (5620): No heartbeat from core client for 30 sec - exiting 11:53:15 (5620): No heartbeat from core client for 30 sec - exiting 11:53:16 (5620): No heartbeat from core client for 30 sec - exiting 11:53:17 (5620): No heartbeat from core client for 30 sec - exiting 11:53:18 (5620): No heartbeat from core client for 30 sec - exiting 11:53:19 (5620): No heartbeat from core client for 30 sec - exiting 11:53:20 (5620): No heartbeat from core client for 30 sec - exiting 11:53:21 (5620): No heartbeat from core client for 30 sec - exiting 11:53:22 (5620): No heartbeat from core client for 30 sec - exiting 11:53:23 (5620): No heartbeat from core client for 30 sec - exiting 11:53:24 (5620): No heartbeat from core client for 30 sec - exiting 11:53:25 (5620): No heartbeat from core client for 30 sec - exiting 11:53:26 (5620): No heartbeat from core client for 30 sec - exiting 11:53:27 (5620): No heartbeat from core client for 30 sec - exiting 11:53:28 (5620): No heartbeat from core client for 30 sec - exiting 11:53:29 (5620): No heartbeat from core client for 30 sec - exiting 11:53:30 (5620): No heartbeat from core client for 30 sec - exiting 11:53:31 (5620): No heartbeat from core client for 30 sec - exiting 11:53:32 (5620): No heartbeat from core client for 30 sec - exiting 11:53:33 (5620): No heartbeat from core client for 30 sec - exiting 11:53:34 (5620): No heartbeat from core client for 30 sec - exiting 11:53:35 (5620): No heartbeat from core client for 30 sec - exiting 11:53:36 (5620): No heartbeat from core client for 30 sec - exiting 11:53:37 (5620): No heartbeat from core client for 30 sec - exiting 11:53:38 (5620): No heartbeat from core client for 30 sec - exiting 11:53:39 (5620): No heartbeat from core client for 30 sec - exiting 11:53:40 (5620): No heartbeat from core client for 30 sec - exiting 11:53:41 (5620): No heartbeat from core client for 30 sec - exiting 11:53:42 (5620): No heartbeat from core client for 30 sec - exiting 11:53:43 (5620): No heartbeat from core client for 30 sec - exiting 11:53:44 (5620): No heartbeat from core client for 30 sec - exiting 11:53:45 (5620): No heartbeat from core client for 30 sec - exiting 11:53:46 (5620): No heartbeat from core client for 30 sec - exiting 11:53:47 (5620): No heartbeat from core client for 30 sec - exiting 11:53:48 (5620): No heartbeat from core client for 30 sec - exiting 11:53:49 (5620): No heartbeat from core client for 30 sec - exiting 11:53:50 (5620): No heartbeat from core client for 30 sec - exiting 11:53:51 (5620): No heartbeat from core client for 30 sec - exiting 11:53:52 (5620): No heartbeat from core client for 30 sec - exiting 11:53:53 (5620): No heartbeat from core client for 30 sec - exiting 11:53:54 (5620): No heartbeat from core client for 30 sec - exiting 11:53:55 (5620): No heartbeat from core client for 30 sec - exiting 11:53:56 (5620): No heartbeat from core client for 30 sec - exiting 11:53:57 (5620): No heartbeat from core client for 30 sec - exiting 11:53:58 (5620): No heartbeat from core client for 30 sec - exiting 11:53:59 (5620): No heartbeat from core client for 30 sec - exiting 11:54:00 (5620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=13908, selfPID=13908, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4980, selfPID=4980, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:19:13 (10708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=10076, selfPID=10076, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=10436, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=12388, selfPID=12388, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=12388, selfPID=4420, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_anz_n63q_2012_1_008595526_0_11.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_n63q_2012_1_008595526_0_12.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
20 May 2014 07:46:40	1314417	16412757	hadam3p_anz_n63q_2012_1_008595526_0	115,499	1,392,943	12.0602
18 May 2014 09:36:48	1314417	16412757	hadam3p_anz_n63q_2012_1_008595526_0	103,979	1,250,686	12.0283
15 May 2014 21:52:16	1314417	16412757	hadam3p_anz_n63q_2012_1_008595526_0	92,459	1,107,458	11.9778
10 May 2014 07:03:01	1314417	16412757	hadam3p_anz_n63q_2012_1_008595526_0	80,939	965,372	11.9272
08 May 2014 10:59:16	1314417	16412757	hadam3p_anz_n63q_2012_1_008595526_0	69,419	829,627	11.9510
06 May 2014 10:38:53	1314417	16412757	hadam3p_anz_n63q_2012_1_008595526_0	57,899	689,062	11.9011
04 May 2014 19:00:45	1314417	16412757	hadam3p_anz_n63q_2012_1_008595526_0	46,379	553,227	11.9284
03 May 2014 02:21:11	1314417	16412757	hadam3p_anz_n63q_2012_1_008595526_0	34,859	414,823	11.9000
10 Apr 2014 10:51:17	1314417	16412757	hadam3p_anz_n63q_2012_1_008595526_0	23,339	274,845	11.7762
02 Apr 2014 15:39:10	1314417	16412757	hadam3p_anz_n63q_2012_1_008595526_0	11,819	137,725	11.6528