Task 18343077

Name	hadam3p_anz_f4bb_2012_1_009777644_0
Workunit	9833608
Created	24 Apr 2015, 14:47:08 UTC
Sent	1 May 2015, 12:21:54 UTC
Report deadline	12 Apr 2016, 17:41:54 UTC
Received	13 May 2015, 20:20:26 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1357694
Run time	2 days 23 hours 19 min 35 sec
CPU time	2 days 16 hours 49 min 44 sec
Validate state	Invalid
Credit	2,000.18
Device peak FLOPS	3.38 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.4.42</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 15:54:05 (7604): No heartbeat from core client for 30 sec - exiting 15:54:06 (7604): No heartbeat from core client for 30 sec - exiting 15:54:07 (7604): No heartbeat from core client for 30 sec - exiting 15:54:08 (7604): No heartbeat from core client for 30 sec - exiting 15:54:09 (7604): No heartbeat from core client for 30 sec - exiting 15:54:10 (7604): No heartbeat from core client for 30 sec - exiting 15:54:11 (7604): No heartbeat from core client for 30 sec - exiting 15:54:12 (7604): No heartbeat from core client for 30 sec - exiting 15:54:13 (7604): No heartbeat from core client for 30 sec - exiting 15:54:14 (7604): No heartbeat from core client for 30 sec - exiting 15:54:15 (7604): No heartbeat from core client for 30 sec - exiting 15:54:16 (7604): No heartbeat from core client for 30 sec - exiting 15:54:17 (7604): No heartbeat from core client for 30 sec - exiting 15:54:18 (7604): No heartbeat from core client for 30 sec - exiting 15:54:19 (7604): No heartbeat from core client for 30 sec - exiting 15:54:20 (7604): No heartbeat from core client for 30 sec - exiting 15:54:21 (7604): No heartbeat from core client for 30 sec - exiting 15:54:22 (7604): No heartbeat from core client for 30 sec - exiting 15:54:23 (7604): No heartbeat from core client for 30 sec - exiting 15:54:24 (7604): No heartbeat from core client for 30 sec - exiting 15:54:25 (7604): No heartbeat from core client for 30 sec - exiting 15:54:26 (7604): No heartbeat from core client for 30 sec - exiting 15:54:27 (7604): No heartbeat from core client for 30 sec - exiting 15:54:28 (7604): No heartbeat from core client for 30 sec - exiting 15:54:29 (7604): No heartbeat from core client for 30 sec - exiting 15:54:30 (7604): No heartbeat from core client for 30 sec - exiting 15:54:31 (7604): No heartbeat from core client for 30 sec - exiting 15:54:32 (7604): No heartbeat from core client for 30 sec - exiting 15:54:33 (7604): No heartbeat from core client for 30 sec - exiting 15:54:34 (7604): No heartbeat from core client for 30 sec - exiting 15:54:35 (7604): No heartbeat from core client for 30 sec - exiting 15:54:36 (7604): No heartbeat from core client for 30 sec - exiting 15:54:37 (7604): No heartbeat from core client for 30 sec - exiting 15:54:38 (7604): No heartbeat from core client for 30 sec - exiting 15:54:39 (7604): No heartbeat from core client for 30 sec - exiting 15:54:40 (7604): No heartbeat from core client for 30 sec - exiting 15:54:41 (7604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9800, selfPID=9800, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=10208, selfPID=10208, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9036, selfPID=9036, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 18:36:04 (1308): No heartbeat from core client for 30 sec - exiting 18:36:05 (1308): No heartbeat from core client for 30 sec - exiting 18:36:06 (1308): No heartbeat from core client for 30 sec - exiting 18:36:07 (1308): No heartbeat from core client for 30 sec - exiting 18:36:08 (1308): No heartbeat from core client for 30 sec - exiting 18:36:09 (1308): No heartbeat from core client for 30 sec - exiting 18:36:10 (1308): No heartbeat from core client for 30 sec - exiting 18:36:11 (1308): No heartbeat from core client for 30 sec - exiting 18:36:12 (1308): No heartbeat from core client for 30 sec - exiting 18:36:13 (1308): No heartbeat from core client for 30 sec - exiting 18:36:14 (1308): No heartbeat from core client for 30 sec - exiting 18:36:15 (1308): No heartbeat from core client for 30 sec - exiting 18:36:16 (1308): No heartbeat from core client for 30 sec - exiting 18:36:17 (1308): No heartbeat from core client for 30 sec - exiting 18:36:18 (1308): No heartbeat from core client for 30 sec - exiting 18:36:19 (1308): No heartbeat from core client for 30 sec - exiting 18:36:20 (1308): No heartbeat from core client for 30 sec - exiting 18:36:21 (1308): No heartbeat from core client for 30 sec - exiting 18:36:22 (1308): No heartbeat from core client for 30 sec - exiting 18:36:23 (1308): No heartbeat from core client for 30 sec - exiting 18:36:24 (1308): No heartbeat from core client for 30 sec - exiting 18:36:25 (1308): No heartbeat from core client for 30 sec - exiting 18:36:26 (1308): No heartbeat from core client for 30 sec - exiting 18:36:27 (1308): No heartbeat from core client for 30 sec - exiting 18:36:28 (1308): No heartbeat from core client for 30 sec - exiting 18:36:29 (1308): No heartbeat from core client for 30 sec - exiting 18:36:30 (1308): No heartbeat from core client for 30 sec - exiting 18:36:31 (1308): No heartbeat from core client for 30 sec - exiting 18:36:32 (1308): No heartbeat from core client for 30 sec - exiting 18:36:33 (1308): No heartbeat from core client for 30 sec - exiting 18:36:34 (1308): No heartbeat from core client for 30 sec - exiting 18:36:35 (1308): No heartbeat from core client for 30 sec - exiting 18:36:36 (1308): No heartbeat from core client for 30 sec - exiting 18:36:37 (1308): No heartbeat from core client for 30 sec - exiting 18:36:38 (1308): No heartbeat from core client for 30 sec - exiting 18:36:39 (1308): No heartbeat from core client for 30 sec - exiting 18:36:40 (1308): No heartbeat from core client for 30 sec - exiting 18:36:41 (1308): No heartbeat from core client for 30 sec - exiting 18:36:42 (1308): No heartbeat from core client for 30 sec - exiting 18:36:43 (1308): No heartbeat from core client for 30 sec - exiting 18:36:44 (1308): No heartbeat from core client for 30 sec - exiting 18:36:45 (1308): No heartbeat from core client for 30 sec - exiting 18:36:46 (1308): No heartbeat from core client for 30 sec - exiting 18:36:47 (1308): No heartbeat from core client for 30 sec - exiting 18:36:48 (1308): No heartbeat from core client for 30 sec - exiting 18:36:49 (1308): No heartbeat from core client for 30 sec - exiting 18:36:50 (1308): No heartbeat from core client for 30 sec - exiting 18:36:51 (1308): No heartbeat from core client for 30 sec - exiting 18:36:52 (1308): No heartbeat from core client for 30 sec - exiting 18:36:53 (1308): No heartbeat from core client for 30 sec - exiting 18:36:54 (1308): No heartbeat from core client for 30 sec - exiting 18:36:55 (1308): No heartbeat from core client for 30 sec - exiting 18:36:56 (1308): No heartbeat from core client for 30 sec - exiting 18:36:57 (1308): No heartbeat from core client for 30 sec - exiting 18:36:58 (1308): No heartbeat from core client for 30 sec - exiting 18:36:59 (1308): No heartbeat from core client for 30 sec - exiting 18:37:00 (1308): No heartbeat from core client for 30 sec - exiting 18:37:01 (1308): No heartbeat from core client for 30 sec - exiting 18:37:02 (1308): No heartbeat from core client for 30 sec - exiting 18:37:03 (1308): No heartbeat from core client for 30 sec - exiting 18:37:04 (1308): No heartbeat from core client for 30 sec - exiting 18:37:05 (1308): No heartbeat from core client for 30 sec - exiting 18:37:06 (1308): No heartbeat from core client for 30 sec - exiting 18:37:07 (1308): No heartbeat from core client for 30 sec - exiting 18:37:08 (1308): No heartbeat from core client for 30 sec - exiting 18:37:09 (1308): No heartbeat from core client for 30 sec - exiting 18:37:10 (1308): No heartbeat from core client for 30 sec - exiting 18:37:11 (1308): No heartbeat from core client for 30 sec - exiting 18:37:12 (1308): No heartbeat from core client for 30 sec - exiting 18:37:13 (1308): No heartbeat from core client for 30 sec - exiting 18:37:14 (1308): No heartbeat from core client for 30 sec - exiting 18:37:15 (1308): No heartbeat from core client for 30 sec - exiting 18:37:16 (1308): No heartbeat from core client for 30 sec - exiting 18:37:17 (1308): No heartbeat from core client for 30 sec - exiting 18:37:18 (1308): No heartbeat from core client for 30 sec - exiting 18:37:19 (1308): No heartbeat from core client for 30 sec - exiting 18:37:20 (1308): No heartbeat from core client for 30 sec - exiting 18:37:21 (1308): No heartbeat from core client for 30 sec - exiting 18:37:22 (1308): No heartbeat from core client for 30 sec - exiting 18:37:23 (1308): No heartbeat from core client for 30 sec - exiting 18:37:24 (1308): No heartbeat from core client for 30 sec - exiting 18:37:25 (1308): No heartbeat from core client for 30 sec - exiting 18:37:26 (1308): No heartbeat from core client for 30 sec - exiting 18:37:27 (1308): No heartbeat from core client for 30 sec - exiting 18:37:28 (1308): No heartbeat from core client for 30 sec - exiting 18:37:29 (1308): No heartbeat from core client for 30 sec - exiting 18:37:30 (1308): No heartbeat from core client for 30 sec - exiting 18:37:31 (1308): No heartbeat from core client for 30 sec - exiting 18:37:32 (1308): No heartbeat from core client for 30 sec - exiting 18:37:33 (1308): No heartbeat from core client for 30 sec - exiting 18:37:34 (1308): No heartbeat from core client for 30 sec - exiting 18:37:35 (1308): No heartbeat from core client for 30 sec - exiting 18:37:36 (1308): No heartbeat from core client for 30 sec - exiting 18:37:37 (1308): No heartbeat from core client for 30 sec - exiting 18:37:38 (1308): No heartbeat from core client for 30 sec - exiting 18:37:39 (1308): No heartbeat from core client for 30 sec - exiting 18:37:40 (1308): No heartbeat from core client for 30 sec - exiting 18:37:41 (1308): No heartbeat from core client for 30 sec - exiting 18:37:42 (1308): No heartbeat from core client for 30 sec - exiting 18:37:43 (1308): No heartbeat from core client for 30 sec - exiting 18:37:44 (1308): No heartbeat from core client for 30 sec - exiting 18:37:45 (1308): No heartbeat from core client for 30 sec - exiting 18:37:46 (1308): No heartbeat from core client for 30 sec - exiting 18:37:47 (1308): No heartbeat from core client for 30 sec - exiting 18:37:48 (1308): No heartbeat from core client for 30 sec - exiting 18:37:49 (1308): No heartbeat from core client for 30 sec - exiting 18:37:50 (1308): No heartbeat from core client for 30 sec - exiting 18:37:51 (1308): No heartbeat from core client for 30 sec - exiting 18:37:52 (1308): No heartbeat from core client for 30 sec - exiting 18:37:53 (1308): No heartbeat from core client for 30 sec - exiting 18:37:54 (1308): No heartbeat from core client for 30 sec - exiting 18:37:55 (1308): No heartbeat from core client for 30 sec - exiting 18:37:56 (1308): No heartbeat from core client for 30 sec - exiting 18:37:57 (1308): No heartbeat from core client for 30 sec - exiting 18:37:58 (1308): No heartbeat from core client for 30 sec - exiting 18:37:59 (1308): No heartbeat from core client for 30 sec - exiting 18:38:00 (1308): No heartbeat from core client for 30 sec - exiting 18:38:01 (1308): No heartbeat from core client for 30 sec - exiting 18:38:02 (1308): No heartbeat from core client for 30 sec - exiting 18:38:03 (1308): No heartbeat from core client for 30 sec - exiting 18:38:04 (1308): No heartbeat from core client for 30 sec - exiting 18:38:05 (1308): No heartbeat from core client for 30 sec - exiting 18:38:06 (1308): No heartbeat from core client for 30 sec - exiting 18:38:07 (1308): No heartbeat from core client for 30 sec - exiting 18:38:08 (1308): No heartbeat from core client for 30 sec - exiting 18:38:09 (1308): No heartbeat from core client for 30 sec - exiting 18:38:10 (1308): No heartbeat from core client for 30 sec - exiting 18:38:11 (1308): No heartbeat from core client for 30 sec - exiting 18:38:12 (1308): No heartbeat from core client for 30 sec - exiting 18:38:13 (1308): No heartbeat from core client for 30 sec - exiting 18:38:14 (1308): No heartbeat from core client for 30 sec - exiting 18:38:15 (1308): No heartbeat from core client for 30 sec - exiting 18:38:16 (1308): No heartbeat from core client for 30 sec - exiting 18:38:17 (1308): No heartbeat from core client for 30 sec - exiting 18:38:18 (1308): No heartbeat from core client for 30 sec - exiting 18:38:19 (1308): No heartbeat from core client for 30 sec - exiting 18:38:20 (1308): No heartbeat from core client for 30 sec - exiting 18:38:21 (1308): No heartbeat from core client for 30 sec - exiting 18:38:22 (1308): No heartbeat from core client for 30 sec - exiting 18:38:23 (1308): No heartbeat from core client for 30 sec - exiting 18:38:24 (1308): No heartbeat from core client for 30 sec - exiting 18:38:25 (1308): No heartbeat from core client for 30 sec - exiting 18:38:26 (1308): No heartbeat from core client for 30 sec - exiting 18:38:27 (1308): No heartbeat from core client for 30 sec - exiting 18:38:28 (1308): No heartbeat from core client for 30 sec - exiting 18:38:29 (1308): No heartbeat from core client for 30 sec - exiting 18:38:30 (1308): No heartbeat from core client for 30 sec - exiting 18:38:31 (1308): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6620, selfPID=6620, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=0, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2792, selfPID=5272, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_anz_f4bb_2012_1_009777644_0_5.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_f4bb_2012_1_009777644_0_6.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_f4bb_2012_1_009777644_0_7.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_f4bb_2012_1_009777644_0_8.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_f4bb_2012_1_009777644_0_9.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_f4bb_2012_1_009777644_0_10.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_f4bb_2012_1_009777644_0_11.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_f4bb_2012_1_009777644_0_12.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
12 May 2015 12:35:22	1357694	18343077	hadam3p_anz_f4bb_2012_1_009777644_0	46,379	205,734	4.4359
08 May 2015 19:26:41	1357694	18343077	hadam3p_anz_f4bb_2012_1_009777644_0	34,859	153,917	4.4154
08 May 2015 19:15:04	1357694	18343077	hadam3p_anz_f4bb_2012_1_009777644_0	23,339	101,665	4.3560
08 May 2015 19:08:00	1357694	18343077	hadam3p_anz_f4bb_2012_1_009777644_0	11,819	53,283	4.5082