Task 16451324

Name	hadam3p_anz_aaow_2012_1_008620192_0
Workunit	8766704
Created	2 Apr 2014, 16:22:58 UTC
Sent	22 Apr 2014, 5:14:10 UTC
Report deadline	4 Apr 2015, 10:34:10 UTC
Received	6 May 2014, 12:12:39 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1290755
Run time	5 days 0 hours 31 min 22 sec
CPU time	4 days 17 hours 20 min 58 sec
Validate state	Invalid
Credit	2,497.00
Device peak FLOPS	2.91 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.2.33</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=19704, selfPID=19704, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:55:03 (6192): No heartbeat from core client for 30 sec - exiting 08:55:04 (6192): No heartbeat from core client for 30 sec - exiting 08:55:05 (6192): No heartbeat from core client for 30 sec - exiting 08:55:06 (6192): No heartbeat from core client for 30 sec - exiting 08:55:07 (6192): No heartbeat from core client for 30 sec - exiting 08:55:08 (6192): No heartbeat from core client for 30 sec - exiting 08:55:09 (6192): No heartbeat from core client for 30 sec - exiting 08:55:10 (6192): No heartbeat from core client for 30 sec - exiting 08:55:11 (6192): No heartbeat from core client for 30 sec - exiting 08:55:12 (6192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1648, selfPID=1648, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6828, selfPID=6828, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1448, selfPID=1448, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7968, selfPID=7968, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 08:39:22 (7420): No heartbeat from core client for 30 sec - exiting 08:39:24 (7420): No heartbeat from core client for 30 sec - exiting 08:39:25 (7420): No heartbeat from core client for 30 sec - exiting 08:39:26 (7420): No heartbeat from core client for 30 sec - exiting 08:39:27 (7420): No heartbeat from core client for 30 sec - exiting 08:39:28 (7420): No heartbeat from core client for 30 sec - exiting 08:39:29 (7420): No heartbeat from core client for 30 sec - exiting 08:39:30 (7420): No heartbeat from core client for 30 sec - exiting 08:39:31 (7420): No heartbeat from core client for 30 sec - exiting 08:39:32 (7420): No heartbeat from core client for 30 sec - exiting 08:39:33 (7420): No heartbeat from core client for 30 sec - exiting 08:39:34 (7420): No heartbeat from core client for 30 sec - exiting 08:39:35 (7420): No heartbeat from core client for 30 sec - exiting 08:39:36 (7420): No heartbeat from core client for 30 sec - exiting 08:39:37 (7420): No heartbeat from core client for 30 sec - exiting 08:39:38 (7420): No heartbeat from core client for 30 sec - exiting 08:39:39 (7420): No heartbeat from core client for 30 sec - exiting 08:39:40 (7420): No heartbeat from core client for 30 sec - exiting 08:39:41 (7420): No heartbeat from core client for 30 sec - exiting 08:39:42 (7420): No heartbeat from core client for 30 sec - exiting 08:39:43 (7420): No heartbeat from core client for 30 sec - exiting 08:39:44 (7420): No heartbeat from core client for 30 sec - exiting 08:39:45 (7420): No heartbeat from core client for 30 sec - exiting 08:39:46 (7420): No heartbeat from core client for 30 sec - exiting 08:39:47 (7420): No heartbeat from core client for 30 sec - exiting 08:39:48 (7420): No heartbeat from core client for 30 sec - exiting 08:39:49 (7420): No heartbeat from core client for 30 sec - exiting 08:39:50 (7420): No heartbeat from core client for 30 sec - exiting 08:39:51 (7420): No heartbeat from core client for 30 sec - exiting 08:39:52 (7420): No heartbeat from core client for 30 sec - exiting 08:39:53 (7420): No heartbeat from core client for 30 sec - exiting 08:39:54 (7420): No heartbeat from core client for 30 sec - exiting 08:39:55 (7420): No heartbeat from core client for 30 sec - exiting 08:39:56 (7420): No heartbeat from core client for 30 sec - exiting 08:39:57 (7420): No heartbeat from core client for 30 sec - exiting 08:39:58 (7420): No heartbeat from core client for 30 sec - exiting 08:39:59 (7420): No heartbeat from core client for 30 sec - exiting 08:40:00 (7420): No heartbeat from core client for 30 sec - exiting 08:40:01 (7420): No heartbeat from core client for 30 sec - exiting 08:40:02 (7420): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:57:34 (1448): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5692, selfPID=5692, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4036, selfPID=4036, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8868, selfPID=8868, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:24:34 (8468): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... BUFFOUT: C I/O Error - Return code = 32 Model crashed: Leaving CPDN_Main::Monitor... 11:05:30 (8248): No heartbeat from core client for 30 sec - exiting 11:05:31 (8248): No heartbeat from core client for 30 sec - exiting 11:05:32 (8248): No heartbeat from core client for 30 sec - exiting 11:05:33 (8248): No heartbeat from core client for 30 sec - exiting 11:05:34 (8248): No heartbeat from core client for 30 sec - exiting 11:05:35 (8248): No heartbeat from core client for 30 sec - exiting 11:05:36 (8248): No heartbeat from core client for 30 sec - exiting 11:05:37 (8248): No heartbeat from core client for 30 sec - exiting 11:05:38 (8248): No heartbeat from core client for 30 sec - exiting 11:05:39 (8248): No heartbeat from core client for 30 sec - exiting 11:05:40 (8248): No heartbeat from core client for 30 sec - exiting 11:05:41 (8248): No heartbeat from core client for 30 sec - exiting 11:05:42 (8248): No heartbeat from core client for 30 sec - exiting 11:05:43 (8248): No heartbeat from core client for 30 sec - exiting 11:05:44 (8248): No heartbeat from core client for 30 sec - exiting 11:05:45 (8248): No heartbeat from core client for 30 sec - exiting 11:05:46 (8248): No heartbeat from core client for 30 sec - exiting 11:08:14 (8248): No heartbeat from core client for 30 sec - exiting 11:08:15 (8248): No heartbeat from core client for 30 sec - exiting 11:08:16 (8248): No heartbeat from core client for 30 sec - exiting 11:08:17 (8248): No heartbeat from core client for 30 sec - exiting 11:08:18 (8248): No heartbeat from core client for 30 sec - exiting 11:08:19 (8248): No heartbeat from core client for 30 sec - exiting 11:08:20 (8248): No heartbeat from core client for 30 sec - exiting 11:08:21 (8248): No heartbeat from core client for 30 sec - exiting 11:08:22 (8248): No heartbeat from core client for 30 sec - exiting 11:08:23 (8248): No heartbeat from core client for 30 sec - exiting 11:08:24 (8248): No heartbeat from core client for 30 sec - exiting 11:08:25 (8248): No heartbeat from core client for 30 sec - exiting 11:08:26 (8248): No heartbeat from core client for 30 sec - exiting 11:08:27 (8248): No heartbeat from core client for 30 sec - exiting 11:08:28 (8248): No heartbeat from core client for 30 sec - exiting 11:08:29 (8248): No heartbeat from core client for 30 sec - exiting 11:08:30 (8248): No heartbeat from core client for 30 sec - exiting 11:08:31 (8248): No heartbeat from core client for 30 sec - exiting 11:08:32 (8248): No heartbeat from core client for 30 sec - exiting 11:08:33 (8248): No heartbeat from core client for 30 sec - exiting 11:08:34 (8248): No heartbeat from core client for 30 sec - exiting 11:08:35 (8248): No heartbeat from core client for 30 sec - exiting 11:08:36 (8248): No heartbeat from core client for 30 sec - exiting 11:08:37 (8248): No heartbeat from core client for 30 sec - exiting 11:08:38 (8248): No heartbeat from core client for 30 sec - exiting 11:08:39 (8248): No heartbeat from core client for 30 sec - exiting 11:08:40 (8248): No heartbeat from core client for 30 sec - exiting 11:08:41 (8248): No heartbeat from core client for 30 sec - exiting 11:08:42 (8248): No heartbeat from core client for 30 sec - exiting 11:08:43 (8248): No heartbeat from core client for 30 sec - exiting 11:08:44 (8248): No heartbeat from core client for 30 sec - exiting 11:08:45 (8248): No heartbeat from core client for 30 sec - exiting 11:08:46 (8248): No heartbeat from core client for 30 sec - exiting 11:08:47 (8248): No heartbeat from core client for 30 sec - exiting 11:08:48 (8248): No heartbeat from core client for 30 sec - exiting 11:08:49 (8248): No heartbeat from core client for 30 sec - exiting 11:08:50 (8248): No heartbeat from core client for 30 sec - exiting 11:08:51 (8248): No heartbeat from core client for 30 sec - exiting 11:08:52 (8248): No heartbeat from core client for 30 sec - exiting 11:08:53 (8248): No heartbeat from core client for 30 sec - exiting 11:08:54 (8248): No heartbeat from core client for 30 sec - exiting 11:08:55 (8248): No heartbeat from core client for 30 sec - exiting 11:08:56 (8248): No heartbeat from core client for 30 sec - exiting 11:08:57 (8248): No heartbeat from core client for 30 sec - exiting 11:08:58 (8248): No heartbeat from core client for 30 sec - exiting Called boinc_finish 11:09:19 (8248): No heartbeat from core client for 30 sec - exiting 11:09:20 (8248): No heartbeat from core client for 30 sec - exiting </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_anz_aaow_2012_1_008620192_0_6.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_aaow_2012_1_008620192_0_7.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_aaow_2012_1_008620192_0_8.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_aaow_2012_1_008620192_0_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_aaow_2012_1_008620192_0_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_aaow_2012_1_008620192_0_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_aaow_2012_1_008620192_0_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
05 May 2014 17:06:59	1290755	16451324	hadam3p_anz_aaow_2012_1_008620192_0	57,899	389,359	6.7248
03 May 2014 15:49:04	1290755	16451324	hadam3p_anz_aaow_2012_1_008620192_0	46,379	310,357	6.6918
01 May 2014 06:47:06	1290755	16451324	hadam3p_anz_aaow_2012_1_008620192_0	34,859	232,576	6.6719
29 Apr 2014 09:01:14	1290755	16451324	hadam3p_anz_aaow_2012_1_008620192_0	23,339	154,305	6.6115
26 Apr 2014 13:30:27	1290755	16451324	hadam3p_anz_aaow_2012_1_008620192_0	11,819	77,203	6.5321