Task 16445363

Name	hadam3p_anz_a66u_2012_1_008614358_0
Workunit	8760870
Created	2 Apr 2014, 14:42:43 UTC
Sent	29 Apr 2014, 22:55:28 UTC
Report deadline	12 Apr 2015, 4:15:28 UTC
Received	11 Jun 2014, 1:11:46 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1053744
Run time	4 days 7 hours 1 min 18 sec
CPU time	4 days 3 hours 32 min 22 sec
Validate state	Invalid
Credit	2,497.00
Device peak FLOPS	3.03 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>6.10.60</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:58:47 (7620): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 20:58:52 (7620): No heartbeat from core client for 30 sec - exiting 20:58:53 (7620): No heartbeat from core client for 30 sec - exiting 20:58:55 (7620): No heartbeat from core client for 30 sec - exiting 20:58:57 (7620): No heartbeat from core client for 30 sec - exiting 20:58:58 (7620): No heartbeat from core client for 30 sec - exiting 20:58:59 (7620): No heartbeat from core client for 30 sec - exiting 20:59:00 (7620): No heartbeat from core client for 30 sec - exiting 20:59:01 (7620): No heartbeat from core client for 30 sec - exiting 20:59:02 (7620): No heartbeat from core client for 30 sec - exiting 20:59:04 (7620): No heartbeat from core client for 30 sec - exiting 22:40:40 (6272): No heartbeat from core client for 30 sec - exiting 22:40:41 (6272): No heartbeat from core client for 30 sec - exiting 22:40:42 (6272): No heartbeat from core client for 30 sec - exiting 22:40:43 (6272): No heartbeat from core client for 30 sec - exiting 22:40:44 (6272): No heartbeat from core client for 30 sec - exiting 22:40:45 (6272): No heartbeat from core client for 30 sec - exiting 22:40:46 (6272): No heartbeat from core client for 30 sec - exiting 22:40:47 (6272): No heartbeat from core client for 30 sec - exiting 22:40:49 (6272): No heartbeat from core client for 30 sec - exiting 22:40:50 (6272): No heartbeat from core client for 30 sec - exiting 22:40:51 (6272): No heartbeat from core client for 30 sec - exiting 22:40:52 (6272): No heartbeat from core client for 30 sec - exiting 22:40:53 (6272): No heartbeat from core client for 30 sec - exiting 22:40:54 (6272): No heartbeat from core client for 30 sec - exiting 22:40:55 (6272): No heartbeat from core client for 30 sec - exiting 22:40:56 (6272): No heartbeat from core client for 30 sec - exiting 22:40:57 (6272): No heartbeat from core client for 30 sec - exiting 22:40:58 (6272): No heartbeat from core client for 30 sec - exiting 22:40:59 (6272): No heartbeat from core client for 30 sec - exiting 22:41:01 (6272): No heartbeat from core client for 30 sec - exiting 22:41:02 (6272): No heartbeat from core client for 30 sec - exiting 22:41:03 (6272): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 04:50:09 (3260): No heartbeat from core client for 30 sec - exiting 04:50:10 (3260): No heartbeat from core client for 30 sec - exiting 04:50:11 (3260): No heartbeat from core client for 30 sec - exiting 04:50:12 (3260): No heartbeat from core client for 30 sec - exiting 04:50:13 (3260): No heartbeat from core client for 30 sec - exiting 04:50:14 (3260): No heartbeat from core client for 30 sec - exiting 04:50:15 (3260): No heartbeat from core client for 30 sec - exiting 04:50:16 (3260): No heartbeat from core client for 30 sec - exiting 04:50:17 (3260): No heartbeat from core client for 30 sec - exiting 04:50:18 (3260): No heartbeat from core client for 30 sec - exiting 04:50:19 (3260): No heartbeat from core client for 30 sec - exiting 04:50:20 (3260): No heartbeat from core client for 30 sec - exiting 04:50:21 (3260): No heartbeat from core client for 30 sec - exiting 04:50:22 (3260): No heartbeat from core client for 30 sec - exiting 04:50:23 (3260): No heartbeat from core client for 30 sec - exiting 04:50:24 (3260): No heartbeat from core client for 30 sec - exiting 04:50:25 (3260): No heartbeat from core client for 30 sec - exiting 04:50:26 (3260): No heartbeat from core client for 30 sec - exiting 04:50:27 (3260): No heartbeat from core client for 30 sec - exiting 04:50:28 (3260): No heartbeat from core client for 30 sec - exiting 04:50:29 (3260): No heartbeat from core client for 30 sec - exiting 04:50:30 (3260): No heartbeat from core client for 30 sec - exiting 04:50:31 (3260): No heartbeat from core client for 30 sec - exiting 04:50:32 (3260): No heartbeat from core client for 30 sec - exiting 04:50:33 (3260): No heartbeat from core client for 30 sec - exiting 04:50:34 (3260): No heartbeat from core client for 30 sec - exiting 04:50:35 (3260): No heartbeat from core client for 30 sec - exiting 04:50:36 (3260): No heartbeat from core client for 30 sec - exiting 04:50:37 (3260): No heartbeat from core client for 30 sec - exiting 04:50:38 (3260): No heartbeat from core client for 30 sec - exiting 04:50:39 (3260): No heartbeat from core client for 30 sec - exiting 04:50:40 (3260): No heartbeat from core client for 30 sec - exiting 04:50:41 (3260): No heartbeat from core client for 30 sec - exiting 04:50:42 (3260): No heartbeat from core client for 30 sec - exiting 04:50:43 (3260): No heartbeat from core client for 30 sec - exiting 04:50:44 (3260): No heartbeat from core client for 30 sec - exiting 04:50:45 (3260): No heartbeat from core client for 30 sec - exiting 04:50:46 (3260): No heartbeat from core client for 30 sec - exiting 04:50:47 (3260): No heartbeat from core client for 30 sec - exiting 04:50:48 (3260): No heartbeat from core client for 30 sec - exiting 04:50:49 (3260): No heartbeat from core client for 30 sec - exiting 04:50:50 (3260): No heartbeat from core client for 30 sec - exiting 04:50:51 (3260): No heartbeat from core client for 30 sec - exiting 04:50:52 (3260): No heartbeat from core client for 30 sec - exiting 04:50:53 (3260): No heartbeat from core client for 30 sec - exiting 04:50:54 (3260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:50:55 (3260): No heartbeat from core client for 30 sec - exiting 04:50:56 (3260): No heartbeat from core client for 30 sec - exiting 04:50:57 (3260): No heartbeat from core client for 30 sec - exiting 04:50:58 (3260): No heartbeat from core client for 30 sec - exiting 04:50:59 (3260): No heartbeat from core client for 30 sec - exiting 04:51:00 (3260): No heartbeat from core client for 30 sec - exiting 04:51:01 (3260): No heartbeat from core client for 30 sec - exiting 04:51:02 (3260): No heartbeat from core client for 30 sec - exiting 04:51:03 (3260): No heartbeat from core client for 30 sec - exiting 04:51:04 (3260): No heartbeat from core client for 30 sec - exiting 04:51:05 (3260): No heartbeat from core client for 30 sec - exiting 04:56:16 (3332): No heartbeat from core client for 30 sec - exiting 04:56:17 (3332): No heartbeat from core client for 30 sec - exiting 04:56:18 (3332): No heartbeat from core client for 30 sec - exiting 04:56:19 (3332): No heartbeat from core client for 30 sec - exiting 04:56:20 (3332): No heartbeat from core client for 30 sec - exiting 04:56:21 (3332): No heartbeat from core client for 30 sec - exiting 04:56:22 (3332): No heartbeat from core client for 30 sec - exiting 04:56:23 (3332): No heartbeat from core client for 30 sec - exiting 04:56:24 (3332): No heartbeat from core client for 30 sec - exiting 04:56:25 (3332): No heartbeat from core client for 30 sec - exiting 04:56:26 (3332): No heartbeat from core client for 30 sec - exiting 04:56:27 (3332): No heartbeat from core client for 30 sec - exiting 04:56:28 (3332): No heartbeat from core client for 30 sec - exiting 04:56:29 (3332): No heartbeat from core client for 30 sec - exiting 04:56:30 (3332): No heartbeat from core client for 30 sec - exiting 04:56:31 (3332): No heartbeat from core client for 30 sec - exiting 04:56:32 (3332): No heartbeat from core client for 30 sec - exiting 04:56:33 (3332): No heartbeat from core client for 30 sec - exiting 04:56:34 (3332): No heartbeat from core client for 30 sec - exiting 04:56:35 (3332): No heartbeat from core client for 30 sec - exiting 04:56:36 (3332): No heartbeat from core client for 30 sec - exiting 04:56:37 (3332): No heartbeat from core client for 30 sec - exiting 04:56:38 (3332): No heartbeat from core client for 30 sec - exiting 04:56:39 (3332): No heartbeat from core client for 30 sec - exiting 04:56:41 (3332): No heartbeat from core client for 30 sec - exiting 04:56:42 (3332): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:56:43 (3332): No heartbeat from core client for 30 sec - exiting 04:56:44 (3332): No heartbeat from core client for 30 sec - exiting 04:56:45 (3332): No heartbeat from core client for 30 sec - exiting 04:56:46 (3332): No heartbeat from core client for 30 sec - exiting 04:56:47 (3332): No heartbeat from core client for 30 sec - exiting 04:56:48 (3332): No heartbeat from core client for 30 sec - exiting 04:56:49 (3332): No heartbeat from core client for 30 sec - exiting 04:56:50 (3332): No heartbeat from core client for 30 sec - exiting 04:56:51 (3332): No heartbeat from core client for 30 sec - exiting 04:56:52 (3332): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4604, selfPID=4604, iMonCtr=2 05:04:02 (3068): No heartbeat from core client for 30 sec - exiting 05:04:03 (3068): No heartbeat from core client for 30 sec - exiting 05:04:04 (3068): No heartbeat from core client for 30 sec - exiting 05:04:05 (3068): No heartbeat from core client for 30 sec - exiting 05:04:06 (3068): No heartbeat from core client for 30 sec - exiting 05:04:07 (3068): No heartbeat from core client for 30 sec - exiting 05:04:08 (3068): No heartbeat from core client for 30 sec - exiting 05:04:09 (3068): No heartbeat from core client for 30 sec - exiting 05:04:10 (3068): No heartbeat from core client for 30 sec - exiting 05:04:11 (3068): No heartbeat from core client for 30 sec - exiting 05:04:12 (3068): No heartbeat from core client for 30 sec - exiting 05:04:13 (3068): No heartbeat from core client for 30 sec - exiting 05:04:14 (3068): No heartbeat from core client for 30 sec - exiting 05:04:15 (3068): No heartbeat from core client for 30 sec - exiting 05:04:16 (3068): No heartbeat from core client for 30 sec - exiting 05:04:17 (3068): No heartbeat from core client for 30 sec - exiting 05:04:18 (3068): No heartbeat from core client for 30 sec - exiting 05:04:19 (3068): No heartbeat from core client for 30 sec - exiting 05:04:20 (3068): No heartbeat from core client for 30 sec - exiting 05:04:21 (3068): No heartbeat from core client for 30 sec - exiting 05:04:22 (3068): No heartbeat from core client for 30 sec - exiting 05:04:23 (3068): No heartbeat from core client for 30 sec - exiting 05:04:24 (3068): No heartbeat from core client for 30 sec - exiting 05:04:25 (3068): No heartbeat from core client for 30 sec - exiting 05:04:26 (3068): No heartbeat from core client for 30 sec - exiting 05:04:27 (3068): No heartbeat from core client for 30 sec - exiting 05:04:28 (3068): No heartbeat from core client for 30 sec - exiting 05:04:29 (3068): No heartbeat from core client for 30 sec - exiting 05:04:30 (3068): No heartbeat from core client for 30 sec - exiting 05:04:31 (3068): No heartbeat from core client for 30 sec - exiting 05:04:32 (3068): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... 02:02:23 (1388): No heartbeat from core client for 30 sec - exiting 02:02:24 (1388): No heartbeat from core client for 30 sec - exiting 02:02:25 (1388): No heartbeat from core client for 30 sec - exiting 02:02:26 (1388): No heartbeat from core client for 30 sec - exiting 02:02:27 (1388): No heartbeat from core client for 30 sec - exiting 02:02:28 (1388): No heartbeat from core client for 30 sec - exiting 02:02:29 (1388): No heartbeat from core client for 30 sec - exiting 02:02:30 (1388): No heartbeat from core client for 30 sec - exiting 02:02:31 (1388): No heartbeat from core client for 30 sec - exiting 02:02:32 (1388): No heartbeat from core client for 30 sec - exiting 02:02:33 (1388): No heartbeat from core client for 30 sec - exiting 02:02:34 (1388): No heartbeat from core client for 30 sec - exiting 02:02:35 (1388): No heartbeat from core client for 30 sec - exiting 02:02:36 (1388): No heartbeat from core client for 30 sec - exiting 02:02:37 (1388): No heartbeat from core client for 30 sec - exiting 02:02:38 (1388): No heartbeat from core client for 30 sec - exiting 02:02:39 (1388): No heartbeat from core client for 30 sec - exiting 02:02:40 (1388): No heartbeat from core client for 30 sec - exiting 02:02:41 (1388): No heartbeat from core client for 30 sec - exiting 02:02:42 (1388): No heartbeat from core client for 30 sec - exiting 02:02:44 (1388): No heartbeat from core client for 30 sec - exiting 02:02:45 (1388): No heartbeat from core client for 30 sec - exiting 02:02:46 (1388): No heartbeat from core client for 30 sec - exiting 02:02:47 (1388): No heartbeat from core client for 30 sec - exiting 02:02:48 (1388): No heartbeat from core client for 30 sec - exiting 02:02:49 (1388): No heartbeat from core client for 30 sec - exiting 02:02:50 (1388): No heartbeat from core client for 30 sec - exiting 02:02:51 (1388): No heartbeat from core client for 30 sec - exiting 02:02:52 (1388): No heartbeat from core client for 30 sec - exiting 02:02:53 (1388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:02:54 (1388): No heartbeat from core client for 30 sec - exiting 02:02:55 (1388): No heartbeat from core client for 30 sec - exiting 02:02:56 (1388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 05:15:49 (2312): No heartbeat from core client for 30 sec - exiting 05:15:50 (2312): No heartbeat from core client for 30 sec - exiting 05:15:51 (2312): No heartbeat from core client for 30 sec - exiting 05:15:52 (2312): No heartbeat from core client for 30 sec - exiting 05:15:53 (2312): No heartbeat from core client for 30 sec - exiting 05:15:54 (2312): No heartbeat from core client for 30 sec - exiting 05:15:55 (2312): No heartbeat from core client for 30 sec - exiting 05:15:56 (2312): No heartbeat from core client for 30 sec - exiting 05:15:57 (2312): No heartbeat from core client for 30 sec - exiting 05:15:58 (2312): No heartbeat from core client for 30 sec - exiting 05:15:59 (2312): No heartbeat from core client for 30 sec - exiting 05:16:00 (2312): No heartbeat from core client for 30 sec - exiting 05:16:01 (2312): No heartbeat from core client for 30 sec - exiting 05:16:02 (2312): No heartbeat from core client for 30 sec - exiting 05:16:03 (2312): No heartbeat from core client for 30 sec - exiting 05:16:04 (2312): No heartbeat from core client for 30 sec - exiting 05:16:05 (2312): No heartbeat from core client for 30 sec - exiting 05:16:06 (2312): No heartbeat from core client for 30 sec - exiting 05:16:07 (2312): No heartbeat from core client for 30 sec - exiting 05:16:08 (2312): No heartbeat from core client for 30 sec - exiting 05:16:09 (2312): No heartbeat from core client for 30 sec - exiting 05:16:10 (2312): No heartbeat from core client for 30 sec - exiting 05:16:11 (2312): No heartbeat from core client for 30 sec - exiting 05:16:12 (2312): No heartbeat from core client for 30 sec - exiting 05:16:13 (2312): No heartbeat from core client for 30 sec - exiting 05:16:14 (2312): No heartbeat from core client for 30 sec - exiting 05:16:15 (2312): No heartbeat from core client for 30 sec - exiting 05:16:16 (2312): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:16:17 (2312): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 19:10:13 (3528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=1 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6020, selfPID=5944, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> <file_xfer_error> <file_name>hadam3p_anz_a66u_2012_1_008614358_0_6.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_a66u_2012_1_008614358_0_7.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_a66u_2012_1_008614358_0_8.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_a66u_2012_1_008614358_0_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_a66u_2012_1_008614358_0_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_a66u_2012_1_008614358_0_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_a66u_2012_1_008614358_0_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
09 Jun 2014 22:30:57	1053744	16445363	hadam3p_anz_a66u_2012_1_008614358_0	57,899	330,375	5.7061
06 Jun 2014 12:23:18	1053744	16445363	hadam3p_anz_a66u_2012_1_008614358_0	46,379	265,781	5.7306
03 Jun 2014 20:53:51	1053744	16445363	hadam3p_anz_a66u_2012_1_008614358_0	34,859	201,392	5.7773
02 Jun 2014 14:03:56	1053744	16445363	hadam3p_anz_a66u_2012_1_008614358_0	23,339	132,936	5.6959
14 May 2014 04:51:02	1053744	16445363	hadam3p_anz_a66u_2012_1_008614358_0	11,819	66,178	5.5993