Task 18344951

Name	hadam3p_anz_f7sh_2012_1_009779462_0
Workunit	9835426
Created	24 Apr 2015, 15:38:34 UTC
Sent	24 Apr 2015, 22:28:12 UTC
Report deadline	6 Apr 2016, 3:48:12 UTC
Received	12 May 2015, 16:18:52 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1336048
Run time	6 days 3 hours 26 min 32 sec
CPU time	5 days 5 hours 41 min 39 sec
Validate state	Invalid
Credit	2,993.82
Device peak FLOPS	1.50 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.2.42</core_client_version> <![CDATA[ <stderr_txt> 22:45:54 (1848): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:51:17 (3192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:50:54 (5336): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:53:23 (1632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:10:06 (6008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:09:38 (5528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:49:09 (5900): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:27:12 (3868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:35:12 (4836): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:20:06 (3964): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:40:55 (4588): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:59:41 (6928): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 02:21:47 (6348): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:02:59 (5856): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:05:46 (6092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:06:49 (6876): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:33:38 (4124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:40:57 (3732): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:58:18 (2900): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:12:25 (6880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:42:57 (5136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:19:29 (1000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:54:11 (8108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:04:50 (7380): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 20:24:22 (4056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:41:23 (5180): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:28:02 (3764): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:04:12 (4196): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:22:46 (8124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:36:23 (9800): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:22:20 (5168): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:51:28 (7312): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:01:45 (8260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:37:11 (4804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:53:24 (5692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:30:36 (6444): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:32:22 (5368): Can't acquire lockfile (32) - waiting 35s CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:49:23 (4676): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:03:27 (9252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 22:22:23 (5172): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:47:45 (6492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:37:01 (4124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:55:46 (5412): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:10:43 (5092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:36:32 (6672): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:18:11 (4812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:58:41 (5768): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:00:11 (3336): Can't acquire lockfile (32) - waiting 35s 04:03:40 (3336): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:03:41 (3336): No heartbeat from core client for 30 sec - exiting 04:03:42 (3336): No heartbeat from core client for 30 sec - exiting 04:03:43 (3336): No heartbeat from core client for 30 sec - exiting 04:03:44 (3336): No heartbeat from core client for 30 sec - exiting 04:03:45 (3336): No heartbeat from core client for 30 sec - exiting 04:03:46 (3336): No heartbeat from core client for 30 sec - exiting 04:03:47 (3336): No heartbeat from core client for 30 sec - exiting 04:03:48 (3336): No heartbeat from core client for 30 sec - exiting 04:03:49 (3336): No heartbeat from core client for 30 sec - exiting 04:03:50 (3336): No heartbeat from core client for 30 sec - exiting 04:03:51 (3336): No heartbeat from core client for 30 sec - exiting 04:03:52 (3336): No heartbeat from core client for 30 sec - exiting 04:03:53 (3336): No heartbeat from core client for 30 sec - exiting 04:03:54 (3336): No heartbeat from core client for 30 sec - exiting 04:03:55 (3336): No heartbeat from core client for 30 sec - exiting 04:03:56 (3336): No heartbeat from core client for 30 sec - exiting 04:03:57 (3336): No heartbeat from core client for 30 sec - exiting 04:03:58 (3336): No heartbeat from core client for 30 sec - exiting 04:03:59 (3336): No heartbeat from core client for 30 sec - exiting 04:04:00 (3336): No heartbeat from core client for 30 sec - exiting 04:04:01 (3336): No heartbeat from core client for 30 sec - exiting 04:04:02 (3336): No heartbeat from core client for 30 sec - exiting 04:04:03 (3336): No heartbeat from core client for 30 sec - exiting 04:04:04 (3336): No heartbeat from core client for 30 sec - exiting 04:04:05 (3336): No heartbeat from core client for 30 sec - exiting 04:04:06 (3336): No heartbeat from core client for 30 sec - exiting 04:04:07 (3336): No heartbeat from core client for 30 sec - exiting 04:04:08 (3336): No heartbeat from core client for 30 sec - exiting 04:04:09 (3336): No heartbeat from core client for 30 sec - exiting 04:04:10 (3336): No heartbeat from core client for 30 sec - exiting 04:10:30 (3336): No heartbeat from core client for 30 sec - exiting 04:10:31 (3336): No heartbeat from core client for 30 sec - exiting 04:10:32 (3336): No heartbeat from core client for 30 sec - exiting 04:10:33 (3336): No heartbeat from core client for 30 sec - exiting 04:10:34 (3336): No heartbeat from core client for 30 sec - exiting 04:10:35 (3336): No heartbeat from core client for 30 sec - exiting 04:10:36 (3336): No heartbeat from core client for 30 sec - exiting 04:10:37 (3336): No heartbeat from core client for 30 sec - exiting 04:10:38 (3336): No heartbeat from core client for 30 sec - exiting 04:10:39 (3336): No heartbeat from core client for 30 sec - exiting 04:10:40 (3336): No heartbeat from core client for 30 sec - exiting 04:10:41 (3336): No heartbeat from core client for 30 sec - exiting 04:10:42 (3336): No heartbeat from core client for 30 sec - exiting 04:10:43 (3336): No heartbeat from core client for 30 sec - exiting 04:10:44 (3336): No heartbeat from core client for 30 sec - exiting 04:10:45 (3336): No heartbeat from core client for 30 sec - exiting 04:10:46 (3336): No heartbeat from core client for 30 sec - exiting 04:10:47 (3336): No heartbeat from core client for 30 sec - exiting 04:10:48 (3336): No heartbeat from core client for 30 sec - exiting 04:10:49 (3336): No heartbeat from core client for 30 sec - exiting 04:10:50 (3336): No heartbeat from core client for 30 sec - exiting 04:10:51 (3336): No heartbeat from core client for 30 sec - exiting 04:10:52 (3336): No heartbeat from core client for 30 sec - exiting 04:10:53 (3336): No heartbeat from core client for 30 sec - exiting 04:10:54 (3336): No heartbeat from core client for 30 sec - exiting 04:10:55 (3336): No heartbeat from core client for 30 sec - exiting 04:10:56 (3336): No heartbeat from core client for 30 sec - exiting 04:10:57 (3336): No heartbeat from core client for 30 sec - exiting 04:10:58 (3336): No heartbeat from core client for 30 sec - exiting 04:10:59 (3336): No heartbeat from core client for 30 sec - exiting 04:11:00 (3336): No heartbeat from core client for 30 sec - exiting 04:11:01 (3336): No heartbeat from core client for 30 sec - exiting 04:11:02 (3336): No heartbeat from core client for 30 sec - exiting 04:11:03 (3336): No heartbeat from core client for 30 sec - exiting 04:11:04 (3336): No heartbeat from core client for 30 sec - exiting 04:11:05 (3336): No heartbeat from core client for 30 sec - exiting 04:11:06 (3336): No heartbeat from core client for 30 sec - exiting 04:11:07 (3336): No heartbeat from core client for 30 sec - exiting 04:11:08 (3336): No heartbeat from core client for 30 sec - exiting 04:11:09 (3336): No heartbeat from core client for 30 sec - exiting 04:11:10 (3336): No heartbeat from core client for 30 sec - exiting 04:11:11 (3336): No heartbeat from core client for 30 sec - exiting 04:11:12 (3336): No heartbeat from core client for 30 sec - exiting 04:11:13 (3336): No heartbeat from core client for 30 sec - exiting 04:11:14 (3336): No heartbeat from core client for 30 sec - exiting 04:11:15 (3336): No heartbeat from core client for 30 sec - exiting 04:11:16 (3336): No heartbeat from core client for 30 sec - exiting 04:11:17 (3336): No heartbeat from core client for 30 sec - exiting 04:11:18 (3336): No heartbeat from core client for 30 sec - exiting 04:11:19 (3336): No heartbeat from core client for 30 sec - exiting 04:11:20 (3336): No heartbeat from core client for 30 sec - exiting 04:11:21 (3336): No heartbeat from core client for 30 sec - exiting 04:11:22 (3336): No heartbeat from core client for 30 sec - exiting 04:11:23 (3336): No heartbeat from core client for 30 sec - exiting 04:11:24 (3336): No heartbeat from core client for 30 sec - exiting 04:11:25 (3336): No heartbeat from core client for 30 sec - exiting 04:11:26 (3336): No heartbeat from core client for 30 sec - exiting 04:11:27 (3336): No heartbeat from core client for 30 sec - exiting 04:11:28 (3336): No heartbeat from core client for 30 sec - exiting 04:11:29 (3336): No heartbeat from core client for 30 sec - exiting 04:11:30 (3336): No heartbeat from core client for 30 sec - exiting 04:11:31 (3336): No heartbeat from core client for 30 sec - exiting 04:11:32 (3336): No heartbeat from core client for 30 sec - exiting 04:11:33 (3336): No heartbeat from core client for 30 sec - exiting 04:11:35 (3336): No heartbeat from core client for 30 sec - exiting 04:11:36 (3336): No heartbeat from core client for 30 sec - exiting 04:11:37 (3336): No heartbeat from core client for 30 sec - exiting 04:11:38 (3336): No heartbeat from core client for 30 sec - exiting 04:11:39 (3336): No heartbeat from core client for 30 sec - exiting 04:11:40 (3336): No heartbeat from core client for 30 sec - exiting 04:11:41 (3336): No heartbeat from core client for 30 sec - exiting 04:11:42 (3336): No heartbeat from core client for 30 sec - exiting 04:11:43 (3336): No heartbeat from core client for 30 sec - exiting 04:11:44 (3336): No heartbeat from core client for 30 sec - exiting 04:11:45 (3336): No heartbeat from core client for 30 sec - exiting 04:11:46 (3336): No heartbeat from core client for 30 sec - exiting 04:11:47 (3336): No heartbeat from core client for 30 sec - exiting 04:11:48 (3336): No heartbeat from core client for 30 sec - exiting 04:11:49 (3336): No heartbeat from core client for 30 sec - exiting 04:11:50 (3336): No heartbeat from core client for 30 sec - exiting 04:11:51 (3336): No heartbeat from core client for 30 sec - exiting 04:11:52 (3336): No heartbeat from core client for 30 sec - exiting 04:11:53 (3336): No heartbeat from core client for 30 sec - exiting 04:11:54 (3336): No heartbeat from core client for 30 sec - exiting 04:11:55 (3336): No heartbeat from core client for 30 sec - exiting 04:11:56 (3336): No heartbeat from core client for 30 sec - exiting 04:11:57 (3336): No heartbeat from core client for 30 sec - exiting 04:11:58 (3336): No heartbeat from core client for 30 sec - exiting 04:11:59 (3336): No heartbeat from core client for 30 sec - exiting 04:12:00 (3336): No heartbeat from core client for 30 sec - exiting 04:12:01 (3336): No heartbeat from core client for 30 sec - exiting 04:12:02 (3336): No heartbeat from core client for 30 sec - exiting 04:12:03 (3336): No heartbeat from core client for 30 sec - exiting 04:12:04 (3336): No heartbeat from core client for 30 sec - exiting 04:12:05 (3336): No heartbeat from core client for 30 sec - exiting 04:12:06 (3336): No heartbeat from core client for 30 sec - exiting 04:12:07 (3336): No heartbeat from core client for 30 sec - exiting 04:12:08 (3336): No heartbeat from core client for 30 sec - exiting 04:12:09 (3336): No heartbeat from core client for 30 sec - exiting 04:12:10 (3336): No heartbeat from core client for 30 sec - exiting 04:12:11 (3336): No heartbeat from core client for 30 sec - exiting 04:12:12 (3336): No heartbeat from core client for 30 sec - exiting 04:12:13 (3336): No heartbeat from core client for 30 sec - exiting 04:12:14 (3336): No heartbeat from core client for 30 sec - exiting 04:12:15 (3336): No heartbeat from core client for 30 sec - exiting 04:12:16 (3336): No heartbeat from core client for 30 sec - exiting 04:12:17 (3336): No heartbeat from core client for 30 sec - exiting 04:12:18 (3336): No heartbeat from core client for 30 sec - exiting 04:12:19 (3336): No heartbeat from core client for 30 sec - exiting 04:12:20 (3336): No heartbeat from core client for 30 sec - exiting 04:12:21 (3336): No heartbeat from core client for 30 sec - exiting 04:12:22 (3336): No heartbeat from core client for 30 sec - exiting 04:12:23 (3336): No heartbeat from core client for 30 sec - exiting 04:12:24 (3336): No heartbeat from core client for 30 sec - exiting 04:12:25 (3336): No heartbeat from core client for 30 sec - exiting 04:12:26 (3336): No heartbeat from core client for 30 sec - exiting 04:12:27 (3336): No heartbeat from core client for 30 sec - exiting 04:12:28 (3336): No heartbeat from core client for 30 sec - exiting 04:12:29 (3336): No heartbeat from core client for 30 sec - exiting 04:12:30 (3336): No heartbeat from core client for 30 sec - exiting 04:12:31 (3336): No heartbeat from core client for 30 sec - exiting 04:12:32 (3336): No heartbeat from core client for 30 sec - exiting 04:12:33 (3336): No heartbeat from core client for 30 sec - exiting 04:12:34 (3336): No heartbeat from core client for 30 sec - exiting 04:12:35 (3336): No heartbeat from core client for 30 sec - exiting 04:12:36 (3336): No heartbeat from core client for 30 sec - exiting 04:12:37 (3336): No heartbeat from core client for 30 sec - exiting 04:12:38 (3336): No heartbeat from core client for 30 sec - exiting 04:12:39 (3336): No heartbeat from core client for 30 sec - exiting 04:12:40 (3336): No heartbeat from core client for 30 sec - exiting 04:12:41 (3336): No heartbeat from core client for 30 sec - exiting 04:12:42 (3336): No heartbeat from core client for 30 sec - exiting 04:12:43 (3336): No heartbeat from core client for 30 sec - exiting 04:12:44 (3336): No heartbeat from core client for 30 sec - exiting 04:12:45 (3336): No heartbeat from core client for 30 sec - exiting 04:12:46 (3336): No heartbeat from core client for 30 sec - exiting 04:12:47 (3336): No heartbeat from core client for 30 sec - exiting 04:12:48 (3336): No heartbeat from core client for 30 sec - exiting 04:12:49 (3336): No heartbeat from core client for 30 sec - exiting 04:12:50 (3336): No heartbeat from core client for 30 sec - exiting 04:12:51 (3336): No heartbeat from core client for 30 sec - exiting 04:12:52 (3336): No heartbeat from core client for 30 sec - exiting 04:12:53 (3336): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 04:07:19 (7072): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:10:51 (3740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:40:12 (7488): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:05:51 (11904): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:10:49 (1016): Can't acquire lockfile (32) - waiting 35s 10:42:46 (1016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/xaakm.pipe_dummy 2048 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=0, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5204, selfPID=4088, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_anz_f7sh_2012_1_009779462_0_7.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_f7sh_2012_1_009779462_0_8.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_f7sh_2012_1_009779462_0_9.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_f7sh_2012_1_009779462_0_10.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_f7sh_2012_1_009779462_0_11.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_f7sh_2012_1_009779462_0_12.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
12 May 2015 09:54:43	1336048	18344951	hadam3p_anz_f7sh_2012_1_009779462_0	69,419	411,734	5.9311
08 May 2015 21:49:00	1336048	18344951	hadam3p_anz_f7sh_2012_1_009779462_0	57,899	344,792	5.9551
08 May 2015 19:11:59	1336048	18344951	hadam3p_anz_f7sh_2012_1_009779462_0	46,379	275,770	5.9460
08 May 2015 19:08:47	1336048	18344951	hadam3p_anz_f7sh_2012_1_009779462_0	34,859	206,437	5.9221
08 May 2015 19:06:06	1336048	18344951	hadam3p_anz_f7sh_2012_1_009779462_0	23,339	136,922	5.8667
29 Apr 2015 07:05:41	1336048	18344951	hadam3p_anz_f7sh_2012_1_009779462_0	11,819	68,743	5.8163