Task 18506131

Name	hadam3p_anz_n3l9_2007_1_009861241_0
Workunit	9899738
Created	29 May 2015, 15:53:17 UTC
Sent	4 Jun 2015, 21:21:55 UTC
Report deadline	17 May 2016, 2:41:55 UTC
Received	9 Jun 2015, 10:49:57 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	194 (0x000000C2) EXIT_ABORTED_BY_CLIENT
Computer ID	1361723
Run time	2 days 9 hours 19 min 33 sec
CPU time	2 days 4 hours 47 min 25 sec
Validate state	Invalid
Credit	3,490.64
Device peak FLOPS	3.05 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.4.42</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:35:39 (11576): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:35:41 (11576): No heartbeat from core client for 30 sec - exiting 09:35:42 (11576): No heartbeat from core client for 30 sec - exiting 09:35:43 (11576): No heartbeat from core client for 30 sec - exiting 09:35:44 (11576): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=15164, selfPID=15164, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5196, selfPID=5196, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 09:05:11 (12868): No heartbeat from core client for 30 sec - exiting 09:05:12 (12868): No heartbeat from core client for 30 sec - exiting 09:05:13 (12868): No heartbeat from core client for 30 sec - exiting 09:05:14 (12868): No heartbeat from core client for 30 sec - exiting 09:05:15 (12868): No heartbeat from core client for 30 sec - exiting 09:05:16 (12868): No heartbeat from core client for 30 sec - exiting 09:05:17 (12868): No heartbeat from core client for 30 sec - exiting 09:05:18 (12868): No heartbeat from core client for 30 sec - exiting 09:05:19 (12868): No heartbeat from core client for 30 sec - exiting 09:05:20 (12868): No heartbeat from core client for 30 sec - exiting 09:05:21 (12868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:03:55 (13108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:03:57 (13108): No heartbeat from core client for 30 sec - exiting 11:05:08 (5964): No heartbeat from core client for 30 sec - exiting 11:05:09 (5964): No heartbeat from core client for 30 sec - exiting 11:05:10 (5964): No heartbeat from core client for 30 sec - exiting 11:05:11 (5964): No heartbeat from core client for 30 sec - exiting 11:05:12 (5964): No heartbeat from core client for 30 sec - exiting 11:05:13 (5964): No heartbeat from core client for 30 sec - exiting 11:05:14 (5964): No heartbeat from core client for 30 sec - exiting 11:05:15 (5964): No heartbeat from core client for 30 sec - exiting 11:05:16 (5964): No heartbeat from core client for 30 sec - exiting 11:05:17 (5964): No heartbeat from core client for 30 sec - exiting 11:05:18 (5964): No heartbeat from core client for 30 sec - exiting 11:05:19 (5964): No heartbeat from core client for 30 sec - exiting 11:05:20 (5964): No heartbeat from core client for 30 sec - exiting 11:05:21 (5964): No heartbeat from core client for 30 sec - exiting 11:05:22 (5964): No heartbeat from core client for 30 sec - exiting 11:05:23 (5964): No heartbeat from core client for 30 sec - exiting 11:05:24 (5964): No heartbeat from core client for 30 sec - exiting 11:05:25 (5964): No heartbeat from core client for 30 sec - exiting 11:05:26 (5964): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:15:21 (8120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=13064, selfPID=13064, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:34:32 (11584): No heartbeat from core client for 30 sec - exiting 13:34:33 (11584): No heartbeat from core client for 30 sec - exiting 13:34:34 (11584): No heartbeat from core client for 30 sec - exiting 13:34:35 (11584): No heartbeat from core client for 30 sec - exiting 13:34:36 (11584): No heartbeat from core client for 30 sec - exiting 13:34:37 (11584): No heartbeat from core client for 30 sec - exiting 13:34:38 (11584): No heartbeat from core client for 30 sec - exiting 13:34:39 (11584): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:30:21 (14640): No heartbeat from core client for 30 sec - exiting 17:30:22 (14640): No heartbeat from core client for 30 sec - exiting 17:30:23 (14640): No heartbeat from core client for 30 sec - exiting 17:30:24 (14640): No heartbeat from core client for 30 sec - exiting 17:30:25 (14640): No heartbeat from core client for 30 sec - exiting 17:30:26 (14640): No heartbeat from core client for 30 sec - exiting 17:30:27 (14640): No heartbeat from core client for 30 sec - exiting 17:30:28 (14640): No heartbeat from core client for 30 sec - exiting 17:30:29 (14640): No heartbeat from core client for 30 sec - exiting 17:30:30 (14640): No heartbeat from core client for 30 sec - exiting 17:30:31 (14640): No heartbeat from core client for 30 sec - exiting 17:30:32 (14640): No heartbeat from core client for 30 sec - exiting 17:30:33 (14640): No heartbeat from core client for 30 sec - exiting 17:30:34 (14640): No heartbeat from core client for 30 sec - exiting 17:30:35 (14640): No heartbeat from core client for 30 sec - exiting 17:30:36 (14640): No heartbeat from core client for 30 sec - exiting 17:30:37 (14640): No heartbeat from core client for 30 sec - exiting 17:30:38 (14640): No heartbeat from core client for 30 sec - exiting 17:30:39 (14640): No heartbeat from core client for 30 sec - exiting 17:30:40 (14640): No heartbeat from core client for 30 sec - exiting 17:30:41 (14640): No heartbeat from core client for 30 sec - exiting 17:30:42 (14640): No heartbeat from core client for 30 sec - exiting 17:30:43 (14640): No heartbeat from core client for 30 sec - exiting 17:30:44 (14640): No heartbeat from core client for 30 sec - exiting 17:30:45 (14640): No heartbeat from core client for 30 sec - exiting 17:30:46 (14640): No heartbeat from core client for 30 sec - exiting 17:30:47 (14640): No heartbeat from core client for 30 sec - exiting 17:30:48 (14640): No heartbeat from core client for 30 sec - exiting 17:30:49 (14640): No heartbeat from core client for 30 sec - exiting 17:30:50 (14640): No heartbeat from core client for 30 sec - exiting 17:30:51 (14640): No heartbeat from core client for 30 sec - exiting 17:30:52 (14640): No heartbeat from core client for 30 sec - exiting 17:30:53 (14640): No heartbeat from core client for 30 sec - exiting 17:30:54 (14640): No heartbeat from core client for 30 sec - exiting 17:30:55 (14640): No heartbeat from core client for 30 sec - exiting 17:30:56 (14640): No heartbeat from core client for 30 sec - exiting 17:30:57 (14640): No heartbeat from core client for 30 sec - exiting 17:30:58 (14640): No heartbeat from core client for 30 sec - exiting 17:30:59 (14640): No heartbeat from core client for 30 sec - exiting 17:31:00 (14640): No heartbeat from core client for 30 sec - exiting 17:31:01 (14640): No heartbeat from core client for 30 sec - exiting 17:31:02 (14640): No heartbeat from core client for 30 sec - exiting 17:31:03 (14640): No heartbeat from core client for 30 sec - exiting 17:31:04 (14640): No heartbeat from core client for 30 sec - exiting 17:31:05 (14640): No heartbeat from core client for 30 sec - exiting 17:31:06 (14640): No heartbeat from core client for 30 sec - exiting 17:31:07 (14640): No heartbeat from core client for 30 sec - exiting 17:31:08 (14640): No heartbeat from core client for 30 sec - exiting 17:31:09 (14640): No heartbeat from core client for 30 sec - exiting 17:31:10 (14640): No heartbeat from core client for 30 sec - exiting 17:31:11 (14640): No heartbeat from core client for 30 sec - exiting 17:31:12 (14640): No heartbeat from core client for 30 sec - exiting 17:31:46 (14640): No heartbeat from core client for 30 sec - exiting 17:31:47 (14640): No heartbeat from core client for 30 sec - exiting 17:31:48 (14640): No heartbeat from core client for 30 sec - exiting 17:31:49 (14640): No heartbeat from core client for 30 sec - exiting 17:31:50 (14640): No heartbeat from core client for 30 sec - exiting 17:31:51 (14640): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6204, selfPID=6204, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:48:48 (11584): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8412, selfPID=8412, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 00:00:34 (17196): No heartbeat from core client for 30 sec - exiting 00:00:35 (17196): No heartbeat from core client for 30 sec - exiting 00:00:36 (17196): No heartbeat from core client for 30 sec - exiting 00:00:37 (17196): No heartbeat from core client for 30 sec - exiting 00:00:38 (17196): No heartbeat from core client for 30 sec - exiting 00:00:39 (17196): No heartbeat from core client for 30 sec - exiting 00:00:40 (17196): No heartbeat from core client for 30 sec - exiting 00:00:41 (17196): No heartbeat from core client for 30 sec - exiting 00:00:42 (17196): No heartbeat from core client for 30 sec - exiting 00:00:43 (17196): No heartbeat from core client for 30 sec - exiting 00:00:44 (17196): No heartbeat from core client for 30 sec - exiting 00:00:45 (17196): No heartbeat from core client for 30 sec - exiting 00:00:46 (17196): No heartbeat from core client for 30 sec - exiting 00:00:47 (17196): No heartbeat from core client for 30 sec - exiting 00:00:48 (17196): No heartbeat from core client for 30 sec - exiting 00:00:49 (17196): No heartbeat from core client for 30 sec - exiting 00:00:50 (17196): No heartbeat from core client for 30 sec - exiting 00:00:51 (17196): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:00:52 (17196): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 03:28:25 (8804): No heartbeat from core client for 30 sec - exiting 03:28:26 (8804): No heartbeat from core client for 30 sec - exiting 03:28:27 (8804): No heartbeat from core client for 30 sec - exiting 03:28:28 (8804): No heartbeat from core client for 30 sec - exiting 03:28:30 (8804): No heartbeat from core client for 30 sec - exiting 03:28:31 (8804): No heartbeat from core client for 30 sec - exiting 03:28:32 (8804): No heartbeat from core client for 30 sec - exiting 03:28:33 (8804): No heartbeat from core client for 30 sec - exiting 03:28:34 (8804): No heartbeat from core client for 30 sec - exiting 03:28:35 (8804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4952, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> finish file present too long </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
08 Jun 2015 12:58:03	1361723	18506131	hadam3p_anz_n3l9_2007_1_009861241_0	80,939	179,607	2.2190
07 Jun 2015 14:12:04	1361723	18506131	hadam3p_anz_n3l9_2007_1_009861241_0	69,419	154,308	2.2228
07 Jun 2015 08:02:27	1361723	18506131	hadam3p_anz_n3l9_2007_1_009861241_0	57,899	128,704	2.2229
06 Jun 2015 15:34:06	1361723	18506131	hadam3p_anz_n3l9_2007_1_009861241_0	46,379	103,070	2.2223
06 Jun 2015 08:02:23	1361723	18506131	hadam3p_anz_n3l9_2007_1_009861241_0	34,859	78,390	2.2488
05 Jun 2015 22:36:31	1361723	18506131	hadam3p_anz_n3l9_2007_1_009861241_0	23,339	53,393	2.2877
05 Jun 2015 08:04:20	1361723	18506131	hadam3p_anz_n3l9_2007_1_009861241_0	11,819	28,569	2.4172