Task 19242565

Name	hadam3p_anz_a1fh_201412_12_313_010277054_1
Workunit	10277054
Created	30 Jan 2016, 17:27:12 UTC
Sent	2 Feb 2016, 21:54:07 UTC
Report deadline	15 Jan 2017, 3:14:07 UTC
Received	6 Feb 2016, 5:49:14 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1382405
Run time	2 days 16 hours 42 min 16 sec
CPU time	2 days 15 hours 58 min 7 sec
Validate state	Invalid
Credit	3,490.64
Device peak FLOPS	4.25 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.6.9</core_client_version> <![CDATA[ <stderr_txt> 11:54:22 (26536): start_timer_thread(): CreateThread() failed, errno 0 11:54:24 (21956): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 07:29:53 (23828): start_timer_thread(): CreateThread() failed, errno 0 07:29:55 (20232): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 16:18:23 (3272): start_timer_thread(): CreateThread() failed, errno 0 16:18:24 (19740): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 17:48:17 (28504): start_timer_thread(): CreateThread() failed, errno 0 17:48:18 (27456): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 18:29:10 (11752): start_timer_thread(): CreateThread() failed, errno 0 18:29:12 (4580): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 18:47:09 (32464): start_timer_thread(): CreateThread() failed, errno 0 18:47:11 (30800): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 18:54:14 (26476): start_timer_thread(): CreateThread() failed, errno 0 18:54:15 (31632): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 19:01:35 (7552): start_timer_thread(): CreateThread() failed, errno 0 19:01:37 (30140): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 03:09:10 (32396): start_timer_thread(): CreateThread() failed, errno 0 03:09:12 (24240): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 04:24:19 (33504): start_timer_thread(): CreateThread() failed, errno 0 04:24:20 (33156): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 05:58:13 (17600): start_timer_thread(): CreateThread() failed, errno 0 05:58:15 (30600): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 06:43:29 (34188): start_timer_thread(): CreateThread() failed, errno 0 06:43:30 (19776): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 07:21:49 (32664): start_timer_thread(): CreateThread() failed, errno 0 07:21:51 (31480): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 07:43:24 (28300): start_timer_thread(): CreateThread() failed, errno 0 07:43:26 (34524): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 17:41:06 (36608): start_timer_thread(): CreateThread() failed, errno 0 17:41:08 (35936): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 06:25:26 (22340): No heartbeat from core client for 30 sec - exiting 06:25:27 (22340): No heartbeat from core client for 30 sec - exiting 06:25:28 (22340): No heartbeat from core client for 30 sec - exiting 06:25:29 (22340): No heartbeat from core client for 30 sec - exiting 06:25:30 (22340): No heartbeat from core client for 30 sec - exiting 06:25:31 (22340): No heartbeat from core client for 30 sec - exiting 06:25:32 (22340): No heartbeat from core client for 30 sec - exiting 06:25:33 (22340): No heartbeat from core client for 30 sec - exiting 06:25:34 (22340): No heartbeat from core client for 30 sec - exiting 06:25:35 (22340): No heartbeat from core client for 30 sec - exiting 06:25:36 (22340): No heartbeat from core client for 30 sec - exiting 06:25:37 (22340): No heartbeat from core client for 30 sec - exiting 06:25:38 (22340): No heartbeat from core client for 30 sec - exiting 06:25:39 (22340): No heartbeat from core client for 30 sec - exiting 06:25:40 (22340): No heartbeat from core client for 30 sec - exiting 06:25:41 (22340): No heartbeat from core client for 30 sec - exiting 06:25:42 (22340): No heartbeat from core client for 30 sec - exiting 06:25:43 (22340): No heartbeat from core client for 30 sec - exiting 06:25:44 (22340): No heartbeat from core client for 30 sec - exiting 06:25:45 (22340): No heartbeat from core client for 30 sec - exiting 06:25:46 (22340): No heartbeat from core client for 30 sec - exiting 06:25:47 (22340): No heartbeat from core client for 30 sec - exiting 06:25:48 (22340): No heartbeat from core client for 30 sec - exiting 06:25:49 (22340): No heartbeat from core client for 30 sec - exiting 06:25:50 (22340): No heartbeat from core client for 30 sec - exiting 06:25:51 (22340): No heartbeat from core client for 30 sec - exiting 06:25:52 (22340): No heartbeat from core client for 30 sec - exiting 06:25:53 (22340): No heartbeat from core client for 30 sec - exiting 06:25:54 (22340): No heartbeat from core client for 30 sec - exiting 06:25:55 (22340): No heartbeat from core client for 30 sec - exiting 06:25:56 (22340): No heartbeat from core client for 30 sec - exiting 06:25:57 (22340): No heartbeat from core client for 30 sec - exiting 06:25:58 (22340): No heartbeat from core client for 30 sec - exiting 06:25:59 (22340): No heartbeat from core client for 30 sec - exiting 06:26:00 (22340): No heartbeat from core client for 30 sec - exiting 06:26:01 (22340): No heartbeat from core client for 30 sec - exiting 06:26:02 (22340): No heartbeat from core client for 30 sec - exiting 06:26:03 (22340): No heartbeat from core client for 30 sec - exiting 06:26:04 (22340): No heartbeat from core client for 30 sec - exiting 06:26:16 (39364): start_timer_thread(): CreateThread() failed, errno 0 06:26:18 (39404): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - No 'heartbeat' from BOINC... 06:26:28 (39596): start_timer_thread(): CreateThread() failed, errno 0 06:26:29 (39668): start_timer_thread(): CreateThread() failed, errno 0 06:27:13 (39560): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:27:23 (33712): start_timer_thread(): CreateThread() failed, errno 0 06:27:24 (39164): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 06:42:44 (37428): No heartbeat from core client for 30 sec - exiting 06:42:45 (37428): No heartbeat from core client for 30 sec - exiting 06:42:46 (37428): No heartbeat from core client for 30 sec - exiting 06:42:47 (37428): No heartbeat from core client for 30 sec - exiting 06:42:48 (37428): No heartbeat from core client for 30 sec - exiting 06:42:49 (37428): No heartbeat from core client for 30 sec - exiting 06:42:50 (37428): No heartbeat from core client for 30 sec - exiting 06:42:51 (37428): No heartbeat from core client for 30 sec - exiting 06:42:52 (37428): No heartbeat from core client for 30 sec - exiting 06:42:53 (37428): No heartbeat from core client for 30 sec - exiting 06:42:54 (37428): No heartbeat from core client for 30 sec - exiting 06:42:55 (37428): No heartbeat from core client for 30 sec - exiting 06:42:56 (37428): No heartbeat from core client for 30 sec - exiting 06:42:57 (37428): No heartbeat from core client for 30 sec - exiting 06:42:58 (37428): No heartbeat from core client for 30 sec - exiting 06:42:59 (37428): No heartbeat from core client for 30 sec - exiting 06:43:00 (37428): No heartbeat from core client for 30 sec - exiting 06:43:01 (37428): No heartbeat from core client for 30 sec - exiting 06:43:02 (37428): No heartbeat from core client for 30 sec - exiting 06:43:03 (37428): No heartbeat from core client for 30 sec - exiting 06:43:04 (37428): No heartbeat from core client for 30 sec - exiting 06:43:05 (37428): No heartbeat from core client for 30 sec - exiting 06:43:06 (37428): No heartbeat from core client for 30 sec - exiting 06:43:07 (37428): No heartbeat from core client for 30 sec - exiting 06:43:08 (37428): No heartbeat from core client for 30 sec - exiting 06:43:09 (37428): No heartbeat from core client for 30 sec - exiting 06:43:10 (37428): No heartbeat from core client for 30 sec - exiting 06:43:11 (37428): No heartbeat from core client for 30 sec - exiting 06:43:12 (37428): No heartbeat from core client for 30 sec - exiting 06:43:13 (37428): No heartbeat from core client for 30 sec - exiting 06:43:14 (37428): No heartbeat from core client for 30 sec - exiting 06:43:15 (37428): No heartbeat from core client for 30 sec - exiting 06:43:16 (37428): No heartbeat from core client for 30 sec - exiting 06:43:17 (37428): No heartbeat from core client for 30 sec - exiting 06:43:18 (37428): No heartbeat from core client for 30 sec - exiting 06:43:19 (37428): No heartbeat from core client for 30 sec - exiting 06:43:20 (37428): No heartbeat from core client for 30 sec - exiting 06:43:33 (39684): start_timer_thread(): CreateThread() failed, errno 0 06:43:34 (37596): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - No 'heartbeat' from BOINC... 06:43:45 (39168): start_timer_thread(): CreateThread() failed, errno 0 06:43:46 (40012): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:54:48 (36004): start_timer_thread(): CreateThread() failed, errno 0 06:54:49 (35660): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 08:09:18 (38192): No heartbeat from core client for 30 sec - exiting 08:09:19 (38192): No heartbeat from core client for 30 sec - exiting 08:09:20 (38192): No heartbeat from core client for 30 sec - exiting 08:09:21 (38192): No heartbeat from core client for 30 sec - exiting 08:09:22 (38192): No heartbeat from core client for 30 sec - exiting 08:09:23 (38192): No heartbeat from core client for 30 sec - exiting 08:09:24 (38192): No heartbeat from core client for 30 sec - exiting 08:09:25 (38192): No heartbeat from core client for 30 sec - exiting 08:09:26 (38192): No heartbeat from core client for 30 sec - exiting 08:09:27 (38192): No heartbeat from core client for 30 sec - exiting 08:09:28 (38192): No heartbeat from core client for 30 sec - exiting 08:09:29 (38192): No heartbeat from core client for 30 sec - exiting 08:09:30 (38192): No heartbeat from core client for 30 sec - exiting 08:09:31 (38192): No heartbeat from core client for 30 sec - exiting 08:09:32 (38192): No heartbeat from core client for 30 sec - exiting 08:09:33 (38192): No heartbeat from core client for 30 sec - exiting 08:09:34 (38192): No heartbeat from core client for 30 sec - exiting 08:09:35 (38192): No heartbeat from core client for 30 sec - exiting 08:09:36 (38192): No heartbeat from core client for 30 sec - exiting 08:09:37 (38192): No heartbeat from core client for 30 sec - exiting 08:09:38 (38192): No heartbeat from core client for 30 sec - exiting 08:09:39 (38192): No heartbeat from core client for 30 sec - exiting 08:09:40 (38192): No heartbeat from core client for 30 sec - exiting 08:09:41 (38192): No heartbeat from core client for 30 sec - exiting 08:09:42 (38192): No heartbeat from core client for 30 sec - exiting 08:09:43 (38192): No heartbeat from core client for 30 sec - exiting 08:09:44 (38192): No heartbeat from core client for 30 sec - exiting 08:09:45 (38192): No heartbeat from core client for 30 sec - exiting 08:09:46 (38192): No heartbeat from core client for 30 sec - exiting 08:09:47 (38192): No heartbeat from core client for 30 sec - exiting 08:09:48 (38192): No heartbeat from core client for 30 sec - exiting 08:09:49 (38192): No heartbeat from core client for 30 sec - exiting 08:09:50 (38192): No heartbeat from core client for 30 sec - exiting 08:09:51 (38192): No heartbeat from core client for 30 sec - exiting 08:09:52 (38192): No heartbeat from core client for 30 sec - exiting 08:09:53 (38192): No heartbeat from core client for 30 sec - exiting 08:09:54 (38192): No heartbeat from core client for 30 sec - exiting 08:09:55 (38192): No heartbeat from core client for 30 sec - exiting 08:10:02 (34180): start_timer_thread(): CreateThread() failed, errno 0 08:10:03 (39500): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - No 'heartbeat' from BOINC... 08:10:15 (32800): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 10:47:55 (37568): start_timer_thread(): CreateThread() failed, errno 0 10:47:57 (33268): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 11:58:19 (42176): start_timer_thread(): CreateThread() failed, errno 0 11:58:21 (38876): start_timer_thread(): CreateThread() failed, errno 0 12:02:45 (39372): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:02:49 (41364): start_timer_thread(): CreateThread() failed, errno 0 12:02:50 (31556): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 18:44:47 (41012): No heartbeat from core client for 30 sec - exiting 18:44:48 (41012): No heartbeat from core client for 30 sec - exiting 18:44:49 (41012): No heartbeat from core client for 30 sec - exiting 18:44:50 (41012): No heartbeat from core client for 30 sec - exiting 18:44:51 (41012): No heartbeat from core client for 30 sec - exiting 18:44:52 (41012): No heartbeat from core client for 30 sec - exiting 18:44:53 (41012): No heartbeat from core client for 30 sec - exiting 18:44:54 (41012): No heartbeat from core client for 30 sec - exiting 18:44:55 (41012): No heartbeat from core client for 30 sec - exiting 18:44:56 (41012): No heartbeat from core client for 30 sec - exiting 18:44:57 (41012): No heartbeat from core client for 30 sec - exiting 18:44:58 (41012): No heartbeat from core client for 30 sec - exiting 18:44:59 (41012): No heartbeat from core client for 30 sec - exiting 18:45:00 (41012): No heartbeat from core client for 30 sec - exiting 18:45:01 (29760): start_timer_thread(): CreateThread() failed, errno 0 18:45:01 (41012): No heartbeat from core client for 30 sec - exiting 18:45:02 (36136): start_timer_thread(): CreateThread() failed, errno 0 18:45:02 (41012): No heartbeat from core client for 30 sec - exiting 18:45:03 (41012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:45:24 (37896): start_timer_thread(): CreateThread() failed, errno 0 18:45:26 (40968): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=40968, selfPID=40968, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=40968, selfPID=42216, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_anz_a1fh_201412_12_313_010277054_1_8.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_a1fh_201412_12_313_010277054_1_9.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_a1fh_201412_12_313_010277054_1_10.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_a1fh_201412_12_313_010277054_1_11.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_a1fh_201412_12_313_010277054_1_12.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
05 Feb 2016 22:19:13	1382405	19242565	hadam3p_anz_a1fh_201412_12_313_010277054_1	80,939	212,212	2.6219
05 Feb 2016 08:03:33	1382405	19242565	hadam3p_anz_a1fh_201412_12_313_010277054_1	69,419	182,535	2.6295
04 Feb 2016 23:17:59	1382405	19242565	hadam3p_anz_a1fh_201412_12_313_010277054_1	57,899	152,829	2.6396
04 Feb 2016 12:51:22	1382405	19242565	hadam3p_anz_a1fh_201412_12_313_010277054_1	46,379	123,032	2.6528
04 Feb 2016 01:22:11	1382405	19242565	hadam3p_anz_a1fh_201412_12_313_010277054_1	34,859	93,063	2.6697
03 Feb 2016 15:38:58	1382405	19242565	hadam3p_anz_a1fh_201412_12_313_010277054_1	23,339	62,766	2.6893
03 Feb 2016 07:38:02	1382405	19242565	hadam3p_anz_a1fh_201412_12_313_010277054_1	11,819	32,007	2.7081