Task 19214938

Name	hadam3p_anz_k5mr_201212_12_306_010269260_0
Workunit	10269260
Created	25 Jan 2016, 13:58:37 UTC
Sent	25 Jan 2016, 18:22:25 UTC
Report deadline	6 Jan 2017, 23:42:25 UTC
Received	29 Jan 2016, 4:53:49 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1382405
Run time	2 days 18 hours 49 min 24 sec
CPU time	2 days 18 hours 6 min 36 sec
Validate state	Invalid
Credit	2,497.00
Device peak FLOPS	4.25 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.6.9</core_client_version> <![CDATA[ <stderr_txt> 08:23:06 (48084): start_timer_thread(): CreateThread() failed, errno 0 08:23:07 (46200): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 16:50:48 (45160): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 19:04:48 (48980): No heartbeat from core client for 30 sec - exiting 19:04:49 (48980): No heartbeat from core client for 30 sec - exiting 19:04:50 (48980): No heartbeat from core client for 30 sec - exiting 19:04:51 (48980): No heartbeat from core client for 30 sec - exiting 19:04:52 (48980): No heartbeat from core client for 30 sec - exiting 19:04:53 (48980): No heartbeat from core client for 30 sec - exiting 19:04:54 (48980): No heartbeat from core client for 30 sec - exiting 19:04:55 (48980): No heartbeat from core client for 30 sec - exiting 19:04:56 (48980): No heartbeat from core client for 30 sec - exiting 19:04:57 (48980): No heartbeat from core client for 30 sec - exiting 19:04:58 (48980): No heartbeat from core client for 30 sec - exiting 19:04:59 (48980): No heartbeat from core client for 30 sec - exiting 19:05:00 (48980): No heartbeat from core client for 30 sec - exiting 19:05:01 (48980): No heartbeat from core client for 30 sec - exiting 19:05:02 (48980): No heartbeat from core client for 30 sec - exiting 19:05:03 (48980): No heartbeat from core client for 30 sec - exiting 19:05:04 (48980): No heartbeat from core client for 30 sec - exiting 19:05:05 (48980): No heartbeat from core client for 30 sec - exiting 19:05:06 (48980): No heartbeat from core client for 30 sec - exiting 19:05:07 (48980): No heartbeat from core client for 30 sec - exiting 19:05:08 (48980): No heartbeat from core client for 30 sec - exiting 19:05:09 (48980): No heartbeat from core client for 30 sec - exiting 19:05:10 (48980): No heartbeat from core client for 30 sec - exiting 19:05:11 (48980): No heartbeat from core client for 30 sec - exiting 19:05:12 (48980): No heartbeat from core client for 30 sec - exiting 19:05:13 (48980): No heartbeat from core client for 30 sec - exiting 19:05:14 (48980): No heartbeat from core client for 30 sec - exiting 19:05:15 (48980): No heartbeat from core client for 30 sec - exiting 19:05:16 (48980): No heartbeat from core client for 30 sec - exiting 19:05:17 (48980): No heartbeat from core client for 30 sec - exiting 19:05:18 (48980): No heartbeat from core client for 30 sec - exiting 19:05:19 (48980): No heartbeat from core client for 30 sec - exiting 19:05:20 (48980): No heartbeat from core client for 30 sec - exiting 19:05:21 (48980): No heartbeat from core client for 30 sec - exiting 19:05:22 (48980): No heartbeat from core client for 30 sec - exiting 19:05:23 (48980): No heartbeat from core client for 30 sec - exiting 19:05:24 (48980): No heartbeat from core client for 30 sec - exiting 19:05:25 (48980): No heartbeat from core client for 30 sec - exiting 19:05:26 (48980): No heartbeat from core client for 30 sec - exiting 19:05:27 (48980): No heartbeat from core client for 30 sec - exiting 19:05:28 (48980): No heartbeat from core client for 30 sec - exiting 19:05:29 (48980): No heartbeat from core client for 30 sec - exiting 19:05:30 (48980): No heartbeat from core client for 30 sec - exiting 19:05:31 (48980): No heartbeat from core client for 30 sec - exiting 19:05:32 (48980): No heartbeat from core client for 30 sec - exiting 19:05:33 (48980): No heartbeat from core client for 30 sec - exiting 19:05:34 (48980): No heartbeat from core client for 30 sec - exiting 19:05:35 (48980): No heartbeat from core client for 30 sec - exiting 19:05:36 (48980): No heartbeat from core client for 30 sec - exiting 19:05:37 (48980): No heartbeat from core client for 30 sec - exiting 19:05:38 (48980): No heartbeat from core client for 30 sec - exiting 19:06:09 (8940): start_timer_thread(): CreateThread() failed, errno 0 19:06:09 (48980): No heartbeat from core client for 30 sec - exiting 19:06:10 (48980): No heartbeat from core client for 30 sec - exiting 19:06:10 (46860): start_timer_thread(): CreateThread() failed, errno 0 19:06:11 (48980): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:06:14 (4312): start_timer_thread(): CreateThread() failed, errno 0 19:06:15 (48708): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 07:28:45 (50364): start_timer_thread(): CreateThread() failed, errno 0 07:28:46 (50404): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 19:04:01 (49500): No heartbeat from core client for 30 sec - exiting 19:04:02 (49500): No heartbeat from core client for 30 sec - exiting 19:04:03 (49500): No heartbeat from core client for 30 sec - exiting 19:04:04 (49500): No heartbeat from core client for 30 sec - exiting 19:04:05 (49500): No heartbeat from core client for 30 sec - exiting 19:04:06 (49500): No heartbeat from core client for 30 sec - exiting 19:04:07 (49500): No heartbeat from core client for 30 sec - exiting 19:04:08 (49500): No heartbeat from core client for 30 sec - exiting 19:04:09 (49500): No heartbeat from core client for 30 sec - exiting 19:04:10 (49500): No heartbeat from core client for 30 sec - exiting 19:04:11 (49500): No heartbeat from core client for 30 sec - exiting 19:04:12 (49500): No heartbeat from core client for 30 sec - exiting 19:04:13 (49500): No heartbeat from core client for 30 sec - exiting 19:04:14 (49500): No heartbeat from core client for 30 sec - exiting 19:04:15 (49500): No heartbeat from core client for 30 sec - exiting 19:04:16 (49500): No heartbeat from core client for 30 sec - exiting 19:04:17 (49500): No heartbeat from core client for 30 sec - exiting 19:04:18 (49500): No heartbeat from core client for 30 sec - exiting 19:04:19 (49500): No heartbeat from core client for 30 sec - exiting 19:04:20 (49500): No heartbeat from core client for 30 sec - exiting 19:04:21 (49500): No heartbeat from core client for 30 sec - exiting 19:04:52 (49500): No heartbeat from core client for 30 sec - exiting 19:04:53 (49500): No heartbeat from core client for 30 sec - exiting 19:04:54 (49500): No heartbeat from core client for 30 sec - exiting 19:04:55 (49500): No heartbeat from core client for 30 sec - exiting 19:04:56 (49500): No heartbeat from core client for 30 sec - exiting 19:04:57 (49500): No heartbeat from core client for 30 sec - exiting 19:04:58 (49500): No heartbeat from core client for 30 sec - exiting 19:04:59 (49500): No heartbeat from core client for 30 sec - exiting 19:05:00 (49500): No heartbeat from core client for 30 sec - exiting 19:05:01 (49500): No heartbeat from core client for 30 sec - exiting 19:05:02 (49500): No heartbeat from core client for 30 sec - exiting 19:05:03 (49500): No heartbeat from core client for 30 sec - exiting 19:05:04 (49500): No heartbeat from core client for 30 sec - exiting 19:05:05 (49500): No heartbeat from core client for 30 sec - exiting 19:05:06 (49500): No heartbeat from core client for 30 sec - exiting 19:05:07 (49500): No heartbeat from core client for 30 sec - exiting 19:05:08 (49500): No heartbeat from core client for 30 sec - exiting 19:05:09 (46464): start_timer_thread(): CreateThread() failed, errno 0 19:05:10 (51852): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - No 'heartbeat' from BOINC... 19:05:17 (51848): start_timer_thread(): CreateThread() failed, errno 0 19:05:19 (52016): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 07:19:26 (54136): start_timer_thread(): CreateThread() failed, errno 0 07:19:28 (54220): start_timer_thread(): CreateThread() failed, errno 0 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=54136, selfPID=0, iMonCtr=1 No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=54136, selfPID=54136, iMonCtr=1 07:33:40 (50100): start_timer_thread(): CreateThread() failed, errno 0 07:33:42 (53276): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 16:18:23 (46004): start_timer_thread(): CreateThread() failed, errno 0 16:18:25 (53408): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 16:25:02 (49856): start_timer_thread(): CreateThread() failed, errno 0 16:25:04 (49668): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 16:31:02 (53368): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 16:35:21 (51552): start_timer_thread(): CreateThread() failed, errno 0 16:35:23 (53352): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 17:04:41 (49408): start_timer_thread(): CreateThread() failed, errno 0 17:04:43 (52284): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 19:07:40 (53004): No heartbeat from core client for 30 sec - exiting 19:07:41 (53004): No heartbeat from core client for 30 sec - exiting 19:07:42 (53004): No heartbeat from core client for 30 sec - exiting 19:07:43 (53004): No heartbeat from core client for 30 sec - exiting 19:07:44 (53004): No heartbeat from core client for 30 sec - exiting 19:07:45 (53004): No heartbeat from core client for 30 sec - exiting 19:07:46 (53004): No heartbeat from core client for 30 sec - exiting 19:07:47 (53004): No heartbeat from core client for 30 sec - exiting 19:07:48 (53004): No heartbeat from core client for 30 sec - exiting 19:07:49 (53004): No heartbeat from core client for 30 sec - exiting 19:07:50 (53004): No heartbeat from core client for 30 sec - exiting 19:07:51 (53004): No heartbeat from core client for 30 sec - exiting 19:07:52 (53004): No heartbeat from core client for 30 sec - exiting 19:07:53 (53004): No heartbeat from core client for 30 sec - exiting 19:07:54 (53004): No heartbeat from core client for 30 sec - exiting 19:07:55 (53004): No heartbeat from core client for 30 sec - exiting 19:07:56 (53004): No heartbeat from core client for 30 sec - exiting 19:07:57 (53004): No heartbeat from core client for 30 sec - exiting 19:07:58 (53004): No heartbeat from core client for 30 sec - exiting 19:07:59 (53004): No heartbeat from core client for 30 sec - exiting 19:08:00 (53004): No heartbeat from core client for 30 sec - exiting 19:08:01 (53004): No heartbeat from core client for 30 sec - exiting 19:08:02 (53004): No heartbeat from core client for 30 sec - exiting 19:08:03 (53004): No heartbeat from core client for 30 sec - exiting 19:08:04 (53004): No heartbeat from core client for 30 sec - exiting 19:08:05 (53004): No heartbeat from core client for 30 sec - exiting 19:08:06 (53004): No heartbeat from core client for 30 sec - exiting 19:08:07 (53004): No heartbeat from core client for 30 sec - exiting 19:08:08 (53004): No heartbeat from core client for 30 sec - exiting 19:08:09 (53004): No heartbeat from core client for 30 sec - exiting 19:08:10 (53004): No heartbeat from core client for 30 sec - exiting 19:08:11 (53004): No heartbeat from core client for 30 sec - exiting 19:08:12 (53004): No heartbeat from core client for 30 sec - exiting 19:08:13 (53004): No heartbeat from core client for 30 sec - exiting 19:08:14 (53004): No heartbeat from core client for 30 sec - exiting 19:08:15 (53004): No heartbeat from core client for 30 sec - exiting 19:08:16 (53004): No heartbeat from core client for 30 sec - exiting 19:08:17 (53004): No heartbeat from core client for 30 sec - exiting 19:08:18 (53004): No heartbeat from core client for 30 sec - exiting 19:08:19 (53004): No heartbeat from core client for 30 sec - exiting 19:08:20 (53004): No heartbeat from core client for 30 sec - exiting 19:08:21 (53004): No heartbeat from core client for 30 sec - exiting 19:08:22 (53004): No heartbeat from core client for 30 sec - exiting 19:08:23 (53004): No heartbeat from core client for 30 sec - exiting 19:08:24 (53004): No heartbeat from core client for 30 sec - exiting 19:08:25 (53004): No heartbeat from core client for 30 sec - exiting 19:08:26 (53004): No heartbeat from core client for 30 sec - exiting 19:08:27 (53004): No heartbeat from core client for 30 sec - exiting 19:08:28 (53004): No heartbeat from core client for 30 sec - exiting 19:08:29 (53004): No heartbeat from core client for 30 sec - exiting 19:08:30 (53004): No heartbeat from core client for 30 sec - exiting 19:08:31 (53004): No heartbeat from core client for 30 sec - exiting 19:08:32 (53004): No heartbeat from core client for 30 sec - exiting 19:08:33 (53004): No heartbeat from core client for 30 sec - exiting 19:08:48 (32176): start_timer_thread(): CreateThread() failed, errno 0 19:08:49 (52548): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - No 'heartbeat' from BOINC... 19:08:54 (47076): start_timer_thread(): CreateThread() failed, errno 0 19:08:55 (39696): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 23:37:02 (51032): start_timer_thread(): CreateThread() failed, errno 0 23:37:04 (49228): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 07:23:03 (56180): start_timer_thread(): CreateThread() failed, errno 0 07:23:05 (54844): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 08:28:38 (52804): start_timer_thread(): CreateThread() failed, errno 0 08:28:40 (50544): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 16:04:39 (52204): start_timer_thread(): CreateThread() failed, errno 0 16:04:41 (52288): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 16:24:20 (53992): start_timer_thread(): CreateThread() failed, errno 0 16:24:22 (51408): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 16:37:58 (57512): start_timer_thread(): CreateThread() failed, errno 0 16:37:59 (55620): start_timer_thread(): CreateThread() failed, errno 0 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=57512, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=55620, selfPID=51004, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_anz_k5mr_201212_12_306_010269260_0_6.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_k5mr_201212_12_306_010269260_0_7.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_k5mr_201212_12_306_010269260_0_8.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_k5mr_201212_12_306_010269260_0_9.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_k5mr_201212_12_306_010269260_0_10.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_k5mr_201212_12_306_010269260_0_11.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_k5mr_201212_12_306_010269260_0_12.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
28 Jan 2016 18:06:41	1382405	19214938	hadam3p_anz_k5mr_201212_12_306_010269260_0	57,899	209,027	3.6102
28 Jan 2016 02:40:05	1382405	19214938	hadam3p_anz_k5mr_201212_12_306_010269260_0	46,379	167,939	3.6210
27 Jan 2016 13:24:38	1382405	19214938	hadam3p_anz_k5mr_201212_12_306_010269260_0	34,859	126,346	3.6245
26 Jan 2016 23:33:54	1382405	19214938	hadam3p_anz_k5mr_201212_12_306_010269260_0	23,339	84,759	3.6316
26 Jan 2016 09:20:07	1382405	19214938	hadam3p_anz_k5mr_201212_12_306_010269260_0	11,819	43,068	3.6440