Task 19220403

Name	hadam3p_anz_k97u_201212_12_306_010272723_1
Workunit	10272723
Created	25 Jan 2016, 16:22:07 UTC
Sent	25 Jan 2016, 16:22:57 UTC
Report deadline	6 Jan 2017, 21:42:57 UTC
Received	6 Feb 2016, 1:55:04 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1377590
Run time	1 days 18 hours 41 min 21 sec
CPU time	1 days 13 hours 58 min 47 sec
Validate state	Invalid
Credit	509.72
Device peak FLOPS	3.56 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.6.22</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 07:49:39 (9016): No heartbeat from core client for 30 sec - exiting 07:49:41 (9016): No heartbeat from core client for 30 sec - exiting 07:49:42 (9016): No heartbeat from core client for 30 sec - exiting 07:49:43 (9016): No heartbeat from core client for 30 sec - exiting 07:49:44 (9016): No heartbeat from core client for 30 sec - exiting 07:49:45 (9016): No heartbeat from core client for 30 sec - exiting 07:49:46 (9016): No heartbeat from core client for 30 sec - exiting 07:49:47 (9016): No heartbeat from core client for 30 sec - exiting 07:49:48 (9016): No heartbeat from core client for 30 sec - exiting 07:49:49 (9016): No heartbeat from core client for 30 sec - exiting 07:49:50 (9016): No heartbeat from core client for 30 sec - exiting 07:49:51 (9016): No heartbeat from core client for 30 sec - exiting 07:49:52 (9016): No heartbeat from core client for 30 sec - exiting 07:49:53 (9016): No heartbeat from core client for 30 sec - exiting 07:49:54 (9016): No heartbeat from core client for 30 sec - exiting 07:49:55 (9016): No heartbeat from core client for 30 sec - exiting 07:49:56 (9016): No heartbeat from core client for 30 sec - exiting 07:49:57 (9016): No heartbeat from core client for 30 sec - exiting 07:49:58 (9016): No heartbeat from core client for 30 sec - exiting 07:49:59 (9016): No heartbeat from core client for 30 sec - exiting 07:50:00 (9016): No heartbeat from core client for 30 sec - exiting 07:50:01 (9016): No heartbeat from core client for 30 sec - exiting 07:50:02 (9016): No heartbeat from core client for 30 sec - exiting 07:50:03 (9016): No heartbeat from core client for 30 sec - exiting 07:50:04 (9016): No heartbeat from core client for 30 sec - exiting 07:50:05 (9016): No heartbeat from core client for 30 sec - exiting 07:50:06 (9016): No heartbeat from core client for 30 sec - exiting 07:50:07 (9016): No heartbeat from core client for 30 sec - exiting 07:50:08 (9016): No heartbeat from core client for 30 sec - exiting 07:50:09 (9016): No heartbeat from core client for 30 sec - exiting 07:50:10 (9016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 03:51:47 (5740): No heartbeat from core client for 30 sec - exiting 03:51:48 (5740): No heartbeat from core client for 30 sec - exiting 03:51:49 (5740): No heartbeat from core client for 30 sec - exiting 03:51:50 (5740): No heartbeat from core client for 30 sec - exiting 03:51:51 (5740): No heartbeat from core client for 30 sec - exiting 03:51:52 (5740): No heartbeat from core client for 30 sec - exiting 03:51:53 (5740): No heartbeat from core client for 30 sec - exiting 03:51:54 (5740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:09:34 (10496): No heartbeat from core client for 30 sec - exiting 08:09:35 (10496): No heartbeat from core client for 30 sec - exiting 08:09:36 (10496): No heartbeat from core client for 30 sec - exiting 08:09:37 (10496): No heartbeat from core client for 30 sec - exiting 08:09:38 (10496): No heartbeat from core client for 30 sec - exiting 08:09:39 (10496): No heartbeat from core client for 30 sec - exiting 08:09:40 (10496): No heartbeat from core client for 30 sec - exiting 08:09:41 (10496): No heartbeat from core client for 30 sec - exiting 08:09:42 (10496): No heartbeat from core client for 30 sec - exiting 08:09:43 (10496): No heartbeat from core client for 30 sec - exiting 08:09:44 (10496): No heartbeat from core client for 30 sec - exiting 08:09:45 (10496): No heartbeat from core client for 30 sec - exiting 08:09:46 (10496): No heartbeat from core client for 30 sec - exiting 08:09:47 (10496): No heartbeat from core client for 30 sec - exiting 08:09:48 (10496): No heartbeat from core client for 30 sec - exiting 08:09:49 (10496): No heartbeat from core client for 30 sec - exiting 08:09:50 (10496): No heartbeat from core client for 30 sec - exiting 08:09:51 (10496): No heartbeat from core client for 30 sec - exiting 08:09:52 (10496): No heartbeat from core client for 30 sec - exiting 08:09:53 (10496): No heartbeat from core client for 30 sec - exiting 08:09:54 (10496): No heartbeat from core client for 30 sec - exiting 08:09:55 (10496): No heartbeat from core client for 30 sec - exiting 08:09:56 (10496): No heartbeat from core client for 30 sec - exiting 08:09:57 (10496): No heartbeat from core client for 30 sec - exiting 08:09:58 (10496): No heartbeat from core client for 30 sec - exiting 08:09:59 (10496): No heartbeat from core client for 30 sec - exiting 08:10:00 (10496): No heartbeat from core client for 30 sec - exiting 08:10:01 (10496): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 09:58:47 (2732): start_timer_thread(): CreateThread() failed, errno 0 diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 09:58:48 (6020): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 15:35:56 (10724): No heartbeat from core client for 30 sec - exiting 15:35:58 (10724): No heartbeat from core client for 30 sec - exiting 15:35:59 (10724): No heartbeat from core client for 30 sec - exiting 15:36:00 (10724): No heartbeat from core client for 30 sec - exiting 15:36:01 (10724): No heartbeat from core client for 30 sec - exiting 15:36:02 (10724): No heartbeat from core client for 30 sec - exiting 15:36:03 (10724): No heartbeat from core client for 30 sec - exiting 15:36:04 (10724): No heartbeat from core client for 30 sec - exiting 15:36:05 (10724): No heartbeat from core client for 30 sec - exiting 15:36:06 (10724): No heartbeat from core client for 30 sec - exiting 15:36:07 (10724): No heartbeat from core client for 30 sec - exiting 15:36:08 (10724): No heartbeat from core client for 30 sec - exiting 15:36:09 (10724): No heartbeat from core client for 30 sec - exiting 15:36:10 (10724): No heartbeat from core client for 30 sec - exiting 15:36:11 (10724): No heartbeat from core client for 30 sec - exiting 15:36:12 (10724): No heartbeat from core client for 30 sec - exiting 15:36:13 (10724): No heartbeat from core client for 30 sec - exiting 15:36:14 (10724): No heartbeat from core client for 30 sec - exiting 15:36:15 (10724): No heartbeat from core client for 30 sec - exiting 15:36:16 (10724): No heartbeat from core client for 30 sec - exiting 15:36:17 (10724): No heartbeat from core client for 30 sec - exiting 15:36:18 (10724): No heartbeat from core client for 30 sec - exiting 15:36:19 (10724): No heartbeat from core client for 30 sec - exiting 15:36:20 (10724): No heartbeat from core client for 30 sec - exiting 15:36:21 (10724): No heartbeat from core client for 30 sec - exiting 15:36:22 (10724): No heartbeat from core client for 30 sec - exiting 15:36:23 (10724): No heartbeat from core client for 30 sec - exiting 15:36:24 (10724): No heartbeat from core client for 30 sec - exiting 15:36:25 (10724): No heartbeat from core client for 30 sec - exiting 15:36:26 (10724): No heartbeat from core client for 30 sec - exiting 15:36:27 (10724): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 07:42:50 (11176): No heartbeat from core client for 30 sec - exiting 07:42:52 (11176): No heartbeat from core client for 30 sec - exiting 07:42:53 (11176): No heartbeat from core client for 30 sec - exiting 07:42:54 (11176): No heartbeat from core client for 30 sec - exiting 07:42:55 (11176): No heartbeat from core client for 30 sec - exiting 07:42:56 (11176): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=19956, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=20672, selfPID=21300, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 07:56:13 (3616): No heartbeat from core client for 30 sec - exiting 07:56:14 (3616): No heartbeat from core client for 30 sec - exiting 07:56:15 (3616): No heartbeat from core client for 30 sec - exiting 07:56:16 (3616): No heartbeat from core client for 30 sec - exiting 07:56:17 (5424): start_timer_thread(): CreateThread() failed, errno 0 07:56:17 (3616): No heartbeat from core client for 30 sec - exiting 07:56:18 (12236): start_timer_thread(): CreateThread() failed, errno 0 07:56:18 (3616): No heartbeat from core client for 30 sec - exiting 07:56:19 (3616): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:29:58 (8676): No heartbeat from core client for 30 sec - exiting 10:29:59 (8676): No heartbeat from core client for 30 sec - exiting 10:30:00 (8676): No heartbeat from core client for 30 sec - exiting 10:30:01 (8676): No heartbeat from core client for 30 sec - exiting 10:30:03 (8676): No heartbeat from core client for 30 sec - exiting 10:30:04 (8676): No heartbeat from core client for 30 sec - exiting 10:30:05 (8676): No heartbeat from core client for 30 sec - exiting 10:30:06 (8676): No heartbeat from core client for 30 sec - exiting 10:30:07 (8676): No heartbeat from core client for 30 sec - exiting 10:30:08 (8676): No heartbeat from core client for 30 sec - exiting 10:30:09 (8676): No heartbeat from core client for 30 sec - exiting 10:30:10 (8676): No heartbeat from core client for 30 sec - exiting 10:30:11 (8676): No heartbeat from core client for 30 sec - exiting 10:30:12 (8676): No heartbeat from core client for 30 sec - exiting 10:30:13 (8676): No heartbeat from core client for 30 sec - exiting 10:30:14 (8676): No heartbeat from core client for 30 sec - exiting 10:30:15 (8676): No heartbeat from core client for 30 sec - exiting 10:30:16 (8676): No heartbeat from core client for 30 sec - exiting 10:30:17 (8676): No heartbeat from core client for 30 sec - exiting 10:30:18 (8676): No heartbeat from core client for 30 sec - exiting 10:30:19 (8676): No heartbeat from core client for 30 sec - exiting 10:30:20 (8676): No heartbeat from core client for 30 sec - exiting 10:30:21 (8676): No heartbeat from core client for 30 sec - exiting 10:30:22 (8676): No heartbeat from core client for 30 sec - exiting 10:30:23 (8676): No heartbeat from core client for 30 sec - exiting 10:30:24 (8676): No heartbeat from core client for 30 sec - exiting 10:30:25 (8676): No heartbeat from core client for 30 sec - exiting 10:30:26 (8676): No heartbeat from core client for 30 sec - exiting 10:30:27 (8676): No heartbeat from core client for 30 sec - exiting 10:30:28 (8676): No heartbeat from core client for 30 sec - exiting 10:30:29 (8676): No heartbeat from core client for 30 sec - exiting 12:40:18 (4792): start_timer_thread(): CreateThread() failed, errno 0 12:40:20 (9428): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 18:25:13 (18512): start_timer_thread(): CreateThread() failed, errno 0 Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=18512, iMonCtr=1 18:25:24 (18800): start_timer_thread(): CreateThread() failed, errno 0 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=0, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=18800, selfPID=10784, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_anz_k97u_201212_12_306_010272723_1_2.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_k97u_201212_12_306_010272723_1_3.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_k97u_201212_12_306_010272723_1_4.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_k97u_201212_12_306_010272723_1_5.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_k97u_201212_12_306_010272723_1_6.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_k97u_201212_12_306_010272723_1_7.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_k97u_201212_12_306_010272723_1_8.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_k97u_201212_12_306_010272723_1_9.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_k97u_201212_12_306_010272723_1_10.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_k97u_201212_12_306_010272723_1_11.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_k97u_201212_12_306_010272723_1_12.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
29 Jan 2016 04:25:37	1377590	19220403	hadam3p_anz_k97u_201212_12_306_010272723_1	11,819	71,759	6.0715