Task 18349087

Name	hadam3p_anz_d067_2012_1_009783460_0
Workunit	9839424
Created	24 Apr 2015, 17:38:19 UTC
Sent	26 Apr 2015, 20:37:18 UTC
Report deadline	8 Apr 2016, 1:57:18 UTC
Received	8 Oct 2015, 17:55:50 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1323040
Run time	3 days 1 hours 11 min 42 sec
CPU time	2 days 9 hours 56 min 39 sec
Validate state	Invalid
Credit	1,503.36
Device peak FLOPS	3.59 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.6.9</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:59:40 (2492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:44:44 (4652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:16:56 (5384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6792, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:39:49 (3008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:39:50 (3008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:53:36 (4692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 22:53:09 (5384): start_timer_thread(): CreateThread() failed, errno 0 22:53:10 (5884): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 22:59:34 (5232): start_timer_thread(): CreateThread() failed, errno 0 22:59:36 (5156): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 23:43:34 (7880): start_timer_thread(): CreateThread() failed, errno 0 23:43:36 (5160): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 23:52:33 (6044): start_timer_thread(): CreateThread() failed, errno 0 23:52:34 (5940): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:04:18 (5812): start_timer_thread(): CreateThread() failed, errno 0 19:04:20 (6068): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... ReCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:58:17 (8256): start_timer_thread(): CreateThread() failed, errno 0 19:58:18 (3740): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 21:20:04 (7708): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:15:18 (1192): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:20:44 (8276): No heartbeat from core client for 30 sec - exiting 22:20:45 (8276): No heartbeat from core client for 30 sec - exiting 22:20:46 (8276): No heartbeat from core client for 30 sec - exiting 22:20:47 (8276): No heartbeat from core client for 30 sec - exiting 22:20:48 (8276): No heartbeat from core client for 30 sec - exiting 22:20:49 (8276): No heartbeat from core client for 30 sec - exiting 22:20:51 (8276): No heartbeat from core client for 30 sec - exiting 22:21:24 (8276): No heartbeat from core client for 30 sec - exiting 22:21:25 (8276): No heartbeat from core client for 30 sec - exiting 22:21:26 (8276): No heartbeat from core client for 30 sec - exiting 22:21:27 (8276): No heartbeat from core client for 30 sec - exiting 22:21:29 (8276): No heartbeat from core client for 30 sec - exiting 22:21:30 (8276): No heartbeat from core client for 30 sec - exiting 22:21:31 (8276): No heartbeat from core client for 30 sec - exiting 22:21:32 (8276): No heartbeat from core client for 30 sec - exiting 22:21:33 (8276): No heartbeat from core client for 30 sec - exiting 22:21:34 (8276): No heartbeat from core client for 30 sec - exiting 22:21:35 (8276): No heartbeat from core client for 30 sec - exiting 22:21:36 (8276): No heartbeat from core client for 30 sec - exiting 22:21:37 (8276): No heartbeat from core client for 30 sec - exiting 22:21:38 (8276): No heartbeat from core client for 30 sec - exiting 22:21:39 (8276): No heartbeat from core client for 30 sec - exiting 22:21:41 (8276): No heartbeat from core client for 30 sec - exiting 22:21:42 (8276): No heartbeat from core client for 30 sec - exiting 22:21:43 (8276): No heartbeat from core client for 30 sec - exiting 22:21:44 (8276): No heartbeat from core client for 30 sec - exiting 22:21:45 (8276): No heartbeat from core client for 30 sec - exiting 22:21:46 (8276): No heartbeat from core client for 30 sec - exiting 22:21:47 (8276): No heartbeat from core client for 30 sec - exiting 22:21:49 (8276): No heartbeat from core client for 30 sec - exiting 22:21:50 (8276): No heartbeat from core client for 30 sec - exiting 22:21:51 (8276): No heartbeat from core client for 30 sec - exiting 22:21:52 (8276): No heartbeat from core client for 30 sec - exiting 22:21:53 (8276): No heartbeat from core client for 30 sec - exiting 22:21:54 (8276): No heartbeat from core client for 30 sec - exiting 22:21:56 (8276): No heartbeat from core client for 30 sec - exiting 22:21:57 (8276): No heartbeat from core client for 30 sec - exiting 22:21:58 (8276): No heartbeat from core client for 30 sec - exiting 22:21:59 (8276): No heartbeat from core client for 30 sec - exiting 22:22:00 (8276): No heartbeat from core client for 30 sec - exiting 22:22:01 (8276): No heartbeat from core client for 30 sec - exiting 22:22:02 (8276): No heartbeat from core client for 30 sec - exiting 22:22:04 (8276): No heartbeat from core client for 30 sec - exiting 22:22:05 (8276): No heartbeat from core client for 30 sec - exiting 22:22:06 (8276): No heartbeat from core client for 30 sec - exiting 22:22:07 (8276): No heartbeat from core client for 30 sec - exiting 22:22:08 (8276): No heartbeat from core client for 30 sec - exiting 22:22:09 (8276): No heartbeat from core client for 30 sec - exiting 22:22:10 (8276): No heartbeat from core client for 30 sec - exiting 22:22:11 (8276): No heartbeat from core client for 30 sec - exiting 22:22:12 (8276): No heartbeat from core client for 30 sec - exiting 22:22:13 (8276): No heartbeat from core client for 30 sec - exiting 22:22:15 (8276): No heartbeat from core client for 30 sec - exiting 22:22:16 (8276): No heartbeat from core client for 30 sec - exiting 22:22:17 (8276): No heartbeat from core client for 30 sec - exiting 22:22:18 (8276): No heartbeat from core client for 30 sec - exiting 22:22:19 (8276): No heartbeat from core client for 30 sec - exiting 22:22:20 (8276): No heartbeat from core client for 30 sec - exiting 22:22:21 (8276): No heartbeat from core client for 30 sec - exiting 22:22:22 (8276): No heartbeat from core client for 30 sec - exiting 22:22:23 (8276): No heartbeat from core client for 30 sec - exiting 22:22:24 (8276): No heartbeat from core client for 30 sec - exiting 22:22:25 (8276): No heartbeat from core client for 30 sec - exiting 22:22:27 (8276): No heartbeat from core client for 30 sec - exiting 22:22:28 (8276): No heartbeat from core client for 30 sec - exiting 22:22:29 (8276): No heartbeat from core client for 30 sec - exiting 22:22:30 (8276): No heartbeat from core client for 30 sec - exiting 22:22:31 (8276): No heartbeat from core client for 30 sec - exiting 22:22:32 (8276): No heartbeat from core client for 30 sec - exiting 22:22:33 (8276): No heartbeat from core client for 30 sec - exiting 22:22:34 (8276): No heartbeat from core client for 30 sec - exiting 22:22:35 (8276): No heartbeat from core client for 30 sec - exiting 22:22:36 (8276): No heartbeat from core client for 30 sec - exiting 22:22:38 (8276): No heartbeat from core client for 30 sec - exiting 22:22:39 (8276): No heartbeat from core client for 30 sec - exiting 22:22:40 (8276): No heartbeat from core client for 30 sec - exiting 22:22:41 (8276): No heartbeat from core client for 30 sec - exiting 22:22:42 (8276): No heartbeat from core client for 30 sec - exiting 22:22:43 (8276): No heartbeat from core client for 30 sec - exiting 22:22:44 (8276): No heartbeat from core client for 30 sec - exiting 22:22:45 (8276): No heartbeat from core client for 30 sec - exiting 22:22:46 (8276): No heartbeat from core client for 30 sec - exiting 22:22:47 (8276): No heartbeat from core client for 30 sec - exiting 22:22:48 (8276): No heartbeat from core client for 30 sec - exiting 22:22:50 (8276): No heartbeat from core client for 30 sec - exiting 22:22:51 (8276): No heartbeat from core client for 30 sec - exiting 22:22:52 (8276): No heartbeat from core client for 30 sec - exiting 22:22:53 (8276): No heartbeat from core client for 30 sec - exiting 22:22:54 (8276): No heartbeat from core client for 30 sec - exiting 22:22:55 (8276): No heartbeat from core client for 30 sec - exiting 22:22:56 (8276): No heartbeat from core client for 30 sec - exiting 22:22:57 (8276): No heartbeat from core client for 30 sec - exiting 22:22:58 (8276): No heartbeat from core client for 30 sec - exiting 22:23:00 (8276): No heartbeat from core client for 30 sec - exiting 22:23:01 (8276): No heartbeat from core client for 30 sec - exiting 22:23:02 (8276): No heartbeat from core client for 30 sec - exiting 22:23:03 (8276): No heartbeat from core client for 30 sec - exiting 22:23:04 (8276): No heartbeat from core client for 30 sec - exiting 22:23:05 (8276): No heartbeat from core client for 30 sec - exiting 22:23:06 (8276): No heartbeat from core client for 30 sec - exiting 22:23:08 (8276): No heartbeat from core client for 30 sec - exiting 22:23:09 (8276): No heartbeat from core client for 30 sec - exiting 22:23:10 (8276): No heartbeat from core client for 30 sec - exiting 22:23:11 (8276): No heartbeat from core client for 30 sec - exiting 22:23:12 (8276): No heartbeat from core client for 30 sec - exiting 22:23:13 (8276): No heartbeat from core client for 30 sec - exiting 22:23:14 (8276): No heartbeat from core client for 30 sec - exiting 22:23:15 (8276): No heartbeat from core client for 30 sec - exiting 22:23:16 (8276): No heartbeat from core client for 30 sec - exiting 22:23:17 (8276): No heartbeat from core client for 30 sec - exiting 22:23:19 (8276): No heartbeat from core client for 30 sec - exiting 22:23:20 (8276): No heartbeat from core client for 30 sec - exiting 22:23:22 (8276): No heartbeat from core client for 30 sec - exiting 22:23:23 (8276): No heartbeat from core client for 30 sec - exiting 22:23:24 (8276): No heartbeat from core client for 30 sec - exiting 22:23:25 (8276): No heartbeat from core client for 30 sec - exiting 22:23:26 (8276): No heartbeat from core client for 30 sec - exiting 22:23:27 (8276): No heartbeat from core client for 30 sec - exiting 22:23:28 (8276): No heartbeat from core client for 30 sec - exiting 22:23:29 (8276): No heartbeat from core client for 30 sec - exiting 22:23:30 (8276): No heartbeat from core client for 30 sec - exiting 22:23:31 (8276): No heartbeat from core client for 30 sec - exiting 22:23:32 (8276): No heartbeat from core client for 30 sec - exiting 22:23:34 (8276): No heartbeat from core client for 30 sec - exiting 22:23:35 (8276): No heartbeat from core client for 30 sec - exiting 22:23:36 (8276): No heartbeat from core client for 30 sec - exiting 22:23:37 (8276): No heartbeat from core client for 30 sec - exiting 22:23:38 (8276): No heartbeat from core client for 30 sec - exiting 22:23:39 (8276): No heartbeat from core client for 30 sec - exiting 22:23:40 (8276): No heartbeat from core client for 30 sec - exiting 22:23:41 (8276): No heartbeat from core client for 30 sec - exiting 22:23:42 (8276): No heartbeat from core client for 30 sec - exiting 22:23:43 (8276): No heartbeat from core client for 30 sec - exiting 22:23:44 (8276): No heartbeat from core client for 30 sec - exiting 22:23:46 (8276): No heartbeat from core client for 30 sec - exiting 22:23:47 (8276): No heartbeat from core client for 30 sec - exiting 22:23:48 (8276): No heartbeat from core client for 30 sec - exiting 22:23:49 (8276): No heartbeat from core client for 30 sec - exiting 22:23:50 (8276): No heartbeat from core client for 30 sec - exiting 22:23:51 (8276): No heartbeat from core client for 30 sec - exiting 22:23:52 (8276): No heartbeat from core client for 30 sec - exiting 22:23:53 (8276): No heartbeat from core client for 30 sec - exiting 22:23:54 (8276): No heartbeat from core client for 30 sec - exiting 22:23:55 (8276): No heartbeat from core client for 30 sec - exiting 22:23:56 (8276): No heartbeat from core client for 30 sec - exiting 22:23:58 (8276): No heartbeat from core client for 30 sec - exiting 22:23:59 (8276): No heartbeat from core client for 30 sec - exiting 22:24:00 (8276): No heartbeat from core client for 30 sec - exiting 22:24:01 (8276): No heartbeat from core client for 30 sec - exiting 22:24:02 (8276): No heartbeat from core client for 30 sec - exiting 22:24:03 (8276): No heartbeat from core client for 30 sec - exiting 22:24:04 (8276): No heartbeat from core client for 30 sec - exiting 22:24:05 (8276): No heartbeat from core client for 30 sec - exiting 22:24:06 (8276): No heartbeat from core client for 30 sec - exiting 22:24:07 (8276): No heartbeat from core client for 30 sec - exiting 22:24:09 (8276): No heartbeat from core client for 30 sec - exiting 22:24:10 (8276): No heartbeat from core client for 30 sec - exiting 22:24:11 (8276): No heartbeat from core client for 30 sec - exiting 22:24:12 (8276): No heartbeat from core client for 30 sec - exiting 22:24:14 (8276): No heartbeat from core client for 30 sec - exiting 22:24:15 (8276): No heartbeat from core client for 30 sec - exiting 22:24:16 (8276): No heartbeat from core client for 30 sec - exiting 22:24:17 (8276): No heartbeat from core client for 30 sec - exiting 22:24:18 (8276): No heartbeat from core client for 30 sec - exiting 22:24:20 (8276): No heartbeat from core client for 30 sec - exiting 22:24:21 (8276): No heartbeat from core client for 30 sec - exiting 22:24:22 (4968): start_timer_thread(): CreateThread() failed, errno 0 22:24:22 (8276): No heartbeat from core client for 30 sec - exiting 22:24:23 (8276): No heartbeat from core client for 30 sec - exiting 22:24:24 (8276): No heartbeat from core client for 30 sec - exiting 22:24:25 (8276): No heartbeat from core client for 30 sec - exiting 22:24:26 (8276): No heartbeat from core client for 30 sec - exiting 22:24:27 (8276): No heartbeat from core client for 30 sec - exiting 22:24:28 (8276): No heartbeat from core client for 30 sec - exiting 22:24:30 (8276): No heartbeat from core client for 30 sec - exiting 22:24:31 (8276): No heartbeat from core client for 30 sec - exiting 22:24:31 (7764): start_timer_thread(): CreateThread() failed, errno 0 22:24:32 (8276): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:28:06 (8252): start_timer_thread(): CreateThread() failed, errno 0 22:28:07 (4964): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 23:19:54 (5436): start_timer_thread(): CreateThread() failed, errno 0 23:19:55 (6076): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 18:46:03 (1044): start_timer_thread(): CreateThread() failed, errno 0 18:46:04 (6772): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 18:54:10 (8744): start_timer_thread(): CreateThread() failed, errno 0 18:54:11 (6152): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 19:09:16 (3488): start_timer_thread(): CreateThread() failed, errno 0 19:09:17 (3496): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 19:20:38 (9108): start_timer_thread(): CreateThread() failed, errno 0 19:20:39 (6644): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 19:36:55 (4148): start_timer_thread(): CreateThread() failed, errno 0 19:36:56 (7908): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 20:23:52 (8560): start_timer_thread(): CreateThread() failed, errno 0 20:23:54 (956): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:05:47 (6964): start_timer_thread(): CreateThread() failed, errno 0 20:05:48 (6984): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 20:20:49 (3956): start_timer_thread(): CreateThread() failed, errno 0 20:20:50 (6212): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 21:55:50 (4800): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:59:07 (1020): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 22:36:20 (8292): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 20:48:12 (7516): start_timer_thread(): CreateThread() failed, errno 0 20:48:14 (4412): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 20:55:03 (8364): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 21:03:24 (1080): start_timer_thread(): CreateThread() failed, errno 0 21:03:25 (384): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 19:39:02 (8776): start_timer_thread(): CreateThread() failed, errno 0 19:39:03 (6940): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 20:16:31 (3784): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:53:59 (4920): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:30:05 (7744): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:24:20 (5144): start_timer_thread(): CreateThread() failed, errno 0 00:24:22 (7380): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 19:24:54 (1160): start_timer_thread(): CreateThread() failed, errno 0 19:24:56 (3400): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 20:45:34 (5192): start_timer_thread(): CreateThread() failed, errno 0 20:45:36 (2828): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 21:01:36 (7288): start_timer_thread(): CreateThread() failed, errno 0 21:01:39 (2556): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 21:09:26 (5812): start_timer_thread(): CreateThread() failed, errno 0 21:09:28 (1140): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 21:13:54 (6428): start_timer_thread(): CreateThread() failed, errno 0 21:13:56 (1524): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 21:38:29 (8152): start_timer_thread(): CreateThread() failed, errno 0 21:38:30 (6256): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 22:19:58 (7492): start_timer_thread(): CreateThread() failed, errno 0 22:20:00 (2204): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 23:09:03 (4152): start_timer_thread(): CreateThread() failed, errno 0 23:09:05 (7660): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 23:24:05 (7620): start_timer_thread(): CreateThread() failed, errno 0 23:24:06 (7692): start_timer_thread(): CreateThread() failed, errno 0 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7692, selfPID=8188, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_anz_d067_2012_1_009783460_0_4.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_d067_2012_1_009783460_0_5.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_d067_2012_1_009783460_0_6.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_d067_2012_1_009783460_0_7.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_d067_2012_1_009783460_0_8.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_d067_2012_1_009783460_0_9.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_d067_2012_1_009783460_0_10.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_d067_2012_1_009783460_0_11.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_d067_2012_1_009783460_0_12.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
19 Jul 2015 20:04:13	1323040	18349087	hadam3p_anz_d067_2012_1_009783460_0	34,859	163,121	4.6795
29 May 2015 10:52:43	1323040	18349087	hadam3p_anz_d067_2012_1_009783460_0	23,339	108,436	4.6461
10 May 2015 12:29:48	1323040	18349087	hadam3p_anz_d067_2012_1_009783460_0	11,819	54,985	4.6523