Task 17944233

Name	hadam3p_anz_n56u_2013_1_009522687_0
Workunit	9604430
Created	11 Feb 2015, 19:45:03 UTC
Sent	13 Feb 2015, 12:37:56 UTC
Report deadline	26 Jan 2016, 17:57:56 UTC
Received	26 Feb 2015, 1:06:22 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1084069
Run time	6 days 3 hours 45 min 20 sec
CPU time	6 days 3 hours 4 min 40 sec
Validate state	Invalid
Credit	3,490.64
Device peak FLOPS	3.42 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.4.27</core_client_version> <![CDATA[ <stderr_txt> 12:39:46 (25560): start_timer_thread(): CreateThread() failed, errno 0 12:39:48 (26868): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 16:54:57 (34472): start_timer_thread(): CreateThread() failed, errno 0 16:54:58 (35084): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 20:50:53 (1784): start_timer_thread(): CreateThread() failed, errno 0 20:50:55 (8172): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 20:57:22 (13268): start_timer_thread(): CreateThread() failed, errno 0 20:57:24 (12556): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 01:58:50 (13000): start_timer_thread(): CreateThread() failed, errno 0 01:58:52 (12072): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 07:00:05 (31160): start_timer_thread(): CreateThread() failed, errno 0 07:00:07 (27096): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 08:41:15 (1864): start_timer_thread(): CreateThread() failed, errno 0 08:41:17 (5800): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 12:25:20 (10560): start_timer_thread(): CreateThread() failed, errno 0 12:25:21 (10212): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 13:15:51 (3220): start_timer_thread(): CreateThread() failed, errno 0 13:15:53 (11952): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:57:50 (14876): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=18268, selfPID=18268, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 23:15:08 (20376): No heartbeat from core client for 30 sec - exiting 23:15:09 (20376): No heartbeat from core client for 30 sec - exiting 23:15:10 (20376): No heartbeat from core client for 30 sec - exiting 23:15:11 (20376): No heartbeat from core client for 30 sec - exiting 23:15:12 (20376): No heartbeat from core client for 30 sec - exiting 23:15:13 (20376): No heartbeat from core client for 30 sec - exiting 23:15:14 (20376): No heartbeat from core client for 30 sec - exiting 23:15:15 (20376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=14788, selfPID=14788, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=16388, selfPID=16388, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 00:12:29 (7332): start_timer_thread(): CreateThread() failed, errno 0 00:12:30 (5136): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 19:08:39 (4496): start_timer_thread(): CreateThread() failed, errno 0 19:08:41 (4900): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 20:40:11 (9300): start_timer_thread(): CreateThread() failed, errno 0 20:40:12 (8416): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 23:41:55 (11460): start_timer_thread(): CreateThread() failed, errno 0 23:41:57 (11260): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 07:32:57 (11460): start_timer_thread(): CreateThread() failed, errno 0 07:32:59 (12204): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 18:38:12 (3320): start_timer_thread(): CreateThread() failed, errno 0 18:38:14 (12216): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 21:09:33 (4224): start_timer_thread(): CreateThread() failed, errno 0 21:09:34 (12112): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 21:15:49 (10568): start_timer_thread(): CreateThread() failed, errno 0 21:15:51 (11396): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 22:21:50 (6192): No heartbeat from core client for 30 sec - exiting 22:21:53 (6192): No heartbeat from core client for 30 sec - exiting 22:21:54 (6192): No heartbeat from core client for 30 sec - exiting 22:21:55 (6192): No heartbeat from core client for 30 sec - exiting 22:21:56 (6192): No heartbeat from core client for 30 sec - exiting 22:21:57 (6192): No heartbeat from core client for 30 sec - exiting 22:21:58 (6192): No heartbeat from core client for 30 sec - exiting 22:21:59 (6192): No heartbeat from core client for 30 sec - exiting 22:22:00 (6192): No heartbeat from core client for 30 sec - exiting 22:22:01 (6192): No heartbeat from core client for 30 sec - exiting 22:22:02 (6192): No heartbeat from core client for 30 sec - exiting 22:22:03 (6192): No heartbeat from core client for 30 sec - exiting 22:22:04 (6192): No heartbeat from core client for 30 sec - exiting 22:22:05 (6192): No heartbeat from core client for 30 sec - exiting 22:22:06 (6192): No heartbeat from core client for 30 sec - exiting 22:22:07 (6192): No heartbeat from core client for 30 sec - exiting 22:22:08 (6192): No heartbeat from core client for 30 sec - exiting 22:22:09 (6192): No heartbeat from core client for 30 sec - exiting 22:22:10 (6192): No heartbeat from core client for 30 sec - exiting 22:22:11 (6192): No heartbeat from core client for 30 sec - exiting 22:22:12 (6192): No heartbeat from core client for 30 sec - exiting 22:22:13 (6192): No heartbeat from core client for 30 sec - exiting 22:22:14 (6192): No heartbeat from core client for 30 sec - exiting 22:22:15 (6192): No heartbeat from core client for 30 sec - exiting 22:22:16 (6192): No heartbeat from core client for 30 sec - exiting 22:22:17 (6192): No heartbeat from core client for 30 sec - exiting 22:22:18 (6192): No heartbeat from core client for 30 sec - exiting 22:22:19 (6192): No heartbeat from core client for 30 sec - exiting 22:22:20 (6192): No heartbeat from core client for 30 sec - exiting 22:22:21 (6192): No heartbeat from core client for 30 sec - exiting 22:22:22 (6192): No heartbeat from core client for 30 sec - exiting 22:22:23 (6192): No heartbeat from core client for 30 sec - exiting 22:22:24 (6192): No heartbeat from core client for 30 sec - exiting 22:22:25 (6192): No heartbeat from core client for 30 sec - exiting 22:22:26 (6192): No heartbeat from core client for 30 sec - exiting 22:22:27 (6192): No heartbeat from core client for 30 sec - exiting 22:22:28 (6192): No heartbeat from core client for 30 sec - exiting 22:22:29 (6192): No heartbeat from core client for 30 sec - exiting 22:22:30 (6192): No heartbeat from core client for 30 sec - exiting 22:22:31 (6192): No heartbeat from core client for 30 sec - exiting 22:22:32 (6192): No heartbeat from core client for 30 sec - exiting 22:22:33 (6192): No heartbeat from core client for 30 sec - exiting 22:22:34 (6192): No heartbeat from core client for 30 sec - exiting 22:22:35 (6192): No heartbeat from core client for 30 sec - exiting 22:22:36 (6192): No heartbeat from core client for 30 sec - exiting 22:22:37 (6192): No heartbeat from core client for 30 sec - exiting 22:22:38 (6192): No heartbeat from core client for 30 sec - exiting 22:22:39 (6192): No heartbeat from core client for 30 sec - exiting 22:22:40 (6192): No heartbeat from core client for 30 sec - exiting 22:22:41 (6192): No heartbeat from core client for 30 sec - exiting 22:22:42 (6192): No heartbeat from core client for 30 sec - exiting 22:22:43 (6192): No heartbeat from core client for 30 sec - exiting 22:22:44 (6192): No heartbeat from core client for 30 sec - exiting 22:22:45 (6192): No heartbeat from core client for 30 sec - exiting 22:22:46 (6192): No heartbeat from core client for 30 sec - exiting 22:22:47 (6192): No heartbeat from core client for 30 sec - exiting 22:22:48 (6192): No heartbeat from core client for 30 sec - exiting 22:22:49 (6192): No heartbeat from core client for 30 sec - exiting 22:22:50 (6192): No heartbeat from core client for 30 sec - exiting 22:22:51 (6192): No heartbeat from core client for 30 sec - exiting 22:22:52 (6192): No heartbeat from core client for 30 sec - exiting 22:22:53 (6192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=10592, selfPID=10592, iMonCtr=2 22:44:42 (3892): No heartbeat from core client for 30 sec - exiting 22:44:43 (3892): No heartbeat from core client for 30 sec - exiting 22:44:44 (3892): No heartbeat from core client for 30 sec - exiting 22:44:45 (3892): No heartbeat from core client for 30 sec - exiting 22:44:46 (3892): No heartbeat from core client for 30 sec - exiting 22:44:47 (3892): No heartbeat from core client for 30 sec - exiting 22:44:48 (3892): No heartbeat from core client for 30 sec - exiting 22:44:49 (3892): No heartbeat from core client for 30 sec - exiting 22:44:50 (3892): No heartbeat from core client for 30 sec - exiting 22:44:51 (3892): No heartbeat from core client for 30 sec - exiting 22:44:52 (3892): No heartbeat from core client for 30 sec - exiting 22:44:53 (3892): No heartbeat from core client for 30 sec - exiting 22:44:54 (3892): No heartbeat from core client for 30 sec - exiting 22:44:55 (3892): No heartbeat from core client for 30 sec - exiting 22:44:56 (3892): No heartbeat from core client for 30 sec - exiting 22:44:57 (3892): No heartbeat from core client for 30 sec - exiting 22:44:58 (3892): No heartbeat from core client for 30 sec - exiting 22:44:59 (3892): No heartbeat from core client for 30 sec - exiting 22:45:00 (3892): No heartbeat from core client for 30 sec - exiting 22:45:01 (3892): No heartbeat from core client for 30 sec - exiting 22:45:02 (3892): No heartbeat from core client for 30 sec - exiting 22:45:03 (3892): No heartbeat from core client for 30 sec - exiting 22:45:04 (3892): No heartbeat from core client for 30 sec - exiting 22:45:05 (3892): No heartbeat from core client for 30 sec - exiting 22:45:06 (3892): No heartbeat from core client for 30 sec - exiting 22:45:07 (3892): No heartbeat from core client for 30 sec - exiting 22:45:08 (3892): No heartbeat from core client for 30 sec - exiting 22:45:09 (3892): No heartbeat from core client for 30 sec - exiting 22:45:10 (3892): No heartbeat from core client for 30 sec - exiting 22:45:11 (3892): No heartbeat from core client for 30 sec - exiting 22:45:12 (3892): No heartbeat from core client for 30 sec - exiting 22:45:13 (3892): No heartbeat from core client for 30 sec - exiting 22:45:14 (3892): No heartbeat from core client for 30 sec - exiting 22:45:15 (3892): No heartbeat from core client for 30 sec - exiting 22:45:16 (3892): No heartbeat from core client for 30 sec - exiting 22:45:17 (3892): No heartbeat from core client for 30 sec - exiting 22:45:18 (3892): No heartbeat from core client for 30 sec - exiting 22:45:19 (3892): No heartbeat from core client for 30 sec - exiting 22:45:20 (3892): No heartbeat from core client for 30 sec - exiting 22:45:21 (3892): No heartbeat from core client for 30 sec - exiting 22:45:22 (3892): No heartbeat from core client for 30 sec - exiting 22:45:23 (3892): No heartbeat from core client for 30 sec - exiting 22:45:24 (3892): No heartbeat from core client for 30 sec - exiting 22:45:25 (3892): No heartbeat from core client for 30 sec - exiting 22:45:26 (3892): No heartbeat from core client for 30 sec - exiting 22:45:27 (3892): No heartbeat from core client for 30 sec - exiting 22:45:28 (3892): No heartbeat from core client for 30 sec - exiting 22:45:29 (3892): No heartbeat from core client for 30 sec - exiting 22:45:30 (3892): No heartbeat from core client for 30 sec - exiting 22:45:31 (3892): No heartbeat from core client for 30 sec - exiting 22:45:32 (3892): No heartbeat from core client for 30 sec - exiting 22:45:33 (3892): No heartbeat from core client for 30 sec - exiting 22:45:34 (3892): No heartbeat from core client for 30 sec - exiting 22:45:35 (3892): No heartbeat from core client for 30 sec - exiting 22:45:36 (3892): No heartbeat from core client for 30 sec - exiting 22:45:37 (3892): No heartbeat from core client for 30 sec - exiting 22:45:38 (3892): No heartbeat from core client for 30 sec - exiting 22:45:39 (3892): No heartbeat from core client for 30 sec - exiting 22:45:40 (3892): No heartbeat from core client for 30 sec - exiting 22:45:41 (3892): No heartbeat from core client for 30 sec - exiting 22:45:42 (3892): No heartbeat from core client for 30 sec - exiting 22:45:43 (3892): No heartbeat from core client for 30 sec - exiting 22:45:44 (3892): No heartbeat from core client for 30 sec - exiting 22:45:45 (3892): No heartbeat from core client for 30 sec - exiting 22:45:46 (3892): No heartbeat from core client for 30 sec - exiting 22:45:47 (3892): No heartbeat from core client for 30 sec - exiting 22:45:48 (3892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional WCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 23:41:03 (8648): No heartbeat from core client for 30 sec - exiting 23:41:04 (8648): No heartbeat from core client for 30 sec - exiting 23:41:06 (8648): No heartbeat from core client for 30 sec - exiting 23:41:07 (8648): No heartbeat from core client for 30 sec - exiting 23:41:08 (8648): No heartbeat from core client for 30 sec - exiting 23:41:09 (8648): No heartbeat from core client for 30 sec - exiting 23:41:10 (8648): No heartbeat from core client for 30 sec - exiting 23:41:11 (8648): No heartbeat from core client for 30 sec - exiting 23:41:12 (5076): start_timer_thread(): CreateThread() failed, errno 0 23:41:12 (8648): No heartbeat from core client for 30 sec - exiting 23:41:13 (5164): start_timer_thread(): CreateThread() failed, errno 0 23:41:13 (8648): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:41:19 (9000): start_timer_thread(): CreateThread() failed, errno 0 23:41:21 (6776): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 02:18:37 (9612): start_timer_thread(): CreateThread() failed, errno 0 02:18:39 (6844): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 03:30:31 (720): start_timer_thread(): CreateThread() failed, errno 0 03:30:32 (1276): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 08:50:41 (10084): start_timer_thread(): CreateThread() failed, errno 0 08:50:42 (3060): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 10:25:46 (3736): start_timer_thread(): CreateThread() failed, errno 0 10:25:47 (1048): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 12:26:47 (2476): start_timer_thread(): CreateThread() failed, errno 0 12:26:49 (5972): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 15:06:52 (5664): start_timer_thread(): CreateThread() failed, errno 0 15:06:53 (9620): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 20:53:33 (4612): start_timer_thread(): CreateThread() failed, errno 0 20:53:34 (8048): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 23:17:07 (6120): start_timer_thread(): CreateThread() fa2led3:17:07 ( 9144): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 00:09:07 (7392): start_timer_thread(): CreateThread() failed, errno 0 00:09:08 (5204): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 07:52:00 (11896): start_timer_thread(): CreateThread() failed, errno 0 07:52:02 (12088): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 18:48:02 (8460): start_timer_thread(): CreateThread() failed, errno 0 18:48:04 (5772): start_timer_thread(): CreateThread() failed, errno 0 19:15:46 (10080): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 20:43:05 (3880): start_timer_thread(): CreateThread() failed, errno 0 20:43:06 (5336): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 22:48:01 (7296): No heartbeat from core client for 30 sec - exiting 22:48:02 (7296): No heartbeat from core client for 30 sec - exiting 22:48:03 (7296): No heartbeat from core client for 30 sec - exiting 22:48:04 (7296): No heartbeat from core client for 30 sec - exiting 22:48:06 (7296): No heartbeat from core client for 30 sec - exiting 22:48:07 (7296): No heartbeat from core client for 30 sec - exiting 22:48:08 (7296): No heartbeat from core client for 30 sec - exiting 22:48:09 (7296): No heartbeat from core client for 30 sec - exiting 22:48:10 (7296): No heartbeat from core client for 30 sec - exiting 22:48:11 (7296): No heartbeat from core client for 30 sec - exiting 22:48:12 (7296): No heartbeat from core client for 30 sec - exiting 22:48:13 (7296): No heartbeat from core client for 30 sec - exiting 22:48:14 (7296): No heartbeat from core client for 30 sec - exiting 22:48:15 (7296): No heartbeat from core client for 30 sec - exiting 22:48:16 (7296): No heartbeat from core client for 30 sec - exiting 22:48:17 (7296): No heartbeat from core client for 30 sec - exiting 22:48:18 (7296): No heartbeat from core client for 30 sec - exiting 22:48:19 (7296): No heartbeat from core client for 30 sec - exiting 22:48:20 (7296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=11188, selfPID=11188, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 23:59:15 (1920): start_timer_thread(): CreateThread() failed, errno 0 23:59:18 (7880): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 07:52:08 (8452): start_timer_thread(): CreateThread() failed, errno 0 07:52:12 (9704): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 16:39:16 (9896): start_timer_thread(): CreateThread() failed, errno 0 16:39:18 (2520): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 17:20:42 (9208): start_timer_thread(): CreateThread() failed, errno 0 17:20:43 (4984): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 18:34:05 (9444): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:58:49 (10912): start_timer_thread(): CreateThread() failed, errno 0 20:58:52 (11112): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 12:03:53 (3444): start_timer_thread(): CreateThread() failed, errno 0 12:03:54 (1800): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 12:15:16 (11592): start_timer_thread(): CreateThread() failed, errno 0 12:15:18 (5768): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:10:13 (8300): No heartbeat from core client for 30 sec - exiting 16:10:14 (8300): No heartbeat from core client for 30 sec - exiting 16:10:15 (8300): No heartbeat from core client for 30 sec - exiting 16:10:16 (8300): No heartbeat from core client for 30 sec - exiting 16:10:17 (8300): No heartbeat from core client for 30 sec - exiting 16:10:18 (8300): No heartbeat from core client for 30 sec - exiting 16:10:19 (8300): No heartbeat from core client for 30 sec - exiting 16:10:20 (8300): No heartbeat from core client for 30 sec - exiting 16:10:21 (8300): No heartbeat from core client for 30 sec - exiting 16:10:22 (8300): No heartbeat from core client for 30 sec - exiting 16:10:23 (8300): No heartbeat from core client for 30 sec - exiting 16:10:24 (8300): No heartbeat from core client for 30 sec - exiting 16:10:25 (8300): No heartbeat from core client for 30 sec - exiting 16:10:26 (8300): No heartbeat from core client for 30 sec - exiting 16:10:27 (8300): No heartbeat from core client for 30 sec - exiting 16:10:28 (8300): No heartbeat from core client for 30 sec - exiting 16:10:29 (8300): No heartbeat from core client for 30 sec - exiting 16:10:30 (8300): No heartbeat from core client for 30 sec - exiting 16:10:31 (8300): No heartbeat from core client for 30 sec - exiting 16:10:32 (8300): No heartbeat from core client for 30 sec - exiting 16:10:33 (8300): No heartbeat from core client for 30 sec - exiting 16:10:34 (8300): No heartbeat from core client for 30 sec - exiting 16:10:35 (8300): No heartbeat from core client for 30 sec - exiting 16:10:36 (8300): No heartbeat from core client for 30 sec - exiting 16:10:37 (8300): No heartbeat from core client for 30 sec - exiting 16:10:38 (8300): No heartbeat from core client for 30 sec - exiting 16:10:39 (8300): No heartbeat from core client for 30 sec - exiting 16:10:40 (8300): No heartbeat from core client for 30 sec - exiting 16:10:41 (8300): No heartbeat from core client for 30 sec - exiting 16:10:42 (8300): No heartbeat from core client for 30 sec - exiting 16:10:43 (8300): No heartbeat from core client for 30 sec - exiting 16:10:44 (8300): No heartbeat from core client for 30 sec - exiting 16:10:45 (8300): No heartbeat from core client for 30 sec - exiting 16:10:46 (8300): No heartbeat from core client for 30 sec - exiting 16:10:47 (8300): No heartbeat from core client for 30 sec - exiting 16:10:48 (8300): No heartbeat from core client for 30 sec - exiting 16:10:49 (8300): No heartbeat from core client for 30 sec - exiting 16:10:50 (8300): No heartbeat from core client for 30 sec - exiting 16:10:51 (8300): No heartbeat from core client for 30 sec - exiting 16:10:52 (8300): No heartbeat from core client for 30 sec - exiting 16:10:53 (8300): No heartbeat from core client for 30 sec - exiting 16:10:54 (8300): No heartbeat from core client for 30 sec - exiting 16:10:55 (8300): No heartbeat from core client for 30 sec - exiting 16:10:56 (8300): No heartbeat from core client for 30 sec - exiting 16:10:57 (8300): No heartbeat from core client for 30 sec - exiting 16:10:58 (8300): No heartbeat from core client for 30 sec - exiting 16:10:59 (8300): No heartbeat from core client for 30 sec - exiting 16:11:00 (8300): No heartbeat from core client for 30 sec - exiting 16:11:01 (8300): No heartbeat from core client for 30 sec - exiting 16:11:02 (8300): No heartbeat from core client for 30 sec - exiting 16:11:03 (8300): No heartbeat from core client for 30 sec - exiting 16:11:04 (8300): No heartbeat from core client for 30 sec - exiting 16:11:05 (8300): No heartbeat from core client for 30 sec - exiting 16:11:06 (8300): No heartbeat from core client for 30 sec - exiting 16:11:07 (8300): No heartbeat from core client for 30 sec - exiting 16:11:08 (8300): No heartbeat from core client for 30 sec - exiting 16:11:09 (8300): No heartbeat from core client for 30 sec - exiting 16:11:10 (8300): No heartbeat from core client for 30 sec - exiting 16:11:11 (8300): No heartbeat from core client for 30 sec - exiting 16:11:12 (8300): No heartbeat from core client for 30 sec - exiting 16:11:13 (8300): No heartbeat from core client for 30 sec - exiting 16:11:14 (8300): No heartbeat from core client for 30 sec - exiting 16:11:15 (8300): No heartbeat from core client for 30 sec - exiting 16:11:16 (8300): No heartbeat from core client for 30 sec - exiting 16:11:17 (8300): No heartbeat from core client for 30 sec - exiting 16:11:18 (8300): No heartbeat from core client for 30 sec - exiting 16:11:19 (8300): No heartbeat from core client for 30 sec - exiting 16:11:20 (8300): No heartbeat from core client for 30 sec - exiting 16:11:21 (8300): No heartbeat from core client for 30 sec - exiting 16:11:22 (8300): No heartbeat from core client for 30 sec - exiting 16:11:23 (8300): No heartbeat from core client for 30 sec - exiting 16:11:24 (8300): No heartbeat from core client for 30 sec - exiting 16:11:25 (8300): No heartbeat from core client for 30 sec - exiting 16:11:26 (8300): No heartbeat from core client for 30 sec - exiting 16:11:27 (8300): No heartbeat from core client for 30 sec - exiting 16:11:28 (8300): No heartbeat from core client for 30 sec - exiting 16:11:29 (8300): No heartbeat from core client for 30 sec - exiting 16:11:30 (8300): No heartbeat from core client for 30 sec - exiting 16:11:31 (8300): No heartbeat from core client for 30 sec - exiting 16:11:32 (8300): No heartbeat from core client for 30 sec - exiting 16:11:33 (8300): No heartbeat from core client for 30 sec - exiting 16:11:34 (8300): No heartbeat from core client for 30 sec - exiting 16:11:35 (8300): No heartbeat from core client for 30 sec - exiting 16:11:36 (8300): No heartbeat from core client for 30 sec - exiting 16:11:37 (8300): No heartbeat from core client for 30 sec - exiting 16:11:38 (8300): No heartbeat from core client for 30 sec - exiting 16:11:39 (8300): No heartbeat from core client for 30 sec - exiting 16:11:40 (8300): No heartbeat from core client for 30 sec - exiting 16:11:41 (8300): No heartbeat from core client for 30 sec - exiting 16:11:42 (8300): No heartbeat from core client for 30 sec - exiting 16:11:43 (8300): No heartbeat from core client for 30 sec - exiting 16:11:44 (8300): No heartbeat from core client for 30 sec - exiting 16:11:45 (8300): No heartbeat from core client for 30 sec - exiting 16:11:46 (8300): No heartbeat from core client for 30 sec - exiting 16:11:47 (8300): No heartbeat from core client for 30 sec - exiting 16:11:48 (8300): No heartbeat from core client for 30 sec - exiting 16:11:49 (8300): No heartbeat from core client for 30 sec - exiting 16:11:50 (8300): No heartbeat from core client for 30 sec - exiting 16:11:51 (8300): No heartbeat from core client for 30 sec - exiting 16:11:52 (8300): No heartbeat from core client for 30 sec - exiting 16:11:53 (8300): No heartbeat from core client for 30 sec - exiting 16:11:54 (8300): No heartbeat from core client for 30 sec - exiting 16:11:55 (8300): No heartbeat from core client for 30 sec - exiting 16:11:56 (8300): No heartbeat from core client for 30 sec - exiting 16:11:57 (8300): No heartbeat from core client for 30 sec - exiting 16:11:58 (8300): No heartbeat from core client for 30 sec - exiting 16:11:59 (8300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1596, selfPID=1596, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 23:17:53 (1524): start_timer_thread(): CreateThread() failed, errno 0 23:17:55 (10100): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 01:31:20 (5812): start_timer_thread(): CreateThread() failed, errno 0 01:31:24 (4540): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 12:46:33 (6544): start_timer_thread(): CreateThread() failed, errno 0 12:46:34 (5024): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 13:38:10 (5204): start_timer_thread(): CreateThread() failed, errno 0 13:38:11 (4056): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 14:55:45 (5316): start_timer_thread(): CreateThread() failed, errno 0 14:55:46 (11016): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 15:22:34 (7672): start_timer_thread(): CreateThread() failed, errno 0 15:22:36 (2468): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 15:31:18 (6972): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 07:50:12 (8084): start_timer_thread(): CreateThread() failed, errno 0 07:50:13 (3124): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 12:45:39 (10568): start_timer_thread(): CreateThread() failed, errno 0 diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 12:45:41 (10692): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 17:01:20 (1876): start_timer_thread(): CreateThread() failed, errno 0 diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 17:01:21 (6892): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 15:32:39 (6348): start_timer_thread(): CreateThread() failed, errno 0 15:32:40 (5240): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 18:32:04 (4776): start_timer_thread(): CreateThread() failed, errno 0 18:32:06 (8812): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 19:36:47 (2128): start_timer_thread(): CreateThread() failed, errno 0 19:36:49 (6484): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 20:32:02 (3972): start_timer_thread(): CreateThread() failed, errno 0 20:32:03 (3632): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 20:47:30 (4796): start_timer_thread(): CreateThread() failed, errno 0 20:47:31 (8340): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 23:52:46 (7728): start_timer_thread(): CreateThread() failed, errno 0 23:52:47 (6488): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 00:09:52 (5168): start_timer_thread(): CreateThread() failed, errno 0 00:09:53 (8960): start_timer_thread(): CreateThread() failed, errno 0 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8960, selfPID=4760, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_anz_n56u_2013_1_009522687_0_8.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_n56u_2013_1_009522687_0_9.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_n56u_2013_1_009522687_0_10.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_n56u_2013_1_009522687_0_11.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_n56u_2013_1_009522687_0_12.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
25 Feb 2015 16:33:54	1084069	17944233	hadam3p_anz_n56u_2013_1_009522687_0	80,939	517,542	6.3942
21 Feb 2015 12:27:32	1084069	17944233	hadam3p_anz_n56u_2013_1_009522687_0	69,419	442,764	6.3781
20 Feb 2015 09:12:23	1084069	17944233	hadam3p_anz_n56u_2013_1_009522687_0	57,899	363,042	6.2703
19 Feb 2015 05:01:11	1084069	17944233	hadam3p_anz_n56u_2013_1_009522687_0	46,379	285,628	6.1586
17 Feb 2015 19:51:39	1084069	17944233	hadam3p_anz_n56u_2013_1_009522687_0	34,859	221,553	6.3557
16 Feb 2015 21:53:52	1084069	17944233	hadam3p_anz_n56u_2013_1_009522687_0	23,339	149,294	6.3968
15 Feb 2015 21:01:13	1084069	17944233	hadam3p_anz_n56u_2013_1_009522687_0	11,819	73,611	6.2282