Task 19194981

Name	hadam3p_anz_q0mb_201212_12_290_010257302_0
Workunit	10257302
Created	14 Jan 2016, 14:34:54 UTC
Sent	14 Jan 2016, 19:42:16 UTC
Report deadline	27 Dec 2016, 1:02:16 UTC
Received	17 Apr 2016, 16:02:10 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1326178
Run time	5 days 1 hours 7 min 37 sec
CPU time	5 days 0 hours 58 min 41 sec
Validate state	Invalid
Credit	4,981.10
Device peak FLOPS	3.60 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.4.42</core_client_version> <![CDATA[ <stderr_txt> 20:43:31 (12172): start_timer_thread(): CreateThread() failed, errno 0 20:43:33 (11640): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 12:13:24 (18080): start_timer_thread(): CreateThread() failed, errno 0 12:13:26 (18076): start_timer_thread(): CreateThread() failed, errno 0 12:37:22 (16852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:38:34 (7288): start_timer_thread(): CreateThread() failed, errno 0 12:38:36 (20308): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 09:55:38 (17992): start_timer_thread(): CreateThread() failed, errno 0 diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 09:55:39 (6672): start_timer_thread(): CreateThread() failed, errno 0 20:06:25 (18272): start_timer_thread(): CreateThread() failed, errno 0 20:06:26 (18816): start_timer_thread(): CreateThread() failed, errno 0 No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=18272, selfPID=18816, iMonCtr=1 11:09:51 (17032): start_timer_thread(): CreateThread() failed, errno 0 11:09:52 (17596): start_timer_thread(): CreateThread() failed, errno 0 12:19:22 (15404): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:24:29 (18532): start_timer_thread(): CreateThread() failed, errno 0 12:24:36 (21868): start_timer_thread(): CreateThread() failed, errno 0 12:27:13 (1816): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:28:57 (17768): start_timer_thread(): CreateThread() failed, errno 0 12:28:58 (18616): start_timer_thread(): CreateThread() failed, errno 0 12:37:22 (17368): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:39:35 (2696): start_timer_thread(): CreateThread() failed, errno 0 12:39:40 (17804): start_timer_thread(): CreateThread() failed, errno 0 13:57:32 (21576): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:59:12 (8788): start_timer_thread(): CreateThread() failed, errno 0 13:59:13 (5344): start_timer_thread(): CreateThread() failed, errno 0 14:07:36 (18912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:08:02 (19408): start_timer_thread(): CreateThread() failed, errno 0 14:08:02 (14000): start_timer_thread(): CreateThread() failed, errno 0 14:17:38 (1744): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:19:16 (4444): start_timer_thread(): CreateThread() failed, errno 0 14:19:20 (4820): start_timer_thread(): CreateThread() failed, errno 0 14:22:38 (11528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:24:00 (14332): start_timer_thread(): CreateThread() failed, errno 0 14:24:01 (16248): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 20:29:44 (17200): start_timer_thread(): CreateThread() failed, errno 0 20:29:46 (17580): start_timer_thread(): CreateThread() failed, errno 0 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=17200, selfPID=17200, iMonCtr=1 No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=17200, selfPID=17580, iMonCtr=1 diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 20:27:40 (4464): start_timer_thread(): CreateThread() failed, errno 0 diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 20:27:42 (17672): start_timer_thread(): CreateThread() failed, errno 0 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4464, selfPID=4464, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4464, selfPID=17672, iMonCtr=1 diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 19:21:58 (9328): start_timer_thread(): CreateThread() failed, errno 0 diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 19:22:04 (17204): start_timer_thread(): CreateThread() failed, errno 0 diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 18:10:10 (19620): start_timer_thread(): CreateThread() failed, errno 0 diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 18:10:11 (20512): start_timer_thread(): CreateThread() failed, errno 0 20:00:20 (18112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 20:01:25 (23248): start_timer_thread(): CreateThread() failed, errno 0 diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 20:01:30 (6508): start_timer_thread(): CreateThread() failed, errno 0 20:04:07 (840): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 20:04:59 (9944): start_timer_thread(): CreateThread() failed, errno 0 diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 20:05:01 (20532): start_timer_thread(): CreateThread() failed, errno 0 20:20:31 (1512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 20:21:20 (20152): start_timer_thread(): CreateThread() failed, errno 0 20:21:21 (14436): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 18:00:20 (17036): start_timer_thread(): CreateThread() failed, errno 0 18:00:22 (17868): start_timer_thread(): CreateThread() failed, errno 0 20:08:16 (4696): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:09:00 (17280): start_timer_thread(): CreateThread() failed, errno 0 20:09:02 (12456): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 11:55:40 (15800): start_timer_thread(): CreateThread() failed, errno 0 diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 11:55:42 (16760): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 13:52:01 (16292): start_timer_thread(): CreateThread() failed, errno 0 diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 13:52:03 (20632): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 17:33:54 (17088): start_timer_thread(): CreateThread() failed, errno 0 17:33:55 (17732): start_timer_thread(): CreateThread() failed, errno 0 No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=17088, selfPID=17732, iMonCtr=1 08:33:22 (17972): start_timer_thread(): CreateThread() failed, errno 0 08:33:24 (18672): start_timer_thread(): CreateThread() failed, errno 0 09:13:46 (16480): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:16:08 (10916): start_timer_thread(): CreateThread() failed, errno 0 09:16:12 (21124): start_timer_thread(): CreateThread() failed, errno 0 09:19:30 (15756): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:21:12 (19164): start_timer_thread(): CreateThread() failed, errno 0 09:21:16 (15748): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 12:29:38 (14972): start_timer_thread(): CreateThread() failed, errno 0 12:29:40 (16388): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 10:04:22 (18496): start_timer_thread(): CreateThread() failed, errno 0 10:04:23 (19212): start_timer_thread(): CreateThread() failed, errno 0 No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=18496, selfPID=19212, iMonCtr=1 10:56:16 (16568): start_timer_thread(): CreateThread() failed, errno 0 10:56:18 (17344): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 12:05:27 (17908): start_timer_thread(): CreateThread() failed, errno 0 12:05:28 (17208): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 13:46:14 (16992): start_timer_thread(): CreateThread() failed, errno 0 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=16992, selfPID=16992, iMonCtr=1 No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=16992, selfPID=14572, iMonCtr=1 10:21:46 (4964): start_timer_thread(): CreateThread() failed, errno 0 10:21:47 (17464): start_timer_thread(): CreateThread() failed, errno 0 No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4964, selfPID=17464, iMonCtr=1 18:16:32 (18008): start_timer_thread(): CreateThread() failed, errno 0 18:16:33 (18736): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 19:34:10 (20364): No heartbeat from core client for 30 sec - exiting 19:34:11 (20364): No heartbeat from core client for 30 sec - exiting 19:34:12 (20364): No heartbeat from core client for 30 sec - exiting 19:34:13 (20364): No heartbeat from core client for 30 sec - exiting 19:34:15 (20364): No heartbeat from core client for 30 sec - exiting 19:34:16 (20364): No heartbeat from core client for 30 sec - exiting 19:34:17 (20364): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:39:29 (6660): start_timer_thread(): CreateThread() failed, errno 0 19:39:31 (10572): start_timer_thread(): CreateThread() failed, errno 0 19:43:07 (17660): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:49:07 (18688): start_timer_thread(): CreateThread() failed, errno 0 19:49:09 (13528): start_timer_thread(): CreateThread() failed, errno 0 19:49:13 (18264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:54:27 (764): start_timer_thread(): CreateThread() failed, errno 0 19:54:28 (22976): start_timer_thread(): CreateThread() failed, errno 0 19:55:04 (16992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:55:39 (3240): start_timer_thread(): CreateThread() failed, errno 0 19:55:42 (17088): start_timer_thread(): CreateThread() failed, errno 0 20:00:48 (21332): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:05:52 (8868): No heartbeat from core client for 30 sec - exiting 20:05:53 (8868): No heartbeat from core client for 30 sec - exiting 20:05:55 (8868): No heartbeat from core client for 30 sec - exiting 20:05:56 (8868): No heartbeat from core client for 30 sec - exiting 20:05:57 (8868): No heartbeat from core client for 30 sec - exiting 20:05:58 (8868): No heartbeat from core client for 30 sec - exiting 20:06:00 (8868): No heartbeat from core client for 30 sec - exiting 20:06:01 (8868): No heartbeat from core client for 30 sec - exiting 20:06:02 (8868): No heartbeat from core client for 30 sec - exiting 20:06:04 (8868): No heartbeat from core client for 30 sec - exiting 20:06:05 (8868): No heartbeat from core client for 30 sec - exiting 20:06:07 (8868): No heartbeat from core client for 30 sec - exiting 20:06:08 (8868): No heartbeat from core client for 30 sec - exiting 20:06:09 (8868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:10:17 (22872): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:11:44 (10080): start_timer_thread(): CreateThread() failed, errno 0 20:12:11 (16120): start_timer_thread(): CreateThread() failed, errno 0 20:16:11 (3436): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:23:47 (24720): No heartbeat from core client for 30 sec - exiting 20:23:49 (24720): No heartbeat from core client for 30 sec - exiting 20:23:50 (24720): No heartbeat from core client for 30 sec - exiting 20:23:51 (24720): No heartbeat from core client for 30 sec - exiting 20:23:53 (24720): No heartbeat from core client for 30 sec - exiting 20:23:54 (24720): No heartbeat from core client for 30 sec - exiting 20:23:55 (24720): No heartbeat from core client for 30 sec - exiting 20:23:57 (24720): No heartbeat from core client for 30 sec - exiting 20:23:58 (24720): No heartbeat from core client for 30 sec - exiting 20:23:59 (24720): No heartbeat from core client for 30 sec - exiting 20:24:01 (24720): No heartbeat from core client for 30 sec - exiting 20:24:02 (24720): No heartbeat from core client for 30 sec - exiting 20:24:03 (24720): No heartbeat from core client for 30 sec - exiting 20:24:04 (24720): No heartbeat from core client for 30 sec - exiting 20:24:06 (24720): No heartbeat from core client for 30 sec - exiting 20:24:07 (24720): No heartbeat from core client for 30 sec - exiting 20:24:08 (24720): No heartbeat from core client for 30 sec - exiting 20:24:10 (24720): No heartbeat from core client for 30 sec - exiting 20:24:11 (24720): No heartbeat from core client for 30 sec - exiting 20:24:12 (24720): No heartbeat from core client for 30 sec - exiting 20:24:14 (24720): No heartbeat from core client for 30 sec - exiting 20:24:15 (24720): No heartbeat from core client for 30 sec - exiting 20:24:16 (24720): No heartbeat from core client for 30 sec - exiting 20:24:17 (24720): No heartbeat from core client for 30 sec - exiting 20:24:19 (24720): No heartbeat from core client for 30 sec - exiting 20:24:20 (24720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:27:56 (26432): start_timer_thread(): CreateThread() failed, errno 0 20:27:57 (15304): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 14:08:52 (10544): start_timer_thread(): CreateThread() failed, errno 0 14:08:53 (20200): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 15:09:01 (16316): start_timer_thread(): CreateThread() failed, errno 0 15:09:02 (8100): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 16:46:18 (14720): start_timer_thread(): CreateThread() failed, errno 0 16:46:19 (18220): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 19:25:08 (4516): start_timer_thread(): CreateThread() failed, errno 0 19:25:10 (18332): start_timer_thread(): CreateThread() failed, errno 0 20:30:45 (17220): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:31:57 (21208): start_timer_thread(): CreateThread() failed, errno 0 20:32:00 (7836): start_timer_thread(): CreateThread() failed, errno 0 20:32:36 (22468): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:34:09 (22720): start_timer_thread(): CreateThread() failed, errno 0 20:34:16 (22760): start_timer_thread(): CreateThread() failed, errno 0 20:35:38 (21708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:36:14 (25016): start_timer_thread(): CreateThread() failed, errno 0 20:36:16 (25340): start_timer_thread(): CreateThread() failed, errno 0 20:46:22 (12056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:47:33 (10480): start_timer_thread(): CreateThread() failed, errno 0 20:47:36 (3656): start_timer_thread(): CreateThread() failed, errno 0 20:51:22 (10964): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:51:52 (25644): start_timer_thread(): CreateThread() failed, errno 0 20:51:53 (25264): start_timer_thread(): CreateThread() failed, errno 0 20:56:24 (24920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:57:33 (15012): start_timer_thread(): CreateThread() failed, errno 0 20:57:35 (12528): start_timer_thread(): CreateThread() failed, errno 0 21:01:24 (28156): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:02:32 (14184): start_timer_thread(): CreateThread() failed, errno 0 21:02:36 (23080): start_timer_thread(): CreateThread() failed, errno 0 21:03:12 (20068): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:05:06 (24108): start_timer_thread(): CreateThread() failed, errno 0 21:05:07 (25752): start_timer_thread(): CreateThread() failed, errno 0 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=25752, selfPID=14756, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 10:35:47 (15444): start_timer_thread(): CreateThread() failed, errno 0 10:35:49 (16984): start_timer_thread(): CreateThread() failed, errno 0 08:37:44 (18404): start_timer_thread(): CreateThread() failed, errno 0 08:37:46 (18688): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=18688, selfPID=18688, iMonCtr=2 09:39:45 (19900): start_timer_thread(): CreateThread() failed, errno 0 09:39:47 (20336): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 11:28:39 (11800): start_timer_thread(): CreateThread() failed, errno 0 11:28:40 (2432): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 12:43:18 (5660): start_timer_thread(): CreateThread() failed, errno 0 12:43:19 (8256): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 12:59:00 (20612): start_timer_thread(): CreateThread() failed, errno 0 12:59:01 (23496): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 18:49:19 (18452): start_timer_thread(): CreateThread() failed, errno 0 18:49:21 (19400): start_timer_thread(): CreateThread() failed, errno 0 20:04:55 (17036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:05:42 (16400): start_timer_thread(): CreateThread() failed, errno 0 20:05:43 (24544): start_timer_thread(): CreateThread() failed, errno 0 20:09:56 (20716): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:10:28 (16076): start_timer_thread(): CreateThread() failed, errno 0 20:10:29 (17988): start_timer_thread(): CreateThread() failed, errno 0 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=17988, selfPID=17988, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 09:38:29 (16576): start_timer_thread(): CreateThread() failed, errno 0 09:38:31 (10660): start_timer_thread(): CreateThread() failed, errno 0 10:10:31 (12652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:12:10 (23356): start_timer_thread(): CreateThread() failed, errno 0 10:12:12 (7112): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 11:06:12 (18176): start_timer_thread(): CreateThread() failed, errno 0 11:06:13 (18656): start_timer_thread(): CreateThread() failed, errno 0 18:36:33 (16688): start_timer_thread(): CreateThread() failed, errno 0 18:36:35 (18000): start_timer_thread(): CreateThread() failed, errno 0 08:47:37 (17292): start_timer_thread(): CreateThread() failed, errno 0 08:47:38 (17348): start_timer_thread(): CreateThread() failed, errno 0 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=17292, selfPID=17348, iMonCtr=1 09:31:09 (18252): start_timer_thread(): CreateThread() failed, errno 0 09:31:10 (18892): start_timer_thread(): CreateThread() failed, errno 0 No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=18252, selfPID=18892, iMonCtr=1 10:07:29 (16872): start_timer_thread(): CreateThread() failed, errno 0 10:07:30 (1820): start_timer_thread(): CreateThread() failed, errno 0 10:24:40 (15212): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:27:07 (21812): start_timer_thread(): CreateThread() failed, errno 0 10:27:09 (21464): start_timer_thread(): CreateThread() failed, errno 0 10:28:18 (1492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:30:24 (19644): start_timer_thread(): CreateThread() failed, errno 0 10:30:28 (23100): start_timer_thread(): CreateThread() failed, errno 0 10:31:50 (23400): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:32:33 (22952): start_timer_thread(): CreateThread() failed, errno 0 10:32:44 (22084): start_timer_thread(): CreateThread() failed, errno 0 10:43:04 (21936): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:43:19 (6740): start_timer_thread(): CreateThread() failed, errno 0 10:43:30 (19860): start_timer_thread(): CreateThread() failed, errno 0 10:47:52 (21064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:48:38 (2736): start_timer_thread(): CreateThread() failed, errno 0 10:48:47 (3552): start_timer_thread(): CreateThread() failed, errno 0 10:49:13 (18760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:51:17 (22996): start_timer_thread(): CreateThread() failed, errno 0 10:51:21 (13992): start_timer_thread(): CreateThread() failed, errno 0 10:51:22 (21188): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:52:28 (13676): start_timer_thread(): CreateThread() failed, errno 0 10:52:30 (6724): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 17:57:10 (18128): start_timer_thread(): CreateThread() failed, errno 0 17:57:12 (19108): start_timer_thread(): CreateThread() failed, errno 0 22:35:01 (17516): start_timer_thread(): CreateThread() failed, errno 0 22:35:03 (17856): start_timer_thread(): CreateThread() failed, errno 0 No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=17516, selfPID=17856, iMonCtr=1 11:18:14 (15316): start_timer_thread(): CreateThread() failed, errno 0 11:18:15 (19392): start_timer_thread(): CreateThread() failed, errno 0 11:38:43 (17280): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:39:45 (20520): start_timer_thread(): CreateThread() failed, errno 0 11:39:48 (21524): start_timer_thread(): CreateThread() failed, errno 0 11:43:46 (1476): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:45:02 (5940): start_timer_thread(): CreateThread() failed, errno 0 11:45:03 (5936): start_timer_thread(): CreateThread() failed, errno 0 11:48:46 (11656): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:49:21 (1796): start_timer_thread(): CreateThread() failed, errno 0 11:49:23 (9900): start_timer_thread(): CreateThread() failed, errno 0 11:51:38 (5148): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN p11:55:29 (5136): start_timer_thread(): CreateThread() failed, errno 0 11:55:33 (17508): start_timer_thread(): CreateThread() failed, errno 0 11:59:34 (17040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:00:33 (1848): start_timer_thread(): CreateThread() failed, errno 0 12:00:37 (24976): start_timer_thread(): CreateThread() failed, errno 0 12:04:35 (2284): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:05:38 (16740): start_timer_thread(): CreateThread() failed, errno 0 12:05:41 (16772): start_timer_thread(): CreateThread() failed, errno 0 12:09:36 (7920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:10:46 (14060): start_timer_thread(): CreateThread() failed, errno 0 12:10:49 (5904): start_timer_thread(): CreateThread() failed, errno 0 12:24:39 (24448): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:25:47 (4468): start_timer_thread(): CreateThread() failed, errno 0 12:25:49 (15336): start_timer_thread(): CreateThread() failed, errno 0 12:29:02 (20460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:32:42 (20476): start_timer_thread(): CreateThread() failed, errno 0 12:32:45 (21756): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 07:59:59 (17564): start_timer_thread(): CreateThread() failed, errno 0 08:00:01 (18580): start_timer_thread(): CreateThread() failed, errno 0 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=17564, selfPID=18580, iMonCtr=1 15:03:41 (16660): start_timer_thread(): CreateThread() failed, errno 0 15:03:43 (17276): start_timer_thread(): CreateThread() failed, errno 0 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=16660, selfPID=16660, iMonCtr=1 No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=16660, selfPID=17276, iMonCtr=1 diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 16:13:42 (18484): start_timer_thread(): CreateThread() failed, errno 0 diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 16:13:44 (19440): start_timer_thread(): CreateThread() failed, errno 0 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=18484, selfPID=18484, iMonCtr=1 No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=18484, selfPID=19440, iMonCtr=1 16:53:08 (17476): start_timer_thread(): CreateThread() failed, errno 0 16:53:10 (18136): start_timer_thread(): CreateThread() failed, errno 0 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=17476, selfPID=17476, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=17476, selfPID=18136, iMonCtr=1 08:51:07 (19352): start_timer_thread(): CreateThread() failed, errno 0 08:51:09 (19728): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 18:14:29 (22484): start_timer_thread(): CreateThread() failed, errno 0 18:14:31 (22544): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 20:30:50 (16628): start_timer_thread(): CreateThread() failed, errno 0 20:30:56 (16876): start_timer_thread(): CreateThread() failed, errno 0 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=16628, selfPID=16628, iMonCtr=1 diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 21:37:17 (18416): start_timer_thread(): CreateThread() failed, errno 0 diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 21:37:18 (18464): start_timer_thread(): CreateThread() failed, errno 0 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=18416, selfPID=18416, iMonCtr=1 19:30:25 (16652): start_timer_thread(): CreateThread() failed, errno 0 19:30:29 (16756): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 19:58:36 (17912): start_timer_thread(): CreateThread() failed, errno 0 19:58:38 (18520): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... No Process Handle Regional Worke20:59:20 (15472): start_timer_thread(): CreateThread() failed, errno 0 20:59:21 (14812): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 21:22:48 (17376): start_timer_thread(): CreateThread() failed, errno 0 21:22:49 (17572): start_timer_thread(): CreateThread() failed, errno 0 diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 18:45:08 (17972): start_timer_thread(): CreateThread() failed, errno 0 diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 18:45:10 (17936): start_timer_thread(): CreateThread() failed, errno 0 19:00:35 (16364): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 19:01:57 (15608): start_timer_thread(): CreateThread() failed, errno 0 19:01:57 (18180): start_timer_thread(): CreateThread() failed, errno 0 19:02:53 (13148): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 19:03:31 (5336): start_timer_thread(): CreateThread() failed, errno 0 diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 19:03:33 (6884): start_timer_thread(): CreateThread() failed, errno 0 19:05:59 (5204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 19:07:14 (15332): start_timer_thread(): CreateThread() failed, errno 0 diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 19:07:17 (22784): start_timer_thread(): CreateThread() failed, errno 0 19:10:59 (13368): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 19:11:35 (16680): start_timer_thread(): CreateThread() failed, errno 0 diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 19:11:44 (21804): start_timer_thread(): CreateThread() failed, errno 0 19:16:01 (20608): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 19:17:47 (19952): start_timer_thread(): CreateThread() failed, errno 0 diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 19:17:52 (17308): start_timer_thread(): CreateThread() failed, errno 0 19:21:01 (2364): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 19:22:24 (18520): start_timer_thread(): CreateThread() failed, errno 0 diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 19:22:28 (10476): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 19:07:33 (17664): start_timer_thread(): CreateThread() failed, errno 0 19:07:34 (18208): start_timer_thread(): CreateThread() failed, errno 0 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=17664, selfPID=17664, iMonCtr=1 19:59:57 (18264): start_timer_thread(): CreateThread() failed, errno 0 19:59:58 (17932): start_timer_thread(): CreateThread() failed, errno 0 20:20:44 (15472): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:21:57 (21772): start_timer_thread(): CreateThread() failed, errno 0 20:22:00 (13328): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 13:11:24 (17180): start_timer_thread(): CreateThread() failed, errno 0 13:11:26 (17688): start_timer_thread(): CreateThread() failed, errno 0 15:01:40 (15864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:03:30 (23672): start_timer_thread(): CreateThread() failed, errno 0 15:03:31 (23196): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 17:35:54 (8836): start_timer_thread(): CreateThread() failed, errno 0 Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=8836, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=0, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5704, selfPID=13408, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_anz_q0mb_201212_12_290_010257302_0_11.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_q0mb_201212_12_290_010257302_0_12.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
15 Apr 2016 12:06:38	1326178	19194981	hadam3p_anz_q0mb_201212_12_290_010257302_0	115,499	423,743	3.6688
05 Apr 2016 15:18:13	1326178	19194981	hadam3p_anz_q0mb_201212_12_290_010257302_0	103,979	380,964	3.6639
04 Apr 2016 10:14:05	1326178	19194981	hadam3p_anz_q0mb_201212_12_290_010257302_0	92,459	339,696	3.6740
20 Mar 2016 18:13:54	1326178	19194981	hadam3p_anz_q0mb_201212_12_290_010257302_0	80,939	297,070	3.6703
19 Mar 2016 17:53:53	1326178	19194981	hadam3p_anz_q0mb_201212_12_290_010257302_0	69,419	252,834	3.6421
16 Mar 2016 17:51:23	1326178	19194981	hadam3p_anz_q0mb_201212_12_290_010257302_0	57,899	211,297	3.6494
06 Mar 2016 17:33:22	1326178	19194981	hadam3p_anz_q0mb_201212_12_290_010257302_0	46,379	169,865	3.6625
26 Feb 2016 07:34:10	1326178	19194981	hadam3p_anz_q0mb_201212_12_290_010257302_0	34,859	128,116	3.6753
26 Jan 2016 22:08:39	1326178	19194981	hadam3p_anz_q0mb_201212_12_290_010257302_0	23,339	84,993	3.6417
17 Jan 2016 19:06:56	1326178	19194981	hadam3p_anz_q0mb_201212_12_290_010257302_0	11,819	42,789	3.6204