Task 21088383

Name	wah2_eas50_n0zb_201612_10_712_011491030_0
Workunit	11491030
Created	23 Feb 2018, 14:58:54 UTC
Sent	24 Feb 2018, 10:31:42 UTC
Report deadline	6 Feb 2019, 15:51:42 UTC
Received	6 Mar 2018, 2:07:18 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	194 (0x000000C2) EXIT_ABORTED_BY_CLIENT
Computer ID	1436093
Run time	1 days 19 hours 25 min 18 sec
CPU time	1 days 12 hours 14 min 48 sec
Validate state	Invalid
Credit	3,819.41
Device peak FLOPS	5.12 GFLOPS
Application version	Weather At Home 2 (wah2) v8.24 windows_intelx86
Peak working set size	253.46 MB
Peak swap size	216.19 MB
Peak disk usage	111.82 MB
Stderr	<core_client_version>7.8.3</core_client_version> <![CDATA[ <message> finish file present too long</message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=27392, selfPID=21148, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 14:54:21 (7660): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:49:20 (9844): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=18920, iMonCtr=2 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=24000, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_ain::Monitor... 04:37:57 (18920): called boinc_finish(0) CPDN Monitor - Abort request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x0048EE46 write attempt to address 0x046B512C Engaging BOINC Windows Runtime Debugger... ****************** BOINC Windows Runtime Debugger Version 7.7.0 Dump Timestamp : 03/05/18 17:06:28 Install Directory : Data Directory : F:\Boinc projects Project Symstore : LoadLibraryA( F:\Boinc projects\dbghelp.dll ): GetLastError = 126 Loaded Library : dbghelp.dll LoadLibraryA( F:\Boinc projects\symsrv.dll ): GetLastError = 126 LoadLibraryA( symsrv.dll ): GetLastError = 126 LoadLibraryA( F:\Boinc projects\srcsrv.dll ): GetLastError = 126 LoadLibraryA( srcsrv.dll ): GetLastError = 126 LoadLibraryA( F:\Boinc projects\version.dll ): GetLastError = 126 Loaded Library : version.dll Debugger Engine : 4.0.5.0 Symbol Search Path: F:\Boinc projects\projects\climateprediction.net;F:\Boinc projects\projects\climateprediction.net ModLoad: 0000000000400000 0000000000152000 F:\Boinc projects\projects\climateprediction.net\wah2_8.24_windows_intelx86.exe (-nosymbols- Symbols Loaded) Linked PDB Filename : ModLoad: 0000000077790000 000000000018d000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.16299.248) (-exported- Symbols Loaded) Linked PDB Filename : wntdll.pdb File Version : 10.0.16299.15 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.16299.15 ModLoad: 0000000074f20000 00000000000d0000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.16299.15) (-exported- Symbols Loaded) Linked PDB Filename : wkernel32.pdb File Version : 10.0.16299.15 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.16299.15 ModLoad: 0000000075680000 00000000001d7000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.16299.248) (-exported- Symbols Loaded) Linked PDB Filename : wkernelbase.pdb File Version : 10.0.16299.15 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.16299.15 ModLoad: 0000000073ce0000 000000000009a000 C:\WINDOWS\SYSTEM32\apphelp.dll (6.2.16299.98) (-exported- Symbols Loaded) Linked PDB Filename : apphelp.pdb File Version : 10.0.16299.15 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.16299.15 ModLoad: 0000000074260000 0000000000175000 C:\WINDOWS\System32\USER32.dll (6.2.16299.125) (-exported- Symbols Loaded) Linked PDB Filename : wuser32.pdb File Version : 10.0.16299.15 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.16299.15 ModLoad: 00000000758a0000 0000000000016000 C:\WINDOWS\System32\win32u.dll (6.2.16299.15) (-exported- Symbols Loaded) Linked PDB Filename : wwin32u.pdb File Version : 10.0.16299.15 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.16299.15 ModLoad: 00000000750b0000 0000000000022000 C:\WINDOWS\System32\GDI32.dll (6.2.16299.15) (-exported- Symbols Loaded) Linked PDB Filename : wgdi32.pdb File Version : 10.0.16299.15 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.16299.15 ModLoad: 0000000074ca0000 000000000015e000 C:\WINDOWS\System32\gdi32full.dll (6.2.16299.98) (-exported- Symbols Loaded) Linked PDB Filename : wgdi32full.pdb File Version : 10.0.16299.98 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.16299.98 ModLoad: 00000000773c0000 000000000007c000 C:\WINDOWS\System32\msvcp_win.dll (6.2.16299.248) (-exported- Symbols Loaded) Linked PDB Filename : msvcp_win.pdb File Version : 10.0.16299.248 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.16299.248 ModLoad: 0000000075310000 0000000000117000 C:\WINDOWS\System32\ucrtbase.dll (6.2.16299.248) (-exported- Symbols Loaded) Linked PDB Filename : ucrtbase.pdb File Version : 10.0.16299.248 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.16299.248 ModLoad: 00000000741e0000 0000000000078000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.16299.192) (-exported- Symbols Loaded) Linked PDB Filename : advapi32.pdb File Version : 10.0.16299.15 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.16299.15 ModLoad: 0000000075250000 00000000000bd000 C:\WINDOWS\System32\msvcrt.dll (7.0.16299.125) (-exported- Symbols Loaded) Linked PDB Filename : msvcrt.pdb File Version : 7.0.16299.125 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 7.0.16299.125 ModLoad: 0000000074490000 0000000000043000 C:\WINDOWS\System32\sechost.dll (6.2.16299.15) (-exported- Symbols Loaded) Linked PDB Filename : sechost.pdb File Version : 10.0.16299.15 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.16299.15 ModLoad: 0000000074ff0000 00000000000be000 C:\WINDOWS\System32\RPCRT4.dll (6.2.16299.192) (-exported- Symbols Loaded) Linked PDB Filename : wrpcrt4.pdb File Version : 10.0.16299.15 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.16299.15 ModLoad: 00000000741b0000 0000000000020000 C:\WINDOWS\System32\SspiCli.dll (6.2.16299.192) (-exported- Symbols Loaded) Linked PDB Filename : wsspicli.pdb File Version : 10.0.16299.192 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.16299.192 ModLoad: 00000000741a0000 000000000000a000 C:\WINDOWS\System32\CRYPTBASE.dll (6.2.16299.15) (-exported- Symbols Loaded) Linked PDB Filename : cryptbase.pdb File Version : 10.0.16299.15 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.16299.15 ModLoad: 0000000074ec0000 0000000000057000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.16299.98) (-exported- Symbols Loaded) Linked PDB Filename : bcryptprimitives.pdb File Version : 10.0.16299.98 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.16299.98 ModLoad: 0000000074e90000 0000000000025000 C:\WINDOWS\System32\IMM32.DLL (6.2.16299.15) (-exported- Symbols Loaded) Linked PDB Filename : wimm32.pdb File Version : 10.0.16299.15 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.16299.15 ModLoad: 0000000077540000 0000000000246000 C:\WINDOWS\System32\combase.dll (6.2.16299.15) (-exported- Symbols Loaded) Linked PDB Filename : combase.pdb File Version : 10.0.16299.15 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.16299.15 ModLoad: 000000006e9e0000 0000000000181000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.16299.15) (-exported- Symbols Loaded) Linked PDB Filename : dbghelp.pdb File Version : 10.0.16299.15 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.16299.15 ModLoad: 0000000074190000 0000000000008000 C:\WINDOWS\SYSTEM32\version.dll (6.2.16299.15) (-exported- Symbols Loaded) Linked PDB Filename : version.pdb File Version : 10.0.16299.15 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.16299.15 * Dump of the Process Statistics: * - I/O Operations Counters - Read: 1506, Write: 0, Other 10666 - I/O Transfers Counters - Read: 0, Write: 1790, Other 0 - Paged Pool Usage - QuotaPagedPoolUsage: 97952, QuotaPeakPagedPoolUsage: 98048 QuotaNonPagedPoolUsage: 8624, QuotaPeakNonPagedPoolUsage: 8912 - Virtual Memory Usage - VirtualSize: 92295168, PeakVirtualSize: 92295168 - Pagefile Usage - PagefileUsage: 3534848, PeakPagefileUsage: 3534848 - Working Set Size - WorkingSetSize: 7106560, PeakWorkingSetSize: 7163904, PageFaultCount: 2154 * Dump of thread ID 15076 (state: Waiting): * - Information - Status: Wait Reason: UserRequest, , Kernel Time: 1250000.000000, User Time: 1718750.000000, Wait Time: 91331024.000000 - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x0048EE46 write attempt to address 0x046B512C - Registers - eax=00000065 ebx=004b63b9 ecx=0019dc08 edx=046b512c esi=0019d9c0 edi=0019dc38 eip=0048ee46 esp=0019d954 ebp=0019dbe4 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00010202 - Callstack - ChildEBP RetAddr Args to Child 0019dbe4 0048161c 0019dc08 004b63b8 00000000 0019dc38 wah2_8.24_windows_intelx86!+0x0 0019dc28 0044fa52 046b512c 004b63b8 004b6484 00000421 wah2_8.24_windows_intelx86!+0x0 0019dc48 00496e90 0000000b 00000000 00000000 00000000 wah2_8.24_windows_intelx86!+0x0 0019dc60 00485ca1 c0000005 0019dc94 00490c54 00000000 wah2_8.24_windows_intelx86!+0x0 0019ff80 74f38654 003e3000 74f38630 0411b5f7 0019ffdc wah2_8.24_windows_intelx86!+0x0 0019ff94 777f4a77 003e3000 0ea3eec8 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 0019ffdc 777f4a47 ffffffff 77819ed6 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 0019ffec 00000000 00485cce 003e3000 00000000 78746341 ntdll!RtlGetAppContainerNamedObjectPath+0x0 * Dump of thread ID 28932 (state: Waiting): * - Information - Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 91329880.000000 - Registers - eax=00000000 ebx=026c7a58 ecx=00000000 edx=00000000 esi=026cf1c0 edi=026cf380 eip=7780041c esp=028bfd8c ebp=028bff80 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000202 - Callstack - ChildEBP RetAddr Args to Child 028bff80 74f38654 026c7a58 74f38630 0683b5f7 028bffdc ntdll!ZwWaitForWorkViaWorkerFactory+0x0 028bff94 777f4a77 026c7a58 0c31eec8 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 028bffdc 777f4a47 ffffffff 77819ed6 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 028bffec 00000000 777c3880 026c7a58 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 * Dump of thread ID 12348 (state: Waiting): * - Information - Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 91329880.000000 - Registers - eax=00000000 ebx=026c7a58 ecx=00000000 edx=00000000 esi=026d0028 edi=026d01e8 eip=7780041c esp=029ffd8c ebp=029fff80 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000202 - Callstack - ChildEBP RetAddr Args to Child 029fff80 74f38654 026c7a58 74f38630 0697b5f7 029fffdc ntdll!ZwWaitForWorkViaWorkerFactory+0x0 029fff94 777f4a77 026c7a58 0c25eec8 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 029fffdc 777f4a47 ffffffff 77819ed6 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 029fffec 00000000 777c3880 026c7a58 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 * Dump of thread ID 23876 (state: Waiting): * - Information - Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 91329880.000000 - Registers - eax=00000000 ebx=026c7a58 ecx=00000000 edx=00000000 esi=026d1050 edi=026d1210 eip=7780041c esp=02b3fd8c ebp=02b3ff80 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000202 - Callstack - ChildEBP RetAddr Args to Child 02b3ff80 74f38654 026c7a58 74f38630 06bbb5f7 02b3ffdc ntdll!ZwWaitForWorkViaWorkerFactory+0x0 02b3ff94 777f4a77 026c7a58 0c09eec8 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 02b3ffdc 777f4a47 ffffffff 77819ed6 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 02b3ffec 00000000 777c3880 026c7a58 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 * Dump of thread ID 21980 (state: Waiting): * - Information - Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 91331024.000000 - Registers - eax=00000000 ebx=00000000 ecx=00000000 edx=00000000 esi=00000000 edi=00000001 eip=777feacc esp=045efcdc ebp=045efd40 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000202 - Callstack - ChildEBP RetAddr Args to Child 045efd40 7578287f 00000064 00000000 045eff80 00478b44 ntdll!ZwDelayExecution+0x0 045efd50 00478b44 00000064 00478b20 00478b20 00000000 KERNELBASE!Sleep+0x0 045eff80 74f38654 00000000 74f38630 0056b5f7 045effdc wah2_8.24_windows_intelx86!+0x0 045eff94 777f4a77 00000000 0ae4eec8 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 045effdc 777f4a47 ffffffff 77819ed6 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 045effec 00000000 00478b20 00000000 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 * Debug Message Dump ** * Foreground Window Data *** Window Name : Window Class : Window Process ID: 0 Window Thread ID : 0 Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
03 Mar 2018 02:22:22	1436093	21088383	wah2_eas50_n0zb_201612_10_712_011491030_0	57,899	112,572	1.9443
02 Mar 2018 05:57:07	1436093	21088383	wah2_eas50_n0zb_201612_10_712_011491030_0	46,379	89,900	1.9384
28 Feb 2018 12:34:13	1436093	21088383	wah2_eas50_n0zb_201612_10_712_011491030_0	34,859	66,083	1.8957
26 Feb 2018 11:54:34	1436093	21088383	wah2_eas50_n0zb_201612_10_712_011491030_0	23,339	43,597	1.8680
25 Feb 2018 12:21:16	1436093	21088383	wah2_eas50_n0zb_201612_10_712_011491030_0	11,819	21,535	1.8221