Task 21848791

Name	wah2_sam50_a059_201312_28_858_011967514_0
Workunit	11967514
Created	16 Dec 2019, 14:24:31 UTC
Sent	16 Dec 2019, 15:28:36 UTC
Report deadline	27 Nov 2020, 20:48:36 UTC
Received	20 Dec 2019, 5:07:41 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	194 (0x000000C2) EXIT_ABORTED_BY_CLIENT
Computer ID	1495239
Run time	1 days 13 hours 13 min 27 sec
CPU time	1 days 10 hours 39 min 24 sec
Validate state	Invalid
Credit	3,059.47
Device peak FLOPS	4.15 GFLOPS
Application version	Weather At Home 2 (wah2) v8.24 windows_intelx86
Peak working set size	225.79 MB
Peak swap size	187.88 MB
Peak disk usage	75.09 MB
Stderr	<core_client_version>7.14.2</core_client_version> <![CDATA[ <message> finish file present too long</message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=16548, iMonCtr=2 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9360, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9872, selfPID=7212, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_ain::Monitor... 23:09:50 (7212): called boinc_finish(0) Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Abort request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x0048EE46 write attempt to address 0x027B912C Engaging BOINC Windows Runtime Debugger... ****************** BOINC Windows Runtime Debugger Version 7.7.0 Dump Timestamp : 12/20/19 05:07:40 Install Directory : Data Directory : F:\ProgramData\BOINC Project Symstore : LoadLibraryA( F:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126 Loaded Library : dbghelp.dll LoadLibraryA( F:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126 LoadLibraryA( symsrv.dll ): GetLastError = 126 LoadLibraryA( F:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126 LoadLibraryA( srcsrv.dll ): GetLastError = 126 LoadLibraryA( F:\ProgramData\BOINC\version.dll ): GetLastError = 126 Loaded Library : version.dll Debugger Engine : 4.0.5.0 Symbol Search Path: F:\ProgramData\BOINC\projects\climateprediction.net;F:\ProgramData\BOINC\projects\climateprediction.net ModLoad: 0000000000400000 0000000000152000 F:\ProgramData\BOINC\projects\climateprediction.net\wah2_8.24_windows_intelx86.exe (-nosymbols- Symbols Loaded) Linked PDB Filename : ModLoad: 0000000077da0000 000000000019a000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.18362.387) (-exported- Symbols Loaded) Linked PDB Filename : wntdll.pdb File Version : 10.0.18362.530 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Betriebssystem Microsoft® Windows® Product Version : 10.0.18362.530 ModLoad: 0000000076930000 00000000000e0000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.18362.329) (-exported- Symbols Loaded) Linked PDB Filename : wkernel32.pdb File Version : 10.0.18362.530 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Betriebssystem Microsoft® Windows® Product Version : 10.0.18362.530 ModLoad: 00000000765b0000 00000000001fc000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.18362.535) (-exported- Symbols Loaded) Linked PDB Filename : wkernelbase.pdb File Version : 10.0.18362.530 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Betriebssystem Microsoft® Windows® Product Version : 10.0.18362.530 ModLoad: 0000000075590000 0000000000197000 C:\WINDOWS\System32\USER32.dll (6.2.18362.535) (-exported- Symbols Loaded) Linked PDB Filename : wuser32.pdb File Version : 10.0.18362.530 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Betriebssystem Microsoft® Windows® Product Version : 10.0.18362.530 ModLoad: 0000000075b00000 0000000000017000 C:\WINDOWS\System32\win32u.dll (6.2.18362.535) (-exported- Symbols Loaded) Linked PDB Filename : wwin32u.pdb File Version : 10.0.18362.535 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.18362.535 ModLoad: 0000000076170000 0000000000021000 C:\WINDOWS\System32\GDI32.dll (6.2.18362.1) (-exported- Symbols Loaded) Linked PDB Filename : wgdi32.pdb File Version : 10.0.18362.1 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.18362.1 ModLoad: 00000000775d0000 000000000015a000 C:\WINDOWS\System32\gdi32full.dll (6.2.18362.535) (-exported- Symbols Loaded) Linked PDB Filename : wgdi32full.pdb File Version : 10.0.18362.535 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.18362.535 ModLoad: 0000000075b20000 000000000007c000 C:\WINDOWS\System32\msvcp_win.dll (6.2.18362.387) (-exported- Symbols Loaded) Linked PDB Filename : msvcp_win.pdb File Version : 10.0.18362.387 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.18362.387 ModLoad: 0000000076810000 000000000011f000 C:\WINDOWS\System32\ucrtbase.dll (6.2.18362.387) (-exported- Symbols Loaded) Linked PDB Filename : ucrtbase.pdb File Version : 10.0.18362.387 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.18362.387 ModLoad: 00000000763a0000 0000000000079000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.18362.329) (-exported- Symbols Loaded) Linked PDB Filename : advapi32.pdb File Version : 10.0.18362.530 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Betriebssystem Microsoft® Windows® Product Version : 10.0.18362.530 ModLoad: 0000000076200000 00000000000bf000 C:\WINDOWS\System32\msvcrt.dll (7.0.18362.1) (-exported- Symbols Loaded) Linked PDB Filename : msvcrt.pdb File Version : 7.0.18362.1 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 7.0.18362.1 ModLoad: 0000000076310000 0000000000076000 C:\WINDOWS\System32\sechost.dll (6.2.18362.267) (-exported- Symbols Loaded) Linked PDB Filename : sechost.pdb File Version : 10.0.18362.1 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.18362.1 ModLoad: 0000000077cd0000 00000000000bb000 C:\WINDOWS\System32\RPCRT4.dll (6.2.18362.476) (-exported- Symbols Loaded) Linked PDB Filename : wrpcrt4.pdb File Version : 10.0.18362.530 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Betriebssystem Microsoft® Windows® Product Version : 10.0.18362.530 ModLoad: 0000000075570000 0000000000020000 C:\WINDOWS\System32\SspiCli.dll (6.2.18362.1) (-exported- Symbols Loaded) Linked PDB Filename : wsspicli.pdb File Version : 10.0.18362.1 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.18362.1 ModLoad: 0000000075560000 000000000000a000 C:\WINDOWS\System32\CRYPTBASE.dll (6.2.18362.1) (-exported- Symbols Loaded) Linked PDB Filename : cryptbase.pdb File Version : 10.0.18362.1 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.18362.1 ModLoad: 00000000761a0000 000000000005f000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.18362.295) (-exported- Symbols Loaded) Linked PDB Filename : bcryptprimitives.pdb File Version : 10.0.18362.295 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.18362.295 ModLoad: 0000000075a10000 0000000000025000 C:\WINDOWS\System32\IMM32.DLL (6.2.18362.387) (-exported- Symbols Loaded) Linked PDB Filename : wimm32.pdb File Version : 10.0.18362.387 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.18362.387 ModLoad: 0000000066c50000 000000000018f000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.18362.1) (-exported- Symbols Loaded) Linked PDB Filename : dbghelp.pdb File Version : 10.0.18362.1 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.18362.1 ModLoad: 0000000073910000 0000000000008000 C:\WINDOWS\SYSTEM32\version.dll (6.2.18362.1) (-exported- Symbols Loaded) Linked PDB Filename : version.pdb File Version : 10.0.18362.1 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.18362.1 * Dump of the Process Statistics: * - I/O Operations Counters - Read: 3489, Write: 0, Other 89579 - I/O Transfers Counters - Read: 0, Write: 1671, Other 0 - Paged Pool Usage - QuotaPagedPoolUsage: 92824, QuotaPeakPagedPoolUsage: 92984 QuotaNonPagedPoolUsage: 9032, QuotaPeakNonPagedPoolUsage: 9320 - Virtual Memory Usage - VirtualSize: 55967744, PeakVirtualSize: 55967744 - Pagefile Usage - PagefileUsage: 3801088, PeakPagefileUsage: 3801088 - Working Set Size - WorkingSetSize: 6287360, PeakWorkingSetSize: 6291456, PageFaultCount: 1843 * Dump of thread ID 19704 (state: Waiting): * - Information - Status: Wait Reason: UserRequest, , Kernel Time: 13437500.000000, User Time: 16875000.000000, Wait Time: 22073710.000000 - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x0048EE46 write attempt to address 0x027B912C - Registers - eax=00000065 ebx=004b63b9 ecx=0019dc78 edx=027b912c esi=0019da30 edi=0019dca8 eip=0048ee46 esp=0019d9c4 ebp=0019dc54 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00010202 - Callstack - ChildEBP RetAddr Args to Child 0019dc54 0048161c 0019dc78 004b63b8 00000000 0019dca8 wah2_8.24_windows_intelx86!+0x0 0019dc98 0044fa52 027b912c 004b63b8 004b6484 00000421 wah2_8.24_windows_intelx86!+0x0 0019dcb8 00496e90 0000000b 00000000 00000000 00000000 wah2_8.24_windows_intelx86!+0x0 0019dcd0 00485ca1 c0000005 0019dd04 00490c54 00000000 wah2_8.24_windows_intelx86!+0x0 0019ff70 76946359 003bf000 76946340 0019ffdc 77e07b74 wah2_8.24_windows_intelx86!+0x0 0019ff80 77e07b74 003bf000 ed92e027 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 0019ffdc 77e07b44 ffffffff 77e28ef6 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 0019ffec 00000000 00485cce 003bf000 00000000 78746341 ntdll!RtlGetAppContainerNamedObjectPath+0x0 * Dump of thread ID 15556 (state: Waiting): * - Information - Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 22072236.000000 - Registers - eax=00000000 ebx=006d6e30 ecx=00000000 edx=00000000 esi=006d6e30 edi=006d5a90 eip=77e13a4c esp=008cfdb8 ebp=008cff70 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000206 - Callstack - ChildEBP RetAddr Args to Child 008cff70 76946359 006d5a90 76946340 008cffdc 77e07b74 ntdll!NtWaitForWorkViaWorkerFactory+0x0 008cff80 77e07b74 006d5a90 ed07e027 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 008cffdc 77e07b44 ffffffff 77e28ef6 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 008cffec 00000000 77df63b0 006d5a90 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 * Dump of thread ID 10300 (state: Waiting): * - Information - Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 22072236.000000 - Registers - eax=00000000 ebx=006d7a28 ecx=00000000 edx=00000000 esi=006d7a28 edi=006d5a90 eip=77e13a4c esp=009cfdb8 ebp=009cff70 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000206 - Callstack - ChildEBP RetAddr Args to Child 009cff70 76946359 006d5a90 76946340 009cffdc 77e07b74 ntdll!NtWaitForWorkViaWorkerFactory+0x0 009cff80 77e07b74 006d5a90 ed17e027 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 009cffdc 77e07b44 ffffffff 77e28ef6 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 009cffec 00000000 77df63b0 006d5a90 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 * Dump of thread ID 13680 (state: Waiting): * - Information - Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 22072236.000000 - Registers - eax=00000000 ebx=006d7e78 ecx=00000000 edx=00000000 esi=006d7e78 edi=006d5a90 eip=77e13a4c esp=00b0fdb8 ebp=00b0ff70 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000206 - Callstack - ChildEBP RetAddr Args to Child 00b0ff70 76946359 006d5a90 76946340 00b0ffdc 77e07b74 ntdll!NtWaitForWorkViaWorkerFactory+0x0 00b0ff80 77e07b74 006d5a90 ed3be027 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 00b0ffdc 77e07b44 ffffffff 77e28ef6 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 00b0ffec 00000000 77df63b0 006d5a90 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 * Dump of thread ID 16212 (state: Waiting): * - Information - Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 22073704.000000 - Registers - eax=00000000 ebx=00000000 ecx=00000000 edx=00000000 esi=00000000 edi=026efd0c eip=77e120bc esp=026efccc ebp=026efd30 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000206 - Callstack - ChildEBP RetAddr Args to Child 026efd30 766be82f 00000064 00000000 026eff70 00478b44 ntdll!NtDelayExecution+0x0 026efd40 00478b44 00000064 00478b20 00478b20 00000000 KERNELBASE!Sleep+0x0 026eff70 76946359 00000000 76946340 026effdc 77e07b74 wah2_8.24_windows_intelx86!+0x0 026eff80 77e07b74 00000000 efe5e027 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 026effdc 77e07b44 ffffffff 77e28ef6 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 026effec 00000000 00478b20 00000000 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 * Debug Message Dump ** * Foreground Window Data *** Window Name : Window Class : Window Process ID: 0 Window Thread ID : 0 Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
19 Dec 2019 17:36:08	1495239	21848791	wah2_sam50_a059_201312_28_858_011967514_0	46,379	107,620	2.3204
18 Dec 2019 10:46:19	1495239	21848791	wah2_sam50_a059_201312_28_858_011967514_0	34,859	81,769	2.3457
17 Dec 2019 15:52:20	1495239	21848791	wah2_sam50_a059_201312_28_858_011967514_0	23,339	55,981	2.3986
17 Dec 2019 08:27:24	1495239	21848791	wah2_sam50_a059_201312_28_858_011967514_0	11,819	29,777	2.5194