Task 20770512

Name	wah2_pnw25_rahr_199912_24_664_011269714_0
Workunit	11269714
Created	28 Sep 2017, 21:58:06 UTC
Sent	30 Sep 2017, 3:21:08 UTC
Report deadline	12 Sep 2018, 8:41:08 UTC
Received	7 Oct 2017, 14:16:08 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	194 (0x000000C2) EXIT_ABORTED_BY_CLIENT
Computer ID	1433867
Run time	23 hours 34 min 4 sec
CPU time	18 hours 19 min 24 sec
Validate state	Invalid
Credit	3,059.47
Device peak FLOPS	4.87 GFLOPS
Application version	Weather At Home 2 (wah2) v8.24 windows_intelx86
Peak working set size	181.19 MB
Peak swap size	165.95 MB
Peak disk usage	0.02 MB
Stderr	<core_client_version>7.8.2</core_client_version> <![CDATA[ <message> finish file present too long </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 00:54:00 (14148): start_timer_thread(): CreateThread() failed, errno 0 00:54:02 (1124): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 01:11:17 (13344): start_timer_thread(): CreateThread() failed, errno 0 01:11:19 (12668): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 10:02:05 (2244): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:31:08 (600): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:30:25 (23452): start_timer_thread(): CreateThread() failed, errno 0 Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=23452, iMonCtr=1 14:30:37 (6032): start_timer_thread(): CreateThread() failed, errno 0 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=0, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6032, selfPID=1940, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_ain::Monitor... 14:30:43 (1940): called boinc_finish(0) CPDN Monitor - Abort request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x0048EE46 write attempt to address 0x026FF12C Engaging BOINC Windows Runtime Debugger... ****************** BOINC Windows Runtime Debugger Version 7.7.0 Dump Timestamp : 10/07/17 14:32:54 Install Directory : Data Directory : E:\ProgramData\BOINC Project Symstore : LoadLibraryA( E:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126 Loaded Library : dbghelp.dll LoadLibraryA( E:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126 LoadLibraryA( symsrv.dll ): GetLastError = 126 LoadLibraryA( E:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126 LoadLibraryA( srcsrv.dll ): GetLastError = 126 LoadLibraryA( E:\ProgramData\BOINC\version.dll ): GetLastError = 126 Loaded Library : version.dll Debugger Engine : 4.0.5.0 Symbol Search Path: E:\ProgramData\BOINC\projects\climateprediction.net;E:\ProgramData\BOINC\projects\climateprediction.net ModLoad: 0000000000400000 0000000000152000 E:\ProgramData\BOINC\projects\climateprediction.net\wah2_8.24_windows_intelx86.exe (-nosymbols- Symbols Loaded) Linked PDB Filename : ModLoad: 0000000077e60000 000000000018e000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.15063.608) (-exported- Symbols Loaded) Linked PDB Filename : wntdll.pdb File Version : 10.0.15063.608 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.15063.608 ModLoad: 0000000077c90000 00000000000d0000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.15063.296) (-exported- Symbols Loaded) Linked PDB Filename : wkernel32.pdb File Version : 10.0.15063.608 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.15063.608 ModLoad: 0000000075920000 00000000001c2000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.15063.608) (-exported- Symbols Loaded) Linked PDB Filename : wkernelbase.pdb File Version : 10.0.15063.608 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.15063.608 ModLoad: 0000000074950000 000000000013c000 C:\WINDOWS\System32\USER32.dll (6.2.15063.608) (-exported- Symbols Loaded) Linked PDB Filename : wuser32.pdb File Version : 10.0.15063.0 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.15063.0 ModLoad: 0000000077480000 0000000000016000 C:\WINDOWS\System32\win32u.dll (6.2.15063.608) (-exported- Symbols Loaded) Linked PDB Filename : wwin32u.pdb File Version : 10.0.15063.608 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.15063.608 ModLoad: 0000000077660000 0000000000021000 C:\WINDOWS\System32\GDI32.dll (6.2.15063.483) (-exported- Symbols Loaded) Linked PDB Filename : wgdi32.pdb File Version : 10.0.15063.483 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.15063.483 ModLoad: 0000000074c60000 0000000000158000 C:\WINDOWS\System32\gdi32full.dll (6.2.15063.608) (-exported- Symbols Loaded) Linked PDB Filename : wgdi32full.pdb File Version : 10.0.15063.608 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.15063.608 ModLoad: 0000000077340000 0000000000079000 C:\WINDOWS\System32\msvcp_win.dll (6.2.15063.0) (-exported- Symbols Loaded) Linked PDB Filename : msvcp_win.pdb File Version : 10.0.15063.0 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.15063.0 ModLoad: 0000000074dd0000 0000000000118000 C:\WINDOWS\System32\ucrtbase.dll (6.2.15063.447) (-exported- Symbols Loaded) Linked PDB Filename : ucrtbase.pdb File Version : 10.0.15063.447 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.15063.447 ModLoad: 0000000077dd0000 0000000000077000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.15063.0) (-exported- Symbols Loaded) Linked PDB Filename : advapi32.pdb File Version : 10.0.15063.0 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.15063.0 ModLoad: 00000000773c0000 00000000000bd000 C:\WINDOWS\System32\msvcrt.dll (7.0.15063.0) (-exported- Symbols Loaded) Linked PDB Filename : msvcrt.pdb File Version : 7.0.15063.0 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 7.0.15063.0 ModLoad: 00000000750a0000 0000000000041000 C:\WINDOWS\System32\sechost.dll (6.2.15063.0) (-exported- Symbols Loaded) Linked PDB Filename : sechost.pdb File Version : 10.0.15063.0 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.15063.0 ModLoad: 0000000075b30000 00000000000c0000 C:\WINDOWS\System32\RPCRT4.dll (6.2.15063.447) (-exported- Symbols Loaded) Linked PDB Filename : wrpcrt4.pdb File Version : 10.0.15063.0 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.15063.0 ModLoad: 0000000074930000 0000000000020000 C:\WINDOWS\System32\SspiCli.dll (6.2.15063.0) (-exported- Symbols Loaded) Linked PDB Filename : wsspicli.pdb File Version : 10.0.15063.0 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.15063.0 ModLoad: 0000000074920000 000000000000a000 C:\WINDOWS\System32\CRYPTBASE.dll (6.2.15063.0) (-exported- Symbols Loaded) Linked PDB Filename : cryptbase.pdb File Version : 10.0.15063.0 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.15063.0 ModLoad: 00000000774a0000 0000000000057000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.15063.138) (-exported- Symbols Loaded) Linked PDB Filename : bcryptprimitives.pdb File Version : 10.0.15063.138 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.15063.138 ModLoad: 0000000077510000 0000000000025000 C:\WINDOWS\System32\IMM32.DLL (6.2.15063.0) (-exported- Symbols Loaded) Linked PDB Filename : wimm32.pdb File Version : 10.0.15063.0 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.15063.0 ModLoad: 0000000074340000 000000000015d000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.15063.447) (-exported- Symbols Loaded) Linked PDB Filename : dbghelp.pdb File Version : 10.0.15063.447 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.15063.447 ModLoad: 00000000748c0000 0000000000008000 C:\WINDOWS\SYSTEM32\version.dll (6.2.15063.0) (-exported- Symbols Loaded) Linked PDB Filename : version.pdb File Version : 10.0.15063.0 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.15063.0 * Dump of the Process Statistics: * - I/O Operations Counters - Read: 5983, Write: 0, Other 63593 - I/O Transfers Counters - Read: 0, Write: 4290, Other 0 - Paged Pool Usage - QuotaPagedPoolUsage: 90480, QuotaPeakPagedPoolUsage: 90640 QuotaNonPagedPoolUsage: 8488, QuotaPeakNonPagedPoolUsage: 8640 - Virtual Memory Usage - VirtualSize: 57008128, PeakVirtualSize: 57008128 - Pagefile Usage - PagefileUsage: 4198400, PeakPagefileUsage: 4198400 - Working Set Size - WorkingSetSize: 6713344, PeakWorkingSetSize: 6713344, PageFaultCount: 1948 * Dump of thread ID 6620 (state: Waiting): * - Information - Status: Wait Reason: UserRequest, , Kernel Time: 23437500.000000, User Time: 16406250.000000, Wait Time: 3554270.000000 - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x0048EE46 write attempt to address 0x026FF12C - Registers - eax=00000065 ebx=004b63b9 ecx=0019d8e8 edx=026ff12c esi=0019d6a0 edi=0019d918 eip=0048ee46 esp=0019d634 ebp=0019d8c4 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00010202 - Callstack - ChildEBP RetAddr Args to Child 0019d8c4 0048161c 0019d8e8 004b63b8 00000000 0019d918 wah2_8.24_windows_intelx86!+0x0 0019d908 0044fa52 026ff12c 004b63b8 004b6484 00000421 wah2_8.24_windows_intelx86!+0x0 0019d928 00496e90 0000000b 00000000 00000000 00000000 wah2_8.24_windows_intelx86!+0x0 0019d940 00485ca1 c0000005 0019d974 00490c54 00000000 wah2_8.24_windows_intelx86!+0x0 0019ff80 77ca8744 0024c000 77ca8720 8563d8c8 0019ffdc wah2_8.24_windows_intelx86!+0x0 0019ff94 77ec582d 0024c000 24e3061a 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 0019ffdc 77ec57fd ffffffff 77ee6383 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 0019ffec 00000000 00485cce 0024c000 00000000 78746341 ntdll!RtlGetAppContainerNamedObjectPath+0x0 * Dump of thread ID 15188 (state: Waiting): * - Information - Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 3553575.000000 - Registers - eax=00000000 ebx=007b4dc0 ecx=00000000 edx=00000000 esi=007b5290 edi=007b5450 eip=77ed396c esp=009afd7c ebp=009aff80 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000202 - Callstack - ChildEBP RetAddr Args to Child 009aff80 77ca8744 007b4dc0 77ca8720 85e0d8c8 009affdc ntdll!ZwWaitForWorkViaWorkerFactory+0x0 009aff94 77ec582d 007b4dc0 2460061a 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 009affdc 77ec57fd ffffffff 77ee6383 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 009affec 00000000 77e9a470 007b4dc0 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 * Dump of thread ID 10676 (state: Waiting): * - Information - Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 3553575.000000 - Registers - eax=00000000 ebx=007b4dc0 ecx=00000000 edx=00000000 esi=007b5e08 edi=007b5fc8 eip=77ed396c esp=00aafd7c ebp=00aaff80 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000202 - Callstack - ChildEBP RetAddr Args to Child 00aaff80 77ca8744 007b4dc0 77ca8720 85d0d8c8 00aaffdc ntdll!ZwWaitForWorkViaWorkerFactory+0x0 00aaff94 77ec582d 007b4dc0 2450061a 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 00aaffdc 77ec57fd ffffffff 77ee6383 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 00aaffec 00000000 77e9a470 007b4dc0 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 * Dump of thread ID 17264 (state: Waiting): * - Information - Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 3553575.000000 - Registers - eax=00000000 ebx=007b4dc0 ecx=00000000 edx=00000000 esi=007b62c8 edi=007b6488 eip=77ed396c esp=00bafd7c ebp=00baff80 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000202 - Callstack - ChildEBP RetAddr Args to Child 00baff80 77ca8744 007b4dc0 77ca8720 85c0d8c8 00baffdc ntdll!ZwWaitForWorkViaWorkerFactory+0x0 00baff94 77ec582d 007b4dc0 2440061a 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 00baffdc 77ec57fd ffffffff 77ee6383 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 00baffec 00000000 77e9a470 007b4dc0 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 * Dump of thread ID 13972 (state: Waiting): * - Information - Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 3554265.000000 - Registers - eax=00000000 ebx=025afd1c ecx=00000000 edx=00000000 esi=00000000 edi=00000001 eip=77ed205c esp=025afcdc ebp=025afd40 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000202 - Callstack - ChildEBP RetAddr Args to Child 025afd40 75a1354f 00000064 00000000 025aff80 00478b44 ntdll!NtDelayExecution+0x0 025afd50 00478b44 00000064 00478b20 00478b20 00000000 KERNELBASE!Sleep+0x0 025aff80 77ca8744 00000000 77ca8720 8720d8c8 025affdc wah2_8.24_windows_intelx86!+0x0 025aff94 77ec582d 00000000 26a0061a 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 025affdc 77ec57fd ffffffff 77ee6383 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 025affec 00000000 00478b20 00000000 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 * Debug Message Dump ** * Foreground Window Data *** Window Name : Window Class : Window Process ID: 0 Window Thread ID : 0 Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
07 Oct 2017 09:21:08	1433867	20770512	wah2_pnw25_rahr_199912_24_664_011269714_0	46,379	54,485	1.1748
07 Oct 2017 04:33:18	1433867	20770512	wah2_pnw25_rahr_199912_24_664_011269714_0	34,859	41,359	1.1865
07 Oct 2017 00:38:01	1433867	20770512	wah2_pnw25_rahr_199912_24_664_011269714_0	23,339	28,293	1.2123
30 Sep 2017 10:30:00	1433867	20770512	wah2_pnw25_rahr_199912_24_664_011269714_0	11,819	14,729	1.2462