Task 21464303

Name	wah2_safr50_c3s6_200212_16_777_011699166_2
Workunit	11699166
Created	1 Jan 2019, 18:46:06 UTC
Sent	1 Jan 2019, 18:53:15 UTC
Report deadline	15 Dec 2019, 0:13:15 UTC
Received	3 Feb 2019, 13:54:12 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	194 (0x000000C2) EXIT_ABORTED_BY_CLIENT
Computer ID	1459781
Run time	8 days 6 hours 17 min 1 sec
CPU time	6 days 23 hours 43 min 1 sec
Validate state	Invalid
Credit	8,379.03
Device peak FLOPS	3.24 GFLOPS
Application version	Weather At Home 2 (wah2) v8.24 windows_intelx86
Peak working set size	255.74 MB
Peak swap size	220.23 MB
Peak disk usage	273.03 MB
Stderr	<core_client_version>7.14.2</core_client_version> <![CDATA[ <message> finish file present too long</message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=15272, selfPID=15272, iMonCtr=1 No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=15272, selfPID=5756, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=15688, selfPID=15688, iMonCtr=1 No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=15688, selfPID=2324, iMonCtr=1 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:42:36 (18672): BOINC client no longer exists - exiting 19:42:36 (18672): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=16148, selfPID=13856, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_ain::Monitor... 16:48:56 (13856): called boinc_finish(0) CPDN Monitor - Abort request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x0048EE46 write attempt to address 0x026A612C Engaging BOINC Windows Runtime Debugger... ****************** BOINC Windows Runtime Debugger Version 7.7.0 Dump Timestamp : 02/03/19 16:52:29 Install Directory : Data Directory : D:\ProgramData\BOINC Project Symstore : LoadLibraryA( D:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126 Loaded Library : dbghelp.dll LoadLibraryA( D:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126 LoadLibraryA( symsrv.dll ): GetLastError = 126 LoadLibraryA( D:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126 LoadLibraryA( srcsrv.dll ): GetLastError = 126 LoadLibraryA( D:\ProgramData\BOINC\version.dll ): GetLastError = 126 Loaded Library : version.dll Debugger Engine : 4.0.5.0 Symbol Search Path: D:\ProgramData\BOINC\projects\climateprediction.net;D:\ProgramData\BOINC\projects\climateprediction.net ModLoad: 0000000000400000 0000000000152000 D:\ProgramData\BOINC\projects\climateprediction.net\wah2_8.24_windows_intelx86.exe (-nosymbols- Symbols Loaded) Linked PDB Filename : ModLoad: 0000000077c50000 000000000019c000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.17763.194) (-exported- Symbols Loaded) Linked PDB Filename : wntdll.pdb File Version : 10.0.17763.282 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Îïåðàöèîííàÿ ñèñòåìà Microsoft® Windows® Product Version : 10.0.17763.282 ModLoad: 0000000075b70000 00000000000e0000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.17763.1) (-exported- Symbols Loaded) Linked PDB Filename : wkernel32.pdb File Version : 10.0.17763.282 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Îïåðàöèîííàÿ ñèñòåìà Microsoft® Windows® Product Version : 10.0.17763.282 ModLoad: 0000000076810000 00000000001f9000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.17763.134) (-exported- Symbols Loaded) Linked PDB Filename : wkernelbase.pdb File Version : 10.0.17763.282 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Îïåðàöèîííàÿ ñèñòåìà Microsoft® Windows® Product Version : 10.0.17763.282 ModLoad: 0000000076120000 0000000000199000 C:\WINDOWS\System32\USER32.dll (6.2.17763.168) (-exported- Symbols Loaded) Linked PDB Filename : wuser32.pdb File Version : 10.0.17763.282 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Îïåðàöèîííàÿ ñèñòåìà Microsoft® Windows® Product Version : 10.0.17763.282 ModLoad: 0000000077020000 0000000000017000 C:\WINDOWS\System32\win32u.dll (6.2.17763.1) (-exported- Symbols Loaded) Linked PDB Filename : wwin32u.pdb File Version : 10.0.17763.1 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.17763.1 ModLoad: 0000000077040000 0000000000023000 C:\WINDOWS\System32\GDI32.dll (6.2.17763.1) (-exported- Symbols Loaded) Linked PDB Filename : wgdi32.pdb File Version : 10.0.17763.1 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.17763.1 ModLoad: 0000000075940000 0000000000167000 C:\WINDOWS\System32\gdi32full.dll (6.2.17763.194) (-exported- Symbols Loaded) Linked PDB Filename : wgdi32full.pdb File Version : 10.0.17763.194 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.17763.194 ModLoad: 0000000076a20000 0000000000080000 C:\WINDOWS\System32\msvcp_win.dll (6.2.17763.1) (-exported- Symbols Loaded) Linked PDB Filename : msvcp_win.pdb File Version : 10.0.17763.1 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.17763.1 ModLoad: 0000000076e70000 0000000000123000 C:\WINDOWS\System32\ucrtbase.dll (6.2.17763.1) (-exported- Symbols Loaded) Linked PDB Filename : ucrtbase.pdb File Version : 10.0.17763.1 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.17763.1 ModLoad: 0000000075750000 000000000007e000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.17763.1) (-exported- Symbols Loaded) Linked PDB Filename : advapi32.pdb File Version : 10.0.17763.282 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Îïåðàöèîííàÿ ñèñòåìà Microsoft® Windows® Product Version : 10.0.17763.282 ModLoad: 0000000075c50000 00000000000c0000 C:\WINDOWS\System32\msvcrt.dll (7.0.17763.1) (-exported- Symbols Loaded) Linked PDB Filename : msvcrt.pdb File Version : 7.0.17763.1 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 7.0.17763.1 ModLoad: 00000000755e0000 0000000000079000 C:\WINDOWS\System32\sechost.dll (6.2.17763.1) (-exported- Symbols Loaded) Linked PDB Filename : sechost.pdb File Version : 10.0.17763.1 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.17763.1 ModLoad: 0000000075ab0000 00000000000bf000 C:\WINDOWS\System32\RPCRT4.dll (6.2.17763.194) (-exported- Symbols Loaded) Linked PDB Filename : wrpcrt4.pdb File Version : 10.0.17763.282 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Îïåðàöèîííàÿ ñèñòåìà Microsoft® Windows® Product Version : 10.0.17763.282 ModLoad: 00000000752c0000 0000000000020000 C:\WINDOWS\System32\SspiCli.dll (6.2.17763.1) (-exported- Symbols Loaded) Linked PDB Filename : wsspicli.pdb File Version : 10.0.17763.1 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.17763.1 ModLoad: 00000000752b0000 000000000000a000 C:\WINDOWS\System32\CRYPTBASE.dll (6.2.17763.1) (-exported- Symbols Loaded) Linked PDB Filename : cryptbase.pdb File Version : 10.0.17763.1 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.17763.1 ModLoad: 00000000756e0000 0000000000062000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.17763.1) (-exported- Symbols Loaded) Linked PDB Filename : bcryptprimitives.pdb File Version : 10.0.17763.1 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.17763.1 ModLoad: 0000000077c00000 0000000000025000 C:\WINDOWS\System32\IMM32.DLL (6.2.17763.1) (-exported- Symbols Loaded) Linked PDB Filename : wimm32.pdb File Version : 10.0.17763.1 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.17763.1 ModLoad: 000000006ebf0000 000000000018f000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.17763.1) (-exported- Symbols Loaded) Linked PDB Filename : dbghelp.pdb File Version : 10.0.17763.1 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.17763.1 ModLoad: 0000000074df0000 0000000000008000 C:\WINDOWS\SYSTEM32\version.dll (6.2.17763.1) (-exported- Symbols Loaded) Linked PDB Filename : version.pdb File Version : 10.0.17763.1 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.17763.1 * Dump of the Process Statistics: * - I/O Operations Counters - Read: 1707, Write: 0, Other 16005 - I/O Transfers Counters - Read: 0, Write: 3642, Other 0 - Paged Pool Usage - QuotaPagedPoolUsage: 93104, QuotaPeakPagedPoolUsage: 93264 QuotaNonPagedPoolUsage: 9032, QuotaPeakNonPagedPoolUsage: 9456 - Virtual Memory Usage - VirtualSize: 55828480, PeakVirtualSize: 55828480 - Pagefile Usage - PagefileUsage: 3493888, PeakPagefileUsage: 3493888 - Working Set Size - WorkingSetSize: 6451200, PeakWorkingSetSize: 6455296, PageFaultCount: 1915 * Dump of thread ID 12484 (state: Waiting): * - Information - Status: Wait Reason: UserRequest, , Kernel Time: 6875000.000000, User Time: 5156250.000000, Wait Time: 11904.000000 - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x0048EE46 write attempt to address 0x026A612C - Registers - eax=00000065 ebx=004b63b9 ecx=0019dc80 edx=026a612c esi=0019da38 edi=0019dcb0 eip=0048ee46 esp=0019d9cc ebp=0019dc5c cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00010202 - Callstack - ChildEBP RetAddr Args to Child 0019dc5c 0048161c 0019dc80 004b63b8 00000000 0019dcb0 wah2_8.24_windows_intelx86!+0x0 0019dca0 0044fa52 026a612c 004b63b8 004b6484 00000421 wah2_8.24_windows_intelx86!+0x0 0019dcc0 00496e90 0000000b 00000000 00000000 00000000 wah2_8.24_windows_intelx86!+0x0 0019dcd8 00485ca1 c0000005 0019dd0c 00490c54 00000000 wah2_8.24_windows_intelx86!+0x0 0019ff70 75b8fe09 003a3000 75b8fdf0 0019ffdc 77cb662d wah2_8.24_windows_intelx86!+0x0 0019ff80 77cb662d 003a3000 46714035 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 0019ffdc 77cb65fd ffffffff 77cd5198 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 0019ffec 00000000 00485cce 003a3000 00000000 78746341 ntdll!RtlGetAppContainerNamedObjectPath+0x0 * Dump of thread ID 12400 (state: Waiting): * - Information - Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 10702.000000 - Registers - eax=00000000 ebx=007253c8 ecx=00000000 edx=00000000 esi=00725208 edi=00722958 eip=77cc216c esp=0091fdb4 ebp=0091ff70 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000206 - Callstack - ChildEBP RetAddr Args to Child 0091ff70 75b8fe09 00722958 75b8fdf0 0091ffdc 77cb662d ntdll!NtWaitForWorkViaWorkerFactory+0x0 0091ff80 77cb662d 00722958 46f94035 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 0091ffdc 77cb65fd ffffffff 77cd5198 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 0091ffec 00000000 77c9e230 00722958 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 * Dump of thread ID 11248 (state: Waiting): * - Information - Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 10702.000000 - Registers - eax=00000000 ebx=007291f8 ecx=00000000 edx=00000000 esi=00729038 edi=00722958 eip=77cc216c esp=00a1fdb4 ebp=00a1ff70 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000206 - Callstack - ChildEBP RetAddr Args to Child 00a1ff70 75b8fe09 00722958 75b8fdf0 00a1ffdc 77cb662d ntdll!NtWaitForWorkViaWorkerFactory+0x0 00a1ff80 77cb662d 00722958 46c94035 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 00a1ffdc 77cb65fd ffffffff 77cd5198 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 00a1ffec 00000000 77c9e230 00722958 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 * Dump of thread ID 12464 (state: Waiting): * - Information - Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 10702.000000 - Registers - eax=00000000 ebx=0072a3f0 ecx=00000000 edx=00000000 esi=0072a230 edi=00722958 eip=77cc216c esp=00b1fdb4 ebp=00b1ff70 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000206 - Callstack - ChildEBP RetAddr Args to Child 00b1ff70 75b8fe09 00722958 75b8fdf0 00b1ffdc 77cb662d ntdll!NtWaitForWorkViaWorkerFactory+0x0 00b1ff80 77cb662d 00722958 46d94035 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 00b1ffdc 77cb65fd ffffffff 77cd5198 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 00b1ffec 00000000 77c9e230 00722958 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 * Dump of thread ID 11928 (state: Waiting): * - Information - Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 11904.000000 - Registers - eax=00000000 ebx=025dfd0c ecx=00000000 edx=00000000 esi=00000000 edi=025dfd0c eip=77cc07ec esp=025dfccc ebp=025dfd30 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000206 - Callstack - ChildEBP RetAddr Args to Child 025dfd30 76908aaf 00000064 00000000 025dff70 00478b44 ntdll!ZwDelayExecution+0x0 025dfd40 00478b44 00000064 00478b20 00478b20 00000000 KERNELBASE!Sleep+0x0 025dff70 75b8fe09 00000000 75b8fdf0 025dffdc 77cb662d wah2_8.24_windows_intelx86!+0x0 025dff80 77cb662d 00000000 44354035 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 025dffdc 77cb65fd ffffffff 77cd5198 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 025dffec 00000000 00478b20 00000000 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 * Debug Message Dump ** * Foreground Window Data *** Window Name : Window Class : Window Process ID: 0 Window Thread ID : 0 Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
06 Feb 2019 19:46:44	1459781	21464303	wah2_safr50_c3s6_200212_16_777_011699166_2	127,019	593,935	4.6760
06 Feb 2019 13:58:13	1459781	21464303	wah2_safr50_c3s6_200212_16_777_011699166_2	115,499	543,218	4.7032
06 Feb 2019 13:58:13	1459781	21464303	wah2_safr50_c3s6_200212_16_777_011699166_2	115,499	543,218	4.7032
05 Feb 2019 20:21:57	1459781	21464303	wah2_safr50_c3s6_200212_16_777_011699166_2	103,979	488,455	4.6976
23 Jan 2019 17:24:23	1459781	21464303	wah2_safr50_c3s6_200212_16_777_011699166_2	92,459	435,273	4.7077
20 Jan 2019 09:18:42	1459781	21464303	wah2_safr50_c3s6_200212_16_777_011699166_2	80,939	382,189	4.7219
18 Jan 2019 11:02:44	1459781	21464303	wah2_safr50_c3s6_200212_16_777_011699166_2	69,419	328,041	4.7255
16 Jan 2019 15:55:39	1459781	21464303	wah2_safr50_c3s6_200212_16_777_011699166_2	57,899	270,686	4.6751
12 Jan 2019 18:24:43	1459781	21464303	wah2_safr50_c3s6_200212_16_777_011699166_2	46,379	217,675	4.6934
08 Jan 2019 14:32:21	1459781	21464303	wah2_safr50_c3s6_200212_16_777_011699166_2	34,859	164,822	4.7282
06 Jan 2019 23:44:00	1459781	21464303	wah2_safr50_c3s6_200212_16_777_011699166_2	23,339	113,597	4.8673
04 Jan 2019 20:37:33	1459781	21464303	wah2_safr50_c3s6_200212_16_777_011699166_2	11,819	59,493	5.0337