Task 19997668

Name	wah2_pnw25_c08o_200312_49_452_010736290_1
Workunit	10736290
Created	27 Sep 2016, 12:12:08 UTC
Sent	27 Sep 2016, 13:24:20 UTC
Report deadline	9 Sep 2017, 18:44:20 UTC
Received	30 Sep 2016, 7:33:23 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	194 (0x000000C2) EXIT_ABORTED_BY_CLIENT
Computer ID	1400529
Run time	1 days 6 hours 15 min 48 sec
CPU time	1 days 4 hours 20 min 23 sec
Validate state	Invalid
Credit	5,339.28
Device peak FLOPS	4.22 GFLOPS
Application version	Weather At Home 2 (wah2) v8.19 windows_intelx86
Peak working set size	180.82 MB
Peak swap size	165.79 MB
Peak disk usage	0.02 MB
Stderr	<core_client_version>7.6.22</core_client_version> <![CDATA[ <message> finish file present too long </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Error converting file to netcdf: D:\Wissenschaft\Rechenkraft\Data/projects/climateprediction.net/wah2_pnw25_c08o_200312_49_452_010736290/dataout\c08oga.pdk3dec No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=14688, selfPID=14688, iMonCtr=1 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Error converting file to netcdf: D:\Wissenschaft\Rechenkraft\Data/projects/climateprediction.net/wah2_pnw25_c08o_200312_49_452_010736290/dataout\c08oga.pdk4feb Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Error converting file to netcdf: D:\Wissenschaft\Rechenkraft\Data/projects/climateprediction.net/wah2_pnw25_c08o_200312_49_452_010736290/dataout\c08oga.pdk4mar Suspended CPDN Monitor - Suspend request from BOINC... Error converting file to netcdf: D:\Wissenschaft\Rechenkraft\Data/projects/climateprediction.net/wah2_pnw25_c08o_200312_49_452_010736290/dataout\c08oga.pdk4apr Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=10064, selfPID=8244, iMonCtr=1 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=10064, selfPID=10064, iMonCtr=1 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Error converting file to netcdf: D:\Wissenschaft\Rechenkraft\Data/projects/climateprediction.net/wah2_pnw25_c08o_200312_49_452_010736290/dataout\c08oga.pdk4may Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Error converting file to netcdf: D:\Wissenschaft\Rechenkraft\Data/projects/climateprediction.net/wah2_pnw25_c08o_200312_49_452_010736290/dataout\c08oga.pdk4jun Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=21976, selfPID=1596, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_ain::Monitor... 08:25:42 (1596): called boinc_finish(0) CPDN Monitor - Abort request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x004981C4 write attempt to address 0x0241B12C Engaging BOINC Windows Runtime Debugger... ****************** BOINC Windows Runtime Debugger Version 7.7.0 Dump Timestamp : 09/30/16 08:32:56 Install Directory : Data Directory : D:\Wissenschaft\Rechenkraft\Data Project Symstore : LoadLibraryA( D:\Wissenschaft\Rechenkraft\Data\dbghelp.dll ): GetLastError = 126 Loaded Library : dbghelp.dll LoadLibraryA( D:\Wissenschaft\Rechenkraft\Data\symsrv.dll ): GetLastError = 126 LoadLibraryA( symsrv.dll ): GetLastError = 126 LoadLibraryA( D:\Wissenschaft\Rechenkraft\Data\srcsrv.dll ): GetLastError = 126 LoadLibraryA( srcsrv.dll ): GetLastError = 126 LoadLibraryA( D:\Wissenschaft\Rechenkraft\Data\version.dll ): GetLastError = 126 Loaded Library : version.dll Debugger Engine : 4.0.5.0 Symbol Search Path: D:\Wissenschaft\Rechenkraft\Data\projects\climateprediction.net;D:\Wissenschaft\Rechenkraft\Data\projects\climateprediction.net ModLoad: 0000000000400000 0000000000153000 D:\Wissenschaft\Rechenkraft\Data\projects\climateprediction.net\wah2_8.19_windows_intelx86.exe (-nosymbols- Symbols Loaded) Linked PDB Filename : ModLoad: 0000000077d70000 0000000000182000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.14393.103) (-exported- Symbols Loaded) Linked PDB Filename : wntdll.pdb File Version : 10.0.14393.0 (rs1_release.160715-1616) Company Name : Microsoft Corporation Product Name : Betriebssystem Microsoft® Windows® Product Version : 10.0.14393.0 ModLoad: 0000000076990000 00000000000e0000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.14393.0) (-exported- Symbols Loaded) Linked PDB Filename : wkernel32.pdb File Version : 10.0.14393.0 (rs1_release.160715-1616) Company Name : Microsoft Corporation Product Name : Betriebssystem Microsoft® Windows® Product Version : 10.0.14393.0 ModLoad: 0000000076dd0000 00000000001a1000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.14393.187) (-exported- Symbols Loaded) Linked PDB Filename : wkernelbase.pdb File Version : 10.0.14393.0 (rs1_release.160715-1616) Company Name : Microsoft Corporation Product Name : Betriebssystem Microsoft® Windows® Product Version : 10.0.14393.0 ModLoad: 000000006f740000 000000000002f000 D:\Sicherheit\Viren\AVG\Av\avghookx.dll (16.111.0.7797) (-nosymbols- Symbols Loaded) Linked PDB Filename : r:\sources\2016_0826_140919\build\avcli_smoke_utils\RU_NTDLL!Win32_vs110\bin\Release_Unicode_NTDLL_vs110\Win32\avghookx.pdb File Version : 16.111.0.7797 Company Name : AVG Technologies CZ, s.r.o. Product Name : AVG Internet Security Product Version : 16.111.0.7797 ModLoad: 0000000074a90000 000000000015f000 C:\WINDOWS\System32\USER32.dll (6.2.14393.5) (-exported- Symbols Loaded) Linked PDB Filename : wuser32.pdb File Version : 10.0.14393.0 (rs1_release.160715-1616) Company Name : Microsoft Corporation Product Name : Betriebssystem Microsoft® Windows® Product Version : 10.0.14393.0 ModLoad: 00000000770e0000 0000000000015000 C:\WINDOWS\System32\win32u.dll (6.2.14393.51) (-exported- Symbols Loaded) Linked PDB Filename : wwin32u.pdb File Version : 10.0.14393.51 (rs1_release_inmarket.160801-1836) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.14393.51 ModLoad: 0000000077c80000 000000000002b000 C:\WINDOWS\System32\GDI32.dll (6.2.14393.0) (-exported- Symbols Loaded) Linked PDB Filename : wgdi32.pdb File Version : 10.0.14393.0 (rs1_release.160715-1616) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.14393.0 ModLoad: 0000000076f80000 000000000015b000 C:\WINDOWS\System32\gdi32full.dll (6.2.14393.0) (-exported- Symbols Loaded) Linked PDB Filename : wgdi32full.pdb File Version : 10.0.14393.0 (rs1_release.160715-1616) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.14393.0 ModLoad: 00000000761b0000 0000000000077000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.14393.0) (-exported- Symbols Loaded) Linked PDB Filename : advapi32.pdb File Version : 10.0.14393.0 (rs1_release.160715-1616) Company Name : Microsoft Corporation Product Name : Betriebssystem Microsoft® Windows® Product Version : 10.0.14393.0 ModLoad: 0000000077cb0000 00000000000be000 C:\WINDOWS\System32\msvcrt.dll (7.0.14393.0) (-exported- Symbols Loaded) Linked PDB Filename : msvcrt.pdb File Version : 7.0.14393.0 (rs1_release.160715-1616) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 7.0.14393.0 ModLoad: 0000000077b80000 0000000000041000 C:\WINDOWS\System32\sechost.dll (6.2.14393.0) (-exported- Symbols Loaded) Linked PDB Filename : sechost.pdb File Version : 10.0.14393.0 (rs1_release.160715-1616) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.14393.0 ModLoad: 00000000768c0000 00000000000c1000 C:\WINDOWS\System32\RPCRT4.dll (6.2.14393.82) (-exported- Symbols Loaded) Linked PDB Filename : wrpcrt4.pdb File Version : 10.0.14393.0 (rs1_release.160715-1616) Company Name : Microsoft Corporation Product Name : Betriebssystem Microsoft® Windows® Product Version : 10.0.14393.0 ModLoad: 0000000074810000 000000000001e000 C:\WINDOWS\System32\SspiCli.dll (6.2.14393.187) (-exported- Symbols Loaded) Linked PDB Filename : wsspicli.pdb File Version : 10.0.14393.187 (rs1_release_inmarket.160906-1818) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.14393.187 ModLoad: 0000000074800000 000000000000a000 C:\WINDOWS\System32\CRYPTBASE.dll (6.2.14393.0) (-exported- Symbols Loaded) Linked PDB Filename : cryptbase.pdb File Version : 10.0.14393.0 (rs1_release.160715-1616) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.14393.0 ModLoad: 0000000076a90000 000000000005a000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.14393.0) (-exported- Symbols Loaded) Linked PDB Filename : bcryptprimitives.pdb File Version : 10.0.14393.0 (rs1_release.160715-1616) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.14393.0 ModLoad: 0000000076bb0000 0000000000025000 C:\WINDOWS\System32\IMM32.DLL (6.2.14393.0) (-exported- Symbols Loaded) Linked PDB Filename : wimm32.pdb File Version : 10.0.14393.0 (rs1_release.160715-1616) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.14393.0 ModLoad: 0000000064530000 0000000000145000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.14321.1024) (-exported- Symbols Loaded) Linked PDB Filename : dbghelp.pdb File Version : 10.0.14321.1024 (rs1_release.160715-1616) Company Name : Microsoft Product Name : Microsoft® Windows® Operating System Product Version : 10.0.14321.1024 ModLoad: 0000000077110000 00000000000e0000 C:\WINDOWS\System32\ucrtbase.dll (6.2.14393.0) (-exported- Symbols Loaded) Linked PDB Filename : ucrtbase.pdb File Version : 10.0.14393.0 (rs1_release.160715-1616) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.14393.0 ModLoad: 00000000747f0000 0000000000008000 C:\WINDOWS\SYSTEM32\version.dll (6.2.14393.0) (-exported- Symbols Loaded) Linked PDB Filename : version.pdb File Version : 10.0.14393.0 (rs1_release.160715-1616) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.14393.0 * Dump of the Process Statistics: * - I/O Operations Counters - Read: 912, Write: 0, Other 8463 - I/O Transfers Counters - Read: 0, Write: 1901, Other 0 - Paged Pool Usage - QuotaPagedPoolUsage: 86384, QuotaPeakPagedPoolUsage: 86544 QuotaNonPagedPoolUsage: 7600, QuotaPeakNonPagedPoolUsage: 8024 - Virtual Memory Usage - VirtualSize: 51810304, PeakVirtualSize: 51810304 - Pagefile Usage - PagefileUsage: 3821568, PeakPagefileUsage: 3821568 - Working Set Size - WorkingSetSize: 5963776, PeakWorkingSetSize: 5963776, PageFaultCount: 1995 * Dump of thread ID 15444 (state: Waiting): * - Information - Status: Wait Reason: UserRequest, , Kernel Time: 1250000.000000, User Time: 3750000.000000, Wait Time: 5328.000000 - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x004981C4 write attempt to address 0x0241B12C - Registers - eax=00000065 ebx=004b7451 ecx=0019dda8 edx=0241b12c esi=0019db60 edi=0019ddd8 eip=004981c4 esp=0019daf4 ebp=0019dd84 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00010202 - Callstack - ChildEBP RetAddr Args to Child 0019dd84 0048230c 0019dda8 004b7450 00000000 0019ddd8 wah2_8.19_windows_intelx86!+0x0 0019ddc8 004506c2 0241b12c 004b7450 004b751c 00000421 wah2_8.19_windows_intelx86!+0x0 0019dde8 00497b50 0000000b 00000000 00000000 00000000 wah2_8.19_windows_intelx86!+0x0 0019de00 00486891 c0000005 0019de34 00491914 00000000 wah2_8.19_windows_intelx86!+0x0 0019ff80 769a62c4 003ee000 769a62a0 1561df7a 0019ffdc wah2_8.19_windows_intelx86!+0x0 0019ff94 77dd0609 003ee000 eba61c8a 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 0019ffdc 77dd05d4 ffffffff 77df253f 00000000 00000000 ntdll!RtlSubscribeWnfStateChangeNotification+0x0 0019ffec 00000000 004868be 003ee000 00000000 78746341 ntdll!RtlSubscribeWnfStateChangeNotification+0x0 * Dump of thread ID 16368 (state: Waiting): * - Information - Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 5326.000000 - Registers - eax=00000000 ebx=022efd1c ecx=00000000 edx=00000000 esi=00000000 edi=022efd1c eip=77dddf4c esp=022efcdc ebp=022efd40 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000202 - Callstack - ChildEBP RetAddr Args to Child 022efd40 76ea2a5f 00000064 00000000 022eff80 00479834 ntdll!NtDelayExecution+0x0 022efd50 00479834 00000064 00479810 00479810 00000000 KERNELBASE!Sleep+0x0 022eff80 769a62c4 00000000 769a62a0 1756df7a 022effdc wah2_8.19_windows_intelx86!+0x0 022eff94 77dd0609 00000000 e9911c8a 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 022effdc 77dd05d4 ffffffff 77df253f 00000000 00000000 ntdll!RtlSubscribeWnfStateChangeNotification+0x0 022effec 00000000 00479810 00000000 00000000 00000000 ntdll!RtlSubscribeWnfStateChangeNotification+0x0 * Debug Message Dump ** * Foreground Window Data *** Window Name : Window Class : Window Process ID: 0 Window Thread ID : 0 Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
29 Sep 2016 15:50:09	1400529	19997668	wah2_pnw25_c08o_200312_49_452_010736290_1	80,939	99,182	1.2254
29 Sep 2016 10:49:26	1400529	19997668	wah2_pnw25_c08o_200312_49_452_010736290_1	69,419	82,507	1.1885
28 Sep 2016 19:36:41	1400529	19997668	wah2_pnw25_c08o_200312_49_452_010736290_1	57,899	66,955	1.1564
28 Sep 2016 15:26:02	1400529	19997668	wah2_pnw25_c08o_200312_49_452_010736290_1	46,379	55,458	1.1958
28 Sep 2016 12:25:32	1400529	19997668	wah2_pnw25_c08o_200312_49_452_010736290_1	34,859	42,956	1.2323
28 Sep 2016 09:25:02	1400529	19997668	wah2_pnw25_c08o_200312_49_452_010736290_1	23,339	31,609	1.3543
27 Sep 2016 18:47:16	1400529	19997668	wah2_pnw25_c08o_200312_49_452_010736290_1	11,819	16,702	1.4131