climateprediction.net home page
Task 20248455

Task 20248455

Name wah2_pnw25_s6zg_20589_16_526_010924485_0
Workunit 10924485
Created 13 Feb 2017, 11:14:36 UTC
Sent 7 Mar 2017, 19:44:19 UTC
Report deadline 18 Feb 2018, 1:04:19 UTC
Received 15 Mar 2017, 20:21:08 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 0 (0x00000000)
Computer ID 1382966
Run time 6 days 12 hours 32 min
CPU time 6 days 9 hours 27 min 49 sec
Validate state Invalid
Credit 10,658.83
Device peak FLOPS 2.40 GFLOPS
Application version Weather At Home 2 (wah2) v8.24
windows_intelx86
Peak working set size 180.72 MB
Peak swap size 166.50 MB
Peak disk usage 25.60 MB
Stderr 
<core_client_version>7.6.33</core_client_version>
<![CDATA[
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x7792A832

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.7.0


Dump Timestamp    : 03/15/17 20:15:44
Install Directory : 
Data Directory    : C:\ProgramData\BOINC
Project Symstore  : 
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Signal 11 received: Segment violation
Signal 11 received: Software termination signal from kill 
Signal 11 received: Abnormal termination triggered by abort call
Signal 11 received, exitinebugger Engine   : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\projects\climateprediction.net\wah2_pnw25_s6zg_20589_16_526_010924485;C:\ProgramData\BOINC\projects\climateprediction.net


ModLoad: 00000000000f0000 00000000008f0000 C:\ProgramData\BOINC\projects\climateprediction.net\wah2rm3m2t_um_8.24_windows_intelx86.exe (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : F:\cpdn\cpdn\cpdnboinc\monitor\win_build\WAH2 Release\wah2rm3m2t.pdb

ModLoad: 0000000077bc0000 0000000000183000 C:\WINDOWS\SYSTEM32\ntdll.dl. (..2
.14:93.479) (-exported-5:Symbols Loaded)4
 5   Linked PDB Fi(ename   calntdll.pdb
    File Veision          : 10.0n14393.206 (rs1_rec_fse.160915-0inish
    Company (am9e          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operatin
 System
    Product Version       : 10.0.14393.206

ModLoad: 0000000074840000 00000000000e0000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.14393.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : wkernel32.pdb
    File Version          : 10.0.14393.206 (rs1_release.160915-0644)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.14393.206

ModLoad: 0000000077850000 00000000001a1000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.14393.479) (-exported- Symbols Loaded)
    Linked PDB Filename   : wkernelbase.pdb
    File Version          : 10.0.14393.206 (rs1_release.160915-0644)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.14393.206

ModLoad: 0000000075a60000 000000000015f000 C:\WINDOWS\System32\USER32.dll (6.2.14393.576) (-exported- Symbols Loaded)
    Linked PDB Filename   : wuser32.pdb
    File Version          : 10.0.14393.0 (rs1_release.160715-1616)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.14393.0

ModLoad: 0000000077830000 0000000000015000 C:\WINDOWS\System32\win32u.dll (6.2.14393.51) (-exported- Symbols Loaded)
    Linked PDB Filename   : wwin32u.pdb
    File Version          : 10.0.14393.51 (rs1_release_inmarket.160801-1836)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.14393.51

ModLoad: 0000000077a10000 000000000002b000 C:\WINDOWS\System32\GDI32.dll (6.2.14393.206) (-exported- Symbols Loaded)
    Linked PDB Filename   : wgdi32.pdb
    File Version          : 10.0.14393.206 (rs1_release.160915-0644)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.14393.206

ModLoad: 0000000075310000 000000000015b000 C:\WINDOWS\System32\gdi32full.dll (6.2.14393.576) (-exported- Symbols Loaded)
    Linked PDB Filename   : wgdi32full.pdb
    File Version          : 10.0.14393.576 (rs1_release_inmarket.161208-2252)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.14393.576

ModLoad: 0000000075820000 0000000000077000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.14393.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 10.0.14393.0 (rs1_release.160715-1616)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.14393.0

ModLoad: 00000000746a0000 00000000000be000 C:\WINDOWS\System32\msvcrt.dll (7.0.14393.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.14393.0 (rs1_release.160715-1616)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.14393.0

ModLoad: 0000000074990000 0000000000041000 C:\WINDOWS\System32\sechost.dll (6.2.14393.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 10.0.14393.0 (rs1_release.160715-1616)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.14393.0

ModLoad: 00000000756a0000 00000000000c1000 C:\WINDOWS\System32\RPCRT4.dll (6.2.14393.82) (-exported- Symbols Loaded)
    Linked PDB Filename   : wrpcrt4.pdb
    File Version          : 10.0.14393.0 (rs1_release.160715-1616)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.14393.0

ModLoad: 0000000074680000 000000000001e000 C:\WINDOWS\System32\SspiCli.dll (6.2.14393.576) (-exported- Symbols Loaded)
    Linked PDB Filename   : wsspicli.pdb
    File Version          : 10.0.14393.576 (rs1_release_inmarket.161208-2252)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.14393.576

ModLoad: 0000000074670000 000000000000a000 C:\WINDOWS\System32\CRYPTBASE.dll (6.2.14393.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptbase.pdb
    File Version          : 10.0.14393.0 (rs1_release.160715-1616)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.14393.0

ModLoad: 00000000747b0000 000000000005a000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.14393.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcryptprimitives.pdb
    File Version          : 10.0.14393.0 (rs1_release.160715-1616)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.14393.0

ModLoad: 0000000075800000 0000000000019000 C:\WINDOWS\System32\imagehlp.dll (6.2.14393.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : imagehlp.pdb
    File Version          : 10.0.14393.0 (rs1_release.160715-1616)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.14393.0

ModLoad: 0000000077740000 00000000000e0000 C:\WINDOWS\System32\ucrtbase.dll (6.2.14393.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : ucrtbase.pdb
    File Version          : 10.0.14393.0 (rs1_release.160715-1616)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.14393.0

ModLoad: 0000000074810000 0000000000025000 C:\WINDOWS\System32\IMM32.DLL (6.2.14393.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : wimm32.pdb
    File Version          : 10.0.14393.0 (rs1_release.160715-1616)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.14393.0

ModLoad: 0000000073950000 0000000000145000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.14321.1024) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 10.0.14321.1024 (rs1_release.160715-1616)
    Company Name          : Microsoft
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.14321.1024

ModLoad: 0000000074400000 0000000000008000 C:\WINDOWS\SYSTEM32\version.dll (6.2.14393.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 10.0.14393.0 (rs1_release.160715-1616)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.14393.0



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 7, Write: 0, Other 186

- I/O Transfers Counters -
Read: 0, Write: 69, Other 0

- Paged Pool Usage -
QuotaPagedPoolUsage: 246752, QuotaPeakPagedPoolUsage: 246848
QuotaNonPagedPoolUsage: 8344, QuotaPeakNonPagedPoolUsage: 8344

- Virtual Memory Usage -
VirtualSize: 1623973888, PeakVirtualSize: 1623973888

- Pagefile Usage -
PagefileUsage: 24018944, PeakPagefileUsage: 40062976

- Working Set Size -
WorkingSetSize: 5652480, PeakWorkingSetSize: 5652480, PageFaultCount: 1479

*** Dump of thread ID 308 (state: Ready): ***

- Information -
Status: Base Priority: Above Normal, Priority: Highest, , Kernel Time: 156250.000000, User Time: 0.000000, Wait Time: 43531628.000000

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x7792A832

- Registers -
eax=1251f348 ebx=00c10000 ecx=00000003 edx=00000000 esi=004838a0 edi=0056d6ac
eip=7792a832 esp=1251f348 ebp=1251f3a4
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000216

- Callstack -
ChildEBP RetAddr  Args to Child
1251f3a4 00429707 e06d7363 00000001 00000003 1251f3d0 KERNELBASE!RaiseException+0x0 
1251f3dc 004262d1 1251f3ec 004a0274 004838a0 00498584 wah2rm3m2t_um_8.24_windows_inte!+0x0 
1251f3fc 000f6521 00fd9f80 01000000 000f90b9 37060000 wah2rm3m2t_um_8.24_windows_inte!+0x0 
1251f82c 004286ea 000f0000 00000000 126c351e 0000000a wah2rm3m2t_um_8.24_windows_inte!+0x0 
1251f8bc 748562c4 00c10000 748562a0 70a7b6ea 1251f918 wah2rm3m2t_um_8.24_windows_inte!+0x0 
1251f8d0 77c20fd9 00c10000 73e4f93b 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
1251f918 77c20fa4 ffffffff 77c42efc 00000000 00000000 ntdll!RtlSubscribeWnfStateChangeNotification+0x0 
1251f928 00000000 0042873d 00c10000 00000000 00000000 ntdll!RtlSubscribeWnfStateChangeNotification+0x0 

*** Dump of thread ID 1104 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 43531624.000000

- Registers -
eax=00000000 ebx=126c3c20 ecx=00000000 edx=00000000 esi=126ca178 edi=126ca338
eip=77c301cc esp=23edfb94 ebp=23edfd38
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000202

- Callstack -
ChildEBP RetAddr  Args to Child
23edfd38 748562c4 126c3c20 748562a0 411bb376 23edfd94 ntdll!NtWaitForWorkViaWorkerFactory+0x0 
23edfd4c 77c20fd9 126c3c20 4258fdb7 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
23edfd94 77c20fa4 ffffffff 77c42efc 00000000 00000000 ntdll!RtlSubscribeWnfStateChangeNotification+0x0 
23edfda4 00000000 77bf67c0 126c3c20 00000000 00000000 ntdll!RtlSubscribeWnfStateChangeNotification+0x0 

*** Dump of thread ID 1748 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 43531624.000000

- Registers -
eax=77bf67c0 ebx=126c3c20 ecx=00000000 edx=00000000 esi=126caba0 edi=00000000
eip=77c301cc esp=3578f688 ebp=3578f82c
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000206

- Callstack -
ChildEBP RetAddr  Args to Child
3578f82c 748562c4 126c3c20 748562a0 578eb67a 3578f888 ntdll!NtWaitForWorkViaWorkerFactory+0x0 
3578f840 77c20fd9 126c3c20 54cdf8ab 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
3578f888 77c20fa4 ffffffff 77c42efc 00000000 00000000 ntdll!RtlSubscribeWnfStateChangeNotification+0x0 
3578f898 00000000 77bf67c0 126c3c20 00000000 00000000 ntdll!RtlSubscribeWnfStateChangeNotification+0x0 

*** Dump of thread ID 2896 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 43531628.000000

- Registers -
eax=003aa6b0 ebx=5e48f768 ecx=00000000 edx=00000000 esi=00000000 edi=5e48f768
eip=77c2e91c esp=5e48f728 ebp=5e48f78c
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000206

- Callstack -
ChildEBP RetAddr  Args to Child
5e48f78c 77922bcf 00000064 00000000 5e48f9cc 003aa6d4 ntdll!NtDelayExecution+0x0 
5e48f79c 003aa6d4 00000064 003aa6b0 003aa6b0 00000000 KERNELBASE!Sleep+0x0 
5e48f9cc 748562c4 00000000 748562a0 3cbeb7da 5e48fa28 wah2rm3m2t_um_8.24_windows_inte!+0x0 
5e48f9e0 77c20fd9 00000000 3ffdfa0b 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
5e48fa28 77c20fa4 ffffffff 77c42efc 00000000 00000000 ntdll!RtlSubscribeWnfStateChangeNotification+0x0 
5e48fa38 00000000 003aa6b0 00000000 00000000 00000000 ntdll!RtlSubscribeWnfStateChangeNotification+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1464, iMonCtr=2
Model crash detected, will try to restart...
Leaving CPDN_ain::Monitor...
20:15:49 (1464): called boinc_finish(0)

</stderr_txt>
<message>
upload failure: <file_xfer_error>
  <file_name>wah2_pnw25_s6zg_20589_16_526_010924485_0_r1807728700_15.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_pnw25_s6zg_20589_16_526_010924485_0_r1807728700_16.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_pnw25_s6zg_20589_16_526_010924485_0_r1807728700_restart.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>

</message>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
15 Mar 2017 02:21:41 1382966 20248455 wah2_pnw25_s6zg_20589_16_526_010924485_0 161,579 519,826 3.2172
14 Mar 2017 15:26:30 1382966 20248455 wah2_pnw25_s6zg_20589_16_526_010924485_0 150,059 481,912 3.2115
14 Mar 2017 04:15:00 1382966 20248455 wah2_pnw25_s6zg_20589_16_526_010924485_0 138,539 444,346 3.2074
13 Mar 2017 17:57:06 1382966 20248455 wah2_pnw25_s6zg_20589_16_526_010924485_0 127,019 407,767 3.2103
13 Mar 2017 11:00:03 1382966 20248455 wah2_pnw25_s6zg_20589_16_526_010924485_0 115,499 371,241 3.2142
12 Mar 2017 21:02:12 1382966 20248455 wah2_pnw25_s6zg_20589_16_526_010924485_0 103,979 334,658 3.2185
12 Mar 2017 10:26:44 1382966 20248455 wah2_pnw25_s6zg_20589_16_526_010924485_0 92,459 297,759 3.2204
11 Mar 2017 23:59:25 1382966 20248455 wah2_pnw25_s6zg_20589_16_526_010924485_0 80,939 260,455 3.2179
11 Mar 2017 13:21:23 1382966 20248455 wah2_pnw25_s6zg_20589_16_526_010924485_0 69,419 223,146 3.2145
11 Mar 2017 02:53:07 1382966 20248455 wah2_pnw25_s6zg_20589_16_526_010924485_0 57,899 186,144 3.2150
10 Mar 2017 16:26:46 1382966 20248455 wah2_pnw25_s6zg_20589_16_526_010924485_0 46,379 149,242 3.2179
10 Mar 2017 05:57:55 1382966 20248455 wah2_pnw25_s6zg_20589_16_526_010924485_0 34,859 112,332 3.2225
09 Mar 2017 19:29:59 1382966 20248455 wah2_pnw25_s6zg_20589_16_526_010924485_0 23,339 75,015 3.2141
09 Mar 2017 08:58:57 1382966 20248455 wah2_pnw25_s6zg_20589_16_526_010924485_0 11,819 38,111 3.2246


©2024 cpdn.org