climateprediction.net home page
Task 20492063

Task 20492063

Name wah2_pnw25_c2kf_200312_49_588_011084654_1
Workunit 11084654
Created 15 Jun 2017, 5:36:06 UTC
Sent 15 Jun 2017, 6:08:11 UTC
Report deadline 28 May 2018, 11:28:11 UTC
Received 16 Jul 2017, 17:23:52 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 0 (0x00000000)
Computer ID 1330107
Run time 23 days 2 hours 5 min 28 sec
CPU time 21 days 0 hours 34 min 24 sec
Validate state Invalid
Credit 31,937.05
Device peak FLOPS 3.52 GFLOPS
Application version Weather At Home 2 (wah2) v8.24
i686-apple-darwin
Peak working set size 1,366.84 MB
Peak swap size 4,091.85 MB
Peak disk usage 71.69 MB
Stderr
<core_client_version>7.6.22</core_client_version>
<![CDATA[
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/wah2_pnw25_c2kf_200312_49_588_011084654/dataout/c2kfga.pdk3dec
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/wah2_pnw25_c2kf_200312_49_588_011084654/dataout/c2kfga.pdk4feb
Suspended CPDN Monitor - Suspend request from BOINC...
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/wah2_pnw25_c2kf_200312_49_588_011084654/dataout/c2kfga.pdk4mar
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/wah2_pnw25_c2kf_200312_49_588_011084654/dataout/c2kfga.pdk4apr
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/wah2_pnw25_c2kf_200312_49_588_011084654/dataout/c2kfga.pdk4may
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/wah2_pnw25_c2kf_200312_49_588_011084654/dataout/c2kfga.pdk4jun
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/wah2_pnw25_c2kf_200312_49_588_011084654/dataout/c2kfga.pdk4jul
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/wah2_pnw25_c2kf_200312_49_588_011084654/dataout/c2kfga.pdk4aug
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/wah2_pnw25_c2kf_200312_49_588_011084654/dataout/c2kfga.pdk4sep
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/wah2_pnw25_c2kf_200312_49_588_011084654/dataout/c2kfga.pdk4oct
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/wah2_pnw25_c2kf_200312_49_588_011084654/dataout/c2kfga.pdk4nov
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/wah2_pnw25_c2kf_200312_49_588_011084654/dataout/c2kfga.pdk4dec
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/wah2_pnw25_c2kf_200312_49_588_011084654/dataout/c2kfga.pdk5feb
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/wah2_pnw25_c2kf_200312_49_588_011084654/dataout/c2kfga.pdk5mar
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/wah2_pnw25_c2kf_200312_49_588_011084654/dataout/c2kfga.pdk5apr
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/wah2_pnw25_c2kf_200312_49_588_011084654/dataout/c2kfga.pdk5may
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/wah2_pnw25_c2kf_200312_49_588_011084654/dataout/c2kfga.pdk5jun
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/wah2_pnw25_c2kf_200312_49_588_011084654/dataout/c2kfga.pdk5jul
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/wah2_pnw25_c2kf_200312_49_588_011084654/dataout/c2kfga.pdk5aug
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/wah2_pnw25_c2kf_200312_49_588_011084654/dataout/c2kfga.pdk5sep
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/wah2_pnw25_c2kf_200312_49_588_011084654/dataout/c2kfga.pdk5oct
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/wah2_pnw25_c2kf_200312_49_588_011084654/dataout/c2kfga.pdk5dec
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/wah2_pnw25_c2kf_200312_49_588_011084654/dataout/c2kfga.pdk6feb
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/wah2_pnw25_c2kf_200312_49_588_011084654/dataout/c2kfga.pdk6mar
Suspended CPDN Monitor - Suspend request from BOINC...
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/wah2_pnw25_c2kf_200312_49_588_011084654/dataout/c2kfga.pdk6apr
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/wah2_pnw25_c2kf_200312_49_588_011084654/dataout/c2kfga.pdk6may
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/wah2_pnw25_c2kf_200312_49_588_011084654/dataout/c2kfga.pdk6jun
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/wah2_pnw25_c2kf_200312_49_588_011084654/dataout/c2kfga.pdk6jul
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/wah2_pnw25_c2kf_200312_49_588_011084654/dataout/c2kfga.pdk6aug
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/wah2_pnw25_c2kf_200312_49_588_011084654/dataout/c2kfga.pdk6sep
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/wah2_pnw25_c2kf_200312_49_588_011084654/dataout/c2kfga.pdk6oct
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/wah2_pnw25_c2kf_200312_49_588_011084654/dataout/c2kfga.pdk6dec
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/wah2_pnw25_c2kf_200312_49_588_011084654/dataout/c2kfga.pdk7feb
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/wah2_pnw25_c2kf_200312_49_588_011084654/dataout/c2kfga.pdk7mar
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/wah2_pnw25_c2kf_200312_49_588_011084654/dataout/c2kfga.pdk7apr
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/wah2_pnw25_c2kf_200312_49_588_011084654/dataout/c2kfga.pdk7may
wah2rm3m2t_um_8.24_i686-apple-darwin(1945,0xa6f3b1c0) malloc: *** mach_vm_map(size=1048576) failed (error code=3)
*** error: can't allocate region
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation

Crashed executable name: wah2rm3m2t_um_8.24_i686-apple-darwin
built using BOINC library version 7.7.0
Machine type Intel x86-64h Haswell (32-bit executable)
System version: Macintosh OS 10.12.5 build 16F73
Sun Jul 16 12:22:33 2017


Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0xffffffe1 ebx: 0x00000003 ecx: 0xbeb6eacc edx: 0xa165191e
  edi: 0xbeb6eb38 esi: 0x00000000 ebp: 0xbeb6eb08 esp: 0xbeb6eacc
   ss: 0x00000023 efl: 0x00000292 eip: 0xa165191e  cs: 0x0000000b
   ds: 0x00000023  es: 0x00000023  fs: 0x00000000  gs: 0x0000000f

Binary Images Description:
    0x1000 -   0x46afff /Library/Application Support/BOINC Data/projects/climateprediction.net/wah2rm3m2t_um_8.24_i686-apple-darwin
0x9ffb1000 - 0x9ffb2fff /usr/lib/libSystem.B.dylib
0xa0148000 - 0xa019efff /usr/lib/libc++.1.dylib
0xa019f000 - 0xa01c2fff /usr/lib/libc++abi.dylib
0xa0caa000 - 0xa106efff /usr/lib/libobjc.A.dylib
0xa12b1000 - 0xa1301fff /usr/lib/libstdc++.6.dylib
0xa1471000 - 0xa1475fff /usr/lib/system/libcache.dylib
0xa1476000 - 0xa1480fff /usr/lib/system/libcommonCrypto.dylib
0xa1481000 - 0xa1486fff /usr/lib/system/libcompiler_rt.dylib
0xa1487000 - 0xa148ffff /usr/lib/system/libcopyfile.dylib
0xa1490000 - 0xa14f6fff /usr/lib/system/libcorecrypto.dylib
0xa14f7000 - 0xa1524fff /usr/lib/system/libdispatch.dylib
0xa1525000 - 0xa152afff /usr/lib/system/libdyld.dylib
0xa152b000 - 0xa152bfff /usr/lib/system/libkeymgr.dylib
0xa1539000 - 0xa1539fff /usr/lib/system/liblaunch.dylib
0xa153a000 - 0xa1540fff /usr/lib/system/libmacho.dylib
0xa1541000 - 0xa1543fff /usr/lib/system/libquarantine.dylib
0xa1544000 - 0xa1545fff /usr/lib/system/libremovefile.dylib
0xa1546000 - 0xa155dfff /usr/lib/system/libsystem_asl.dylib
0xa155e000 - 0xa155efff /usr/lib/system/libsystem_blocks.dylib
0xa155f000 - 0xa15edfff /usr/lib/system/libsystem_c.dylib
0xa15ee000 - 0xa15f1fff /usr/lib/system/libsystem_configuration.dylib
0xa15f2000 - 0xa15f5fff /usr/lib/system/libsystem_coreservices.dylib
0xa15f6000 - 0xa160efff /usr/lib/system/libsystem_coretls.dylib
0xa160f000 - 0xa1615fff /usr/lib/system/libsystem_dnssd.dylib
0xa1616000 - 0xa163dfff /usr/lib/system/libsystem_info.dylib
0xa163e000 - 0xa165ffff /usr/lib/system/libsystem_kernel.dylib
0xa1660000 - 0xa16acfff /usr/lib/system/libsystem_m.dylib
0xa16ad000 - 0xa16c7fff /usr/lib/system/libsystem_malloc.dylib
0xa16c8000 - 0xa171efff /usr/lib/system/libsystem_network.dylib
0xa171f000 - 0xa1728fff /usr/lib/system/libsystem_networkextension.dylib
0xa1729000 - 0xa1731fff /usr/lib/system/libsystem_notify.dylib
0xa1732000 - 0xa1738fff /usr/lib/system/libsystem_platform.dylib
0xa1739000 - 0xa1742fff /usr/lib/system/libsystem_pthread.dylib
0xa1743000 - 0xa1746fff /usr/lib/system/libsystem_sandbox.dylib
0xa1747000 - 0xa1749fff /usr/lib/system/libsystem_secinit.dylib
0xa174a000 - 0xa1751fff /usr/lib/system/libsystem_symptoms.dylib
0xa1752000 - 0xa1764fff /usr/lib/system/libsystem_trace.dylib
0xa1765000 - 0xa176bfff /usr/lib/system/libunwind.dylib
0xa176c000 - 0xa1792fff /usr/lib/system/libxpc.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1941, iMonCtr=2
Model crash detected, will try to restart...
Leaving CPDN_ain::Monitor...
12:22:52 (1941): called boinc_finish(0)

</stderr_txt>
<message>
upload failure: <file_xfer_error>
  <file_name>wah2_pnw25_c2kf_200312_49_588_011084654_1_r1668485698_43.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_pnw25_c2kf_200312_49_588_011084654_1_r1668485698_44.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_pnw25_c2kf_200312_49_588_011084654_1_r1668485698_45.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_pnw25_c2kf_200312_49_588_011084654_1_r1668485698_46.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_pnw25_c2kf_200312_49_588_011084654_1_r1668485698_47.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_pnw25_c2kf_200312_49_588_011084654_1_r1668485698_48.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_pnw25_c2kf_200312_49_588_011084654_1_r1668485698_49.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_pnw25_c2kf_200312_49_588_011084654_1_r1668485698_restart.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>

</message>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
16 Jul 2017 16:02:15 1330107 20492063 wah2_pnw25_c2kf_200312_49_588_011084654_1 484,139 1,815,114 3.7492
15 Jul 2017 21:45:22 1330107 20492063 wah2_pnw25_c2kf_200312_49_588_011084654_1 472,619 1,764,170 3.7328
15 Jul 2017 02:13:40 1330107 20492063 wah2_pnw25_c2kf_200312_49_588_011084654_1 461,099 1,713,681 3.7165
14 Jul 2017 07:31:15 1330107 20492063 wah2_pnw25_c2kf_200312_49_588_011084654_1 449,579 1,663,952 3.7011
13 Jul 2017 09:55:40 1330107 20492063 wah2_pnw25_c2kf_200312_49_588_011084654_1 438,059 1,613,146 3.6825
12 Jul 2017 13:25:57 1330107 20492063 wah2_pnw25_c2kf_200312_49_588_011084654_1 426,539 1,564,203 3.6672
11 Jul 2017 20:26:40 1330107 20492063 wah2_pnw25_c2kf_200312_49_588_011084654_1 415,019 1,522,801 3.6692
11 Jul 2017 01:07:53 1330107 20492063 wah2_pnw25_c2kf_200312_49_588_011084654_1 403,499 1,475,313 3.6563
10 Jul 2017 08:24:36 1330107 20492063 wah2_pnw25_c2kf_200312_49_588_011084654_1 391,979 1,429,785 3.6476
09 Jul 2017 12:49:27 1330107 20492063 wah2_pnw25_c2kf_200312_49_588_011084654_1 380,459 1,378,823 3.6241
08 Jul 2017 16:33:57 1330107 20492063 wah2_pnw25_c2kf_200312_49_588_011084654_1 368,939 1,329,932 3.6047
07 Jul 2017 22:50:14 1330107 20492063 wah2_pnw25_c2kf_200312_49_588_011084654_1 357,419 1,279,324 3.5793
07 Jul 2017 03:59:28 1330107 20492063 wah2_pnw25_c2kf_200312_49_588_011084654_1 345,899 1,229,413 3.5543
05 Jul 2017 20:36:17 1330107 20492063 wah2_pnw25_c2kf_200312_49_588_011084654_1 334,379 1,178,922 3.5257
05 Jul 2017 05:00:13 1330107 20492063 wah2_pnw25_c2kf_200312_49_588_011084654_1 322,859 1,131,765 3.5054
04 Jul 2017 02:04:12 1330107 20492063 wah2_pnw25_c2kf_200312_49_588_011084654_1 311,339 1,081,409 3.4734
03 Jul 2017 06:37:42 1330107 20492063 wah2_pnw25_c2kf_200312_49_588_011084654_1 299,819 1,034,144 3.4492
02 Jul 2017 13:03:10 1330107 20492063 wah2_pnw25_c2kf_200312_49_588_011084654_1 288,299 981,694 3.4051
01 Jul 2017 14:44:12 1330107 20492063 wah2_pnw25_c2kf_200312_49_588_011084654_1 276,779 930,581 3.3622
01 Jul 2017 08:12:47 1330107 20492063 wah2_pnw25_c2kf_200312_49_588_011084654_1 265,259 895,025 3.3742


©2024 cpdn.org