climateprediction.net home page
Task 21374363

Task 21374363

Name wah2_global_e0d8_200412_145_766_011654848_1
Workunit 11654848
Created 11 Nov 2018, 7:00:23 UTC
Sent 11 Nov 2018, 7:34:00 UTC
Report deadline 24 Oct 2019, 12:54:00 UTC
Received 14 Jun 2019, 5:03:38 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 0 (0x00000000)
Computer ID 1444977
Run time 32 days 2 hours 19 min 27 sec
CPU time 31 days 14 hours 9 min 48 sec
Validate state Invalid
Credit 20,142.74
Device peak FLOPS 1.67 GFLOPS
Application version Weather At Home 2 (wah2) v8.24
windows_intelx86
Peak working set size 74.77 MB
Peak swap size 1.96 MB
Peak disk usage 0.04 MB
Stderr
<core_client_version>7.8.3</core_client_version>
<![CDATA[
<stderr_txt>
01:34:59 (2124): start_timer_thread(): CreateThread() failed, errno 0
01:35:01 (1440): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
00:02:50 (8468): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
00:02:36 (8952): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
00:02:29 (9008): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
00:02:45 (8784): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7272, selfPID=8964, iMonCtr=1
Model crash detected, will try to restart...
00:02:42 (4816): start_timer_thread(): CreateThread() failed, errno 0
00:02:44 (6360): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9048, iMonCtr=2
00:02:22 (8916): start_timer_thread(): CreateThread() failed, errno 0
00:02:42 (8760): start_timer_thread(): CreateThread() failed, errno 0
00:02:43 (8848): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
22:35:07 (2952): start_timer_thread(): CreateThread() failed, errno 0
00:02:54 (3440): start_timer_thread(): CreateThread() failed, errno 0
00:02:34 (8832): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
00:02:39 (8928): start_timer_thread(): CreateThread() failed, errno 0
00:02:41 (9060): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
00:03:37 (8988): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
14:25:17 (7244): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
15:42:28 (1368): start_timer_thread(): CreateThread() failed, errno 0
15:42:30 (8204): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
17:16:09 (3760): start_timer_thread(): CreateThread() failed, errno 0
17:16:11 (3176): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
18:43:58 (1932): start_timer_thread(): CreateThread() failed, errno 0
18:44:00 (7988): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
20:17:01 (6972): start_timer_thread(): CreateThread() failed, errno 0
20:17:02 (6964): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
22:20:44 (8068): start_timer_thread(): CreateThread() failed, errno 0
22:20:46 (308): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
00:45:27 (6840): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
02:41:36 (6364): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
04:32:08 (8012): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
06:26:16 (3380): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
09:11:51 (2720): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
10:57:17 (2656): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
12:36:18 (3088): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
14:37:36 (6616): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
16:33:33 (4012): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
18:32:32 (7356): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
20:39:06 (3600): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
22:38:41 (5272): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
01:32:28 (6852): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
03:02:35 (1660): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
04:41:08 (9032): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
07:43:17 (5264): start_timer_thread(): CreateThread() failed, errno 0
07:43:18 (800): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
09:02:12 (6612): start_timer_thread(): CreateThread() failed, errno 0
09:02:13 (5332): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
10:45:28 (2800): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
13:38:29 (3444): start_timer_thread(): CreateThread() failed, errno 0
13:38:31 (8200): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
15:14:28 (8916): start_timer_thread(): CreateThread() failed, errno 0
15:14:29 (5376): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
16:55:00 (6408): start_timer_thread(): CreateThread() failed, errno 0
16:55:02 (4952): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
19:50:11 (6668): start_timer_thread(): CreateThread() failed, errno 0
19:50:13 (8020): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
21:17:09 (7792): start_timer_thread(): CreateThread() failed, errno 0
21:17:11 (9072): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
23:16:36 (600): start_timer_thread(): CreateThread() failed, errno 0
23:16:38 (5576): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7792, selfPID=7792, iMonCtr=2
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...

Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO                                                                                                                                                                                           tmp/xadae.pipe_dummy                                                            
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=0, iMonCtr=2
Suspended CPDN Monitor - Suspend request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8472, selfPID=10464, iMonCtr=1
Model crash detected, will try to restart...
Leaving CPDN_ain::Monitor...
14:51:22 (10464): called boinc_finish(0)

</stderr_txt>
<message>
upload failure: <file_xfer_error>
  <file_name>wah2_global_e0d8_200412_145_766_011654848_1_r2062008999_107.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0d8_200412_145_766_011654848_1_r2062008999_108.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0d8_200412_145_766_011654848_1_r2062008999_109.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0d8_200412_145_766_011654848_1_r2062008999_110.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0d8_200412_145_766_011654848_1_r2062008999_111.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0d8_200412_145_766_011654848_1_r2062008999_112.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0d8_200412_145_766_011654848_1_r2062008999_113.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0d8_200412_145_766_011654848_1_r2062008999_114.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0d8_200412_145_766_011654848_1_r2062008999_115.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0d8_200412_145_766_011654848_1_r2062008999_116.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0d8_200412_145_766_011654848_1_r2062008999_117.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0d8_200412_145_766_011654848_1_r2062008999_118.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0d8_200412_145_766_011654848_1_r2062008999_119.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0d8_200412_145_766_011654848_1_r2062008999_120.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0d8_200412_145_766_011654848_1_r2062008999_121.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0d8_200412_145_766_011654848_1_r2062008999_122.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0d8_200412_145_766_011654848_1_r2062008999_123.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0d8_200412_145_766_011654848_1_r2062008999_124.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0d8_200412_145_766_011654848_1_r2062008999_125.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0d8_200412_145_766_011654848_1_r2062008999_126.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0d8_200412_145_766_011654848_1_r2062008999_127.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0d8_200412_145_766_011654848_1_r2062008999_128.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0d8_200412_145_766_011654848_1_r2062008999_129.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0d8_200412_145_766_011654848_1_r2062008999_130.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0d8_200412_145_766_011654848_1_r2062008999_131.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0d8_200412_145_766_011654848_1_r2062008999_132.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0d8_200412_145_766_011654848_1_r2062008999_133.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0d8_200412_145_766_011654848_1_r2062008999_134.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0d8_200412_145_766_011654848_1_r2062008999_135.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0d8_200412_145_766_011654848_1_r2062008999_136.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0d8_200412_145_766_011654848_1_r2062008999_137.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0d8_200412_145_766_011654848_1_r2062008999_138.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0d8_200412_145_766_011654848_1_r2062008999_139.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0d8_200412_145_766_011654848_1_r2062008999_140.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0d8_200412_145_766_011654848_1_r2062008999_141.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0d8_200412_145_766_011654848_1_r2062008999_142.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0d8_200412_145_766_011654848_1_r2062008999_143.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0d8_200412_145_766_011654848_1_r2062008999_144.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0d8_200412_145_766_011654848_1_r2062008999_145.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0d8_200412_145_766_011654848_1_r2062008999_restart.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
</message>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
07 Feb 2019 04:55:36 1444977 21374363 wah2_global_e0d8_200412_145_766_011654848_1 305,347 2,717,751 8.9005
07 Feb 2019 02:39:11 1444977 21374363 wah2_global_e0d8_200412_145_766_011654848_1 302,467 2,691,542 8.8986
07 Feb 2019 01:26:54 1444977 21374363 wah2_global_e0d8_200412_145_766_011654848_1 299,587 2,665,530 8.8973
07 Feb 2019 00:05:57 1444977 21374363 wah2_global_e0d8_200412_145_766_011654848_1 296,707 2,640,546 8.8995
06 Feb 2019 23:14:41 1444977 21374363 wah2_global_e0d8_200412_145_766_011654848_1 293,827 2,614,324 8.8975
06 Feb 2019 22:26:37 1444977 21374363 wah2_global_e0d8_200412_145_766_011654848_1 290,947 2,588,935 8.8983
06 Feb 2019 21:43:54 1444977 21374363 wah2_global_e0d8_200412_145_766_011654848_1 288,067 2,564,033 8.9008
06 Feb 2019 21:11:31 1444977 21374363 wah2_global_e0d8_200412_145_766_011654848_1 285,187 2,539,062 8.9031
06 Feb 2019 18:48:53 1444977 21374363 wah2_global_e0d8_200412_145_766_011654848_1 282,307 2,512,821 8.9010
06 Feb 2019 17:15:22 1444977 21374363 wah2_global_e0d8_200412_145_766_011654848_1 279,427 2,487,127 8.9008
06 Feb 2019 16:30:11 1444977 21374363 wah2_global_e0d8_200412_145_766_011654848_1 276,547 2,461,151 8.8996
06 Feb 2019 15:50:57 1444977 21374363 wah2_global_e0d8_200412_145_766_011654848_1 273,667 2,435,090 8.8980
06 Feb 2019 12:06:22 1444977 21374363 wah2_global_e0d8_200412_145_766_011654848_1 270,787 2,408,826 8.8956
06 Feb 2019 11:05:28 1444977 21374363 wah2_global_e0d8_200412_145_766_011654848_1 267,907 2,382,925 8.8946
06 Feb 2019 09:41:16 1444977 21374363 wah2_global_e0d8_200412_145_766_011654848_1 265,027 2,356,152 8.8902
06 Feb 2019 08:38:57 1444977 21374363 wah2_global_e0d8_200412_145_766_011654848_1 262,147 2,329,654 8.8868
06 Feb 2019 04:30:40 1444977 21374363 wah2_global_e0d8_200412_145_766_011654848_1 259,267 2,303,884 8.8861
06 Feb 2019 03:26:17 1444977 21374363 wah2_global_e0d8_200412_145_766_011654848_1 256,387 2,278,720 8.8878
06 Feb 2019 02:20:16 1444977 21374363 wah2_global_e0d8_200412_145_766_011654848_1 253,507 2,251,753 8.8824
06 Feb 2019 01:24:11 1444977 21374363 wah2_global_e0d8_200412_145_766_011654848_1 250,627 2,224,791 8.8769


©2024 cpdn.org