climateprediction.net home page
Task 21365420

Task 21365420

Name wah2_global_e1wr_208812_145_770_011666847_0
Workunit 11666847
Created 5 Nov 2018, 6:40:17 UTC
Sent 5 Nov 2018, 16:31:21 UTC
Report deadline 18 Oct 2019, 21:51:21 UTC
Received 30 Nov 2018, 9:07:03 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 0 (0x00000000)
Computer ID 1279364
Run time 3 days 6 hours 55 min 49 sec
CPU time 3 days 6 hours 29 min 44 sec
Validate state Invalid
Credit 14,063.24
Device peak FLOPS 4.83 GFLOPS
Application version Weather At Home 2 (wah2) v8.24
windows_intelx86
Peak working set size 240.01 MB
Peak swap size 174.97 MB
Peak disk usage 151.90 MB
Stderr 
<core_client_version>7.14.2</core_client_version>
<![CDATA[
<stderr_txt>
17:39:06 (11968): start_timer_thread(): CreateThread() failed, errno 0
17:39:08 (7844): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
10:15:22 (11320): start_timer_thread(): CreateThread() failed, errno 0
10:15:23 (7236): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
11:35:24 (772): start_timer_thread(): CreateThread() failed, errno 0
11:35:26 (5344): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
10:02:05 (636): start_timer_thread(): CreateThread() failed, errno 0
10:02:06 (2732): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
09:07:29 (7456): start_timer_thread(): CreateThread() failed, errno 0
09:07:31 (3580): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
08:57:35 (3124): start_timer_thread(): CreateThread() failed, errno 0
08:57:37 (4592): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
10:01:05 (8432): start_timer_thread(): CreateThread() failed, errno 0
10:01:07 (8720): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
09:37:16 (8088): start_timer_thread(): CreateThread() failed, errno 0
09:37:18 (10208): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
09:06:05 (6484): start_timer_thread(): CreateThread() failed, errno 0
09:06:07 (5284): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
09:36:26 (8380): start_timer_thread(): CreateThread() failed, errno 0
09:36:28 (2212): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
15:17:02 (9192): start_timer_thread(): CreateThread() failed, errno 0
15:17:03 (5468): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
16:09:39 (5548): start_timer_thread(): CreateThread() failed, errno 0
16:09:40 (6412): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
BUFFIN: C I/O Error feof - Unit 62 - Return code = 16

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/xadae.pipe_dummy                                                            
Leaving CPDN_ain::Monitor...
09:07:14 (9240): called boinc_finish(0)

</stderr_txt>
<message>
upload failure: <file_xfer_error>
  <file_name>wah2_global_e1wr_208812_145_770_011666847_0_r84516580_75.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1wr_208812_145_770_011666847_0_r84516580_76.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1wr_208812_145_770_011666847_0_r84516580_77.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1wr_208812_145_770_011666847_0_r84516580_78.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1wr_208812_145_770_011666847_0_r84516580_79.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1wr_208812_145_770_011666847_0_r84516580_80.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1wr_208812_145_770_011666847_0_r84516580_81.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1wr_208812_145_770_011666847_0_r84516580_82.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1wr_208812_145_770_011666847_0_r84516580_83.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1wr_208812_145_770_011666847_0_r84516580_84.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1wr_208812_145_770_011666847_0_r84516580_85.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1wr_208812_145_770_011666847_0_r84516580_86.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1wr_208812_145_770_011666847_0_r84516580_87.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1wr_208812_145_770_011666847_0_r84516580_88.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1wr_208812_145_770_011666847_0_r84516580_89.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1wr_208812_145_770_011666847_0_r84516580_90.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1wr_208812_145_770_011666847_0_r84516580_91.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1wr_208812_145_770_011666847_0_r84516580_92.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1wr_208812_145_770_011666847_0_r84516580_93.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1wr_208812_145_770_011666847_0_r84516580_94.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1wr_208812_145_770_011666847_0_r84516580_95.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1wr_208812_145_770_011666847_0_r84516580_96.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1wr_208812_145_770_011666847_0_r84516580_97.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1wr_208812_145_770_011666847_0_r84516580_98.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1wr_208812_145_770_011666847_0_r84516580_99.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1wr_208812_145_770_011666847_0_r84516580_100.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1wr_208812_145_770_011666847_0_r84516580_101.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1wr_208812_145_770_011666847_0_r84516580_102.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1wr_208812_145_770_011666847_0_r84516580_103.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1wr_208812_145_770_011666847_0_r84516580_104.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1wr_208812_145_770_011666847_0_r84516580_105.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1wr_208812_145_770_011666847_0_r84516580_106.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1wr_208812_145_770_011666847_0_r84516580_107.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1wr_208812_145_770_011666847_0_r84516580_108.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1wr_208812_145_770_011666847_0_r84516580_109.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1wr_208812_145_770_011666847_0_r84516580_110.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1wr_208812_145_770_011666847_0_r84516580_111.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1wr_208812_145_770_011666847_0_r84516580_112.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1wr_208812_145_770_011666847_0_r84516580_113.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1wr_208812_145_770_011666847_0_r84516580_114.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1wr_208812_145_770_011666847_0_r84516580_115.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1wr_208812_145_770_011666847_0_r84516580_116.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1wr_208812_145_770_011666847_0_r84516580_117.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1wr_208812_145_770_011666847_0_r84516580_118.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1wr_208812_145_770_011666847_0_r84516580_119.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1wr_208812_145_770_011666847_0_r84516580_120.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1wr_208812_145_770_011666847_0_r84516580_121.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1wr_208812_145_770_011666847_0_r84516580_122.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1wr_208812_145_770_011666847_0_r84516580_123.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1wr_208812_145_770_011666847_0_r84516580_124.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1wr_208812_145_770_011666847_0_r84516580_125.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1wr_208812_145_770_011666847_0_r84516580_126.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1wr_208812_145_770_011666847_0_r84516580_127.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1wr_208812_145_770_011666847_0_r84516580_128.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1wr_208812_145_770_011666847_0_r84516580_129.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1wr_208812_145_770_011666847_0_r84516580_130.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1wr_208812_145_770_011666847_0_r84516580_131.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1wr_208812_145_770_011666847_0_r84516580_132.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1wr_208812_145_770_011666847_0_r84516580_133.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1wr_208812_145_770_011666847_0_r84516580_134.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1wr_208812_145_770_011666847_0_r84516580_135.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1wr_208812_145_770_011666847_0_r84516580_136.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1wr_208812_145_770_011666847_0_r84516580_137.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1wr_208812_145_770_011666847_0_r84516580_138.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1wr_208812_145_770_011666847_0_r84516580_139.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1wr_208812_145_770_011666847_0_r84516580_140.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1wr_208812_145_770_011666847_0_r84516580_141.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1wr_208812_145_770_011666847_0_r84516580_142.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1wr_208812_145_770_011666847_0_r84516580_143.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1wr_208812_145_770_011666847_0_r84516580_144.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1wr_208812_145_770_011666847_0_r84516580_145.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1wr_208812_145_770_011666847_0_r84516580_restart.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
</message>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
30 Nov 2018 08:07:13 1279364 21365420 wah2_global_e1wr_208812_145_770_011666847_0 213,187 282,545 1.3253
29 Nov 2018 16:43:11 1279364 21365420 wah2_global_e1wr_208812_145_770_011666847_0 210,307 278,825 1.3258
29 Nov 2018 15:44:57 1279364 21365420 wah2_global_e1wr_208812_145_770_011666847_0 207,427 275,203 1.3267
29 Nov 2018 14:42:40 1279364 21365420 wah2_global_e1wr_208812_145_770_011666847_0 204,547 270,841 1.3241
29 Nov 2018 13:40:58 1279364 21365420 wah2_global_e1wr_208812_145_770_011666847_0 201,667 266,181 1.3199
29 Nov 2018 12:43:45 1279364 21365420 wah2_global_e1wr_208812_145_770_011666847_0 198,787 262,368 1.3198
29 Nov 2018 11:41:17 1279364 21365420 wah2_global_e1wr_208812_145_770_011666847_0 195,907 258,559 1.3198
29 Nov 2018 10:39:05 1279364 21365420 wah2_global_e1wr_208812_145_770_011666847_0 193,027 254,863 1.3203
29 Nov 2018 08:39:14 1279364 21365420 wah2_global_e1wr_208812_145_770_011666847_0 190,147 251,139 1.3208
28 Nov 2018 16:11:02 1279364 21365420 wah2_global_e1wr_208812_145_770_011666847_0 187,267 247,241 1.3203
28 Nov 2018 15:13:16 1279364 21365420 wah2_global_e1wr_208812_145_770_011666847_0 184,387 243,238 1.3192
28 Nov 2018 13:40:04 1279364 21365420 wah2_global_e1wr_208812_145_770_011666847_0 181,507 239,346 1.3187
28 Nov 2018 12:43:23 1279364 21365420 wah2_global_e1wr_208812_145_770_011666847_0 178,627 235,549 1.3187
28 Nov 2018 11:40:42 1279364 21365420 wah2_global_e1wr_208812_145_770_011666847_0 175,747 231,855 1.3193
28 Nov 2018 10:38:34 1279364 21365420 wah2_global_e1wr_208812_145_770_011666847_0 172,867 228,260 1.3204
28 Nov 2018 09:41:26 1279364 21365420 wah2_global_e1wr_208812_145_770_011666847_0 169,987 224,675 1.3217
28 Nov 2018 08:38:30 1279364 21365420 wah2_global_e1wr_208812_145_770_011666847_0 167,107 220,948 1.3222
27 Nov 2018 16:52:29 1279364 21365420 wah2_global_e1wr_208812_145_770_011666847_0 164,227 217,295 1.3231
27 Nov 2018 15:50:33 1279364 21365420 wah2_global_e1wr_208812_145_770_011666847_0 161,347 213,587 1.3238
27 Nov 2018 14:52:32 1279364 21365420 wah2_global_e1wr_208812_145_770_011666847_0 158,467 209,784 1.3238


©2024 cpdn.org