climateprediction.net home page
Task 19873062

Task 19873062

Name wah2_pnw25_z955_199812_24_406_010589742_2
Workunit 10589742
Created 12 Aug 2016, 16:35:25 UTC
Sent 12 Aug 2016, 16:46:39 UTC
Report deadline 25 Jul 2017, 22:06:39 UTC
Received 20 Sep 2016, 20:08:37 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 0 (0x00000000)
Computer ID 1405210
Run time 6 days 10 hours 48 min 33 sec
CPU time 6 days 7 hours 10 min 59 sec
Validate state Invalid
Credit 12,938.64
Device peak FLOPS 2.90 GFLOPS
Application version Weather At Home 2 (wah2) (region independent) v8.12
windows_intelx86
Peak working set size 179.31 MB
Peak swap size 165.63 MB
Peak disk usage 0.03 MB
Stderr
<core_client_version>7.6.22</core_client_version>
<![CDATA[
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
20:07:37 (9484): BOINC client no longer exists - exiting
20:07:37 (9484): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
18:11:56 (7380): start_timer_thread(): CreateThread() failed, errno 0
18:11:57 (4368): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
19:45:51 (8548): start_timer_thread(): CreateThread() failed, errno 0
19:45:53 (8640): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
22:36:55 (6940): start_timer_thread(): CreateThread() failed, errno 0
22:36:56 (916): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
21:52:32 (9012): start_timer_thread(): CreateThread() failed, errno 0
21:52:34 (9044): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
13:40:38 (9180): start_timer_thread(): CreateThread() failed, errno 0
13:40:40 (7456): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
17:40:54 (6656): start_timer_thread(): CreateThread() failed, errno 0
17:40:55 (6780): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
17:56:20 (9172): start_timer_thread(): CreateThread() failed, errno 0
17:56:21 (6096): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
18:40:18 (2108): start_timer_thread(): CreateThread() failed, errno 0
18:40:19 (9052): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
12:52:08 (5552): start_timer_thread(): CreateThread() failed, errno 0
12:52:09 (7668): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
13:32:55 (9088): start_timer_thread(): CreateThread() failed, errno 0
13:32:56 (3096): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
17:27:20 (2824): start_timer_thread(): CreateThread() failed, errno 0
17:27:21 (7984): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
18:33:59 (6916): start_timer_thread(): CreateThread() failed, errno 0
18:34:01 (4484): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
22:28:24 (6236): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
22:36:31 (4924): start_timer_thread(): CreateThread() failed, errno 0
22:36:32 (6268): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
07:32:05 (5484): start_timer_thread(): CreateThread() failed, errno 0
07:32:07 (7956): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
14:46:20 (7276): start_timer_thread(): CreateThread() failed, errno 0
14:46:21 (8972): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
15:19:05 (5064): start_timer_thread(): CreateThread() failed, errno 0
15:19:06 (8780): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
16:02:17 (6368): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
16:31:10 (824): start_timer_thread(): CreateThread() failed, errno 0
16:31:11 (4252): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
09:17:17 (9840): start_timer_thread(): CreateThread() failed, errno 0
09:17:18 (9776): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
17:07:08 (8924): start_timer_thread(): CreateThread() failed, errno 0
17:07:10 (8980): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
20:33:36 (8068): start_timer_thread(): CreateThread() failed, errno 0
20:33:37 (5140): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
21:17:57 (7320): start_timer_thread(): CreateThread() failed, errno 0
21:17:58 (7976): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
21:43:40 (7140): start_timer_thread(): CreateThread() failed, errno 0
21:43:42 (6932): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
22:45:37 (6672): start_timer_thread(): CreateThread() failed, errno 0
22:45:39 (7152): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
22:54:13 (8800): start_timer_thread(): CreateThread() failed, errno 0
22:54:15 (8828): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
23:06:54 (7660): start_timer_thread(): CreateThread() failed, errno 0
23:06:55 (8908): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
11:31:11 (6048): start_timer_thread(): CreateThread() failed, errno 0
11:31:12 (9124): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
12:09:40 (7360): start_timer_thread(): CreateThread() failed, errno 0
12:09:42 (6720): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
13:24:16 (688): start_timer_thread(): CreateThread() failed, errno 0
13:24:17 (7972): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
13:43:09 (5712): start_timer_thread(): CreateThread() failed, errno 0
13:43:10 (9936): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
19:45:18 (6892): start_timer_thread(): CreateThread() failed, errno 0
19:45:20 (6104): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
12:01:09 (4512): start_timer_thread(): CreateThread() failed, errno 0
12:01:10 (1680): start_timer_thread(): CreateThread() failed, errno 0
12:06:51 (8316): start_timer_thread(): CreateThread() failed, errno 0
12:06:52 (8328): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
21:46:45 (2840): start_timer_thread(): CreateThread() failed, errno 0
21:46:46 (7388): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
12:26:28 (5696): start_timer_thread(): CreateThread() failed, errno 0
12:26:29 (5692): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
12:49:59 (8020): start_timer_thread(): CreateThread() failed, errno 0
12:50:00 (2176): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
15:34:28 (9972): start_timer_thread(): CreateThread() failed, errno 0
15:34:29 (9740): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
18:28:26 (7648): start_timer_thread(): CreateThread() failed, errno 0
18:28:28 (7824): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
18:48:50 (8028): start_timer_thread(): CreateThread() failed, errno 0
18:48:52 (8120): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
19:10:21 (4824): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
19:49:03 (4768): start_timer_thread(): CreateThread() failed, errno 0
19:49:05 (3924): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
20:01:25 (7352): start_timer_thread(): CreateThread() failed, errno 0
20:09:35 (7720): start_timer_thread(): CreateThread() failed, errno 0
20:09:36 (7776): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
19:22:22 (912): start_timer_thread(): CreateThread() failed, errno 0
19:22:24 (3928): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
20:41:43 (624): start_timer_thread(): CreateThread() failed, errno 0
21:04:27 (3896): start_timer_thread(): CreateThread() failed, errno 0
21:04:29 (5960): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
14:19:18 (1068): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
16:47:58 (8364): start_timer_thread(): CreateThread() failed, errno 0
16:47:59 (6120): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
18:21:11 (188): start_timer_thread(): CreateThread() failed, errno 0
18:21:13 (4600): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
18:25:24 (7876): start_timer_thread(): CreateThread() failed, errno 0
18:25:26 (7964): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
18:49:08 (8012): start_timer_thread(): CreateThread() failed, errno 0
18:49:10 (1764): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
11:40:11 (7940): start_timer_thread(): CreateThread() failed, errno 0
11:40:12 (10400): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
12:17:31 (1436): start_timer_thread(): CreateThread() failed, errno 0
12:17:32 (4196): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
13:59:38 (8948): start_timer_thread(): CreateThread() failed, errno 0
13:59:40 (9960): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
20:13:26 (7936): start_timer_thread(): CreateThread() failed, errno 0
20:13:28 (8292): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
13:40:23 (616): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
19:05:52 (9708): start_timer_thread(): CreateThread() failed, errno 0
19:05:53 (9412): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
13:12:13 (4000): start_timer_thread(): CreateThread() failed, errno 0
13:12:14 (13880): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
17:53:43 (5432): start_timer_thread(): CreateThread() failed, errno 0
17:53:44 (2412): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
18:27:24 (11472): start_timer_thread(): CreateThread() failed, errno 0
18:27:25 (11016): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
21:37:12 (7964): start_timer_thread(): CreateThread() failed, errno 0
21:37:13 (2412): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
09:00:37 (6936): BOINC client no longer exists - exiting
09:00:37 (6936): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
18:11:35 (5276): start_timer_thread(): CreateThread() failed, errno 0
18:11:36 (8156): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
18:17:17 (6864): start_timer_thread(): CreateThread() failed, errno 0
18:17:18 (9920): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
19:22:50 (868): start_timer_thread(): CreateThread() failed, errno 0
19:22:51 (1656): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
21:46:28 (6028): start_timer_thread(): CreateThread() failed, errno 0

Model crashed: P_TH_ADJ : NEGATIVE PRESSURE VALUE CREATED.                                                                                                                                                                                                                     tmp/xadae.pipe_dummy                                                            
21:46:30 (8080): start_timer_thread(): CreateThread() failed, errno 0
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8080, selfPID=8080, iMonCtr=2
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8080, selfPID=4232, iMonCtr=1
Model crash detected, will try to restart...
Leaving CPDN_Main::Monitor...
21:46:33 (4232): called boinc_finish(0)

</stderr_txt>
<message>
upload failure: <file_xfer_error>
  <file_name>wah2_pnw25_z955_199812_24_406_010589742_2_r226202556_18.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_pnw25_z955_199812_24_406_010589742_2_r226202556_19.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_pnw25_z955_199812_24_406_010589742_2_r226202556_20.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_pnw25_z955_199812_24_406_010589742_2_r226202556_21.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_pnw25_z955_199812_24_406_010589742_2_r226202556_22.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_pnw25_z955_199812_24_406_010589742_2_r226202556_23.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_pnw25_z955_199812_24_406_010589742_2_r226202556_24.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_pnw25_z955_199812_24_406_010589742_2_r226202556_25.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>

</message>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
20 Sep 2016 19:47:46 1405210 19873062 wah2_pnw25_z955_199812_24_406_010589742_2 196,139 544,076 2.7739
18 Sep 2016 20:47:06 1405210 19873062 wah2_pnw25_z955_199812_24_406_010589742_2 184,619 519,962 2.8164
17 Sep 2016 11:46:12 1405210 19873062 wah2_pnw25_z955_199812_24_406_010589742_2 173,099 490,315 2.8326
13 Sep 2016 17:07:25 1405210 19873062 wah2_pnw25_z955_199812_24_406_010589742_2 161,579 463,655 2.8695
11 Sep 2016 19:49:51 1405210 19873062 wah2_pnw25_z955_199812_24_406_010589742_2 150,059 440,007 2.9322
09 Sep 2016 19:19:25 1405210 19873062 wah2_pnw25_z955_199812_24_406_010589742_2 138,539 413,891 2.9875
05 Sep 2016 14:26:49 1405210 19873062 wah2_pnw25_z955_199812_24_406_010589742_2 127,019 384,001 3.0232
03 Sep 2016 16:10:24 1405210 19873062 wah2_pnw25_z955_199812_24_406_010589742_2 115,499 349,967 3.0300
31 Aug 2016 19:56:23 1405210 19873062 wah2_pnw25_z955_199812_24_406_010589742_2 103,979 319,939 3.0770
28 Aug 2016 19:48:03 1405210 19873062 wah2_pnw25_z955_199812_24_406_010589742_2 92,459 287,888 3.1137
27 Aug 2016 21:08:43 1405210 19873062 wah2_pnw25_z955_199812_24_406_010589742_2 80,939 253,332 3.1299
25 Aug 2016 17:18:01 1405210 19873062 wah2_pnw25_z955_199812_24_406_010589742_2 69,419 215,215 3.1002
22 Aug 2016 18:16:28 1405210 19873062 wah2_pnw25_z955_199812_24_406_010589742_2 57,899 178,539 3.0836
21 Aug 2016 14:06:47 1405210 19873062 wah2_pnw25_z955_199812_24_406_010589742_2 46,379 146,794 3.1651
20 Aug 2016 14:07:59 1405210 19873062 wah2_pnw25_z955_199812_24_406_010589742_2 34,859 112,056 3.2146
18 Aug 2016 16:52:57 1405210 19873062 wah2_pnw25_z955_199812_24_406_010589742_2 23,339 75,917 3.2528
15 Aug 2016 21:42:08 1405210 19873062 wah2_pnw25_z955_199812_24_406_010589742_2 11,819 38,808 3.2835


©2024 cpdn.org