climateprediction.net home page
Task 11322090

Task 11322090

Name hadsm3dhet2_kcn3_006626033_6
Workunit 6829406
Created 15 Mar 2010, 12:41:04 UTC
Sent 31 Mar 2010, 2:44:35 UTC
Report deadline 13 Mar 2011, 8:04:35 UTC
Received 14 Nov 2010, 7:27:05 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 21 (0x00000015) Unknown error code
Computer ID 989238
Run time 21 days 15 hours 48 min 31 sec
CPU time 17 days 0 hours 9 min 14 sec
Validate state Invalid
Credit 5,160.66
Device peak FLOPS 0.00 GFLOPS
Application version ---
Stderr
<core_client_version>6.6.36</core_client_version>
<![CDATA[
<message>
The device is not ready. (0x15) - exit code 21 (0x15)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
No Process Handle
CPDN process is not running, exiting, bRetVal = 1, checkPID=4560, selfPID=4560, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1844, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5004, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
No Process Handle
CPDN process is not running, exiting, bRetVal = 1, checkPID=4640, selfPID=4640, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CCPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CCPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3268, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
MainError:	12:44:18 AM	No files match the supplied pattern.
MainError:	12:44:18 AM	No files match the supplied pattern.
MainError:	12:44:18 AM	No files match the supplied pattern.
MainError:	12:44:18 AM	No files match the supplied pattern.
MainError:	12:44:18 AM	No files match the supplied pattern.
MainError:	12:44:18 AM	No files match the supplied pattern.
MainError:	12:44:18 AM	No files match the supplied pattern.
MainError:	12:44:18 AM	No files match the supplied pattern.
MainError:	12:44:18 AM	No files match the supplied pattern.
MainError:	12:44:18 AM	No files match the supplied pattern.
MainError:	12:44:18 AM	No files match the supplied pattern.
MainError:	12:44:18 AM	No files match the supplied pattern.
MainError:	12:44:18 AM	No files match the supplied pattern.
MainError:	12:44:18 AM	No files match the supplied pattern.
MainError:	12:44:18 AM	No files match the supplied pattern.
MainError:	12:44:18 AM	No files match the supplied pattern.
MainError:	12:44:18 AM	No files match the supplied pattern.
MainError:	12:44:18 AM	No files match the supplied pattern.
MainError:	12:44:18 AM	No files match the supplied pattern.
MainError:	12:44:18 AM	No files match the supplied pattern.
MainError:	12:44:18 AM	No files match the supplied pattern.
MainError:	12:44:18 AM	No files match the supplied pattern.
MainError:	12:44:18 AM	No files match the supplied pattern.
MainError:	12:44:18 AM	No files match the supplied pattern.
MainError:	12:44:18 AM	No files match the supplied pattern.
MainError:	12:44:18 AM	No files match the supplied pattern.
MainError:	12:44:18 AM	No files match the supplied pattern.
MainError:	12:44:18 AM	No files match the supplied pattern.
MainError:	12:44:19 AM	No files match the supplied pattern.
MainError:	12:44:19 AM	No files match the supplied pattern.
MainError:	12:44:19 AM	No files match the supplied pattern.
MainError:	12:44:19 AM	No files match the supplied pattern.
MainError:	12:44:19 AM	No files match the supplied pattern.
MainError:	12:44:19 AM	No files match the supplied pattern.
MainError:	12:44:19 AM	No files match the supplied pattern.
MainError:	12:44:19 AM	No files match the supplied pattern.
MainError:	12:44:19 AM	No files match the supplied pattern.
MainError:	12:44:19 AM	No files match the supplied pattern.
MainError:	12:44:19 AM	No files match the supplied pattern.
MainError:	12:44:19 AM	No files match the supplied pattern.
MainError:	12:44:19 AM	No files match the supplied pattern.
MainError:	12:44:19 AM	No files match the supplied pattern.
MainError:	12:44:19 AM	No files match the supplied pattern.
MainError:	12:44:19 AM	No files match the supplied pattern.
MainError:	12:44:19 AM	No files match the supplied pattern.
MainError:	12:44:19 AM	No files match the supplied pattern.
MainError:	12:44:19 AM	No files match the supplied pattern.
MainError:	12:44:19 AM	No files match the supplied pattern.
MainError:	12:44:19 AM	No files match the supplied pattern.
MainError:	12:44:19 AM	No files match the supplied pattern.
MainError:	12:44:19 AM	No files match the supplied pattern.
MainError:	12:44:19 AM	No files match the supplied pattern.
MainError:	12:44:19 AM	No files match the supplied pattern.
MainError:	12:44:19 AM	No files match the supplied pattern.
MainError:	12:44:19 AM	No files match the supplied pattern.
MainError:	12:44:19 AM	No files match the supplied pattern.
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6124, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4048, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2384, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2688, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4104, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4020, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5308, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1612, iMonCtr=1
Model crash detected, will try to restart...
No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - No 'heartbeat' from BOINC...
No heartbeat from core client for 30 sec - exiting
No heartbeat from core client for 30 sec - exiting
No heartbeat from core client for 30 sec - exiting
No heartbeat from core client for 30 sec - exiting
No heartbeat from core client for 30 sec - exiting
No heartbeat from core client for 30 sec - exiting
No heartbeat from core client for 30 sec - exiting
No heartbeat from core client for 30 sec - exiting
No heartbeat from core client for 30 sec - exiting
No heartbeat from core client for 30 sec - exiting
No heartbeat from core client for 30 sec - exiting
No heartbeat from core client for 30 sec - exiting
No heartbeat from core client for 30 sec - exiting
No heartbeat from core client for 30 sec - exiting
No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5672, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5128, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4180, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5668, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4920, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
MainError:	05:01:07 PM	No files match the supplied pattern.
MainError:	05:01:07 PM	No files match the supplied pattern.
MainError:	05:01:07 PM	No files match the supplied pattern.
MainError:	05:01:07 PM	No files match the supplied pattern.
MainError:	05:01:07 PM	No files match the supplied pattern.
MainError:	05:01:07 PM	No files match the supplied pattern.
MainError:	05:01:07 PM	No files match the supplied pattern.
MainError:	05:01:07 PM	No files match the supplied pattern.
MainError:	05:01:07 PM	No files match the supplied pattern.
MainError:	05:01:07 PM	No files match the supplied pattern.
MainError:	05:01:07 PM	No files match the supplied pattern.
MainError:	05:01:07 PM	No files match the supplied pattern.
MainError:	05:01:07 PM	No files match the supplied pattern.
MainError:	05:01:07 PM	No files match the supplied pattern.
MainError:	05:01:07 PM	No files match the supplied pattern.
MainError:	05:01:07 PM	No files match the supplied pattern.
MainError:	05:01:07 PM	No files match the supplied pattern.
MainError:	05:01:07 PM	No files match the supplied pattern.
MainError:	05:01:07 PM	No files match the supplied pattern.
MainError:	05:01:07 PM	No files match the supplied pattern.
MainError:	05:01:07 PM	No files match the supplied pattern.
MainError:	05:01:07 PM	No files match the supplied pattern.
MainError:	05:01:07 PM	No files match the supplied pattern.
MainError:	05:01:07 PM	No files match the supplied pattern.
MainError:	05:01:07 PM	No files match the supplied pattern.
MainError:	05:01:07 PM	No files match the supplied pattern.
MainError:	05:01:07 PM	No files match the supplied pattern.
MainError:	05:01:07 PM	No files match the supplied pattern.
MainError:	05:01:07 PM	No files match the supplied pattern.
MainError:	05:01:07 PM	No files match the supplied pattern.
MainError:	05:01:07 PM	No files match the supplied pattern.
MainError:	05:01:07 PM	No files match the supplied pattern.
MainError:	05:01:07 PM	No files match the supplied pattern.
MainError:	05:01:07 PM	No files match the supplied pattern.
MainError:	05:01:07 PM	No files match the supplied pattern.
MainError:	05:01:07 PM	No files match the supplied pattern.
MainError:	05:01:07 PM	No files match the supplied pattern.
MainError:	05:01:07 PM	No files match the supplied pattern.
MainError:	05:01:07 PM	No files match the supplied pattern.
MainError:	05:01:07 PM	No files match the supplied pattern.
MainError:	05:01:07 PM	No files match the supplied pattern.
MainError:	05:01:07 PM	No files match the supplied pattern.
MainError:	05:01:07 PM	No files match the supplied pattern.
MainError:	05:01:07 PM	No files match the supplied pattern.
MainError:	05:01:07 PM	No files match the supplied pattern.
MainError:	05:01:07 PM	No files match the supplied pattern.
MainError:	05:01:07 PM	No files match the supplied pattern.
MainError:	05:01:07 PM	No files match the supplied pattern.
MainError:	05:01:07 PM	No files match the supplied pattern.
MainError:	05:01:07 PM	No files match the supplied pattern.
MainError:	05:01:07 PM	No files match the supplied pattern.
MainError:	05:01:07 PM	No files match the supplied pattern.
MainError:	05:01:07 PM	No files match the supplied pattern.
MainError:	05:01:07 PM	No files match the supplied pattern.
MainError:	05:01:07 PM	No files match the supplied pattern.
MainError:	05:01:07 PM	No files match the supplied pattern.
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
No Process Handle
CPDN process is not running, exiting, bRetVal = 1, checkPID=5780, selfPID=5780, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2452, iMonCtr=1
Model crash detected, will try to restart...
No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - No 'heartbeat' from BOINC...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5196, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=492, iMonCtr=1
Model crash detected, will try to restart...
No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3944, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1656, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5104, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1844, iMonCtr=1
Model crash detected, will try to restart...
No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5136, iMonCtr=1
Model crash detected, will try to restart...
No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - No 'heartbeat' from BOINC...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5928, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3948, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5108, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5852, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5092, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5680, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4728, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5792, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5852, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
MainError:	03:23:04 AM	Could not make heat convergence file when pre-initialising phase 2
Post-processing failed! :-(
called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 Sep 2010 19:14:25 989238 11322090 hadsm3dhet2_kcn3_006626033_6 43,208 999,805 1.7799
08 Sep 2010 04:41:43 989238 11322090 hadsm3dhet2_kcn3_006626033_6 32,406 981,497 1.7816
07 Sep 2010 04:55:29 989238 11322090 hadsm3dhet2_kcn3_006626033_6 21,604 961,478 1.7802
05 Sep 2010 13:09:02 989238 11322090 hadsm3dhet2_kcn3_006626033_6 10,802 942,579 1.7808
04 Sep 2010 17:06:03 989238 11322090 hadsm3dhet2_kcn3_006626033_6 259,248 923,446 1.7810
04 Sep 2010 00:45:59 989238 11322090 hadsm3dhet2_kcn3_006626033_6 248,446 904,358 1.7813
04 Sep 2010 00:45:59 989238 11322090 hadsm3dhet2_kcn3_006626033_6 237,644 885,429 1.7819
01 Sep 2010 11:59:32 989238 11322090 hadsm3dhet2_kcn3_006626033_6 226,842 864,968 1.7794
31 Aug 2010 01:23:27 989238 11322090 hadsm3dhet2_kcn3_006626033_6 216,040 845,399 1.7787
29 Aug 2010 15:15:28 989238 11322090 hadsm3dhet2_kcn3_006626033_6 205,238 825,884 1.7781
29 Aug 2010 04:58:47 989238 11322090 hadsm3dhet2_kcn3_006626033_6 194,436 805,838 1.7762
27 Aug 2010 02:20:55 989238 11322090 hadsm3dhet2_kcn3_006626033_6 183,634 785,433 1.7735
23 Aug 2010 06:09:08 989238 11322090 hadsm3dhet2_kcn3_006626033_6 172,832 765,940 1.7727
09 Aug 2010 10:12:34 989238 11322090 hadsm3dhet2_kcn3_006626033_6 162,030 746,321 1.7716
07 Aug 2010 20:37:46 989238 11322090 hadsm3dhet2_kcn3_006626033_6 151,228 727,492 1.7723
06 Aug 2010 21:07:32 989238 11322090 hadsm3dhet2_kcn3_006626033_6 140,426 707,397 1.7699
05 Aug 2010 03:44:21 989238 11322090 hadsm3dhet2_kcn3_006626033_6 129,624 687,961 1.7691
03 Aug 2010 09:08:52 989238 11322090 hadsm3dhet2_kcn3_006626033_6 118,822 668,844 1.7691
30 Jul 2010 03:15:17 989238 11322090 hadsm3dhet2_kcn3_006626033_6 108,020 649,331 1.7680
28 Jul 2010 16:52:29 989238 11322090 hadsm3dhet2_kcn3_006626033_6 97,218 631,046 1.7703


©2024 cpdn.org