climateprediction.net home page
Task 13204269

Task 13204269

Name hadam3p_pnw_2zxp_1995_1_007390802_0
Workunit 7588232
Created 6 Aug 2011, 2:45:01 UTC
Sent 6 Aug 2011, 2:45:11 UTC
Report deadline 18 Jul 2012, 8:05:11 UTC
Received 4 Sep 2011, 20:20:23 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status -226 (0xFFFFFF1E) ERR_TOO_MANY_EXITS
Computer ID 1034263
Run time 11 days 15 hours 48 min 8 sec
CPU time 4 days 0 hours 25 min
Validate state Invalid
Credit 2,254.93
Device peak FLOPS 1.93 GFLOPS
Application version UK Met Office HadAM3P-HadRM3P Pacific North West v6.09
windows_intelx86
Stderr
<core_client_version>6.10.18</core_client_version>
<![CDATA[
<message>
too many exit(0)s
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8628, selfPID=11360, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6876, selfPID=6876, iMonCtr=2
CPDN Monitor - Quit request from BOINC...
23:34:24 (8244): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:34:25 (8244): No heartbeat from core client for 30 sec - exiting
23:34:26 (8244): No heartbeat from core client for 30 sec - exiting
23:34:27 (8244): No heartbeat from core client for 30 sec - exiting
23:34:28 (8244): No heartbeat from core client for 30 sec - exiting
23:34:29 (8244): No heartbeat from core client for 30 sec - exiting
23:34:30 (8244): No heartbeat from core client for 30 sec - exiting
23:34:31 (8244): No heartbeat from core client for 30 sec - exiting
23:34:32 (8244): No heartbeat from core client for 30 sec - exiting
23:34:33 (8244): No heartbeat from core client for 30 sec - exiting
23:34:34 (8244): No heartbeat from core client for 30 sec - exiting
23:34:35 (8244): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=12584, iMonCtr=2
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=10808, iMonCtr
=2
el crash detected, will try to restart...
Leaving CPDN_Main::Monitor...
Regional yearly means requires 12 input files got 0
CPDN Monitor - Quit request from BOINC...
21:34:30 (8944): No heartbeat from core client for 30 sec - exiting
21:34:31 (8944): No heartbeat from core client for 30 sec - exiting
21:34:32 (8944): No heartbeat from core client for 30 sec - exiting
21:34:33 (8944): No heartbeat from core client for 30 sec - exiting
21:34:34 (8944): No heartbeat from core client for 30 sec - exiting
21:34:35 (8944): No heartbeat from core client for 30 sec - exiting
21:34:37 (8944): No heartbeat from core client for 30 sec - exiting
21:34:38 (8944): No heartbeat from core client for 30 sec - exiting
21:34:39 (8944): No heartbeat from core client for 30 sec - exiting
21:34:40 (8944): No heartbeat from core client for 30 sec - exiting
21:34:41 (8944): No heartbeat from core client for 30 sec - exiting
21:34:42 (8944): No heartbeat from core client for 30 sec - exiting
21:34:43 (8944): No heartbeat from core client for 30 sec - exiting
21:34:44 (8944): No heartbeat from core client for 30 sec - exiting
21:34:45 (8944): No heartbeat from core client for 30 sec - exiting
21:34:46 (8944): No heartbeat from core client for 30 sec - exiting
21:34:47 (8944): No heartbeat from core client for 30 sec - exiting
21:34:48 (8944): No heartbeat from core client for 30 sec - exiting
21:34:49 (8944): No heartbeat from core client for 30 sec - exiting
21:34:50 (8944): No heartbeat from core client for 30 sec - exiting
21:34:51 (8944): No heartbeat from core client for 30 sec - exiting
21:34:52 (8944): No heartbeat from core client for 30 sec - exiting
21:34:53 (8944): No heartbeat from core client for 30 sec - exiting
21:34:54 (8944): No heartbeat from core client for 30 sec - exiting
21:34:55 (8944): No heartbeat from core client for 30 sec - exiting
21:34:56 (8944): No heartbeat from core client for 30 sec - exiting
21:34:57 (8944): No heartbeat from core client for 30 sec - exiting
21:34:58 (8944): No heartbeat from core client for 30 sec - exiting
21:34:59 (8944): No heartbeat from core client for 30 sec - exiting
21:35:01 (8944): No heartbeat from core client for 30 sec - exiting
21:35:02 (8944): No heartbeat from core client for 30 sec - exiting
21:35:03 (8944): No heartbeat from core client for 30 sec - exiting
21:35:04 (8944): No heartbeat from core client for 30 sec - exiting
21:35:05 (8944): No heartbeat from core client for 30 sec - exiting
21:35:06 (8944): No heartbeat from core client for 30 sec - exiting
21:35:07 (8944): No heartbeat from core client for 30 sec - exiting
21:35:08 (8944): No heartbeat from core client for 30 sec - exiting
21:35:09 (8944): No heartbeat from core client for 30 sec - exiting
21:35:10 (8944): No heartbeat from core client for 30 sec - exiting
21:35:11 (8944): No heartbeat from core client for 30 sec - exiting
21:35:12 (8944): No heartbeat from core client for 30 sec - exiting
21:35:13 (8944): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9568, selfPID=1428, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9808, selfPID=9808, iMonCtr=2
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
22:56:23 (7072): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7324, selfPID=948, iMonCtr=1
Model crash detected, will try to restart...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1944, iMonCtr=2
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4360, selfPID=7128, iMonCtr=1
Model crash detected, will try to restart...
Leaving CPDN_Main::Monitor...
Regional yearly means requires 12 input files got 1
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7096, selfPID=7096, iMonCtr=2
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=11740, selfPID=11740, iMonCtr=2
CPDN Monitor - Quit request from BOINC...
CGntroller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=11168, iMonCtr=2
Model crash detected, will try to restart...
lobal Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6376, iMonCtr=2
CPDN Monitor - Quit request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8280, iMonCtr=2
Model crash detected, will try to restart...
Leaving CPDN_Main::Monitor...
Regional yearly means requires 12 input files got 2
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9420, selfPID=9420, iMonCtr=2
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8996, iMonCtr=2
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7316, selfPID=6504, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4816, selfPID=4816, iMonCtr=2
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=12440, iMonCtr=2
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=10628, iMonCtr=2
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9916, selfPID=9916, iMonCtr=2
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9588, iMonCtr=2
ntroller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5248, iMonCtr=2
Model crash detected, will try to restart...
Leaving CPDN_Main::Monitor...
Regional yearly means requires 12 input files got 3
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
21:02:38 (5008): No heartbeat from core client for 30 sec - exiting
21:02:39 (5008): No heartbeat from core client for 30 sec - exiting
21:02:40 (5008): No heartbeat from core client for 30 sec - exiting
21:02:41 (5008): No heartbeat from core client for 30 sec - exiting
21:02:42 (5008): No heartbeat from core client for 30 sec - exiting
21:02:43 (5008): No heartbeat from core client for 30 sec - exiting
21:02:44 (5008): No heartbeat from core client for 30 sec - exiting
21:02:45 (5008): No heartbeat from core client for 30 sec - exiting
21:02:46 (5008): No heartbeat from core client for 30 sec - exiting
21:02:47 (5008): No heartbeat from core client for 30 sec - exiting
21:02:48 (5008): No heartbeat from core client for 30 sec - exiting
21:02:49 (5008): No heartbeat from core client for 30 sec - exiting
21:02:50 (5008): No heartbeat from core client for 30 sec - exiting
21:02:51 (5008): No heartbeat from core client for 30 sec - exiting
21:02:52 (5008): No heartbeat from core client for 30 sec - exiting
21:02:53 (5008): No heartbeat from core client for 30 sec - exiting
21:02:54 (5008): No heartbeat from core client for 30 sec - exiting
21:02:55 (5008): No heartbeat from core client for 30 sec - exiting
21:02:56 (5008): No heartbeat from core client for 30 sec - exiting
21:02:57 (5008): No heartbeat from core client for 30 sec - exiting
21:02:58 (5008): No heartbeat from core client for 30 sec - exiting
21:02:59 (5008): No heartbeat from core client for 30 sec - exiting
21:03:00 (5008): No heartbeat from core client for 30 sec - exiting
21:03:01 (5008): No heartbeat from core client for 30 sec - exiting
21:03:02 (5008): No heartbeat from core client for 30 sec - exiting
21:03:03 (5008): No heartbeat from core client for 30 sec - exiting
21:03:04 (5008): No heartbeat from core client for 30 sec - exiting
21:03:05 (5008): No heartbeat from core client for 30 sec - exiting
21:03:06 (5008): No heartbeat from core client for 30 sec - exiting
21:03:07 (5008): No heartbeat from core client for 30 sec - exiting
21:03:08 (5008): No heartbeat from core client for 30 sec - exiting
21:03:09 (5008): No heartbeat from core client for 30 sec - exiting
21:03:10 (5008): No heartbeat from core client for 30 sec - exiting
21:03:12 (5008): No heartbeat from core client for 30 sec - exiting
21:03:13 (5008): No heartbeat from core client for 30 sec - exiting
21:03:14 (5008): No heartbeat from core client for 30 sec - exiting
21:03:15 (5008): No heartbeat from core client for 30 sec - exiting
21:03:16 (5008): No heartbeat from core client for 30 sec - exiting
21:03:17 (5008): No heartbeat from core client for 30 sec - exiting
21:03:19 (5008): No heartbeat from core client for 30 sec - exiting
21:03:20 (5008): No heartbeat from core client for 30 sec - exiting
21:03:21 (5008): No heartbeat from core client for 30 sec - exiting
21:03:22 (5008): No heartbeat from core client for 30 sec - exiting
21:03:23 (5008): No heartbeat from core client for 30 sec - exiting
21:03:25 (5008): No heartbeat from core client for 30 sec - exiting
21:03:26 (5008): No heartbeat from core client for 30 sec - exiting
21:03:27 (5008): No heartbeat from core client for 30 sec - exiting
21:03:28 (5008): No heartbeat from core client for 30 sec - exiting
21:03:30 (5008): No heartbeat from core client for 30 sec - exiting
21:03:31 (5008): No heartbeat from core client for 30 sec - exiting
21:03:32 (5008): No heartbeat from core client for 30 sec - exiting
21:03:33 (5008): No heartbeat from core client for 30 sec - exiting
21:03:34 (5008): No heartbeat from core client for 30 sec - exiting
21:03:36 (5008): No heartbeat from core client for 30 sec - exiting
21:03:37 (5008): No heartbeat from core client for 30 sec - exiting
21:03:38 (5008): No heartbeat from core client for 30 sec - exiting
21:03:39 (5008): No heartbeat from core client for 30 sec - exiting
21:03:41 (5008): No heartbeat from core client for 30 sec - exiting
21:03:42 (5008): No heartbeat from core client for 30 sec - exiting
21:03:43 (5008): No heartbeat from core client for 30 sec - exiting
21:03:44 (5008): No heartbeat from core client for 30 sec - exiting
21:03:45 (5008): No heartbeat from core client for 30 sec - exiting
21:03:46 (5008): No heartbeat from core client for 30 sec - exiting
21:03:47 (5008): No heartbeat from core client for 30 sec - exiting
21:03:48 (5008): No heartbeat from core client for 30 sec - exiting
21:03:49 (5008): No heartbeat from core client for 30 sec - exiting
21:03:50 (5008): No heartbeat from core client for 30 sec - exiting
21:03:51 (5008): No heartbeat from core client for 30 sec - exiting
21:03:52 (5008): No heartbeat from core client for 30 sec - exiting
21:03:53 (5008): No heartbeat from core client for 30 sec - exiting
21:03:54 (5008): No heartbeat from core client for 30 sec - exiting
21:03:55 (5008): No heartbeat from core client for 30 sec - exiting
21:03:56 (5008): No heartbeat from core client for 30 sec - exiting
21:03:57 (5008): No heartbeat from core client for 30 sec - exiting
21:03:58 (5008): No heartbeat from core client for 30 sec - exiting
21:03:59 (5008): No heartbeat from core client for 30 sec - exiting
21:04:00 (5008): No heartbeat from core client for 30 sec - exiting
21:04:01 (5008): No heartbeat from core client for 30 sec - exiting
21:04:03 (5008): No heartbeat from core client for 30 sec - exiting
21:04:04 (5008): No heartbeat from core client for 30 sec - exiting
21:04:05 (5008): No heartbeat from core client for 30 sec - exiting
21:04:06 (5008): No heartbeat from core client for 30 sec - exiting
21:04:07 (5008): No heartbeat from core client for 30 sec - exiting
21:04:08 (5008): No heartbeat from core client for 30 sec - exiting
21:04:09 (5008): No heartbeat from core client for 30 sec - exiting
21:04:10 (5008): No heartbeat from core client for 30 sec - exiting
21:04:11 (5008): No heartbeat from core client for 30 sec - exiting
21:04:12 (5008): No heartbeat from core client for 30 sec - exiting
21:04:13 (5008): No heartbeat from core client for 30 sec - exiting
21:04:15 (5008): No heartbeat from core client for 30 sec - exiting
21:04:16 (5008): No heartbeat from core client for 30 sec - exiting
21:04:17 (5008): No heartbeat from core client for 30 sec - exiting
21:04:18 (5008): No heartbeat from core client for 30 sec - exiting
21:04:19 (5008): No heartbeat from core client for 30 sec - exiting
21:04:20 (5008): No heartbeat from core client for 30 sec - exiting
21:04:21 (5008): No heartbeat from core client for 30 sec - exiting
21:04:22 (5008): No heartbeat from core client for 30 sec - exiting
21:04:23 (5008): No heartbeat from core client for 30 sec - exiting
21:04:24 (5008): No heartbeat from core client for 30 sec - exiting
21:04:25 (5008): No heartbeat from core client for 30 sec - exiting
21:04:26 (5008): No heartbeat from core client for 30 sec - exiting
21:04:27 (5008): No heartbeat from core client for 30 sec - exiting
21:04:28 (5008): No heartbeat from core client for 30 sec - exiting
21:04:30 (5008): No heartbeat from core client for 30 sec - exiting
21:04:31 (5008): No heartbeat from core client for 30 sec - exiting
21:04:33 (5008): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8544, selfPID=11876, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9312, iMonCtr=2
Model crash detected, will try to restart...
Leaving CPDN_Main::Monitor...
Regional yearly means requires 12 input files got 4
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6712, selfPID=9576, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7388, selfPID=7628, iMonCtr=1
Model crash detected, will try to restart...
Leaving CPDN_Main::Monitor...
Regional yearly means requires 12 input files got 5
07:49:52 (4884): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6636, iMonCtr=2
Model crash detected, will try to restart...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6564, iMonCtr=2
20:31:55 (6712): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
14:35:37 (4432): No heartbeat from core client for 30 sec - exiting
14:35:38 (4432): No heartbeat from core client for 30 sec - exiting
14:35:39 (4432): No heartbeat from core client for 30 sec - exiting
14:35:40 (4432): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:35:41 (4432): No heartbeat from core client for 30 sec - exiting
14:35:42 (4432): No heartbeat from core client for 30 sec - exiting
14:35:43 (4432): No heartbeat from core client for 30 sec - exiting
14:35:44 (4432): No heartbeat from core client for 30 sec - exiting
14:35:45 (4432): No heartbeat from core client for 30 sec - exiting
14:35:46 (4432): No heartbeat from core client for 30 sec - exiting
14:35:47 (4432): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5100, iMonCtr=2
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7108, selfPID=12368, iMonCtr=1
Model crash detected, will try to restart...
Leaving CPDN_Main::Monitor...
Regional yearly means requires 12 input files got 6
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CGlobal Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4912, iMonCtr=2
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3264, iMonCtr=2
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2220, selfPID=7104, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=640, iMonCtr=2
Model crash detected, will try to restart...
Leaving CPDN_Main::Monitor...
Regional yearly means requires 12 input files got 8
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7660, selfPID=3092, iMonCtr=1
Model crash detected, will try to restart...
Leaving CPDN_Main::Monitor...
Regional yearly means requires 12 input files got 9
CPDN Monitor - Quit request from BOINC...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
03 Sep 2011 23:35:37 1034263 13204269 hadam3p_pnw_2zxp_1995_1_007390802_0 103,776 324,993 3.1317
01 Sep 2011 16:54:09 1034263 13204269 hadam3p_pnw_2zxp_1995_1_007390802_0 92,256 262,311 2.8433
30 Aug 2011 06:49:03 1034263 13204269 hadam3p_pnw_2zxp_1995_1_007390802_0 80,736 208,567 2.5833
26 Aug 2011 21:52:22 1034263 13204269 hadam3p_pnw_2zxp_1995_1_007390802_0 69,216 154,753 2.2358
24 Aug 2011 11:06:35 1034263 13204269 hadam3p_pnw_2zxp_1995_1_007390802_0 57,696 99,928 1.7320
21 Aug 2011 19:46:34 1034263 13204269 hadam3p_pnw_2zxp_1995_1_007390802_0 46,176 45,070 0.9760
19 Aug 2011 03:41:06 1034263 13204269 hadam3p_pnw_2zxp_1995_1_007390802_0 34,660 126,809 3.6587
18 Aug 2011 21:05:11 1034263 13204269 hadam3p_pnw_2zxp_1995_1_007390802_0 34,656 126,185 3.6411
14 Aug 2011 20:56:17 1034263 13204269 hadam3p_pnw_2zxp_1995_1_007390802_0 23,136 68,737 2.9710
10 Aug 2011 06:21:08 1034263 13204269 hadam3p_pnw_2zxp_1995_1_007390802_0 11,616 13,257 1.1413


©2024 cpdn.org