climateprediction.net home page
Task 14440512

Task 14440512

Name hadam3p_pnw_bc41_1976_1_007902000_0
Workunit 8057112
Created 17 Apr 2012, 16:53:23 UTC
Sent 13 May 2012, 16:37:27 UTC
Report deadline 25 Apr 2013, 21:57:27 UTC
Received 28 Jul 2012, 17:56:42 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 0 (0x00000000)
Computer ID 1211338
Run time 4 days 14 hours 23 min 28 sec
CPU time 4 days 2 hours 38 min 45 sec
Validate state Invalid
Credit 2,254.93
Device peak FLOPS 2.30 GFLOPS
Application version UK Met Office HadAM3P-HadRM3P Pacific North West v6.09
windows_intelx86
Stderr
<core_client_version>6.12.34</core_client_version>
<![CDATA[
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
22:16:32 (11136): start_timer_thread(): CreateThread() failed, errno 0
22:16:32 (11528): start_timer_thread(): CreateThread() failed, errno 0
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
18:05:40 (7760): start_timer_thread(): CreateThread() failed, errno 0
18:05:40 (7228): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
17:05:57 (7864): start_timer_thread(): CreateThread() failed, errno 0
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
CPDN Monitor - Quit request from BOINC...
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
18:39:15 (2712): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1636, selfPID=1636, iMonCtr=2
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
20:07:11 (6236): start_timer_thread(): CreateThread() failed, errno 0
20:07:11 (6436): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6236, selfPID=6236, iMonCtr=2
21:38:49 (7132): start_timer_thread(): CreateThread() failed, errno 0
21:38:49 (7096): start_timer_thread(): CreateThread() failed, errno 0
14:39:08 (6900): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
16:10:16 (2704): start_timer_thread(): CreateThread() failed, errno 0
16:10:16 (3696): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
17:46:25 (952): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
19:39:53 (5112): start_timer_thread(): CreateThread() failed, errno 0
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
CPDN Monitor - Quit request from BOINC...
21:27:58 (6896): start_timer_thread(): CreateThread() failed, errno 0
21:27:58 (7540): start_timer_thread(): CreateThread() failed, errno 0
21:06:50 (7376): start_timer_thread(): CreateThread() failed, errno 0
21:06:50 (6932): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
23:18:39 (7896): start_timer_thread(): CreateThread() failed, errno 0
11:55:03 (3864): start_timer_thread(): CreateThread() failed, errno 0
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3864, selfPID=3864, iMonCtr=2
15:09:20 (8144): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
15:48:46 (7244): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
16:29:26 (6308): start_timer_thread(): CreateThread() failed, errno 0
16:29:26 (5952): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
17:00:13 (7092): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
19:02:19 (3764): start_timer_thread(): CreateThread() failed, errno 0
19:02:19 (2328): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2328, selfPID=2328, iMonCtr=2
20:23:24 (7644): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7644, selfPID=7644, iMonCtr=2
CPDN Monitor - Quit request from BOINC...
17:47:39 (6348): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=10152, selfPID=10152, iMonCtr=2
CPDN Monitor - Quit request from BOINC...
22:10:51 (15120): start_timer_thread(): CreateThread() failed, errno 0
17:54:20 (7208): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
21:59:48 (49432): start_timer_thread(): CreateThread() failed, errno 0
21:59:48 (50944): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
16:18:52 (2696): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
17:41:11 (7060): start_timer_thread(): CreateThread() failed, errno 0
17:41:11 (6728): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
20:20:33 (9348): start_timer_thread(): CreateThread() failed, errno 0
20:20:33 (8708): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
22:20:12 (14716): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
di0:46:4a (4812): start_timer_thread(): CreateThread() failed, ehExcept
ionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
d12:32:41 (7704): start_timer_thread(): CreateThread() failed, errno 0
iagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
18:34:23 (5740): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
22:07:59 (4028): start_timer_thread(): CreateThread() failed, errno 0
15:38:02 (1128): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
18:04:08 (5788): start_timer_thread(): CreateThread() failed, errno 0
18:04:08 (2044): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
19:17:28 (4584): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
21:43:26 (2940): start_timer_thread(): CreateThread() failed, errno 0
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
CPDN Monitor - Quit request from BOINC...
18:40:23 (3376): start_timer_thread(): CreateThread() failed, errno 0
199:3:35:19 (6884): start_timer_thread(): CreateTeread() failed, errno 0
ailed, errno 0
CPDN Monitor - Quit request from BOINC...
20:59:51 (4628): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7068, selfPID=7068, iMonCtr=2
22:21:17 (2508): start_timer_thread(): CreateThread() failed, errno 0
22:21:17 (6744): start_timer_thread(): CreateThread() failed, errno 0
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6284, iMonCtr=2
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
15:35:17 (5052): start_timer_thread(): CreateThread() failed, errno 0
15:35:17 (288): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5052, selfPID=5052, iMonCtr=2
15:46:49 (6976): start_timer_thread(): CreateThread() failed, errno 0
15:46:49 (6968): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
17:10:28 (6968): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
11:35:57 (7384): start_timer_thread(): CreateTeateThread() failed, err
o 0
CPDN Monitor - Quit request from BOINC...
20:11:25 (7280): start_timer_thread(): CreateThread() failed, errno 0
20:11:25 (2416): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
21:37:32 (5340): start_timer_thread(): CreateThread() failed, errno 0
21:37:32 (6064): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6064, selfPID=6064, iMonCtr=2
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
22:52:03 (7348): start_timer_thread(): CreateThread() failed, errno 0
00:00:53 (5908): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
di1:56:25 (5024): start_timer_thxception_monitor():d() failed, errno 0
nMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
CPDN Monitor - Quit request from BOINC...
03:32:03 (3444): start_timer_thread(): CreateThread() failed, errno 0
03:32:03 (4412): start_timer_thread(): CreateThread() failed, errno 0
19::11:0:05 (2644): stt_timer_thread(): CreateThread() failed, errno 0
 0
CPDN Monitor - Quit request from BOINC...
20:46:28 (632): start_timer_thread(): CreateThread() failed, errno 0
20:46:28 (4516): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
22:13:34 (5436): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
23:35:39 (4064): start_timer_thread(): CreateThread() failed, errno 0
23:35:39 (2324): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
01:04:51 (5736): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
01:33:29 (6776): start_timer_thread(): CreateThread() failed, errno 0
01:33:29 (6784): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
03:37:18 (7036): start_timer_thread(): CreateThread() failed, errno 0
03:37:18 (3096): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7036, selfPID=7036, iMonCtr=2
12:09:08 (3976): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
13:33:30 (5240): start_timer_thread(): CreateThread() failed, errno 0
13:33:30 (6112): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6112, selfPID=6112, iMonCtr=2
15:13:24 (6936): start_timer_thread(): CreateThread() failed, errno 0
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
15:13:24 (7296): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
17:15:59 (2212): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
20:59:44 (7768): start_timer_thread(): CreateThread() failed, errno 0
20:59:44 (6548): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
di2:24agnostics_init_unhandled_ereaeption_monitThrear() failed, errno 0
ptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
CPDN Monitor - Quit request from BOINC...
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
23:43:51 (7296): start_timer_thread(): CreateThread() failed, errno 0
23:43:51 (6132): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6132, selfPID=6132, iMonCtr=2
01:11:10 (6768): start_timer_thread(): CreateThread() failed, errno 0
01:11:10 (6900): start_timer_thread(): CreateThread() failed, errno 0
14:48:35 (2168): start_timer_thread(): CreateThread() failed, errno 0
14:48:35 (2068): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
16:18:12 (4740): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5644, selfPID=5644, iMonCtr=2
18:46:10 (5480): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
20:36:38 (7204): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7421:53:46 (7148): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
18:15:28 (2408): start_timer_thread(): CreateThread() failed, errno 0
18:15:28 (3960): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
19:44:10 (5920): start_timer_thread(): CreateThread() failed, errno 0
19:44:10 (3044): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
21:11:46 (4364): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4372, selfPID=4372, iMonCtr=2
22:41:51 (4172): start_timer_thread(): CreateThread() failed, errno 0
22:41:51 (324): start_timer_thread(): CreateThread() failed, errno 0
155:05:12 (19:4): start_timer_thread(): Creread(): CreateThread() faile
d, errno 0
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
21:04:47 (4100): start_timer_thread(): CreateThread() failed, errno 0
21:04:47 (5324): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
23:16:21 (4548): start_timer_thread(): CreateThread() failed, errno 0
23:16:21 (4176): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
17:34:09 (1556): start_timer_thread(): CreateThread() failed, errno 0
17:34:09 (2180): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
21:11:06 (5640): start_timer_thread(): CreateThread() failed, errno 0
21:11:06 (7444): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
22:27:05 (4632): start_timer_thread(): CreateThread() failed, errno 0
22:27:05 (2564): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
23:54:55 (316): start_timer_thread(): CreateThread() failed, errno 0
13:27:07 (2756): start_timer_thread(): CreateThread() failed, errno 0
13:27:07 (4792): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2756, selfPID=2756, iMonCtr=2
15:16:24 (5724): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
16:39:32 (5084): start_timer_thread(): CreateThread() failed, 1rrno 0
9:32 (5284): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
18:15:37 (1128): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6084, selfPID=6084, iMonCtr=2
19:49:06 (3780): start_timer_thread(): CreateThread() failed, errno 0
19:49:06 (2568): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
20:24:25 (1216): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
21:30:24 (5436): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
23:06:19 (2412): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4744, selfPID=4744, iMonCtr=2
CPDN Monitor - Quit request from BOINC...
20:13:47 (4684): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
21:46:36 (5708): start_timer_thread(): CreateThread() failed, errno 0
21:46:36 (2620): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2620, selfPID=2620, iMonCtr=2
23:28:12 (4560): start_timer_thread(): CreateThread() failed, errno 0
23:28:12 (2568): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
00:40:40 (1200): start_timer_thread(): CreateThread() failed, errno 0
00:40:40 (1304): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
16:36:38 (6104): start_timer_thread(): CreateThread() failed, errno 0

Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO                                                                                                                                                                                           tmp/xaakm.pipe_dummy                                                            2048    
Leaving CPDN_Main::Monitor...
Regional yearly means requires 12 input files got 9
Called boinc_finish

</stderr_txt>
<message>
upload failure: <file_xfer_error>
  <file_name>hadam3p_pnw_bc41_1976_1_007902000_0_10.zip</file_name>
  <error_code>-161</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>hadam3p_pnw_bc41_1976_1_007902000_0_11.zip</file_name>
  <error_code>-161</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>hadam3p_pnw_bc41_1976_1_007902000_0_12.zip</file_name>
  <error_code>-161</error_code>
</file_xfer_error>

</message>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
27 Jul 2012 20:00:45 1211338 14440512 hadam3p_pnw_bc41_1976_1_007902000_0 103,776 340,336 3.2795
20 Jul 2012 14:43:07 1211338 14440512 hadam3p_pnw_bc41_1976_1_007902000_0 92,256 301,596 3.2691
18 Jul 2012 14:45:23 1211338 14440512 hadam3p_pnw_bc41_1976_1_007902000_0 80,736 264,660 3.2781
16 Jul 2012 14:42:36 1211338 14440512 hadam3p_pnw_bc41_1976_1_007902000_0 69,216 229,231 3.3118
15 Jul 2012 01:00:52 1211338 14440512 hadam3p_pnw_bc41_1976_1_007902000_0 57,696 192,174 3.3308
13 Jul 2012 19:21:11 1211338 14440512 hadam3p_pnw_bc41_1976_1_007902000_0 46,176 154,284 3.3412
10 Jul 2012 19:14:10 1211338 14440512 hadam3p_pnw_bc41_1976_1_007902000_0 34,656 116,353 3.3574
05 Jul 2012 21:37:04 1211338 14440512 hadam3p_pnw_bc41_1976_1_007902000_0 23,136 76,921 3.3247
02 Jul 2012 15:33:34 1211338 14440512 hadam3p_pnw_bc41_1976_1_007902000_0 11,616 38,789 3.3393


©2024 cpdn.org