climateprediction.net home page
Task 19030912

Task 19030912

Name hadam3p_eu_f99s_2010_1_010203908_2
Workunit 10143329
Created 5 Oct 2015, 17:12:08 UTC
Sent 5 Oct 2015, 17:26:36 UTC
Report deadline 16 Sep 2016, 22:46:36 UTC
Received 9 Oct 2015, 10:56:40 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 9 (0x00000009) Unknown error code
Computer ID 1376025
Run time 9 hours 36 min 6 sec
CPU time 9 hours 23 min 18 sec
Validate state Invalid
Credit 2,389.90
Device peak FLOPS 2.85 GFLOPS
Application version UK Met Office HadAM3P-HadRM3P Europe v7.26
windows_intelx86
Stderr 
<core_client_version>7.6.9</core_client_version>
<![CDATA[
<message>
The storage control block address is invalid.
 (0x9) - exit code 9 (0x9)
</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Access Violation (0xc0000005) at address 0x00462AC7 read attempt to address 0x010503AC

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.5.0


Dump Timestamp    : 10/05/15 12:22:56
Install Directory : 
Data Directory    : E:\Downloads
Project Symstore  : 
LoadLibraryA( E:\Downloads\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( E:\Downloads\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( E:\Downloads\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( E:\Downloads\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: E:\Downloads\slots\0;E:\Downloads\projects\climateprediction.net


ModLoad: 0000000000400000 0000000000196000 E:\Downloads\projects\climateprediction.net\hadam3p_eu_7.26_windows_intelx86.exe (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000077340000 0000000000180000 C:\Windows\SysWOW64\ntdll.dll (6.1.7601.18939) (-exported- Symbols Loaded)
    Linked PDB Filename   : wntdll.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 0000000074d10000 0000000000110000 C:\Windows\syswow64\kernel32.dll (6.1.7601.18939) (-exported- Symbols Loaded)
    Linked PDB Filename   : wkernel32.pdb
    File Version          : 6.1.7601.18015 (win7sp1_gdr.121129-1432)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.18015

ModLoad: 0000000076df0000 0000000000047000 C:\Windows\syswow64\KERNELBASE.dll (6.1.7601.18939) (-exported- Symbols Loaded)
    Linked PDB Filename   : wkernelbase.pdb
    File Version          : 6.1.7601.18015 (win7sp1_gdr.121129-1432)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.18015

ModLoad: 0000000076430000 0000000000100000 C:\Windows\syswow64\USER32.dll (6.1.7601.17514) (-exported- Symbols Loaded)
    Linked PDB Filename   : wuser32.pdb
    File Version          : 6.1.7601.17514 (win7sp1_rtm.101119-1850)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.17514

ModLoad: 0000000076a50000 0000000000090000 C:\Windows\syswow64\GDI32.dll (6.1.7601.18898) (-exported- Symbols Loaded)
    Linked PDB Filename   : wgdi32.pdb
    File Version          : 6.1.7601.18898 (win7sp1_gdr.150617-0600)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.18898

ModLoad: 00000000750e0000 000000000000a000 C:\Windows\syswow64\LPK.dll (6.1.7601.18985) (-exported- Symbols Loaded)
    Linked PDB Filename   : wlpk.pdb
    File Version          : 6.1.7601.18985 (win7sp1_gdr.150901-1452)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.18985

ModLoad: 0000000076bf0000 000000000009d000 C:\Windows\syswow64\USP10.dll (1.626.7601.18454) (-exported- Symbols Loaded)
    Linked PDB Filename   : usp10.pdb
    File Version          : 1.0626.7601.18454 (win7sp1_gdr.140424-1533)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft(R) Uniscribe Unicode script processor
    Product Version       : 1.0626.7601.18454

ModLoad: 0000000074f00000 00000000000ac000 C:\Windows\syswow64\msvcrt.dll (7.0.7601.17744) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.7601.17744 (win7sp1_gdr.111215-1535)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.7601.17744

ModLoad: 0000000076200000 00000000000a1000 C:\Windows\syswow64\ADVAPI32.dll (6.1.7601.18939) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 6.1.7601.18869 (win7sp1_gdr.150525-0603)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.18869

ModLoad: 0000000076ae0000 0000000000019000 C:\Windows\SysWOW64\sechost.dll (6.1.7601.18869) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 00000000766f0000 00000000000f0000 C:\Windows\syswow64\RPCRT4.dll (6.1.7601.18951) (-exported- Symbols Loaded)
    Linked PDB Filename   : wrpcrt4.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 0000000074cb0000 0000000000060000 C:\Windows\syswow64\SspiCli.dll (6.1.7601.18951) (-exported- Symbols Loaded)
    Linked PDB Filename   : wsspicli.pdb
    File Version          : 6.1.7601.18951 (win7sp1_gdr.150805-0600)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.18951

ModLoad: 0000000074ca0000 000000000000c000 C:\Windows\syswow64\CRYPTBASE.dll (6.1.7601.18951) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptbase.pdb
    File Version          : 6.1.7601.18951 (win7sp1_gdr.150805-0600)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.18951

ModLoad: 0000000076690000 0000000000060000 C:\Windows\system32\IMM32.DLL (6.1.7601.17514) (-exported- Symbols Loaded)
    Linked PDB Filename   : wimm32.pdb
    File Version          : 6.1.7601.17514 (win7sp1_rtm.101119-1850)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.17514

ModLoad: 0000000074e20000 00000000000cc000 C:\Windows\syswow64\MSCTF.dll (6.1.7601.18731) (-exported- Symbols Loaded)
    Linked PDB Filename   : msctf.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 0000000074a60000 0000000000021000 C:\Windows\system32\ntmarta.dll (6.1.7600.16385) (-exported- Symbols Loaded)
    Linked PDB Filename   : ntmarta.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 0000000076190000 0000000000045000 C:\Windows\syswow64\WLDAP32.dll (6.1.7601.17514) (-exported- Symbols Loaded)
    Linked PDB Filename   : wldap32.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 0000000071a20000 000000000004c000 C:\Windows\system32\apphelp.dll (6.1.7601.18777) (-exported- Symbols Loaded)
    Linked PDB Filename   : apphelp.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 00000000720c0000 00000000000eb000 C:\Windows\system32\dbghelp.dll (6.1.7601.17514) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 6.1.7601.17514 (win7sp1_rtm.101119-1850)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.17514

ModLoad: 0000000074af0000 0000000000009000 C:\Windows\system32\version.dll (6.1.7600.16385) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 15126, Write: 0, Other 59136

- I/O Transfers Counters -
Read: 0, Write: 2454, Other 0

- Paged Pool Usage -
QuotaPagedPoolUsage: 99968, QuotaPeakPagedPoolUsage: 99968
QuotaNonPagedPoolUsage: 7688, QuotaPeakNonPagedPoolUsage: 8080

- Virtual Memory Usage -
VirtualSize: 57389056, PeakVirtualSize: 57389056

- Pagefile Usage -
PagefileUsage: 3006464, PeakPagefileUsage: 3342336

- Working Set Size -
WorkingSetSize: 30347264, PeakWorkingSetSize: 31678464, PageFaultCount: 8940

*** Dump of thread ID 10108 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 461556.000000

- Unhandled Exception Record -
Reason: Access Violation (0xc0000005) at address 0x00462AC7 read attempt to address 0x010503AC

- Registers -
eax=00000015 ebx=80000000 ecx=00000000 edx=00c3e8b8 esi=00f80020 edi=00000000
eip=00462ac7 esp=02a7fe90 ebp=02a7fe94
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00010216

- Callstack -
ChildEBP RetAddr  Args to Child
02a7fe94 00447c9f 00f80020 00000000 00f80020 80000000 hadam3p_eu_7.26_windows_intelx8!+0x0 
02a7feac 0044f498 00f80020 00000000 0056189c 02a7fefc hadam3p_eu_7.26_windows_intelx8!+0x0 
02a7fec0 004835dc 00000015 f6c26f3c 00000001 00000006 hadam3p_eu_7.26_windows_intelx8!+0x0 
02a7fefc 74dc7451 00000006 f6c22df5 00000000 00000000 hadam3p_eu_7.26_windows_intelx8!+0x0 
02a7ff88 74d2336a 00000006 02a7ffd4 77379882 80000006 kernel32!CtrlRoutine+0x0 
02a7ff94 77379882 80000006 75e4940d 00000000 00000000 kernel32!BaseThreadInitThunk+0x0 
02a7ffd4 77379855 74dc729c 80000006 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 
02a7ffec 00000000 74dc729c 80000006 00000000 183d2af1 ntdll!RtlInitializeExceptionChain+0x0 

*** Dump of thread ID 7520 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 15288098.000000, User Time: 39312252.000000, Wait Time: 461548.000000

- Registers -
eax=00000000 ebx=004cf850 ecx=00000000 edx=00000000 esi=0018f9d8 edi=00000000
eip=7735fdd1 esp=0018f994 ebp=0018f9fc
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
0018f9fc 76e044ab 000000c8 00000000 0018fa20 00468901 ntdll!ZwDelayExecution+0x0 
0018fa0c 00468901 000000c8 000000c8 00000000 0018fa58 KERNELBASE!Sleep+0x0 
0018fa20 00403d94 a0000000 027f9999 004cf858 004cfb88 hadam3p_eu_7.26_windows_intelx8!+0x0 
0018fa58 00404d2e 00000000 f47d6c88 00000000 00000000 hadam3p_eu_7.26_windows_intelx8!+0x0 
0018fd48 00404f1f 0018fef8 00404f9d 004d02a8 0018fd68 hadam3p_eu_7.26_windows_intelx8!+0x0 
0018fd50 00404f9d 004d02a8 0018fd68 009c4308 0018fd68 hadam3p_eu_7.26_windows_intelx8!+0x0 
0018fef8 00484cab 00400000 00000000 009c434c 0000000a hadam3p_eu_7.26_windows_intelx8!+0x0 
0018ff88 74d2336a 7efde000 0018ffd4 77379882 7efde000 hadam3p_eu_7.26_windows_intelx8!+0x0 
0018ff94 77379882 7efde000 775b940d 00000000 00000000 kernel32!BaseThreadInitThunk+0x0 
0018ffd4 77379855 00484cfe 7efde000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 
0018ffec 00000000 00484cfe 7efde000 00000000 78746341 ntdll!RtlInitializeExceptionChain+0x0 

*** Dump of thread ID 7380 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 156001.000000, Wait Time: 461552.000000

- Registers -
eax=c0000022 ebx=00000000 ecx=00000000 edx=00000000 esi=00bffd24 edi=00000000
eip=7735fdd1 esp=00bffce0 ebp=00bffd48
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
00bffd48 76e044ab 00000064 00000000 00bfff88 00477d44 ntdll!ZwDelayExecution+0x0 
00bffd58 00477d44 00000064 00000000 00000000 00000000 KERNELBASE!Sleep+0x0 
00bfff88 74d2336a 00000000 00bfffd4 77379882 00000000 hadam3p_eu_7.26_windows_intelx8!+0x0 
00bfff94 77379882 00000000 77fc940d 00000000 00000000 kernel32!BaseThreadInitThunk+0x0 
00bfffd4 77379855 00477d20 00000000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 
00bfffec 00000000 00477d20 00000000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8948, selfPID=8948, iMonCtr=1
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8948, selfPID=7584, iMonCtr=1
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7432, selfPID=7488, iMonCtr=1
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7432, selfPID=7432, iMonCtr=1
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7720, selfPID=7616, iMonCtr=1
Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6060, selfPID=6060, iMonCtr=1

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
27 Oct 2015 16:51:56 1376025 19030912 hadam3p_eu_f99s_2010_1_010203908_2 138,539 323,350 2.3340
26 Oct 2015 22:29:40 1376025 19030912 hadam3p_eu_f99s_2010_1_010203908_2 127,019 298,902 2.3532
26 Oct 2015 18:26:30 1376025 19030912 hadam3p_eu_f99s_2010_1_010203908_2 115,499 273,505 2.3680
26 Oct 2015 18:26:30 1376025 19030912 hadam3p_eu_f99s_2010_1_010203908_2 103,979 247,830 2.3835
26 Oct 2015 18:26:30 1376025 19030912 hadam3p_eu_f99s_2010_1_010203908_2 92,459 222,173 2.4029
26 Oct 2015 18:26:30 1376025 19030912 hadam3p_eu_f99s_2010_1_010203908_2 80,939 194,580 2.4040
26 Oct 2015 18:26:30 1376025 19030912 hadam3p_eu_f99s_2010_1_010203908_2 69,419 166,687 2.4012
26 Oct 2015 18:26:30 1376025 19030912 hadam3p_eu_f99s_2010_1_010203908_2 57,899 138,522 2.3925
26 Oct 2015 18:26:30 1376025 19030912 hadam3p_eu_f99s_2010_1_010203908_2 46,379 110,038 2.3726
26 Oct 2015 18:26:30 1376025 19030912 hadam3p_eu_f99s_2010_1_010203908_2 34,859 82,163 2.3570
26 Oct 2015 18:26:30 1376025 19030912 hadam3p_eu_f99s_2010_1_010203908_2 23,339 54,614 2.3400
07 Oct 2015 05:41:48 1376025 19030912 hadam3p_eu_f99s_2010_1_010203908_2 11,819 27,219 2.3030


©2024 cpdn.org