climateprediction.net home page
Task 21264703

Task 21264703

Name wah2_eu25_ej3h_201412_13_746_011597027_1
Workunit 11597028
Created 8 Aug 2018, 21:49:29 UTC
Sent 8 Aug 2018, 22:37:30 UTC
Report deadline 22 Jul 2019, 3:57:30 UTC
Received 8 Sep 2018, 8:03:58 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 194 (0x000000C2) EXIT_ABORTED_BY_CLIENT
Computer ID 1316113
Run time 12 days 6 hours 9 min 6 sec
CPU time 10 days 8 hours 47 min 58 sec
Validate state Invalid
Credit 8,379.03
Device peak FLOPS 4.71 GFLOPS
Application version Weather At Home 2 (wah2) v8.24
windows_intelx86
Peak working set size 314.53 MB
Peak swap size 277.27 MB
Peak disk usage 67.27 MB
Stderr 
<core_client_version>7.12.1</core_client_version>
<![CDATA[
<message>
finish file present too long</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1564, selfPID=15824, iMonCtr=1
Model crash detected, will try to restart...
Leaving CPDN_ain::Monitor...
23:42:54 (15824): called boinc_finish(0)
CPDN Monitor - Abort request from BOINC...


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Access Violation (0xc0000005) at address 0x0048EE46 write attempt to address 0x0236312C

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.7.0


Dump Timestamp    : 09/07/18 23:45:29
Install Directory : 
Data Directory    : F:\inne\BOINC
Project Symstore  : 
LoadLibraryA( F:\inne\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( F:\inne\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( F:\inne\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( F:\inne\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: F:\inne\BOINC\projects\climateprediction.net;F:\inne\BOINC\projects\climateprediction.net


ModLoad: 0000000000400000 0000000000152000 F:\inne\BOINC\projects\climateprediction.net\wah2_8.24_windows_intelx86.exe (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000077400000 0000000000190000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.17134.228) (-exported- Symbols Loaded)
    Linked PDB Filename   : wntdll.pdb
    File Version          : 10.0.17134.280 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : System operacyjny Microsoft&#174; Windows&#174;
    Product Version       : 10.0.17134.280

ModLoad: 0000000075c40000 00000000000e0000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.17134.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : wkernel32.pdb
    File Version          : 10.0.17134.228 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : System operacyjny Microsoft&#174; Windows&#174;
    Product Version       : 10.0.17134.228

ModLoad: 00000000748b0000 00000000001e4000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.17134.165) (-exported- Symbols Loaded)
    Linked PDB Filename   : wkernelbase.pdb
    File Version          : 10.0.17134.228 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : System operacyjny Microsoft&#174; Windows&#174;
    Product Version       : 10.0.17134.228

ModLoad: 0000000075590000 000000000018d000 C:\WINDOWS\System32\USER32.dll (6.2.17134.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : wuser32.pdb
    File Version          : 10.0.17134.280 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : System operacyjny Microsoft&#174; Windows&#174;
    Product Version       : 10.0.17134.280

ModLoad: 0000000075b20000 0000000000017000 C:\WINDOWS\System32\win32u.dll (6.2.17134.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : wwin32u.pdb
    File Version          : 10.0.17134.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.1

ModLoad: 0000000074830000 0000000000022000 C:\WINDOWS\System32\GDI32.dll (6.2.17134.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : wgdi32.pdb
    File Version          : 10.0.17134.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.1

ModLoad: 0000000073ce0000 0000000000164000 C:\WINDOWS\System32\gdi32full.dll (6.2.17134.112) (-exported- Symbols Loaded)
    Linked PDB Filename   : wgdi32full.pdb
    File Version          : 10.0.17134.112 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.112

ModLoad: 0000000074f80000 000000000007d000 C:\WINDOWS\System32\msvcp_win.dll (6.2.17134.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcp_win.pdb
    File Version          : 10.0.17134.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.1

ModLoad: 0000000075890000 000000000011e000 C:\WINDOWS\System32\ucrtbase.dll (6.2.17134.191) (-exported- Symbols Loaded)
    Linked PDB Filename   : ucrtbase.pdb
    File Version          : 10.0.17134.191 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.191

ModLoad: 0000000073fb0000 0000000000078000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.17134.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 10.0.17134.280 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : System operacyjny Microsoft&#174; Windows&#174;
    Product Version       : 10.0.17134.280

ModLoad: 0000000073e50000 00000000000bf000 C:\WINDOWS\System32\msvcrt.dll (7.0.17134.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.17134.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.17134.1

ModLoad: 0000000075090000 0000000000044000 C:\WINDOWS\System32\sechost.dll (6.2.17134.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 10.0.17134.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.1

ModLoad: 0000000074ec0000 00000000000c0000 C:\WINDOWS\System32\RPCRT4.dll (6.2.17134.112) (-exported- Symbols Loaded)
    Linked PDB Filename   : wrpcrt4.pdb
    File Version          : 10.0.17134.280 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : System operacyjny Microsoft&#174; Windows&#174;
    Product Version       : 10.0.17134.280

ModLoad: 0000000073cc0000 0000000000020000 C:\WINDOWS\System32\SspiCli.dll (6.2.17134.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : wsspicli.pdb
    File Version          : 10.0.17134.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.1

ModLoad: 0000000073cb0000 000000000000a000 C:\WINDOWS\System32\CRYPTBASE.dll (6.2.17134.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptbase.pdb
    File Version          : 10.0.17134.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.1

ModLoad: 0000000074b70000 0000000000058000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.17134.137) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcryptprimitives.pdb
    File Version          : 10.0.17134.137 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.137

ModLoad: 0000000075510000 0000000000026000 C:\WINDOWS\System32\IMM32.DLL (6.2.17134.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : wimm32.pdb
    File Version          : 10.0.17134.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.1

ModLoad: 000000006fd40000 0000000000182000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.17134.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 10.0.17134.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.1

ModLoad: 0000000073ca0000 0000000000008000 C:\WINDOWS\SYSTEM32\version.dll (6.2.17134.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 10.0.17134.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.1



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 638, Write: 0, Other 7497

- I/O Transfers Counters -
Read: 0, Write: 1921, Other 0

- Paged Pool Usage -
QuotaPagedPoolUsage: 91944, QuotaPeakPagedPoolUsage: 92104
QuotaNonPagedPoolUsage: 8488, QuotaPeakNonPagedPoolUsage: 8776

- Virtual Memory Usage -
VirtualSize: 54841344, PeakVirtualSize: 54841344

- Pagefile Usage -
PagefileUsage: 3428352, PeakPagefileUsage: 3428352

- Working Set Size -
WorkingSetSize: 5992448, PeakWorkingSetSize: 5992448, PageFaultCount: 1785

*** Dump of thread ID 1244 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 1250000.000000, User Time: 1093750.000000, Wait Time: 6925.000000

- Unhandled Exception Record -
Reason: Access Violation (0xc0000005) at address 0x0048EE46 write attempt to address 0x0236312C

- Registers -
eax=00000065 ebx=004b63b9 ecx=0019dc88 edx=0236312c esi=0019da40 edi=0019dcb8
eip=0048ee46 esp=0019d9d4 ebp=0019dc64
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00010202

- Callstack -
ChildEBP RetAddr  Args to Child
0019dc64 0048161c 0019dc88 004b63b8 00000000 0019dcb8 wah2_8.24_windows_intelx86!+0x0 
0019dca8 0044fa52 0236312c 004b63b8 004b6484 00000421 wah2_8.24_windows_intelx86!+0x0 
0019dcc8 00496e90 0000000b 00000000 00000000 00000000 wah2_8.24_windows_intelx86!+0x0 
0019dce0 00485ca1 c0000005 0019dd14 00490c54 00000000 wah2_8.24_windows_intelx86!+0x0 
0019ff80 75c58484 002f4000 75c58460 a51f3b46 0019ffdc wah2_8.24_windows_intelx86!+0x0 
0019ff94 77462fea 002f4000 4c65923b 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
0019ffdc 77462fba ffffffff 7747ec33 00000000 00000000 ntdll!RtlValidSecurityDescriptor+0x0 
0019ffec 00000000 00485cce 002f4000 00000000 78746341 ntdll!RtlValidSecurityDescriptor+0x0 

*** Dump of thread ID 9648 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 5940.000000

- Registers -
eax=00000000 ebx=0080deb0 ecx=00000000 edx=00000000 esi=0080dcf0 edi=008025b0
eip=7746bebc esp=007ffdc8 ebp=007fff80
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000202

- Callstack -
ChildEBP RetAddr  Args to Child
007fff80 75c58484 008025b0 75c58460 a5793b46 007fffdc ntdll!NtWaitForWorkViaWorkerFactory+0x0 
007fff94 77462fea 008025b0 4c03923b 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
007fffdc 77462fba ffffffff 7747ec33 00000000 00000000 ntdll!RtlValidSecurityDescriptor+0x0 
007fffec 00000000 7744c8c0 008025b0 00000000 77b9e9dd ntdll!RtlValidSecurityDescriptor+0x0 

*** Dump of thread ID 10408 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 5940.000000

- Registers -
eax=7744c8c0 ebx=00000000 ecx=00000000 edx=00000000 esi=0080df30 edi=008025b0
eip=7746bebc esp=0219fdc8 ebp=0219ff80
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000202

- Callstack -
ChildEBP RetAddr  Args to Child
0219ff80 75c58484 008025b0 75c58460 a71f3b46 0219ffdc ntdll!NtWaitForWorkViaWorkerFactory+0x0 
0219ff94 77462fea 008025b0 4e65923b 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
0219ffdc 77462fba ffffffff 7747ec33 00000000 00000000 ntdll!RtlValidSecurityDescriptor+0x0 
0219ffec 00000000 7744c8c0 008025b0 00000000 00000000 ntdll!RtlValidSecurityDescriptor+0x0 

*** Dump of thread ID 4848 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 6924.000000

- Registers -
eax=00000000 ebx=00000000 ecx=00000000 edx=00000000 esi=00000000 edi=00000001
eip=7746a54c esp=0259fcdc ebp=0259fd40
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000202

- Callstack -
ChildEBP RetAddr  Args to Child
0259fd40 749b369f 00000064 00000000 0259ff80 00478b44 ntdll!NtDelayExecution+0x0 
0259fd50 00478b44 00000064 00478b20 00478b20 00000000 KERNELBASE!Sleep+0x0 
0259ff80 75c58484 00000000 75c58460 a75f3b46 0259ffdc wah2_8.24_windows_intelx86!+0x0 
0259ff94 77462fea 00000000 4e25923b 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
0259ffdc 77462fba ffffffff 7747ec33 00000000 00000000 ntdll!RtlValidSecurityDescriptor+0x0 
0259ffec 00000000 00478b20 00000000 00000000 10de406e ntdll!RtlValidSecurityDescriptor+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
07 Sep 2018 13:27:48 1316113 21264703 wah2_eu25_ej3h_201412_13_746_011597027_1 127,019 877,389 6.9075
05 Sep 2018 17:47:05 1316113 21264703 wah2_eu25_ej3h_201412_13_746_011597027_1 115,499 801,429 6.9388
04 Sep 2018 07:04:34 1316113 21264703 wah2_eu25_ej3h_201412_13_746_011597027_1 103,979 723,856 6.9616
02 Sep 2018 19:34:11 1316113 21264703 wah2_eu25_ej3h_201412_13_746_011597027_1 92,459 647,801 7.0064
30 Aug 2018 07:54:05 1316113 21264703 wah2_eu25_ej3h_201412_13_746_011597027_1 80,939 571,818 7.0648
28 Aug 2018 14:17:54 1316113 21264703 wah2_eu25_ej3h_201412_13_746_011597027_1 69,419 495,852 7.1429
27 Aug 2018 15:42:24 1316113 21264703 wah2_eu25_ej3h_201412_13_746_011597027_1 57,899 421,352 7.2774
25 Aug 2018 14:19:26 1316113 21264703 wah2_eu25_ej3h_201412_13_746_011597027_1 46,379 346,860 7.4788
22 Aug 2018 12:09:51 1316113 21264703 wah2_eu25_ej3h_201412_13_746_011597027_1 34,859 258,081 7.4036
20 Aug 2018 13:22:52 1316113 21264703 wah2_eu25_ej3h_201412_13_746_011597027_1 23,339 171,518 7.3490
17 Aug 2018 19:10:55 1316113 21264703 wah2_eu25_ej3h_201412_13_746_011597027_1 11,819 86,834 7.3470


©2024 climateprediction.net