climateprediction.net home page
Task 21522023

Task 21522023

Name wah2_safr50_n0si_201612_24_791_011756032_0
Workunit 11756032
Created 7 Mar 2019, 10:31:46 UTC
Sent 27 Mar 2019, 2:37:36 UTC
Report deadline 8 Mar 2020, 7:57:36 UTC
Received 23 Apr 2019, 22:35:02 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status -529697949 (0xE06D7363) Unknown error code
Computer ID 1433245
Run time 27 days 16 hours 53 min 41 sec
CPU time 26 days 1 hours 2 min
Validate state Invalid
Credit 15,978.39
Device peak FLOPS 1.15 GFLOPS
Application version Weather At Home 2 (wah2) v8.24
windows_intelx86
Peak working set size 243.75 MB
Peak swap size 220.73 MB
Peak disk usage 89.98 MB
Stderr 
<core_client_version>7.14.2</core_client_version>
<![CDATA[
<message>
(unknown error) - exit code -529697949 (0xe06d7363)</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x75EEB022

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.7.0


Dump Timestamp    : 04/23/19 23:34:30
Install Directory : 
Data Directory    : C:\ProgramData\BOINC
Project Symstore  : 
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\projects\climateprediction.net\wah2_safr50_n0si_201612_24_791_011756032;C:\ProgramData\BOINC\projects\climateprediction.net


ModLoad: 0000000000400000 0000000000152000 C:\ProgramData\BOINC\projects\climateprediction.net\wah2_8.24_windows_intelx86.exe (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000770f0000 000000000019c000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.17763.292) (-exported- Symbols Loaded)
    Linked PDB Filename   : wntdll.pdb
    File Version          : 10.0.17763.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Operativsystemet Microsoft&#174; Windows&#174;
    Product Version       : 10.0.17763.1

ModLoad: 00000000761a0000 00000000000e0000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.17763.292) (-exported- Symbols Loaded)
    Linked PDB Filename   : wkernel32.pdb
    File Version          : 10.0.17763.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Operativsystemet Microsoft&#174; Windows&#174;
    Product Version       : 10.0.17763.1

ModLoad: 0000000075dd0000 00000000001fa000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.17763.292) (-exported- Symbols Loaded)
    Linked PDB Filename   : wkernelbase.pdb
    File Version          : 10.0.17763.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Operativsystemet Microsoft&#174; Windows&#174;
    Product Version       : 10.0.17763.1

ModLoad: 0000000075ff0000 0000000000199000 C:\WINDOWS\System32\USER32.dll (6.2.17763.168) (-exported- Symbols Loaded)
    Linked PDB Filename   : wuser32.pdb
    File Version          : 10.0.17763.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Operativsystemet Microsoft&#174; Windows&#174;
    Product Version       : 10.0.17763.1

ModLoad: 0000000075fd0000 0000000000017000 C:\WINDOWS\System32\win32u.dll (6.2.17763.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : wwin32u.pdb
    File Version          : 10.0.17763.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.1

ModLoad: 00000000770a0000 0000000000023000 C:\WINDOWS\System32\GDI32.dll (6.2.17763.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : wgdi32.pdb
    File Version          : 10.0.17763.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.1

ModLoad: 0000000075000000 0000000000167000 C:\WINDOWS\System32\gdi32full.dll (6.2.17763.316) (-exported- Symbols Loaded)
    Linked PDB Filename   : wgdi32full.pdb
    File Version          : 10.0.17763.316 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.316

ModLoad: 0000000076920000 0000000000080000 C:\WINDOWS\System32\msvcp_win.dll (6.2.17763.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcp_win.pdb
    File Version          : 10.0.17763.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.1

ModLoad: 0000000076f10000 0000000000123000 C:\WINDOWS\System32\ucrtbase.dll (6.2.17763.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : ucrtbase.pdb
    File Version          : 10.0.17763.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.1

ModLoad: 00000000752e0000 000000000007e000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.17763.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 10.0.17763.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Operativsystemet Microsoft&#174; Windows&#174;
    Product Version       : 10.0.17763.1

ModLoad: 0000000075510000 00000000000c0000 C:\WINDOWS\System32\msvcrt.dll (7.0.17763.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.17763.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.17763.1

ModLoad: 0000000075630000 0000000000079000 C:\WINDOWS\System32\sechost.dll (6.2.17763.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 10.0.17763.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.1

ModLoad: 0000000075360000 00000000000bf000 C:\WINDOWS\System32\RPCRT4.dll (6.2.17763.194) (-exported- Symbols Loaded)
    Linked PDB Filename   : wrpcrt4.pdb
    File Version          : 10.0.17763.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Operativsystemet Microsoft&#174; Windows&#174;
    Product Version       : 10.0.17763.1

ModLoad: 0000000074760000 0000000000020000 C:\WINDOWS\System32\SspiCli.dll (6.2.17763.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : wsspicli.pdb
    File Version          : 10.0.17763.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.1

ModLoad: 0000000074750000 000000000000a000 C:\WINDOWS\System32\CRYPTBASE.dll (6.2.17763.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptbase.pdb
    File Version          : 10.0.17763.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.1

ModLoad: 0000000074e50000 0000000000062000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.17763.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcryptprimitives.pdb
    File Version          : 10.0.17763.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.1

ModLoad: 0000000073630000 0000000000029000 C:\WINDOWS\SYSTEM32\ntmarta.dll (6.2.17763.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : ntmarta.pdb
    File Version          : 10.0.17763.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Operativsystemet Microsoft&#174; Windows&#174;
    Product Version       : 10.0.17763.1

ModLoad: 000000006d390000 0000000000086000 C:\ProgramData\BOINC\projects\climateprediction.net\wah2_se_8.24_windows_intelx86.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : F:\cpdn\cpdn\cpdnboinc\monitor\win_build\Release\umtonc.pdb

ModLoad: 000000006d200000 000000000018f000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.17763.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 10.0.17763.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.1

ModLoad: 0000000073350000 0000000000008000 C:\WINDOWS\SYSTEM32\version.dll (6.2.17763.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 10.0.17763.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.1



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 977208, Write: 0, Other 733157

- I/O Transfers Counters -
Read: 0, Write: 20055, Other 0

- Paged Pool Usage -
QuotaPagedPoolUsage: 205040, QuotaPeakPagedPoolUsage: 205608
QuotaNonPagedPoolUsage: 10992, QuotaPeakNonPagedPoolUsage: 11120

- Virtual Memory Usage -
VirtualSize: 167927808, PeakVirtualSize: 169005056

- Pagefile Usage -
PagefileUsage: 3653632, PeakPagefileUsage: 54972416

- Working Set Size -
WorkingSetSize: 3174400, PeakWorkingSetSize: 128090112, PageFaultCount: 915507

*** Dump of thread ID 6908 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 680625024.000000, User Time: 5344531456.000000, Wait Time: 355150176.000000

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x75EEB022

- Registers -
eax=0019e680 ebx=060ab800 ecx=00000003 edx=00000000 esi=6d3f922c edi=6d40c450
eip=75eeb022 esp=0019e680 ebp=0019e6dc
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000212

- Callstack -
ChildEBP RetAddr  Args to Child
0019e6dc 6d3dcaf9 e06d7363 00000001 00000003 0019e708 KERNELBASE!RaiseException+0x0 
0019e714 6d3d9ebc 0019e724 6d4059d8 6d3f922c 6d3fb27c wah2_se_8.24_windows_intelx86!umtonc+0x0 
0019e734 6d39e42b 03073300 060ab800 004e4d99 0611f490 wah2_se_8.24_windows_intelx86!umtonc+0x0 
0019e750 6d3929b1 0019e788 0019e874 0019e85c 0019e850 wah2_se_8.24_windows_intelx86!+0x0 
0019e998 6d39efac 00670888 0019ea2d 00000000 0019eb34 wah2_se_8.24_windows_intelx86!+0x0 
0019eb34 0040bdf2 004e4d98 004e4ed0 004e4c90 00000000 wah2_se_8.24_windows_intelx86!umtonc+0x0 
0019eb6c 00401f39 00fa93b8 00fa93f0 00fa93f0 00000000 wah2_8.24_windows_intelx86!+0x0 
0019ebc0 004021ad 000007e2 00000009 00000000 004cefe0 wah2_8.24_windows_intelx86!+0x0 
0019ed88 00402703 000007e2 00000009 012b0040 0019ede8 wah2_8.24_windows_intelx86!+0x0 
0019ed9c 0040724e 000007e2 012b0040 004cefe0 004a56b0 wah2_8.24_windows_intelx86!+0x0 
0019ede8 004092c5 00000000 181e6104 00485cce 00000000 wah2_8.24_windows_intelx86!+0x0 
0019fd30 004094b7 0019fee0 00409535 004d1370 0019fd50 wah2_8.24_windows_intelx86!+0x0 
0019fd38 00409535 004d1370 0019fd50 00792fe8 0019fd50 wah2_8.24_windows_intelx86!+0x0 
0019fee0 00485c7b 00400000 00000000 00793026 0000000a wah2_8.24_windows_intelx86!+0x0 
0019ff70 761c0179 00350000 761c0160 0019ffdc 7715662d wah2_8.24_windows_intelx86!+0x0 
0019ff80 7715662d 00350000 a55bde19 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
0019ffdc 771565fd ffffffff 77175194 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 
0019ffec 00000000 00485cce 00350000 00000000 78746341 ntdll!RtlGetAppContainerNamedObjectPath+0x0 

*** Dump of thread ID 2176 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 355150112.000000

- Registers -
eax=00000000 ebx=00793fe8 ecx=00000000 edx=00000000 esi=00793e28 edi=007921c8
eip=7716216c esp=0078fdb4 ebp=0078ff70
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000206

- Callstack -
ChildEBP RetAddr  Args to Child
0078ff70 761c0179 007921c8 761c0160 0078ffdc 7715662d ntdll!NtWaitForWorkViaWorkerFactory+0x0 
0078ff80 7715662d 007921c8 a53ade19 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
0078ffdc 771565fd ffffffff 77175194 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 
0078ffec 00000000 7713e230 007921c8 00000000 4dd7ccf7 ntdll!RtlGetAppContainerNamedObjectPath+0x0 

*** Dump of thread ID 5140 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 355150112.000000

- Registers -
eax=00000000 ebx=00797a40 ecx=00000000 edx=00000000 esi=00797880 edi=007921c8
eip=7716216c esp=009cfdb4 ebp=009cff70
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000206

- Callstack -
ChildEBP RetAddr  Args to Child
009cff70 761c0179 007921c8 761c0160 009cffdc 7715662d ntdll!NtWaitForWorkViaWorkerFactory+0x0 
009cff80 7715662d 007921c8 a5dede19 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
009cffdc 771565fd ffffffff 77175194 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 
009cffec 00000000 7713e230 007921c8 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 

*** Dump of thread ID 6064 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 355150112.000000

- Registers -
eax=00000000 ebx=00797e48 ecx=00000000 edx=00000000 esi=00797c88 edi=007921c8
eip=7716216c esp=00b0fdb4 ebp=00b0ff70
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000206

- Callstack -
ChildEBP RetAddr  Args to Child
00b0ff70 761c0179 007921c8 761c0160 00b0ffdc 7715662d ntdll!NtWaitForWorkViaWorkerFactory+0x0 
00b0ff80 7715662d 007921c8 a5f2de19 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
00b0ffdc 771565fd ffffffff 77175194 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 
00b0ffec 00000000 7713e230 007921c8 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 

*** Dump of thread ID 2948 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 3750000.000000, User Time: 468750.000000, Wait Time: 355150144.000000

- Registers -
eax=c0000022 ebx=012afd0c ecx=00000000 edx=00000000 esi=00000000 edi=012afd0c
eip=771607ec esp=012afccc ebp=012afd30
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000206

- Callstack -
ChildEBP RetAddr  Args to Child
012afd30 75ec8f8f 00000064 00000000 012aff70 00478b44 ntdll!ZwDelayExecution+0x0 
012afd40 00478b44 00000064 00478b20 00478b20 00000000 KERNELBASE!Sleep+0x0 
012aff70 761c0179 00000000 761c0160 012affdc 7715662d wah2_8.24_windows_intelx86!+0x0 
012aff80 7715662d 00000000 a468de19 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
012affdc 771565fd ffffffff 77175194 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 
012affec 00000000 00478b20 00000000 00000000 32686177 ntdll!RtlGetAppContainerNamedObjectPath+0x0 

*** Dump of thread ID 6540 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 468750.000000, User Time: 0.000000, Wait Time: 355150112.000000

- Registers -
eax=00000000 ebx=00792000 ecx=00000000 edx=00000000 esi=00791e40 edi=007907c0
eip=7716216c esp=05a9fdb4 ebp=05a9ff70
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000206

- Callstack -
ChildEBP RetAddr  Args to Child
05a9ff70 761c0179 007907c0 761c0160 05a9ffdc 7715662d ntdll!NtWaitForWorkViaWorkerFactory+0x0 
05a9ff80 7715662d 007907c0 a0ebde19 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
05a9ffdc 771565fd ffffffff 77175194 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 
05a9ffec 00000000 7713e230 007907c0 00000000 00000010 ntdll!RtlGetAppContainerNamedObjectPath+0x0 

*** Dump of thread ID 3476 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 355150112.000000

- Registers -
eax=00000000 ebx=007abca0 ecx=00000000 edx=00000000 esi=007abae0 edi=00792c08
eip=7716216c esp=05f1fdb4 ebp=05f1ff70
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000206

- Callstack -
ChildEBP RetAddr  Args to Child
05f1ff70 761c0179 00792c08 761c0160 05f1ffdc 7715662d ntdll!NtWaitForWorkViaWorkerFactory+0x0 
05f1ff80 7715662d 00792c08 a0b3de19 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
05f1ffdc 771565fd ffffffff 77175194 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 
05f1ffec 00000000 7713e230 00792c08 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 

*** Dump of thread ID 7920 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 355150112.000000

- Registers -
eax=7713e230 ebx=00000000 ecx=00000000 edx=00000000 esi=007ad9e8 edi=00792c08
eip=7716216c esp=0605fdb4 ebp=0605ff70
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000206

- Callstack -
ChildEBP RetAddr  Args to Child
0605ff70 761c0179 00792c08 761c0160 0605ffdc 7715662d ntdll!NtWaitForWorkViaWorkerFactory+0x0 
0605ff80 7715662d 00792c08 a347de19 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
0605ffdc 771565fd ffffffff 77175194 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 
0605ffec 00000000 7713e230 00792c08 00000000 6d3b2af9 ntdll!RtlGetAppContainerNamedObjectPath+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7588, selfPID=7588, iMonCtr=1

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
22 Apr 2019 10:47:36 1433245 21522023 wah2_safr50_n0si_201612_24_791_011756032_0 242,219 2,140,062 8.8352
21 Apr 2019 04:28:55 1433245 21522023 wah2_safr50_n0si_201612_24_791_011756032_0 230,699 2,035,140 8.8216
19 Apr 2019 21:08:53 1433245 21522023 wah2_safr50_n0si_201612_24_791_011756032_0 219,179 1,938,110 8.8426
18 Apr 2019 12:06:09 1433245 21522023 wah2_safr50_n0si_201612_24_791_011756032_0 207,659 1,841,151 8.8662
17 Apr 2019 05:01:37 1433245 21522023 wah2_safr50_n0si_201612_24_791_011756032_0 196,139 1,739,268 8.8675
16 Apr 2019 00:00:12 1433245 21522023 wah2_safr50_n0si_201612_24_791_011756032_0 184,619 1,637,509 8.8697
14 Apr 2019 19:34:51 1433245 21522023 wah2_safr50_n0si_201612_24_791_011756032_0 173,099 1,537,239 8.8807
13 Apr 2019 14:31:33 1433245 21522023 wah2_safr50_n0si_201612_24_791_011756032_0 161,579 1,439,843 8.9111
12 Apr 2019 10:51:03 1433245 21522023 wah2_safr50_n0si_201612_24_791_011756032_0 150,059 1,342,472 8.9463
11 Apr 2019 06:58:40 1433245 21522023 wah2_safr50_n0si_201612_24_791_011756032_0 138,539 1,244,302 8.9816
10 Apr 2019 03:14:20 1433245 21522023 wah2_safr50_n0si_201612_24_791_011756032_0 127,019 1,145,974 9.0221
08 Apr 2019 22:59:30 1433245 21522023 wah2_safr50_n0si_201612_24_791_011756032_0 115,499 1,047,172 9.0665
07 Apr 2019 18:52:24 1433245 21522023 wah2_safr50_n0si_201612_24_791_011756032_0 103,979 948,041 9.1176
06 Apr 2019 10:21:15 1433245 21522023 wah2_safr50_n0si_201612_24_791_011756032_0 92,459 846,662 9.1572
05 Apr 2019 02:33:48 1433245 21522023 wah2_safr50_n0si_201612_24_791_011756032_0 80,939 739,364 9.1348
03 Apr 2019 20:44:31 1433245 21522023 wah2_safr50_n0si_201612_24_791_011756032_0 69,419 636,603 9.1704
02 Apr 2019 15:16:51 1433245 21522023 wah2_safr50_n0si_201612_24_791_011756032_0 57,899 535,454 9.2481
01 Apr 2019 11:12:01 1433245 21522023 wah2_safr50_n0si_201612_24_791_011756032_0 46,379 436,697 9.4158
31 Mar 2019 06:20:50 1433245 21522023 wah2_safr50_n0si_201612_24_791_011756032_0 34,859 335,393 9.6214
29 Mar 2019 21:14:09 1433245 21522023 wah2_safr50_n0si_201612_24_791_011756032_0 23,339 222,769 9.5449


©2024 climateprediction.net