climateprediction.net home page
Task 21529809

Task 21529809

Name wah2_safr50_a0yu_201612_24_790_011752510_1
Workunit 11752510
Created 9 Mar 2019, 0:58:10 UTC
Sent 25 Mar 2019, 12:10:00 UTC
Report deadline 6 Mar 2020, 17:30:00 UTC
Received 30 Mar 2019, 18:54:28 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 0 (0x00000000)
Computer ID 1419071
Run time 2 days 3 hours 0 min 38 sec
CPU time 2 days 2 hours 55 min
Validate state Invalid
Credit 5,339.28
Device peak FLOPS 3.86 GFLOPS
Application version Weather At Home 2 (wah2) v8.24
windows_intelx86
Peak working set size 256.96 MB
Peak swap size 221.79 MB
Peak disk usage 89.89 MB
Stderr
<core_client_version>7.14.2</core_client_version>
<![CDATA[
<stderr_txt>


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Access Violation (0xc0000005) at address 0x00463007 read attempt to address 0x011E03AC

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.7.0


Dump Timestamp    : 03/27/19 18:10:22
Install Directory : 
Data Directory    : C:\ProgramData\BOINC
Project Symstore  : 
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\slots\1;C:\ProgramData\BOINC\projects\climateprediction.net


ModLoad: 0000000000400000 0000000000152000 C:\ProgramData\BOINC\projects\climateprediction.net\wah2_8.24_windows_intelx86.exe (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000773f0000 0000000000180000 C:\Windows\SysWOW64\ntdll.dll (6.1.7601.24387) (-exported- Symbols Loaded)
    Linked PDB Filename   : wntdll.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 00000000759b0000 0000000000110000 C:\Windows\syswow64\kernel32.dll (6.1.7601.24387) (-exported- Symbols Loaded)
    Linked PDB Filename   : wkernel32.pdb
    File Version          : 6.1.7601.18015 (win7sp1_gdr.121129-1432)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.18015

ModLoad: 0000000075e60000 0000000000047000 C:\Windows\syswow64\KERNELBASE.dll (6.1.7601.24387) (-exported- Symbols Loaded)
    Linked PDB Filename   : wkernelbase.pdb
    File Version          : 6.1.7601.18015 (win7sp1_gdr.121129-1432)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.18015

ModLoad: 0000000075d60000 0000000000100000 C:\Windows\syswow64\USER32.dll (6.1.7601.23594) (-exported- Symbols Loaded)
    Linked PDB Filename   : wuser32.pdb
    File Version          : 6.1.7601.17514 (win7sp1_rtm.101119-1850)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.17514

ModLoad: 0000000075ed0000 0000000000090000 C:\Windows\syswow64\GDI32.dll (6.1.7601.24308) (-exported- Symbols Loaded)
    Linked PDB Filename   : wgdi32.pdb
    File Version          : 6.1.7601.24308 (win7sp1_ldr.181111-0600)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.24308

ModLoad: 0000000075ec0000 000000000000a000 C:\Windows\syswow64\LPK.dll (6.1.7601.24280) (-exported- Symbols Loaded)
    Linked PDB Filename   : wlpk.pdb
    File Version          : 6.1.7601.24280 (win7sp1_ldr.181006-0600)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.24280

ModLoad: 0000000076d30000 000000000009d000 C:\Windows\syswow64\USP10.dll (1.626.7601.23894) (-exported- Symbols Loaded)
    Linked PDB Filename   : usp10.pdb
    File Version          : 1.0626.7601.23894 (win7sp1_ldr.170816-0600)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft(R) Uniscribe Unicode script processor
    Product Version       : 1.0626.7601.23894

ModLoad: 0000000076950000 00000000000ac000 C:\Windows\syswow64\msvcrt.dll (7.0.7601.17744) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.7601.17744 (win7sp1_gdr.111215-1535)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.7601.17744

ModLoad: 0000000075f60000 00000000000a1000 C:\Windows\syswow64\ADVAPI32.dll (6.1.7601.24387) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 6.1.7601.24387 (win7sp1_ldr_escrow.190305-1700)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.24387

ModLoad: 0000000075c50000 0000000000019000 C:\Windows\SysWOW64\sechost.dll (6.1.7601.18869) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 0000000076030000 00000000000f0000 C:\Windows\syswow64\RPCRT4.dll (6.1.7601.24387) (-exported- Symbols Loaded)
    Linked PDB Filename   : wrpcrt4.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 0000000074b10000 0000000000060000 C:\Windows\syswow64\SspiCli.dll (6.1.7601.24387) (-exported- Symbols Loaded)
    Linked PDB Filename   : wsspicli.pdb
    File Version          : 6.1.7601.24387 (win7sp1_ldr_escrow.190305-1700)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.24387

ModLoad: 0000000074b00000 000000000000c000 C:\Windows\syswow64\CRYPTBASE.dll (6.1.7601.24387) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptbase.pdb
    File Version          : 6.1.7601.24387 (win7sp1_ldr_escrow.190305-1700)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.24387

ModLoad: 00000000766f0000 0000000000060000 C:\Windows\system32\IMM32.DLL (6.1.7601.17514) (-exported- Symbols Loaded)
    Linked PDB Filename   : wimm32.pdb
    File Version          : 6.1.7601.17514 (win7sp1_rtm.101119-1850)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.17514

ModLoad: 0000000075ac0000 00000000000cd000 C:\Windows\syswow64\MSCTF.dll (6.1.7601.23915) (-exported- Symbols Loaded)
    Linked PDB Filename   : msctf.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 0000000074390000 0000000000032000 C:\PROGRA~2\Sophos\SOPHOS~1\SOPHOS~1.DLL (10.8.1.316) (-exported- Symbols Loaded)
    Linked PDB Filename   : c:\Build\build\Symbols\Release\sophos_detoured.pdb
    File Version          : 10.8.1.316
    Company Name          : Sophos Limited
    Product Name          : Sophos Anti-Virus
    Product Version       : 10.8.1

ModLoad: 0000000075d50000 0000000000005000 C:\Windows\syswow64\PSAPI.DLL (6.1.7600.16385) (-exported- Symbols Loaded)
    Linked PDB Filename   : psapi.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 0000000074320000 0000000000021000 C:\Windows\system32\ntmarta.dll (6.1.7600.16385) (-exported- Symbols Loaded)
    Linked PDB Filename   : ntmarta.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 0000000076220000 0000000000045000 C:\Windows\syswow64\WLDAP32.dll (6.1.7601.23889) (-exported- Symbols Loaded)
    Linked PDB Filename   : wldap32.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 000000006dac0000 000000000004c000 C:\Windows\system32\apphelp.dll (6.1.7601.19050) (-exported- Symbols Loaded)
    Linked PDB Filename   : apphelp.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 000000006d0b0000 00000000000eb000 C:\Windows\system32\dbghelp.dll (6.1.7601.17514) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 6.1.7601.17514 (win7sp1_rtm.101119-1850)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.17514

ModLoad: 00000000739a0000 0000000000009000 C:\Windows\system32\version.dll (6.1.7600.16385) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 21716, Write: 0, Other 81241

- I/O Transfers Counters -
Read: 0, Write: 2697, Other 0

- Paged Pool Usage -
QuotaPagedPoolUsage: 195688, QuotaPeakPagedPoolUsage: 195688
QuotaNonPagedPoolUsage: 8168, QuotaPeakNonPagedPoolUsage: 8248

- Virtual Memory Usage -
VirtualSize: 106487808, PeakVirtualSize: 106487808

- Pagefile Usage -
PagefileUsage: 2830336, PeakPagefileUsage: 3334144

- Working Set Size -
WorkingSetSize: 78852096, PeakWorkingSetSize: 79417344, PageFaultCount: 20297

*** Dump of thread ID 5900 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 2353460.000000

- Unhandled Exception Record -
Reason: Access Violation (0xc0000005) at address 0x00463007 read attempt to address 0x011E03AC

- Registers -
eax=00000015 ebx=80000000 ecx=00000000 edx=0065e8b8 esi=01110020 edi=00000000
eip=00463007 esp=059dfe90 ebp=059dfe94
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00010216

- Callstack -
ChildEBP RetAddr  Args to Child
059dfe94 0044826f 01110020 00000000 01110020 80000000 wah2_8.24_windows_intelx86!+0x0 
059dfeac 0044fa68 01110020 00000000 0051d6b0 059dfefc wah2_8.24_windows_intelx86!+0x0 
059dfec0 004856fc 00000015 2fce8cea 00000001 00000006 wah2_8.24_windows_intelx86!+0x0 
059dfefc 75a67731 00000006 2fcec359 00000000 00000000 wah2_8.24_windows_intelx86!+0x0 
059dff88 759c344d 00000006 059dffd4 77429802 80000006 kernel32!CtrlRoutine+0x0 
059dff94 77429802 80000006 70f96ea7 00000000 00000000 kernel32!BaseThreadInitThunk+0x0 
059dffd4 774297d5 75a6757c 80000006 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 
059dffec 00000000 75a6757c 80000006 00000000 29fd175b ntdll!RtlInitializeExceptionChain+0x0 

*** Dump of thread ID 8768 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 20124128.000000, User Time: 42432272.000000, Wait Time: 2353454.000000

- Registers -
eax=00000000 ebx=00000050 ecx=00000000 edx=00000000 esi=0018ed80 edi=00000000
eip=7740fdc1 esp=0018ed3c ebp=0018eda4
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
0018eda4 75e74667 000000c8 00000000 0018edc8 00468ec1 ntdll!NtDelayExecution+0x0 
0018edb4 00468ec1 000000c8 000000c8 00000000 0018ee00 KERNELBASE!Sleep+0x0 
0018edc8 00407a89 a0000000 027f9999 00000000 004d0c50 wah2_8.24_windows_intelx86!+0x0 
0018ee00 004092c5 00000000 2a4b8f5e 00000000 00000000 wah2_8.24_windows_intelx86!+0x0 
0018fd48 004094b7 0018fef8 00409535 004d1370 0018fd68 wah2_8.24_windows_intelx86!+0x0 
0018fd50 00409535 004d1370 0018fd68 00703028 0018fd68 wah2_8.24_windows_intelx86!+0x0 
0018fef8 00485c7b 00400000 00000000 00703066 0000000a wah2_8.24_windows_intelx86!+0x0 
0018ff88 759c344d 7efde000 0018ffd4 77429802 7efde000 wah2_8.24_windows_intelx86!+0x0 
0018ff94 77429802 7efde000 757c6ea7 00000000 00000000 kernel32!BaseThreadInitThunk+0x0 
0018ffd4 774297d5 00485cce 7efde000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 
0018ffec 00000000 00485cce 7efde000 00000000 78746341 ntdll!RtlInitializeExceptionChain+0x0 

*** Dump of thread ID 9428 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 2353454.000000

- Registers -
eax=c0000022 ebx=00000000 ecx=00000000 edx=00000000 esi=0110fd24 edi=00000000
eip=7740fdc1 esp=0110fce0 ebp=0110fd48
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
0110fd48 75e74667 00000064 00000000 0110ff88 00478b44 ntdll!NtDelayExecution+0x0 
0110fd58 00478b44 00000064 00000000 00000000 00000000 KERNELBASE!Sleep+0x0 
0110ff88 759c344d 00000000 0110ffd4 77429802 00000000 wah2_8.24_windows_intelx86!+0x0 
0110ff94 77429802 00000000 74746ea7 00000000 00000000 kernel32!BaseThreadInitThunk+0x0 
0110ffd4 774297d5 00478b20 00000000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 
0110ffec 00000000 00478b20 00000000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2908, selfPID=2908, iMonCtr=1
No Process Handle
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2908, selfPID=8004, iMonCtr=1
No Process Handle
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2056, selfPID=3168, iMonCtr=1
No Process Handle
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2056, selfPID=2056, iMonCtr=1
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2900, selfPID=2900, iMonCtr=1
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2900, selfPID=3972, iMonCtr=1
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2816, selfPID=2816, iMonCtr=1
No Process Handle
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2816, selfPID=3908, iMonCtr=1
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2912, selfPID=2912, iMonCtr=1
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2912, selfPID=3896, iMonCtr=1
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2848, selfPID=2848, iMonCtr=1
No Process Handle
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2848, selfPID=3928, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Signal 11 received: Segment violation
Signal 11 received: Software termination signal from kill 
Signal 11 received: Abnormal termination triggered by abort call
Signal 11 received, exiting...
18:41:13 (3908): called boinc_finish(193)
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2244, iMonCtr=2
Model crash detected, will try to restart...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2820, iMonCtr=2
Leaving CPDN_ain::Monitor...
18:41:17 (2244): called boinc_finish(0)

</stderr_txt>
<message>
upload failure: <file_xfer_error>
  <file_name>wah2_safr50_a0yu_201612_24_790_011752510_1_r810506511_8.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_safr50_a0yu_201612_24_790_011752510_1_r810506511_9.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_safr50_a0yu_201612_24_790_011752510_1_r810506511_10.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_safr50_a0yu_201612_24_790_011752510_1_r810506511_11.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_safr50_a0yu_201612_24_790_011752510_1_r810506511_12.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_safr50_a0yu_201612_24_790_011752510_1_r810506511_13.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_safr50_a0yu_201612_24_790_011752510_1_r810506511_14.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_safr50_a0yu_201612_24_790_011752510_1_r810506511_15.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_safr50_a0yu_201612_24_790_011752510_1_r810506511_16.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_safr50_a0yu_201612_24_790_011752510_1_r810506511_17.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_safr50_a0yu_201612_24_790_011752510_1_r810506511_18.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_safr50_a0yu_201612_24_790_011752510_1_r810506511_19.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_safr50_a0yu_201612_24_790_011752510_1_r810506511_20.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_safr50_a0yu_201612_24_790_011752510_1_r810506511_21.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_safr50_a0yu_201612_24_790_011752510_1_r810506511_22.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_safr50_a0yu_201612_24_790_011752510_1_r810506511_23.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_safr50_a0yu_201612_24_790_011752510_1_r810506511_24.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_safr50_a0yu_201612_24_790_011752510_1_r810506511_restart.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
</message>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
30 Mar 2019 17:54:43 1419071 21529809 wah2_safr50_a0yu_201612_24_790_011752510_1 80,939 180,150 2.2258
30 Mar 2019 09:28:50 1419071 21529809 wah2_safr50_a0yu_201612_24_790_011752510_1 69,419 154,739 2.2291
30 Mar 2019 02:22:20 1419071 21529809 wah2_safr50_a0yu_201612_24_790_011752510_1 57,899 129,310 2.2334
29 Mar 2019 10:52:07 1419071 21529809 wah2_safr50_a0yu_201612_24_790_011752510_1 46,379 103,236 2.2259
29 Mar 2019 00:56:02 1419071 21529809 wah2_safr50_a0yu_201612_24_790_011752510_1 34,859 77,586 2.2257
28 Mar 2019 13:22:37 1419071 21529809 wah2_safr50_a0yu_201612_24_790_011752510_1 23,339 51,848 2.2215
28 Mar 2019 11:23:12 1419071 21529809 wah2_safr50_a0yu_201612_24_790_011752510_1 11,819 26,078 2.2064


©2024 climateprediction.net