climateprediction.net home page
Task 21678240

Task 21678240

Name wah2_sam50_a1f7_201412_24_804_011795725_2
Workunit 11795725
Created 20 May 2019, 17:04:16 UTC
Sent 24 May 2019, 4:21:37 UTC
Report deadline 5 May 2020, 9:41:37 UTC
Received 13 Jul 2019, 10:29:48 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 0 (0x00000000)
Computer ID 1485864
Run time 5 days 6 hours 42 min 14 sec
CPU time 4 days 14 hours 56 min 14 sec
Validate state Invalid
Credit 17,498.26
Device peak FLOPS 5.03 GFLOPS
Application version Weather At Home 2 (wah2) v8.24
windows_intelx86
Peak working set size 225.32 MB
Peak swap size 187.99 MB
Peak disk usage 46.95 MB
Stderr
<core_client_version>7.14.2</core_client_version>
<![CDATA[
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
GCM : BUFFIN: C I/O Error feof - Unit 61 - Return code = 16
GCM : BUFFIN: C I/O Error feof - Unit 61 - Return code = 16

GCM : BUFFIN: C I/O Error feof - Unit 63 - Return code = 16
GCM : BUFFIN: C I/O Error feof - Unit 63 - Return code = 16

GCM : BUFFIN: C I/O Error feof - Unit 64 - Return code = 16
GCM : BUFFIN: C I/O Error feof - Unit 64 - Return code = 16

CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

forrtl: The handle is invalid.

Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=10232, selfPID=10232, iMonCtr=2
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
forrtl: The handle is invalid.

Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
forrtl: The handle is invalid.

Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
forrtl: The handle is invalid.

Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=13648, iMonCtr=2
Model crash detected, will try to restart...
Leaving CPDN_ain::Monitor...
02:28:55 (13648): called boinc_finish(0)

</stderr_txt>
<message>
upload failure: <file_xfer_error>
  <file_name>wah2_sam50_a1f7_201412_24_804_011795725_2_r2079897731_24.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sam50_a1f7_201412_24_804_011795725_2_r2079897731_restart.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
</message>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
06 Jun 2019 11:46:18 1485864 21678240 wah2_sam50_a1f7_201412_24_804_011795725_2 265,259 394,968 1.4890
06 Jun 2019 11:46:18 1485864 21678240 wah2_sam50_a1f7_201412_24_804_011795725_2 253,739 378,311 1.4909
06 Jun 2019 11:46:18 1485864 21678240 wah2_sam50_a1f7_201412_24_804_011795725_2 242,219 361,295 1.4916
06 Jun 2019 11:46:18 1485864 21678240 wah2_sam50_a1f7_201412_24_804_011795725_2 230,699 344,269 1.4923
06 Jun 2019 11:46:18 1485864 21678240 wah2_sam50_a1f7_201412_24_804_011795725_2 219,179 327,521 1.4943
06 Jun 2019 11:46:18 1485864 21678240 wah2_sam50_a1f7_201412_24_804_011795725_2 207,659 310,574 1.4956
06 Jun 2019 11:46:18 1485864 21678240 wah2_sam50_a1f7_201412_24_804_011795725_2 196,139 293,599 1.4969
06 Jun 2019 11:46:18 1485864 21678240 wah2_sam50_a1f7_201412_24_804_011795725_2 184,619 277,168 1.5013
06 Jun 2019 11:46:18 1485864 21678240 wah2_sam50_a1f7_201412_24_804_011795725_2 173,099 260,726 1.5062
06 Jun 2019 11:46:18 1485864 21678240 wah2_sam50_a1f7_201412_24_804_011795725_2 161,579 244,382 1.5125
06 Jun 2019 11:46:18 1485864 21678240 wah2_sam50_a1f7_201412_24_804_011795725_2 150,059 227,334 1.5150
06 Jun 2019 11:46:18 1485864 21678240 wah2_sam50_a1f7_201412_24_804_011795725_2 138,539 210,618 1.5203
06 Jun 2019 11:46:17 1485864 21678240 wah2_sam50_a1f7_201412_24_804_011795725_2 127,019 193,342 1.5222
29 May 2019 11:18:56 1485864 21678240 wah2_sam50_a1f7_201412_24_804_011795725_2 115,499 175,155 1.5165
27 May 2019 06:18:55 1485864 21678240 wah2_sam50_a1f7_201412_24_804_011795725_2 103,979 157,228 1.5121
27 May 2019 00:54:47 1485864 21678240 wah2_sam50_a1f7_201412_24_804_011795725_2 92,459 140,038 1.5146
26 May 2019 19:09:03 1485864 21678240 wah2_sam50_a1f7_201412_24_804_011795725_2 80,939 122,556 1.5142
26 May 2019 13:39:45 1485864 21678240 wah2_sam50_a1f7_201412_24_804_011795725_2 69,419 104,932 1.5116
26 May 2019 07:34:40 1485864 21678240 wah2_sam50_a1f7_201412_24_804_011795725_2 57,899 87,029 1.5031
25 May 2019 23:46:33 1485864 21678240 wah2_sam50_a1f7_201412_24_804_011795725_2 46,379 69,142 1.4908


©2024 climateprediction.net