climateprediction.net home page
Task 21382657

Task 21382657

Name wah2_global_e0r5_208812_145_767_011657849_1
Workunit 11657849
Created 14 Nov 2018, 15:00:58 UTC
Sent 14 Nov 2018, 15:13:48 UTC
Report deadline 27 Oct 2019, 20:33:48 UTC
Received 19 Dec 2018, 8:32:37 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 0 (0x00000000)
Computer ID 1470944
Run time 6 days 9 hours 32 min 46 sec
CPU time 5 days 7 hours 15 min 45 sec
Validate state Invalid
Credit 12,543.37
Device peak FLOPS 3.29 GFLOPS
Application version Weather At Home 2 (wah2) v8.24
windows_intelx86
Peak working set size 247.18 MB
Peak swap size 174.54 MB
Peak disk usage 50.81 MB
Stderr
<core_client_version>7.14.2</core_client_version>
<![CDATA[
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=25092, selfPID=16416, iMonCtr=1
Model crash detected, will try to restart...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=25092, selfPID=25092, iMonCtr=2
Leaving CPDN_ain::Monitor...
22:33:40 (16416): called boinc_finish(0)

</stderr_txt>
<message>
upload failure: <file_xfer_error>
  <file_name>wah2_global_e0r5_208812_145_767_011657849_1_r1426483184_67.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0r5_208812_145_767_011657849_1_r1426483184_68.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0r5_208812_145_767_011657849_1_r1426483184_69.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0r5_208812_145_767_011657849_1_r1426483184_70.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0r5_208812_145_767_011657849_1_r1426483184_71.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0r5_208812_145_767_011657849_1_r1426483184_72.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0r5_208812_145_767_011657849_1_r1426483184_73.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0r5_208812_145_767_011657849_1_r1426483184_74.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0r5_208812_145_767_011657849_1_r1426483184_75.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0r5_208812_145_767_011657849_1_r1426483184_76.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0r5_208812_145_767_011657849_1_r1426483184_77.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0r5_208812_145_767_011657849_1_r1426483184_78.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0r5_208812_145_767_011657849_1_r1426483184_79.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0r5_208812_145_767_011657849_1_r1426483184_80.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0r5_208812_145_767_011657849_1_r1426483184_81.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0r5_208812_145_767_011657849_1_r1426483184_82.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0r5_208812_145_767_011657849_1_r1426483184_83.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0r5_208812_145_767_011657849_1_r1426483184_84.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0r5_208812_145_767_011657849_1_r1426483184_85.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0r5_208812_145_767_011657849_1_r1426483184_86.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0r5_208812_145_767_011657849_1_r1426483184_87.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0r5_208812_145_767_011657849_1_r1426483184_88.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0r5_208812_145_767_011657849_1_r1426483184_89.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0r5_208812_145_767_011657849_1_r1426483184_90.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0r5_208812_145_767_011657849_1_r1426483184_91.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0r5_208812_145_767_011657849_1_r1426483184_92.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0r5_208812_145_767_011657849_1_r1426483184_93.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0r5_208812_145_767_011657849_1_r1426483184_94.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0r5_208812_145_767_011657849_1_r1426483184_95.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0r5_208812_145_767_011657849_1_r1426483184_96.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0r5_208812_145_767_011657849_1_r1426483184_97.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0r5_208812_145_767_011657849_1_r1426483184_98.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0r5_208812_145_767_011657849_1_r1426483184_99.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0r5_208812_145_767_011657849_1_r1426483184_100.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0r5_208812_145_767_011657849_1_r1426483184_101.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0r5_208812_145_767_011657849_1_r1426483184_102.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0r5_208812_145_767_011657849_1_r1426483184_103.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0r5_208812_145_767_011657849_1_r1426483184_104.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0r5_208812_145_767_011657849_1_r1426483184_105.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0r5_208812_145_767_011657849_1_r1426483184_106.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0r5_208812_145_767_011657849_1_r1426483184_107.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0r5_208812_145_767_011657849_1_r1426483184_108.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0r5_208812_145_767_011657849_1_r1426483184_109.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0r5_208812_145_767_011657849_1_r1426483184_110.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0r5_208812_145_767_011657849_1_r1426483184_111.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0r5_208812_145_767_011657849_1_r1426483184_112.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0r5_208812_145_767_011657849_1_r1426483184_113.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0r5_208812_145_767_011657849_1_r1426483184_114.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0r5_208812_145_767_011657849_1_r1426483184_115.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0r5_208812_145_767_011657849_1_r1426483184_116.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0r5_208812_145_767_011657849_1_r1426483184_117.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0r5_208812_145_767_011657849_1_r1426483184_118.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0r5_208812_145_767_011657849_1_r1426483184_119.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0r5_208812_145_767_011657849_1_r1426483184_120.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0r5_208812_145_767_011657849_1_r1426483184_121.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0r5_208812_145_767_011657849_1_r1426483184_122.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0r5_208812_145_767_011657849_1_r1426483184_123.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0r5_208812_145_767_011657849_1_r1426483184_124.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0r5_208812_145_767_011657849_1_r1426483184_125.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0r5_208812_145_767_011657849_1_r1426483184_126.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0r5_208812_145_767_011657849_1_r1426483184_127.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0r5_208812_145_767_011657849_1_r1426483184_128.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0r5_208812_145_767_011657849_1_r1426483184_129.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0r5_208812_145_767_011657849_1_r1426483184_130.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0r5_208812_145_767_011657849_1_r1426483184_131.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0r5_208812_145_767_011657849_1_r1426483184_132.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0r5_208812_145_767_011657849_1_r1426483184_133.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0r5_208812_145_767_011657849_1_r1426483184_134.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0r5_208812_145_767_011657849_1_r1426483184_135.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0r5_208812_145_767_011657849_1_r1426483184_136.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0r5_208812_145_767_011657849_1_r1426483184_137.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0r5_208812_145_767_011657849_1_r1426483184_138.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0r5_208812_145_767_011657849_1_r1426483184_139.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0r5_208812_145_767_011657849_1_r1426483184_140.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0r5_208812_145_767_011657849_1_r1426483184_141.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0r5_208812_145_767_011657849_1_r1426483184_142.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0r5_208812_145_767_011657849_1_r1426483184_143.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0r5_208812_145_767_011657849_1_r1426483184_144.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0r5_208812_145_767_011657849_1_r1426483184_145.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0r5_208812_145_767_011657849_1_r1426483184_restart.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
</message>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
18 Dec 2018 20:12:33 1470944 21382657 wah2_global_e0r5_208812_145_767_011657849_1 190,147 455,063 2.3932
18 Dec 2018 15:14:35 1470944 21382657 wah2_global_e0r5_208812_145_767_011657849_1 187,267 446,683 2.3853
16 Dec 2018 22:57:47 1470944 21382657 wah2_global_e0r5_208812_145_767_011657849_1 184,387 438,656 2.3790
08 Dec 2018 09:17:42 1470944 21382657 wah2_global_e0r5_208812_145_767_011657849_1 181,507 430,842 2.3737
04 Dec 2018 20:43:31 1470944 21382657 wah2_global_e0r5_208812_145_767_011657849_1 178,627 423,549 2.3711
03 Dec 2018 19:17:47 1470944 21382657 wah2_global_e0r5_208812_145_767_011657849_1 175,747 416,413 2.3694
03 Dec 2018 17:38:10 1470944 21382657 wah2_global_e0r5_208812_145_767_011657849_1 172,867 409,126 2.3667
03 Dec 2018 15:01:56 1470944 21382657 wah2_global_e0r5_208812_145_767_011657849_1 169,987 401,837 2.3639
03 Dec 2018 12:00:03 1470944 21382657 wah2_global_e0r5_208812_145_767_011657849_1 167,107 394,613 2.3614
03 Dec 2018 10:00:28 1470944 21382657 wah2_global_e0r5_208812_145_767_011657849_1 164,227 387,367 2.3587
03 Dec 2018 07:19:35 1470944 21382657 wah2_global_e0r5_208812_145_767_011657849_1 161,347 380,182 2.3563
03 Dec 2018 05:03:03 1470944 21382657 wah2_global_e0r5_208812_145_767_011657849_1 158,467 373,016 2.3539
03 Dec 2018 03:13:14 1470944 21382657 wah2_global_e0r5_208812_145_767_011657849_1 155,587 365,829 2.3513
03 Dec 2018 00:07:55 1470944 21382657 wah2_global_e0r5_208812_145_767_011657849_1 152,707 358,494 2.3476
02 Dec 2018 22:39:27 1470944 21382657 wah2_global_e0r5_208812_145_767_011657849_1 149,827 350,983 2.3426
02 Dec 2018 12:17:47 1470944 21382657 wah2_global_e0r5_208812_145_767_011657849_1 146,947 344,195 2.3423
02 Dec 2018 10:16:51 1470944 21382657 wah2_global_e0r5_208812_145_767_011657849_1 144,067 337,917 2.3456
02 Dec 2018 08:43:14 1470944 21382657 wah2_global_e0r5_208812_145_767_011657849_1 141,187 331,640 2.3489
02 Dec 2018 05:57:28 1470944 21382657 wah2_global_e0r5_208812_145_767_011657849_1 138,307 325,358 2.3524
02 Dec 2018 03:58:12 1470944 21382657 wah2_global_e0r5_208812_145_767_011657849_1 135,427 319,061 2.3560


©2024 climateprediction.net