climateprediction.net home page
Task 11183367

Task 11183367

Name hadsm3dhet2_k1xs_006612162_2
Workunit 6815535
Created 15 Mar 2010, 12:23:16 UTC
Sent 9 May 2010, 4:31:39 UTC
Report deadline 21 Apr 2011, 9:51:39 UTC
Received 4 Apr 2011, 1:11:48 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status -1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID 1061885
Run time 61 days 4 hours 33 min 32 sec
CPU time 48 days 10 hours 47 min 14 sec
Validate state Invalid
Credit 5,061.41
Device peak FLOPS 0.00 GFLOPS
Application version ---
Stderr
<core_client_version>6.10.18</core_client_version>
<![CDATA[
<message>
 - exit code -1073741819 (0xc0000005)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4696, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5708, iMonCtr=1
Model crash detected, will try to restart...
No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3860, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5280, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3868, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5220, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1892, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4780, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5504, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=556, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4316, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5124, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4588, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5700, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5872, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4584, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
MainError:	03:05:00 PM	No files match the supplied pattern.
MainError:	03:05:00 PM	No files match the supplied pattern.
MainError:	03:05:00 PM	No files match the supplied pattern.
MainError:	03:05:00 PM	No files match the supplied pattern.
MainError:	03:05:00 PM	No files match the supplied pattern.
MainError:	03:05:00 PM	No files match the supplied pattern.
MainError:	03:05:00 PM	No files match the supplied pattern.
MainError:	03:05:00 PM	No files match the supplied pattern.
MainError:	03:05:00 PM	No files match the supplied pattern.
MainError:	03:05:00 PM	No files match the supplied pattern.
MainError:	03:05:00 PM	No files match the supplied pattern.
MainError:	03:05:00 PM	No files match the supplied pattern.
MainError:	03:05:00 PM	No files match the supplied pattern.
MainError:	03:05:00 PM	No files match the supplied pattern.
MainError:	03:05:00 PM	No files match the supplied pattern.
MainError:	03:05:00 PM	No files match the supplied pattern.
MainError:	03:05:00 PM	No files match the supplied pattern.
MainError:	03:05:00 PM	No files match the supplied pattern.
MainError:	03:05:00 PM	No files match the supplied pattern.
MainError:	03:05:00 PM	No files match the supplied pattern.
MainError:	03:05:00 PM	No files match the supplied pattern.
MainError:	03:05:00 PM	No files match the supplied pattern.
MainError:	03:05:00 PM	No files match the supplied pattern.
MainError:	03:05:00 PM	No files match the supplied pattern.
MainError:	03:05:00 PM	No files match the supplied pattern.
MainError:	03:05:00 PM	No files match the supplied pattern.
MainError:	03:05:00 PM	No files match the supplied pattern.
MainError:	03:05:00 PM	No files match the supplied pattern.
MainError:	03:05:00 PM	No files match the supplied pattern.
MainError:	03:05:00 PM	No files match the supplied pattern.
MainError:	03:05:00 PM	No files match the supplied pattern.
MainError:	03:05:00 PM	No files match the supplied pattern.
MainError:	03:05:00 PM	No files match the supplied pattern.
MainError:	03:05:00 PM	No files match the supplied pattern.
MainError:	03:05:00 PM	No files match the supplied pattern.
MainError:	03:05:00 PM	No files match the supplied pattern.
MainError:	03:05:00 PM	No files match the supplied pattern.
MainError:	03:05:00 PM	No files match the supplied pattern.
MainError:	03:05:00 PM	No files match the supplied pattern.
MainError:	03:05:00 PM	No files match the supplied pattern.
MainError:	03:05:00 PM	No files match the supplied pattern.
MainError:	03:05:00 PM	No files match the supplied pattern.
MainError:	03:05:00 PM	No files match the supplied pattern.
MainError:	03:05:00 PM	No files match the supplied pattern.
MainError:	03:05:00 PM	No files match the supplied pattern.
MainError:	03:05:00 PM	No files match the supplied pattern.
MainError:	03:05:00 PM	No files match the supplied pattern.
MainError:	03:05:00 PM	No files match the supplied pattern.
MainError:	03:05:00 PM	No files match the supplied pattern.
MainError:	03:05:00 PM	No files match the supplied pattern.
MainError:	03:05:00 PM	No files match the supplied pattern.
MainError:	03:05:00 PM	No files match the supplied pattern.
MainError:	03:05:00 PM	No files match the supplied pattern.
MainError:	03:05:00 PM	No files match the supplied pattern.
MainError:	03:05:00 PM	No files match the supplied pattern.
MainError:	03:05:00 PM	No files match the supplied pattern.
CPDN Monitor - Quit request from BOINC...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5960, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5136, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
No Process Handle
CPDN process is not running, exiting, bRetVal = 1, checkPID=4192, selfPID=4192, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4820, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2540, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4976, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5548, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=996, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5220, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9388, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3052, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5508, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4556, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6076, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4568, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5412, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4884, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=10696, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
MainError:	12:06:31 AM	No files match the supplied pattern.
MainError:	12:06:31 AM	No files match the supplied pattern.
MainError:	12:06:31 AM	No files match the supplied pattern.
MainError:	12:06:31 AM	No files match the supplied pattern.
MainError:	12:06:31 AM	No files match the supplied pattern.
MainError:	12:06:31 AM	No files match the supplied pattern.
MainError:	12:06:31 AM	No files match the supplied pattern.
MainError:	12:06:31 AM	No files match the supplied pattern.
MainError:	12:06:31 AM	No files match the supplied pattern.
MainError:	12:06:31 AM	No files match the supplied pattern.
MainError:	12:06:31 AM	No files match the supplied pattern.
MainError:	12:06:31 AM	No files match the supplied pattern.
MainError:	12:06:31 AM	No files match the supplied pattern.
MainError:	12:06:31 AM	No files match the supplied pattern.
MainError:	12:06:31 AM	No files match the supplied pattern.
MainError:	12:06:31 AM	No files match the supplied pattern.
MainError:	12:06:31 AM	No files match the supplied pattern.
MainError:	12:06:31 AM	No files match the supplied pattern.
MainError:	12:06:31 AM	No files match the supplied pattern.
MainError:	12:06:31 AM	No files match the supplied pattern.
MainError:	12:06:31 AM	No files match the supplied pattern.
MainError:	12:06:31 AM	No files match the supplied pattern.
MainError:	12:06:31 AM	No files match the supplied pattern.
MainError:	12:06:31 AM	No files match the supplied pattern.
MainError:	12:06:31 AM	No files match the supplied pattern.
MainError:	12:06:31 AM	No files match the supplied pattern.
MainError:	12:06:31 AM	No files match the supplied pattern.
MainError:	12:06:31 AM	No files match the supplied pattern.
MainError:	12:06:31 AM	No files match the supplied pattern.
MainError:	12:06:31 AM	No files match the supplied pattern.
MainError:	12:06:31 AM	No files match the supplied pattern.
MainError:	12:06:31 AM	No files match the supplied pattern.
MainError:	12:06:31 AM	No files match the supplied pattern.
MainError:	12:06:31 AM	No files match the supplied pattern.
MainError:	12:06:31 AM	No files match the supplied pattern.
MainError:	12:06:31 AM	No files match the supplied pattern.
MainError:	12:06:31 AM	No files match the supplied pattern.
MainError:	12:06:31 AM	No files match the supplied pattern.
MainError:	12:06:31 AM	No files match the supplied pattern.
MainError:	12:06:31 AM	No files match the supplied pattern.
MainError:	12:06:31 AM	No files match the supplied pattern.
MainError:	12:06:31 AM	No files match the supplied pattern.
MainError:	12:06:31 AM	No files match the supplied pattern.
MainError:	12:06:31 AM	No files match the supplied pattern.
MainError:	12:06:31 AM	No files match the supplied pattern.
MainError:	12:06:31 AM	No files match the supplied pattern.
MainError:	12:06:31 AM	No files match the supplied pattern.
MainError:	12:06:31 AM	No files match the supplied pattern.
MainError:	12:06:31 AM	No files match the supplied pattern.
MainError:	12:06:31 AM	No files match the supplied pattern.
MainError:	12:06:31 AM	No files match the supplied pattern.
MainError:	12:06:31 AM	No files match the supplied pattern.
MainError:	12:06:31 AM	No files match the supplied pattern.
MainError:	12:06:31 AM	No files match the supplied pattern.
MainError:	12:06:31 AM	No files match the supplied pattern.
MainError:	12:06:31 AM	No files match the supplied pattern.
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5888, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6008, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=248, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5944, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2244, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=12084, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5352, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1400, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5484, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4244, iMonCtr=1
Model crash detected, will try to restart...
No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
No heartbeat from core client for 30 sec - exiting
No heartbeat from core client for 30 sec - exiting
No heartbeat from core client for 30 sec - exiting
No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5960, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9340, iMonCtr=1
Model crash detected, will try to restart...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6012, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4140, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5648, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4308, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4968, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5572, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
01 Dec 2010 18:15:02 1061885 11183367 hadsm3dhet2_k1xs_006612162_2 32,406 3,073,269 5.5786
25 Sep 2010 19:05:52 1061885 11183367 hadsm3dhet2_k1xs_006612162_2 21,604 2,272,810 4.2081
25 Jul 2010 17:28:42 1061885 11183367 hadsm3dhet2_k1xs_006612162_2 10,802 1,485,768 2.8071
19 Jul 2010 00:21:24 1061885 11183367 hadsm3dhet2_k1xs_006612162_2 259,248 1,407,344 2.7143
18 Jul 2010 01:56:27 1061885 11183367 hadsm3dhet2_k1xs_006612162_2 248,446 1,378,390 2.7150
14 Jul 2010 18:21:11 1061885 11183367 hadsm3dhet2_k1xs_006612162_2 237,644 1,348,358 2.7136
14 Jul 2010 02:01:02 1061885 11183367 hadsm3dhet2_k1xs_006612162_2 226,842 1,318,273 2.7120
13 Jul 2010 16:09:06 1061885 11183367 hadsm3dhet2_k1xs_006612162_2 216,040 1,288,703 2.7114
12 Jul 2010 22:06:31 1061885 11183367 hadsm3dhet2_k1xs_006612162_2 205,238 1,259,705 2.7120
08 Jul 2010 03:53:35 1061885 11183367 hadsm3dhet2_k1xs_006612162_2 194,436 1,231,305 2.7140
07 Jul 2010 01:24:49 1061885 11183367 hadsm3dhet2_k1xs_006612162_2 183,634 1,201,677 2.7133
03 Jul 2010 21:59:42 1061885 11183367 hadsm3dhet2_k1xs_006612162_2 172,832 1,172,451 2.7135
03 Jul 2010 21:22:51 1061885 11183367 hadsm3dhet2_k1xs_006612162_2 162,030 1,144,550 2.7169
01 Jul 2010 01:41:17 1061885 11183367 hadsm3dhet2_k1xs_006612162_2 151,228 1,115,543 2.7177
28 Jun 2010 22:28:59 1061885 11183367 hadsm3dhet2_k1xs_006612162_2 140,426 1,087,147 2.7201
27 Jun 2010 16:47:45 1061885 11183367 hadsm3dhet2_k1xs_006612162_2 129,624 1,057,660 2.7198
27 Jun 2010 15:26:31 1061885 11183367 hadsm3dhet2_k1xs_006612162_2 118,822 1,028,757 2.7211
24 Jun 2010 19:58:48 1061885 11183367 hadsm3dhet2_k1xs_006612162_2 108,020 1,000,483 2.7241
24 Jun 2010 13:08:41 1061885 11183367 hadsm3dhet2_k1xs_006612162_2 97,218 971,546 2.7255
22 Jun 2010 19:25:10 1061885 11183367 hadsm3dhet2_k1xs_006612162_2 86,416 942,357 2.7262


©2024 climateprediction.net