climateprediction.net home page
Task 11681398

Task 11681398

Name hadam3p_pnw_v3vz_2006_1_006678669_0
Workunit 6881922
Created 26 Aug 2010, 11:09:20 UTC
Sent 27 Aug 2010, 13:34:17 UTC
Report deadline 9 Aug 2011, 18:54:17 UTC
Received 16 Oct 2010, 13:13:17 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 0 (0x00000000)
Computer ID 1068208
Run time 8 days 21 hours 17 min 58 sec
CPU time 6 days 16 hours 48 min 52 sec
Validate state Invalid
Credit 2,505.40
Device peak FLOPS 1.53 GFLOPS
Application version UK Met Office HadAM3P-HadRM3P Pacific North West v6.05
windows_intelx86
Stderr
<core_client_version>6.10.43</core_client_version>
<![CDATA[
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2584, selfPID=2584, iMonCtr=2
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Regional CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2544, selfPID=2544, iMonCtr=2
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
RCPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
02:53:21 (4444): Can't acquire lockfile (32) - waiting 35s
forrtl: Access is denied.
04:03:40 (4444): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:03:41 (4444): No heartbeat from core client for 30 sec - exiting
04:03:42 (4444): No heartbeat from core client for 30 sec - exiting
04:03:43 (4444): No heartbeat from core client for 30 sec - exiting
04:03:44 (4444): No heartbeat from core client for 30 sec - exiting
04:03:45 (4444): No heartbeat from core client for 30 sec - exiting
04:03:46 (4444): No heartbeat from core client for 30 sec - exiting
04:03:47 (4444): No heartbeat from core client for 30 sec - exiting
04:03:48 (4444): No heartbeat from core client for 30 sec - exiting
04:03:49 (4444): No heartbeat from core client for 30 sec - exiting
04:03:50 (4444): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not rCPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
RCPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
RegioCPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
RCPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
RCPDN Monitor - Quit request from BOINC...
Regional WorCPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
forrtl: Access is denied.
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
RCPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
RCPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1416, selfPID=1416, iMonCtr=2
CPDN Monitor - Quit request from BOINC...
RCPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
07:12:05 (3860): No heartbeat from core client for 30 sec - exiting
07:12:07 (3860): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3380, selfPID=3380, iMonCtr=2
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3976, selfPID=3976, iMonCtr=2
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3736, selfPID=3736, iMonCtr=2
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1372, selfPID=1372, iMonCtr=2
CPDN Monitor - Quit request from BOINC...
forrtl: Access is denied.
forrtl: Access is denied.
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3692, selfPID=3692, iMonCtr=2
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
forrtl: Access is denied.
CPDN Monitor - Quit request from BOINC...
forrtl: Access is denied.
forrtl: Access is denied.
CPDN Monitor - Quit request from BOINC...
forrtl: Access is denied.
forrtl: Access is denied.
CPDN Monitor - Quit request from BOINC...
forrtl: Access is denied.
forrtl: Access is denied.
CPDN Monitor - Quit request from BOINC...
forrtl: Access is denied.
forrtl: Access is denied.
CPDN Monitor - Quit request from BOINC...
forrtl: Access is denied.
forrtl: Access is denied.
CPDN Monitor - Quit request from BOINC...
forrtl: Access is denied.
forrtl: Access is denied.
CPDN Monitor - Quit request from BOINC...
forrtl: Access is denied.
forrtl: Access is denied.
CPDN Monitor - Quit request from BOINC...
forrtl: Access is denied.
forrtl: Access is denied.
CPDN Monitor - Quit request from BOINC...
forrtl: Access is denied.
forrtl: Access is denied.
CPDN Monitor - Quit request from BOINC...
forrtl: Access is denied.
forrtl: Access is denied.
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
RCPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
RegionaCPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
RCPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
RCPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
19:18:15 (684): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1448, selfPID=1448, iMonCtr=2
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=640, selfPID=640, iMonCtr=2
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2740, selfCPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=904, selfPID=904, iMonCtr=2
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
R16:11:47 (744): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3348, selfPID=3348, iMonCtr=2
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3856, selfPID=3856, iMonCtr=2
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
RCPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3496, selfPID=3496, iMonCtr=2
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1112, selfPID=1112, iMonCtr=2
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
RCPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
RCPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
03:30:45 (3292): No heartbeat from core client for 30 sec - exiting
03:30:47 (3292): No heartbeat from core client for 30 sec - exiting
03:30:48 (3292): No heartbeat from core client for 30 sec - exiting
03:30:49 (3292): No heartbeat from core client for 30 sec - exiting
03:30:50 (3292): No heartbeat from core client for 30 sec - exiting
03:30:51 (3292): No heartbeat from core client for 30 sec - exiting
03:30:52 (3292): No heartbeat from core client for 30 sec - exiting
03:30:53 (3292): No heartbeat from core client for 30 sec - exiting
03:30:54 (3292): No heartbeat from core client for 30 sec - exiting
03:30:55 (3292): No heartbeat from core client for 30 sec - exiting
03:30:56 (3292): No heartbeat from core client for 30 sec - exiting
03:30:57 (3292): No heartbeat from core client for 30 sec - exiting
03:30:58 (3292): No heartbeat from core client for 30 sec - exiting
03:30:59 (3292): No heartbeat from core client for 30 sec - exiting
03:31:00 (3292): No heartbeat from core client for 30 sec - exiting
03:31:01 (3292): No heartbeat from core client for 30 sec - exiting
03:31:02 (3292): No heartbeat from core client for 30 sec - exiting
03:31:03 (3292): No heartbeat from core client for 30 sec - exiting
03:31:04 (3292): No heartbeat from core client for 30 sec - exiting
03:31:05 (3292): No heartbeat from core client for 30 sec - exiting
03:31:06 (3292): No heartbeat from core client for 30 sec - exiting
03:31:07 (3292): No heartbeat from core client for 30 sec - exiting
03:31:08 (3292): No heartbeat from core client for 30 sec - exiting
03:31:09 (3292): No heartbeat from core client for 30 sec - exiting
03:31:10 (3292): No heartbeat from core client for 30 sec - exiting
03:31:11 (3292): No heartbeat from core client for 30 sec - exiting
03:31:12 (3292): No heartbeat from core client for 30 sec - exiting
03:31:13 (3292): No heartbeat from core client for 30 sec - exiting
03:31:14 (3292): No heartbeat from core client for 30 sec - exiting
03:31:15 (3292): No heartbeat from core client for 30 sec - exiting
03:31:16 (3292): No heartbeat from core client for 30 sec - exiting
03:31:17 (3292): No heartbeat from core client for 30 sec - exiting
03:31:18 (3292): No heartbeat from core client for 30 sec - exiting
03:31:19 (3292): No heartbeat from core client for 30 sec - exiting
03:31:20 (3292): No heartbeat from core client for 30 sec - exiting
03:31:21 (3292): No heartbeat from core client for 30 sec - exiting
03:31:22 (3292): No heartbeat from core client for 30 sec - exiting
03:31:23 (3292): No heartbeat from core client for 30 sec - exiting
03:31:24 (3292): No heartbeat from core client for 30 sec - exiting
03:31:25 (3292): No heartbeat from core client for 30 sec - exiting
03:31:26 (3292): No heartbeat from core client for 30 sec - exiting
03:31:27 (3292): No heartbeat from core client for 30 sec - exiting
03:31:28 (3292): No heartbeat from core client for 30 sec - exiting
03:31:29 (3292): No heartbeat from core client for 30 sec - exiting
03:31:30 (3292): No heartbeat from core client for 30 sec - exiting
03:31:31 (3292): No heartbeat from core client for 30 sec - exiting
03:31:32 (3292): No heartbeat from core client for 30 sec - exiting
03:31:33 (3292): No heartbeat from core client for 30 sec - exiting
03:31:34 (3292): No heartbeat from core client for 30 sec - exiting
03:31:35 (3292): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3100, selfPID=3100, iMonCtr=2
cpdnmonitor: error reading file C:\Documents and Settings\All Users\Application Data\BOINC/projects/climateprediction.net/hadam3p_pnw_v3vz_2006_1_006678669/dataout/atmos_restart.day
Signal 11 received, exiting...
01:36:31 (1560): called boinc_finish
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2664, selfPID=2664, iMonCtr=2
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2664, selfPID=2404, iMonCtr=1
Model crash detected, will try to restart...
Leaving CPDN_Main::Monitor...
Regional yearly means requires 12 input files got 10
01:36:48 (2404): called boinc_finish

</stderr_txt>
<message>
<file_xfer_error>
  <file_name>hadam3p_pnw_v3vz_2006_1_006678669_0_11.zip</file_name>
  <error_code>-161</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>hadam3p_pnw_v3vz_2006_1_006678669_0_12.zip</file_name>
  <error_code>-161</error_code>
</file_xfer_error>

</message>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
15 Oct 2010 04:37:55 1068208 11681398 hadam3p_pnw_v3vz_2006_1_006678669_0 115,303 546,393 4.7388
15 Oct 2010 03:41:34 1068208 11681398 hadam3p_pnw_v3vz_2006_1_006678669_0 115,296 545,721 4.7332
13 Oct 2010 03:51:14 1068208 11681398 hadam3p_pnw_v3vz_2006_1_006678669_0 103,776 491,126 4.7326
05 Oct 2010 16:29:20 1068208 11681398 hadam3p_pnw_v3vz_2006_1_006678669_0 92,261 438,530 4.7531
05 Oct 2010 16:03:32 1068208 11681398 hadam3p_pnw_v3vz_2006_1_006678669_0 92,256 437,863 4.7462
04 Oct 2010 04:17:28 1068208 11681398 hadam3p_pnw_v3vz_2006_1_006678669_0 80,736 384,575 4.7634
30 Sep 2010 18:36:40 1068208 11681398 hadam3p_pnw_v3vz_2006_1_006678669_0 69,216 329,866 4.7657
29 Sep 2010 13:55:09 1068208 11681398 hadam3p_pnw_v3vz_2006_1_006678669_0 57,696 274,446 4.7568
27 Sep 2010 09:37:28 1068208 11681398 hadam3p_pnw_v3vz_2006_1_006678669_0 46,176 219,012 4.7430
23 Sep 2010 02:42:05 1068208 11681398 hadam3p_pnw_v3vz_2006_1_006678669_0 34,657 164,213 4.7382
23 Sep 2010 02:41:53 1068208 11681398 hadam3p_pnw_v3vz_2006_1_006678669_0 34,656 163,549 4.7192
19 Sep 2010 06:02:28 1068208 11681398 hadam3p_pnw_v3vz_2006_1_006678669_0 23,136 108,555 4.6920
17 Sep 2010 13:23:30 1068208 11681398 hadam3p_pnw_v3vz_2006_1_006678669_0 11,616 54,544 4.6956


©2024 climateprediction.net