climateprediction.net (CPDN) home page
Task 13555066

Task 13555066

Name hadcm3n_y7pv_1900_40_007524676_1
Workunit 7722151
Created 28 Oct 2011, 13:32:22 UTC
Sent 30 Oct 2011, 18:51:41 UTC
Report deadline 30 Jan 2012, 2:18:52 UTC
Received 15 Nov 2011, 17:23:11 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1074891
Run time 10 days 14 hours 4 min 19 sec
CPU time 9 days 8 hours 43 min 44 sec
Validate state Invalid
Credit 3,421.44
Device peak FLOPS 3.11 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
windows_intelx86
Stderr
<core_client_version>6.10.58</core_client_version>
<![CDATA[
<message>
The device does not recognize the command. (0x16) - exit code 22 (0x16)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Signal 22 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5196, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
Signal 22 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8548, iMonCtr=1
Model crash detected, will try to restart...
Signal 22 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8548, iMonCtr=1
Model crash detected, will try to restart...
Signal 22 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8548, iMonCtr=1
Model crash detected, will try to restart...
Signal 22 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8548, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Signal 22 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2784, iMonCtr=1
Model crash detected, will try to restart...
Sorry, too many model crashes! :-(
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/ancil/ctldata/STASHmaster/STASHmaster_O
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/ancil/ctldata/STASHmaster/STASHmaster_S
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/ancil/ctldata/STASHmaster/STASHmaster_W
checkdir error:  cannot create hadcm3n_y7pv_1900_40_007524676/dataout
                 unable to process dataout/.
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/ancil/basin_hadcm3
error:  cannot create hadcm3n_y7pv_1900_40_007524676/jobs/ncatts.cpdc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_arctic_0.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_arctic_300.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_arctic_3000.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_arctic_700.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_arctic_full.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_global_0.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_global_300.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_global_3000.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_global_700.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_global_full.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_n_atl_0.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_n_atl_300.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_n_atl_3000.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_n_atl_700.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_n_atl_full.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_n_ind_0.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_n_ind_300.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_n_ind_3000.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_n_ind_700.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_n_ind_full.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_n_pac_0.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_n_pac_300.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_n_pac_3000.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_n_pac_700.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_n_pac_full.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_southern_0.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_southern_300.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_southern_3000.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_southern_700.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_southern_full.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_s_atl_0.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_s_atl_300.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_s_atl_3000.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_s_atl_700.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_s_atl_full.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_s_ind_0.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_s_ind_300.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_s_ind_3000.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_s_ind_700.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_s_ind_full.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_s_pac_0.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_s_pac_300.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_s_pac_3000.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_s_pac_700.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_s_pac_full.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/varlevs.xml
error:  cannot create hadcm3n_y7pv_1900_40_007524676/jobs/xabnk.namelists
error:  cannot create hadcm3n_y7pv_1900_40_007524676/jobs/xabnk.stashc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/jobs/ncatts.cpdc
CPDN Monitor - Quit request from BOINC...
Called boinc_finish
09:47:27 (1840): Can't acquire lockfile (1393) - waiting 35s
09:48:02 (1840): Can't set up shared mem: -1. Will run in standalone mode.
error:  cannot create hadcm3n_y7pv_1900_40_007524676/jobs/xabnk.PRESM_A
error:  cannot create hadcm3n_y7pv_1900_40_007524676/jobs/xabnk.PRESM_O
checkdir error:  cannot create hadcm3n_y7pv_1900_40_007524676/tmp
                 unable to process tmp/.
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/ancil/ctldata/stasets/X01001218
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/ancil/ctldata/stasets/X01002207
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/ancil/ctldata/stasets/X01003236
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/ancil/ctldata/stasets/X01003237
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/ancil/ctldata/stasets/X01003254
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/ancil/ctldata/stasets/X01003274
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/ancil/ctldata/stasets/X01003275
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/ancil/ctldata/stasets/X01003276
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/ancil/ctldata/stasets/X01003277
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/ancil/ctldata/stasets/X01003278
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/ancil/ctldata/stasets/X01003279
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/ancil/ctldata/stasets/X01003280
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/ancil/ctldata/stasets/X01003281
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/ancil/ctldata/stasets/X01003286
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/ancil/ctldata/stasets/X01005207
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/ancil/ctldata/stasets/X01005208
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/ancil/ctldata/stasets/X01005222
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/ancil/ctldata/stasets/X01005223
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/ancil/ctldata/stasets/X01010206
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/ancil/ctldata/STASHmaster/STASHmaster_O
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/ancil/ctldata/STASHmaster/STASHmaster_S
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/ancil/ctldata/STASHmaster/STASHmaster_W
checkdir error:  cannot create hadcm3n_y7pv_1900_40_007524676/dataout
                 unable to process dataout/.
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/ancil/basin_hadcm3
error:  cannot create hadcm3n_y7pv_1900_40_007524676/jobs/ncatts.cpdc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_arctic_0.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_arctic_300.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_arctic_3000.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_arctic_700.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_arctic_full.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_global_0.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_global_300.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_global_3000.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_global_700.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_global_full.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_n_atl_0.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_n_atl_300.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_n_atl_3000.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_n_atl_700.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_n_atl_full.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_n_ind_0.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_n_ind_300.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_n_ind_3000.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_n_ind_700.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_n_ind_full.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_n_pac_0.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_n_pac_300.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_n_pac_3000.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_n_pac_700.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_n_pac_full.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_southern_0.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_southern_300.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_southern_3000.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_southern_700.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_southern_full.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_s_atl_0.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_s_atl_300.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_s_atl_3000.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_s_atl_700.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_s_atl_full.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_s_ind_0.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_s_ind_300.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_s_ind_3000.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_s_ind_700.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_s_ind_full.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_s_pac_0.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_s_pac_300.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_s_pac_3000.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_s_pac_700.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/masks/cpdn_omsk_s_pac_full.nc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/datain/varlevs.xml
error:  cannot create hadcm3n_y7pv_1900_40_007524676/jobs/xabnk.namelists
error:  cannot create hadcm3n_y7pv_1900_40_007524676/jobs/xabnk.stashc
error:  cannot create hadcm3n_y7pv_1900_40_007524676/jobs/ncatts.cpdc
Model exiting, can't open config file for hadcm3n_y7pv_1900_40_007524676
Called boinc_finish
09:58:56 (3800): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:59:47 (9184): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:01:13 (7608): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
OPEN:  Unable to Open File dataout/y7pvko.daa0c30 for Read/Write

Model crashed: DUMPCTL : Fail to open output dump - may already exist                                                                                                                                                                                                          tmp/pipe_dummy                                                                  2048    
CPDN Monitor - Quit request from BOINC...
OPEN:  Unable to Open File dataout/y7pvka.daa0c50 for Read/Write

Model crashed: DUMPCTL : Fail to open output dump - may already exist                                                                                                                                                                                                          tmp/pipe_dummy                                                                  2048    
CPDN Monitor - Quit request from BOINC...
OPEN:  Unable to Open File dataout/y7pvko.daa0c50 for Read/Write

Model crashed: DUMPCTL : Fail to open output dump - may already exist                                                                                                                                                                                                          tmp/pipe_dummy                                                                  2048    
CPDN Monitor - Quit request from BOINC...
OPEN:  Unable to Open File dataout/y7pvka.daa0c60 for Read/Write

Model crashed: DUMPCTL : Fail to open output dump - may already exist                                                                                                                                                                                                          tmp/pipe_dummy                                                                  2048    
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
OPEN:  Unable to Open File dataout/y7pvka.daa0cn0 for Read/Write

Model crashed: DUMPCTL : Fail to open output dump - may already exist                                                                                                                                                                                                          tmp/pipe_dummy                                                                  2048    
OPEN:  Unable to Open File dataout/y7pvka.daa0cn0 for Read/Write

Model crashed: DUMPCTL : Fail to open output dump - may already exist                                                                                                                                                                                                          tmp/pipe_dummy                                                                  2048    
OPEN:  Unable to Open File dataout/y7pvka.daa0cn0 for Read/Write

Model crashed: DUMPCTL : Fail to open output dump - may already exist                                                                                                                                                                                                          tmp/pipe_dummy                                                                  2048    
OPEN:  Unable to Open File dataout/y7pvka.daa0cn0 for Read/Write

Model crashed: DUMPCTL : Fail to open output dump - may already exist                                                                                                                                                                                                          tmp/pipe_dummy                                                                  2048    
OPEN:  Unable to Open File dataout/y7pvko.daa0cn0 for Read/Write

Model crashed: DUMPCTL : Fail to open output dump - may already exist                                                                                                                                                                                                          tmp/pipe_dummy                                                                  2048    
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Signal 22 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8064, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
Signal 22 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7484, iMonCtr=1
Model crash detected, will try to restart...
Signal 22 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7484, iMonCtr=1
Model crash detected, will try to restart...
Signal 22 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7484, iMonCtr=1
Model crash detected, will try to restart...
Signal 22 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7484, iMonCtr=1
Model crash detected, will try to restart...
Signal 22 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7484, iMonCtr=1
Model crash detected, will try to restart...
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
07 Nov 2011 19:13:12 1074891 13555066 hadcm3n_y7pv_1900_40_007524676_1 285,120 577,134 2.0242
07 Nov 2011 02:17:59 1074891 13555066 hadcm3n_y7pv_1900_40_007524676_1 259,200 524,821 2.0248
06 Nov 2011 10:09:09 1074891 13555066 hadcm3n_y7pv_1900_40_007524676_1 233,280 472,458 2.0253
05 Nov 2011 19:12:36 1074891 13555066 hadcm3n_y7pv_1900_40_007524676_1 207,360 420,331 2.0271
05 Nov 2011 02:35:35 1074891 13555066 hadcm3n_y7pv_1900_40_007524676_1 181,440 368,041 2.0284
04 Nov 2011 09:38:11 1074891 13555066 hadcm3n_y7pv_1900_40_007524676_1 155,520 315,869 2.0311
03 Nov 2011 16:06:50 1074891 13555066 hadcm3n_y7pv_1900_40_007524676_1 129,600 263,504 2.0332
02 Nov 2011 22:33:16 1074891 13555066 hadcm3n_y7pv_1900_40_007524676_1 103,680 210,959 2.0347
02 Nov 2011 04:56:49 1074891 13555066 hadcm3n_y7pv_1900_40_007524676_1 77,760 158,172 2.0341
01 Nov 2011 11:26:25 1074891 13555066 hadcm3n_y7pv_1900_40_007524676_1 51,840 105,409 2.0334
31 Oct 2011 20:05:24 1074891 13555066 hadcm3n_y7pv_1900_40_007524676_1 25,920 52,557 2.0277


©2025 cpdn.org