climateprediction.net home page
Task 12752313

Task 12752313

Name hadcm3n_o7bf_1900_40_007204814_2
Workunit 7403094
Created 28 Mar 2011, 17:48:35 UTC
Sent 28 Mar 2011, 17:51:40 UTC
Report deadline 28 Jun 2011, 1:18:51 UTC
Received 12 Apr 2011, 5:01:20 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1024572
Run time 13 days 7 hours 16 min 31 sec
CPU time 12 days 22 hours 18 min 55 sec
Validate state Invalid
Credit 6,220.80
Device peak FLOPS 2.31 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
windows_intelx86
Stderr
<core_client_version>6.10.17</core_client_version>
<![CDATA[
<message>
The device does not recognize the command. (0x16) - exit code 22 (0x16)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
07:08:32 (6916): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:08:33 (6916): No heartbeat from core client for 30 sec - exiting
07:08:34 (6916): No heartbeat from core client for 30 sec - exiting
07:08:35 (6916): No heartbeat from core client for 30 sec - exiting
07:08:36 (6916): No heartbeat from core client for 30 sec - exiting
07:08:37 (6916): No heartbeat from core client for 30 sec - exiting
07:08:38 (6916): No heartbeat from core client for 30 sec - exiting
07:08:39 (6916): No heartbeat from core client for 30 sec - exiting
07:08:40 (6916): No heartbeat from core client for 30 sec - exiting
07:08:42 (6916): No heartbeat from core client for 30 sec - exiting
07:08:43 (6916): No heartbeat from core client for 30 sec - exiting
10:52:31 (2864): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:52:32 (2864): No heartbeat from core client for 30 sec - exiting
10:52:33 (2864): No heartbeat from core client for 30 sec - exiting
10:52:34 (2864): No heartbeat from core client for 30 sec - exiting
10:52:35 (2864): No heartbeat from core client for 30 sec - exiting
10:52:36 (2864): No heartbeat from core client for 30 sec - exiting
10:52:37 (2864): No heartbeat from core client for 30 sec - exiting
10:52:39 (2864): No heartbeat from core client for 30 sec - exiting
14:38:42 (4136): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:38:43 (4136): No heartbeat from core client for 30 sec - exiting
14:38:44 (4136): No heartbeat from core client for 30 sec - exiting
14:38:45 (4136): No heartbeat from core client for 30 sec - exiting
14:38:46 (4136): No heartbeat from core client for 30 sec - exiting
18:24:59 (2612): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:10:31 (1292): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:10:32 (1292): No heartbeat from core client for 30 sec - exiting
22:10:33 (1292): No heartbeat from core client for 30 sec - exiting
22:10:35 (1292): No heartbeat from core client for 30 sec - exiting
22:10:36 (1292): No heartbeat from core client for 30 sec - exiting
22:10:37 (1292): No heartbeat from core client for 30 sec - exiting
22:10:38 (1292): No heartbeat from core client for 30 sec - exiting
22:10:39 (1292): No heartbeat from core client for 30 sec - exiting
22:10:40 (1292): No heartbeat from core client for 30 sec - exiting
22:10:41 (1292): No heartbeat from core client for 30 sec - exiting
22:10:42 (1292): No heartbeat from core client for 30 sec - exiting
01:52:26 (6800): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:52:42 (6800): No heartbeat from core client for 30 sec - exiting
01:52:44 (6800): No heartbeat from core client for 30 sec - exiting
01:52:45 (6800): No heartbeat from core client for 30 sec - exiting
01:52:46 (6800): No heartbeat from core client for 30 sec - exiting
01:52:47 (6800): No heartbeat from core client for 30 sec - exiting
01:52:48 (6800): No heartbeat from core client for 30 sec - exiting
01:52:49 (6800): No heartbeat from core client for 30 sec - exiting
01:52:50 (6800): No heartbeat from core client for 30 sec - exiting
01:52:51 (6800): No heartbeat from core client for 30 sec - exiting
01:52:52 (6800): No heartbeat from core client for 30 sec - exiting
09:21:59 (7592): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:22:09 (7592): No heartbeat from core client for 30 sec - exiting
09:25:06 (7592): No heartbeat from core client for 30 sec - exiting
09:25:07 (7592): No heartbeat from core client for 30 sec - exiting
09:25:09 (7592): No heartbeat from core client for 30 sec - exiting
09:25:10 (7592): No heartbeat from core client for 30 sec - exiting
09:25:11 (7592): No heartbeat from core client for 30 sec - exiting
09:25:12 (7592): No heartbeat from core client for 30 sec - exiting
09:25:13 (7592): No heartbeat from core client for 30 sec - exiting
09:25:14 (7592): No heartbeat from core client for 30 sec - exiting
09:25:15 (7592): No heartbeat from core client for 30 sec - exiting
09:25:16 (7592): No heartbeat from core client for 30 sec - exiting
13:07:54 (4536): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:52:06 (7364): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:52:07 (7364): No heartbeat from core client for 30 sec - exiting
20:37:11 (6900): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:37:12 (6900): No heartbeat from core client for 30 sec - exiting
20:37:13 (6900): No heartbeat from core client for 30 sec - exiting
20:37:14 (6900): No heartbeat from core client for 30 sec - exiting
20:37:15 (6900): No heartbeat from core client for 30 sec - exiting
20:37:16 (6900): No heartbeat from core client for 30 sec - exiting
20:37:18 (6900): No heartbeat from core client for 30 sec - exiting
20:37:19 (6900): No heartbeat from core client for 30 sec - exiting
20:37:20 (6900): No heartbeat from core client for 30 sec - exiting
20:37:21 (6900): No heartbeat from core client for 30 sec - exiting
20:37:22 (6900): No heartbeat from core client for 30 sec - exiting
00:24:25 (7360): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:24:26 (7360): No heartbeat from core client for 30 sec - exiting
00:24:27 (7360): No heartbeat from core client for 30 sec - exiting
00:24:28 (7360): No heartbeat from core client for 30 sec - exiting
00:24:29 (7360): No heartbeat from core client for 30 sec - exiting
00:24:30 (7360): No heartbeat from core client for 30 sec - exiting
00:24:32 (7360): No heartbeat from core client for 30 sec - exiting
00:24:33 (7360): No heartbeat from core client for 30 sec - exiting
00:24:34 (7360): No heartbeat from core client for 30 sec - exiting
00:24:35 (7360): No heartbeat from core client for 30 sec - exiting
00:24:36 (7360): No heartbeat from core client for 30 sec - exiting
04:09:12 (3308): No heartbeat from core client for 30 sec - exiting
04:11:33 (3308): No heartbeat from core client for 30 sec - exiting
04:11:34 (3308): No heartbeat from core client for 30 sec - exiting
04:11:35 (3308): No heartbeat from core client for 30 sec - exiting
04:11:37 (3308): No heartbeat from core client for 30 sec - exiting
04:11:38 (3308): No heartbeat from core client for 30 sec - exiting
04:11:39 (3308): No heartbeat from core client for 30 sec - exiting
04:11:40 (3308): No heartbeat from core client for 30 sec - exiting
04:11:41 (3308): No heartbeat from core client for 30 sec - exiting
04:11:42 (3308): No heartbeat from core client for 30 sec - exiting
04:11:43 (3308): No heartbeat from core client for 30 sec - exiting
04:11:44 (3308): No heartbeat from core client for 30 sec - exiting
04:11:45 (3308): No heartbeat from core client for 30 sec - exiting
04:11:46 (3308): No heartbeat from core client for 30 sec - exiting
04:11:48 (3308): No heartbeat from core client for 30 sec - exiting
04:11:49 (3308): No heartbeat from core client for 30 sec - exiting
04:11:50 (3308): No heartbeat from core client for 30 sec - exiting
04:11:51 (3308): No heartbeat from core client for 30 sec - exiting
04:11:52 (3308): No heartbeat from core client for 30 sec - exiting
04:11:53 (3308): No heartbeat from core client for 30 sec - exiting
04:11:54 (3308): No heartbeat from core client for 30 sec - exiting
04:11:55 (3308): No heartbeat from core client for 30 sec - exiting
04:11:56 (3308): No heartbeat from core client for 30 sec - exiting
04:11:57 (3308): No heartbeat from core client for 30 sec - exiting
04:11:58 (3308): No heartbeat from core client for 30 sec - exiting
04:12:00 (3308): No heartbeat from core client for 30 sec - exiting
04:12:01 (3308): No heartbeat from core client for 30 sec - exiting
04:12:02 (3308): No heartbeat from core client for 30 sec - exiting
04:12:03 (3308): No heartbeat from core client for 30 sec - exiting
04:12:04 (3308): No heartbeat from core client for 30 sec - exiting
04:12:05 (3308): No heartbeat from core client for 30 sec - exiting
04:12:06 (3308): No heartbeat from core client for 30 sec - exiting
04:12:07 (3308): No heartbeat from core client for 30 sec - exiting
04:12:08 (3308): No heartbeat from core client for 30 sec - exiting
04:12:09 (3308): No heartbeat from core client for 30 sec - exiting
04:12:10 (3308): No heartbeat from core client for 30 sec - exiting
04:12:12 (3308): No heartbeat from core client for 30 sec - exiting
04:12:13 (3308): No heartbeat from core client for 30 sec - exiting
04:12:14 (3308): No heartbeat from core client for 30 sec - exiting
04:12:15 (3308): No heartbeat from core client for 30 sec - exiting
04:12:16 (3308): No heartbeat from core client for 30 sec - exiting
04:12:17 (3308): No heartbeat from core client for 30 sec - exiting
04:12:18 (3308): No heartbeat from core client for 30 sec - exiting
04:12:19 (3308): No heartbeat from core client for 30 sec - exiting
04:12:20 (3308): No heartbeat from core client for 30 sec - exiting
04:12:21 (3308): No heartbeat from core client for 30 sec - exiting
04:12:23 (3308): No heartbeat from core client for 30 sec - exiting
04:12:24 (3308): No heartbeat from core client for 30 sec - exiting
04:12:25 (3308): No heartbeat from core client for 30 sec - exiting
04:12:26 (3308): No heartbeat from core client for 30 sec - exiting
04:12:27 (3308): No heartbeat from core client for 30 sec - exiting
04:12:28 (3308): No heartbeat from core client for 30 sec - exiting
04:12:29 (3308): No heartbeat from core client for 30 sec - exiting
04:12:30 (3308): No heartbeat from core client for 30 sec - exiting
04:12:31 (3308): No heartbeat from core client for 30 sec - exiting
04:12:32 (3308): No heartbeat from core client for 30 sec - exiting
04:12:33 (3308): No heartbeat from core client for 30 sec - exiting
04:12:35 (3308): No heartbeat from core client for 30 sec - exiting
04:12:36 (3308): No heartbeat from core client for 30 sec - exiting
04:12:37 (3308): No heartbeat from core client for 30 sec - exiting
04:12:38 (3308): No heartbeat from core client for 30 sec - exiting
04:12:39 (3308): No heartbeat from core client for 30 sec - exiting
04:12:40 (3308): No heartbeat from core client for 30 sec - exiting
04:12:41 (3308): No heartbeat from core client for 30 sec - exiting
04:12:42 (3308): No heartbeat from core client for 30 sec - exiting
04:12:43 (3308): No heartbeat from core client for 30 sec - exiting
04:12:44 (3308): No heartbeat from core client for 30 sec - exiting
04:12:45 (3308): No heartbeat from core client for 30 sec - exiting
04:12:47 (3308): No heartbeat from core client for 30 sec - exiting
04:12:48 (3308): No heartbeat from core client for 30 sec - exiting
04:12:49 (3308): No heartbeat from core client for 30 sec - exiting
04:12:50 (3308): No heartbeat from core client for 30 sec - exiting
04:12:51 (3308): No heartbeat from core client for 30 sec - exiting
04:12:52 (3308): No heartbeat from core client for 30 sec - exiting
04:12:53 (3308): No heartbeat from core client for 30 sec - exiting
04:12:54 (3308): No heartbeat from core client for 30 sec - exiting
04:12:55 (3308): No heartbeat from core client for 30 sec - exiting
04:12:56 (3308): No heartbeat from core client for 30 sec - exiting
04:12:58 (3308): No heartbeat from core client for 30 sec - exiting
04:12:59 (3308): No heartbeat from core client for 30 sec - exiting
04:13:00 (3308): No heartbeat from core client for 30 sec - exiting
04:13:01 (3308): No heartbeat from core client for 30 sec - exiting
04:13:02 (3308): No heartbeat from core client for 30 sec - exiting
04:13:03 (3308): No heartbeat from core client for 30 sec - exiting
04:13:04 (3308): No heartbeat from core client for 30 sec - exiting
04:13:05 (3308): No heartbeat from core client for 30 sec - exiting
04:13:06 (3308): No heartbeat from core client for 30 sec - exiting
04:13:07 (3308): No heartbeat from core client for 30 sec - exiting
04:13:08 (3308): No heartbeat from core client for 30 sec - exiting
04:13:10 (3308): No heartbeat from core client for 30 sec - exiting
04:13:11 (3308): No heartbeat from core client for 30 sec - exiting
04:13:12 (3308): No heartbeat from core client for 30 sec - exiting
04:13:13 (3308): No heartbeat from core client for 30 sec - exiting
04:13:14 (3308): No heartbeat from core client for 30 sec - exiting
04:13:15 (3308): No heartbeat from core client for 30 sec - exiting
04:13:16 (3308): No heartbeat from core client for 30 sec - exiting
04:13:17 (3308): No heartbeat from core client for 30 sec - exiting
04:13:18 (3308): No heartbeat from core client for 30 sec - exiting
04:13:19 (3308): No heartbeat from core client for 30 sec - exiting
04:13:20 (3308): No heartbeat from core client for 30 sec - exiting
04:13:22 (3308): No heartbeat from core client for 30 sec - exiting
04:13:23 (3308): No heartbeat from core client for 30 sec - exiting
04:13:24 (3308): No heartbeat from core client for 30 sec - exiting
04:13:25 (3308): No heartbeat from core client for 30 sec - exiting
04:13:26 (3308): No heartbeat from core client for 30 sec - exiting
04:13:27 (3308): No heartbeat from core client for 30 sec - exiting
04:13:28 (3308): No heartbeat from core client for 30 sec - exiting
04:13:29 (3308): No heartbeat from core client for 30 sec - exiting
04:13:30 (3308): No heartbeat from core client for 30 sec - exiting
04:13:31 (3308): No heartbeat from core client for 30 sec - exiting
04:13:33 (3308): No heartbeat from core client for 30 sec - exiting
04:13:34 (3308): No heartbeat from core client for 30 sec - exiting
04:13:35 (3308): No heartbeat from core client for 30 sec - exiting
04:13:36 (3308): No heartbeat from core client for 30 sec - exiting
04:13:37 (3308): No heartbeat from core client for 30 sec - exiting
04:13:38 (3308): No heartbeat from core client for 30 sec - exiting
04:13:39 (3308): No heartbeat from core client for 30 sec - exiting
04:13:40 (3308): No heartbeat from core client for 30 sec - exiting
04:13:41 (3308): No heartbeat from core client for 30 sec - exiting
04:13:42 (3308): No heartbeat from core client for 30 sec - exiting
04:13:43 (3308): No heartbeat from core client for 30 sec - exiting
04:13:45 (3308): No heartbeat from core client for 30 sec - exiting
04:13:46 (3308): No heartbeat from core client for 30 sec - exiting
04:13:47 (3308): No heartbeat from core client for 30 sec - exiting
04:13:48 (3308): No heartbeat from core client for 30 sec - exiting
04:13:49 (3308): No heartbeat from core client for 30 sec - exiting
04:13:50 (3308): No heartbeat from core client for 30 sec - exiting
04:13:51 (3308): No heartbeat from core client for 30 sec - exiting
04:13:52 (3308): No heartbeat from core client for 30 sec - exiting
04:13:53 (3308): No heartbeat from core client for 30 sec - exiting
04:13:54 (3308): No heartbeat from core client for 30 sec - exiting
04:13:55 (3308): No heartbeat from core client for 30 sec - exiting
04:13:57 (3308): No heartbeat from core client for 30 sec - exiting
04:13:58 (3308): No heartbeat from core client for 30 sec - exiting
04:13:59 (3308): No heartbeat from core client for 30 sec - exiting
04:14:00 (3308): No heartbeat from core client for 30 sec - exiting
04:14:01 (3308): No heartbeat from core client for 30 sec - exiting
04:14:02 (3308): No heartbeat from core client for 30 sec - exiting
04:14:03 (3308): No heartbeat from core client for 30 sec - exiting
04:14:04 (3308): No heartbeat from core client for 30 sec - exiting
04:14:05 (3308): No heartbeat from core client for 30 sec - exiting
04:14:06 (3308): No heartbeat from core client for 30 sec - exiting
04:14:08 (3308): No heartbeat from core client for 30 sec - exiting
04:14:09 (3308): No heartbeat from core client for 30 sec - exiting
04:14:10 (3308): No heartbeat from core client for 30 sec - exiting
04:14:11 (3308): No heartbeat from core client for 30 sec - exiting
04:14:12 (3308): No heartbeat from core client for 30 sec - exiting
04:14:13 (3308): No heartbeat from core client for 30 sec - exiting
04:14:14 (3308): No heartbeat from core client for 30 sec - exiting
04:14:15 (3308): No heartbeat from core client for 30 sec - exiting
04:14:16 (3308): No heartbeat from core client for 30 sec - exiting
04:14:17 (3308): No heartbeat from core client for 30 sec - exiting
04:14:18 (3308): No heartbeat from core client for 30 sec - exiting
04:14:20 (3308): No heartbeat from core client for 30 sec - exiting
04:14:21 (3308): No heartbeat from core client for 30 sec - exiting
04:14:22 (3308): No heartbeat from core client for 30 sec - exiting
04:14:23 (3308): No heartbeat from core client for 30 sec - exiting
04:14:24 (3308): No heartbeat from core client for 30 sec - exiting
04:14:25 (3308): No heartbeat from core client for 30 sec - exiting
04:14:26 (3308): No heartbeat from core client for 30 sec - exiting
04:14:27 (3308): No heartbeat from core client for 30 sec - exiting
04:14:28 (3308): No heartbeat from core client for 30 sec - exiting
04:14:29 (3308): No heartbeat from core client for 30 sec - exiting
04:14:30 (3308): No heartbeat from core client for 30 sec - exiting
04:14:32 (3308): No heartbeat from core client for 30 sec - exiting
04:14:33 (3308): No heartbeat from core client for 30 sec - exiting
04:14:34 (3308): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
cpdnmonitor: cannot open input file C:\Documents and Settings\All Users\Application Data\BOINC/projects/climateprediction.net/hadcm3n_o7bf_1900_40_007204814/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file C:\Documents and Settings\All Users\Application Data\BOINC/projects/climateprediction.net/hadcm3n_o7bf_1900_40_007204814/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
cpdnmonitor: cannot open input file C:\Documents and Settings\All Users\Application Data\BOINC/projects/climateprediction.net/hadcm3n_o7bf_1900_40_007204814/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file C:\Documents and Settings\All Users\Application Data\BOINC/projects/climateprediction.net/hadcm3n_o7bf_1900_40_007204814/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
cpdnmonitor: cannot open input file C:\Documents and Settings\All Users\Application Data\BOINC/projects/climateprediction.net/hadcm3n_o7bf_1900_40_007204814/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file C:\Documents and Settings\All Users\Application Data\BOINC/projects/climateprediction.net/hadcm3n_o7bf_1900_40_007204814/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
cpdnmonitor: cannot open input file C:\Documents and Settings\All Users\Application Data\BOINC/projects/climateprediction.net/hadcm3n_o7bf_1900_40_007204814/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file C:\Documents and Settings\All Users\Application Data\BOINC/projects/climateprediction.net/hadcm3n_o7bf_1900_40_007204814/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
cpdnmonitor: cannot open input file C:\Documents and Settings\All Users\Application Data\BOINC/projects/climateprediction.net/hadcm3n_o7bf_1900_40_007204814/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file C:\Documents and Settings\All Users\Application Data\BOINC/projects/climateprediction.net/hadcm3n_o7bf_1900_40_007204814/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
cpdnmonitor: cannot open input file C:\Documents and Settings\All Users\Application Data\BOINC/projects/climateprediction.net/hadcm3n_o7bf_1900_40_007204814/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file C:\Documents and Settings\All Users\Application Data\BOINC/projects/climateprediction.net/hadcm3n_o7bf_1900_40_007204814/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
12 Apr 2011 09:07:59 1024572 12752313 hadcm3n_o7bf_1900_40_007204814_2 518,400 1,117,190 2.1551
12 Apr 2011 09:06:40 1024572 12752313 hadcm3n_o7bf_1900_40_007204814_2 492,480 1,062,557 2.1576
12 Apr 2011 09:05:55 1024572 12752313 hadcm3n_o7bf_1900_40_007204814_2 466,560 1,007,560 2.1596
12 Apr 2011 09:05:16 1024572 12752313 hadcm3n_o7bf_1900_40_007204814_2 440,640 952,057 2.1606
12 Apr 2011 09:04:41 1024572 12752313 hadcm3n_o7bf_1900_40_007204814_2 414,720 895,814 2.1600
12 Apr 2011 09:04:12 1024572 12752313 hadcm3n_o7bf_1900_40_007204814_2 388,800 839,043 2.1580
12 Apr 2011 09:03:41 1024572 12752313 hadcm3n_o7bf_1900_40_007204814_2 362,880 784,561 2.1620
12 Apr 2011 09:02:12 1024572 12752313 hadcm3n_o7bf_1900_40_007204814_2 336,960 728,265 2.1613
12 Apr 2011 09:02:02 1024572 12752313 hadcm3n_o7bf_1900_40_007204814_2 311,040 671,539 2.1590
12 Apr 2011 08:58:54 1024572 12752313 hadcm3n_o7bf_1900_40_007204814_2 285,120 615,242 2.1578
05 Apr 2011 07:05:15 1024572 12752313 hadcm3n_o7bf_1900_40_007204814_2 259,200 559,787 2.1597
04 Apr 2011 15:09:42 1024572 12752313 hadcm3n_o7bf_1900_40_007204814_2 233,280 503,851 2.1599
03 Apr 2011 23:13:12 1024572 12752313 hadcm3n_o7bf_1900_40_007204814_2 207,360 447,859 2.1598
03 Apr 2011 06:40:49 1024572 12752313 hadcm3n_o7bf_1900_40_007204814_2 181,440 389,725 2.1480
02 Apr 2011 13:59:40 1024572 12752313 hadcm3n_o7bf_1900_40_007204814_2 155,520 331,260 2.1300
01 Apr 2011 21:30:42 1024572 12752313 hadcm3n_o7bf_1900_40_007204814_2 129,600 273,482 2.1102
01 Apr 2011 03:51:50 1024572 12752313 hadcm3n_o7bf_1900_40_007204814_2 103,680 218,357 2.1061
31 Mar 2011 12:32:19 1024572 12752313 hadcm3n_o7bf_1900_40_007204814_2 77,760 164,394 2.1141
30 Mar 2011 20:58:29 1024572 12752313 hadcm3n_o7bf_1900_40_007204814_2 51,840 109,435 2.1110
30 Mar 2011 01:52:10 1024572 12752313 hadcm3n_o7bf_1900_40_007204814_2 25,920 55,658 2.1473


©2024 climateprediction.net