climateprediction.net home page
Task 15797555

Task 15797555

Name hadcm3n_n26h_1920_40_008371713_0
Workunit 8522572
Created 26 May 2013, 20:46:45 UTC
Sent 26 May 2013, 20:47:01 UTC
Report deadline 26 Aug 2013, 4:14:12 UTC
Received 17 Aug 2013, 2:22:05 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1189392
Run time 26 days 7 hours 18 min 38 sec
CPU time 16 days 17 hours 37 min 43 sec
Validate state Invalid
Credit 9,331.20
Device peak FLOPS 2.12 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
windows_intelx86
Stderr
<core_client_version>7.0.64</core_client_version>
<![CDATA[
<message>
(unknown error) - exit code 193 (0xc1)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
12:55:59 (376): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
02:05:28 (12264): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:05:29 (12264): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
13:42:16 (5764): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
19:12:29 (3604): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
BUFFIN: C I/O Error feof - Unit 63 - Return code = 16
BUFFIN: C I/O Error feof - Unit 64 - Return code = 16
BUFFIN: C I/O Error feof - Unit 65 - Return code = 16
BUFFIN: C I/O Error feof - Unit 66 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16
BUFFIN: C I/O Error feof - Unit 69 - Return code = 16
Error converting file to netcdf: dataout/n26hko.pjc6c10
Error converting file to netcdf: dataout/n26hko.pic6c10
Error converting file to netcdf: dataout/n26hko.pfc6c10
Error converting file to netcdf: dataout/n26hka.phc6c10
Error converting file to netcdf: dataout/n26hka.pgc6c10
Error converting file to netcdf: dataout/n26hka.pec6c10
Error converting file to netcdf: dataout/n26hka.pdc6c10
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
12:18:50 (4956): No heartbeat from core client for 30 sec - exiting
12:18:52 (4956): No heartbeat from core client for 30 sec - exiting
12:18:53 (4956): No heartbeat from core client for 30 sec - exiting
12:18:54 (4956): No heartbeat from core client for 30 sec - exiting
12:18:55 (4956): No heartbeat from core client for 30 sec - exiting
12:18:56 (4956): No heartbeat from core client for 30 sec - exiting
12:18:57 (4956): No heartbeat from core client for 30 sec - exiting
12:18:58 (4956): No heartbeat from core client for 30 sec - exiting
12:18:59 (4956): No heartbeat from core client for 30 sec - exiting
12:19:00 (4956): No heartbeat from core client for 30 sec - exiting
12:19:01 (4956): No heartbeat from core client for 30 sec - exiting
12:19:02 (4956): No heartbeat from core client for 30 sec - exiting
12:19:03 (4956): No heartbeat from core client for 30 sec - exiting
12:19:04 (4956): No heartbeat from core client for 30 sec - exiting
12:19:05 (4956): No heartbeat from core client for 30 sec - exiting
12:19:06 (4956): No heartbeat from core client for 30 sec - exiting
12:19:07 (4956): No heartbeat from core client for 30 sec - exiting
12:19:08 (4956): No heartbeat from core client for 30 sec - exiting
12:19:09 (4956): No heartbeat from core client for 30 sec - exiting
12:19:10 (4956): No heartbeat from core client for 30 sec - exiting
12:19:11 (4956): No heartbeat from core client for 30 sec - exiting
12:19:12 (4956): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
10:04:37 (6196): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:04:39 (6196): No heartbeat from core client for 30 sec - exiting
10:04:40 (6196): No heartbeat from core client for 30 sec - exiting
10:04:41 (6196): No heartbeat from core client for 30 sec - exiting
Atmos Hold Restart file rename failed on atmos_restart.hold
10:14:11 (3580): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
19:37:00 (5896): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
05:58:14 (6808): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
02:03:56 (6804): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:03:57 (6804): No heartbeat from core client for 30 sec - exiting
02:03:58 (6804): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
07:40:59 (4980): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
17:59:19 (4568): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
18:17:05 (5888): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
02:04:03 (8784): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
18:11:59 (6692): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:12:01 (6692): No heartbeat from core client for 30 sec - exiting
18:44:06 (1864): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
06:50:19 (4832): No heartbeat from core client for 30 sec - exiting
06:50:21 (4832): No heartbeat from core client for 30 sec - exiting
06:50:22 (4832): No heartbeat from core client for 30 sec - exiting
06:50:23 (4832): No heartbeat from core client for 30 sec - exiting
06:50:24 (4832): No heartbeat from core client for 30 sec - exiting
06:50:25 (4832): No heartbeat from core client for 30 sec - exiting
06:50:26 (4832): No heartbeat from core client for 30 sec - exiting
06:50:27 (4832): No heartbeat from core client for 30 sec - exiting
06:50:28 (4832): No heartbeat from core client for 30 sec - exiting
06:50:29 (4832): No heartbeat from core client for 30 sec - exiting
06:50:30 (4832): No heartbeat from core client for 30 sec - exiting
06:50:31 (4832): No heartbeat from core client for 30 sec - exiting
06:50:32 (4832): No heartbeat from core client for 30 sec - exiting
06:50:33 (4832): No heartbeat from core client for 30 sec - exiting
06:50:34 (4832): No heartbeat from core client for 30 sec - exiting
06:50:35 (4832): No heartbeat from core client for 30 sec - exiting
06:50:36 (4832): No heartbeat from core client for 30 sec - exiting
06:50:37 (4832): No heartbeat from core client for 30 sec - exiting
06:50:38 (4832): No heartbeat from core client for 30 sec - exiting
06:50:39 (4832): No heartbeat from core client for 30 sec - exiting
06:50:40 (4832): No heartbeat from core client for 30 sec - exiting
06:50:41 (4832): No heartbeat from core client for 30 sec - exiting
06:50:42 (4832): No heartbeat from core client for 30 sec - exiting
06:50:43 (4832): No heartbeat from core client for 30 sec - exiting
06:50:44 (4832): No heartbeat from core client for 30 sec - exiting
06:50:45 (4832): No heartbeat from core client for 30 sec - exiting
06:50:46 (4832): No heartbeat from core client for 30 sec - exiting
06:50:47 (4832): No heartbeat from core client for 30 sec - exiting
06:50:48 (4832): No heartbeat from core client for 30 sec - exiting
06:50:49 (4832): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:14:06 (6496): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
20:48:27 (4328): No heartbeat from core client for 30 sec - exiting
20:48:28 (4328): No heartbeat from core client for 30 sec - exiting
20:48:29 (4328): No heartbeat from core client for 30 sec - exiting
20:48:30 (4328): No heartbeat from core client for 30 sec - exiting
20:48:31 (4328): No heartbeat from core client for 30 sec - exiting
20:48:32 (4328): No heartbeat from core client for 30 sec - exiting
20:48:33 (4328): No heartbeat from core client for 30 sec - exiting
20:48:34 (4328): No heartbeat from core client for 30 sec - exiting
20:48:35 (4328): No heartbeat from core client for 30 sec - exiting
20:48:36 (4328): No heartbeat from core client for 30 sec - exiting
20:48:37 (4328): No heartbeat from core client for 30 sec - exiting
20:48:38 (4328): No heartbeat from core client for 30 sec - exiting
20:48:39 (4328): No heartbeat from core client for 30 sec - exiting
20:48:40 (4328): No heartbeat from core client for 30 sec - exiting
20:48:41 (4328): No heartbeat from core client for 30 sec - exiting
20:48:42 (4328): No heartbeat from core client for 30 sec - exiting
20:48:43 (4328): No heartbeat from core client for 30 sec - exiting
20:48:44 (4328): No heartbeat from core client for 30 sec - exiting
20:48:45 (4328): No heartbeat from core client for 30 sec - exiting
20:48:46 (4328): No heartbeat from core client for 30 sec - exiting
20:48:47 (4328): No heartbeat from core client for 30 sec - exiting
20:48:48 (4328): No heartbeat from core client for 30 sec - exiting
20:48:49 (4328): No heartbeat from core client for 30 sec - exiting
20:48:50 (4328): No heartbeat from core client for 30 sec - exiting
20:48:51 (4328): No heartbeat from core client for 30 sec - exiting
20:48:52 (4328): No heartbeat from core client for 30 sec - exiting
20:48:53 (4328): No heartbeat from core client for 30 sec - exiting
20:48:54 (4328): No heartbeat from core client for 30 sec - exiting
20:48:55 (4328): No heartbeat from core client for 30 sec - exiting
20:48:56 (4328): No heartbeat from core client for 30 sec - exiting
20:48:57 (4328): No heartbeat from core client for 30 sec - exiting
20:48:58 (4328): No heartbeat from core client for 30 sec - exiting
20:48:59 (4328): No heartbeat from core client for 30 sec - exiting
20:49:00 (4328): No heartbeat from core client for 30 sec - exiting
20:49:01 (4328): No heartbeat from core client for 30 sec - exiting
20:49:02 (4328): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
03:14:32 (5748): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...

Model crashed: TEMPHIST: Failed in OPEN of history file                                                                                                                                                                                                                        tmp/pipe_dummy                                                                  2048    
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
20:05:04 (6104): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...

Model crashed: TEMPHIST: Failed in OPEN of history file                                                                                                                                                                                                                        tmp/pipe_dummy                                                                  2048    
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
07:52:53 (6808): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:52:55 (6808): No heartbeat from core client for 30 sec - exiting

Model crashed: TEMPHIST: Failed in OPEN of history file                                                                                                                                                                                                                        tmp/pipe_dummy                                                                  2048    
CPDN Monitor - Quit request from BOINC...

Model crashed: TEMPHIST: Failed in OPEN of history file                                                                                                                                                                                                                        tmp/pipe_dummy                                                                  2048    
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...

Model crashed: TEMPHIST: Failed in OPEN of history file                                                                                                                                                                                                                        tmp/pipe_dummy                                                                  2048    
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...

Model crashed: TEMPHIST: Failed in OPEN of history file                                                                                                                                                                                                                        tmp/pipe_dummy                                                                  2048    

Model crashed: TEMPHIST: Failed in OPEN of history file                                                                                                                                                                                                                        tmp/pipe_dummy                                                                  2048    
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...

Model crashed: TEMPHIST: Failed in OPEN of history file                                                                                                                                                                                                                        tmp/pipe_dummy                                                                  2048    
15:10:40 (6560): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...

Model crashed: TEMPHIST: Failed in OPEN of history file                                                                                                                                                                                                                        tmp/pipe_dummy                                                                  2048    
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...

Model crashed: TEMPHIST: Failed in OPEN of history file                                                                                                                                                                                                                        tmp/pipe_dummy                                                                  2048    
CPDN Monitor - Quit request from BOINC...

Model crashed: TEMPHIST: Failed in OPEN of history file                                                                                                                                                                                                                        tmp/pipe_dummy                                                                  2048    
CPDN Monitor - Quit request from BOINC...

Model crashed: TEMPHIST: Failed in OPEN of history file                                                                                                                                                                                                                        tmp/pipe_dummy                                                                  2048    

Model crashed: TEMPHIST: Failed in OPEN of history file                                                                                                                                                                                                                        tmp/pipe_dummy                                                                  2048    
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...

Model crashed: TEMPHIST: Failed in OPEN of history file                                                                                                                                                                                                                        tmp/pipe_dummy                                                                  2048    

Model crashed: TEMPHIST: Failed in OPEN of history file                                                                                                                                                                                                                        tmp/pipe_dummy                                                                  2048    

Model crashed: TEMPHIST: Failed in OPEN of history file                                                                                                                                                                                                                        tmp/pipe_dummy                                                                  2048    

Model crashed: TEMPHIST: Failed in OPEN of history file                                                                                                                                                                                                                        tmp/pipe_dummy                                                                  2048    

Model crashed: TEMPHIST: Failed in OPEN of history file                                                                                                                                                                                                                        tmp/pipe_dummy                                                                  2048    


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Access Violation (0xc0000005) at address 0x76FD3AC3 read attempt to address 0x40B51882

Engaging BOINC Windows Runtime Debugger...



Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Access Violation (0xc0000005) at address 0x76FD7383 read attempt to address 0xFFFFFFF8

Engaging BOINC Windows Runtime Debugger...

Cannot serialize file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_n26h_1920_40_008371713/dataout/shmem_restart.day
Signal 11 received, exiting...
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
16 Aug 2013 19:26:50 1189392 15797555 hadcm3n_n26h_1920_40_008371713_0 777,600 1,427,321 1.8355
15 Aug 2013 22:31:53 1189392 15797555 hadcm3n_n26h_1920_40_008371713_0 751,680 1,483,866 1.9741
15 Aug 2013 01:28:02 1189392 15797555 hadcm3n_n26h_1920_40_008371713_0 725,760 1,424,093 1.9622
14 Aug 2013 17:54:45 1189392 15797555 hadcm3n_n26h_1920_40_008371713_0 699,840 1,391,221 1.9879
14 Aug 2013 17:54:45 1189392 15797555 hadcm3n_n26h_1920_40_008371713_0 673,920 1,331,991 1.9765
14 Aug 2013 17:54:45 1189392 15797555 hadcm3n_n26h_1920_40_008371713_0 648,000 1,340,299 2.0684
14 Aug 2013 17:54:45 1189392 15797555 hadcm3n_n26h_1920_40_008371713_0 622,080 1,286,811 2.0686
14 Aug 2013 17:54:45 1189392 15797555 hadcm3n_n26h_1920_40_008371713_0 596,160 1,272,397 2.1343
14 Aug 2013 17:54:45 1189392 15797555 hadcm3n_n26h_1920_40_008371713_0 570,240 1,238,658 2.1722
14 Aug 2013 17:54:45 1189392 15797555 hadcm3n_n26h_1920_40_008371713_0 544,320 1,192,151 2.1902
14 Aug 2013 17:54:45 1189392 15797555 hadcm3n_n26h_1920_40_008371713_0 518,400 1,153,120 2.2244
14 Aug 2013 17:54:45 1189392 15797555 hadcm3n_n26h_1920_40_008371713_0 492,480 1,099,431 2.2324
30 Jul 2013 10:23:07 1189392 15797555 hadcm3n_n26h_1920_40_008371713_0 466,560 1,040,070 2.2292
30 Jul 2013 10:23:07 1189392 15797555 hadcm3n_n26h_1920_40_008371713_0 440,640 985,265 2.2360
30 Jul 2013 10:23:07 1189392 15797555 hadcm3n_n26h_1920_40_008371713_0 414,720 923,918 2.2278
26 Jul 2013 05:06:08 1189392 15797555 hadcm3n_n26h_1920_40_008371713_0 388,800 864,176 2.2227
24 Jul 2013 22:30:01 1189392 15797555 hadcm3n_n26h_1920_40_008371713_0 362,880 799,580 2.2034
23 Jul 2013 19:29:52 1189392 15797555 hadcm3n_n26h_1920_40_008371713_0 336,960 736,477 2.1857
09 Jul 2013 23:58:27 1189392 15797555 hadcm3n_n26h_1920_40_008371713_0 311,040 679,459 2.1845
04 Jul 2013 14:20:40 1189392 15797555 hadcm3n_n26h_1920_40_008371713_0 285,120 619,803 2.1738


©2024 climateprediction.net