climateprediction.net home page
Task 15592871

Task 15592871

Name hadcm3n_48t2_1940_40_008306534_0
Workunit 8457669
Created 7 Feb 2013, 10:15:20 UTC
Sent 7 Feb 2013, 10:22:35 UTC
Report deadline 9 May 2013, 17:49:46 UTC
Received 13 May 2013, 11:33:41 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 898291
Run time 63 days 13 hours 31 min 18 sec
CPU time 52 days 12 hours 35 min 38 sec
Validate state Valid
Credit 12,441.60
Device peak FLOPS 1.57 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
windows_intelx86
Stderr
<core_client_version>6.10.9</core_client_version>
<![CDATA[
<stderr_txt>
Ocean Restart file copy failed on 48t2ko.dae17j0
Ocean Restart file copy failed on 48t2ko.dae17q0
Atmos Hold Restart file rename failed on atmos_restart.hold
Ocean Restart file copy failed on 48t2ko.dae18s0
Ocean Restart file copy failed on 48t2ko.dae1960
Suspended CPDN Monitor - Suspend request from BOINC...
11:24:09 (5656): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:24:55 (8208): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Ocean Restart file copy failed on 48t2ko.dae3c60
Ocean Restart file copy failed on 48t2ko.dae3cb0
14:28:06 (13788): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Ocean Restart file copy failed on 48t2ko.dae3cl0
15:57:00 (13300): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:59:12 (9404): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Ocean Restart file copy failed on 48t2ko.dae41g0
Atmos Hold Restart file rename failed on atmos_restart.hold
Ocean Restart file copy failed on 48t2ko.dae59q0
Atmos Hold Restart file rename failed on atmos_restart.hold
Ocean Restart file copy failed on 48t2ko.dae5a10
12:46:48 (6920): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:46:50 (6920): No heartbeat from core client for 30 sec - exiting
12:46:51 (6920): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
Ocean Restart file copy failed on 48t2ko.dae85o0
Ocean Restart file copy failed on 48t2ko.dae85u0
Ocean Restart file copy failed on 48t2ko.dae86a0
Ocean Restart file copy failed on 48t2ko.dae86k0
Atmos Hold Restart file rename failed on atmos_restart.hold
Ocean Restart file copy failed on 48t2ko.dae86r0
Ocean Restart file copy failed on 48t2ko.dae86t0
17:23:45 (7836): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:23:47 (7836): No heartbeat from core client for 30 sec - exiting
17:23:48 (7836): No heartbeat from core client for 30 sec - exiting
17:25:04 (13612): No heartbeat from core client for 30 sec - exiting
17:25:05 (13612): No heartbeat from core client for 30 sec - exiting
17:25:06 (13612): No heartbeat from core client for 30 sec - exiting
17:25:07 (13612): No heartbeat from core client for 30 sec - exiting
17:25:08 (13612): No heartbeat from core client for 30 sec - exiting
17:25:09 (13612): No heartbeat from core client for 30 sec - exiting
17:25:10 (13612): No heartbeat from core client for 30 sec - exiting
17:25:11 (13612): No heartbeat from core client for 30 sec - exiting
17:25:12 (13612): No heartbeat from core client for 30 sec - exiting
17:25:13 (13612): No heartbeat from core client for 30 sec - exiting
17:25:14 (13612): No heartbeat from core client for 30 sec - exiting
17:25:15 (13612): No heartbeat from core client for 30 sec - exiting
17:25:16 (13612): No heartbeat from core client for 30 sec - exiting
17:25:17 (13612): No heartbeat from core client for 30 sec - exiting
17:25:18 (13612): No heartbeat from core client for 30 sec - exiting
17:25:19 (13612): No heartbeat from core client for 30 sec - exiting
17:25:20 (13612): No heartbeat from core client for 30 sec - exiting
17:25:21 (13612): No heartbeat from core client for 30 sec - exiting
17:25:22 (13612): No heartbeat from core client for 30 sec - exiting
17:25:23 (13612): No heartbeat from core client for 30 sec - exiting
17:25:24 (13612): No heartbeat from core client for 30 sec - exiting
17:25:26 (13612): No heartbeat from core client for 30 sec - exiting
17:25:27 (13612): No heartbeat from core client for 30 sec - exiting
17:25:28 (13612): No heartbeat from core client for 30 sec - exiting
17:25:29 (13612): No heartbeat from core client for 30 sec - exiting
17:25:30 (13612): No heartbeat from core client for 30 sec - exiting
17:25:31 (13612): No heartbeat from core client for 30 sec - exiting
17:25:32 (13612): No heartbeat from core client for 30 sec - exiting
17:25:33 (13612): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Ocean Restart file copy failed on 48t2ko.dae87a0
Atmos Hold Restart file rename failed on atmos_restart.hold
Ocean Restart file copy failed on 48t2ko.dae87p0
Skipping gmts_generator due to netcdf error 13 - Permission denied
Skipping gmts_generator due to netcdf error -49 - Variable not found
Skipping gmts_generator due to netcdf error -49 - Variable not found
Skipping gmts_generator due to netcdf error -49 - Variable not found
Skipping gmts_generator due to netcdf error -49 - Variable not found
Suspended CPDN Monitor - Suspend request from BOINC...
Ocean Restart file copy failed on 48t2ko.daf0180
Ocean Restart file copy failed on 48t2ko.daf01a0
Ocean Restart file copy failed on 48t2ko.daf01h0
Atmos Hold Restart file rename failed on atmos_restart.hold
Ocean Restart file copy failed on 48t2ko.daf02e0
Ocean Restart file copy failed on 48t2ko.daf02i0
Ocean Restart file copy failed on 48t2ko.daf02l0
Ocean Restart file copy failed on 48t2ko.daf02s0
Suspended CPDN Monitor - Suspend request from BOINC...
Ocean Restart file copy failed on 48t2ko.daf22k0
Ocean Restart file copy failed on 48t2ko.daf22r0
13:38:58 (7424): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:39:00 (7424): No heartbeat from core client for 30 sec - exiting
13:39:01 (7424): No heartbeat from core client for 30 sec - exiting
13:42:44 (4412): No heartbeat from core client for 30 sec - exiting
13:42:45 (4412): No heartbeat from core client for 30 sec - exiting
13:42:46 (4412): No heartbeat from core client for 30 sec - exiting
13:42:47 (4412): No heartbeat from core client for 30 sec - exiting
13:42:48 (4412): No heartbeat from core client for 30 sec - exiting
13:42:49 (4412): No heartbeat from core client for 30 sec - exiting
13:42:50 (4412): No heartbeat from core client for 30 sec - exiting
13:42:52 (4412): No heartbeat from core client for 30 sec - exiting
13:42:53 (4412): No heartbeat from core client for 30 sec - exiting
13:42:54 (4412): No heartbeat from core client for 30 sec - exiting
13:42:55 (4412): No heartbeat from core client for 30 sec - exiting
13:42:56 (4412): No heartbeat from core client for 30 sec - exiting
13:42:57 (4412): No heartbeat from core client for 30 sec - exiting
13:42:58 (4412): No heartbeat from core client for 30 sec - exiting
13:42:59 (4412): No heartbeat from core client for 30 sec - exiting
13:43:00 (4412): No heartbeat from core client for 30 sec - exiting
13:43:01 (4412): No heartbeat from core client for 30 sec - exiting
13:43:02 (4412): No heartbeat from core client for 30 sec - exiting
13:43:03 (4412): No heartbeat from core client for 30 sec - exiting
13:43:04 (4412): No heartbeat from core client for 30 sec - exiting
13:43:05 (4412): No heartbeat from core client for 30 sec - exiting
13:43:06 (4412): No heartbeat from core client for 30 sec - exiting
13:43:07 (4412): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Ocean Restart file copy failed on 48t2ko.daf2330
Atmos Hold Restart file rename failed on atmos_restart.hold
Atmos Hold Restart file rename failed on atmos_restart.hold
Ocean Restart file copy failed on 48t2ko.daf23o0
Atmos Hold Restart file rename failed on atmos_restart.hold
Ocean Restart file copy failed on 48t2ko.daf2440
17:14:34 (8396): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:14:35 (8396): No heartbeat from core client for 30 sec - exiting
17:14:36 (8396): No heartbeat from core client for 30 sec - exiting
17:14:37 (8396): No heartbeat from core client for 30 sec - exiting
17:14:38 (8396): No heartbeat from core client for 30 sec - exiting
17:14:39 (8396): No heartbeat from core client for 30 sec - exiting
17:14:40 (8396): No heartbeat from core client for 30 sec - exiting
17:14:41 (8396): No heartbeat from core client for 30 sec - exiting
17:14:42 (8396): No heartbeat from core client for 30 sec - exiting
17:14:43 (8396): No heartbeat from core client for 30 sec - exiting
17:14:44 (8396): No heartbeat from core client for 30 sec - exiting
11:31:06 (5340): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Ocean Restart file copy failed on 48t2ko.daf3ae0
Ocean Restart file copy failed on 48t2ko.daf3ah0
Skipping gmts_generator due to netcdf error 13 - Permission denied
Skipping gmts_generator due to netcdf error 13 - Permission denied
Skipping gmts_generator due to netcdf error -49 - Variable not found
Skipping gmts_generator due to netcdf error -49 - Variable not found
Skipping gmts_generator due to netcdf error -49 - Variable not found
Skipping gmts_generator due to netcdf error -49 - Variable not found
Skipping gmts_generator due to netcdf error -49 - Variable not found
Skipping gmts_generator due to netcdf error -49 - Variable not found
Suspended CPDN Monitor - Suspend request from BOINC...

Model crashed: TEMPHIST: Failed in OPEN of history file                                                                                                                                                                                                                        tmp/pipe_dummy                                                                  2048    
11:32:57 (3144): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:32:59 (3144): No heartbeat from core client for 30 sec - exiting
11:34:51 (10528): No heartbeat from core client for 30 sec - exiting
11:34:52 (10528): No heartbeat from core client for 30 sec - exiting
11:34:53 (10528): No heartbeat from core client for 30 sec - exiting
11:34:54 (10528): No heartbeat from core client for 30 sec - exiting
11:34:55 (10528): No heartbeat from core client for 30 sec - exiting
11:34:56 (10528): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Ocean Restart file copy failed on 48t2ko.daf67p0
Ocean Restart file copy failed on 48t2ko.daf67u0
12:53:10 (8992): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Atmos Hold Restart file rename failed on atmos_restart.hold
Ocean Restart file copy failed on 48t2ko.daf6830
14:42:41 (2692): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Ocean Restart file copy failed on 48t2ko.daf68r0
17:18:43 (12372): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:18:44 (12372): No heartbeat from core client for 30 sec - exiting
17:18:46 (12372): No heartbeat from core client for 30 sec - exiting
17:18:47 (12372): No heartbeat from core client for 30 sec - exiting
17:18:48 (12372): No heartbeat from core client for 30 sec - exiting
17:18:49 (12372): No heartbeat from core client for 30 sec - exiting
17:18:50 (12372): No heartbeat from core client for 30 sec - exiting
17:18:51 (12372): No heartbeat from core client for 30 sec - exiting
17:18:52 (12372): No heartbeat from core client for 30 sec - exiting
17:18:53 (12372): No heartbeat from core client for 30 sec - exiting
17:18:54 (12372): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
11:35:59 (4312): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:36:00 (4312): No heartbeat from core client for 30 sec - exiting
Ocean Restart file copy failed on 48t2ko.daf8830
13:03:08 (4216): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Ocean Restart file copy failed on 48t2ko.daf8870
16:36:23 (3780): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Ocean Restart file copy failed on 48t2ko.daf8970
11:39:38 (13568): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Ocean Restart file copy failed on 48t2ko.dag08r0
Suspended CPDN Monitor - Suspend request from BOINC...
Ocean Restart file copy failed on 48t2ko.dag24e0
11:41:41 (8152): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:41:42 (8152): No heartbeat from core client for 30 sec - exiting
11:57:49 (10080): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Ocean Restart file copy failed on 48t2ko.dag24h0
Atmos Hold Restart file rename failed on atmos_restart.hold
Ocean Restart file copy failed on 48t2ko.dag24n0
Atmos Hold Restart file rename failed on atmos_restart.hold
Ocean Restart file copy failed on 48t2ko.dag2510
Ocean Restart file copy failed on 48t2ko.dag2530
Ocean Restart file copy failed on 48t2ko.dag25b0
Ocean Restart file copy failed on 48t2ko.dag25g0
Ocean Restart file copy failed on 48t2ko.dag25u0
Ocean Restart file copy failed on 48t2ko.dag2640
Ocean Restart file copy failed on 48t2ko.dag2670
19:50:22 (10000): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:50:23 (10000): No heartbeat from core client for 30 sec - exiting
19:50:24 (10000): No heartbeat from core client for 30 sec - exiting
19:50:25 (10000): No heartbeat from core client for 30 sec - exiting
19:50:26 (10000): No heartbeat from core client for 30 sec - exiting
19:50:27 (10000): No heartbeat from core client for 30 sec - exiting
19:50:28 (10000): No heartbeat from core client for 30 sec - exiting
19:50:29 (10000): No heartbeat from core client for 30 sec - exiting
19:50:30 (10000): No heartbeat from core client for 30 sec - exiting
19:50:31 (10000): No heartbeat from core client for 30 sec - exiting
19:50:32 (10000): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
Ocean Restart file copy failed on 48t2ko.dag4bj0
11:45:29 (9020): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Atmos Hold Restart file rename failed on atmos_restart.hold
Ocean Restart file copy failed on 48t2ko.dag4br0
Ocean Restart file copy failed on 48t2ko.dag4bu0
14:28:32 (3028): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:31:23 (16328): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Ocean Restart file copy failed on 48t2ko.dag5150
Ocean Restart file copy failed on 48t2ko.dag6cc0
11:48:15 (5956): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Ocean Restart file copy failed on 48t2ko.dag6cj0
Ocean Restart file copy failed on 48t2ko.dag6cm0
Ocean Restart file copy failed on 48t2ko.dag6co0
Suspended CPDN Monitor - Suspend request from BOINC...
11:55:09 (10604): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:55:10 (10604): No heartbeat from core client for 30 sec - exiting
11:55:12 (10604): No heartbeat from core client for 30 sec - exiting
12:00:50 (13724): No heartbeat from core client for 30 sec - exiting
12:00:51 (13724): No heartbeat from core client for 30 sec - exiting
12:00:52 (13724): No heartbeat from core client for 30 sec - exiting
12:00:53 (13724): No heartbeat from core client for 30 sec - exiting
12:00:54 (13724): No heartbeat from core client for 30 sec - exiting
12:00:55 (13724): No heartbeat from core client for 30 sec - exiting
12:00:56 (13724): No heartbeat from core client for 30 sec - exiting
12:00:57 (13724): No heartbeat from core client for 30 sec - exiting
12:00:58 (13724): No heartbeat from core client for 30 sec - exiting
12:00:59 (13724): No heartbeat from core client for 30 sec - exiting
12:01:00 (13724): No heartbeat from core client for 30 sec - exiting
12:01:01 (13724): No heartbeat from core client for 30 sec - exiting
12:01:02 (13724): No heartbeat from core client for 30 sec - exiting
12:01:03 (13724): No heartbeat from core client for 30 sec - exiting
12:01:04 (13724): No heartbeat from core client for 30 sec - exiting
12:01:05 (13724): No heartbeat from core client for 30 sec - exiting
12:01:06 (13724): No heartbeat from core client for 30 sec - exiting
12:01:07 (13724): No heartbeat from core client for 30 sec - exiting
12:01:08 (13724): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Ocean Restart file copy failed on 48t2ko.dag9170
Atmos Hold Restart file rename failed on atmos_restart.hold
Atmos Hold Restart file rename failed on atmos_restart.hold
Ocean Restart file copy failed on 48t2ko.dag9210
Ocean Restart file copy failed on 48t2ko.dag92e0
Ocean Restart file copy failed on 48t2ko.dag92i0
Atmos Hold Restart file rename failed on atmos_restart.hold
Ocean Restart file copy failed on 48t2ko.dag9350
23:34:24 (12868): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
17:38:36 (10732): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:44:06 (13008): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:44:08 (13008): No heartbeat from core client for 30 sec - exiting
04:44:09 (13008): No heartbeat from core client for 30 sec - exiting
04:44:10 (13008): No heartbeat from core client for 30 sec - exiting
04:44:11 (13008): No heartbeat from core client for 30 sec - exiting
04:44:12 (13008): No heartbeat from core client for 30 sec - exiting
11:30:56 (2908): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:25:57 (4524): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:25:58 (4524): No heartbeat from core client for 30 sec - exiting
12:25:59 (4524): No heartbeat from core client for 30 sec - exiting
12:26:00 (4524): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
11:43:55 (10680): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:46:51 (10792): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:53:44 (12188): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:56:09 (8096): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:58:28 (11484): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:00:27 (6264): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:02:50 (7436): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:05:56 (10212): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:07:59 (5392): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:13:19 (10716): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:15:33 (6016): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:20:55 (6104): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:23:19 (9768): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:25:32 (4956): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:27:37 (9284): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:29:51 (9888): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
13 May 2013 11:35:49 898291 15592871 hadcm3n_48t2_1940_40_008306534_0 1,036,800 4,536,424 4.3754
11 May 2013 21:16:44 898291 15592871 hadcm3n_48t2_1940_40_008306534_0 1,010,880 4,406,433 4.3590
10 May 2013 08:46:13 898291 15592871 hadcm3n_48t2_1940_40_008306534_0 984,960 4,280,659 4.3460
08 May 2013 20:57:00 898291 15592871 hadcm3n_48t2_1940_40_008306534_0 959,040 4,158,898 4.3365
07 May 2013 09:36:47 898291 15592871 hadcm3n_48t2_1940_40_008306534_0 933,120 4,042,839 4.3326
05 May 2013 20:08:32 898291 15592871 hadcm3n_48t2_1940_40_008306534_0 907,200 3,915,790 4.3163
04 May 2013 08:36:04 898291 15592871 hadcm3n_48t2_1940_40_008306534_0 881,280 3,790,679 4.3013
21 Apr 2013 19:52:45 898291 15592871 hadcm3n_48t2_1940_40_008306534_0 855,360 3,676,888 4.2986
20 Apr 2013 17:22:47 898291 15592871 hadcm3n_48t2_1940_40_008306534_0 829,440 3,582,077 4.3187
19 Apr 2013 16:21:00 898291 15592871 hadcm3n_48t2_1940_40_008306534_0 803,520 3,496,205 4.3511
18 Apr 2013 15:05:41 898291 15592871 hadcm3n_48t2_1940_40_008306534_0 777,600 3,415,660 4.3926
28 Mar 2013 03:26:55 898291 15592871 hadcm3n_48t2_1940_40_008306534_0 751,680 3,307,379 4.4000
26 Mar 2013 07:30:41 898291 15592871 hadcm3n_48t2_1940_40_008306534_0 725,760 3,182,353 4.3849
24 Mar 2013 11:07:46 898291 15592871 hadcm3n_48t2_1940_40_008306534_0 699,840 3,068,378 4.3844
22 Mar 2013 09:49:15 898291 15592871 hadcm3n_48t2_1940_40_008306534_0 673,920 2,948,576 4.3753
20 Mar 2013 23:31:36 898291 15592871 hadcm3n_48t2_1940_40_008306534_0 648,000 2,849,659 4.3976
19 Mar 2013 13:30:20 898291 15592871 hadcm3n_48t2_1940_40_008306534_0 622,080 2,754,452 4.4278
18 Mar 2013 01:06:40 898291 15592871 hadcm3n_48t2_1940_40_008306534_0 596,160 2,655,391 4.4542
16 Mar 2013 12:19:26 898291 15592871 hadcm3n_48t2_1940_40_008306534_0 570,240 2,552,926 4.4769
14 Mar 2013 18:20:56 898291 15592871 hadcm3n_48t2_1940_40_008306534_0 544,320 2,439,580 4.4819


©2024 cpdn.org