climateprediction.net home page
Task 13658374

Task 13658374

Name hadcm3n_yj4y_1900_40_007515006_3
Workunit 7712481
Created 24 Nov 2011, 8:17:43 UTC
Sent 24 Nov 2011, 8:20:44 UTC
Report deadline 23 Feb 2012, 15:47:55 UTC
Received 17 Jan 2012, 16:48:42 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1114532
Run time 31 days 21 hours 42 min 20 sec
CPU time 21 days 21 hours 36 min 59 sec
Validate state Valid
Credit 12,441.60
Device peak FLOPS 3.16 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
windows_intelx86
Stderr
<core_client_version>6.12.34</core_client_version>
<![CDATA[
<stderr_txt>
19:40:30 (12132): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
16:57:16 (8664): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - No 'heartbeat' from BOINC...
16:57:17 (8664): No heartbeat from core client for 30 sec - exiting
16:57:18 (8664): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5212, iMonCtr=1
Model crash detected, will try to restart...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
22:34:13 (1804): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
23:19:36 (11932): No heartbeat from core client for 30 sec - exiting
23:19:37 (11932): No heartbeat from core client for 30 sec - exiting
23:19:38 (11932): No heartbeat from core client for 30 sec - exiting
23:19:39 (11932): No heartbeat from core client for 30 sec - exiting
23:19:40 (11932): No heartbeat from core client for 30 sec - exiting
23:19:41 (11932): No heartbeat from core client for 30 sec - exiting
23:19:42 (11932): No heartbeat from core client for 30 sec - exiting
23:19:43 (11932): No heartbeat from core client for 30 sec - exiting
23:19:44 (11932): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
02:52:10 (4552): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:52:11 (4552): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
No Process Handle
Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8052, selfPID=8052, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
08:48:54 (3976): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9452, selfPID=9452, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
23:19:04 (8768): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
00:05:45 (5752): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:06:27 (11644): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:06:28 (11644): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
17:10:12 (6040): No heartbeat from core client for 30 sec - exiting
17:10:13 (6040): No heartbeat from core client for 30 sec - exiting
17:10:14 (6040): No heartbeat from core client for 30 sec - exiting
17:10:15 (6040): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:13:07 (6232): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:13:09 (6232): No heartbeat from core client for 30 sec - exiting
18:13:10 (6232): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
08:20:12 (7476): No heartbeat from core client for 30 sec - exiting
08:20:13 (7476): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
16:53:07 (6336): No heartbeat from core client for 30 sec - exiting
16:53:08 (6336): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:53:09 (6336): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
22:13:36 (5720): No heartbeat from core client for 30 sec - exiting
22:13:37 (5720): No heartbeat from core client for 30 sec - exiting
22:13:38 (5720): No heartbeat from core client for 30 sec - exiting
22:13:39 (5720): No heartbeat from core client for 30 sec - exiting
22:13:40 (5720): No heartbeat from core client for 30 sec - exiting
22:13:41 (5720): No heartbeat from core client for 30 sec - exiting
22:13:43 (5720): No heartbeat from core client for 30 sec - exiting
22:13:44 (5720): No heartbeat from core client for 30 sec - exiting
22:13:45 (5720): No heartbeat from core client for 30 sec - exiting
22:13:46 (5720): No heartbeat from core client for 30 sec - exiting
22:13:47 (5720): No heartbeat from core client for 30 sec - exiting
22:13:48 (5720): No heartbeat from core client for 30 sec - exiting
22:13:49 (5720): No heartbeat from core client for 30 sec - exiting
22:13:50 (5720): No heartbeat from core client for 30 sec - exiting
22:13:51 (5720): No heartbeat from core client for 30 sec - exiting
22:13:52 (5720): No heartbeat from core client for 30 sec - exiting
22:13:53 (5720): No heartbeat from core client for 30 sec - exiting
22:13:54 (5720): No heartbeat from core client for 30 sec - exiting
22:13:55 (5720): No heartbeat from core client for 30 sec - exiting
22:13:56 (5720): No heartbeat from core client for 30 sec - exiting
22:13:57 (5720): No heartbeat from core client for 30 sec - exiting
22:13:58 (5720): No heartbeat from core client for 30 sec - exiting
22:13:59 (5720): No heartbeat from core client for 30 sec - exiting
22:14:00 (5720): No heartbeat from core client for 30 sec - exiting
22:14:01 (5720): No heartbeat from core client for 30 sec - exiting
22:14:02 (5720): No heartbeat from core client for 30 sec - exiting
22:14:03 (5720): No heartbeat from core client for 30 sec - exiting
22:14:04 (5720): No heartbeat from core client for 30 sec - exiting
22:14:05 (5720): No heartbeat from core client for 30 sec - exiting
22:14:06 (5720): No heartbeat from core client for 30 sec - exiting
22:14:07 (5720): No heartbeat from core client for 30 sec - exiting
22:14:08 (5720): No heartbeat from core client for 30 sec - exiting
22:14:09 (5720): No heartbeat from core client for 30 sec - exiting
22:14:10 (5720): No heartbeat from core client for 30 sec - exiting
22:14:11 (5720): No heartbeat from core client for 30 sec - exiting
22:14:12 (5720): No heartbeat from core client for 30 sec - exiting
22:14:13 (5720): No heartbeat from core client for 30 sec - exiting
22:14:14 (5720): No heartbeat from core client for 30 sec - exiting
22:14:15 (5720): No heartbeat from core client for 30 sec - exiting
22:14:16 (5720): No heartbeat from core client for 30 sec - exiting
22:14:17 (5720): No heartbeat from core client for 30 sec - exiting
22:14:18 (5720): No heartbeat from core client for 30 sec - exiting
22:14:19 (5720): No heartbeat from core client for 30 sec - exiting
22:14:20 (5720): No heartbeat from core client for 30 sec - exiting
22:14:21 (5720): No heartbeat from core client for 30 sec - exiting
22:14:22 (5720): No heartbeat from core client for 30 sec - exiting
22:14:23 (5720): No heartbeat from core client for 30 sec - exiting
22:14:24 (5720): No heartbeat from core client for 30 sec - exiting
22:14:25 (5720): No heartbeat from core client for 30 sec - exiting
22:14:26 (5720): No heartbeat from core client for 30 sec - exiting
22:14:27 (5720): No heartbeat from core client for 30 sec - exiting
22:14:28 (5720): No heartbeat from core client for 30 sec - exiting
22:14:29 (5720): No heartbeat from core client for 30 sec - exiting
22:14:30 (5720): No heartbeat from core client for 30 sec - exiting
22:14:31 (5720): No heartbeat from core client for 30 sec - exiting
22:14:32 (5720): No heartbeat from core client for 30 sec - exiting
22:14:33 (5720): No heartbeat from core client for 30 sec - exiting
22:14:34 (5720): No heartbeat from core client for 30 sec - exiting
22:14:35 (5720): No heartbeat from core client for 30 sec - exiting
22:14:36 (5720): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
23:46:56 (4348): No heartbeat from core client for 30 sec - exiting
23:46:57 (4348): No heartbeat from core client for 30 sec - exiting
23:46:58 (4348): No heartbeat from core client for 30 sec - exiting
23:46:59 (4348): No heartbeat from core client for 30 sec - exiting
23:47:00 (4348): No heartbeat from core client for 30 sec - exiting
23:47:01 (4348): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
22:15:15 (6372): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
17 Jan 2012 15:09:50 1114532 13658374 hadcm3n_yj4y_1900_40_007515006_3 1,036,800 1,891,606 1.8245
16 Jan 2012 07:49:24 1114532 13658374 hadcm3n_yj4y_1900_40_007515006_3 1,010,880 1,846,848 1.8270
14 Jan 2012 19:42:04 1114532 13658374 hadcm3n_yj4y_1900_40_007515006_3 984,960 1,802,540 1.8301
13 Jan 2012 07:12:20 1114532 13658374 hadcm3n_yj4y_1900_40_007515006_3 959,040 1,755,066 1.8300
11 Jan 2012 20:09:05 1114532 13658374 hadcm3n_yj4y_1900_40_007515006_3 933,120 1,705,065 1.8273
09 Jan 2012 22:40:56 1114532 13658374 hadcm3n_yj4y_1900_40_007515006_3 907,200 1,657,383 1.8269
08 Jan 2012 05:59:20 1114532 13658374 hadcm3n_yj4y_1900_40_007515006_3 881,280 1,610,549 1.8275
04 Jan 2012 00:49:06 1114532 13658374 hadcm3n_yj4y_1900_40_007515006_3 855,360 1,564,541 1.8291
03 Jan 2012 08:46:15 1114532 13658374 hadcm3n_yj4y_1900_40_007515006_3 829,440 1,519,644 1.8321
02 Jan 2012 19:09:52 1114532 13658374 hadcm3n_yj4y_1900_40_007515006_3 803,520 1,474,856 1.8355
02 Jan 2012 03:43:45 1114532 13658374 hadcm3n_yj4y_1900_40_007515006_3 777,600 1,430,028 1.8390
01 Jan 2012 12:43:09 1114532 13658374 hadcm3n_yj4y_1900_40_007515006_3 751,680 1,382,866 1.8397
31 Dec 2011 22:24:56 1114532 13658374 hadcm3n_yj4y_1900_40_007515006_3 725,760 1,336,873 1.8420
26 Dec 2011 23:24:59 1114532 13658374 hadcm3n_yj4y_1900_40_007515006_3 699,840 1,290,874 1.8445
25 Dec 2011 03:37:40 1114532 13658374 hadcm3n_yj4y_1900_40_007515006_3 673,920 1,241,899 1.8428
24 Dec 2011 03:59:03 1114532 13658374 hadcm3n_yj4y_1900_40_007515006_3 648,000 1,196,371 1.8463
22 Dec 2011 18:04:57 1114532 13658374 hadcm3n_yj4y_1900_40_007515006_3 622,080 1,147,181 1.8441
21 Dec 2011 23:55:39 1114532 13658374 hadcm3n_yj4y_1900_40_007515006_3 596,160 1,095,934 1.8383
21 Dec 2011 04:52:01 1114532 13658374 hadcm3n_yj4y_1900_40_007515006_3 570,240 1,047,012 1.8361
20 Dec 2011 11:55:05 1114532 13658374 hadcm3n_yj4y_1900_40_007515006_3 544,320 996,241 1.8302


©2024 cpdn.org