climateprediction.net home page
Task 11589139

Task 11589139

Name famous_r141_1599_200_006666713_1
Workunit 6870085
Created 22 Jun 2010, 10:54:23 UTC
Sent 25 Jun 2010, 12:55:51 UTC
Report deadline 24 Sep 2010, 20:23:02 UTC
Received 22 Jul 2010, 2:38:58 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1021071
Run time 19 days 10 hours 43 min 21 sec
CPU time 18 days 21 hours 45 min 48 sec
Validate state Invalid
Credit 3,242.66
Device peak FLOPS 0.65 GFLOPS
Application version UK Met Office FAMOUS v6.11
i686-pc-linux-gnu
Stderr
<core_client_version>6.10.17</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
 (25277): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
 (25656): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
 (8935): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
 (10105): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
 (10105): No heartbeat from core client for 30 sec - exiting
 (10105): No heartbeat from core client for 30 sec - exiting
 (10105): No heartbeat from core client for 30 sec - exiting
 (8747): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
 (8856): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
 (21710): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - No 'heartbeat' from BOINC...
 (3300): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
 (3300): No heartbeat from core client for 30 sec - exiting
 (3300): No heartbeat from core client for 30 sec - exiting
 (3300): No heartbeat from core client for 30 sec - exiting
 (3300): No heartbeat from core client for 30 sec - exiting
 (3300): No heartbeat from core client for 30 sec - exiting
 (3300): No heartbeat from core client for 30 sec - exiting
 (3300): No heartbeat from core client for 30 sec - exiting
 (3300): No heartbeat from core client for 30 sec - exiting
 (3300): No heartbeat from core client for 30 sec - exiting
 (17372): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
 (18028): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - No 'heartbeat' from BOINC...
 (30988): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
 (505): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
 (24215): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
 (24483): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
 (24648): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
 (28323): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
 (5669): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
 (27522): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 60 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 61 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
MainError:	11:56:15 PM	No files match the supplied pattern.
MainError:	11:56:16 PM	No files match the supplied pattern.
 (1076): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
 (13502): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
 (28213): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
 (28213): No heartbeat from core client for 30 sec - exiting
 (28213): No heartbeat from core client for 30 sec - exiting
 (28213): No heartbeat from core client for 30 sec - exiting
 (28213): No heartbeat from core client for 30 sec - exiting
 (28213): No heartbeat from core client for 30 sec - exiting
 (28213): No heartbeat from core client for 30 sec - exiting
 (28213): No heartbeat from core client for 30 sec - exiting
 (28213): No heartbeat from core client for 30 sec - exiting
 (28213): No heartbeat from core client for 30 sec - exiting
 (28213): No heartbeat from core client for 30 sec - exiting
 (28213): No heartbeat from core client for 30 sec - exiting
 (28213): No heartbeat from core client for 30 sec - exiting
 (28213): No heartbeat from core client for 30 sec - exiting
 (28213): No heartbeat from core client for 30 sec - exiting
 (28213): No heartbeat from core client for 30 sec - exiting
 (28213): No heartbeat from core client for 30 sec - exiting
 (28213): No heartbeat from core client for 30 sec - exiting
 (28213): No heartbeat from core client for 30 sec - exiting
 (28213): No heartbeat from core client for 30 sec - exiting
 (28213): No heartbeat from core client for 30 sec - exiting
 (28213): No heartbeat from core client for 30 sec - exiting
 (28213): No heartbeat from core client for 30 sec - exiting
 (28213): No heartbeat from core client for 30 sec - exiting
 (28213): No heartbeat from core client for 30 sec - exiting
 (28213): No heartbeat from core client for 30 sec - exiting
 (28213): No heartbeat from core client for 30 sec - exiting
 (28213): No heartbeat from core client for 30 sec - exiting
 (28213): No heartbeat from core client for 30 sec - exiting
 (28213): No heartbeat from core client for 30 sec - exiting
 (28213): No heartbeat from core client for 30 sec - exiting
 (28213): No heartbeat from core client for 30 sec - exiting
 (28213): No heartbeat from core client for 30 sec - exiting
 (28213): No heartbeat from core client for 30 sec - exiting
 (28213): No heartbeat from core client for 30 sec - exiting
 (28213): No heartbeat from core client for 30 sec - exiting
 (28213): No heartbeat from core client for 30 sec - exiting
 (28213): No heartbeat from core client for 30 sec - exiting
 (28213): No heartbeat from core client for 30 sec - exiting
 (28213): No heartbeat from core client for 30 sec - exiting
 (28213): No heartbeat from core client for 30 sec - exiting
 (28213): No heartbeat from core client for 30 sec - exiting
 (28213): No heartbeat from core client for 30 sec - exiting
 (28213): No heartbeat from core client for 30 sec - exiting
 (28213): No heartbeat from core client for 30 sec - exiting
 (28213): No heartbeat from core client for 30 sec - exiting
 (28213): No heartbeat from core client for 30 sec - exiting
 (28213): No heartbeat from core client for 30 sec - exiting
 (28213): No heartbeat from core client for 30 sec - exiting
 (28213): No heartbeat from core client for 30 sec - exiting
 (28213): No heartbeat from core client for 30 sec - exiting
 (28213): No heartbeat from core client for 30 sec - exiting
 (28213): No heartbeat from core client for 30 sec - exiting
 (28213): No heartbeat from core client for 30 sec - exiting
 (28213): No heartbeat from core client for 30 sec - exiting
 (28213): No heartbeat from core client for 30 sec - exiting
 (28213): No heartbeat from core client for 30 sec - exiting
 (28213): No heartbeat from core client for 30 sec - exiting
 (28213): No heartbeat from core client for 30 sec - exiting
 (28213): No heartbeat from core client for 30 sec - exiting
 (28213): No heartbeat from core client for 30 sec - exiting
 (28213): No heartbeat from core client for 30 sec - exiting
 (28213): No heartbeat from core client for 30 sec - exiting
 (28213): No heartbeat from core client for 30 sec - exiting
 (28213): No heartbeat from core client for 30 sec - exiting
 (28213): No heartbeat from core client for 30 sec - exiting
 (28213): No heartbeat from core client for 30 sec - exiting
 (28213): No heartbeat from core client for 30 sec - exiting
 (28213): No heartbeat from core client for 30 sec - exiting
 (28213): No heartbeat from core client for 30 sec - exiting
 (32359): No heartbeat from core client for 30 sec - exiting
 (32359): No heartbeat from core client for 30 sec - exiting
 (32359): No heartbeat from core client for 30 sec - exiting
 (32359): No heartbeat from core client for 30 sec - exiting
 (32359): No heartbeat from core client for 30 sec - exiting
 (32359): No heartbeat from core client for 30 sec - exiting
 (32359): No heartbeat from core client for 30 sec - exiting
 (32359): No heartbeat from core client for 30 sec - exiting
 (32359): No heartbeat from core client for 30 sec - exiting
 (32359): No heartbeat from core client for 30 sec - exiting
 (32359): No heartbeat from core client for 30 sec - exiting
 (32359): No heartbeat from core client for 30 sec - exiting
 (32359): No heartbeat from core client for 30 sec - exiting
 (32359): No heartbeat from core client for 30 sec - exiting
 (32359): No heartbeat from core client for 30 sec - exiting
 (32359): No heartbeat from core client for 30 sec - exiting
 (32359): No heartbeat from core client for 30 sec - exiting
 (32359): No heartbeat from core client for 30 sec - exiting
 (32359): No heartbeat from core client for 30 sec - exiting
 (32359): No heartbeat from core client for 30 sec - exiting
 (32359): No heartbeat from core client for 30 sec - exiting
 (32359): No heartbeat from core client for 30 sec - exiting
 (32359): No heartbeat from core client for 30 sec - exiting
 (32359): No heartbeat from core client for 30 sec - exiting
 (32359): No heartbeat from core client for 30 sec - exiting
 (32359): No heartbeat from core client for 30 sec - exiting
 (32359): No heartbeat from core client for 30 sec - exiting
 (32359): No heartbeat from core client for 30 sec - exiting
 (32359): No heartbeat from core client for 30 sec - exiting
 (32359): No heartbeat from core client for 30 sec - exiting
 (32359): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
 (32421): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
 (32421): No heartbeat from core client for 30 sec - exiting
 (32421): No heartbeat from core client for 30 sec - exiting
 (32421): No heartbeat from core client for 30 sec - exiting
 (32421): No heartbeat from core client for 30 sec - exiting
 (32421): No heartbeat from core client for 30 sec - exiting
 (32421): No heartbeat from core client for 30 sec - exiting
 (32421): No heartbeat from core client for 30 sec - exiting
 (32421): No heartbeat from core client for 30 sec - exiting
 (32421): No heartbeat from core client for 30 sec - exiting
 (32421): No heartbeat from core client for 30 sec - exiting
 (32421): No heartbeat from core client for 30 sec - exiting
 (32421): No heartbeat from core client for 30 sec - exiting
 (32421): No heartbeat from core client for 30 sec - exiting
 (32421): No heartbeat from core client for 30 sec - exiting
 (32421): No heartbeat from core client for 30 sec - exiting
 (32421): No heartbeat from core client for 30 sec - exiting
 (32421): No heartbeat from core client for 30 sec - exiting
 (32421): No heartbeat from core client for 30 sec - exiting
 (32421): No heartbeat from core client for 30 sec - exiting
 (32421): No heartbeat from core client for 30 sec - exiting
 (32421): No heartbeat from core client for 30 sec - exiting
 (32421): No heartbeat from core client for 30 sec - exiting
 (32421): No heartbeat from core client for 30 sec - exiting
 (32421): No heartbeat from core client for 30 sec - exiting
 (32421): No heartbeat from core client for 30 sec - exiting
 (32421): No heartbeat from core client for 30 sec - exiting
 (32421): No heartbeat from core client for 30 sec - exiting
 (32421): No heartbeat from core client for 30 sec - exiting
 (32421): No heartbeat from core client for 30 sec - exiting
 (32421): No heartbeat from core client for 30 sec - exiting
 (32421): No heartbeat from core client for 30 sec - exiting
 (32421): No heartbeat from core client for 30 sec - exiting
 (32421): No heartbeat from core client for 30 sec - exiting
 (31287): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
 (31422): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
 (31422): No heartbeat from core client for 30 sec - exiting
 (31422): No heartbeat from core client for 30 sec - exiting
 (31422): No heartbeat from core client for 30 sec - exiting
 (1496): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
 (6702): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
 (6754): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
 (22345): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
 (28378): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
 (6943): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
 (26462): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
 (26525): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
 (6343): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
 (10244): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
 (10244): No heartbeat from core client for 30 sec - exiting
 (10244): No heartbeat from core client for 30 sec - exiting
 (10244): No heartbeat from core client for 30 sec - exiting
 (10244): No heartbeat from core client for 30 sec - exiting
 (10244): No heartbeat from core client for 30 sec - exiting
 (10244): No heartbeat from core client for 30 sec - exiting
 (10244): No heartbeat from core client for 30 sec - exiting
 (10244): No heartbeat from core client for 30 sec - exiting
 (10244): No heartbeat from core client for 30 sec - exiting
 (10244): No heartbeat from core client for 30 sec - exiting
 (10244): No heartbeat from core client for 30 sec - exiting
 (10244): No heartbeat from core client for 30 sec - exiting
 (10244): No heartbeat from core client for 30 sec - exiting
 (10244): No heartbeat from core client for 30 sec - exiting
 (10244): No heartbeat from core client for 30 sec - exiting
 (10244): No heartbeat from core client for 30 sec - exiting
 (10244): No heartbeat from core client for 30 sec - exiting
 (10244): No heartbeat from core client for 30 sec - exiting
 (10244): No heartbeat from core client for 30 sec - exiting
 (10244): No heartbeat from core client for 30 sec - exiting
 (10244): No heartbeat from core client for 30 sec - exiting
 (10244): No heartbeat from core client for 30 sec - exiting
 (10244): No heartbeat from core client for 30 sec - exiting
 (10244): No heartbeat from core client for 30 sec - exiting
 (10244): No heartbeat from core client for 30 sec - exiting
 (10244): No heartbeat from core client for 30 sec - exiting
 (10244): No heartbeat from core client for 30 sec - exiting
 (10244): No heartbeat from core client for 30 sec - exiting
 (10244): No heartbeat from core client for 30 sec - exiting
 (10244): No heartbeat from core client for 30 sec - exiting
 (10244): No heartbeat from core client for 30 sec - exiting
 (10244): No heartbeat from core client for 30 sec - exiting
 (10244): No heartbeat from core client for 30 sec - exiting
 (10244): No heartbeat from core client for 30 sec - exiting
 (10244): No heartbeat from core client for 30 sec - exiting
 (10244): No heartbeat from core client for 30 sec - exiting
 (10244): No heartbeat from core client for 30 sec - exiting
 (10244): No heartbeat from core client for 30 sec - exiting
 (10244): No heartbeat from core client for 30 sec - exiting
 (10244): No heartbeat from core client for 30 sec - exiting
 (10244): No heartbeat from core client for 30 sec - exiting
 (10244): No heartbeat from core client for 30 sec - exiting
 (10244): No heartbeat from core client for 30 sec - exiting
 (10244): No heartbeat from core client for 30 sec - exiting
 (10244): No heartbeat from core client for 30 sec - exiting
 (10244): No heartbeat from core client for 30 sec - exiting
 (10244): No heartbeat from core client for 30 sec - exiting
 (10244): No heartbeat from core client for 30 sec - exiting
 (10244): No heartbeat from core client for 30 sec - exiting
 (10244): No heartbeat from core client for 30 sec - exiting
 (10244): No heartbeat from core client for 30 sec - exiting
 (10244): No heartbeat from core client for 30 sec - exiting
 (10244): No heartbeat from core client for 30 sec - exiting
 (10244): No heartbeat from core client for 30 sec - exiting
 (10244): No heartbeat from core client for 30 sec - exiting
 (10244): No heartbeat from core client for 30 sec - exiting
 (10244): No heartbeat from core client for 30 sec - exiting
 (10244): No heartbeat from core client for 30 sec - exiting
 (10244): No heartbeat from core client for 30 sec - exiting
 (10244): No heartbeat from core client for 30 sec - exiting
 (10244): No heartbeat from core client for 30 sec - exiting
 (10244): No heartbeat from core client for 30 sec - exiting
 (10244): No heartbeat from core client for 30 sec - exiting
 (10244): No heartbeat from core client for 30 sec - exiting
 (10244): No heartbeat from core client for 30 sec - exiting
 (10244): No heartbeat from core client for 30 sec - exiting
 (29347): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
 (17650): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
 (26993): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
 (27082): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
 (29070): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
 (29145): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
 (15741): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
 (16810): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
 (17123): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
 (21784): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
 (11240): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
 (11762): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
 (26841): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
 (17044): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Signal 15 received, exiting...
 (25358): called boinc_finish
Signal 15 received, exiting...
 (25358): called boinc_finish
 (28677): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received, exiting...
Signal 15 received, exiting...
 (4369): called boinc_finish
Signal 15 received, exiting...
 (4369): called boinc_finish

Model crashed: P_TH_ADJ : NEGATIVE PRESSURE VALUE CREATED.                                                                                                                                                                                                                     tmp/pipe_dummy                                                                  

Model crashed: P_TH_ADJ : NEGATIVE PRESSURE VALUE CREATED.                                                                                                                                                                                                                     tmp/pipe_dummy                                                                  

Model crashed: P_TH_ADJ : NEGATIVE PRESSURE VALUE CREATED.                                                                                                                                                                                                                     tmp/pipe_dummy                                                                  

Model crashed: P_TH_ADJ : NEGATIVE PRESSURE VALUE CREATED.                                                                                                                                                                                                                     tmp/pipe_dummy                                                                  

Model crashed: P_TH_ADJ : NEGATIVE PRESSURE VALUE CREATED.                                                                                                                                                                                                                     tmp/pipe_dummy                                                                  

Model crashed: P_TH_ADJ : NEGATIVE PRESSURE VALUE CREATED.                                                                                                                                                                                                                     tmp/pipe_dummy                                                                  
Sorry, too many model crashes! :-(
 (3907): called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
22 Jul 2010 00:06:28 1021071 11589139 famous_r141_1599_200_006666713_1 982,826 1,629,551 1.6580
21 Jul 2010 19:39:37 1021071 11589139 famous_r141_1599_200_006666713_1 973,466 1,613,972 1.6580
21 Jul 2010 15:23:29 1021071 11589139 famous_r141_1599_200_006666713_1 964,106 1,598,389 1.6579
21 Jul 2010 11:28:11 1021071 11589139 famous_r141_1599_200_006666713_1 954,746 1,582,813 1.6578
21 Jul 2010 07:43:46 1021071 11589139 famous_r141_1599_200_006666713_1 945,386 1,567,223 1.6578
21 Jul 2010 02:20:07 1021071 11589139 famous_r141_1599_200_006666713_1 936,026 1,551,648 1.6577
19 Jul 2010 09:12:40 1021071 11589139 famous_r141_1599_200_006666713_1 926,666 1,536,072 1.6576
19 Jul 2010 04:52:29 1021071 11589139 famous_r141_1599_200_006666713_1 917,306 1,520,421 1.6575
19 Jul 2010 00:51:48 1021071 11589139 famous_r141_1599_200_006666713_1 907,946 1,504,732 1.6573
18 Jul 2010 20:09:16 1021071 11589139 famous_r141_1599_200_006666713_1 898,586 1,489,068 1.6571
18 Jul 2010 15:45:22 1021071 11589139 famous_r141_1599_200_006666713_1 889,226 1,473,391 1.6569
18 Jul 2010 11:24:26 1021071 11589139 famous_r141_1599_200_006666713_1 879,866 1,457,731 1.6568
18 Jul 2010 06:55:48 1021071 11589139 famous_r141_1599_200_006666713_1 870,506 1,442,057 1.6566
18 Jul 2010 02:40:03 1021071 11589139 famous_r141_1599_200_006666713_1 861,146 1,426,396 1.6564
17 Jul 2010 21:47:46 1021071 11589139 famous_r141_1599_200_006666713_1 851,786 1,410,811 1.6563
17 Jul 2010 12:02:33 1021071 11589139 famous_r141_1599_200_006666713_1 842,426 1,395,196 1.6562
17 Jul 2010 07:44:19 1021071 11589139 famous_r141_1599_200_006666713_1 833,066 1,379,587 1.6560
17 Jul 2010 03:34:54 1021071 11589139 famous_r141_1599_200_006666713_1 823,706 1,364,010 1.6559
17 Jul 2010 00:49:22 1021071 11589139 famous_r141_1599_200_006666713_1 814,346 1,348,472 1.6559
16 Jul 2010 18:35:11 1021071 11589139 famous_r141_1599_200_006666713_1 804,986 1,332,934 1.6558


©2024 climateprediction.net