Name | hadcm3n_o0so_2140_40_008269334_2 |
Workunit | 8424458 |
Created | 30 Jan 2013, 4:34:29 UTC |
Sent | 30 Jan 2013, 4:34:35 UTC |
Report deadline | 1 May 2013, 12:01:46 UTC |
Received | 21 Feb 2013, 23:07:11 UTC |
Server state | Over |
Outcome | Computation error |
Client state | Compute error |
Exit status | 22 (0x00000016) Unknown error code |
Computer ID | 1088829 |
Run time | 14 days 19 hours 13 min 7 sec |
CPU time | 6 days 4 hours 18 min 4 sec |
Validate state | Invalid |
Credit | 9,331.20 |
Device peak FLOPS | 3.05 GFLOPS |
Application version | UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86 |
Stderr | <core_client_version>6.10.58</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:54:58 (3552): No heartbeat from core client for 30 sec - exiting 18:54:59 (3552): No heartbeat from core client for 30 sec - exiting 18:55:00 (3552): No heartbeat from core client for 30 sec - exiting 18:55:01 (3552): No heartbeat from core client for 30 sec - exiting 18:55:02 (3552): No heartbeat from core client for 30 sec - exiting 18:55:04 (3552): No heartbeat from core client for 30 sec - exiting 18:55:05 (3552): No heartbeat from core client for 30 sec - exiting 18:55:06 (3552): No heartbeat from core client for 30 sec - exiting 18:55:07 (3552): No heartbeat from core client for 30 sec - exiting 18:55:08 (3552): No heartbeat from core client for 30 sec - exiting 18:55:09 (3552): No heartbeat from core client for 30 sec - exiting 18:55:10 (3552): No heartbeat from core client for 30 sec - exiting 18:55:11 (3552): No heartbeat from core client for 30 sec - exiting 18:55:12 (3552): No heartbeat from core client for 30 sec - exiting 18:55:13 (3552): No heartbeat from core client for 30 sec - exiting 18:55:14 (3552): No heartbeat from core client for 30 sec - exiting 18:55:16 (3552): No heartbeat from core client for 30 sec - exiting 18:55:17 (3552): No heartbeat from core client for 30 sec - exiting 18:55:18 (3552): No heartbeat from core client for 30 sec - exiting 18:55:19 (3552): No heartbeat from core client for 30 sec - exiting 18:55:20 (3552): No heartbeat from core client for 30 sec - exiting 18:55:21 (3552): No heartbeat from core client for 30 sec - exiting 18:55:22 (3552): No heartbeat from core client for 30 sec - exiting 18:55:23 (3552): No heartbeat from core client for 30 sec - exiting 18:55:24 (3552): No heartbeat from core client for 30 sec - exiting 18:55:25 (3552): No heartbeat from core client for 30 sec - exiting 18:55:26 (3552): No heartbeat from core client for 30 sec - exiting 18:55:28 (3552): No heartbeat from core client for 30 sec - exiting 18:55:29 (3552): No heartbeat from core client for 30 sec - exiting 18:55:30 (3552): No heartbeat from core client for 30 sec - exiting 18:55:31 (3552): No heartbeat from core client for 30 sec - exiting 18:55:32 (3552): No heartbeat from core client for 30 sec - exiting 18:55:33 (3552): No heartbeat from core client for 30 sec - exiting 18:55:34 (3552): No heartbeat from core client for 30 sec - exiting 18:55:35 (3552): No heartbeat from core client for 30 sec - exiting 18:55:36 (3552): No heartbeat from core client for 30 sec - exiting 18:55:37 (3552): No heartbeat from core client for 30 sec - exiting 18:55:38 (3552): No heartbeat from core client for 30 sec - exiting 18:55:40 (3552): No heartbeat from core client for 30 sec - exiting 18:55:41 (3552): No heartbeat from core client for 30 sec - exiting 18:55:42 (3552): No heartbeat from core client for 30 sec - exiting 18:55:43 (3552): No heartbeat from core client for 30 sec - exiting 18:55:44 (3552): No heartbeat from core client for 30 sec - exiting 18:55:45 (3552): No heartbeat from core client for 30 sec - exiting 18:55:46 (3552): No heartbeat from core client for 30 sec - exiting 18:55:47 (3552): No heartbeat from core client for 30 sec - exiting 18:55:48 (3552): No heartbeat from core client for 30 sec - exiting 18:55:49 (3552): No heartbeat from core client for 30 sec - exiting 18:55:51 (3552): No heartbeat from core client for 30 sec - exiting 18:55:52 (3552): No heartbeat from core client for 30 sec - exiting 18:55:53 (3552): No heartbeat from core client for 30 sec - exiting 18:55:54 (3552): No heartbeat from core client for 30 sec - exiting 18:55:55 (3552): No heartbeat from core client for 30 sec - exiting 18:55:56 (3552): No heartbeat from core client for 30 sec - exiting 18:55:57 (3552): No heartbeat from core client for 30 sec - exiting 18:55:58 (3552): No heartbeat from core client for 30 sec - exiting 18:55:59 (3552): No heartbeat from core client for 30 sec - exiting 18:56:00 (3552): No heartbeat from core client for 30 sec - exiting 18:56:01 (3552): No heartbeat from core client for 30 sec - exiting 18:56:03 (3552): No heartbeat from core client for 30 sec - exiting 18:56:04 (3552): No heartbeat from core client for 30 sec - exiting 18:56:05 (3552): No heartbeat from core client for 30 sec - exiting 18:56:06 (3552): No heartbeat from core client for 30 sec - exiting 18:56:07 (3552): No heartbeat from core client for 30 sec - exiting 18:56:08 (3552): No heartbeat from core client for 30 sec - exiting 18:56:09 (3552): No heartbeat from core client for 30 sec - exiting 18:56:10 (3552): No heartbeat from core client for 30 sec - exiting 18:56:11 (3552): No heartbeat from core client for 30 sec - exiting 18:56:12 (3552): No heartbeat from core client for 30 sec - exiting 18:56:13 (3552): No heartbeat from core client for 30 sec - exiting 18:56:15 (3552): No heartbeat from core client for 30 sec - exiting 18:56:16 (3552): No heartbeat from core client for 30 sec - exiting 18:56:17 (3552): No heartbeat from core client for 30 sec - exiting 18:56:18 (3552): No heartbeat from core client for 30 sec - exiting 18:56:19 (3552): No heartbeat from core client for 30 sec - exiting 18:56:20 (3552): No heartbeat from core client for 30 sec - exiting 18:56:21 (3552): No heartbeat from core client for 30 sec - exiting 18:56:22 (3552): No heartbeat from core client for 30 sec - exiting 18:56:23 (3552): No heartbeat from core client for 30 sec - exiting 18:56:24 (3552): No heartbeat from core client for 30 sec - exiting 18:56:25 (3552): No heartbeat from core client for 30 sec - exiting 18:56:27 (3552): No heartbeat from core client for 30 sec - exiting 18:56:28 (3552): No heartbeat from core client for 30 sec - exiting 18:56:29 (3552): No heartbeat from core client for 30 sec - exiting 18:56:30 (3552): No heartbeat from core client for 30 sec - exiting 18:56:31 (3552): No heartbeat from core client for 30 sec - exiting 18:56:32 (3552): No heartbeat from core client for 30 sec - exiting 18:56:33 (3552): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:00:09 (3400): No heartbeat from core client for 30 sec - exiting 19:00:10 (3400): No heartbeat from core client for 30 sec - exiting 19:00:11 (3400): No heartbeat from core client for 30 sec - exiting 19:00:12 (3400): No heartbeat from core client for 30 sec - exiting 19:00:13 (3400): No heartbeat from core client for 30 sec - exiting 19:00:14 (3400): No heartbeat from core client for 30 sec - exiting 19:00:16 (3400): No heartbeat from core client for 30 sec - exiting 19:00:17 (3400): No heartbeat from core client for 30 sec - exiting 19:00:18 (3400): No heartbeat from core client for 30 sec - exiting 19:00:19 (3400): No heartbeat from core client for 30 sec - exiting 19:00:20 (3400): No heartbeat from core client for 30 sec - exiting 19:00:21 (3400): No heartbeat from core client for 30 sec - exiting 19:00:22 (3400): No heartbeat from core client for 30 sec - exiting 19:00:23 (3400): No heartbeat from core client for 30 sec - exiting 19:00:24 (3400): No heartbeat from core client for 30 sec - exiting 19:00:25 (3400): No heartbeat from core client for 30 sec - exiting 19:00:26 (3400): No heartbeat from core client for 30 sec - exiting 19:00:28 (3400): No heartbeat from core client for 30 sec - exiting 19:00:29 (3400): No heartbeat from core client for 30 sec - exiting 19:00:30 (3400): No heartbeat from core client for 30 sec - exiting 19:00:31 (3400): No heartbeat from core client for 30 sec - exiting 19:00:32 (3400): No heartbeat from core client for 30 sec - exiting 19:00:33 (3400): No heartbeat from core client for 30 sec - exiting 19:00:34 (3400): No heartbeat from core client for 30 sec - exiting 19:00:35 (3400): No heartbeat from core client for 30 sec - exiting 19:00:36 (3400): No heartbeat from core client for 30 sec - exiting 19:00:38 (3400): No heartbeat from core client for 30 sec - exiting 19:00:39 (3400): No heartbeat from core client for 30 sec - exiting 19:00:40 (3400): No heartbeat from core client for 30 sec - exiting 19:00:41 (3400): No heartbeat from core client for 30 sec - exiting 19:00:42 (3400): No heartbeat from core client for 30 sec - exiting 19:00:43 (3400): No heartbeat from core client for 30 sec - exiting 19:00:44 (3400): No heartbeat from core client for 30 sec - exiting 19:00:45 (3400): No heartbeat from core client for 30 sec - exiting 19:00:46 (3400): No heartbeat from core client for 30 sec - exiting 19:00:47 (3400): No heartbeat from core client for 30 sec - exiting 19:00:48 (3400): No heartbeat from core client for 30 sec - exiting 19:00:50 (3400): No heartbeat from core client for 30 sec - exiting 19:00:51 (3400): No heartbeat from core client for 30 sec - exiting 19:00:52 (3400): No heartbeat from core client for 30 sec - exiting 19:00:53 (3400): No heartbeat from core client for 30 sec - exiting 19:00:54 (3400): No heartbeat from core client for 30 sec - exiting 19:00:55 (3400): No heartbeat from core client for 30 sec - exiting 19:00:56 (3400): No heartbeat from core client for 30 sec - exiting 19:00:57 (3400): No heartbeat from core client for 30 sec - exiting 19:00:58 (3400): No heartbeat from core client for 30 sec - exiting 19:00:59 (3400): No heartbeat from core client for 30 sec - exiting 19:01:01 (3400): No heartbeat from core client for 30 sec - exiting 19:01:02 (3400): No heartbeat from core client for 30 sec - exiting 19:01:03 (3400): No heartbeat from core client for 30 sec - exiting 19:01:04 (3400): No heartbeat from core client for 30 sec - exiting 19:01:05 (3400): No heartbeat from core client for 30 sec - exiting 19:01:06 (3400): No heartbeat from core client for 30 sec - exiting 19:01:07 (3400): No heartbeat from core client for 30 sec - exiting 19:01:08 (3400): No heartbeat from core client for 30 sec - exiting 19:01:09 (3400): No heartbeat from core client for 30 sec - exiting 19:01:10 (3400): No heartbeat from core client for 30 sec - exiting 19:01:11 (3400): No heartbeat from core client for 30 sec - exiting 19:01:13 (3400): No heartbeat from core client for 30 sec - exiting 19:01:14 (3400): No heartbeat from core client for 30 sec - exiting 19:01:15 (3400): No heartbeat from core client for 30 sec - exiting 19:01:16 (3400): No heartbeat from core client for 30 sec - exiting 19:01:17 (3400): No heartbeat from core client for 30 sec - exiting 19:01:18 (3400): No heartbeat from core client for 30 sec - exiting 19:01:19 (3400): No heartbeat from core client for 30 sec - exiting 19:01:20 (3400): No heartbeat from core client for 30 sec - exiting 19:01:21 (3400): No heartbeat from core client for 30 sec - exiting 19:01:22 (3400): No heartbeat from core client for 30 sec - exiting 19:01:23 (3400): No heartbeat from core client for 30 sec - exiting 19:01:25 (3400): No heartbeat from core client for 30 sec - exiting 19:01:26 (3400): No heartbeat from core client for 30 sec - exiting 19:01:27 (3400): No heartbeat from core client for 30 sec - exiting 19:01:28 (3400): No heartbeat from core client for 30 sec - exiting 19:01:29 (3400): No heartbeat from core client for 30 sec - exiting 19:01:30 (3400): No heartbeat from core client for 30 sec - exiting 19:01:31 (3400): No heartbeat from core client for 30 sec - exiting 19:01:32 (3400): No heartbeat from core client for 30 sec - exiting 19:01:33 (3400): No heartbeat from core client for 30 sec - exiting 19:01:34 (3400): No heartbeat from core client for 30 sec - exiting 19:01:36 (3400): No heartbeat from core client for 30 sec - exiting 19:01:37 (3400): No heartbeat from core client for 30 sec - exiting 19:01:38 (3400): No heartbeat from core client for 30 sec - exiting 19:01:39 (3400): No heartbeat from core client for 30 sec - exiting 19:01:40 (3400): No heartbeat from core client for 30 sec - exiting 19:01:41 (3400): No heartbeat from core client for 30 sec - exiting 19:01:42 (3400): No heartbeat from core client for 30 sec - exiting 19:01:43 (3400): No heartbeat from core client for 30 sec - exiting 19:01:44 (3400): No heartbeat from core client for 30 sec - exiting 19:01:45 (3400): No heartbeat from core client for 30 sec - exiting 19:01:46 (3400): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:29:23 (3856): No heartbeat from core client for 30 sec - exiting 03:29:25 (3856): No heartbeat from core client for 30 sec - exiting 03:29:26 (3856): No heartbeat from core client for 30 sec - exiting 03:29:27 (3856): No heartbeat from core client for 30 sec - exiting 03:29:28 (3856): No heartbeat from core client for 30 sec - exiting 03:29:29 (3856): No heartbeat from core client for 30 sec - exiting 03:29:30 (3856): No heartbeat from core client for 30 sec - exiting 03:29:31 (3856): No heartbeat from core client for 30 sec - exiting 03:29:32 (3856): No heartbeat from core client for 30 sec - exiting 03:29:33 (3856): No heartbeat from core client for 30 sec - exiting 03:29:34 (3856): No heartbeat from core client for 30 sec - exiting 03:29:36 (3856): No heartbeat from core client for 30 sec - exiting 03:29:37 (3856): No heartbeat from core client for 30 sec - exiting 03:29:38 (3856): No heartbeat from core client for 30 sec - exiting 03:29:39 (3856): No heartbeat from core client for 30 sec - exiting 03:29:40 (3856): No heartbeat from core client for 30 sec - exiting 03:29:41 (3856): No heartbeat from core client for 30 sec - exiting 03:29:42 (3856): No heartbeat from core client for 30 sec - exiting 03:29:43 (3856): No heartbeat from core client for 30 sec - exiting 03:29:44 (3856): No heartbeat from core client for 30 sec - exiting 03:29:45 (3856): No heartbeat from core client for 30 sec - exiting 03:29:46 (3856): No heartbeat from core client for 30 sec - exiting 03:29:48 (3856): No heartbeat from core client for 30 sec - exiting 03:29:49 (3856): No heartbeat from core client for 30 sec - exiting 03:29:50 (3856): No heartbeat from core client for 30 sec - exiting 03:29:51 (3856): No heartbeat from core client for 30 sec - exiting 03:29:52 (3856): No heartbeat from core client for 30 sec - exiting 03:29:53 (3856): No heartbeat from core client for 30 sec - exiting 03:29:54 (3856): No heartbeat from core client for 30 sec - exiting 03:29:55 (3856): No heartbeat from core client for 30 sec - exiting 03:29:56 (3856): No heartbeat from core client for 30 sec - exiting 03:29:57 (3856): No heartbeat from core client for 30 sec - exiting 03:29:58 (3856): No heartbeat from core client for 30 sec - exiting 03:30:00 (3856): No heartbeat from core client for 30 sec - exiting 03:30:01 (3856): No heartbeat from core client for 30 sec - exiting 03:30:02 (3856): No heartbeat from core client for 30 sec - exiting 03:30:03 (3856): No heartbeat from core client for 30 sec - exiting 03:30:04 (3856): No heartbeat from core client for 30 sec - exiting 03:30:05 (3856): No heartbeat from core client for 30 sec - exiting 03:30:06 (3856): No heartbeat from core client for 30 sec - exiting 03:30:07 (3856): No heartbeat from core client for 30 sec - exiting 03:30:08 (3856): No heartbeat from core client for 30 sec - exiting 03:30:09 (3856): No heartbeat from core client for 30 sec - exiting 03:30:10 (3856): No heartbeat from core client for 30 sec - exiting 03:30:12 (3856): No heartbeat from core client for 30 sec - exiting 03:30:13 (3856): No heartbeat from core client for 30 sec - exiting 03:30:14 (3856): No heartbeat from core client for 30 sec - exiting 03:30:15 (3856): No heartbeat from core client for 30 sec - exiting 03:30:16 (3856): No heartbeat from core client for 30 sec - exiting 03:30:17 (3856): No heartbeat from core client for 30 sec - exiting 03:30:18 (3856): No heartbeat from core client for 30 sec - exiting 03:30:19 (3856): No heartbeat from core client for 30 sec - exiting 03:30:20 (3856): No heartbeat from core client for 30 sec - exiting 03:30:21 (3856): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... MainError: 08:14:41 PM No files match the supplied pattern. MainError: 08:14:41 PM No files match the supplied pattern. Suspended CPDN Monitor - Suspend request from BOINC... MainError: 07:57:01 AM No files match the supplied pattern. MainError: 07:57:01 AM No files match the supplied pattern. MainError: 07:26:31 PM No files match the supplied pattern. MainError: 07:26:31 PM No files match the supplied pattern. MainError: 06:49:05 AM No files match the supplied pattern. MainError: 06:49:05 AM No files match the supplied pattern. MainError: 06:23:20 PM No files match the supplied pattern. MainError: 06:23:20 PM No files match the supplied pattern. MainError: 05:47:13 AM No files match the supplied pattern. MainError: 05:47:13 AM No files match the supplied pattern. MainError: 05:37:03 PM No files match the supplied pattern. MainError: 05:37:03 PM No files match the supplied pattern. MainError: 05:26:11 AM No files match the supplied pattern. MainError: 05:26:11 AM No files match the supplied pattern. MainError: 05:25:18 PM No files match the supplied pattern. MainError: 05:25:18 PM No files match the supplied pattern. MainError: 05:28:14 AM No files match the supplied pattern. MainError: 05:28:14 AM No files match the supplied pattern. Error converting file to netcdf: dataout/o0soka.ph11c10 Error converting file to netcdf: dataout/o0soka.pg11c10 Error converting file to netcdf: dataout/o0soka.pe11c10 MainError: 05:48:08 PM No files match the supplied pattern. MainError: 05:48:08 PM No files match the supplied pattern. BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]> |
Latest Trickles Received | ||||||
---|---|---|---|---|---|---|
Time Sent (UTC) | Host ID | Result ID | Result Name | Timestep | CPU Time (sec) | Average (sec/TS) |
21 Feb 2013 18:36:44 | 1088829 | 15561038 | hadcm3n_o0so_2140_40_008269334_2 | 777,600 | 1,223,310 | 1.5732 |
21 Feb 2013 05:28:57 | 1088829 | 15561038 | hadcm3n_o0so_2140_40_008269334_2 | 751,680 | 1,181,568 | 1.5719 |
20 Feb 2013 17:26:12 | 1088829 | 15561038 | hadcm3n_o0so_2140_40_008269334_2 | 725,760 | 1,140,170 | 1.5710 |
20 Feb 2013 05:27:24 | 1088829 | 15561038 | hadcm3n_o0so_2140_40_008269334_2 | 699,840 | 1,099,622 | 1.5712 |
19 Feb 2013 17:41:39 | 1088829 | 15561038 | hadcm3n_o0so_2140_40_008269334_2 | 673,920 | 1,059,093 | 1.5715 |
19 Feb 2013 05:47:37 | 1088829 | 15561038 | hadcm3n_o0so_2140_40_008269334_2 | 648,000 | 1,018,446 | 1.5717 |
18 Feb 2013 18:51:38 | 1088829 | 15561038 | hadcm3n_o0so_2140_40_008269334_2 | 622,080 | 978,790 | 1.5734 |
18 Feb 2013 06:52:54 | 1088829 | 15561038 | hadcm3n_o0so_2140_40_008269334_2 | 596,160 | 938,820 | 1.5748 |
17 Feb 2013 20:08:35 | 1088829 | 15561038 | hadcm3n_o0so_2140_40_008269334_2 | 570,240 | 898,927 | 1.5764 |
17 Feb 2013 08:26:55 | 1088829 | 15561038 | hadcm3n_o0so_2140_40_008269334_2 | 544,320 | 858,777 | 1.5777 |
16 Feb 2013 20:58:35 | 1088829 | 15561038 | hadcm3n_o0so_2140_40_008269334_2 | 518,400 | 818,164 | 1.5782 |
16 Feb 2013 09:34:08 | 1088829 | 15561038 | hadcm3n_o0so_2140_40_008269334_2 | 492,480 | 777,728 | 1.5792 |
15 Feb 2013 20:55:18 | 1088829 | 15561038 | hadcm3n_o0so_2140_40_008269334_2 | 466,560 | 737,114 | 1.5799 |
15 Feb 2013 09:22:15 | 1088829 | 15561038 | hadcm3n_o0so_2140_40_008269334_2 | 440,640 | 696,688 | 1.5811 |
14 Feb 2013 21:34:12 | 1088829 | 15561038 | hadcm3n_o0so_2140_40_008269334_2 | 414,720 | 656,066 | 1.5819 |
14 Feb 2013 10:00:58 | 1088829 | 15561038 | hadcm3n_o0so_2140_40_008269334_2 | 388,800 | 615,471 | 1.5830 |
13 Feb 2013 22:13:07 | 1088829 | 15561038 | hadcm3n_o0so_2140_40_008269334_2 | 362,880 | 574,891 | 1.5842 |
13 Feb 2013 11:21:53 | 1088829 | 15561038 | hadcm3n_o0so_2140_40_008269334_2 | 336,960 | 534,209 | 1.5854 |
12 Feb 2013 22:19:01 | 1088829 | 15561038 | hadcm3n_o0so_2140_40_008269334_2 | 311,040 | 492,596 | 1.5837 |
12 Feb 2013 11:00:07 | 1088829 | 15561038 | hadcm3n_o0so_2140_40_008269334_2 | 285,120 | 450,820 | 1.5812 |
©2024 cpdn.org