 |
|
| Name | hadcm3n_n2wo_1880_40_008284544_1 |
| Workunit | 8435679 |
| Created | 8 Feb 2013, 15:25:02 UTC |
| Sent | 8 Feb 2013, 15:29:56 UTC |
| Report deadline | 10 May 2013, 22:57:07 UTC |
| Received | 21 Mar 2013, 11:13:54 UTC |
| Server state | Over |
| Outcome | Computation error |
| Client state | Compute error |
| Exit status | 193 (0x000000C1) EXIT_SIGNAL |
| Computer ID | 1157585 |
| Run time | 10 days 17 hours 22 min |
| CPU time | 10 days 4 hours 55 min 3 sec |
| Validate state | Invalid |
| Credit | 6,220.80 |
| Device peak FLOPS | 2.02 GFLOPS |
| Application version | UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu |
| Stderr | <core_client_version>7.0.28</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:16:34 (20008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 1 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 1 received, exiting... Called boinc_finish 19:07:17 (25872): No heartbeat from core client for 30 sec - exiting 19:07:21 (25872): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... OPEN: File Creation Failed: Too many open files in system OPEN: Unable to Open File dataout/n2woko.da88950 for Read/Write Model crashed: DUMPCTL : Fail to open output dump - may already exist tmp/pipe_dummy 2048 cpdnmonitor: cannot open input file /home/naoto/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so after 11 attempts 06:16:25 (12846): No heartbeat from core client for 30 sec - exiting 06:16:26 (12846): No heartbeat from core client for 30 sec - exiting 06:16:27 (12846): No heartbeat from core client for 30 sec - exiting 06:16:28 (12846): No heartbeat from core client for 30 sec - exiting 06:16:29 (12846): No heartbeat from core client for 30 sec - exiting 06:16:30 (12846): No heartbeat from core client for 30 sec - exiting 06:16:31 (12846): No heartbeat from core client for 30 sec - exiting cpdnmonitor: cannot open input file /home/naoto/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu after 11 attempts 06:16:32 (12846): No heartbeat from core client for 30 sec - exiting 06:16:33 (12846): No heartbeat from core client for 30 sec - exiting 06:16:34 (12846): No heartbeat from core client for 30 sec - exiting 06:16:35 (12846): No heartbeat from core client for 30 sec - exiting 06:16:36 (12846): No heartbeat from core client for 30 sec - exiting 06:16:37 (12846): No heartbeat from core client for 30 sec - exiting 06:16:38 (12846): No heartbeat from core client for 30 sec - exiting 06:16:39 (12846): No heartbeat from core client for 30 sec - exiting 06:16:40 (12846): No heartbeat from core client for 30 sec - exiting 06:16:41 (12846): No heartbeat from core client for 30 sec - exiting 06:16:42 (12846): No heartbeat from core client for 30 sec - exiting 06:16:43 (12846): No heartbeat from core client for 30 sec - exiting 06:16:44 (12846): No heartbeat from core client for 30 sec - exiting 06:16:45 (12846): No heartbeat from core client for 30 sec - exiting 06:16:46 (12846): No heartbeat from core client for 30 sec - exiting 06:16:47 (12846): No heartbeat from core client for 30 sec - exiting 06:16:48 (12846): No heartbeat from core client for 30 sec - exiting 06:16:49 (12846): No heartbeat from core client for 30 sec - exiting 06:16:50 (12846): No heartbeat from core client for 30 sec - exiting 06:16:51 (12846): No heartbeat from core client for 30 sec - exiting 06:16:52 (12846): No heartbeat from core client for 30 sec - exiting 06:16:53 (12846): No heartbeat from core client for 30 sec - exiting 06:16:54 (12846): No heartbeat from core client for 30 sec - exiting 06:16:55 (12846): No heartbeat from core client for 30 sec - exiting 06:16:56 (12846): No heartbeat from core client for 30 sec - exiting 06:16:57 (12846): No heartbeat from core client for 30 sec - exiting cpdnmonitor: cannot open input file /home/naoto/BOINC/projects/climateprediction.net/hadcm3n_n2wo_1880_40_008284544/jobs/xabnk.ihist after 11 attempts 06:16:58 (12846): No heartbeat from core client for 30 sec - exiting 06:16:59 (12846): No heartbeat from core client for 30 sec - exiting 06:17:00 (12846): No heartbeat from core client for 30 sec - exiting 06:17:01 (12846): No heartbeat from core client for 30 sec - exiting 06:17:02 (12846): No heartbeat from core client for 30 sec - exiting 06:17:03 (12846): No heartbeat from core client for 30 sec - exiting 06:17:04 (12846): No heartbeat from core client for 30 sec - exiting 06:17:05 (12846): No heartbeat from core client for 30 sec - exiting 06:17:06 (12846): No heartbeat from core client for 30 sec - exiting 06:17:07 (12846): No heartbeat from core client for 30 sec - exiting 06:17:08 (12846): No heartbeat from core client for 30 sec - exiting 06:17:09 (12846): No heartbeat from core client for 30 sec - exiting 06:17:10 (12846): No heartbeat from core client for 30 sec - exiting 06:17:11 (12846): No heartbeat from core client for 30 sec - exiting 06:17:12 (12846): No heartbeat from core client for 30 sec - exiting 06:17:13 (12846): No heartbeat from core client for 30 sec - exiting 06:17:14 (12846): No heartbeat from core client for 30 sec - exiting 06:17:15 (12846): No heartbeat from core client for 30 sec - exiting 06:17:16 (12846): No heartbeat from core client for 30 sec - exiting 06:17:17 (12846): No heartbeat from core client for 30 sec - exiting 06:17:18 (12846): No heartbeat from core client for 30 sec - exiting 06:17:19 (12846): No heartbeat from core client for 30 sec - exiting 06:17:20 (12846): No heartbeat from core client for 30 sec - exiting 06:17:21 (12846): No heartbeat from core client for 30 sec - exiting 06:17:22 (12846): No heartbeat from core client for 30 sec - exiting 06:17:23 (12846): No heartbeat from core client for 30 sec - exiting 06:17:24 (12846): No heartbeat from core client for 30 sec - exiting 06:17:25 (12846): No heartbeat from core client for 30 sec - exiting 06:17:26 (12846): No heartbeat from core client for 30 sec - exiting 06:17:27 (12846): No heartbeat from core client for 30 sec - exiting cpdnmonitor: cannot open input file /home/naoto/BOINC/projects/climateprediction.net/hadcm3n_n2wo_1880_40_008284544/jobs/xabnk.namelists after 11 attempts 06:17:28 (12846): No heartbeat from core client for 30 sec - exiting 06:17:29 (12846): No heartbeat from core client for 30 sec - exiting 06:17:30 (12846): No heartbeat from core client for 30 sec - exiting 06:17:31 (12846): No heartbeat from core client for 30 sec - exiting 06:17:32 (12846): No heartbeat from core client for 30 sec - exiting 06:17:33 (12846): No heartbeat from core client for 30 sec - exiting 06:17:34 (12846): No heartbeat from core client for 30 sec - exiting 06:17:35 (12846): No heartbeat from core client for 30 sec - exiting 06:17:36 (12846): No heartbeat from core client for 30 sec - exiting 06:17:37 (12846): No heartbeat from core client for 30 sec - exiting 06:17:38 (12846): No heartbeat from core client for 30 sec - exiting 06:17:39 (12846): No heartbeat from core client for 30 sec - exiting 06:17:40 (12846): No heartbeat from core client for 30 sec - exiting 06:17:41 (12846): No heartbeat from core client for 30 sec - exiting 06:17:42 (12846): No heartbeat from core client for 30 sec - exiting 06:17:43 (12846): No heartbeat from core client for 30 sec - exiting 06:17:44 (12846): No heartbeat from core client for 30 sec - exiting 06:17:45 (12846): No heartbeat from core client for 30 sec - exiting 06:17:46 (12846): No heartbeat from core client for 30 sec - exiting 06:17:47 (12846): No heartbeat from core client for 30 sec - exiting 06:17:48 (12846): No heartbeat from core client for 30 sec - exiting 06:17:49 (12846): No heartbeat from core client for 30 sec - exiting 06:17:50 (12846): No heartbeat from core client for 30 sec - exiting 06:17:51 (12846): No heartbeat from core client for 30 sec - exiting 06:17:52 (12846): No heartbeat from core client for 30 sec - exiting 06:17:53 (12846): No heartbeat from core client for 30 sec - exiting cpdnmonitor: cannot open input file /home/naoto/BOINC/projects/climateprediction.net/hadcm3n_n2wo_1880_40_008284544/dataout/atmos_restart.day after 11 attempts 06:17:54 (12846): No heartbeat from core client for 30 sec - exiting 06:17:55 (12846): No heartbeat from core client for 30 sec - exiting 06:17:56 (12846): No heartbeat from core client for 30 sec - exiting 06:17:57 (12846): No heartbeat from core client for 30 sec - exiting 06:17:58 (12846): No heartbeat from core client for 30 sec - exiting 06:17:59 (12846): No heartbeat from core client for 30 sec - exiting 06:18:00 (12846): No heartbeat from core client for 30 sec - exiting 06:18:01 (12846): No heartbeat from core client for 30 sec - exiting 06:18:02 (12846): No heartbeat from core client for 30 sec - exiting 06:18:03 (12846): No heartbeat from core client for 30 sec - exiting 06:18:04 (12846): No heartbeat from core client for 30 sec - exiting 06:18:05 (12846): No heartbeat from core client for 30 sec - exiting 06:18:06 (12846): No heartbeat from core client for 30 sec - exiting 06:18:07 (12846): No heartbeat from core client for 30 sec - exiting 06:18:08 (12846): No heartbeat from core client for 30 sec - exiting 06:18:09 (12846): No heartbeat from core client for 30 sec - exiting 06:18:10 (12846): No heartbeat from core client for 30 sec - exiting 06:18:11 (12846): No heartbeat from core client for 30 sec - exiting 06:18:12 (12846): No heartbeat from core client for 30 sec - exiting 06:18:13 (12846): No heartbeat from core client for 30 sec - exiting 06:18:14 (12846): No heartbeat from core client for 30 sec - exiting 06:18:15 (12846): No heartbeat from core client for 30 sec - exiting 06:18:16 (12846): No heartbeat from core client for 30 sec - exiting 06:18:17 (12846): No heartbeat from core client for 30 sec - exiting 06:18:18 (12846): No heartbeat from core client for 30 sec - exiting 06:18:19 (12846): No heartbeat from core client for 30 sec - exiting 06:18:20 (12846): No heartbeat from core client for 30 sec - exiting 06:18:21 (12846): No heartbeat from core client for 30 sec - exiting 06:18:22 (12846): No heartbeat from core client for 30 sec - exiting cpdnmonitor: cannot open input file /home/naoto/BOINC/projects/climateprediction.net/hadcm3n_n2wo_1880_40_008284544/dataout/ocean_restart.day after 11 attempts 06:18:23 (12846): No heartbeat from core client for 30 sec - exiting 06:18:24 (12846): No heartbeat from core client for 30 sec - exiting SIGSEGV: segmentation violation Stack trace (13 frames): ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df] linux-gate.so.1(__kernel_sigreturn+0x0)[0xb7772400] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x80bc527] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x80bc8df] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x80bc9a9] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x80bcbdf] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x80b4126] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x80b0ff7] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x80507a4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8051127] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib/libc.so.6(__libc_start_main+0xf5)[0xb745e3d5] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] Exiting... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 1 received, exiting... Called boinc_finish SIGSEGV: segmentation violation Stack trace (10 frames): ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df] linux-gate.so.1(__kernel_sigreturn+0x0)[0xb7708400] /lib/libc.so.6(getenv+0x6a)[0xb740b9da] /lib/libc.so.6(+0xa415a)[0xb747f15a] /lib/libc.so.6(+0xa44eb)[0xb747f4eb] /lib/libc.so.6(localtime_r+0x2b)[0xb747dbbb] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x80b0d9c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x80b2dc4] /lib/libpthread.so.0(+0x6e32)[0xb76c3e32] /lib/libc.so.6(clone+0x5e)[0xb74c57ee] Exiting... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... OPEN: File Creation Failed: Too many open files in system OPEN: Unable to Open File dataout/n2woko.da983u0 for Read/Write Model crashed: DUMPCTL : Fail to open output dump - may already exist tmp/pipe_dummy 2048 cpdnmonitor: cannot open input file /home/naoto/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so after 11 attempts Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... OPEN: File Creation Failed: Too many open files in system OPEN: Unable to Open File dataout/n2woko.da99540 for Read/Write Model crashed: DUMPCTL : Fail to open output dump - may already exist tmp/pipe_dummy 2048 cpdnmonitor: cannot open input file /home/naoto/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so after 11 attempts cpdnmonitor: cannot open input file /home/naoto/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu after 11 attempts Signal 1 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... SIGSEGV: segmentation violation Stack trace (14 frames): ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df] linux-gate.so.1(__kernel_sigreturn+0x0)[0xb77c4400] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x806c0d5] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x806e5f2] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8072509] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8077f47] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x80781a3] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e1b] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib/libc.so.6(__libc_start_main+0xf5)[0xb74b03d5] Exiting... </stderr_txt> ]]> |
| Latest Trickles Received | ||||||
|---|---|---|---|---|---|---|
| Time Sent (UTC) | Host ID | Result ID | Result Name | Timestep | CPU Time (sec) | Average (sec/TS) |
| 21 Mar 2013 11:14:50 | 1157585 | 15601188 | hadcm3n_n2wo_1880_40_008284544_1 | 518,400 | 881,702 | 1.7008 |
| 20 Mar 2013 13:20:04 | 1157585 | 15601188 | hadcm3n_n2wo_1880_40_008284544_1 | 492,480 | 835,392 | 1.6963 |
| 19 Mar 2013 08:23:57 | 1157585 | 15601188 | hadcm3n_n2wo_1880_40_008284544_1 | 466,560 | 788,785 | 1.6906 |
| 17 Mar 2013 10:59:29 | 1157585 | 15601188 | hadcm3n_n2wo_1880_40_008284544_1 | 440,640 | 776,023 | 1.7611 |
| 16 Mar 2013 06:32:29 | 1157585 | 15601188 | hadcm3n_n2wo_1880_40_008284544_1 | 414,720 | 729,359 | 1.7587 |
| 13 Mar 2013 02:38:24 | 1157585 | 15601188 | hadcm3n_n2wo_1880_40_008284544_1 | 388,800 | 682,888 | 1.7564 |
| 11 Mar 2013 09:53:33 | 1157585 | 15601188 | hadcm3n_n2wo_1880_40_008284544_1 | 362,880 | 636,370 | 1.7537 |
| 10 Mar 2013 20:53:02 | 1157585 | 15601188 | hadcm3n_n2wo_1880_40_008284544_1 | 336,960 | 589,920 | 1.7507 |
| 08 Mar 2013 06:25:47 | 1157585 | 15601188 | hadcm3n_n2wo_1880_40_008284544_1 | 311,040 | 543,229 | 1.7465 |
| 05 Mar 2013 12:41:55 | 1157585 | 15601188 | hadcm3n_n2wo_1880_40_008284544_1 | 285,120 | 497,179 | 1.7438 |
| 02 Mar 2013 22:13:00 | 1157585 | 15601188 | hadcm3n_n2wo_1880_40_008284544_1 | 259,200 | 451,865 | 1.7433 |
| 28 Feb 2013 06:22:09 | 1157585 | 15601188 | hadcm3n_n2wo_1880_40_008284544_1 | 233,280 | 406,589 | 1.7429 |
| 26 Feb 2013 02:23:10 | 1157585 | 15601188 | hadcm3n_n2wo_1880_40_008284544_1 | 207,360 | 361,484 | 1.7433 |
| 24 Feb 2013 09:50:49 | 1157585 | 15601188 | hadcm3n_n2wo_1880_40_008284544_1 | 181,440 | 316,278 | 1.7432 |
| 22 Feb 2013 09:52:13 | 1157585 | 15601188 | hadcm3n_n2wo_1880_40_008284544_1 | 155,520 | 271,182 | 1.7437 |
| 19 Feb 2013 05:42:35 | 1157585 | 15601188 | hadcm3n_n2wo_1880_40_008284544_1 | 129,600 | 226,062 | 1.7443 |
| 16 Feb 2013 07:43:43 | 1157585 | 15601188 | hadcm3n_n2wo_1880_40_008284544_1 | 103,680 | 180,898 | 1.7448 |
| 14 Feb 2013 10:16:01 | 1157585 | 15601188 | hadcm3n_n2wo_1880_40_008284544_1 | 77,760 | 135,707 | 1.7452 |
| 13 Feb 2013 01:14:47 | 1157585 | 15601188 | hadcm3n_n2wo_1880_40_008284544_1 | 51,840 | 90,536 | 1.7465 |
| 11 Feb 2013 18:41:51 | 1157585 | 15601188 | hadcm3n_n2wo_1880_40_008284544_1 | 25,920 | 45,327 | 1.7487 |
©2024 climateprediction.net