 |
|
| Name | hadcm3n_y9v1_1900_40_007345639_1 |
| Workunit | 7543069 |
| Created | 6 Jul 2011, 13:32:34 UTC |
| Sent | 20 Jul 2011, 6:07:52 UTC |
| Report deadline | 19 Oct 2011, 13:35:03 UTC |
| Received | 19 Aug 2011, 8:27:51 UTC |
| Server state | Over |
| Outcome | Computation error |
| Client state | Compute error |
| Exit status | 193 (0x000000C1) EXIT_SIGNAL |
| Computer ID | 1158007 |
| Run time | 10 days 8 hours 6 min 32 sec |
| CPU time | 9 days 22 hours 3 min 28 sec |
| Validate state | Invalid |
| Credit | 6,220.80 |
| Device peak FLOPS | 2.83 GFLOPS |
| Application version | UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu |
| Stderr | <core_client_version>6.10.58</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:19:22 (3418): No heartbeat from core client for 30 sec - exiting 08:19:23 (3418): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 Error: Input file: dataout/y9v1ko.pjb7c10 is not a valid UM file. Error converting file to netcdf: dataout/y9v1ko.pjb7c10 Error: Input file: dataout/y9v1ko.pib7c10 is not a valid UM file. Error converting file to netcdf: dataout/y9v1ko.pib7c10 Error: Input file: dataout/y9v1ko.pfb7c10 is not a valid UM file. Error converting file to netcdf: dataout/y9v1ko.pfb7c10 Error: Input file: dataout/y9v1ka.phb7c10 is not a valid UM file. Error converting file to netcdf: dataout/y9v1ka.phb7c10 Error: Input file: dataout/y9v1ka.pgb7c10 is not a valid UM file. Error converting file to netcdf: dataout/y9v1ka.pgb7c10 Error: Input file: dataout/y9v1ka.peb7c10 is not a valid UM file. Error converting file to netcdf: dataout/y9v1ka.peb7c10 Error: Input file: dataout/y9v1ka.pdb7c10 is not a valid UM file. Error converting file to netcdf: dataout/y9v1ka.pdb7c10 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08190c50 *** ======= Backtrace: ========= /lib/libc.so.6(+0x6de2b)[0xf74d7e2b] /lib/libc.so.6(+0x6ebab)[0xf74d8bab] /lib/libc.so.6(cfree+0x6d)[0xf74dca6d] /usr/lib/libstdc++.so.6(_ZdlPv+0x21)[0xf76ce6e1] /usr/lib/libstdc++.so.6(_ZdaPv+0x1d)[0xf76ce73d] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib/libc.so.6(__libc_start_main+0xfe)[0xf7480c2e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] ======= Memory map: ======== 08048000-080e3000 r-xp 00000000 fd:00 26575729 /home/czemella/BOINC/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e3000-080e4000 rwxp 0009b000 fd:00 26575729 /home/czemella/BOINC/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e4000-081a1000 rwxp 00000000 00:00 0 [heap] f6e00000-f6e21000 rwxp 00000000 00:00 0 f6e21000-f6f00000 ---p 00000000 00:00 0 f6fed000-f7468000 rwxs 00000000 fd:00 26583532 /home/czemella/BOINC/slots/4/135030 f7468000-f746a000 rwxp 00000000 00:00 0 f746a000-f75d0000 r-xp 00000000 fd:01 1381833 /lib/libc-2.11.3.so f75d0000-f75d1000 ---p 00166000 fd:01 1381833 /lib/libc-2.11.3.so f75d1000-f75d3000 r-xp 00166000 fd:01 1381833 /lib/libc-2.11.3.so f75d3000-f75d4000 rwxp 00168000 fd:01 1381833 /lib/libc-2.11.3.so f75d4000-f75d7000 rwxp 00000000 00:00 0 f75d7000-f75f3000 r-xp 00000000 fd:01 1381944 /lib/libgcc_s.so.1 f75f3000-f75f4000 r-xp 0001b000 fd:01 1381944 /lib/libgcc_s.so.1 f75f4000-f75f5000 rwxp 0001c000 fd:01 1381944 /lib/libgcc_s.so.1 f75f5000-f75f6000 rwxp 00000000 00:00 0 f75f6000-f761e000 r-xp 00000000 fd:01 1382034 /lib/libm-2.11.3.so f761e000-f761f000 r-xp 00027000 fd:01 1382034 /lib/libm-2.11.3.so f761f000-f7620000 rwxp 00028000 fd:01 1382034 /lib/libm-2.11.3.so f7620000-f7703000 r-xp 00000000 fd:01 608306 /usr/lib/libstdc++.so.6.0.14 f7703000-f7707000 r-xp 000e2000 fd:01 608306 /usr/lib/libstdc++.so.6.0.14 f7707000-f7708000 rwxp 000e6000 fd:01 608306 /usr/lib/libstdc++.so.6.0.14 f7708000-f770f000 rwxp 00000000 00:00 0 f770f000-f7712000 r-xp 00000000 fd:01 1382030 /lib/libdl-2.11.3.so f7712000-f7713000 r-xp 00002000 fd:01 1382030 /lib/libdl-2.11.3.so f7713000-f7714000 rwxp 00003000 fd:01 1382030 /lib/libdl-2.11.3.so f7714000-f772b000 r-xp 00000000 fd:01 1381830 /lib/libpthread-2.11.3.so f772b000-f772c000 r-xp 00016000 fd:01 1381830 /lib/libpthread-2.11.3.so f772c000-f772d000 rwxp 00017000 fd:01 1381830 /lib/libpthread-2.11.3.so f772d000-f772f000 rwxp 00000000 00:00 0 f7755000-f7756000 rwxp 00000000 00:00 0 f7756000-f7757000 ---p 00000000 00:00 0 f7757000-f775a000 rwxp 00000000 00:00 0 f775a000-f775c000 rwxs 00000000 fd:00 26583602 /home/czemella/BOINC/slots/4/boinc_mmap_file f775c000-f775d000 rwxp 00000000 00:00 0 f775d000-f777c000 r-xp 00000000 fd:01 1381838 /lib/ld-2.11.3.so f777c000-f777d000 r-xp 0001e000 fd:01 1381838 /lib/ld-2.11.3.so f777d000-f777e000 rwxp 0001f000 fd:01 1381838 /lib/ld-2.11.3.so ffa60000-ffad0000 rw-p 00000000 00:00 0 [stack] ffffe000-fffff000 r-xp 00000000 00:00 0 [vdso] SIGABRT: abort called Stack trace (19 frames): ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df] [0xffffe400] [0xffffe430] /lib/libc.so.6(gsignal+0x4f)[0xf74958df] /lib/libc.so.6(abort+0x180)[0xf7497220] /lib/libc.so.6(+0x67e07)[0xf74d1e07] /lib/libc.so.6(+0x6de2b)[0xf74d7e2b] /lib/libc.so.6(+0x6ebab)[0xf74d8bab] /lib/libc.so.6(cfree+0x6d)[0xf74dca6d] /usr/lib/libstdc++.so.6(_ZdlPv+0x21)[0xf76ce6e1] /usr/lib/libstdc++.so.6(_ZdaPv+0x1d)[0xf76ce73d] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib/libc.so.6(__libc_start_main+0xfe)[0xf7480c2e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] Exiting... </stderr_txt> ]]> |
| Latest Trickles Received | ||||||
|---|---|---|---|---|---|---|
| Time Sent (UTC) | Host ID | Result ID | Result Name | Timestep | CPU Time (sec) | Average (sec/TS) |
| 19 Aug 2011 08:28:27 | 1158007 | 13095144 | hadcm3n_y9v1_1900_40_007345639_1 | 518,400 | 857,005 | 1.6532 |
| 18 Aug 2011 12:21:46 | 1158007 | 13095144 | hadcm3n_y9v1_1900_40_007345639_1 | 492,480 | 814,123 | 1.6531 |
| 17 Aug 2011 13:36:34 | 1158007 | 13095144 | hadcm3n_y9v1_1900_40_007345639_1 | 466,560 | 771,061 | 1.6527 |
| 07 Aug 2011 15:11:36 | 1158007 | 13095144 | hadcm3n_y9v1_1900_40_007345639_1 | 440,640 | 728,052 | 1.6523 |
| 04 Aug 2011 11:10:15 | 1158007 | 13095144 | hadcm3n_y9v1_1900_40_007345639_1 | 414,720 | 685,078 | 1.6519 |
| 03 Aug 2011 11:34:35 | 1158007 | 13095144 | hadcm3n_y9v1_1900_40_007345639_1 | 388,800 | 642,170 | 1.6517 |
| 02 Aug 2011 15:14:25 | 1158007 | 13095144 | hadcm3n_y9v1_1900_40_007345639_1 | 362,880 | 599,419 | 1.6518 |
| 01 Aug 2011 13:45:20 | 1158007 | 13095144 | hadcm3n_y9v1_1900_40_007345639_1 | 336,960 | 556,759 | 1.6523 |
| 31 Jul 2011 23:23:04 | 1158007 | 13095144 | hadcm3n_y9v1_1900_40_007345639_1 | 311,040 | 514,350 | 1.6536 |
| 31 Jul 2011 06:09:37 | 1158007 | 13095144 | hadcm3n_y9v1_1900_40_007345639_1 | 285,120 | 471,946 | 1.6553 |
| 30 Jul 2011 17:42:02 | 1158007 | 13095144 | hadcm3n_y9v1_1900_40_007345639_1 | 259,200 | 429,447 | 1.6568 |
| 29 Jul 2011 18:09:40 | 1158007 | 13095144 | hadcm3n_y9v1_1900_40_007345639_1 | 233,280 | 387,019 | 1.6590 |
| 29 Jul 2011 01:52:52 | 1158007 | 13095144 | hadcm3n_y9v1_1900_40_007345639_1 | 207,360 | 344,167 | 1.6598 |
| 28 Jul 2011 12:07:54 | 1158007 | 13095144 | hadcm3n_y9v1_1900_40_007345639_1 | 181,440 | 301,083 | 1.6594 |
| 27 Jul 2011 16:14:49 | 1158007 | 13095144 | hadcm3n_y9v1_1900_40_007345639_1 | 155,520 | 258,102 | 1.6596 |
| 26 Jul 2011 16:56:57 | 1158007 | 13095144 | hadcm3n_y9v1_1900_40_007345639_1 | 129,600 | 215,289 | 1.6612 |
| 26 Jul 2011 02:31:34 | 1158007 | 13095144 | hadcm3n_y9v1_1900_40_007345639_1 | 103,680 | 172,564 | 1.6644 |
| 25 Jul 2011 22:58:23 | 1158007 | 13095144 | hadcm3n_y9v1_1900_40_007345639_1 | 77,760 | 129,237 | 1.6620 |
| 25 Jul 2011 22:49:35 | 1158007 | 13095144 | hadcm3n_y9v1_1900_40_007345639_1 | 51,840 | 85,675 | 1.6527 |
| 25 Jul 2011 22:49:15 | 1158007 | 13095144 | hadcm3n_y9v1_1900_40_007345639_1 | 25,920 | 42,848 | 1.6531 |
©2024 cpdn.org