 |
|
| Name | hadcm3n_t4xs_1940_40_007315919_1 |
| Workunit | 7513349 |
| Created | 29 Jun 2011, 0:06:08 UTC |
| Sent | 29 Jun 2011, 0:10:49 UTC |
| Report deadline | 28 Sep 2011, 7:38:00 UTC |
| Received | 23 Jul 2011, 1:26:57 UTC |
| Server state | Over |
| Outcome | Computation error |
| Client state | Compute error |
| Exit status | 193 (0x000000C1) EXIT_SIGNAL |
| Computer ID | 1148385 |
| Run time | 22 days 6 hours 6 min 27 sec |
| CPU time | 20 days 17 hours 38 min 9 sec |
| Validate state | Invalid |
| Credit | 6,220.80 |
| Device peak FLOPS | 1.61 GFLOPS |
| Application version | UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu |
| Stderr | <core_client_version>6.10.17</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:36:51 (7376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (!prev): 0x093e2640 *** ======= Backtrace: ========= /lib32/libc.so.6(+0x6c231)[0xf74ed231] /lib32/libc.so.6(+0x6dab8)[0xf74eeab8] /lib32/libc.so.6(cfree+0x6d)[0xf74f1b9d] /usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf76dba91] /usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf76dbaed] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib32/libc.so.6(__libc_start_main+0xe6)[0xf7497bd6] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] ======= Memory map: ======== 08048000-080e3000 r-xp 00000000 08:01 5374052 /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e3000-080e4000 rw-p 0009b000 08:01 5374052 /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e4000-0813b000 rw-p 00000000 00:00 0 0931e000-0941e000 rw-p 00000000 00:00 0 [heap] f6f00000-f6f21000 rw-p 00000000 00:00 0 f6f21000-f7000000 ---p 00000000 00:00 0 f7004000-f747f000 rw-s 00000000 08:01 8323317 /var/lib/boinc-client/slots/5/138385 f747f000-f7481000 rw-p 00000000 00:00 0 f7481000-f75d4000 r-xp 00000000 08:01 3300 /lib32/libc-2.11.1.so f75d4000-f75d5000 ---p 00153000 08:01 3300 /lib32/libc-2.11.1.so f75d5000-f75d7000 r--p 00153000 08:01 3300 /lib32/libc-2.11.1.so f75d7000-f75d8000 rw-p 00155000 08:01 3300 /lib32/libc-2.11.1.so f75d8000-f75db000 rw-p 00000000 00:00 0 f75db000-f75f8000 r-xp 00000000 08:01 9429000 /usr/lib32/libgcc_s.so.1 f75f8000-f75f9000 r--p 0001c000 08:01 9429000 /usr/lib32/libgcc_s.so.1 f75f9000-f75fa000 rw-p 0001d000 08:01 9429000 /usr/lib32/libgcc_s.so.1 f75fa000-f761e000 r-xp 00000000 08:01 3304 /lib32/libm-2.11.1.so f761e000-f761f000 r--p 00023000 08:01 3304 /lib32/libm-2.11.1.so f761f000-f7620000 rw-p 00024000 08:01 3304 /lib32/libm-2.11.1.so f7620000-f7709000 r-xp 00000000 08:01 9428998 /usr/lib32/libstdc++.so.6.0.13 f7709000-f770a000 ---p 000e9000 08:01 9428998 /usr/lib32/libstdc++.so.6.0.13 f770a000-f770e000 r--p 000e9000 08:01 9428998 /usr/lib32/libstdc++.so.6.0.13 f770e000-f770f000 rw-p 000ed000 08:01 9428998 /usr/lib32/libstdc++.so.6.0.13 f770f000-f7716000 rw-p 00000000 00:00 0 f7716000-f7718000 r-xp 00000000 08:01 3303 /lib32/libdl-2.11.1.so f7718000-f7719000 r--p 00001000 08:01 3303 /lib32/libdl-2.11.1.so f7719000-f771a000 rw-p 00002000 08:01 3303 /lib32/libdl-2.11.1.so f771a000-f771b000 rw-p 00000000 00:00 0 f771b000-f7730000 r-xp 00000000 08:01 3314 /lib32/libpthread-2.11.1.so f7730000-f7731000 r--p 00014000 08:01 3314 /lib32/libpthread-2.11.1.so f7731000-f7732000 rw-p 00015000 08:01 3314 /lib32/libpthread-2.11.1.so f7732000-f7734000 rw-p 00000000 00:00 0 f7748000-f7749000 rw-p 00000000 00:00 0 f7749000-f774a000 ---p 00000000 00:00 0 f774a000-f774d000 rw-p 00000000 00:00 0 f774d000-f774f000 rw-s 00000000 08:01 8323311 /var/lib/boinc-client/slots/5/boinc_mmap_file f774f000-f7751000 rw-p 00000000 00:00 0 f7751000-f7752000 r-xp 00000000 00:00 0 [vdso] f7752000-f776e000 r-xp 00000000 08:01 3295 /lib32/ld-2.11.1.so f776e000-f776f000 r--p 0001b000 08:01 3295 /lib32/ld-2.11.1.so f776f000-f7770000 rw-p 0001c000 08:01 3295 /lib32/ld-2.11.1.so ff8bf000-ff92e000 rw-p 00000000 00:00 0 [stack] SIGABRT: abort called Stack trace (19 frames): ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df] [0xf7751400] [0xf7751425] /lib32/libc.so.6(gsignal+0x51)[0xf74ab921] /lib32/libc.so.6(abort+0x182)[0xf74aed52] /lib32/libc.so.6(+0x6213d)[0xf74e313d] /lib32/libc.so.6(+0x6c231)[0xf74ed231] /lib32/libc.so.6(+0x6dab8)[0xf74eeab8] /lib32/libc.so.6(cfree+0x6d)[0xf74f1b9d] /usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf76dba91] /usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf76dbaed] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib32/libc.so.6(__libc_start_main+0xe6)[0xf7497bd6] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] Exiting... </stderr_txt> ]]> |
| Latest Trickles Received | ||||||
|---|---|---|---|---|---|---|
| Time Sent (UTC) | Host ID | Result ID | Result Name | Timestep | CPU Time (sec) | Average (sec/TS) |
| 25 Jul 2011 20:22:11 | 1148385 | 13024961 | hadcm3n_t4xs_1940_40_007315919_1 | 518,400 | 1,791,481 | 3.4558 |
| 25 Jul 2011 19:27:22 | 1148385 | 13024961 | hadcm3n_t4xs_1940_40_007315919_1 | 492,480 | 1,702,430 | 3.4569 |
| 25 Jul 2011 18:57:30 | 1148385 | 13024961 | hadcm3n_t4xs_1940_40_007315919_1 | 466,560 | 1,613,659 | 3.4586 |
| 25 Jul 2011 18:01:15 | 1148385 | 13024961 | hadcm3n_t4xs_1940_40_007315919_1 | 440,640 | 1,525,067 | 3.4610 |
| 25 Jul 2011 17:16:10 | 1148385 | 13024961 | hadcm3n_t4xs_1940_40_007315919_1 | 414,720 | 1,433,819 | 3.4573 |
| 25 Jul 2011 15:59:54 | 1148385 | 13024961 | hadcm3n_t4xs_1940_40_007315919_1 | 388,800 | 1,343,566 | 3.4557 |
| 25 Jul 2011 15:00:45 | 1148385 | 13024961 | hadcm3n_t4xs_1940_40_007315919_1 | 362,880 | 1,253,810 | 3.4552 |
| 25 Jul 2011 14:16:41 | 1148385 | 13024961 | hadcm3n_t4xs_1940_40_007315919_1 | 336,960 | 1,165,555 | 3.4590 |
| 25 Jul 2011 14:16:40 | 1148385 | 13024961 | hadcm3n_t4xs_1940_40_007315919_1 | 311,040 | 1,076,207 | 3.4600 |
| 25 Jul 2011 14:16:41 | 1148385 | 13024961 | hadcm3n_t4xs_1940_40_007315919_1 | 285,120 | 986,863 | 3.4612 |
| 25 Jul 2011 14:16:41 | 1148385 | 13024961 | hadcm3n_t4xs_1940_40_007315919_1 | 259,200 | 897,695 | 3.4633 |
| 10 Jul 2011 17:56:51 | 1148385 | 13024961 | hadcm3n_t4xs_1940_40_007315919_1 | 233,280 | 807,739 | 3.4625 |
| 09 Jul 2011 17:43:05 | 1148385 | 13024961 | hadcm3n_t4xs_1940_40_007315919_1 | 207,360 | 717,248 | 3.4590 |
| 07 Jul 2011 20:29:04 | 1148385 | 13024961 | hadcm3n_t4xs_1940_40_007315919_1 | 181,440 | 627,849 | 3.4604 |
| 07 Jul 2011 15:36:31 | 1148385 | 13024961 | hadcm3n_t4xs_1940_40_007315919_1 | 155,520 | 537,882 | 3.4586 |
| 04 Jul 2011 21:57:54 | 1148385 | 13024961 | hadcm3n_t4xs_1940_40_007315919_1 | 129,600 | 446,034 | 3.4416 |
| 03 Jul 2011 14:12:19 | 1148385 | 13024961 | hadcm3n_t4xs_1940_40_007315919_1 | 103,680 | 355,150 | 3.4254 |
| 02 Jul 2011 12:28:01 | 1148385 | 13024961 | hadcm3n_t4xs_1940_40_007315919_1 | 77,760 | 267,746 | 3.4432 |
| 01 Jul 2011 07:48:18 | 1148385 | 13024961 | hadcm3n_t4xs_1940_40_007315919_1 | 51,840 | 179,002 | 3.4530 |
| 30 Jun 2011 04:38:02 | 1148385 | 13024961 | hadcm3n_t4xs_1940_40_007315919_1 | 25,920 | 89,559 | 3.4552 |
©2024 cpdn.org