 |
|
| Name | hadcm3n_ygke_1980_40_007956493_3 |
| Workunit | 8111605 |
| Created | 9 May 2012, 14:14:24 UTC |
| Sent | 9 May 2012, 14:18:10 UTC |
| Report deadline | 8 Aug 2012, 21:45:21 UTC |
| Received | 29 May 2012, 15:00:51 UTC |
| Server state | Over |
| Outcome | Computation error |
| Client state | Compute error |
| Exit status | 193 (0x000000C1) EXIT_SIGNAL |
| Computer ID | 1183752 |
| Run time | 19 days 8 hours 3 min 19 sec |
| CPU time | 19 days 0 hours 4 min 7 sec |
| Validate state | Invalid |
| Credit | 9,331.20 |
| Device peak FLOPS | 2.99 GFLOPS |
| Application version | UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu |
| Stderr | <core_client_version>6.12.33</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x088efe00 *** ======= Backtrace: ========= /lib32/libc.so.6(+0x6ff02)[0xf7478f02] /lib32/libc.so.6(+0x70ba2)[0xf7479ba2] /lib32/libc.so.6(cfree+0x6d)[0xf747cc5d] /usr/lib32/libstdc++.so.6(_ZdlPv+0x1f)[0xf7678baf] /usr/lib32/libstdc++.so.6(_ZdaPv+0x1b)[0xf7678c0b] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib32/libc.so.6(__libc_start_main+0xf3)[0xf74220f3] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] ======= Memory map: ======== 08048000-080e3000 r-xp 00000000 00:11 2346813 /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e3000-080e4000 rw-p 0009b000 00:11 2346813 /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e4000-0813b000 rw-p 00000000 00:00 0 0889a000-08900000 rw-p 00000000 00:00 0 [heap] f6e00000-f6e21000 rw-p 00000000 00:00 0 f6e21000-f6f00000 ---p 00000000 00:00 0 f6f8b000-f7406000 rw-s 00000000 00:11 11407353 /var/lib/boinc-client/slots/1/140685 f7406000-f7409000 rw-p 00000000 00:00 0 f7409000-f757d000 r-xp 00000000 00:11 7920365 /lib32/libc-2.13.so f757d000-f757f000 r--p 00174000 00:11 7920365 /lib32/libc-2.13.so f757f000-f7580000 rw-p 00176000 00:11 7920365 /lib32/libc-2.13.so f7580000-f7583000 rw-p 00000000 00:00 0 f7583000-f759f000 r-xp 00000000 00:11 2336499 /usr/lib32/libgcc_s.so.1 f759f000-f75a0000 r--p 0001b000 00:11 2336499 /usr/lib32/libgcc_s.so.1 f75a0000-f75a1000 rw-p 0001c000 00:11 2336499 /usr/lib32/libgcc_s.so.1 f75a1000-f75c9000 r-xp 00000000 00:11 7920369 /lib32/libm-2.13.so f75c9000-f75ca000 r--p 00028000 00:11 7920369 /lib32/libm-2.13.so f75ca000-f75cb000 rw-p 00029000 00:11 7920369 /lib32/libm-2.13.so f75cb000-f76a9000 r-xp 00000000 00:11 2336535 /usr/lib32/libstdc++.so.6.0.16 f76a9000-f76aa000 ---p 000de000 00:11 2336535 /usr/lib32/libstdc++.so.6.0.16 f76aa000-f76ae000 r--p 000de000 00:11 2336535 /usr/lib32/libstdc++.so.6.0.16 f76ae000-f76af000 rw-p 000e2000 00:11 2336535 /usr/lib32/libstdc++.so.6.0.16 f76af000-f76b7000 rw-p 00000000 00:00 0 f76b7000-f76ba000 r-xp 00000000 00:11 7920368 /lib32/libdl-2.13.so f76ba000-f76bb000 r--p 00002000 00:11 7920368 /lib32/libdl-2.13.so f76bb000-f76bc000 rw-p 00003000 00:11 7920368 /lib32/libdl-2.13.so f76bc000-f76d3000 r-xp 00000000 00:11 7920379 /lib32/libpthread-2.13.so f76d3000-f76d4000 r--p 00016000 00:11 7920379 /lib32/libpthread-2.13.so f76d4000-f76d5000 rw-p 00017000 00:11 7920379 /lib32/libpthread-2.13.so f76d5000-f76d7000 rw-p 00000000 00:00 0 f76e1000-f76e2000 rw-p 00000000 00:00 0 f76e2000-f76e3000 ---p 00000000 00:00 0 f76e3000-f76e6000 rw-p 00000000 00:00 0 f76e6000-f76e8000 rw-s 00000000 00:11 11407260 /var/lib/boinc-client/slots/1/boinc_mmap_file f76e8000-f76ea000 rw-p 00000000 00:00 0 f76ea000-f76eb000 r-xp 00000000 00:00 0 [vdso] f76eb000-f7709000 r-xp 00000000 00:11 7920702 /lib/i386-linux-gnu/ld-2.13.so f7709000-f770a000 r--p 0001d000 00:11 7920702 /lib/i386-linux-gnu/ld-2.13.so f770a000-f770b000 rw-p 0001e000 00:11 7920702 /lib/i386-linux-gnu/ld-2.13.so fff4c000-fffbc000 rw-p 00000000 00:00 0 [stack] SIGABRT: abort called Stack trace (19 frames): ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df] [0xf76ea400] [0xf76ea430] /lib32/libc.so.6(gsignal+0x4f)[0xf7436c4f] /lib32/libc.so.6(abort+0x175)[0xf743a175] /lib32/libc.so.6(+0x6521c)[0xf746e21c] /lib32/libc.so.6(+0x6ff02)[0xf7478f02] /lib32/libc.so.6(+0x70ba2)[0xf7479ba2] /lib32/libc.so.6(cfree+0x6d)[0xf747cc5d] /usr/lib32/libstdc++.so.6(_ZdlPv+0x1f)[0xf7678baf] /usr/lib32/libstdc++.so.6(_ZdaPv+0x1b)[0xf7678c0b] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib32/libc.so.6(__libc_start_main+0xf3)[0xf74220f3] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] Exiting... </stderr_txt> ]]> |
| Latest Trickles Received | ||||||
|---|---|---|---|---|---|---|
| Time Sent (UTC) | Host ID | Result ID | Result Name | Timestep | CPU Time (sec) | Average (sec/TS) |
| 29 May 2012 15:03:29 | 1183752 | 14649258 | hadcm3n_ygke_1980_40_007956493_3 | 777,600 | 1,641,844 | 2.1114 |
| 28 May 2012 23:27:50 | 1183752 | 14649258 | hadcm3n_ygke_1980_40_007956493_3 | 751,680 | 1,586,979 | 2.1112 |
| 28 May 2012 07:56:17 | 1183752 | 14649258 | hadcm3n_ygke_1980_40_007956493_3 | 725,760 | 1,532,314 | 2.1113 |
| 27 May 2012 16:31:34 | 1183752 | 14649258 | hadcm3n_ygke_1980_40_007956493_3 | 699,840 | 1,477,946 | 2.1118 |
| 27 May 2012 00:58:59 | 1183752 | 14649258 | hadcm3n_ygke_1980_40_007956493_3 | 673,920 | 1,423,311 | 2.1120 |
| 26 May 2012 09:30:59 | 1183752 | 14649258 | hadcm3n_ygke_1980_40_007956493_3 | 648,000 | 1,368,761 | 2.1123 |
| 25 May 2012 18:21:10 | 1183752 | 14649258 | hadcm3n_ygke_1980_40_007956493_3 | 622,080 | 1,314,478 | 2.1130 |
| 25 May 2012 02:50:15 | 1183752 | 14649258 | hadcm3n_ygke_1980_40_007956493_3 | 596,160 | 1,260,121 | 2.1137 |
| 24 May 2012 11:28:06 | 1183752 | 14649258 | hadcm3n_ygke_1980_40_007956493_3 | 570,240 | 1,205,925 | 2.1148 |
| 23 May 2012 19:20:37 | 1183752 | 14649258 | hadcm3n_ygke_1980_40_007956493_3 | 544,320 | 1,151,158 | 2.1149 |
| 23 May 2012 03:20:27 | 1183752 | 14649258 | hadcm3n_ygke_1980_40_007956493_3 | 518,400 | 1,096,431 | 2.1150 |
| 22 May 2012 11:58:06 | 1183752 | 14649258 | hadcm3n_ygke_1980_40_007956493_3 | 492,480 | 1,041,786 | 2.1154 |
| 21 May 2012 19:23:59 | 1183752 | 14649258 | hadcm3n_ygke_1980_40_007956493_3 | 466,560 | 986,965 | 2.1154 |
| 21 May 2012 04:48:25 | 1183752 | 14649258 | hadcm3n_ygke_1980_40_007956493_3 | 440,640 | 932,352 | 2.1159 |
| 20 May 2012 12:05:36 | 1183752 | 14649258 | hadcm3n_ygke_1980_40_007956493_3 | 414,720 | 877,849 | 2.1167 |
| 19 May 2012 20:14:23 | 1183752 | 14649258 | hadcm3n_ygke_1980_40_007956493_3 | 388,800 | 823,398 | 2.1178 |
| 19 May 2012 04:49:54 | 1183752 | 14649258 | hadcm3n_ygke_1980_40_007956493_3 | 362,880 | 768,867 | 2.1188 |
| 18 May 2012 13:22:55 | 1183752 | 14649258 | hadcm3n_ygke_1980_40_007956493_3 | 336,960 | 714,335 | 2.1199 |
| 17 May 2012 21:36:44 | 1183752 | 14649258 | hadcm3n_ygke_1980_40_007956493_3 | 311,040 | 659,047 | 2.1188 |
| 17 May 2012 05:50:45 | 1183752 | 14649258 | hadcm3n_ygke_1980_40_007956493_3 | 285,120 | 603,748 | 2.1175 |
©2024 climateprediction.net