 |
|
| Name | hadcm3n_o4s7_2020_40_007856541_0 |
| Workunit | 8011653 |
| Created | 4 Apr 2012, 17:35:11 UTC |
| Sent | 4 Apr 2012, 17:38:45 UTC |
| Report deadline | 5 Jul 2012, 1:05:56 UTC |
| Received | 10 May 2012, 4:48:03 UTC |
| Server state | Over |
| Outcome | Computation error |
| Client state | Compute error |
| Exit status | 193 (0x000000C1) EXIT_SIGNAL |
| Computer ID | 1192110 |
| Run time | 10 days 23 hours 29 min 44 sec |
| CPU time | 10 days 7 hours 54 min 9 sec |
| Validate state | Invalid |
| Credit | 6,220.80 |
| Device peak FLOPS | 2.28 GFLOPS |
| Application version | UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu |
| Stderr | <core_client_version>6.10.58</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:00:09 (16436): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:00:11 (16436): No heartbeat from core client for 30 sec - exiting 21:01:10 (16486): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09e43850 *** ======= Backtrace: ========= /lib32/libc.so.6(+0x6bff1)[0xf74ccff1] /lib32/libc.so.6(+0x6d880)[0xf74ce880] /lib32/libc.so.6(cfree+0x6d)[0xf74d192d] /usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf76a87b1] /usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf76a880d] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib32/libc.so.6(__libc_start_main+0xe7)[0xf7477ce7] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] ======= Memory map: ======== 08048000-080e3000 r-xp 00000000 08:43 9437649 /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e3000-080e4000 rw-p 0009b000 08:43 9437649 /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e4000-0813b000 rw-p 00000000 00:00 0 09dee000-09e53000 rw-p 00000000 00:00 0 [heap] f6e00000-f6e21000 rw-p 00000000 00:00 0 f6e21000-f6f00000 ---p 00000000 00:00 0 f6fe3000-f745e000 rw-s 00000000 08:43 9440354 /var/lib/boinc-client/slots/0/133870 f745e000-f7461000 rw-p 00000000 00:00 0 f7461000-f75b5000 r-xp 00000000 08:43 11143447 /lib32/libc-2.12.1.so f75b5000-f75b6000 ---p 00154000 08:43 11143447 /lib32/libc-2.12.1.so f75b6000-f75b8000 r--p 00154000 08:43 11143447 /lib32/libc-2.12.1.so f75b8000-f75b9000 rw-p 00156000 08:43 11143447 /lib32/libc-2.12.1.so f75b9000-f75bc000 rw-p 00000000 00:00 0 f75bc000-f75d6000 r-xp 00000000 08:43 4724792 /usr/lib32/libgcc_s.so.1 f75d6000-f75d7000 r--p 00019000 08:43 4724792 /usr/lib32/libgcc_s.so.1 f75d7000-f75d8000 rw-p 0001a000 08:43 4724792 /usr/lib32/libgcc_s.so.1 f75d8000-f75fc000 r-xp 00000000 08:43 11143451 /lib32/libm-2.12.1.so f75fc000-f75fd000 r--p 00023000 08:43 11143451 /lib32/libm-2.12.1.so f75fd000-f75fe000 rw-p 00024000 08:43 11143451 /lib32/libm-2.12.1.so f75fe000-f76dd000 r-xp 00000000 08:43 4724795 /usr/lib32/libstdc++.so.6.0.14 f76dd000-f76e1000 r--p 000de000 08:43 4724795 /usr/lib32/libstdc++.so.6.0.14 f76e1000-f76e2000 rw-p 000e2000 08:43 4724795 /usr/lib32/libstdc++.so.6.0.14 f76e2000-f76e9000 rw-p 00000000 00:00 0 f76e9000-f76eb000 r-xp 00000000 08:43 11143450 /lib32/libdl-2.12.1.so f76eb000-f76ec000 r--p 00001000 08:43 11143450 /lib32/libdl-2.12.1.so f76ec000-f76ed000 rw-p 00002000 08:43 11143450 /lib32/libdl-2.12.1.so f76ed000-f76ee000 rw-p 00000000 00:00 0 f76ee000-f7703000 r-xp 00000000 08:43 11143461 /lib32/libpthread-2.12.1.so f7703000-f7704000 r--p 00014000 08:43 11143461 /lib32/libpthread-2.12.1.so f7704000-f7705000 rw-p 00015000 08:43 11143461 /lib32/libpthread-2.12.1.so f7705000-f7707000 rw-p 00000000 00:00 0 f771a000-f771b000 rw-p 00000000 00:00 0 f771b000-f771c000 ---p 00000000 00:00 0 f771c000-f771f000 rw-p 00000000 00:00 0 f771f000-f7721000 rw-s 00000000 08:43 9440065 /var/lib/boinc-client/slots/0/boinc_mmap_file f7721000-f7723000 rw-p 00000000 00:00 0 f7723000-f7724000 r-xp 00000000 00:00 0 [vdso] f7724000-f7740000 r-xp 00000000 08:43 11143444 /lib32/ld-2.12.1.so f7740000-f7741000 r--p 0001b000 08:43 11143444 /lib32/ld-2.12.1.so f7741000-f7742000 rw-p 0001c000 08:43 11143444 /lib32/ld-2.12.1.so ffd90000-ffdff000 rw-p 00000000 00:00 0 [stack] SIGABRT: abort called Stack trace (19 frames): ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df] [0xf7723400] [0xf7723425] /lib32/libc.so.6(gsignal+0x51)[0xf748ba01] /lib32/libc.so.6(abort+0x182)[0xf748ee42] /lib32/libc.so.6(+0x61f15)[0xf74c2f15] /lib32/libc.so.6(+0x6bff1)[0xf74ccff1] /lib32/libc.so.6(+0x6d880)[0xf74ce880] /lib32/libc.so.6(cfree+0x6d)[0xf74d192d] /usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf76a87b1] /usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf76a880d] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib32/libc.so.6(__libc_start_main+0xe7)[0xf7477ce7] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] Exiting... </stderr_txt> ]]> |
| Latest Trickles Received | ||||||
|---|---|---|---|---|---|---|
| Time Sent (UTC) | Host ID | Result ID | Result Name | Timestep | CPU Time (sec) | Average (sec/TS) |
| 10 May 2012 04:50:45 | 1192110 | 14357917 | hadcm3n_o4s7_2020_40_007856541_0 | 518,400 | 892,446 | 1.7215 |
| 08 May 2012 23:18:13 | 1192110 | 14357917 | hadcm3n_o4s7_2020_40_007856541_0 | 492,480 | 847,375 | 1.7206 |
| 07 May 2012 18:38:10 | 1192110 | 14357917 | hadcm3n_o4s7_2020_40_007856541_0 | 466,560 | 802,950 | 1.7210 |
| 06 May 2012 14:10:16 | 1192110 | 14357917 | hadcm3n_o4s7_2020_40_007856541_0 | 440,640 | 758,576 | 1.7215 |
| 05 May 2012 09:44:12 | 1192110 | 14357917 | hadcm3n_o4s7_2020_40_007856541_0 | 414,720 | 714,115 | 1.7219 |
| 04 May 2012 04:09:55 | 1192110 | 14357917 | hadcm3n_o4s7_2020_40_007856541_0 | 388,800 | 669,278 | 1.7214 |
| 02 May 2012 22:54:23 | 1192110 | 14357917 | hadcm3n_o4s7_2020_40_007856541_0 | 362,880 | 624,789 | 1.7218 |
| 29 Apr 2012 00:05:48 | 1192110 | 14357917 | hadcm3n_o4s7_2020_40_007856541_0 | 336,960 | 580,352 | 1.7223 |
| 27 Apr 2012 20:24:40 | 1192110 | 14357917 | hadcm3n_o4s7_2020_40_007856541_0 | 311,040 | 535,676 | 1.7222 |
| 25 Apr 2012 23:13:24 | 1192110 | 14357917 | hadcm3n_o4s7_2020_40_007856541_0 | 285,120 | 490,763 | 1.7213 |
| 24 Apr 2012 10:28:40 | 1192110 | 14357917 | hadcm3n_o4s7_2020_40_007856541_0 | 259,200 | 445,858 | 1.7201 |
| 22 Apr 2012 18:23:58 | 1192110 | 14357917 | hadcm3n_o4s7_2020_40_007856541_0 | 233,280 | 401,167 | 1.7197 |
| 21 Apr 2012 09:06:42 | 1192110 | 14357917 | hadcm3n_o4s7_2020_40_007856541_0 | 207,360 | 356,608 | 1.7198 |
| 20 Apr 2012 03:41:32 | 1192110 | 14357917 | hadcm3n_o4s7_2020_40_007856541_0 | 181,440 | 312,139 | 1.7203 |
| 19 Apr 2012 01:55:38 | 1192110 | 14357917 | hadcm3n_o4s7_2020_40_007856541_0 | 155,520 | 267,729 | 1.7215 |
| 17 Apr 2012 18:42:57 | 1192110 | 14357917 | hadcm3n_o4s7_2020_40_007856541_0 | 129,600 | 223,089 | 1.7214 |
| 16 Apr 2012 10:36:23 | 1192110 | 14357917 | hadcm3n_o4s7_2020_40_007856541_0 | 103,680 | 178,476 | 1.7214 |
| 15 Apr 2012 01:52:06 | 1192110 | 14357917 | hadcm3n_o4s7_2020_40_007856541_0 | 77,760 | 133,828 | 1.7210 |
| 13 Apr 2012 16:36:11 | 1192110 | 14357917 | hadcm3n_o4s7_2020_40_007856541_0 | 51,840 | 89,026 | 1.7173 |
| 12 Apr 2012 08:44:19 | 1192110 | 14357917 | hadcm3n_o4s7_2020_40_007856541_0 | 25,920 | 44,630 | 1.7218 |
©2024 cpdn.org