 |
|
| Name | famous_v5a8_1999_200_006692614_4 |
| Workunit | 6895867 |
| Created | 26 Aug 2010, 16:01:11 UTC |
| Sent | 8 Sep 2010, 21:21:41 UTC |
| Report deadline | 9 Dec 2010, 4:48:52 UTC |
| Received | 24 Sep 2010, 11:36:09 UTC |
| Server state | Over |
| Outcome | Computation error |
| Client state | Compute error |
| Exit status | -226 (0xFFFFFF1E) ERR_TOO_MANY_EXITS |
| Computer ID | 1077883 |
| Run time | 2 days 23 hours 58 min 46 sec |
| CPU time | 2 days 19 hours 25 min 58 sec |
| Validate state | Invalid |
| Credit | 1,605.93 |
| Device peak FLOPS | 2.56 GFLOPS |
| Application version | UK Met Office FAMOUS v6.11 i686-pc-linux-gnu |
| Stderr | <core_client_version>6.10.17</core_client_version> <![CDATA[ <message> too many exit(0)s </message> <stderr_txt> (10306): No heartbeat from core client for 30 sec - exiting SIGSEGV: segmentation violation Stack trace (9 frames): /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x83aa400] [0xf77c7400] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x834189c] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x830b5a9] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x832dc4d] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x8330bdf] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x83415d2] /lib/i686/cmov/libc.so.6(__libc_start_main+0xe5)[0xf7650b55] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu(pthread_mutex_unlock+0x149)[0x804c041] Exiting... CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... (10623): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... (11095): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... (11251): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (11304): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (11358): No heartbeat from core client for 30 sec - exiting SIGSEGV: segmentation violation Stack trace (9 frames): /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x83aa400] [0xf779a400] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x834189c] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x831aeb4] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x832da0f] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x8330bdf] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x83415d2] /lib/i686/cmov/libc.so.6(__libc_start_main+0xe5)[0xf7623b55] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu(pthread_mutex_unlock+0x149)[0x804c041] Exiting... CPDN Monitor - No 'heartbeat' from BOINC... (11412): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 CPDN Monitor - Quit request from BOINC... (1630): No heartbeat from core client for 30 sec - exiting SIGSEGV: segmentation violation Stack trace (9 frames): /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x83aa400] [0xf7754400] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x834189c] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x830b5a9] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x832dc4d] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x8330bdf] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x83415d2] /lib/i686/cmov/libc.so.6(__libc_start_main+0xe5)[0xf75ddb55] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu(pthread_mutex_unlock+0x149)[0x804c041] Exiting... CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... (1960): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 CPDN Monitor - Quit request from BOINC... (2358): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... (1981): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (2011): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... (3009): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... (3216): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 (3748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... (3813): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... (4073): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... (4936): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... (5234): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... (5637): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (5672): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (5708): No heartbeat from core client for 30 sec - exiting SIGSEGV: segmentation violation Stack trace (9 frames): /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x83aa400] [0xf775b400] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x834189c] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x830b5a9] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x832dc4d] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x8330bdf] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x83415d2] /lib/i686/cmov/libc.so.6(__libc_start_main+0xe5)[0xf75e4b55] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu(pthread_mutex_unlock+0x149)[0x804c041] Exiting... CPDN Monitor - No 'heartbeat' from BOINC... (5743): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (5778): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (5813): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (5848): No heartbeat from core client for 30 sec - exiting SIGSEGV: segmentation violation Stack trace (9 frames): /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x83aa400] [0xf773b400] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x834189c] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x830b5a9] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x832dc4d] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x8330bdf] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x83415d2] /lib/i686/cmov/libc.so.6(__libc_start_main+0xe5)[0xf75c4b55] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu(pthread_mutex_unlock+0x149)[0x804c041] Exiting... CPDN Monitor - No 'heartbeat' from BOINC... (5883): No heartbeat from core client for 30 sec - exiting SIGSEGV: segmentation violation Stack trace (9 frames): /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x83aa400] [0xf76fb400] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x834189c] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x831aeb4] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x832da0f] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x8330bdf] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x83415d2] /lib/i686/cmov/libc.so.6(__libc_start_main+0xe5)[0xf7584b55] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu(pthread_mutex_unlock+0x149)[0x804c041] Exiting... CPDN Monitor - No 'heartbeat' from BOINC... (5918): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (5953): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (5988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (6023): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (6058): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (6096): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (6131): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (6166): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (6201): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (6236): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (6271): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (6306): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (6341): No heartbeat from core client for 30 sec - exiting SIGSEGV: segmentation violation Stack trace (9 frames): /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x83aa400] [0xf7758400] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x834189c] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x830b5a9] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x832dc4d] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x8330bdf] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x83415d2] /lib/i686/cmov/libc.so.6(__libc_start_main+0xe5)[0xf75e1b55] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu(pthread_mutex_unlock+0x149)[0x804c041] Exiting... CPDN Monitor - No 'heartbeat' from BOINC... (6376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (6411): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (6446): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (6481): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (6516): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (6551): No heartbeat from core client for 30 sec - exiting SIGSEGV: segmentation violation Stack trace (9 frames): /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x83aa400] [0xf7771400] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x834189c] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x830b5a9] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x832dc4d] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x8330bdf] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x83415d2] /lib/i686/cmov/libc.so.6(__libc_start_main+0xe5)[0xf75fab55] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu(pthread_mutex_unlock+0x149)[0x804c041] Exiting... CPDN Monitor - No 'heartbeat' from BOINC... (6586): No heartbeat from core client for 30 sec - exiting SIGSEGV: segmentation violation Stack trace (9 frames): /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x83aa400] [0xf76e1400] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x834189c] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x830b5a9] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x832dc4d] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x8330bdf] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x83415d2] /lib/i686/cmov/libc.so.6(__libc_start_main+0xe5)[0xf756ab55] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu(pthread_mutex_unlock+0x149)[0x804c041] Exiting... CPDN Monitor - No 'heartbeat' from BOINC... (6621): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (6656): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (6691): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (6726): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (6761): No heartbeat from core client for 30 sec - exiting SIGSEGV: segmentation violation Stack trace (9 frames): /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x83aa400] [0xf773f400] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x834189c] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x830b5a9] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x832dc4d] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x8330bdf] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x83415d2] /lib/i686/cmov/libc.so.6(__libc_start_main+0xe5)[0xf75c8b55] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu(pthread_mutex_unlock+0x149)[0x804c041] Exiting... CPDN Monitor - No 'heartbeat' from BOINC... (6796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (6832): No heartbeat from core client for 30 sec - exiting SIGSEGV: segmentation violation Stack trace (9 frames): /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x83aa400] [0xf77da400] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x834189c] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x830b5a9] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x832dc4d] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x8330bdf] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x83415d2] /lib/i686/cmov/libc.so.6(__libc_start_main+0xe5)[0xf7663b55] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu(pthread_mutex_unlock+0x149)[0x804c041] Exiting... CPDN Monitor - No 'heartbeat' from BOINC... (6867): No heartbeat from core client for 30 sec - exiting SIGSEGV: segmentation violation Stack trace (9 frames): /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x83aa400] [0xf77c9400] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x834189c] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x830b5a9] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x832dc4d] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x8330bdf] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x83415d2] /lib/i686/cmov/libc.so.6(__libc_start_main+0xe5)[0xf7652b55] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu(pthread_mutex_unlock+0x149)[0x804c041] Exiting... CPDN Monitor - No 'heartbeat' from BOINC... (6902): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (6940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (6975): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (7010): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (7045): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (7080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (7115): No heartbeat from core client for 30 sec - exiting SIGSEGV: segmentation violation Stack trace (9 frames): /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x83aa400] [0xf775d400] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x834189c] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x830b5a9] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x832dc4d] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x8330bdf] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x83415d2] /lib/i686/cmov/libc.so.6(__libc_start_main+0xe5)[0xf75e6b55] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu(pthread_mutex_unlock+0x149)[0x804c041] Exiting... CPDN Monitor - No 'heartbeat' from BOINC... (7150): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (7185): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (7220): No heartbeat from core client for 30 sec - exiting SIGSEGV: segmentation violation Stack trace (9 frames): /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x83aa400] [0xf7765400] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x834189c] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x831aeb4] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x832da0f] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x8330bdf] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x83415d2] /lib/i686/cmov/libc.so.6(__libc_start_main+0xe5)[0xf75eeb55] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu(pthread_mutex_unlock+0x149)[0x804c041] Exiting... CPDN Monitor - No 'heartbeat' from BOINC... (7255): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (7290): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (7325): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (7360): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (7395): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (7430): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (7465): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (7500): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (7535): No heartbeat from core client for 30 sec - exiting SIGSEGV: segmentation violation Stack trace (9 frames): /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x83aa400] [0xf76fb400] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x834189c] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x830b5a9] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x832dc4d] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x8330bdf] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x83415d2] /lib/i686/cmov/libc.so.6(__libc_start_main+0xe5)[0xf7584b55] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu(pthread_mutex_unlock+0x149)[0x804c041] Exiting... CPDN Monitor - No 'heartbeat' from BOINC... (7570): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (7605): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (7640): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (7675): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (7710): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (7745): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (7780): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (7815): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (7850): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (7885): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (7920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (7955): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (7990): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (8025): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (8060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (8095): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (8130): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (8165): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (8200): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (8235): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (8270): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (8305): No heartbeat from core client for 30 sec - exiting SIGSEGV: segmentation violation Stack trace (9 frames): /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x83aa400] [0xf76f9400] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x834189c] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x830b5a9] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x832dc4d] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x8330bdf] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x83415d2] /lib/i686/cmov/libc.so.6(__libc_start_main+0xe5)[0xf7582b55] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu(pthread_mutex_unlock+0x149)[0x804c041] Exiting... CPDN Monitor - No 'heartbeat' from BOINC... (8340): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (8375): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (8410): No heartbeat from core client for 30 sec - exiting SIGSEGV: segmentation violation Stack trace (9 frames): /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x83aa400] [0xf774d400] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x834189c] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x830b5a9] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x832dc4d] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x8330bdf] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x83415d2] /lib/i686/cmov/libc.so.6(__libc_start_main+0xe5)[0xf75d6b55] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu(pthread_mutex_unlock+0x149)[0x804c041] Exiting... CPDN Monitor - No 'heartbeat' from BOINC... (8448): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (8483): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (8518): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (8553): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (8588): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (8623): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (8658): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (8693): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (8728): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (8763): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (8798): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (8833): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (8868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (8903): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (8938): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (8973): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (9008): No heartbeat from core client for 30 sec - exiting SIGSEGV: segmentation violation Stack trace (9 frames): /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x83aa400] [0xf77ab400] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x834189c] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x831aeb4] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x832da0f] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x8330bdf] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x83415d2] /lib/i686/cmov/libc.so.6(__libc_start_main+0xe5)[0xf7634b55] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu(pthread_mutex_unlock+0x149)[0x804c041] Exiting... CPDN Monitor - No 'heartbeat' from BOINC... (9043): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (9078): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (9113): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (9148): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (9183): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (9218): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (9254): No heartbeat from core client for 30 sec - exiting SIGSEGV: segmentation violation Stack trace (9 frames): /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x83aa400] [0xf77a7400] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x834189c] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x830b5a9] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x832dc4d] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x8330bdf] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu[0x83415d2] /lib/i686/cmov/libc.so.6(__libc_start_main+0xe5)[0xf7630b55] /var/lib/boinc-client/projects/climateapps2.oucs.ox.ac.uk_cpdnboinc/famous_um_6.11_i686-pc-linux-gnu(pthread_mutex_unlock+0x149)[0x804c041] Exiting... CPDN Monitor - No 'heartbeat' from BOINC... (9289): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (9324): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (9359): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (9394): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (9429): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... </stderr_txt> ]]> |
| Latest Trickles Received | ||||||
|---|---|---|---|---|---|---|
| Time Sent (UTC) | Host ID | Result ID | Result Name | Timestep | CPU Time (sec) | Average (sec/TS) |
| 24 Sep 2010 05:28:32 | 1077883 | 11722843 | famous_v5a8_1999_200_006692614_4 | 486,746 | 238,023 | 0.4890 |
| 23 Sep 2010 22:39:33 | 1077883 | 11722843 | famous_v5a8_1999_200_006692614_4 | 477,386 | 232,012 | 0.4860 |
| 23 Sep 2010 15:16:01 | 1077883 | 11722843 | famous_v5a8_1999_200_006692614_4 | 468,026 | 226,027 | 0.4829 |
| 23 Sep 2010 11:51:27 | 1077883 | 11722843 | famous_v5a8_1999_200_006692614_4 | 458,666 | 220,024 | 0.4797 |
| 23 Sep 2010 08:16:48 | 1077883 | 11722843 | famous_v5a8_1999_200_006692614_4 | 449,306 | 214,019 | 0.4763 |
| 22 Sep 2010 22:43:43 | 1077883 | 11722843 | famous_v5a8_1999_200_006692614_4 | 439,946 | 208,054 | 0.4729 |
| 22 Sep 2010 10:03:59 | 1077883 | 11722843 | famous_v5a8_1999_200_006692614_4 | 430,586 | 202,151 | 0.4695 |
| 22 Sep 2010 07:09:25 | 1077883 | 11722843 | famous_v5a8_1999_200_006692614_4 | 421,226 | 196,217 | 0.4658 |
| 22 Sep 2010 04:21:51 | 1077883 | 11722843 | famous_v5a8_1999_200_006692614_4 | 411,866 | 190,324 | 0.4621 |
| 21 Sep 2010 17:24:47 | 1077883 | 11722843 | famous_v5a8_1999_200_006692614_4 | 393,146 | 178,503 | 0.4540 |
| 21 Sep 2010 10:35:29 | 1077883 | 11722843 | famous_v5a8_1999_200_006692614_4 | 383,786 | 172,601 | 0.4497 |
| 21 Sep 2010 06:47:16 | 1077883 | 11722843 | famous_v5a8_1999_200_006692614_4 | 374,426 | 166,699 | 0.4452 |
| 21 Sep 2010 02:56:51 | 1077883 | 11722843 | famous_v5a8_1999_200_006692614_4 | 365,066 | 161,050 | 0.4412 |
| 20 Sep 2010 19:51:24 | 1077883 | 11722843 | famous_v5a8_1999_200_006692614_4 | 355,706 | 155,130 | 0.4361 |
| 20 Sep 2010 11:19:48 | 1077883 | 11722843 | famous_v5a8_1999_200_006692614_4 | 346,346 | 149,227 | 0.4309 |
| 20 Sep 2010 02:29:19 | 1077883 | 11722843 | famous_v5a8_1999_200_006692614_4 | 336,986 | 143,113 | 0.4247 |
| 19 Sep 2010 15:53:13 | 1077883 | 11722843 | famous_v5a8_1999_200_006692614_4 | 327,626 | 137,219 | 0.4188 |
| 19 Sep 2010 12:41:12 | 1077883 | 11722843 | famous_v5a8_1999_200_006692614_4 | 318,266 | 131,264 | 0.4124 |
| 18 Sep 2010 07:55:52 | 1077883 | 11722843 | famous_v5a8_1999_200_006692614_4 | 308,906 | 125,297 | 0.4056 |
| 17 Sep 2010 09:36:12 | 1077883 | 11722843 | famous_v5a8_1999_200_006692614_4 | 299,546 | 120,969 | 0.4038 |
©2024 climateprediction.net