Name | hadcm3n_7e9a_1980_40_008429761_1 |
Workunit | 8580617 |
Created | 14 Jan 2014, 2:00:30 UTC |
Sent | 14 Jan 2014, 2:03:27 UTC |
Report deadline | 15 Apr 2014, 9:30:38 UTC |
Received | 26 Apr 2014, 16:10:58 UTC |
Server state | Over |
Outcome | Computation error |
Client state | Aborted by user |
Exit status | 203 (0x000000CB) EXIT_ABORTED_VIA_GUI |
Computer ID | 1260982 |
Run time | 12 days 2 hours 12 min 22 sec |
CPU time | 9 days 4 hours 42 min 30 sec |
Validate state | Invalid |
Credit | 6,220.80 |
Device peak FLOPS | 3.12 GFLOPS |
Application version | UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu |
Stderr | <core_client_version>7.2.42</core_client_version> <![CDATA[ <message> aborted by user </message> <stderr_txt> CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09848870 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called 08:17:24 (29308): No heartbeat from core client for 30 sec - exiting 08:17:25 (29308): No heartbeat from core client for 30 sec - exiting 08:17:26 (29308): No heartbeat from core client for 30 sec - exiting 08:17:27 (29308): No heartbeat from core client for 30 sec - exiting 08:17:28 (29308): No heartbeat from core client for 30 sec - exiting 08:17:29 (29308): No heartbeat from core client for 30 sec - exiting 08:17:30 (29308): No heartbeat from core client for 30 sec - exiting 08:17:31 (29308): No heartbeat from core client for 30 sec - exiting 08:17:32 (29308): No heartbeat from core client for 30 sec - exiting 08:17:33 (29308): No heartbeat from core client for 30 sec - exiting 08:17:34 (29308): No heartbeat from core client for 30 sec - exiting 08:17:35 (29308): No heartbeat from core client for 30 sec - exiting 08:17:36 (29308): No heartbeat from core client for 30 sec - exiting 08:17:37 (29308): No heartbeat from core client for 30 sec - exiting 08:17:38 (29308): No heartbeat from core client for 30 sec - exiting 08:18:29 (29308): No heartbeat from core client for 30 sec - exiting 08:18:30 (29308): No heartbeat from core client for 30 sec - exiting 08:18:31 (29308): No heartbeat from core client for 30 sec - exiting 08:18:32 (29308): No heartbeat from core client for 30 sec - exiting 08:18:33 (29308): No heartbeat from core client for 30 sec - exiting 08:18:34 (29308): No heartbeat from core client for 30 sec - exiting 08:18:35 (29308): No heartbeat from core client for 30 sec - exiting 08:18:36 (29308): No heartbeat from core client for 30 sec - exiting 08:18:37 (29308): No heartbeat from core client for 30 sec - exiting 08:18:38 (29308): No heartbeat from core client for 30 sec - exiting 08:18:39 (29308): No heartbeat from core client for 30 sec - exiting 08:18:40 (29308): No heartbeat from core client for 30 sec - exiting 08:18:41 (29308): No heartbeat from core client for 30 sec - exiting 08:18:42 (29308): No heartbeat from core client for 30 sec - exiting 08:18:43 (29308): No heartbeat from core client for 30 sec - exiting 08:18:44 (29308): No heartbeat from core client for 30 sec - exiting 08:18:45 (29308): No heartbeat from core client for 30 sec - exiting 08:18:46 (29308): No heartbeat from core client for 30 sec - exiting 08:18:47 (29308): No heartbeat from core client for 30 sec - exiting 08:18:48 (29308): No heartbeat from core client for 30 sec - exiting 08:18:49 (29308): No heartbeat from core client for 30 sec - exiting 08:18:50 (29308): No heartbeat from core client for 30 sec - exiting 08:18:51 (29308): No heartbeat from core client for 30 sec - exiting 08:18:52 (29308): No heartbeat from core client for 30 sec - exiting 08:18:53 (29308): No heartbeat from core client for 30 sec - exiting 08:18:54 (29308): No heartbeat from core client for 30 sec - exiting 08:18:55 (29308): No heartbeat from core client for 30 sec - exiting 08:18:56 (29308): No heartbeat from core client for 30 sec - exiting 08:18:57 (29308): No heartbeat from core client for 30 sec - exiting 08:18:58 (29308): No heartbeat from core client for 30 sec - exiting 08:18:59 (29308): No heartbeat from core client for 30 sec - exiting 08:19:00 (29308): No heartbeat from core client for 30 sec - exiting 08:19:01 (29308): No heartbeat from core client for 30 sec - exiting 08:19:02 (29308): No heartbeat from core client for 30 sec - exiting 08:19:03 (29308): No heartbeat from core client for 30 sec - exiting 08:19:04 (29308): No heartbeat from core client for 30 sec - exiting 08:19:05 (29308): No heartbeat from core client for 30 sec - exiting 08:19:06 (29308): No heartbeat from core client for 30 sec - exiting 08:19:07 (29308): No heartbeat from core client for 30 sec - exiting 08:19:08 (29308): No heartbeat from core client for 30 sec - exiting 08:19:09 (29308): No heartbeat from core client for 30 sec - exiting 08:19:10 (29308): No heartbeat from core client for 30 sec - exiting 08:19:11 (29308): No heartbeat from core client for 30 sec - exiting 08:19:12 (29308): No heartbeat from core client for 30 sec - exiting 08:19:13 (29308): No heartbeat from core client for 30 sec - exiting 08:19:14 (29308): No heartbeat from core client for 30 sec - exiting 08:19:15 (29308): No heartbeat from core client for 30 sec - exiting 08:19:16 (29308): No heartbeat from core client for 30 sec - exiting 08:19:17 (29308): No heartbeat from core client for 30 sec - exiting 08:19:18 (29308): No heartbeat from core client for 30 sec - exiting 08:19:19 (29308): No heartbeat from core client for 30 sec - exiting *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09eed0c0 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09ea40c0 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x085070c0 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called 08:20:23 (2541): No heartbeat from core client for 30 sec - exiting 08:20:24 (2541): No heartbeat from core client for 30 sec - exiting 08:20:25 (2541): No heartbeat from core client for 30 sec - exiting 08:20:26 (2541): No heartbeat from core client for 30 sec - exiting 08:20:27 (2541): No heartbeat from core client for 30 sec - exiting 08:20:28 (2541): No heartbeat from core client for 30 sec - exiting 08:20:29 (2541): No heartbeat from core client for 30 sec - exiting 08:20:30 (2541): No heartbeat from core client for 30 sec - exiting *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x085e50c0 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x097270c0 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called 09:50:09 (31433): No heartbeat from core client for 30 sec - exiting 09:51:38 (31433): No heartbeat from core client for 30 sec - exiting 09:53:23 (31433): No heartbeat from core client for 30 sec - exiting 09:54:45 (31433): No heartbeat from core client for 30 sec - exiting 10:03:04 (31433): No heartbeat from core client for 30 sec - exiting 10:04:35 (31433): No heartbeat from core client for 30 sec - exiting 08:59:57 (31433): No heartbeat from core client for 30 sec - exiting 08:59:58 (31433): No heartbeat from core client for 30 sec - exiting 08:59:59 (31433): No heartbeat from core client for 30 sec - exiting 09:00:00 (31433): No heartbeat from core client for 30 sec - exiting 09:00:01 (31433): No heartbeat from core client for 30 sec - exiting 09:00:02 (31433): No heartbeat from core client for 30 sec - exiting 09:00:03 (31433): No heartbeat from core client for 30 sec - exiting 09:00:04 (31433): No heartbeat from core client for 30 sec - exiting 09:00:05 (31433): No heartbeat from core client for 30 sec - exiting 09:00:06 (31433): No heartbeat from core client for 30 sec - exiting 09:00:07 (31433): No heartbeat from core client for 30 sec - exiting 09:00:08 (31433): No heartbeat from core client for 30 sec - exiting 09:00:09 (31433): No heartbeat from core client for 30 sec - exiting 09:00:10 (31433): No heartbeat from core client for 30 sec - exiting 09:00:11 (31433): No heartbeat from core client for 30 sec - exiting 09:00:12 (31433): No heartbeat from core client for 30 sec - exiting 09:00:13 (31433): No heartbeat from core client for 30 sec - exiting 09:00:14 (31433): No heartbeat from core client for 30 sec - exiting 09:00:15 (31433): No heartbeat from core client for 30 sec - exiting 09:00:16 (31433): No heartbeat from core client for 30 sec - exiting 09:00:17 (31433): No heartbeat from core client for 30 sec - exiting 09:00:18 (31433): No heartbeat from core client for 30 sec - exiting 09:00:19 (31433): No heartbeat from core client for 30 sec - exiting 09:00:20 (31433): No heartbeat from core client for 30 sec - exiting 09:00:21 (31433): No heartbeat from core client for 30 sec - exiting 09:00:22 (31433): No heartbeat from core client for 30 sec - exiting 09:00:23 (31433): No heartbeat from core client for 30 sec - exiting 09:00:24 (31433): No heartbeat from core client for 30 sec - exiting 09:00:25 (31433): No heartbeat from core client for 30 sec - exiting 09:00:26 (31433): No heartbeat from core client for 30 sec - exiting 09:00:27 (31433): No heartbeat from core client for 30 sec - exiting 09:00:28 (31433): No heartbeat from core client for 30 sec - exiting 09:00:29 (31433): No heartbeat from core client for 30 sec - exiting 09:00:30 (31433): No heartbeat from core client for 30 sec - exiting 09:00:31 (31433): No heartbeat from core client for 30 sec - exiting 09:00:32 (31433): No heartbeat from core client for 30 sec - exiting 09:00:33 (31433): No heartbeat from core client for 30 sec - exiting 09:00:34 (31433): No heartbeat from core client for 30 sec - exiting 09:00:35 (31433): No heartbeat from core client for 30 sec - exiting 09:00:36 (31433): No heartbeat from core client for 30 sec - exiting 09:00:37 (31433): No heartbeat from core client for 30 sec - exiting 09:00:38 (31433): No heartbeat from core client for 30 sec - exiting 09:00:39 (31433): No heartbeat from core client for 30 sec - exiting 09:00:40 (31433): No heartbeat from core client for 30 sec - exiting 09:00:41 (31433): No heartbeat from core client for 30 sec - exiting 09:00:42 (31433): No heartbeat from core client for 30 sec - exiting *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08c590c0 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x087ea0c0 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08abd0c0 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called 19:02:41 (10002): No heartbeat from core client for 30 sec - exiting 19:02:42 (10002): No heartbeat from core client for 30 sec - exiting 19:02:43 (10002): No heartbeat from core client for 30 sec - exiting 19:02:44 (10002): No heartbeat from core client for 30 sec - exiting 19:02:45 (10002): No heartbeat from core client for 30 sec - exiting 19:02:46 (10002): No heartbeat from core client for 30 sec - exiting 19:02:47 (10002): No heartbeat from core client for 30 sec - exiting 19:02:48 (10002): No heartbeat from core client for 30 sec - exiting 19:02:49 (10002): No heartbeat from core client for 30 sec - exiting 19:02:50 (10002): No heartbeat from core client for 30 sec - exiting 19:02:51 (10002): No heartbeat from core client for 30 sec - exiting 19:02:52 (10002): No heartbeat from core client for 30 sec - exiting 19:02:53 (10002): No heartbeat from core client for 30 sec - exiting 19:02:54 (10002): No heartbeat from core client for 30 sec - exiting 19:02:55 (10002): No heartbeat from core client for 30 sec - exiting 19:02:56 (10002): No heartbeat from core client for 30 sec - exiting 19:02:57 (10002): No heartbeat from core client for 30 sec - exiting 19:02:58 (10002): No heartbeat from core client for 30 sec - exiting 19:02:59 (10002): No heartbeat from core client for 30 sec - exiting 19:03:00 (10002): No heartbeat from core client for 30 sec - exiting 19:03:01 (10002): No heartbeat from core client for 30 sec - exiting 19:03:02 (10002): No heartbeat from core client for 30 sec - exiting 19:03:03 (10002): No heartbeat from core client for 30 sec - exiting 19:03:04 (10002): No heartbeat from core client for 30 sec - exiting 19:03:05 (10002): No heartbeat from core client for 30 sec - exiting 19:03:06 (10002): No heartbeat from core client for 30 sec - exiting 19:03:07 (10002): No heartbeat from core client for 30 sec - exiting 19:03:08 (10002): No heartbeat from core client for 30 sec - exiting 19:03:09 (10002): No heartbeat from core client for 30 sec - exiting 19:03:10 (10002): No heartbeat from core client for 30 sec - exiting 19:03:11 (10002): No heartbeat from core client for 30 sec - exiting 19:03:12 (10002): No heartbeat from core client for 30 sec - exiting 19:03:13 (10002): No heartbeat from core client for 30 sec - exiting 19:03:14 (10002): No heartbeat from core client for 30 sec - exiting 19:03:15 (10002): No heartbeat from core client for 30 sec - exiting 19:03:16 (10002): No heartbeat from core client for 30 sec - exiting 19:03:17 (10002): No heartbeat from core client for 30 sec - exiting 19:03:18 (10002): No heartbeat from core client for 30 sec - exiting 19:03:19 (10002): No heartbeat from core client for 30 sec - exiting 19:03:20 (10002): No heartbeat from core client for 30 sec - exiting 19:03:21 (10002): No heartbeat from core client for 30 sec - exiting 19:03:22 (10002): No heartbeat from core client for 30 sec - exiting 19:03:23 (10002): No heartbeat from core client for 30 sec - exiting 19:03:24 (10002): No heartbeat from core client for 30 sec - exiting 19:03:25 (10002): No heartbeat from core client for 30 sec - exiting 19:03:26 (10002): No heartbeat from core client for 30 sec - exiting 19:03:27 (10002): No heartbeat from core client for 30 sec - exiting 19:03:28 (10002): No heartbeat from core client for 30 sec - exiting 19:03:29 (10002): No heartbeat from core client for 30 sec - exiting 19:03:30 (10002): No heartbeat from core client for 30 sec - exiting 19:03:31 (10002): No heartbeat from core client for 30 sec - exiting 19:04:02 (10002): No heartbeat from core client for 30 sec - exiting 19:04:03 (10002): No heartbeat from core client for 30 sec - exiting 19:04:04 (10002): No heartbeat from core client for 30 sec - exiting 19:04:05 (10002): No heartbeat from core client for 30 sec - exiting 19:04:06 (10002): No heartbeat from core client for 30 sec - exiting 19:04:07 (10002): No heartbeat from core client for 30 sec - exiting 19:04:08 (10002): No heartbeat from core client for 30 sec - exiting 19:04:09 (10002): No heartbeat from core client for 30 sec - exiting 19:04:10 (10002): No heartbeat from core client for 30 sec - exiting 19:04:11 (10002): No heartbeat from core client for 30 sec - exiting 19:04:12 (10002): No heartbeat from core client for 30 sec - exiting 19:04:13 (10002): No heartbeat from core client for 30 sec - exiting 19:04:14 (10002): No heartbeat from core client for 30 sec - exiting 19:04:15 (10002): No heartbeat from core client for 30 sec - exiting 19:04:16 (10002): No heartbeat from core client for 30 sec - exiting 19:04:17 (10002): No heartbeat from core client for 30 sec - exiting 19:04:18 (10002): No heartbeat from core client for 30 sec - exiting 19:04:19 (10002): No heartbeat from core client for 30 sec - exiting 19:04:20 (10002): No heartbeat from core client for 30 sec - exiting 19:04:21 (10002): No heartbeat from core client for 30 sec - exiting 19:04:22 (10002): No heartbeat from core client for 30 sec - exiting 19:04:23 (10002): No heartbeat from core client for 30 sec - exiting 19:04:24 (10002): No heartbeat from core client for 30 sec - exiting 19:04:25 (10002): No heartbeat from core client for 30 sec - exiting 19:04:26 (10002): No heartbeat from core client for 30 sec - exiting 19:04:27 (10002): No heartbeat from core client for 30 sec - exiting 19:04:28 (10002): No heartbeat from core client for 30 sec - exiting 19:04:29 (10002): No heartbeat from core client for 30 sec - exiting 19:04:30 (10002): No heartbeat from core client for 30 sec - exiting 19:04:31 (10002): No heartbeat from core client for 30 sec - exiting 19:04:32 (10002): No heartbeat from core client for 30 sec - exiting 19:04:33 (10002): No heartbeat from core client for 30 sec - exiting 19:04:34 (10002): No heartbeat from core client for 30 sec - exiting 19:04:35 (10002): No heartbeat from core client for 30 sec - exiting 19:04:36 (10002): No heartbeat from core client for 30 sec - exiting 19:04:37 (10002): No heartbeat from core client for 30 sec - exiting 19:04:38 (10002): No heartbeat from core client for 30 sec - exiting 19:04:39 (10002): No heartbeat from core client for 30 sec - exiting 19:04:40 (10002): No heartbeat from core client for 30 sec - exiting 19:04:41 (10002): No heartbeat from core client for 30 sec - exiting 19:04:42 (10002): No heartbeat from core client for 30 sec - exiting 19:04:43 (10002): No heartbeat from core client for 30 sec - exiting 19:04:44 (10002): No heartbeat from core client for 30 sec - exiting 19:04:45 (10002): No heartbeat from core client for 30 sec - exiting 19:04:46 (10002): No heartbeat from core client for 30 sec - exiting 19:04:47 (10002): No heartbeat from core client for 30 sec - exiting 19:04:48 (10002): No heartbeat from core client for 30 sec - exiting 19:04:49 (10002): No heartbeat from core client for 30 sec - exiting 19:04:50 (10002): No heartbeat from core client for 30 sec - exiting 19:04:51 (10002): No heartbeat from core client for 30 sec - exiting 19:04:52 (10002): No heartbeat from core client for 30 sec - exiting 19:06:39 (10002): No heartbeat from core client for 30 sec - exiting 19:06:40 (10002): No heartbeat from core client for 30 sec - exiting 19:06:41 (10002): No heartbeat from core client for 30 sec - exiting 19:06:42 (10002): No heartbeat from core client for 30 sec - exiting 19:06:43 (10002): No heartbeat from core client for 30 sec - exiting 19:06:44 (10002): No heartbeat from core client for 30 sec - exiting 19:06:45 (10002): No heartbeat from core client for 30 sec - exiting 19:06:46 (10002): No heartbeat from core client for 30 sec - exiting 19:06:47 (10002): No heartbeat from core client for 30 sec - exiting 19:06:48 (10002): No heartbeat from core client for 30 sec - exiting 19:06:49 (10002): No heartbeat from core client for 30 sec - exiting 19:06:50 (10002): No heartbeat from core client for 30 sec - exiting 19:06:51 (10002): No heartbeat from core client for 30 sec - exiting 19:06:52 (10002): No heartbeat from core client for 30 sec - exiting 19:06:53 (10002): No heartbeat from core client for 30 sec - exiting 19:06:54 (10002): No heartbeat from core client for 30 sec - exiting 19:06:55 (10002): No heartbeat from core client for 30 sec - exiting 19:06:56 (10002): No heartbeat from core client for 30 sec - exiting 19:06:57 (10002): No heartbeat from core client for 30 sec - exiting 19:06:58 (10002): No heartbeat from core client for 30 sec - exiting 19:06:59 (10002): No heartbeat from core client for 30 sec - exiting 19:07:00 (10002): No heartbeat from core client for 30 sec - exiting 19:07:01 (10002): No heartbeat from core client for 30 sec - exiting 19:07:02 (10002): No heartbeat from core client for 30 sec - exiting 19:07:03 (10002): No heartbeat from core client for 30 sec - exiting 19:07:04 (10002): No heartbeat from core client for 30 sec - exiting 19:07:05 (10002): No heartbeat from core client for 30 sec - exiting 19:07:06 (10002): No heartbeat from core client for 30 sec - exiting 19:07:07 (10002): No heartbeat from core client for 30 sec - exiting 19:07:08 (10002): No heartbeat from core client for 30 sec - exiting 19:07:09 (10002): No heartbeat from core client for 30 sec - exiting 19:07:10 (10002): No heartbeat from core client for 30 sec - exiting 19:07:11 (10002): No heartbeat from core client for 30 sec - exiting 19:07:12 (10002): No heartbeat from core client for 30 sec - exiting 19:07:13 (10002): No heartbeat from core client for 30 sec - exiting 19:07:14 (10002): No heartbeat from core client for 30 sec - exiting 19:07:15 (10002): No heartbeat from core client for 30 sec - exiting 19:07:16 (10002): No heartbeat from core client for 30 sec - exiting 19:07:17 (10002): No heartbeat from core client for 30 sec - exiting 19:07:18 (10002): No heartbeat from core client for 30 sec - exiting 19:07:19 (10002): No heartbeat from core client for 30 sec - exiting 19:07:20 (10002): No heartbeat from core client for 30 sec - exiting 19:07:21 (10002): No heartbeat from core client for 30 sec - exiting 19:07:22 (10002): No heartbeat from core client for 30 sec - exiting 19:07:23 (10002): No heartbeat from core client for 30 sec - exiting 19:07:24 (10002): No heartbeat from core client for 30 sec - exiting 19:07:25 (10002): No heartbeat from core client for 30 sec - exiting 19:07:26 (10002): No heartbeat from core client for 30 sec - exiting 19:07:27 (10002): No heartbeat from core client for 30 sec - exiting 19:07:28 (10002): No heartbeat from core client for 30 sec - exiting 19:07:29 (10002): No heartbeat from core client for 30 sec - exiting 19:09:45 (10002): No heartbeat from core client for 30 sec - exiting 19:09:46 (10002): No heartbeat from core client for 30 sec - exiting 19:09:47 (10002): No heartbeat from core client for 30 sec - exiting 19:09:48 (10002): No heartbeat from core client for 30 sec - exiting 19:09:49 (10002): No heartbeat from core client for 30 sec - exiting 19:09:50 (10002): No heartbeat from core client for 30 sec - exiting 19:09:51 (10002): No heartbeat from core client for 30 sec - exiting 19:09:52 (10002): No heartbeat from core client for 30 sec - exiting 19:09:53 (10002): No heartbeat from core client for 30 sec - exiting 19:09:54 (10002): No heartbeat from core client for 30 sec - exiting 19:09:55 (10002): No heartbeat from core client for 30 sec - exiting 19:09:56 (10002): No heartbeat from core client for 30 sec - exiting 19:09:57 (10002): No heartbeat from core client for 30 sec - exiting 19:09:58 (10002): No heartbeat from core client for 30 sec - exiting 19:09:59 (10002): No heartbeat from core client for 30 sec - exiting 19:10:00 (10002): No heartbeat from core client for 30 sec - exiting 19:10:01 (10002): No heartbeat from core client for 30 sec - exiting 19:10:02 (10002): No heartbeat from core client for 30 sec - exiting 19:10:03 (10002): No heartbeat from core client for 30 sec - exiting 19:10:04 (10002): No heartbeat from core client for 30 sec - exiting 19:10:05 (10002): No heartbeat from core client for 30 sec - exiting 19:10:06 (10002): No heartbeat from core client for 30 sec - exiting 19:10:07 (10002): No heartbeat from core client for 30 sec - exiting 19:10:08 (10002): No heartbeat from core client for 30 sec - exiting 19:10:09 (10002): No heartbeat from core client for 30 sec - exiting 19:10:10 (10002): No heartbeat from core client for 30 sec - exiting 19:10:11 (10002): No heartbeat from core client for 30 sec - exiting 19:10:12 (10002): No heartbeat from core client for 30 sec - exiting 19:10:13 (10002): No heartbeat from core client for 30 sec - exiting 19:10:14 (10002): No heartbeat from core client for 30 sec - exiting 19:10:15 (10002): No heartbeat from core client for 30 sec - exiting 19:10:16 (10002): No heartbeat from core client for 30 sec - exiting 19:10:17 (10002): No heartbeat from core client for 30 sec - exiting 19:10:18 (10002): No heartbeat from core client for 30 sec - exiting 19:10:19 (10002): No heartbeat from core client for 30 sec - exiting 19:10:20 (10002): No heartbeat from core client for 30 sec - exiting 19:10:21 (10002): No heartbeat from core client for 30 sec - exiting 19:10:22 (10002): No heartbeat from core client for 30 sec - exiting 19:10:23 (10002): No heartbeat from core client for 30 sec - exiting 19:10:24 (10002): No heartbeat from core client for 30 sec - exiting 19:10:25 (10002): No heartbeat from core client for 30 sec - exiting 19:10:26 (10002): No heartbeat from core client for 30 sec - exiting 19:10:27 (10002): No heartbeat from core client for 30 sec - exiting 19:10:28 (10002): No heartbeat from core client for 30 sec - exiting 19:10:29 (10002): No heartbeat from core client for 30 sec - exiting 19:10:30 (10002): No heartbeat from core client for 30 sec - exiting 19:10:31 (10002): No heartbeat from core client for 30 sec - exiting 19:10:32 (10002): No heartbeat from core client for 30 sec - exiting 19:10:33 (10002): No heartbeat from core client for 30 sec - exiting 19:10:34 (10002): No heartbeat from core client for 30 sec - exiting 19:10:35 (10002): No heartbeat from core client for 30 sec - exiting 19:13:02 (10002): No heartbeat from core client for 30 sec - exiting 19:13:03 (10002): No heartbeat from core client for 30 sec - exiting 19:13:04 (10002): No heartbeat from core client for 30 sec - exiting 19:13:05 (10002): No heartbeat from core client for 30 sec - exiting 19:13:06 (10002): No heartbeat from core client for 30 sec - exiting 19:13:07 (10002): No heartbeat from core client for 30 sec - exiting 19:13:08 (10002): No heartbeat from core client for 30 sec - exiting 19:13:09 (10002): No heartbeat from core client for 30 sec - exiting 19:13:10 (10002): No heartbeat from core client for 30 sec - exiting 19:13:11 (10002): No heartbeat from core client for 30 sec - exiting 19:13:12 (10002): No heartbeat from core client for 30 sec - exiting 19:13:13 (10002): No heartbeat from core client for 30 sec - exiting 19:13:14 (10002): No heartbeat from core client for 30 sec - exiting 19:13:15 (10002): No heartbeat from core client for 30 sec - exiting 19:13:16 (10002): No heartbeat from core client for 30 sec - exiting 19:13:17 (10002): No heartbeat from core client for 30 sec - exiting 19:13:18 (10002): No heartbeat from core client for 30 sec - exiting 19:13:19 (10002): No heartbeat from core client for 30 sec - exiting 19:13:20 (10002): No heartbeat from core client for 30 sec - exiting 19:13:21 (10002): No heartbeat from core client for 30 sec - exiting 19:13:22 (10002): No heartbeat from core client for 30 sec - exiting 19:13:23 (10002): No heartbeat from core client for 30 sec - exiting 19:13:24 (10002): No heartbeat from core client for 30 sec - exiting 19:13:25 (10002): No heartbeat from core client for 30 sec - exiting 19:13:26 (10002): No heartbeat from core client for 30 sec - exiting 19:13:27 (10002): No heartbeat from core client for 30 sec - exiting 19:13:28 (10002): No heartbeat from core client for 30 sec - exiting 19:13:29 (10002): No heartbeat from core client for 30 sec - exiting 19:13:30 (10002): No heartbeat from core client for 30 sec - exiting 19:13:31 (10002): No heartbeat from core client for 30 sec - exiting 19:13:32 (10002): No heartbeat from core client for 30 sec - exiting 19:13:33 (10002): No heartbeat from core client for 30 sec - exiting 19:13:34 (10002): No heartbeat from core client for 30 sec - exiting 19:13:35 (10002): No heartbeat from core client for 30 sec - exiting 19:13:36 (10002): No heartbeat from core client for 30 sec - exiting 19:13:37 (10002): No heartbeat from core client for 30 sec - exiting 19:13:38 (10002): No heartbeat from core client for 30 sec - exiting 19:13:39 (10002): No heartbeat from core client for 30 sec - exiting 19:13:40 (10002): No heartbeat from core client for 30 sec - exiting 19:13:41 (10002): No heartbeat from core client for 30 sec - exiting 19:13:43 (10002): No heartbeat from core client for 30 sec - exiting 19:13:44 (10002): No heartbeat from core client for 30 sec - exiting 19:13:45 (10002): No heartbeat from core client for 30 sec - exiting 19:13:46 (10002): No heartbeat from core client for 30 sec - exiting 19:13:47 (10002): No heartbeat from core client for 30 sec - exiting 19:13:48 (10002): No heartbeat from core client for 30 sec - exiting 19:13:49 (10002): No heartbeat from core client for 30 sec - exiting 19:13:50 (10002): No heartbeat from core client for 30 sec - exiting 19:13:51 (10002): No heartbeat from core client for 30 sec - exiting 19:13:52 (10002): No heartbeat from core client for 30 sec - exiting 19:13:53 (10002): No heartbeat from core client for 30 sec - exiting 19:16:05 (10002): No heartbeat from core client for 30 sec - exiting 19:16:06 (10002): No heartbeat from core client for 30 sec - exiting 19:16:07 (10002): No heartbeat from core client for 30 sec - exiting 19:16:08 (10002): No heartbeat from core client for 30 sec - exiting 19:16:09 (10002): No heartbeat from core client for 30 sec - exiting 19:16:10 (10002): No heartbeat from core client for 30 sec - exiting 19:16:11 (10002): No heartbeat from core client for 30 sec - exiting 19:16:12 (10002): No heartbeat from core client for 30 sec - exiting 19:16:13 (10002): No heartbeat from core client for 30 sec - exiting 19:16:14 (10002): No heartbeat from core client for 30 sec - exiting 19:16:15 (10002): No heartbeat from core client for 30 sec - exiting 19:16:16 (10002): No heartbeat from core client for 30 sec - exiting 19:16:17 (10002): No heartbeat from core client for 30 sec - exiting 19:16:18 (10002): No heartbeat from core client for 30 sec - exiting 19:16:19 (10002): No heartbeat from core client for 30 sec - exiting 19:16:20 (10002): No heartbeat from core client for 30 sec - exiting 19:16:21 (10002): No heartbeat from core client for 30 sec - exiting 19:16:22 (10002): No heartbeat from core client for 30 sec - exiting 19:16:23 (10002): No heartbeat from core client for 30 sec - exiting 19:16:24 (10002): No heartbeat from core client for 30 sec - exiting 19:16:25 (10002): No heartbeat from core client for 30 sec - exiting 19:16:26 (10002): No heartbeat from core client for 30 sec - exiting 19:16:27 (10002): No heartbeat from core client for 30 sec - exiting 19:16:28 (10002): No heartbeat from core client for 30 sec - exiting 19:16:29 (10002): No heartbeat from core client for 30 sec - exiting 19:16:30 (10002): No heartbeat from core client for 30 sec - exiting 19:16:31 (10002): No heartbeat from core client for 30 sec - exiting 19:16:32 (10002): No heartbeat from core client for 30 sec - exiting 19:16:33 (10002): No heartbeat from core client for 30 sec - exiting 19:16:34 (10002): No heartbeat from core client for 30 sec - exiting 19:16:35 (10002): No heartbeat from core client for 30 sec - exiting 19:16:36 (10002): No heartbeat from core client for 30 sec - exiting 19:16:37 (10002): No heartbeat from core client for 30 sec - exiting 19:16:38 (10002): No heartbeat from core client for 30 sec - exiting 19:16:39 (10002): No heartbeat from core client for 30 sec - exiting 19:16:40 (10002): No heartbeat from core client for 30 sec - exiting 19:16:41 (10002): No heartbeat from core client for 30 sec - exiting 19:16:42 (10002): No heartbeat from core client for 30 sec - exiting 19:16:43 (10002): No heartbeat from core client for 30 sec - exiting 19:16:44 (10002): No heartbeat from core client for 30 sec - exiting 19:16:45 (10002): No heartbeat from core client for 30 sec - exiting 19:16:46 (10002): No heartbeat from core client for 30 sec - exiting 19:16:47 (10002): No heartbeat from core client for 30 sec - exiting 19:16:48 (10002): No heartbeat from core client for 30 sec - exiting 19:16:49 (10002): No heartbeat from core client for 30 sec - exiting 19:16:50 (10002): No heartbeat from core client for 30 sec - exiting 19:16:51 (10002): No heartbeat from core client for 30 sec - exiting 19:16:52 (10002): No heartbeat from core client for 30 sec - exiting 19:16:53 (10002): No heartbeat from core client for 30 sec - exiting 19:16:54 (10002): No heartbeat from core client for 30 sec - exiting 19:16:55 (10002): No heartbeat from core client for 30 sec - exiting 19:18:46 (10002): No heartbeat from core client for 30 sec - exiting 19:18:47 (10002): No heartbeat from core client for 30 sec - exiting 19:18:48 (10002): No heartbeat from core client for 30 sec - exiting 19:18:49 (10002): No heartbeat from core client for 30 sec - exiting 19:18:50 (10002): No heartbeat from core client for 30 sec - exiting 19:18:51 (10002): No heartbeat from core client for 30 sec - exiting 19:18:52 (10002): No heartbeat from core client for 30 sec - exiting 19:18:53 (10002): No heartbeat from core client for 30 sec - exiting 19:18:54 (10002): No heartbeat from core client for 30 sec - exiting 19:18:55 (10002): No heartbeat from core client for 30 sec - exiting 19:18:56 (10002): No heartbeat from core client for 30 sec - exiting 19:18:57 (10002): No heartbeat from core client for 30 sec - exiting 19:18:58 (10002): No heartbeat from core client for 30 sec - exiting 19:18:59 (10002): No heartbeat from core client for 30 sec - exiting 19:19:00 (10002): No heartbeat from core client for 30 sec - exiting 19:19:01 (10002): No heartbeat from core client for 30 sec - exiting 19:19:02 (10002): No heartbeat from core client for 30 sec - exiting 19:19:03 (10002): No heartbeat from core client for 30 sec - exiting 19:19:04 (10002): No heartbeat from core client for 30 sec - exiting 19:19:05 (10002): No heartbeat from core client for 30 sec - exiting 19:19:06 (10002): No heartbeat from core client for 30 sec - exiting 19:19:07 (10002): No heartbeat from core client for 30 sec - exiting 19:19:08 (10002): No heartbeat from core client for 30 sec - exiting 19:19:09 (10002): No heartbeat from core client for 30 sec - exiting 19:19:10 (10002): No heartbeat from core client for 30 sec - exiting 19:19:11 (10002): No heartbeat from core client for 30 sec - exiting 19:19:12 (10002): No heartbeat from core client for 30 sec - exiting 19:19:13 (10002): No heartbeat from core client for 30 sec - exiting 19:19:14 (10002): No heartbeat from core client for 30 sec - exiting 19:19:15 (10002): No heartbeat from core client for 30 sec - exiting 19:19:16 (10002): No heartbeat from core client for 30 sec - exiting 19:19:17 (10002): No heartbeat from core client for 30 sec - exiting 19:19:18 (10002): No heartbeat from core client for 30 sec - exiting 19:19:19 (10002): No heartbeat from core client for 30 sec - exiting 19:19:20 (10002): No heartbeat from core client for 30 sec - exiting 19:19:21 (10002): No heartbeat from core client for 30 sec - exiting 19:19:22 (10002): No heartbeat from core client for 30 sec - exiting 19:19:23 (10002): No heartbeat from core client for 30 sec - exiting 19:19:24 (10002): No heartbeat from core client for 30 sec - exiting 19:19:25 (10002): No heartbeat from core client for 30 sec - exiting 19:19:26 (10002): No heartbeat from core client for 30 sec - exiting 19:19:27 (10002): No heartbeat from core client for 30 sec - exiting 19:19:28 (10002): No heartbeat from core client for 30 sec - exiting 19:19:29 (10002): No heartbeat from core client for 30 sec - exiting 19:19:30 (10002): No heartbeat from core client for 30 sec - exiting 19:19:31 (10002): No heartbeat from core client for 30 sec - exiting 19:19:32 (10002): No heartbeat from core client for 30 sec - exiting 19:19:33 (10002): No heartbeat from core client for 30 sec - exiting 19:19:34 (10002): No heartbeat from core client for 30 sec - exiting 19:19:35 (10002): No heartbeat from core client for 30 sec - exiting 19:19:36 (10002): No heartbeat from core client for 30 sec - exiting 19:19:37 (10002): No heartbeat from core client for 30 sec - exiting 19:19:38 (10002): No heartbeat from core client for 30 sec - exiting 19:19:39 (10002): No heartbeat from core client for 30 sec - exiting 19:19:40 (10002): No heartbeat from core client for 30 sec - exiting 19:19:41 (10002): No heartbeat from core client for 30 sec - exiting 19:19:42 (10002): No heartbeat from core client for 30 sec - exiting 19:19:43 (10002): No heartbeat from core client for 30 sec - exiting 19:19:44 (10002): No heartbeat from core client for 30 sec - exiting 19:19:45 (10002): No heartbeat from core client for 30 sec - exiting 19:19:46 (10002): No heartbeat from core client for 30 sec - exiting 19:19:47 (10002): No heartbeat from core client for 30 sec - exiting 19:19:48 (10002): No heartbeat from core client for 30 sec - exiting 19:19:49 (10002): No heartbeat from core client for 30 sec - exiting 19:19:50 (10002): No heartbeat from core client for 30 sec - exiting 19:19:51 (10002): No heartbeat from core client for 30 sec - exiting *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08e6f0c0 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x093800c0 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called 09:31:26 (3887): No heartbeat from core client for 30 sec - exiting 09:31:27 (3887): No heartbeat from core client for 30 sec - exiting 09:31:28 (3887): No heartbeat from core client for 30 sec - exiting 09:31:29 (3887): No heartbeat from core client for 30 sec - exiting 09:31:30 (3887): No heartbeat from core client for 30 sec - exiting 09:31:31 (3887): No heartbeat from core client for 30 sec - exiting 09:31:32 (3887): No heartbeat from core client for 30 sec - exiting 09:31:33 (3887): No heartbeat from core client for 30 sec - exiting 09:31:34 (3887): No heartbeat from core client for 30 sec - exiting 09:31:35 (3887): No heartbeat from core client for 30 sec - exiting 09:31:36 (3887): No heartbeat from core client for 30 sec - exiting 09:31:37 (3887): No heartbeat from core client for 30 sec - exiting 09:31:38 (3887): No heartbeat from core client for 30 sec - exiting 09:31:39 (3887): No heartbeat from core client for 30 sec - exiting 09:31:40 (3887): No heartbeat from core client for 30 sec - exiting 09:31:41 (3887): No heartbeat from core client for 30 sec - exiting 09:31:42 (3887): No heartbeat from core client for 30 sec - exiting 09:31:43 (3887): No heartbeat from core client for 30 sec - exiting 09:31:44 (3887): No heartbeat from core client for 30 sec - exiting 09:31:45 (3887): No heartbeat from core client for 30 sec - exiting 09:31:46 (3887): No heartbeat from core client for 30 sec - exiting 09:31:47 (3887): No heartbeat from core client for 30 sec - exiting 09:31:48 (3887): No heartbeat from core client for 30 sec - exiting 09:31:49 (3887): No heartbeat from core client for 30 sec - exiting 09:31:50 (3887): No heartbeat from core client for 30 sec - exiting 09:31:51 (3887): No heartbeat from core client for 30 sec - exiting 09:31:52 (3887): No heartbeat from core client for 30 sec - exiting 09:31:53 (3887): No heartbeat from core client for 30 sec - exiting 09:31:54 (3887): No heartbeat from core client for 30 sec - exiting 09:31:55 (3887): No heartbeat from core client for 30 sec - exiting 09:31:56 (3887): No heartbeat from core client for 30 sec - exiting 09:31:57 (3887): No heartbeat from core client for 30 sec - exiting 09:31:58 (3887): No heartbeat from core client for 30 sec - exiting 09:31:59 (3887): No heartbeat from core client for 30 sec - exiting 09:32:00 (3887): No heartbeat from core client for 30 sec - exiting 09:32:01 (3887): No heartbeat from core client for 30 sec - exiting 09:32:02 (3887): No heartbeat from core client for 30 sec - exiting 09:32:03 (3887): No heartbeat from core client for 30 sec - exiting 09:32:04 (3887): No heartbeat from core client for 30 sec - exiting 09:32:05 (3887): No heartbeat from core client for 30 sec - exiting 09:32:06 (3887): No heartbeat from core client for 30 sec - exiting 09:32:07 (3887): No heartbeat from core client for 30 sec - exiting 09:32:08 (3887): No heartbeat from core client for 30 sec - exiting 09:32:09 (3887): No heartbeat from core client for 30 sec - exiting 09:32:10 (3887): No heartbeat from core client for 30 sec - exiting 09:32:11 (3887): No heartbeat from core client for 30 sec - exiting 09:32:12 (3887): No heartbeat from core client for 30 sec - exiting 09:32:13 (3887): No heartbeat from core client for 30 sec - exiting 09:32:14 (3887): No heartbeat from core client for 30 sec - exiting 09:32:15 (3887): No heartbeat from core client for 30 sec - exiting 09:32:16 (3887): No heartbeat from core client for 30 sec - exiting 09:32:17 (3887): No heartbeat from core client for 30 sec - exiting 09:33:18 (3887): No heartbeat from core client for 30 sec - exiting 09:33:19 (3887): No heartbeat from core client for 30 sec - exiting 09:33:20 (3887): No heartbeat from core client for 30 sec - exiting 09:33:21 (3887): No heartbeat from core client for 30 sec - exiting 09:33:22 (3887): No heartbeat from core client for 30 sec - exiting 09:33:23 (3887): No heartbeat from core client for 30 sec - exiting *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x087df0c0 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x0929e0c0 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x0a0dc0c0 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08eb30c0 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called 23:59:19 (9894): No heartbeat from core client for 30 sec - exiting 23:59:20 (9894): No heartbeat from core client for 30 sec - exiting 23:59:21 (9894): No heartbeat from core client for 30 sec - exiting 23:59:22 (9894): No heartbeat from core client for 30 sec - exiting 23:59:23 (9894): No heartbeat from core client for 30 sec - exiting 23:59:24 (9894): No heartbeat from core client for 30 sec - exiting 23:59:25 (9894): No heartbeat from core client for 30 sec - exiting 23:59:26 (9894): No heartbeat from core client for 30 sec - exiting 23:59:27 (9894): No heartbeat from core client for 30 sec - exiting 23:59:28 (9894): No heartbeat from core client for 30 sec - exiting 23:59:29 (9894): No heartbeat from core client for 30 sec - exiting 23:59:30 (9894): No heartbeat from core client for 30 sec - exiting 23:59:31 (9894): No heartbeat from core client for 30 sec - exiting 23:59:32 (9894): No heartbeat from core client for 30 sec - exiting 23:59:33 (9894): No heartbeat from core client for 30 sec - exiting 23:59:34 (9894): No heartbeat from core client for 30 sec - exiting 23:59:35 (9894): No heartbeat from core client for 30 sec - exiting 23:59:36 (9894): No heartbeat from core client for 30 sec - exiting 23:59:37 (9894): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08746158 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x090c70c0 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called 08:24:27 (6463): No heartbeat from core client for 30 sec - exiting 08:24:28 (6463): No heartbeat from core client for 30 sec - exiting 08:24:29 (6463): No heartbeat from core client for 30 sec - exiting 08:24:30 (6463): No heartbeat from core client for 30 sec - exiting 08:24:31 (6463): No heartbeat from core client for 30 sec - exiting 08:24:32 (6463): No heartbeat from core client for 30 sec - exiting 08:24:33 (6463): No heartbeat from core client for 30 sec - exiting 08:24:34 (6463): No heartbeat from core client for 30 sec - exiting 08:24:35 (6463): No heartbeat from core client for 30 sec - exiting 08:24:36 (6463): No heartbeat from core client for 30 sec - exiting 08:24:37 (6463): No heartbeat from core client for 30 sec - exiting 08:24:38 (6463): No heartbeat from core client for 30 sec - exiting 08:24:39 (6463): No heartbeat from core client for 30 sec - exiting 08:24:40 (6463): No heartbeat from core client for 30 sec - exiting 08:24:41 (6463): No heartbeat from core client for 30 sec - exiting 08:24:42 (6463): No heartbeat from core client for 30 sec - exiting 08:24:43 (6463): No heartbeat from core client for 30 sec - exiting 08:24:44 (6463): No heartbeat from core client for 30 sec - exiting 08:24:45 (6463): No heartbeat from core client for 30 sec - exiting 08:24:46 (6463): No heartbeat from core client for 30 sec - exiting 08:24:47 (6463): No heartbeat from core client for 30 sec - exiting 08:24:48 (6463): No heartbeat from core client for 30 sec - exiting 08:24:49 (6463): No heartbeat from core client for 30 sec - exiting 08:24:50 (6463): No heartbeat from core client for 30 sec - exiting 08:24:51 (6463): No heartbeat from core client for 30 sec - exiting 08:24:52 (6463): No heartbeat from core client for 30 sec - exiting 08:24:53 (6463): No heartbeat from core client for 30 sec - exiting 08:24:54 (6463): No heartbeat from core client for 30 sec - exiting 08:24:55 (6463): No heartbeat from core client for 30 sec - exiting 08:24:56 (6463): No heartbeat from core client for 30 sec - exiting 08:24:57 (6463): No heartbeat from core client for 30 sec - exiting 08:24:58 (6463): No heartbeat from core client for 30 sec - exiting 08:24:59 (6463): No heartbeat from core client for 30 sec - exiting 08:25:00 (6463): No heartbeat from core client for 30 sec - exiting 08:25:01 (6463): No heartbeat from core client for 30 sec - exiting 08:25:02 (6463): No heartbeat from core client for 30 sec - exiting 08:25:03 (6463): No heartbeat from core client for 30 sec - exiting 08:25:04 (6463): No heartbeat from core client for 30 sec - exiting 08:25:05 (6463): No heartbeat from core client for 30 sec - exiting 08:25:06 (6463): No heartbeat from core client for 30 sec - exiting 08:25:07 (6463): No heartbeat from core client for 30 sec - exiting 08:25:08 (6463): No heartbeat from core client for 30 sec - exiting 08:25:09 (6463): No heartbeat from core client for 30 sec - exiting 08:25:10 (6463): No heartbeat from core client for 30 sec - exiting 08:25:11 (6463): No heartbeat from core client for 30 sec - exiting 08:25:12 (6463): No heartbeat from core client for 30 sec - exiting 08:25:13 (6463): No heartbeat from core client for 30 sec - exiting 08:25:14 (6463): No heartbeat from core client for 30 sec - exiting 08:25:15 (6463): No heartbeat from core client for 30 sec - exiting 08:25:16 (6463): No heartbeat from core client for 30 sec - exiting 08:25:17 (6463): No heartbeat from core client for 30 sec - exiting 13:55:03 (6463): No heartbeat from core client for 30 sec - exiting 13:55:04 (6463): No heartbeat from core client for 30 sec - exiting 13:55:05 (6463): No heartbeat from core client for 30 sec - exiting 13:55:06 (6463): No heartbeat from core client for 30 sec - exiting 13:55:07 (6463): No heartbeat from core client for 30 sec - exiting 13:55:08 (6463): No heartbeat from core client for 30 sec - exiting 13:55:09 (6463): No heartbeat from core client for 30 sec - exiting 13:55:10 (6463): No heartbeat from core client for 30 sec - exiting 13:55:12 (6463): No heartbeat from core client for 30 sec - exiting 13:55:13 (6463): No heartbeat from core client for 30 sec - exiting 13:55:14 (6463): No heartbeat from core client for 30 sec - exiting 13:55:15 (6463): No heartbeat from core client for 30 sec - exiting 13:55:16 (6463): No heartbeat from core client for 30 sec - exiting 13:55:17 (6463): No heartbeat from core client for 30 sec - exiting 13:55:18 (6463): No heartbeat from core client for 30 sec - exiting 13:55:19 (6463): No heartbeat from core client for 30 sec - exiting 13:55:20 (6463): No heartbeat from core client for 30 sec - exiting 13:55:21 (6463): No heartbeat from core client for 30 sec - exiting 13:55:22 (6463): No heartbeat from core client for 30 sec - exiting 13:55:23 (6463): No heartbeat from core client for 30 sec - exiting 13:55:24 (6463): No heartbeat from core client for 30 sec - exiting 13:55:25 (6463): No heartbeat from core client for 30 sec - exiting 13:55:26 (6463): No heartbeat from core client for 30 sec - exiting 13:55:27 (6463): No heartbeat from core client for 30 sec - exiting 13:55:28 (6463): No heartbeat from core client for 30 sec - exiting 13:55:29 (6463): No heartbeat from core client for 30 sec - exiting 13:55:30 (6463): No heartbeat from core client for 30 sec - exiting 13:55:31 (6463): No heartbeat from core client for 30 sec - exiting 13:55:32 (6463): No heartbeat from core client for 30 sec - exiting 13:55:33 (6463): No heartbeat from core client for 30 sec - exiting *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09a400c0 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x0993b0c0 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called </stderr_txt> ]]> |
Latest Trickles Received | ||||||
---|---|---|---|---|---|---|
Time Sent (UTC) | Host ID | Result ID | Result Name | Timestep | CPU Time (sec) | Average (sec/TS) |
03 Feb 2014 13:01:58 | 1260982 | 16222615 | hadcm3n_7e9a_1980_40_008429761_1 | 518,400 | 763,250 | 1.4723 |
02 Feb 2014 15:32:54 | 1260982 | 16222615 | hadcm3n_7e9a_1980_40_008429761_1 | 492,480 | 726,014 | 1.4742 |
01 Feb 2014 12:57:55 | 1260982 | 16222615 | hadcm3n_7e9a_1980_40_008429761_1 | 466,560 | 688,739 | 1.4762 |
01 Feb 2014 05:11:08 | 1260982 | 16222615 | hadcm3n_7e9a_1980_40_008429761_1 | 440,640 | 650,583 | 1.4765 |
01 Feb 2014 05:11:08 | 1260982 | 16222615 | hadcm3n_7e9a_1980_40_008429761_1 | 414,720 | 612,459 | 1.4768 |
01 Feb 2014 05:11:08 | 1260982 | 16222615 | hadcm3n_7e9a_1980_40_008429761_1 | 388,800 | 576,310 | 1.4823 |
01 Feb 2014 05:11:08 | 1260982 | 16222615 | hadcm3n_7e9a_1980_40_008429761_1 | 362,880 | 538,748 | 1.4846 |
27 Jan 2014 00:16:03 | 1260982 | 16222615 | hadcm3n_7e9a_1980_40_008429761_1 | 336,960 | 499,721 | 1.4830 |
25 Jan 2014 21:34:50 | 1260982 | 16222615 | hadcm3n_7e9a_1980_40_008429761_1 | 311,040 | 461,463 | 1.4836 |
24 Jan 2014 23:40:27 | 1260982 | 16222615 | hadcm3n_7e9a_1980_40_008429761_1 | 285,120 | 423,867 | 1.4866 |
24 Jan 2014 11:36:42 | 1260982 | 16222615 | hadcm3n_7e9a_1980_40_008429761_1 | 259,200 | 385,649 | 1.4878 |
22 Jan 2014 11:59:05 | 1260982 | 16222615 | hadcm3n_7e9a_1980_40_008429761_1 | 233,280 | 346,350 | 1.4847 |
21 Jan 2014 09:45:08 | 1260982 | 16222615 | hadcm3n_7e9a_1980_40_008429761_1 | 207,360 | 307,500 | 1.4829 |
20 Jan 2014 14:01:36 | 1260982 | 16222615 | hadcm3n_7e9a_1980_40_008429761_1 | 181,440 | 270,008 | 1.4881 |
19 Jan 2014 20:52:43 | 1260982 | 16222615 | hadcm3n_7e9a_1980_40_008429761_1 | 155,520 | 231,511 | 1.4886 |
17 Jan 2014 19:03:45 | 1260982 | 16222615 | hadcm3n_7e9a_1980_40_008429761_1 | 129,600 | 192,606 | 1.4862 |
16 Jan 2014 23:44:46 | 1260982 | 16222615 | hadcm3n_7e9a_1980_40_008429761_1 | 103,680 | 154,501 | 1.4902 |
16 Jan 2014 07:13:09 | 1260982 | 16222615 | hadcm3n_7e9a_1980_40_008429761_1 | 77,760 | 117,125 | 1.5062 |
15 Jan 2014 14:15:38 | 1260982 | 16222615 | hadcm3n_7e9a_1980_40_008429761_1 | 51,840 | 78,897 | 1.5219 |
14 Jan 2014 20:45:51 | 1260982 | 16222615 | hadcm3n_7e9a_1980_40_008429761_1 | 25,920 | 39,447 | 1.5219 |
©2024 cpdn.org