Name | hadcm3n_4hos_1940_40_008303176_2 |
Workunit | 8454311 |
Created | 4 Mar 2013, 15:39:15 UTC |
Sent | 4 Mar 2013, 15:39:21 UTC |
Report deadline | 3 Jun 2013, 23:06:32 UTC |
Received | 31 Jul 2015, 21:19:54 UTC |
Server state | Over |
Outcome | Computation error |
Client state | Aborted by user |
Exit status | 203 (0x000000CB) EXIT_ABORTED_VIA_GUI |
Computer ID | 889885 |
Run time | 32 days 7 hours 5 min 55 sec |
CPU time | 26 days 18 hours 10 min 55 sec |
Validate state | Invalid |
Credit | 12,441.60 |
Device peak FLOPS | 2.40 GFLOPS |
Application version | UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu |
Stderr | <core_client_version>7.2.0</core_client_version> <![CDATA[ <message> aborted by user </message> <stderr_txt> (2999): No heartbeat from core client for 30 sec - exiting 13:39:16 (2999): No heartbeat from core client for 30 sec - exiting 13:39:17 (2999): No heartbeat from core client for 30 sec - exiting 13:39:18 (2999): No heartbeat from core client for 30 sec - exiting 13:39:19 (2999): No heartbeat from core client for 30 sec - exiting 13:39:20 (2999): No heartbeat from core client for 30 sec - exiting Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish *** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x08c4a848 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2369: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 *(sizeof(size_t))) - 1)) & ~((2 *(sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed. SIGABRT: abort called Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish 21:32:19 (2836): No heartbeat from core client for 30 sec - exiting *** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x08f37848 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2369: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 *(sizeof(size_t))) - 1)) & ~((2 *(sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed. SIGABRT: abort called 21:32:21 (2836): No heartbeat from core client for 30 sec - exiting 21:32:22 (2836): No heartbeat from core client for 30 sec - exiting 21:32:23 (2836): No heartbeat from core client for 30 sec - exiting 21:32:24 (2836): No heartbeat from core client for 30 sec - exiting 21:32:25 (2836): No heartbeat from core client for 30 sec - exiting 21:32:26 (2836): No heartbeat from core client for 30 sec - exiting 21:32:27 (2836): No heartbeat from core client for 30 sec - exiting 21:32:28 (2836): No heartbeat from core client for 30 sec - exiting 21:32:29 (2836): No heartbeat from core client for 30 sec - exiting 21:32:30 (2836): No heartbeat from core client for 30 sec - exiting *** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x09299830 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2368: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 *(sizeof(size_t))) - 1)) & ~((2 *(sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed. SIGABRT: abort called Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish *** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x09906830 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2368: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 *(sizeof(size_t))) - 1)) & ~((2 *(sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed. SIGABRT: abort called *** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x0a02a830 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2368: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 *(sizeof(size_t))) - 1)) & ~((2 *(sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed. SIGABRT: abort called Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish *** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x09965830 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2368: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 *(sizeof(size_t))) - 1)) & ~((2 *(sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed. SIGABRT: abort called Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish *** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x09d80830 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2368: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 *(sizeof(size_t))) - 1)) & ~((2 *(sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed. SIGABRT: abort called Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish *** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x0933b830 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2368: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 *(sizeof(size_t))) - 1)) & ~((2 *(sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed. SIGABRT: abort called Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish *** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x0941b830 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2368: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 *(sizeof(size_t))) - 1)) & ~((2 *(sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed. SIGABRT: abort called 19:27:21 (3150): No heartbeat from core client for 30 sec - exiting 10:28:15 (3150): No heartbeat from core client for 30 sec - exiting 10:28:16 (3150): No heartbeat from core client for 30 sec - exiting 10:28:17 (3150): No heartbeat from core client for 30 sec - exiting 10:28:18 (3150): No heartbeat from core client for 30 sec - exiting 10:28:19 (3150): No heartbeat from core client for 30 sec - exiting 10:28:20 (3150): No heartbeat from core client for 30 sec - exiting 10:28:21 (3150): No heartbeat from core client for 30 sec - exiting 10:28:22 (3150): No heartbeat from core client for 30 sec - exiting 14:44:49 (3150): No heartbeat from core client for 30 sec - exiting 18:00:17 (3150): No heartbeat from core client for 30 sec - exiting *** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x0946a830 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2368: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 *(sizeof(size_t))) - 1)) & ~((2 *(sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed. SIGABRT: abort called 07:18:21 (2554): No heartbeat from core client for 30 sec - exiting 07:18:22 (2554): No heartbeat from core client for 30 sec - exiting 07:18:23 (2554): No heartbeat from core client for 30 sec - exiting 07:18:24 (2554): No heartbeat from core client for 30 sec - exiting *** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x08d27830 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2368: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 *(sizeof(size_t))) - 1)) & ~((2 *(sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed. SIGABRT: abort called 10:29:45 (2648): No heartbeat from core client for 30 sec - exiting 10:29:49 (2648): No heartbeat from core client for 30 sec - exiting 10:29:50 (2648): No heartbeat from core client for 30 sec - exiting Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish *** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x08b41830 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2368: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 *(sizeof(size_t))) - 1)) & ~((2 *(sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed. SIGABRT: abort called *** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x08da6830 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2368: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 *(sizeof(size_t))) - 1)) & ~((2 *(sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed. SIGABRT: abort called *** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x08294848 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2368: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 *(sizeof(size_t))) - 1)) & ~((2 *(sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed. SIGABRT: abort called Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish *** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x08fbd848 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2368: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 *(sizeof(size_t))) - 1)) & ~((2 *(sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed. SIGABRT: abort called Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish *** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x084d3848 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2368: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 *(sizeof(size_t))) - 1)) & ~((2 *(sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed. SIGABRT: abort called Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish *** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x09b40848 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2368: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 *(sizeof(size_t))) - 1)) & ~((2 *(sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed. SIGABRT: abort called 14:10:18 (2569): No heartbeat from core client for 30 sec - exiting 14:10:26 (2569): No heartbeat from core client for 30 sec - exiting 14:10:27 (2569): No heartbeat from core client for 30 sec - exiting 14:10:28 (2569): No heartbeat from core client for 30 sec - exiting 14:10:29 (2569): No heartbeat from core client for 30 sec - exiting 14:10:30 (2569): No heartbeat from core client for 30 sec - exiting 14:10:31 (2569): No heartbeat from core client for 30 sec - exiting 14:10:32 (2569): No heartbeat from core client for 30 sec - exiting 14:10:33 (2569): No heartbeat from core client for 30 sec - exiting 14:10:34 (2569): No heartbeat from core client for 30 sec - exiting 14:10:35 (2569): No heartbeat from core client for 30 sec - exiting 14:10:36 (2569): No heartbeat from core client for 30 sec - exiting 14:10:37 (2569): No heartbeat from core client for 30 sec - exiting 14:10:38 (2569): No heartbeat from core client for 30 sec - exiting 14:10:39 (2569): No heartbeat from core client for 30 sec - exiting 14:10:40 (2569): No heartbeat from core client for 30 sec - exiting 14:10:41 (2569): No heartbeat from core client for 30 sec - exiting 14:10:42 (2569): No heartbeat from core client for 30 sec - exiting 14:10:43 (2569): No heartbeat from core client for 30 sec - exiting 14:10:44 (2569): No heartbeat from core client for 30 sec - exiting 14:10:45 (2569): No heartbeat from core client for 30 sec - exiting 14:10:46 (2569): No heartbeat from core client for 30 sec - exiting 14:10:47 (2569): No heartbeat from core client for 30 sec - exiting 14:10:48 (2569): No heartbeat from core client for 30 sec - exiting 14:10:49 (2569): No heartbeat from core client for 30 sec - exiting 14:10:50 (2569): No heartbeat from core client for 30 sec - exiting 14:10:51 (2569): No heartbeat from core client for 30 sec - exiting 14:10:52 (2569): No heartbeat from core client for 30 sec - exiting 14:10:53 (2569): No heartbeat from core client for 30 sec - exiting 14:10:54 (2569): No heartbeat from core client for 30 sec - exiting 14:10:55 (2569): No heartbeat from core client for 30 sec - exiting 14:10:56 (2569): No heartbeat from core client for 30 sec - exiting 14:10:57 (2569): No heartbeat from core client for 30 sec - exiting 14:10:58 (2569): No heartbeat from core client for 30 sec - exiting 14:10:59 (2569): No heartbeat from core client for 30 sec - exiting 14:11:00 (2569): No heartbeat from core client for 30 sec - exiting 14:11:01 (2569): No heartbeat from core client for 30 sec - exiting 14:11:02 (2569): No heartbeat from core client for 30 sec - exiting 14:11:03 (2569): No heartbeat from core client for 30 sec - exiting 14:11:04 (2569): No heartbeat from core client for 30 sec - exiting 14:11:05 (2569): No heartbeat from core client for 30 sec - exiting 14:11:06 (2569): No heartbeat from core client for 30 sec - exiting 14:11:07 (2569): No heartbeat from core client for 30 sec - exiting 14:11:08 (2569): No heartbeat from core client for 30 sec - exiting 14:11:09 (2569): No heartbeat from core client for 30 sec - exiting 14:11:10 (2569): No heartbeat from core client for 30 sec - exiting 14:11:11 (2569): No heartbeat from core client for 30 sec - exiting 14:11:12 (2569): No heartbeat from core client for 30 sec - exiting 14:11:13 (2569): No heartbeat from core client for 30 sec - exiting 14:11:14 (2569): No heartbeat from core client for 30 sec - exiting 14:11:15 (2569): No heartbeat from core client for 30 sec - exiting 14:11:16 (2569): No heartbeat from core client for 30 sec - exiting 14:11:17 (2569): No heartbeat from core client for 30 sec - exiting 14:11:18 (2569): No heartbeat from core client for 30 sec - exiting 14:11:19 (2569): No heartbeat from core client for 30 sec - exiting 14:11:20 (2569): No heartbeat from core client for 30 sec - exiting 14:11:21 (2569): No heartbeat from core client for 30 sec - exiting 14:11:22 (2569): No heartbeat from core client for 30 sec - exiting 14:11:23 (2569): No heartbeat from core client for 30 sec - exiting 14:11:24 (2569): No heartbeat from core client for 30 sec - exiting 14:11:25 (2569): No heartbeat from core client for 30 sec - exiting 14:11:26 (2569): No heartbeat from core client for 30 sec - exiting 14:11:27 (2569): No heartbeat from core client for 30 sec - exiting 14:11:28 (2569): No heartbeat from core client for 30 sec - exiting 14:11:29 (2569): No heartbeat from core client for 30 sec - exiting 14:11:30 (2569): No heartbeat from core client for 30 sec - exiting 14:11:31 (2569): No heartbeat from core client for 30 sec - exiting 14:11:32 (2569): No heartbeat from core client for 30 sec - exiting 14:11:33 (2569): No heartbeat from core client for 30 sec - exiting 14:11:34 (2569): No heartbeat from core client for 30 sec - exiting 14:11:35 (2569): No heartbeat from core client for 30 sec - exiting 14:11:36 (2569): No heartbeat from core client for 30 sec - exiting 14:11:37 (2569): No heartbeat from core client for 30 sec - exiting 14:11:38 (2569): No heartbeat from core client for 30 sec - exiting 14:11:39 (2569): No heartbeat from core client for 30 sec - exiting 14:11:40 (2569): No heartbeat from core client for 30 sec - exiting 14:11:41 (2569): No heartbeat from core client for 30 sec - exiting 14:11:42 (2569): No heartbeat from core client for 30 sec - exiting 14:11:43 (2569): No heartbeat from core client for 30 sec - exiting 14:11:44 (2569): No heartbeat from core client for 30 sec - exiting 14:11:45 (2569): No heartbeat from core client for 30 sec - exiting 14:11:46 (2569): No heartbeat from core client for 30 sec - exiting 14:11:47 (2569): No heartbeat from core client for 30 sec - exiting 14:11:48 (2569): No heartbeat from core client for 30 sec - exiting 14:11:49 (2569): No heartbeat from core client for 30 sec - exiting 14:11:50 (2569): No heartbeat from core client for 30 sec - exiting 14:11:51 (2569): No heartbeat from core client for 30 sec - exiting 14:11:52 (2569): No heartbeat from core client for 30 sec - exiting 14:11:53 (2569): No heartbeat from core client for 30 sec - exiting 14:11:54 (2569): No heartbeat from core client for 30 sec - exiting 14:11:55 (2569): No heartbeat from core client for 30 sec - exiting 14:11:56 (2569): No heartbeat from core client for 30 sec - exiting 14:11:57 (2569): No heartbeat from core client for 30 sec - exiting 14:11:58 (2569): No heartbeat from core client for 30 sec - exiting 14:13:32 (2569): No heartbeat from core client for 30 sec - exiting 14:25:56 (2569): No heartbeat from core client for 30 sec - exiting 14:26:11 (2569): No heartbeat from core client for 30 sec - exiting 14:26:12 (2569): No heartbeat from core client for 30 sec - exiting 14:26:13 (2569): No heartbeat from core client for 30 sec - exiting 14:26:14 (2569): No heartbeat from core client for 30 sec - exiting 14:26:15 (2569): No heartbeat from core client for 30 sec - exiting 14:26:16 (2569): No heartbeat from core client for 30 sec - exiting 14:26:17 (2569): No heartbeat from core client for 30 sec - exiting 14:26:18 (2569): No heartbeat from core client for 30 sec - exiting 14:26:19 (2569): No heartbeat from core client for 30 sec - exiting 14:26:20 (2569): No heartbeat from core client for 30 sec - exiting 14:26:21 (2569): No heartbeat from core client for 30 sec - exiting 14:26:22 (2569): No heartbeat from core client for 30 sec - exiting 14:26:23 (2569): No heartbeat from core client for 30 sec - exiting 14:26:24 (2569): No heartbeat from core client for 30 sec - exiting 14:26:25 (2569): No heartbeat from core client for 30 sec - exiting 14:26:26 (2569): No heartbeat from core client for 30 sec - exiting 14:26:27 (2569): No heartbeat from core client for 30 sec - exiting 14:26:28 (2569): No heartbeat from core client for 30 sec - exiting 14:26:29 (2569): No heartbeat from core client for 30 sec - exiting 14:26:30 (2569): No heartbeat from core client for 30 sec - exiting 14:26:31 (2569): No heartbeat from core client for 30 sec - exiting 14:26:32 (2569): No heartbeat from core client for 30 sec - exiting 14:26:33 (2569): No heartbeat from core client for 30 sec - exiting 14:26:34 (2569): No heartbeat from core client for 30 sec - exiting 14:26:35 (2569): No heartbeat from core client for 30 sec - exiting 14:26:36 (2569): No heartbeat from core client for 30 sec - exiting 14:26:37 (2569): No heartbeat from core client for 30 sec - exiting 14:26:38 (2569): No heartbeat from core client for 30 sec - exiting 14:26:39 (2569): No heartbeat from core client for 30 sec - exiting 14:26:40 (2569): No heartbeat from core client for 30 sec - exiting 14:26:41 (2569): No heartbeat from core client for 30 sec - exiting 14:26:42 (2569): No heartbeat from core client for 30 sec - exiting 14:26:43 (2569): No heartbeat from core client for 30 sec - exiting 14:26:44 (2569): No heartbeat from core client for 30 sec - exiting 14:26:45 (2569): No heartbeat from core client for 30 sec - exiting 14:26:46 (2569): No heartbeat from core client for 30 sec - exiting 14:26:47 (2569): No heartbeat from core client for 30 sec - exiting 14:26:48 (2569): No heartbeat from core client for 30 sec - exiting 14:26:49 (2569): No heartbeat from core client for 30 sec - exiting 14:26:50 (2569): No heartbeat from core client for 30 sec - exiting 14:26:52 (2569): No heartbeat from core client for 30 sec - exiting 14:26:53 (2569): No heartbeat from core client for 30 sec - exiting 14:26:54 (2569): No heartbeat from core client for 30 sec - exiting 14:26:55 (2569): No heartbeat from core client for 30 sec - exiting 14:26:56 (2569): No heartbeat from core client for 30 sec - exiting 14:26:57 (2569): No heartbeat from core client for 30 sec - exiting 14:26:58 (2569): No heartbeat from core client for 30 sec - exiting 14:26:59 (2569): No heartbeat from core client for 30 sec - exiting 14:27:00 (2569): No heartbeat from core client for 30 sec - exiting 14:27:01 (2569): No heartbeat from core client for 30 sec - exiting 14:27:02 (2569): No heartbeat from core client for 30 sec - exiting 14:27:04 (2569): No heartbeat from core client for 30 sec - exiting 14:27:05 (2569): No heartbeat from core client for 30 sec - exiting 14:27:06 (2569): No heartbeat from core client for 30 sec - exiting 14:27:37 (2569): No heartbeat from core client for 30 sec - exiting 14:27:38 (2569): No heartbeat from core client for 30 sec - exiting 14:27:39 (2569): No heartbeat from core client for 30 sec - exiting 14:27:40 (2569): No heartbeat from core client for 30 sec - exiting 14:27:41 (2569): No heartbeat from core client for 30 sec - exiting 14:27:42 (2569): No heartbeat from core client for 30 sec - exiting 14:27:43 (2569): No heartbeat from core client for 30 sec - exiting 14:27:44 (2569): No heartbeat from core client for 30 sec - exiting 14:27:45 (2569): No heartbeat from core client for 30 sec - exiting 14:27:46 (2569): No heartbeat from core client for 30 sec - exiting 14:27:47 (2569): No heartbeat from core client for 30 sec - exiting 14:27:48 (2569): No heartbeat from core client for 30 sec - exiting 14:27:49 (2569): No heartbeat from core client for 30 sec - exiting 14:27:50 (2569): No heartbeat from core client for 30 sec - exiting 14:27:51 (2569): No heartbeat from core client for 30 sec - exiting 14:27:52 (2569): No heartbeat from core client for 30 sec - exiting 14:28:03 (2569): No heartbeat from core client for 30 sec - exiting 14:28:04 (2569): No heartbeat from core client for 30 sec - exiting 14:28:05 (2569): No heartbeat from core client for 30 sec - exiting 14:28:06 (2569): No heartbeat from core client for 30 sec - exiting 14:28:07 (2569): No heartbeat from core client for 30 sec - exiting 14:28:08 (2569): No heartbeat from core client for 30 sec - exiting 14:28:09 (2569): No heartbeat from core client for 30 sec - exiting 14:28:10 (2569): No heartbeat from core client for 30 sec - exiting 14:28:11 (2569): No heartbeat from core client for 30 sec - exiting 14:28:12 (2569): No heartbeat from core client for 30 sec - exiting 14:28:13 (2569): No heartbeat from core client for 30 sec - exiting 14:28:14 (2569): No heartbeat from core client for 30 sec - exiting 14:28:15 (2569): No heartbeat from core client for 30 sec - exiting 14:28:16 (2569): No heartbeat from core client for 30 sec - exiting 14:28:17 (2569): No heartbeat from core client for 30 sec - exiting 14:28:18 (2569): No heartbeat from core client for 30 sec - exiting 14:28:19 (2569): No heartbeat from core client for 30 sec - exiting 14:28:20 (2569): No heartbeat from core client for 30 sec - exiting 14:28:21 (2569): No heartbeat from core client for 30 sec - exiting 14:28:22 (2569): No heartbeat from core client for 30 sec - exiting 14:28:23 (2569): No heartbeat from core client for 30 sec - exiting 14:28:24 (2569): No heartbeat from core client for 30 sec - exiting 14:28:25 (2569): No heartbeat from core client for 30 sec - exiting 14:28:26 (2569): No heartbeat from core client for 30 sec - exiting 14:28:27 (2569): No heartbeat from core client for 30 sec - exiting 14:28:28 (2569): No heartbeat from core client for 30 sec - exiting 14:28:29 (2569): No heartbeat from core client for 30 sec - exiting 14:28:30 (2569): No heartbeat from core client for 30 sec - exiting 14:28:31 (2569): No heartbeat from core client for 30 sec - exiting 14:28:32 (2569): No heartbeat from core client for 30 sec - exiting 14:28:33 (2569): No heartbeat from core client for 30 sec - exiting 14:28:34 (2569): No heartbeat from core client for 30 sec - exiting 14:28:41 (2569): No heartbeat from core client for 30 sec - exiting 14:28:42 (2569): No heartbeat from core client for 30 sec - exiting 14:28:43 (2569): No heartbeat from core client for 30 sec - exiting 14:28:44 (2569): No heartbeat from core client for 30 sec - exiting 14:28:45 (2569): No heartbeat from core client for 30 sec - exiting 14:28:46 (2569): No heartbeat from core client for 30 sec - exiting 14:28:48 (2569): No heartbeat from core client for 30 sec - exiting 14:28:49 (2569): No heartbeat from core client for 30 sec - exiting 14:28:50 (2569): No heartbeat from core client for 30 sec - exiting 14:28:51 (2569): No heartbeat from core client for 30 sec - exiting 14:28:52 (2569): No heartbeat from core client for 30 sec - exiting 14:28:53 (2569): No heartbeat from core client for 30 sec - exiting 14:28:54 (2569): No heartbeat from core client for 30 sec - exiting 14:28:55 (2569): No heartbeat from core client for 30 sec - exiting 14:28:56 (2569): No heartbeat from core client for 30 sec - exiting 14:28:57 (2569): No heartbeat from core client for 30 sec - exiting 14:28:58 (2569): No heartbeat from core client for 30 sec - exiting 14:28:59 (2569): No heartbeat from core client for 30 sec - exiting 14:29:00 (2569): No heartbeat from core client for 30 sec - exiting 14:29:01 (2569): No heartbeat from core client for 30 sec - exiting 14:29:02 (2569): No heartbeat from core client for 30 sec - exiting 14:29:03 (2569): No heartbeat from core client for 30 sec - exiting 14:29:04 (2569): No heartbeat from core client for 30 sec - exiting 14:29:05 (2569): No heartbeat from core client for 30 sec - exiting 14:29:06 (2569): No heartbeat from core client for 30 sec - exiting 14:29:07 (2569): No heartbeat from core client for 30 sec - exiting 14:29:08 (2569): No heartbeat from core client for 30 sec - exiting 14:29:09 (2569): No heartbeat from core client for 30 sec - exiting 14:29:10 (2569): No heartbeat from core client for 30 sec - exiting 14:29:11 (2569): No heartbeat from core client for 30 sec - exiting 14:29:12 (2569): No heartbeat from core client for 30 sec - exiting 14:29:13 (2569): No heartbeat from core client for 30 sec - exiting 14:29:14 (2569): No heartbeat from core client for 30 sec - exiting 14:29:15 (2569): No heartbeat from core client for 30 sec - exiting 14:29:16 (2569): No heartbeat from core client for 30 sec - exiting 14:29:17 (2569): No heartbeat from core client for 30 sec - exiting 14:29:18 (2569): No heartbeat from core client for 30 sec - exiting 14:29:19 (2569): No heartbeat from core client for 30 sec - exiting 14:29:20 (2569): No heartbeat from core client for 30 sec - exiting 14:29:21 (2569): No heartbeat from core client for 30 sec - exiting 14:29:22 (2569): No heartbeat from core client for 30 sec - exiting 14:29:23 (2569): No heartbeat from core client for 30 sec - exiting 14:29:24 (2569): No heartbeat from core client for 30 sec - exiting 14:29:25 (2569): No heartbeat from core client for 30 sec - exiting 14:29:26 (2569): No heartbeat from core client for 30 sec - exiting 14:29:27 (2569): No heartbeat from core client for 30 sec - exiting 14:29:28 (2569): No heartbeat from core client for 30 sec - exiting 14:29:29 (2569): No heartbeat from core client for 30 sec - exiting 14:29:30 (2569): No heartbeat from core client for 30 sec - exiting 14:29:31 (2569): No heartbeat from core client for 30 sec - exiting 14:29:32 (2569): No heartbeat from core client for 30 sec - exiting 14:29:33 (2569): No heartbeat from core client for 30 sec - exiting 14:29:34 (2569): No heartbeat from core client for 30 sec - exiting 14:29:35 (2569): No heartbeat from core client for 30 sec - exiting 14:29:36 (2569): No heartbeat from core client for 30 sec - exiting 14:29:37 (2569): No heartbeat from core client for 30 sec - exiting 14:29:38 (2569): No heartbeat from core client for 30 sec - exiting 14:29:39 (2569): No heartbeat from core client for 30 sec - exiting 14:29:40 (2569): No heartbeat from core client for 30 sec - exiting 14:29:41 (2569): No heartbeat from core client for 30 sec - exiting 14:29:42 (2569): No heartbeat from core client for 30 sec - exiting 14:29:43 (2569): No heartbeat from core client for 30 sec - exiting 14:29:44 (2569): No heartbeat from core client for 30 sec - exiting 14:29:45 (2569): No heartbeat from core client for 30 sec - exiting 14:29:46 (2569): No heartbeat from core client for 30 sec - exiting 14:29:47 (2569): No heartbeat from core client for 30 sec - exiting 14:29:48 (2569): No heartbeat from core client for 30 sec - exiting 14:29:49 (2569): No heartbeat from core client for 30 sec - exiting 14:29:50 (2569): No heartbeat from core client for 30 sec - exiting 14:29:51 (2569): No heartbeat from core client for 30 sec - exiting 14:29:52 (2569): No heartbeat from core client for 30 sec - exiting 14:29:53 (2569): No heartbeat from core client for 30 sec - exiting 14:29:54 (2569): No heartbeat from core client for 30 sec - exiting 14:29:55 (2569): No heartbeat from core client for 30 sec - exiting 14:29:56 (2569): No heartbeat from core client for 30 sec - exiting 14:29:59 (2569): No heartbeat from core client for 30 sec - exiting 14:30:00 (2569): No heartbeat from core client for 30 sec - exiting 14:30:01 (2569): No heartbeat from core client for 30 sec - exiting 14:30:03 (2569): No heartbeat from core client for 30 sec - exiting 14:30:04 (2569): No heartbeat from core client for 30 sec - exiting 14:30:05 (2569): No heartbeat from core client for 30 sec - exiting 14:30:07 (2569): No heartbeat from core client for 30 sec - exiting 14:30:08 (2569): No heartbeat from core client for 30 sec - exiting 14:30:09 (2569): No heartbeat from core client for 30 sec - exiting 14:30:11 (2569): No heartbeat from core client for 30 sec - exiting 14:30:12 (2569): No heartbeat from core client for 30 sec - exiting 14:30:13 (2569): No heartbeat from core client for 30 sec - exiting 14:30:15 (2569): No heartbeat from core client for 30 sec - exiting 14:30:16 (2569): No heartbeat from core client for 30 sec - exiting 14:30:17 (2569): No heartbeat from core client for 30 sec - exiting 14:30:19 (2569): No heartbeat from core client for 30 sec - exiting 14:30:20 (2569): No heartbeat from core client for 30 sec - exiting 14:30:21 (2569): No heartbeat from core client for 30 sec - exiting 14:30:23 (2569): No heartbeat from core client for 30 sec - exiting 14:30:24 (2569): No heartbeat from core client for 30 sec - exiting 14:30:25 (2569): No heartbeat from core client for 30 sec - exiting 14:30:27 (2569): No heartbeat from core client for 30 sec - exiting 14:30:28 (2569): No heartbeat from core client for 30 sec - exiting 14:30:29 (2569): No heartbeat from core client for 30 sec - exiting 14:30:31 (2569): No heartbeat from core client for 30 sec - exiting 14:30:32 (2569): No heartbeat from core client for 30 sec - exiting 14:30:33 (2569): No heartbeat from core client for 30 sec - exiting 14:30:35 (2569): No heartbeat from core client for 30 sec - exiting 14:30:36 (2569): No heartbeat from core client for 30 sec - exiting 14:30:37 (2569): No heartbeat from core client for 30 sec - exiting 14:30:39 (2569): No heartbeat from core client for 30 sec - exiting 14:30:40 (2569): No heartbeat from core client for 30 sec - exiting 14:30:41 (2569): No heartbeat from core client for 30 sec - exiting 14:30:43 (2569): No heartbeat from core client for 30 sec - exiting 14:30:44 (2569): No heartbeat from core client for 30 sec - exiting 14:30:45 (2569): No heartbeat from core client for 30 sec - exiting 14:30:47 (2569): No heartbeat from core client for 30 sec - exiting 14:30:48 (2569): No heartbeat from core client for 30 sec - exiting 14:30:49 (2569): No heartbeat from core client for 30 sec - exiting 14:30:51 (2569): No heartbeat from core client for 30 sec - exiting 14:30:52 (2569): No heartbeat from core client for 30 sec - exiting 14:30:53 (2569): No heartbeat from core client for 30 sec - exiting 14:30:55 (2569): No heartbeat from core client for 30 sec - exiting 14:30:56 (2569): No heartbeat from core client for 30 sec - exiting 14:30:58 (2569): No heartbeat from core client for 30 sec - exiting 14:30:59 (2569): No heartbeat from core client for 30 sec - exiting 14:31:00 (2569): No heartbeat from core client for 30 sec - exiting 14:31:01 (2569): No heartbeat from core client for 30 sec - exiting 14:31:03 (2569): No heartbeat from core client for 30 sec - exiting 14:31:04 (2569): No heartbeat from core client for 30 sec - exiting 14:31:05 (2569): No heartbeat from core client for 30 sec - exiting 14:31:07 (2569): No heartbeat from core client for 30 sec - exiting 14:31:08 (2569): No heartbeat from core client for 30 sec - exiting 14:31:10 (2569): No heartbeat from core client for 30 sec - exiting 14:31:11 (2569): No heartbeat from core client for 30 sec - exiting 14:31:12 (2569): No heartbeat from core client for 30 sec - exiting 14:31:13 (2569): No heartbeat from core client for 30 sec - exiting 14:31:14 (2569): No heartbeat from core client for 30 sec - exiting 14:31:15 (2569): No heartbeat from core client for 30 sec - exiting 14:31:16 (2569): No heartbeat from core client for 30 sec - exiting 14:31:17 (2569): No heartbeat from core client for 30 sec - exiting 14:31:18 (2569): No heartbeat from core client for 30 sec - exiting 14:31:20 (2569): No heartbeat from core client for 30 sec - exiting 14:31:33 (2569): No heartbeat from core client for 30 sec - exiting 14:31:34 (2569): No heartbeat from core client for 30 sec - exiting 14:31:35 (2569): No heartbeat from core client for 30 sec - exiting 14:31:36 (2569): No heartbeat from core client for 30 sec - exiting 14:31:37 (2569): No heartbeat from core client for 30 sec - exiting 14:31:38 (2569): No heartbeat from core client for 30 sec - exiting 14:31:39 (2569): No heartbeat from core client for 30 sec - exiting 14:31:40 (2569): No heartbeat from core client for 30 sec - exiting 14:31:41 (2569): No heartbeat from core client for 30 sec - exiting 14:31:42 (2569): No heartbeat from core client for 30 sec - exiting 14:31:43 (2569): No heartbeat from core client for 30 sec - exiting 14:31:44 (2569): No heartbeat from core client for 30 sec - exiting 14:31:45 (2569): No heartbeat from core client for 30 sec - exiting 14:31:46 (2569): No heartbeat from core client for 30 sec - exiting 14:31:47 (2569): No heartbeat from core client for 30 sec - exiting 14:31:48 (2569): No heartbeat from core client for 30 sec - exiting 14:31:49 (2569): No heartbeat from core client for 30 sec - exiting 14:31:50 (2569): No heartbeat from core client for 30 sec - exiting 14:31:51 (2569): No heartbeat from core client for 30 sec - exiting 14:31:52 (2569): No heartbeat from core client for 30 sec - exiting 14:31:53 (2569): No heartbeat from core client for 30 sec - exiting 14:31:54 (2569): No heartbeat from core client for 30 sec - exiting 14:31:55 (2569): No heartbeat from core client for 30 sec - exiting 14:31:56 (2569): No heartbeat from core client for 30 sec - exiting 14:31:57 (2569): No heartbeat from core client for 30 sec - exiting 14:31:58 (2569): No heartbeat from core client for 30 sec - exiting 14:31:59 (2569): No heartbeat from core client for 30 sec - exiting 14:32:00 (2569): No heartbeat from core client for 30 sec - exiting 14:32:01 (2569): No heartbeat from core client for 30 sec - exiting 14:32:02 (2569): No heartbeat from core client for 30 sec - exiting 14:32:03 (2569): No heartbeat from core client for 30 sec - exiting 14:32:04 (2569): No heartbeat from core client for 30 sec - exiting 14:32:05 (2569): No heartbeat from core client for 30 sec - exiting 14:32:06 (2569): No heartbeat from core client for 30 sec - exiting 14:32:07 (2569): No heartbeat from core client for 30 sec - exiting 14:32:08 (2569): No heartbeat from core client for 30 sec - exiting 14:32:09 (2569): No heartbeat from core client for 30 sec - exiting 14:32:10 (2569): No heartbeat from core client for 30 sec - exiting 14:32:12 (2569): No heartbeat from core client for 30 sec - exiting 14:32:13 (2569): No heartbeat from core client for 30 sec - exiting 14:32:14 (2569): No heartbeat from core client for 30 sec - exiting 14:32:15 (2569): No heartbeat from core client for 30 sec - exiting 14:32:16 (2569): No heartbeat from core client for 30 sec - exiting 14:32:17 (2569): No heartbeat from core client for 30 sec - exiting 14:32:18 (2569): No heartbeat from core client for 30 sec - exiting 14:32:19 (2569): No heartbeat from core client for 30 sec - exiting 14:32:20 (2569): No heartbeat from core client for 30 sec - exiting 14:32:32 (2569): No heartbeat from core client for 30 sec - exiting 14:32:33 (2569): No heartbeat from core client for 30 sec - exiting 14:32:34 (2569): No heartbeat from core client for 30 sec - exiting 14:32:35 (2569): No heartbeat from core client for 30 sec - exiting 14:32:37 (2569): No heartbeat from core client for 30 sec - exiting 14:32:38 (2569): No heartbeat from core client for 30 sec - exiting 14:32:39 (2569): No heartbeat from core client for 30 sec - exiting 14:32:40 (2569): No heartbeat from core client for 30 sec - exiting 14:32:41 (2569): No heartbeat from core client for 30 sec - exiting 14:32:42 (2569): No heartbeat from core client for 30 sec - exiting 14:32:43 (2569): No heartbeat from core client for 30 sec - exiting 14:32:44 (2569): No heartbeat from core client for 30 sec - exiting 14:32:45 (2569): No heartbeat from core client for 30 sec - exiting 14:32:46 (2569): No heartbeat from core client for 30 sec - exiting 14:32:47 (2569): No heartbeat from core client for 30 sec - exiting 14:32:53 (2569): No heartbeat from core client for 30 sec - exiting 14:32:54 (2569): No heartbeat from core client for 30 sec - exiting 14:32:55 (2569): No heartbeat from core client for 30 sec - exiting 14:32:56 (2569): No heartbeat from core client for 30 sec - exiting 14:32:57 (2569): No heartbeat from core client for 30 sec - exiting 14:32:58 (2569): No heartbeat from core client for 30 sec - exiting 14:32:59 (2569): No heartbeat from core client for 30 sec - exiting 14:33:00 (2569): No heartbeat from core client for 30 sec - exiting 14:33:01 (2569): No heartbeat from core client for 30 sec - exiting 14:33:02 (2569): No heartbeat from core client for 30 sec - exiting 14:33:03 (2569): No heartbeat from core client for 30 sec - exiting 14:33:04 (2569): No heartbeat from core client for 30 sec - exiting 14:33:05 (2569): No heartbeat from core client for 30 sec - exiting 14:33:06 (2569): No heartbeat from core client for 30 sec - exiting 14:33:08 (2569): No heartbeat from core client for 30 sec - exiting 14:33:09 (2569): No heartbeat from core client for 30 sec - exiting 14:33:10 (2569): No heartbeat from core client for 30 sec - exiting 14:33:15 (2569): No heartbeat from core client for 30 sec - exiting 14:33:16 (2569): No heartbeat from core client for 30 sec - exiting 14:33:17 (2569): No heartbeat from core client for 30 sec - exiting 14:33:18 (2569): No heartbeat from core client for 30 sec - exiting 14:33:19 (2569): No heartbeat from core client for 30 sec - exiting 14:33:20 (2569): No heartbeat from core client for 30 sec - exiting 14:33:21 (2569): No heartbeat from core client for 30 sec - exiting 14:33:22 (2569): No heartbeat from core client for 30 sec - exiting 14:33:23 (2569): No heartbeat from core client for 30 sec - exiting 14:33:24 (2569): No heartbeat from core client for 30 sec - exiting 14:33:25 (2569): No heartbeat from core client for 30 sec - exiting 14:33:26 (2569): No heartbeat from core client for 30 sec - exiting 14:33:27 (2569): No heartbeat from core client for 30 sec - exiting 14:33:28 (2569): No heartbeat from core client for 30 sec - exiting 14:33:29 (2569): No heartbeat from core client for 30 sec - exiting 14:33:30 (2569): No heartbeat from core client for 30 sec - exiting 14:33:31 (2569): No heartbeat from core client for 30 sec - exiting 14:33:32 (2569): No heartbeat from core client for 30 sec - exiting 14:33:33 (2569): No heartbeat from core client for 30 sec - exiting 14:33:34 (2569): No heartbeat from core client for 30 sec - exiting 14:33:35 (2569): No heartbeat from core client for 30 sec - exiting 14:33:36 (2569): No heartbeat from core client for 30 sec - exiting 14:33:37 (2569): No heartbeat from core client for 30 sec - exiting 14:33:38 (2569): No heartbeat from core client for 30 sec - exiting 14:33:39 (2569): No heartbeat from core client for 30 sec - exiting 14:33:40 (2569): No heartbeat from core client for 30 sec - exiting 14:33:41 (2569): No heartbeat from core client for 30 sec - exiting 14:33:42 (2569): No heartbeat from core client for 30 sec - exiting 14:33:43 (2569): No heartbeat from core client for 30 sec - exiting 14:33:44 (2569): No heartbeat from core client for 30 sec - exiting 14:33:45 (2569): No heartbeat from core client for 30 sec - exiting 14:33:46 (2569): No heartbeat from core client for 30 sec - exiting 14:33:47 (2569): No heartbeat from core client for 30 sec - exiting 14:33:48 (2569): No heartbeat from core client for 30 sec - exiting 14:33:49 (2569): No heartbeat from core client for 30 sec - exiting 14:33:50 (2569): No heartbeat from core client for 30 sec - exiting 14:33:51 (2569): No heartbeat from core client for 30 sec - exiting 14:33:52 (2569): No heartbeat from core client for 30 sec - exiting 14:33:53 (2569): No heartbeat from core client for 30 sec - exiting 14:33:55 (2569): No heartbeat from core client for 30 sec - exiting 14:33:56 (2569): No heartbeat from core client for 30 sec - exiting 14:33:57 (2569): No heartbeat from core client for 30 sec - exiting 14:33:58 (2569): No heartbeat from core client for 30 sec - exiting 14:33:59 (2569): No heartbeat from core client for 30 sec - exiting 14:34:00 (2569): No heartbeat from core client for 30 sec - exiting 14:34:01 (2569): No heartbeat from core client for 30 sec - exiting 14:34:02 (2569): No heartbeat from core client for 30 sec - exiting 14:34:03 (2569): No heartbeat from core client for 30 sec - exiting 14:34:04 (2569): No heartbeat from core client for 30 sec - exiting 14:34:05 (2569): No heartbeat from core client for 30 sec - exiting 14:34:06 (2569): No heartbeat from core client for 30 sec - exiting 14:34:07 (2569): No heartbeat from core client for 30 sec - exiting 14:34:08 (2569): No heartbeat from core client for 30 sec - exiting 14:34:09 (2569): No heartbeat from core client for 30 sec - exiting 14:34:10 (2569): No heartbeat from core client for 30 sec - exiting 14:34:11 (2569): No heartbeat from core client for 30 sec - exiting 14:34:12 (2569): No heartbeat from core client for 30 sec - exiting 14:34:13 (2569): No heartbeat from core client for 30 sec - exiting 14:34:14 (2569): No heartbeat from core client for 30 sec - exiting 14:34:15 (2569): No heartbeat from core client for 30 sec - exiting 14:34:16 (2569): No heartbeat from core client for 30 sec - exiting 14:34:17 (2569): No heartbeat from core client for 30 sec - exiting 14:34:18 (2569): No heartbeat from core client for 30 sec - exiting 14:34:19 (2569): No heartbeat from core client for 30 sec - exiting 14:34:20 (2569): No heartbeat from core client for 30 sec - exiting 14:34:21 (2569): No heartbeat from core client for 30 sec - exiting 14:34:22 (2569): No heartbeat from core client for 30 sec - exiting 14:34:23 (2569): No heartbeat from core client for 30 sec - exiting 14:34:24 (2569): No heartbeat from core client for 30 sec - exiting 14:34:25 (2569): No heartbeat from core client for 30 sec - exiting 14:34:26 (2569): No heartbeat from core client for 30 sec - exiting 14:34:27 (2569): No heartbeat from core client for 30 sec - exiting 14:34:28 (2569): No heartbeat from core client for 30 sec - exiting 14:34:29 (2569): No heartbeat from core client for 30 sec - exiting 14:34:30 (2569): No heartbeat from core client for 30 sec - exiting 14:34:31 (2569): No heartbeat from core client for 30 sec - exiting 14:34:32 (2569): No heartbeat from core client for 30 sec - exiting 14:34:33 (2569): No heartbeat from core client for 30 sec - exiting 14:34:34 (2569): No heartbeat from core client for 30 sec - exiting 14:34:35 (2569): No heartbeat from core client for 30 sec - exiting 14:34:36 (2569): No heartbeat from core client for 30 sec - exiting 14:34:37 (2569): No heartbeat from core client for 30 sec - exiting 14:34:38 (2569): No heartbeat from core client for 30 sec - exiting 14:34:39 (2569): No heartbeat from core client for 30 sec - exiting 14:34:40 (2569): No heartbeat from core client for 30 sec - exiting 14:34:41 (2569): No heartbeat from core client for 30 sec - exiting 14:34:42 (2569): No heartbeat from core client for 30 sec - exiting 14:34:43 (2569): No heartbeat from core client for 30 sec - exiting 14:34:44 (2569): No heartbeat from core client for 30 sec - exiting 14:34:45 (2569): No heartbeat from core client for 30 sec - exiting 14:34:46 (2569): No heartbeat from core client for 30 sec - exiting 14:34:47 (2569): No heartbeat from core client for 30 sec - exiting 14:34:48 (2569): No heartbeat from core client for 30 sec - exiting 14:34:49 (2569): No heartbeat from core client for 30 sec - exiting 14:34:50 (2569): No heartbeat from core client for 30 sec - exiting 14:34:51 (2569): No heartbeat from core client for 30 sec - exiting 14:34:52 (2569): No heartbeat from core client for 30 sec - exiting 14:34:53 (2569): No heartbeat from core client for 30 sec - exiting 14:34:54 (2569): No heartbeat from core client for 30 sec - exiting 14:34:55 (2569): No heartbeat from core client for 30 sec - exiting 14:34:56 (2569): No heartbeat from core client for 30 sec - exiting 14:34:57 (2569): No heartbeat from core client for 30 sec - exiting 14:34:58 (2569): No heartbeat from core client for 30 sec - exiting 14:34:59 (2569): No heartbeat from core client for 30 sec - exiting 14:35:00 (2569): No heartbeat from core client for 30 sec - exiting 14:35:01 (2569): No heartbeat from core client for 30 sec - exiting 14:35:02 (2569): No heartbeat from core client for 30 sec - exiting 14:35:03 (2569): No heartbeat from core client for 30 sec - exiting 14:35:04 (2569): No heartbeat from core client for 30 sec - exiting 14:35:05 (2569): No heartbeat from core client for 30 sec - exiting 14:35:06 (2569): No heartbeat from core client for 30 sec - exiting 14:35:07 (2569): No heartbeat from core client for 30 sec - exiting 14:35:08 (2569): No heartbeat from core client for 30 sec - exiting 14:35:09 (2569): No heartbeat from core client for 30 sec - exiting 14:35:10 (2569): No heartbeat from core client for 30 sec - exiting 14:35:11 (2569): No heartbeat from core client for 30 sec - exiting 14:35:12 (2569): No heartbeat from core client for 30 sec - exiting 14:35:13 (2569): No heartbeat from core client for 30 sec - exiting 14:35:14 (2569): No heartbeat from core client for 30 sec - exiting 14:35:15 (2569): No heartbeat from core client for 30 sec - exiting 14:35:16 (2569): No heartbeat from core client for 30 sec - exiting 14:35:17 (2569): No heartbeat from core client for 30 sec - exiting 14:35:18 (2569): No heartbeat from core client for 30 sec - exiting 14:35:19 (2569): No heartbeat from core client for 30 sec - exiting 14:35:20 (2569): No heartbeat from core client for 30 sec - exiting 14:35:21 (2569): No heartbeat from core client for 30 sec - exiting 14:35:22 (2569): No heartbeat from core client for 30 sec - exiting 14:35:23 (2569): No heartbeat from core client for 30 sec - exiting 14:35:24 (2569): No heartbeat from core client for 30 sec - exiting 14:35:26 (2569): No heartbeat from core client for 30 sec - exiting 14:35:27 (2569): No heartbeat from core client for 30 sec - exiting 14:35:28 (2569): No heartbeat from core client for 30 sec - exiting 14:35:29 (2569): No heartbeat from core client for 30 sec - exiting 14:35:30 (2569): No heartbeat from core client for 30 sec - exiting 14:35:33 (2569): No heartbeat from core client for 30 sec - exiting 14:35:34 (2569): No heartbeat from core client for 30 sec - exiting 14:35:35 (2569): No heartbeat from core client for 30 sec - exiting 14:35:49 (2569): No heartbeat from core client for 30 sec - exiting 14:35:50 (2569): No heartbeat from core client for 30 sec - exiting 14:35:51 (2569): No heartbeat from core client for 30 sec - exiting 14:35:52 (2569): No heartbeat from core client for 30 sec - exiting 14:35:53 (2569): No heartbeat from core client for 30 sec - exiting 14:35:54 (2569): No heartbeat from core client for 30 sec - exiting 14:35:55 (2569): No heartbeat from core client for 30 sec - exiting 14:35:56 (2569): No heartbeat from core client for 30 sec - exiting 14:35:57 (2569): No heartbeat from core client for 30 sec - exiting 14:36:01 (2569): No heartbeat from core client for 30 sec - exiting 14:36:02 (2569): No heartbeat from core client for 30 sec - exiting 14:36:03 (2569): No heartbeat from core client for 30 sec - exiting 14:36:04 (2569): No heartbeat from core client for 30 sec - exiting 14:36:06 (2569): No heartbeat from core client for 30 sec - exiting 14:42:41 (2569): No heartbeat from core client for 30 sec - exiting 14:42:43 (2569): No heartbeat from core client for 30 sec - exiting 14:42:44 (2569): No heartbeat from core client for 30 sec - exiting 14:42:45 (2569): No heartbeat from core client for 30 sec - exiting 14:42:46 (2569): No heartbeat from core client for 30 sec - exiting 14:42:47 (2569): No heartbeat from core client for 30 sec - exiting 14:42:48 (2569): No heartbeat from core client for 30 sec - exiting 14:42:49 (2569): No heartbeat from core client for 30 sec - exiting 14:42:50 (2569): No heartbeat from core client for 30 sec - exiting 14:42:51 (2569): No heartbeat from core client for 30 sec - exiting 14:42:52 (2569): No heartbeat from core client for 30 sec - exiting 14:42:53 (2569): No heartbeat from core client for 30 sec - exiting 14:42:54 (2569): No heartbeat from core client for 30 sec - exiting 14:42:55 (2569): No heartbeat from core client for 30 sec - exiting 14:42:56 (2569): No heartbeat from core client for 30 sec - exiting 14:42:57 (2569): No heartbeat from core client for 30 sec - exiting 14:46:01 (2569): No heartbeat from core client for 30 sec - exiting 14:46:02 (2569): No heartbeat from core client for 30 sec - exiting 14:46:03 (2569): No heartbeat from core client for 30 sec - exiting 14:46:04 (2569): No heartbeat from core client for 30 sec - exiting 14:46:06 (2569): No heartbeat from core client for 30 sec - exiting 14:46:07 (2569): No heartbeat from core client for 30 sec - exiting 14:46:08 (2569): No heartbeat from core client for 30 sec - exiting 14:46:10 (2569): No heartbeat from core client for 30 sec - exiting 14:46:11 (2569): No heartbeat from core client for 30 sec - exiting 14:46:12 (2569): No heartbeat from core client for 30 sec - exiting 14:46:14 (2569): No heartbeat from core client for 30 sec - exiting 14:46:15 (2569): No heartbeat from core client for 30 sec - exiting 14:46:16 (2569): No heartbeat from core client for 30 sec - exiting 14:46:18 (2569): No heartbeat from core client for 30 sec - exiting 14:46:19 (2569): No heartbeat from core client for 30 sec - exiting 14:46:21 (2569): No heartbeat from core client for 30 sec - exiting 14:46:22 (2569): No heartbeat from core client for 30 sec - exiting 14:46:23 (2569): No heartbeat from core client for 30 sec - exiting 14:46:24 (2569): No heartbeat from core client for 30 sec - exiting 14:46:26 (2569): No heartbeat from core client for 30 sec - exiting 14:46:27 (2569): No heartbeat from core client for 30 sec - exiting 14:46:28 (2569): No heartbeat from core client for 30 sec - exiting 14:46:30 (2569): No heartbeat from core client for 30 sec - exiting 14:46:31 (2569): No heartbeat from core client for 30 sec - exiting 14:46:32 (2569): No heartbeat from core client for 30 sec - exiting 14:46:34 (2569): No heartbeat from core client for 30 sec - exiting 14:46:35 (2569): No heartbeat from core client for 30 sec - exiting 14:46:36 (2569): No heartbeat from core client for 30 sec - exiting 14:46:38 (2569): No heartbeat from core client for 30 sec - exiting 14:46:39 (2569): No heartbeat from core client for 30 sec - exiting 14:46:40 (2569): No heartbeat from core client for 30 sec - exiting 14:46:42 (2569): No heartbeat from core client for 30 sec - exiting 14:46:43 (2569): No heartbeat from core client for 30 sec - exiting 14:46:45 (2569): No heartbeat from core client for 30 sec - exiting 14:46:46 (2569): No heartbeat from core client for 30 sec - exiting 14:46:47 (2569): No heartbeat from core client for 30 sec - exiting 14:47:28 (2569): No heartbeat from core client for 30 sec - exiting 14:47:29 (2569): No heartbeat from core client for 30 sec - exiting 14:47:30 (2569): No heartbeat from core client for 30 sec - exiting 14:47:31 (2569): No heartbeat from core client for 30 sec - exiting 14:47:32 (2569): No heartbeat from core client for 30 sec - exiting 14:47:33 (2569): No heartbeat from core client for 30 sec - exiting 14:47:34 (2569): No heartbeat from core client for 30 sec - exiting 14:47:35 (2569): No heartbeat from core client for 30 sec - exiting 14:47:36 (2569): No heartbeat from core client for 30 sec - exiting 14:47:37 (2569): No heartbeat from core client for 30 sec - exiting 14:47:38 (2569): No heartbeat from core client for 30 sec - exiting 14:47:39 (2569): No heartbeat from core client for 30 sec - exiting 14:47:40 (2569): No heartbeat from core client for 30 sec - exiting 14:47:41 (2569): No heartbeat from core client for 30 sec - exiting 14:47:42 (2569): No heartbeat from core client for 30 sec - exiting 14:47:43 (2569): No heartbeat from core client for 30 sec - exiting 14:47:44 (2569): No heartbeat from core client for 30 sec - exiting 14:47:45 (2569): No heartbeat from core client for 30 sec - exiting 14:47:46 (2569): No heartbeat from core client for 30 sec - exiting 14:47:47 (2569): No heartbeat from core client for 30 sec - exiting 14:47:48 (2569): No heartbeat from core client for 30 sec - exiting 14:47:49 (2569): No heartbeat from core client for 30 sec - exiting 14:47:50 (2569): No heartbeat from core client for 30 sec - exiting 14:47:51 (2569): No heartbeat from core client for 30 sec - exiting 14:47:52 (2569): No heartbeat from core client for 30 sec - exiting 14:47:53 (2569): No heartbeat from core client for 30 sec - exiting 14:47:54 (2569): No heartbeat from core client for 30 sec - exiting 14:47:55 (2569): No heartbeat from core client for 30 sec - exiting 14:47:56 (2569): No heartbeat from core client for 30 sec - exiting 14:47:57 (2569): No heartbeat from core client for 30 sec - exiting 14:47:58 (2569): No heartbeat from core client for 30 sec - exiting 14:47:59 (2569): No heartbeat from core client for 30 sec - exiting 14:48:00 (2569): No heartbeat from core client for 30 sec - exiting 14:48:01 (2569): No heartbeat from core client for 30 sec - exiting 14:48:02 (2569): No heartbeat from core client for 30 sec - exiting 14:48:03 (2569): No heartbeat from core client for 30 sec - exiting 14:48:04 (2569): No heartbeat from core client for 30 sec - exiting 14:48:05 (2569): No heartbeat from core client for 30 sec - exiting 14:48:06 (2569): No heartbeat from core client for 30 sec - exiting 14:48:07 (2569): No heartbeat from core client for 30 sec - exiting 14:48:08 (2569): No heartbeat from core client for 30 sec - exiting 14:48:09 (2569): No heartbeat from core client for 30 sec - exiting 14:48:10 (2569): No heartbeat from core client for 30 sec - exiting 14:48:11 (2569): No heartbeat from core client for 30 sec - exiting 14:48:12 (2569): No heartbeat from core client for 30 sec - exiting 14:48:13 (2569): No heartbeat from core client for 30 sec - exiting 14:48:14 (2569): No heartbeat from core client for 30 sec - exiting 14:48:15 (2569): No heartbeat from core client for 30 sec - exiting 14:48:16 (2569): No heartbeat from core client for 30 sec - exiting 14:48:17 (2569): No heartbeat from core client for 30 sec - exiting 14:48:18 (2569): No heartbeat from core client for 30 sec - exiting 14:48:19 (2569): No heartbeat from core client for 30 sec - exiting 14:48:20 (2569): No heartbeat from core client for 30 sec - exiting 14:48:21 (2569): No heartbeat from core client for 30 sec - exiting 14:48:22 (2569): No heartbeat from core client for 30 sec - exiting 14:48:23 (2569): No heartbeat from core client for 30 sec - exiting 14:48:24 (2569): No heartbeat from core client for 30 sec - exiting 14:48:25 (2569): No heartbeat from core client for 30 sec - exiting 14:48:26 (2569): No heartbeat from core client for 30 sec - exiting 14:48:27 (2569): No heartbeat from core client for 30 sec - exiting 14:48:28 (2569): No heartbeat from core client for 30 sec - exiting *** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x090a5848 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2368: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 *(sizeof(size_t))) - 1)) & ~((2 *(sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed. SIGABRT: abort called 19:04:17 (3507): No heartbeat from core client for 30 sec - exiting 19:04:18 (3507): No heartbeat from core client for 30 sec - exiting 19:04:20 (3507): No heartbeat from core client for 30 sec - exiting 19:04:21 (3507): No heartbeat from core client for 30 sec - exiting 19:04:22 (3507): No heartbeat from core client for 30 sec - exiting 19:04:23 (3507): No heartbeat from core client for 30 sec - exiting 19:04:24 (3507): No heartbeat from core client for 30 sec - exiting 19:04:25 (3507): No heartbeat from core client for 30 sec - exiting 19:04:26 (3507): No heartbeat from core client for 30 sec - exiting 19:04:27 (3507): No heartbeat from core client for 30 sec - exiting 19:04:28 (3507): No heartbeat from core client for 30 sec - exiting 19:04:29 (3507): No heartbeat from core client for 30 sec - exiting 19:04:30 (3507): No heartbeat from core client for 30 sec - exiting 19:04:31 (3507): No heartbeat from core client for 30 sec - exiting 21:55:35 (3507): No heartbeat from core client for 30 sec - exiting *** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x08673848 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2368: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 *(sizeof(size_t))) - 1)) & ~((2 *(sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed. SIGABRT: abort called Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish 19:30:38 (3154): No heartbeat from core client for 30 sec - exiting 19:30:39 (3154): No heartbeat from core client for 30 sec - exiting 19:30:40 (3154): No heartbeat from core client for 30 sec - exiting 19:30:41 (3154): No heartbeat from core client for 30 sec - exiting *** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x08e14848 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2368: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 *(sizeof(size_t))) - 1)) & ~((2 *(sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed. SIGABRT: abort called 19:30:42 (3154): No heartbeat from core client for 30 sec - exiting 19:30:43 (3154): No heartbeat from core client for 30 sec - exiting 19:30:44 (3154): No heartbeat from core client for 30 sec - exiting 19:30:45 (3154): No heartbeat from core client for 30 sec - exiting 19:30:46 (3154): No heartbeat from core client for 30 sec - exiting 19:30:47 (3154): No heartbeat from core client for 30 sec - exiting 19:30:51 (3154): No heartbeat from core client for 30 sec - exiting 19:30:52 (3154): No heartbeat from core client for 30 sec - exiting 19:30:53 (3154): No heartbeat from core client for 30 sec - exiting 19:30:54 (3154): No heartbeat from core client for 30 sec - exiting 19:30:55 (3154): No heartbeat from core client for 30 sec - exiting 19:30:57 (3154): No heartbeat from core client for 30 sec - exiting 19:30:58 (3154): No heartbeat from core client for 30 sec - exiting 19:30:59 (3154): No heartbeat from core client for 30 sec - exiting 19:31:00 (3154): No heartbeat from core client for 30 sec - exiting 19:31:01 (3154): No heartbeat from core client for 30 sec - exiting 19:31:02 (3154): No heartbeat from core client for 30 sec - exiting 19:31:03 (3154): No heartbeat from core client for 30 sec - exiting 19:31:05 (3154): No heartbeat from core client for 30 sec - exiting </stderr_txt> ]]> |
Latest Trickles Received | ||||||
---|---|---|---|---|---|---|
Time Sent (UTC) | Host ID | Result ID | Result Name | Timestep | CPU Time (sec) | Average (sec/TS) |
03 Apr 2013 08:35:28 | 889885 | 15648835 | hadcm3n_4hos_1940_40_008303176_2 | 1,036,800 | 2,310,891 | 2.2289 |
02 Apr 2013 15:25:47 | 889885 | 15648835 | hadcm3n_4hos_1940_40_008303176_2 | 1,010,880 | 2,251,971 | 2.2277 |
01 Apr 2013 22:09:30 | 889885 | 15648835 | hadcm3n_4hos_1940_40_008303176_2 | 984,960 | 2,193,181 | 2.2267 |
01 Apr 2013 04:48:02 | 889885 | 15648835 | hadcm3n_4hos_1940_40_008303176_2 | 959,040 | 2,134,100 | 2.2252 |
31 Mar 2013 11:35:00 | 889885 | 15648835 | hadcm3n_4hos_1940_40_008303176_2 | 933,120 | 2,074,895 | 2.2236 |
30 Mar 2013 18:16:31 | 889885 | 15648835 | hadcm3n_4hos_1940_40_008303176_2 | 907,200 | 2,015,360 | 2.2215 |
30 Mar 2013 00:51:47 | 889885 | 15648835 | hadcm3n_4hos_1940_40_008303176_2 | 881,280 | 1,955,940 | 2.2194 |
29 Mar 2013 07:25:20 | 889885 | 15648835 | hadcm3n_4hos_1940_40_008303176_2 | 855,360 | 1,896,796 | 2.2175 |
28 Mar 2013 15:00:45 | 889885 | 15648835 | hadcm3n_4hos_1940_40_008303176_2 | 829,440 | 1,839,622 | 2.2179 |
27 Mar 2013 21:49:03 | 889885 | 15648835 | hadcm3n_4hos_1940_40_008303176_2 | 803,520 | 1,779,518 | 2.2147 |
27 Mar 2013 05:21:05 | 889885 | 15648835 | hadcm3n_4hos_1940_40_008303176_2 | 777,600 | 1,721,490 | 2.2139 |
26 Mar 2013 12:37:22 | 889885 | 15648835 | hadcm3n_4hos_1940_40_008303176_2 | 751,680 | 1,663,350 | 2.2128 |
25 Mar 2013 19:43:17 | 889885 | 15648835 | hadcm3n_4hos_1940_40_008303176_2 | 725,760 | 1,605,104 | 2.2116 |
25 Mar 2013 02:50:47 | 889885 | 15648835 | hadcm3n_4hos_1940_40_008303176_2 | 699,840 | 1,546,476 | 2.2098 |
24 Mar 2013 10:12:31 | 889885 | 15648835 | hadcm3n_4hos_1940_40_008303176_2 | 673,920 | 1,488,006 | 2.2080 |
23 Mar 2013 17:41:22 | 889885 | 15648835 | hadcm3n_4hos_1940_40_008303176_2 | 648,000 | 1,429,766 | 2.2064 |
23 Mar 2013 00:24:12 | 889885 | 15648835 | hadcm3n_4hos_1940_40_008303176_2 | 622,080 | 1,369,513 | 2.2015 |
22 Mar 2013 05:38:00 | 889885 | 15648835 | hadcm3n_4hos_1940_40_008303176_2 | 596,160 | 1,311,639 | 2.2001 |
21 Mar 2013 12:45:13 | 889885 | 15648835 | hadcm3n_4hos_1940_40_008303176_2 | 570,240 | 1,253,760 | 2.1987 |
20 Mar 2013 20:13:22 | 889885 | 15648835 | hadcm3n_4hos_1940_40_008303176_2 | 544,320 | 1,196,948 | 2.1990 |
©2024 climateprediction.net