climateprediction.net home page
Task 15648835

Task 15648835

Name hadcm3n_4hos_1940_40_008303176_2
Workunit 8454311
Created 4 Mar 2013, 15:39:15 UTC
Sent 4 Mar 2013, 15:39:21 UTC
Report deadline 3 Jun 2013, 23:06:32 UTC
Received 31 Jul 2015, 21:19:54 UTC
Server state Over
Outcome Computation error
Client state Aborted by user
Exit status 203 (0x000000CB) EXIT_ABORTED_VIA_GUI
Computer ID 889885
Run time 32 days 7 hours 5 min 55 sec
CPU time 26 days 18 hours 10 min 55 sec
Validate state Invalid
Credit 12,441.60
Device peak FLOPS 2.40 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>7.2.0</core_client_version>
<![CDATA[
<message>
aborted by user
</message>
<stderr_txt>
 (2999): No heartbeat from core client for 30 sec - exiting
13:39:16 (2999): No heartbeat from core client for 30 sec - exiting
13:39:17 (2999): No heartbeat from core client for 30 sec - exiting
13:39:18 (2999): No heartbeat from core client for 30 sec - exiting
13:39:19 (2999): No heartbeat from core client for 30 sec - exiting
13:39:20 (2999): No heartbeat from core client for 30 sec - exiting
Signal 15 received, exiting...
Called boinc_finish
Signal 15 received, exiting...
Called boinc_finish
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x08c4a848 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2369: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 *(sizeof(size_t))) - 1)) & ~((2 *(sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed.
SIGABRT: abort called
Signal 15 received, exiting...
Called boinc_finish
Signal 15 received, exiting...
Called boinc_finish
21:32:19 (2836): No heartbeat from core client for 30 sec - exiting
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x08f37848 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2369: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 *(sizeof(size_t))) - 1)) & ~((2 *(sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed.
SIGABRT: abort called
21:32:21 (2836): No heartbeat from core client for 30 sec - exiting
21:32:22 (2836): No heartbeat from core client for 30 sec - exiting
21:32:23 (2836): No heartbeat from core client for 30 sec - exiting
21:32:24 (2836): No heartbeat from core client for 30 sec - exiting
21:32:25 (2836): No heartbeat from core client for 30 sec - exiting
21:32:26 (2836): No heartbeat from core client for 30 sec - exiting
21:32:27 (2836): No heartbeat from core client for 30 sec - exiting
21:32:28 (2836): No heartbeat from core client for 30 sec - exiting
21:32:29 (2836): No heartbeat from core client for 30 sec - exiting
21:32:30 (2836): No heartbeat from core client for 30 sec - exiting
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x09299830 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2368: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 *(sizeof(size_t))) - 1)) & ~((2 *(sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed.
SIGABRT: abort called
Signal 15 received, exiting...
Called boinc_finish
Signal 15 received, exiting...
Called boinc_finish
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x09906830 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2368: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 *(sizeof(size_t))) - 1)) & ~((2 *(sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed.
SIGABRT: abort called
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x0a02a830 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2368: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 *(sizeof(size_t))) - 1)) & ~((2 *(sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed.
SIGABRT: abort called
Signal 15 received, exiting...
Called boinc_finish
Signal 15 received, exiting...
Called boinc_finish
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x09965830 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2368: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 *(sizeof(size_t))) - 1)) & ~((2 *(sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed.
SIGABRT: abort called
Signal 15 received, exiting...
Called boinc_finish
Signal 15 received, exiting...
Called boinc_finish
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x09d80830 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2368: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 *(sizeof(size_t))) - 1)) & ~((2 *(sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed.
SIGABRT: abort called
Signal 15 received, exiting...
Called boinc_finish
Signal 15 received, exiting...
Called boinc_finish
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x0933b830 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2368: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 *(sizeof(size_t))) - 1)) & ~((2 *(sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed.
SIGABRT: abort called
Signal 15 received, exiting...
Called boinc_finish
Signal 15 received, exiting...
Called boinc_finish
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x0941b830 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2368: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 *(sizeof(size_t))) - 1)) & ~((2 *(sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed.
SIGABRT: abort called
19:27:21 (3150): No heartbeat from core client for 30 sec - exiting
10:28:15 (3150): No heartbeat from core client for 30 sec - exiting
10:28:16 (3150): No heartbeat from core client for 30 sec - exiting
10:28:17 (3150): No heartbeat from core client for 30 sec - exiting
10:28:18 (3150): No heartbeat from core client for 30 sec - exiting
10:28:19 (3150): No heartbeat from core client for 30 sec - exiting
10:28:20 (3150): No heartbeat from core client for 30 sec - exiting
10:28:21 (3150): No heartbeat from core client for 30 sec - exiting
10:28:22 (3150): No heartbeat from core client for 30 sec - exiting
14:44:49 (3150): No heartbeat from core client for 30 sec - exiting
18:00:17 (3150): No heartbeat from core client for 30 sec - exiting
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x0946a830 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2368: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 *(sizeof(size_t))) - 1)) & ~((2 *(sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed.
SIGABRT: abort called
07:18:21 (2554): No heartbeat from core client for 30 sec - exiting
07:18:22 (2554): No heartbeat from core client for 30 sec - exiting
07:18:23 (2554): No heartbeat from core client for 30 sec - exiting
07:18:24 (2554): No heartbeat from core client for 30 sec - exiting
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x08d27830 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2368: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 *(sizeof(size_t))) - 1)) & ~((2 *(sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed.
SIGABRT: abort called
10:29:45 (2648): No heartbeat from core client for 30 sec - exiting
10:29:49 (2648): No heartbeat from core client for 30 sec - exiting
10:29:50 (2648): No heartbeat from core client for 30 sec - exiting
Signal 15 received, exiting...
Called boinc_finish
Signal 15 received, exiting...
Called boinc_finish
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x08b41830 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2368: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 *(sizeof(size_t))) - 1)) & ~((2 *(sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed.
SIGABRT: abort called
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x08da6830 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2368: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 *(sizeof(size_t))) - 1)) & ~((2 *(sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed.
SIGABRT: abort called
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x08294848 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2368: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 *(sizeof(size_t))) - 1)) & ~((2 *(sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed.
SIGABRT: abort called
Signal 15 received, exiting...
Called boinc_finish
Signal 15 received, exiting...
Called boinc_finish
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x08fbd848 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2368: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 *(sizeof(size_t))) - 1)) & ~((2 *(sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed.
SIGABRT: abort called
Signal 15 received, exiting...
Called boinc_finish
Signal 15 received, exiting...
Called boinc_finish
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x084d3848 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2368: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 *(sizeof(size_t))) - 1)) & ~((2 *(sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed.
SIGABRT: abort called
Signal 15 received, exiting...
Called boinc_finish
Signal 15 received, exiting...
Called boinc_finish
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x09b40848 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2368: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 *(sizeof(size_t))) - 1)) & ~((2 *(sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed.
SIGABRT: abort called
14:10:18 (2569): No heartbeat from core client for 30 sec - exiting
14:10:26 (2569): No heartbeat from core client for 30 sec - exiting
14:10:27 (2569): No heartbeat from core client for 30 sec - exiting
14:10:28 (2569): No heartbeat from core client for 30 sec - exiting
14:10:29 (2569): No heartbeat from core client for 30 sec - exiting
14:10:30 (2569): No heartbeat from core client for 30 sec - exiting
14:10:31 (2569): No heartbeat from core client for 30 sec - exiting
14:10:32 (2569): No heartbeat from core client for 30 sec - exiting
14:10:33 (2569): No heartbeat from core client for 30 sec - exiting
14:10:34 (2569): No heartbeat from core client for 30 sec - exiting
14:10:35 (2569): No heartbeat from core client for 30 sec - exiting
14:10:36 (2569): No heartbeat from core client for 30 sec - exiting
14:10:37 (2569): No heartbeat from core client for 30 sec - exiting
14:10:38 (2569): No heartbeat from core client for 30 sec - exiting
14:10:39 (2569): No heartbeat from core client for 30 sec - exiting
14:10:40 (2569): No heartbeat from core client for 30 sec - exiting
14:10:41 (2569): No heartbeat from core client for 30 sec - exiting
14:10:42 (2569): No heartbeat from core client for 30 sec - exiting
14:10:43 (2569): No heartbeat from core client for 30 sec - exiting
14:10:44 (2569): No heartbeat from core client for 30 sec - exiting
14:10:45 (2569): No heartbeat from core client for 30 sec - exiting
14:10:46 (2569): No heartbeat from core client for 30 sec - exiting
14:10:47 (2569): No heartbeat from core client for 30 sec - exiting
14:10:48 (2569): No heartbeat from core client for 30 sec - exiting
14:10:49 (2569): No heartbeat from core client for 30 sec - exiting
14:10:50 (2569): No heartbeat from core client for 30 sec - exiting
14:10:51 (2569): No heartbeat from core client for 30 sec - exiting
14:10:52 (2569): No heartbeat from core client for 30 sec - exiting
14:10:53 (2569): No heartbeat from core client for 30 sec - exiting
14:10:54 (2569): No heartbeat from core client for 30 sec - exiting
14:10:55 (2569): No heartbeat from core client for 30 sec - exiting
14:10:56 (2569): No heartbeat from core client for 30 sec - exiting
14:10:57 (2569): No heartbeat from core client for 30 sec - exiting
14:10:58 (2569): No heartbeat from core client for 30 sec - exiting
14:10:59 (2569): No heartbeat from core client for 30 sec - exiting
14:11:00 (2569): No heartbeat from core client for 30 sec - exiting
14:11:01 (2569): No heartbeat from core client for 30 sec - exiting
14:11:02 (2569): No heartbeat from core client for 30 sec - exiting
14:11:03 (2569): No heartbeat from core client for 30 sec - exiting
14:11:04 (2569): No heartbeat from core client for 30 sec - exiting
14:11:05 (2569): No heartbeat from core client for 30 sec - exiting
14:11:06 (2569): No heartbeat from core client for 30 sec - exiting
14:11:07 (2569): No heartbeat from core client for 30 sec - exiting
14:11:08 (2569): No heartbeat from core client for 30 sec - exiting
14:11:09 (2569): No heartbeat from core client for 30 sec - exiting
14:11:10 (2569): No heartbeat from core client for 30 sec - exiting
14:11:11 (2569): No heartbeat from core client for 30 sec - exiting
14:11:12 (2569): No heartbeat from core client for 30 sec - exiting
14:11:13 (2569): No heartbeat from core client for 30 sec - exiting
14:11:14 (2569): No heartbeat from core client for 30 sec - exiting
14:11:15 (2569): No heartbeat from core client for 30 sec - exiting
14:11:16 (2569): No heartbeat from core client for 30 sec - exiting
14:11:17 (2569): No heartbeat from core client for 30 sec - exiting
14:11:18 (2569): No heartbeat from core client for 30 sec - exiting
14:11:19 (2569): No heartbeat from core client for 30 sec - exiting
14:11:20 (2569): No heartbeat from core client for 30 sec - exiting
14:11:21 (2569): No heartbeat from core client for 30 sec - exiting
14:11:22 (2569): No heartbeat from core client for 30 sec - exiting
14:11:23 (2569): No heartbeat from core client for 30 sec - exiting
14:11:24 (2569): No heartbeat from core client for 30 sec - exiting
14:11:25 (2569): No heartbeat from core client for 30 sec - exiting
14:11:26 (2569): No heartbeat from core client for 30 sec - exiting
14:11:27 (2569): No heartbeat from core client for 30 sec - exiting
14:11:28 (2569): No heartbeat from core client for 30 sec - exiting
14:11:29 (2569): No heartbeat from core client for 30 sec - exiting
14:11:30 (2569): No heartbeat from core client for 30 sec - exiting
14:11:31 (2569): No heartbeat from core client for 30 sec - exiting
14:11:32 (2569): No heartbeat from core client for 30 sec - exiting
14:11:33 (2569): No heartbeat from core client for 30 sec - exiting
14:11:34 (2569): No heartbeat from core client for 30 sec - exiting
14:11:35 (2569): No heartbeat from core client for 30 sec - exiting
14:11:36 (2569): No heartbeat from core client for 30 sec - exiting
14:11:37 (2569): No heartbeat from core client for 30 sec - exiting
14:11:38 (2569): No heartbeat from core client for 30 sec - exiting
14:11:39 (2569): No heartbeat from core client for 30 sec - exiting
14:11:40 (2569): No heartbeat from core client for 30 sec - exiting
14:11:41 (2569): No heartbeat from core client for 30 sec - exiting
14:11:42 (2569): No heartbeat from core client for 30 sec - exiting
14:11:43 (2569): No heartbeat from core client for 30 sec - exiting
14:11:44 (2569): No heartbeat from core client for 30 sec - exiting
14:11:45 (2569): No heartbeat from core client for 30 sec - exiting
14:11:46 (2569): No heartbeat from core client for 30 sec - exiting
14:11:47 (2569): No heartbeat from core client for 30 sec - exiting
14:11:48 (2569): No heartbeat from core client for 30 sec - exiting
14:11:49 (2569): No heartbeat from core client for 30 sec - exiting
14:11:50 (2569): No heartbeat from core client for 30 sec - exiting
14:11:51 (2569): No heartbeat from core client for 30 sec - exiting
14:11:52 (2569): No heartbeat from core client for 30 sec - exiting
14:11:53 (2569): No heartbeat from core client for 30 sec - exiting
14:11:54 (2569): No heartbeat from core client for 30 sec - exiting
14:11:55 (2569): No heartbeat from core client for 30 sec - exiting
14:11:56 (2569): No heartbeat from core client for 30 sec - exiting
14:11:57 (2569): No heartbeat from core client for 30 sec - exiting
14:11:58 (2569): No heartbeat from core client for 30 sec - exiting
14:13:32 (2569): No heartbeat from core client for 30 sec - exiting
14:25:56 (2569): No heartbeat from core client for 30 sec - exiting
14:26:11 (2569): No heartbeat from core client for 30 sec - exiting
14:26:12 (2569): No heartbeat from core client for 30 sec - exiting
14:26:13 (2569): No heartbeat from core client for 30 sec - exiting
14:26:14 (2569): No heartbeat from core client for 30 sec - exiting
14:26:15 (2569): No heartbeat from core client for 30 sec - exiting
14:26:16 (2569): No heartbeat from core client for 30 sec - exiting
14:26:17 (2569): No heartbeat from core client for 30 sec - exiting
14:26:18 (2569): No heartbeat from core client for 30 sec - exiting
14:26:19 (2569): No heartbeat from core client for 30 sec - exiting
14:26:20 (2569): No heartbeat from core client for 30 sec - exiting
14:26:21 (2569): No heartbeat from core client for 30 sec - exiting
14:26:22 (2569): No heartbeat from core client for 30 sec - exiting
14:26:23 (2569): No heartbeat from core client for 30 sec - exiting
14:26:24 (2569): No heartbeat from core client for 30 sec - exiting
14:26:25 (2569): No heartbeat from core client for 30 sec - exiting
14:26:26 (2569): No heartbeat from core client for 30 sec - exiting
14:26:27 (2569): No heartbeat from core client for 30 sec - exiting
14:26:28 (2569): No heartbeat from core client for 30 sec - exiting
14:26:29 (2569): No heartbeat from core client for 30 sec - exiting
14:26:30 (2569): No heartbeat from core client for 30 sec - exiting
14:26:31 (2569): No heartbeat from core client for 30 sec - exiting
14:26:32 (2569): No heartbeat from core client for 30 sec - exiting
14:26:33 (2569): No heartbeat from core client for 30 sec - exiting
14:26:34 (2569): No heartbeat from core client for 30 sec - exiting
14:26:35 (2569): No heartbeat from core client for 30 sec - exiting
14:26:36 (2569): No heartbeat from core client for 30 sec - exiting
14:26:37 (2569): No heartbeat from core client for 30 sec - exiting
14:26:38 (2569): No heartbeat from core client for 30 sec - exiting
14:26:39 (2569): No heartbeat from core client for 30 sec - exiting
14:26:40 (2569): No heartbeat from core client for 30 sec - exiting
14:26:41 (2569): No heartbeat from core client for 30 sec - exiting
14:26:42 (2569): No heartbeat from core client for 30 sec - exiting
14:26:43 (2569): No heartbeat from core client for 30 sec - exiting
14:26:44 (2569): No heartbeat from core client for 30 sec - exiting
14:26:45 (2569): No heartbeat from core client for 30 sec - exiting
14:26:46 (2569): No heartbeat from core client for 30 sec - exiting
14:26:47 (2569): No heartbeat from core client for 30 sec - exiting
14:26:48 (2569): No heartbeat from core client for 30 sec - exiting
14:26:49 (2569): No heartbeat from core client for 30 sec - exiting
14:26:50 (2569): No heartbeat from core client for 30 sec - exiting
14:26:52 (2569): No heartbeat from core client for 30 sec - exiting
14:26:53 (2569): No heartbeat from core client for 30 sec - exiting
14:26:54 (2569): No heartbeat from core client for 30 sec - exiting
14:26:55 (2569): No heartbeat from core client for 30 sec - exiting
14:26:56 (2569): No heartbeat from core client for 30 sec - exiting
14:26:57 (2569): No heartbeat from core client for 30 sec - exiting
14:26:58 (2569): No heartbeat from core client for 30 sec - exiting
14:26:59 (2569): No heartbeat from core client for 30 sec - exiting
14:27:00 (2569): No heartbeat from core client for 30 sec - exiting
14:27:01 (2569): No heartbeat from core client for 30 sec - exiting
14:27:02 (2569): No heartbeat from core client for 30 sec - exiting
14:27:04 (2569): No heartbeat from core client for 30 sec - exiting
14:27:05 (2569): No heartbeat from core client for 30 sec - exiting
14:27:06 (2569): No heartbeat from core client for 30 sec - exiting
14:27:37 (2569): No heartbeat from core client for 30 sec - exiting
14:27:38 (2569): No heartbeat from core client for 30 sec - exiting
14:27:39 (2569): No heartbeat from core client for 30 sec - exiting
14:27:40 (2569): No heartbeat from core client for 30 sec - exiting
14:27:41 (2569): No heartbeat from core client for 30 sec - exiting
14:27:42 (2569): No heartbeat from core client for 30 sec - exiting
14:27:43 (2569): No heartbeat from core client for 30 sec - exiting
14:27:44 (2569): No heartbeat from core client for 30 sec - exiting
14:27:45 (2569): No heartbeat from core client for 30 sec - exiting
14:27:46 (2569): No heartbeat from core client for 30 sec - exiting
14:27:47 (2569): No heartbeat from core client for 30 sec - exiting
14:27:48 (2569): No heartbeat from core client for 30 sec - exiting
14:27:49 (2569): No heartbeat from core client for 30 sec - exiting
14:27:50 (2569): No heartbeat from core client for 30 sec - exiting
14:27:51 (2569): No heartbeat from core client for 30 sec - exiting
14:27:52 (2569): No heartbeat from core client for 30 sec - exiting
14:28:03 (2569): No heartbeat from core client for 30 sec - exiting
14:28:04 (2569): No heartbeat from core client for 30 sec - exiting
14:28:05 (2569): No heartbeat from core client for 30 sec - exiting
14:28:06 (2569): No heartbeat from core client for 30 sec - exiting
14:28:07 (2569): No heartbeat from core client for 30 sec - exiting
14:28:08 (2569): No heartbeat from core client for 30 sec - exiting
14:28:09 (2569): No heartbeat from core client for 30 sec - exiting
14:28:10 (2569): No heartbeat from core client for 30 sec - exiting
14:28:11 (2569): No heartbeat from core client for 30 sec - exiting
14:28:12 (2569): No heartbeat from core client for 30 sec - exiting
14:28:13 (2569): No heartbeat from core client for 30 sec - exiting
14:28:14 (2569): No heartbeat from core client for 30 sec - exiting
14:28:15 (2569): No heartbeat from core client for 30 sec - exiting
14:28:16 (2569): No heartbeat from core client for 30 sec - exiting
14:28:17 (2569): No heartbeat from core client for 30 sec - exiting
14:28:18 (2569): No heartbeat from core client for 30 sec - exiting
14:28:19 (2569): No heartbeat from core client for 30 sec - exiting
14:28:20 (2569): No heartbeat from core client for 30 sec - exiting
14:28:21 (2569): No heartbeat from core client for 30 sec - exiting
14:28:22 (2569): No heartbeat from core client for 30 sec - exiting
14:28:23 (2569): No heartbeat from core client for 30 sec - exiting
14:28:24 (2569): No heartbeat from core client for 30 sec - exiting
14:28:25 (2569): No heartbeat from core client for 30 sec - exiting
14:28:26 (2569): No heartbeat from core client for 30 sec - exiting
14:28:27 (2569): No heartbeat from core client for 30 sec - exiting
14:28:28 (2569): No heartbeat from core client for 30 sec - exiting
14:28:29 (2569): No heartbeat from core client for 30 sec - exiting
14:28:30 (2569): No heartbeat from core client for 30 sec - exiting
14:28:31 (2569): No heartbeat from core client for 30 sec - exiting
14:28:32 (2569): No heartbeat from core client for 30 sec - exiting
14:28:33 (2569): No heartbeat from core client for 30 sec - exiting
14:28:34 (2569): No heartbeat from core client for 30 sec - exiting
14:28:41 (2569): No heartbeat from core client for 30 sec - exiting
14:28:42 (2569): No heartbeat from core client for 30 sec - exiting
14:28:43 (2569): No heartbeat from core client for 30 sec - exiting
14:28:44 (2569): No heartbeat from core client for 30 sec - exiting
14:28:45 (2569): No heartbeat from core client for 30 sec - exiting
14:28:46 (2569): No heartbeat from core client for 30 sec - exiting
14:28:48 (2569): No heartbeat from core client for 30 sec - exiting
14:28:49 (2569): No heartbeat from core client for 30 sec - exiting
14:28:50 (2569): No heartbeat from core client for 30 sec - exiting
14:28:51 (2569): No heartbeat from core client for 30 sec - exiting
14:28:52 (2569): No heartbeat from core client for 30 sec - exiting
14:28:53 (2569): No heartbeat from core client for 30 sec - exiting
14:28:54 (2569): No heartbeat from core client for 30 sec - exiting
14:28:55 (2569): No heartbeat from core client for 30 sec - exiting
14:28:56 (2569): No heartbeat from core client for 30 sec - exiting
14:28:57 (2569): No heartbeat from core client for 30 sec - exiting
14:28:58 (2569): No heartbeat from core client for 30 sec - exiting
14:28:59 (2569): No heartbeat from core client for 30 sec - exiting
14:29:00 (2569): No heartbeat from core client for 30 sec - exiting
14:29:01 (2569): No heartbeat from core client for 30 sec - exiting
14:29:02 (2569): No heartbeat from core client for 30 sec - exiting
14:29:03 (2569): No heartbeat from core client for 30 sec - exiting
14:29:04 (2569): No heartbeat from core client for 30 sec - exiting
14:29:05 (2569): No heartbeat from core client for 30 sec - exiting
14:29:06 (2569): No heartbeat from core client for 30 sec - exiting
14:29:07 (2569): No heartbeat from core client for 30 sec - exiting
14:29:08 (2569): No heartbeat from core client for 30 sec - exiting
14:29:09 (2569): No heartbeat from core client for 30 sec - exiting
14:29:10 (2569): No heartbeat from core client for 30 sec - exiting
14:29:11 (2569): No heartbeat from core client for 30 sec - exiting
14:29:12 (2569): No heartbeat from core client for 30 sec - exiting
14:29:13 (2569): No heartbeat from core client for 30 sec - exiting
14:29:14 (2569): No heartbeat from core client for 30 sec - exiting
14:29:15 (2569): No heartbeat from core client for 30 sec - exiting
14:29:16 (2569): No heartbeat from core client for 30 sec - exiting
14:29:17 (2569): No heartbeat from core client for 30 sec - exiting
14:29:18 (2569): No heartbeat from core client for 30 sec - exiting
14:29:19 (2569): No heartbeat from core client for 30 sec - exiting
14:29:20 (2569): No heartbeat from core client for 30 sec - exiting
14:29:21 (2569): No heartbeat from core client for 30 sec - exiting
14:29:22 (2569): No heartbeat from core client for 30 sec - exiting
14:29:23 (2569): No heartbeat from core client for 30 sec - exiting
14:29:24 (2569): No heartbeat from core client for 30 sec - exiting
14:29:25 (2569): No heartbeat from core client for 30 sec - exiting
14:29:26 (2569): No heartbeat from core client for 30 sec - exiting
14:29:27 (2569): No heartbeat from core client for 30 sec - exiting
14:29:28 (2569): No heartbeat from core client for 30 sec - exiting
14:29:29 (2569): No heartbeat from core client for 30 sec - exiting
14:29:30 (2569): No heartbeat from core client for 30 sec - exiting
14:29:31 (2569): No heartbeat from core client for 30 sec - exiting
14:29:32 (2569): No heartbeat from core client for 30 sec - exiting
14:29:33 (2569): No heartbeat from core client for 30 sec - exiting
14:29:34 (2569): No heartbeat from core client for 30 sec - exiting
14:29:35 (2569): No heartbeat from core client for 30 sec - exiting
14:29:36 (2569): No heartbeat from core client for 30 sec - exiting
14:29:37 (2569): No heartbeat from core client for 30 sec - exiting
14:29:38 (2569): No heartbeat from core client for 30 sec - exiting
14:29:39 (2569): No heartbeat from core client for 30 sec - exiting
14:29:40 (2569): No heartbeat from core client for 30 sec - exiting
14:29:41 (2569): No heartbeat from core client for 30 sec - exiting
14:29:42 (2569): No heartbeat from core client for 30 sec - exiting
14:29:43 (2569): No heartbeat from core client for 30 sec - exiting
14:29:44 (2569): No heartbeat from core client for 30 sec - exiting
14:29:45 (2569): No heartbeat from core client for 30 sec - exiting
14:29:46 (2569): No heartbeat from core client for 30 sec - exiting
14:29:47 (2569): No heartbeat from core client for 30 sec - exiting
14:29:48 (2569): No heartbeat from core client for 30 sec - exiting
14:29:49 (2569): No heartbeat from core client for 30 sec - exiting
14:29:50 (2569): No heartbeat from core client for 30 sec - exiting
14:29:51 (2569): No heartbeat from core client for 30 sec - exiting
14:29:52 (2569): No heartbeat from core client for 30 sec - exiting
14:29:53 (2569): No heartbeat from core client for 30 sec - exiting
14:29:54 (2569): No heartbeat from core client for 30 sec - exiting
14:29:55 (2569): No heartbeat from core client for 30 sec - exiting
14:29:56 (2569): No heartbeat from core client for 30 sec - exiting
14:29:59 (2569): No heartbeat from core client for 30 sec - exiting
14:30:00 (2569): No heartbeat from core client for 30 sec - exiting
14:30:01 (2569): No heartbeat from core client for 30 sec - exiting
14:30:03 (2569): No heartbeat from core client for 30 sec - exiting
14:30:04 (2569): No heartbeat from core client for 30 sec - exiting
14:30:05 (2569): No heartbeat from core client for 30 sec - exiting
14:30:07 (2569): No heartbeat from core client for 30 sec - exiting
14:30:08 (2569): No heartbeat from core client for 30 sec - exiting
14:30:09 (2569): No heartbeat from core client for 30 sec - exiting
14:30:11 (2569): No heartbeat from core client for 30 sec - exiting
14:30:12 (2569): No heartbeat from core client for 30 sec - exiting
14:30:13 (2569): No heartbeat from core client for 30 sec - exiting
14:30:15 (2569): No heartbeat from core client for 30 sec - exiting
14:30:16 (2569): No heartbeat from core client for 30 sec - exiting
14:30:17 (2569): No heartbeat from core client for 30 sec - exiting
14:30:19 (2569): No heartbeat from core client for 30 sec - exiting
14:30:20 (2569): No heartbeat from core client for 30 sec - exiting
14:30:21 (2569): No heartbeat from core client for 30 sec - exiting
14:30:23 (2569): No heartbeat from core client for 30 sec - exiting
14:30:24 (2569): No heartbeat from core client for 30 sec - exiting
14:30:25 (2569): No heartbeat from core client for 30 sec - exiting
14:30:27 (2569): No heartbeat from core client for 30 sec - exiting
14:30:28 (2569): No heartbeat from core client for 30 sec - exiting
14:30:29 (2569): No heartbeat from core client for 30 sec - exiting
14:30:31 (2569): No heartbeat from core client for 30 sec - exiting
14:30:32 (2569): No heartbeat from core client for 30 sec - exiting
14:30:33 (2569): No heartbeat from core client for 30 sec - exiting
14:30:35 (2569): No heartbeat from core client for 30 sec - exiting
14:30:36 (2569): No heartbeat from core client for 30 sec - exiting
14:30:37 (2569): No heartbeat from core client for 30 sec - exiting
14:30:39 (2569): No heartbeat from core client for 30 sec - exiting
14:30:40 (2569): No heartbeat from core client for 30 sec - exiting
14:30:41 (2569): No heartbeat from core client for 30 sec - exiting
14:30:43 (2569): No heartbeat from core client for 30 sec - exiting
14:30:44 (2569): No heartbeat from core client for 30 sec - exiting
14:30:45 (2569): No heartbeat from core client for 30 sec - exiting
14:30:47 (2569): No heartbeat from core client for 30 sec - exiting
14:30:48 (2569): No heartbeat from core client for 30 sec - exiting
14:30:49 (2569): No heartbeat from core client for 30 sec - exiting
14:30:51 (2569): No heartbeat from core client for 30 sec - exiting
14:30:52 (2569): No heartbeat from core client for 30 sec - exiting
14:30:53 (2569): No heartbeat from core client for 30 sec - exiting
14:30:55 (2569): No heartbeat from core client for 30 sec - exiting
14:30:56 (2569): No heartbeat from core client for 30 sec - exiting
14:30:58 (2569): No heartbeat from core client for 30 sec - exiting
14:30:59 (2569): No heartbeat from core client for 30 sec - exiting
14:31:00 (2569): No heartbeat from core client for 30 sec - exiting
14:31:01 (2569): No heartbeat from core client for 30 sec - exiting
14:31:03 (2569): No heartbeat from core client for 30 sec - exiting
14:31:04 (2569): No heartbeat from core client for 30 sec - exiting
14:31:05 (2569): No heartbeat from core client for 30 sec - exiting
14:31:07 (2569): No heartbeat from core client for 30 sec - exiting
14:31:08 (2569): No heartbeat from core client for 30 sec - exiting
14:31:10 (2569): No heartbeat from core client for 30 sec - exiting
14:31:11 (2569): No heartbeat from core client for 30 sec - exiting
14:31:12 (2569): No heartbeat from core client for 30 sec - exiting
14:31:13 (2569): No heartbeat from core client for 30 sec - exiting
14:31:14 (2569): No heartbeat from core client for 30 sec - exiting
14:31:15 (2569): No heartbeat from core client for 30 sec - exiting
14:31:16 (2569): No heartbeat from core client for 30 sec - exiting
14:31:17 (2569): No heartbeat from core client for 30 sec - exiting
14:31:18 (2569): No heartbeat from core client for 30 sec - exiting
14:31:20 (2569): No heartbeat from core client for 30 sec - exiting
14:31:33 (2569): No heartbeat from core client for 30 sec - exiting
14:31:34 (2569): No heartbeat from core client for 30 sec - exiting
14:31:35 (2569): No heartbeat from core client for 30 sec - exiting
14:31:36 (2569): No heartbeat from core client for 30 sec - exiting
14:31:37 (2569): No heartbeat from core client for 30 sec - exiting
14:31:38 (2569): No heartbeat from core client for 30 sec - exiting
14:31:39 (2569): No heartbeat from core client for 30 sec - exiting
14:31:40 (2569): No heartbeat from core client for 30 sec - exiting
14:31:41 (2569): No heartbeat from core client for 30 sec - exiting
14:31:42 (2569): No heartbeat from core client for 30 sec - exiting
14:31:43 (2569): No heartbeat from core client for 30 sec - exiting
14:31:44 (2569): No heartbeat from core client for 30 sec - exiting
14:31:45 (2569): No heartbeat from core client for 30 sec - exiting
14:31:46 (2569): No heartbeat from core client for 30 sec - exiting
14:31:47 (2569): No heartbeat from core client for 30 sec - exiting
14:31:48 (2569): No heartbeat from core client for 30 sec - exiting
14:31:49 (2569): No heartbeat from core client for 30 sec - exiting
14:31:50 (2569): No heartbeat from core client for 30 sec - exiting
14:31:51 (2569): No heartbeat from core client for 30 sec - exiting
14:31:52 (2569): No heartbeat from core client for 30 sec - exiting
14:31:53 (2569): No heartbeat from core client for 30 sec - exiting
14:31:54 (2569): No heartbeat from core client for 30 sec - exiting
14:31:55 (2569): No heartbeat from core client for 30 sec - exiting
14:31:56 (2569): No heartbeat from core client for 30 sec - exiting
14:31:57 (2569): No heartbeat from core client for 30 sec - exiting
14:31:58 (2569): No heartbeat from core client for 30 sec - exiting
14:31:59 (2569): No heartbeat from core client for 30 sec - exiting
14:32:00 (2569): No heartbeat from core client for 30 sec - exiting
14:32:01 (2569): No heartbeat from core client for 30 sec - exiting
14:32:02 (2569): No heartbeat from core client for 30 sec - exiting
14:32:03 (2569): No heartbeat from core client for 30 sec - exiting
14:32:04 (2569): No heartbeat from core client for 30 sec - exiting
14:32:05 (2569): No heartbeat from core client for 30 sec - exiting
14:32:06 (2569): No heartbeat from core client for 30 sec - exiting
14:32:07 (2569): No heartbeat from core client for 30 sec - exiting
14:32:08 (2569): No heartbeat from core client for 30 sec - exiting
14:32:09 (2569): No heartbeat from core client for 30 sec - exiting
14:32:10 (2569): No heartbeat from core client for 30 sec - exiting
14:32:12 (2569): No heartbeat from core client for 30 sec - exiting
14:32:13 (2569): No heartbeat from core client for 30 sec - exiting
14:32:14 (2569): No heartbeat from core client for 30 sec - exiting
14:32:15 (2569): No heartbeat from core client for 30 sec - exiting
14:32:16 (2569): No heartbeat from core client for 30 sec - exiting
14:32:17 (2569): No heartbeat from core client for 30 sec - exiting
14:32:18 (2569): No heartbeat from core client for 30 sec - exiting
14:32:19 (2569): No heartbeat from core client for 30 sec - exiting
14:32:20 (2569): No heartbeat from core client for 30 sec - exiting
14:32:32 (2569): No heartbeat from core client for 30 sec - exiting
14:32:33 (2569): No heartbeat from core client for 30 sec - exiting
14:32:34 (2569): No heartbeat from core client for 30 sec - exiting
14:32:35 (2569): No heartbeat from core client for 30 sec - exiting
14:32:37 (2569): No heartbeat from core client for 30 sec - exiting
14:32:38 (2569): No heartbeat from core client for 30 sec - exiting
14:32:39 (2569): No heartbeat from core client for 30 sec - exiting
14:32:40 (2569): No heartbeat from core client for 30 sec - exiting
14:32:41 (2569): No heartbeat from core client for 30 sec - exiting
14:32:42 (2569): No heartbeat from core client for 30 sec - exiting
14:32:43 (2569): No heartbeat from core client for 30 sec - exiting
14:32:44 (2569): No heartbeat from core client for 30 sec - exiting
14:32:45 (2569): No heartbeat from core client for 30 sec - exiting
14:32:46 (2569): No heartbeat from core client for 30 sec - exiting
14:32:47 (2569): No heartbeat from core client for 30 sec - exiting
14:32:53 (2569): No heartbeat from core client for 30 sec - exiting
14:32:54 (2569): No heartbeat from core client for 30 sec - exiting
14:32:55 (2569): No heartbeat from core client for 30 sec - exiting
14:32:56 (2569): No heartbeat from core client for 30 sec - exiting
14:32:57 (2569): No heartbeat from core client for 30 sec - exiting
14:32:58 (2569): No heartbeat from core client for 30 sec - exiting
14:32:59 (2569): No heartbeat from core client for 30 sec - exiting
14:33:00 (2569): No heartbeat from core client for 30 sec - exiting
14:33:01 (2569): No heartbeat from core client for 30 sec - exiting
14:33:02 (2569): No heartbeat from core client for 30 sec - exiting
14:33:03 (2569): No heartbeat from core client for 30 sec - exiting
14:33:04 (2569): No heartbeat from core client for 30 sec - exiting
14:33:05 (2569): No heartbeat from core client for 30 sec - exiting
14:33:06 (2569): No heartbeat from core client for 30 sec - exiting
14:33:08 (2569): No heartbeat from core client for 30 sec - exiting
14:33:09 (2569): No heartbeat from core client for 30 sec - exiting
14:33:10 (2569): No heartbeat from core client for 30 sec - exiting
14:33:15 (2569): No heartbeat from core client for 30 sec - exiting
14:33:16 (2569): No heartbeat from core client for 30 sec - exiting
14:33:17 (2569): No heartbeat from core client for 30 sec - exiting
14:33:18 (2569): No heartbeat from core client for 30 sec - exiting
14:33:19 (2569): No heartbeat from core client for 30 sec - exiting
14:33:20 (2569): No heartbeat from core client for 30 sec - exiting
14:33:21 (2569): No heartbeat from core client for 30 sec - exiting
14:33:22 (2569): No heartbeat from core client for 30 sec - exiting
14:33:23 (2569): No heartbeat from core client for 30 sec - exiting
14:33:24 (2569): No heartbeat from core client for 30 sec - exiting
14:33:25 (2569): No heartbeat from core client for 30 sec - exiting
14:33:26 (2569): No heartbeat from core client for 30 sec - exiting
14:33:27 (2569): No heartbeat from core client for 30 sec - exiting
14:33:28 (2569): No heartbeat from core client for 30 sec - exiting
14:33:29 (2569): No heartbeat from core client for 30 sec - exiting
14:33:30 (2569): No heartbeat from core client for 30 sec - exiting
14:33:31 (2569): No heartbeat from core client for 30 sec - exiting
14:33:32 (2569): No heartbeat from core client for 30 sec - exiting
14:33:33 (2569): No heartbeat from core client for 30 sec - exiting
14:33:34 (2569): No heartbeat from core client for 30 sec - exiting
14:33:35 (2569): No heartbeat from core client for 30 sec - exiting
14:33:36 (2569): No heartbeat from core client for 30 sec - exiting
14:33:37 (2569): No heartbeat from core client for 30 sec - exiting
14:33:38 (2569): No heartbeat from core client for 30 sec - exiting
14:33:39 (2569): No heartbeat from core client for 30 sec - exiting
14:33:40 (2569): No heartbeat from core client for 30 sec - exiting
14:33:41 (2569): No heartbeat from core client for 30 sec - exiting
14:33:42 (2569): No heartbeat from core client for 30 sec - exiting
14:33:43 (2569): No heartbeat from core client for 30 sec - exiting
14:33:44 (2569): No heartbeat from core client for 30 sec - exiting
14:33:45 (2569): No heartbeat from core client for 30 sec - exiting
14:33:46 (2569): No heartbeat from core client for 30 sec - exiting
14:33:47 (2569): No heartbeat from core client for 30 sec - exiting
14:33:48 (2569): No heartbeat from core client for 30 sec - exiting
14:33:49 (2569): No heartbeat from core client for 30 sec - exiting
14:33:50 (2569): No heartbeat from core client for 30 sec - exiting
14:33:51 (2569): No heartbeat from core client for 30 sec - exiting
14:33:52 (2569): No heartbeat from core client for 30 sec - exiting
14:33:53 (2569): No heartbeat from core client for 30 sec - exiting
14:33:55 (2569): No heartbeat from core client for 30 sec - exiting
14:33:56 (2569): No heartbeat from core client for 30 sec - exiting
14:33:57 (2569): No heartbeat from core client for 30 sec - exiting
14:33:58 (2569): No heartbeat from core client for 30 sec - exiting
14:33:59 (2569): No heartbeat from core client for 30 sec - exiting
14:34:00 (2569): No heartbeat from core client for 30 sec - exiting
14:34:01 (2569): No heartbeat from core client for 30 sec - exiting
14:34:02 (2569): No heartbeat from core client for 30 sec - exiting
14:34:03 (2569): No heartbeat from core client for 30 sec - exiting
14:34:04 (2569): No heartbeat from core client for 30 sec - exiting
14:34:05 (2569): No heartbeat from core client for 30 sec - exiting
14:34:06 (2569): No heartbeat from core client for 30 sec - exiting
14:34:07 (2569): No heartbeat from core client for 30 sec - exiting
14:34:08 (2569): No heartbeat from core client for 30 sec - exiting
14:34:09 (2569): No heartbeat from core client for 30 sec - exiting
14:34:10 (2569): No heartbeat from core client for 30 sec - exiting
14:34:11 (2569): No heartbeat from core client for 30 sec - exiting
14:34:12 (2569): No heartbeat from core client for 30 sec - exiting
14:34:13 (2569): No heartbeat from core client for 30 sec - exiting
14:34:14 (2569): No heartbeat from core client for 30 sec - exiting
14:34:15 (2569): No heartbeat from core client for 30 sec - exiting
14:34:16 (2569): No heartbeat from core client for 30 sec - exiting
14:34:17 (2569): No heartbeat from core client for 30 sec - exiting
14:34:18 (2569): No heartbeat from core client for 30 sec - exiting
14:34:19 (2569): No heartbeat from core client for 30 sec - exiting
14:34:20 (2569): No heartbeat from core client for 30 sec - exiting
14:34:21 (2569): No heartbeat from core client for 30 sec - exiting
14:34:22 (2569): No heartbeat from core client for 30 sec - exiting
14:34:23 (2569): No heartbeat from core client for 30 sec - exiting
14:34:24 (2569): No heartbeat from core client for 30 sec - exiting
14:34:25 (2569): No heartbeat from core client for 30 sec - exiting
14:34:26 (2569): No heartbeat from core client for 30 sec - exiting
14:34:27 (2569): No heartbeat from core client for 30 sec - exiting
14:34:28 (2569): No heartbeat from core client for 30 sec - exiting
14:34:29 (2569): No heartbeat from core client for 30 sec - exiting
14:34:30 (2569): No heartbeat from core client for 30 sec - exiting
14:34:31 (2569): No heartbeat from core client for 30 sec - exiting
14:34:32 (2569): No heartbeat from core client for 30 sec - exiting
14:34:33 (2569): No heartbeat from core client for 30 sec - exiting
14:34:34 (2569): No heartbeat from core client for 30 sec - exiting
14:34:35 (2569): No heartbeat from core client for 30 sec - exiting
14:34:36 (2569): No heartbeat from core client for 30 sec - exiting
14:34:37 (2569): No heartbeat from core client for 30 sec - exiting
14:34:38 (2569): No heartbeat from core client for 30 sec - exiting
14:34:39 (2569): No heartbeat from core client for 30 sec - exiting
14:34:40 (2569): No heartbeat from core client for 30 sec - exiting
14:34:41 (2569): No heartbeat from core client for 30 sec - exiting
14:34:42 (2569): No heartbeat from core client for 30 sec - exiting
14:34:43 (2569): No heartbeat from core client for 30 sec - exiting
14:34:44 (2569): No heartbeat from core client for 30 sec - exiting
14:34:45 (2569): No heartbeat from core client for 30 sec - exiting
14:34:46 (2569): No heartbeat from core client for 30 sec - exiting
14:34:47 (2569): No heartbeat from core client for 30 sec - exiting
14:34:48 (2569): No heartbeat from core client for 30 sec - exiting
14:34:49 (2569): No heartbeat from core client for 30 sec - exiting
14:34:50 (2569): No heartbeat from core client for 30 sec - exiting
14:34:51 (2569): No heartbeat from core client for 30 sec - exiting
14:34:52 (2569): No heartbeat from core client for 30 sec - exiting
14:34:53 (2569): No heartbeat from core client for 30 sec - exiting
14:34:54 (2569): No heartbeat from core client for 30 sec - exiting
14:34:55 (2569): No heartbeat from core client for 30 sec - exiting
14:34:56 (2569): No heartbeat from core client for 30 sec - exiting
14:34:57 (2569): No heartbeat from core client for 30 sec - exiting
14:34:58 (2569): No heartbeat from core client for 30 sec - exiting
14:34:59 (2569): No heartbeat from core client for 30 sec - exiting
14:35:00 (2569): No heartbeat from core client for 30 sec - exiting
14:35:01 (2569): No heartbeat from core client for 30 sec - exiting
14:35:02 (2569): No heartbeat from core client for 30 sec - exiting
14:35:03 (2569): No heartbeat from core client for 30 sec - exiting
14:35:04 (2569): No heartbeat from core client for 30 sec - exiting
14:35:05 (2569): No heartbeat from core client for 30 sec - exiting
14:35:06 (2569): No heartbeat from core client for 30 sec - exiting
14:35:07 (2569): No heartbeat from core client for 30 sec - exiting
14:35:08 (2569): No heartbeat from core client for 30 sec - exiting
14:35:09 (2569): No heartbeat from core client for 30 sec - exiting
14:35:10 (2569): No heartbeat from core client for 30 sec - exiting
14:35:11 (2569): No heartbeat from core client for 30 sec - exiting
14:35:12 (2569): No heartbeat from core client for 30 sec - exiting
14:35:13 (2569): No heartbeat from core client for 30 sec - exiting
14:35:14 (2569): No heartbeat from core client for 30 sec - exiting
14:35:15 (2569): No heartbeat from core client for 30 sec - exiting
14:35:16 (2569): No heartbeat from core client for 30 sec - exiting
14:35:17 (2569): No heartbeat from core client for 30 sec - exiting
14:35:18 (2569): No heartbeat from core client for 30 sec - exiting
14:35:19 (2569): No heartbeat from core client for 30 sec - exiting
14:35:20 (2569): No heartbeat from core client for 30 sec - exiting
14:35:21 (2569): No heartbeat from core client for 30 sec - exiting
14:35:22 (2569): No heartbeat from core client for 30 sec - exiting
14:35:23 (2569): No heartbeat from core client for 30 sec - exiting
14:35:24 (2569): No heartbeat from core client for 30 sec - exiting
14:35:26 (2569): No heartbeat from core client for 30 sec - exiting
14:35:27 (2569): No heartbeat from core client for 30 sec - exiting
14:35:28 (2569): No heartbeat from core client for 30 sec - exiting
14:35:29 (2569): No heartbeat from core client for 30 sec - exiting
14:35:30 (2569): No heartbeat from core client for 30 sec - exiting
14:35:33 (2569): No heartbeat from core client for 30 sec - exiting
14:35:34 (2569): No heartbeat from core client for 30 sec - exiting
14:35:35 (2569): No heartbeat from core client for 30 sec - exiting
14:35:49 (2569): No heartbeat from core client for 30 sec - exiting
14:35:50 (2569): No heartbeat from core client for 30 sec - exiting
14:35:51 (2569): No heartbeat from core client for 30 sec - exiting
14:35:52 (2569): No heartbeat from core client for 30 sec - exiting
14:35:53 (2569): No heartbeat from core client for 30 sec - exiting
14:35:54 (2569): No heartbeat from core client for 30 sec - exiting
14:35:55 (2569): No heartbeat from core client for 30 sec - exiting
14:35:56 (2569): No heartbeat from core client for 30 sec - exiting
14:35:57 (2569): No heartbeat from core client for 30 sec - exiting
14:36:01 (2569): No heartbeat from core client for 30 sec - exiting
14:36:02 (2569): No heartbeat from core client for 30 sec - exiting
14:36:03 (2569): No heartbeat from core client for 30 sec - exiting
14:36:04 (2569): No heartbeat from core client for 30 sec - exiting
14:36:06 (2569): No heartbeat from core client for 30 sec - exiting
14:42:41 (2569): No heartbeat from core client for 30 sec - exiting
14:42:43 (2569): No heartbeat from core client for 30 sec - exiting
14:42:44 (2569): No heartbeat from core client for 30 sec - exiting
14:42:45 (2569): No heartbeat from core client for 30 sec - exiting
14:42:46 (2569): No heartbeat from core client for 30 sec - exiting
14:42:47 (2569): No heartbeat from core client for 30 sec - exiting
14:42:48 (2569): No heartbeat from core client for 30 sec - exiting
14:42:49 (2569): No heartbeat from core client for 30 sec - exiting
14:42:50 (2569): No heartbeat from core client for 30 sec - exiting
14:42:51 (2569): No heartbeat from core client for 30 sec - exiting
14:42:52 (2569): No heartbeat from core client for 30 sec - exiting
14:42:53 (2569): No heartbeat from core client for 30 sec - exiting
14:42:54 (2569): No heartbeat from core client for 30 sec - exiting
14:42:55 (2569): No heartbeat from core client for 30 sec - exiting
14:42:56 (2569): No heartbeat from core client for 30 sec - exiting
14:42:57 (2569): No heartbeat from core client for 30 sec - exiting
14:46:01 (2569): No heartbeat from core client for 30 sec - exiting
14:46:02 (2569): No heartbeat from core client for 30 sec - exiting
14:46:03 (2569): No heartbeat from core client for 30 sec - exiting
14:46:04 (2569): No heartbeat from core client for 30 sec - exiting
14:46:06 (2569): No heartbeat from core client for 30 sec - exiting
14:46:07 (2569): No heartbeat from core client for 30 sec - exiting
14:46:08 (2569): No heartbeat from core client for 30 sec - exiting
14:46:10 (2569): No heartbeat from core client for 30 sec - exiting
14:46:11 (2569): No heartbeat from core client for 30 sec - exiting
14:46:12 (2569): No heartbeat from core client for 30 sec - exiting
14:46:14 (2569): No heartbeat from core client for 30 sec - exiting
14:46:15 (2569): No heartbeat from core client for 30 sec - exiting
14:46:16 (2569): No heartbeat from core client for 30 sec - exiting
14:46:18 (2569): No heartbeat from core client for 30 sec - exiting
14:46:19 (2569): No heartbeat from core client for 30 sec - exiting
14:46:21 (2569): No heartbeat from core client for 30 sec - exiting
14:46:22 (2569): No heartbeat from core client for 30 sec - exiting
14:46:23 (2569): No heartbeat from core client for 30 sec - exiting
14:46:24 (2569): No heartbeat from core client for 30 sec - exiting
14:46:26 (2569): No heartbeat from core client for 30 sec - exiting
14:46:27 (2569): No heartbeat from core client for 30 sec - exiting
14:46:28 (2569): No heartbeat from core client for 30 sec - exiting
14:46:30 (2569): No heartbeat from core client for 30 sec - exiting
14:46:31 (2569): No heartbeat from core client for 30 sec - exiting
14:46:32 (2569): No heartbeat from core client for 30 sec - exiting
14:46:34 (2569): No heartbeat from core client for 30 sec - exiting
14:46:35 (2569): No heartbeat from core client for 30 sec - exiting
14:46:36 (2569): No heartbeat from core client for 30 sec - exiting
14:46:38 (2569): No heartbeat from core client for 30 sec - exiting
14:46:39 (2569): No heartbeat from core client for 30 sec - exiting
14:46:40 (2569): No heartbeat from core client for 30 sec - exiting
14:46:42 (2569): No heartbeat from core client for 30 sec - exiting
14:46:43 (2569): No heartbeat from core client for 30 sec - exiting
14:46:45 (2569): No heartbeat from core client for 30 sec - exiting
14:46:46 (2569): No heartbeat from core client for 30 sec - exiting
14:46:47 (2569): No heartbeat from core client for 30 sec - exiting
14:47:28 (2569): No heartbeat from core client for 30 sec - exiting
14:47:29 (2569): No heartbeat from core client for 30 sec - exiting
14:47:30 (2569): No heartbeat from core client for 30 sec - exiting
14:47:31 (2569): No heartbeat from core client for 30 sec - exiting
14:47:32 (2569): No heartbeat from core client for 30 sec - exiting
14:47:33 (2569): No heartbeat from core client for 30 sec - exiting
14:47:34 (2569): No heartbeat from core client for 30 sec - exiting
14:47:35 (2569): No heartbeat from core client for 30 sec - exiting
14:47:36 (2569): No heartbeat from core client for 30 sec - exiting
14:47:37 (2569): No heartbeat from core client for 30 sec - exiting
14:47:38 (2569): No heartbeat from core client for 30 sec - exiting
14:47:39 (2569): No heartbeat from core client for 30 sec - exiting
14:47:40 (2569): No heartbeat from core client for 30 sec - exiting
14:47:41 (2569): No heartbeat from core client for 30 sec - exiting
14:47:42 (2569): No heartbeat from core client for 30 sec - exiting
14:47:43 (2569): No heartbeat from core client for 30 sec - exiting
14:47:44 (2569): No heartbeat from core client for 30 sec - exiting
14:47:45 (2569): No heartbeat from core client for 30 sec - exiting
14:47:46 (2569): No heartbeat from core client for 30 sec - exiting
14:47:47 (2569): No heartbeat from core client for 30 sec - exiting
14:47:48 (2569): No heartbeat from core client for 30 sec - exiting
14:47:49 (2569): No heartbeat from core client for 30 sec - exiting
14:47:50 (2569): No heartbeat from core client for 30 sec - exiting
14:47:51 (2569): No heartbeat from core client for 30 sec - exiting
14:47:52 (2569): No heartbeat from core client for 30 sec - exiting
14:47:53 (2569): No heartbeat from core client for 30 sec - exiting
14:47:54 (2569): No heartbeat from core client for 30 sec - exiting
14:47:55 (2569): No heartbeat from core client for 30 sec - exiting
14:47:56 (2569): No heartbeat from core client for 30 sec - exiting
14:47:57 (2569): No heartbeat from core client for 30 sec - exiting
14:47:58 (2569): No heartbeat from core client for 30 sec - exiting
14:47:59 (2569): No heartbeat from core client for 30 sec - exiting
14:48:00 (2569): No heartbeat from core client for 30 sec - exiting
14:48:01 (2569): No heartbeat from core client for 30 sec - exiting
14:48:02 (2569): No heartbeat from core client for 30 sec - exiting
14:48:03 (2569): No heartbeat from core client for 30 sec - exiting
14:48:04 (2569): No heartbeat from core client for 30 sec - exiting
14:48:05 (2569): No heartbeat from core client for 30 sec - exiting
14:48:06 (2569): No heartbeat from core client for 30 sec - exiting
14:48:07 (2569): No heartbeat from core client for 30 sec - exiting
14:48:08 (2569): No heartbeat from core client for 30 sec - exiting
14:48:09 (2569): No heartbeat from core client for 30 sec - exiting
14:48:10 (2569): No heartbeat from core client for 30 sec - exiting
14:48:11 (2569): No heartbeat from core client for 30 sec - exiting
14:48:12 (2569): No heartbeat from core client for 30 sec - exiting
14:48:13 (2569): No heartbeat from core client for 30 sec - exiting
14:48:14 (2569): No heartbeat from core client for 30 sec - exiting
14:48:15 (2569): No heartbeat from core client for 30 sec - exiting
14:48:16 (2569): No heartbeat from core client for 30 sec - exiting
14:48:17 (2569): No heartbeat from core client for 30 sec - exiting
14:48:18 (2569): No heartbeat from core client for 30 sec - exiting
14:48:19 (2569): No heartbeat from core client for 30 sec - exiting
14:48:20 (2569): No heartbeat from core client for 30 sec - exiting
14:48:21 (2569): No heartbeat from core client for 30 sec - exiting
14:48:22 (2569): No heartbeat from core client for 30 sec - exiting
14:48:23 (2569): No heartbeat from core client for 30 sec - exiting
14:48:24 (2569): No heartbeat from core client for 30 sec - exiting
14:48:25 (2569): No heartbeat from core client for 30 sec - exiting
14:48:26 (2569): No heartbeat from core client for 30 sec - exiting
14:48:27 (2569): No heartbeat from core client for 30 sec - exiting
14:48:28 (2569): No heartbeat from core client for 30 sec - exiting
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x090a5848 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2368: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 *(sizeof(size_t))) - 1)) & ~((2 *(sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed.
SIGABRT: abort called
19:04:17 (3507): No heartbeat from core client for 30 sec - exiting
19:04:18 (3507): No heartbeat from core client for 30 sec - exiting
19:04:20 (3507): No heartbeat from core client for 30 sec - exiting
19:04:21 (3507): No heartbeat from core client for 30 sec - exiting
19:04:22 (3507): No heartbeat from core client for 30 sec - exiting
19:04:23 (3507): No heartbeat from core client for 30 sec - exiting
19:04:24 (3507): No heartbeat from core client for 30 sec - exiting
19:04:25 (3507): No heartbeat from core client for 30 sec - exiting
19:04:26 (3507): No heartbeat from core client for 30 sec - exiting
19:04:27 (3507): No heartbeat from core client for 30 sec - exiting
19:04:28 (3507): No heartbeat from core client for 30 sec - exiting
19:04:29 (3507): No heartbeat from core client for 30 sec - exiting
19:04:30 (3507): No heartbeat from core client for 30 sec - exiting
19:04:31 (3507): No heartbeat from core client for 30 sec - exiting
21:55:35 (3507): No heartbeat from core client for 30 sec - exiting
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x08673848 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2368: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 *(sizeof(size_t))) - 1)) & ~((2 *(sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed.
SIGABRT: abort called
Signal 15 received, exiting...
Called boinc_finish
Signal 15 received, exiting...
Called boinc_finish
19:30:38 (3154): No heartbeat from core client for 30 sec - exiting
19:30:39 (3154): No heartbeat from core client for 30 sec - exiting
19:30:40 (3154): No heartbeat from core client for 30 sec - exiting
19:30:41 (3154): No heartbeat from core client for 30 sec - exiting
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x08e14848 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2368: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 *(sizeof(size_t))) - 1)) & ~((2 *(sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed.
SIGABRT: abort called
19:30:42 (3154): No heartbeat from core client for 30 sec - exiting
19:30:43 (3154): No heartbeat from core client for 30 sec - exiting
19:30:44 (3154): No heartbeat from core client for 30 sec - exiting
19:30:45 (3154): No heartbeat from core client for 30 sec - exiting
19:30:46 (3154): No heartbeat from core client for 30 sec - exiting
19:30:47 (3154): No heartbeat from core client for 30 sec - exiting
19:30:51 (3154): No heartbeat from core client for 30 sec - exiting
19:30:52 (3154): No heartbeat from core client for 30 sec - exiting
19:30:53 (3154): No heartbeat from core client for 30 sec - exiting
19:30:54 (3154): No heartbeat from core client for 30 sec - exiting
19:30:55 (3154): No heartbeat from core client for 30 sec - exiting
19:30:57 (3154): No heartbeat from core client for 30 sec - exiting
19:30:58 (3154): No heartbeat from core client for 30 sec - exiting
19:30:59 (3154): No heartbeat from core client for 30 sec - exiting
19:31:00 (3154): No heartbeat from core client for 30 sec - exiting
19:31:01 (3154): No heartbeat from core client for 30 sec - exiting
19:31:02 (3154): No heartbeat from core client for 30 sec - exiting
19:31:03 (3154): No heartbeat from core client for 30 sec - exiting
19:31:05 (3154): No heartbeat from core client for 30 sec - exiting

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
03 Apr 2013 08:35:28 889885 15648835 hadcm3n_4hos_1940_40_008303176_2 1,036,800 2,310,891 2.2289
02 Apr 2013 15:25:47 889885 15648835 hadcm3n_4hos_1940_40_008303176_2 1,010,880 2,251,971 2.2277
01 Apr 2013 22:09:30 889885 15648835 hadcm3n_4hos_1940_40_008303176_2 984,960 2,193,181 2.2267
01 Apr 2013 04:48:02 889885 15648835 hadcm3n_4hos_1940_40_008303176_2 959,040 2,134,100 2.2252
31 Mar 2013 11:35:00 889885 15648835 hadcm3n_4hos_1940_40_008303176_2 933,120 2,074,895 2.2236
30 Mar 2013 18:16:31 889885 15648835 hadcm3n_4hos_1940_40_008303176_2 907,200 2,015,360 2.2215
30 Mar 2013 00:51:47 889885 15648835 hadcm3n_4hos_1940_40_008303176_2 881,280 1,955,940 2.2194
29 Mar 2013 07:25:20 889885 15648835 hadcm3n_4hos_1940_40_008303176_2 855,360 1,896,796 2.2175
28 Mar 2013 15:00:45 889885 15648835 hadcm3n_4hos_1940_40_008303176_2 829,440 1,839,622 2.2179
27 Mar 2013 21:49:03 889885 15648835 hadcm3n_4hos_1940_40_008303176_2 803,520 1,779,518 2.2147
27 Mar 2013 05:21:05 889885 15648835 hadcm3n_4hos_1940_40_008303176_2 777,600 1,721,490 2.2139
26 Mar 2013 12:37:22 889885 15648835 hadcm3n_4hos_1940_40_008303176_2 751,680 1,663,350 2.2128
25 Mar 2013 19:43:17 889885 15648835 hadcm3n_4hos_1940_40_008303176_2 725,760 1,605,104 2.2116
25 Mar 2013 02:50:47 889885 15648835 hadcm3n_4hos_1940_40_008303176_2 699,840 1,546,476 2.2098
24 Mar 2013 10:12:31 889885 15648835 hadcm3n_4hos_1940_40_008303176_2 673,920 1,488,006 2.2080
23 Mar 2013 17:41:22 889885 15648835 hadcm3n_4hos_1940_40_008303176_2 648,000 1,429,766 2.2064
23 Mar 2013 00:24:12 889885 15648835 hadcm3n_4hos_1940_40_008303176_2 622,080 1,369,513 2.2015
22 Mar 2013 05:38:00 889885 15648835 hadcm3n_4hos_1940_40_008303176_2 596,160 1,311,639 2.2001
21 Mar 2013 12:45:13 889885 15648835 hadcm3n_4hos_1940_40_008303176_2 570,240 1,253,760 2.1987
20 Mar 2013 20:13:22 889885 15648835 hadcm3n_4hos_1940_40_008303176_2 544,320 1,196,948 2.1990


©2024 climateprediction.net