climateprediction.net home page
Task 15908143

Task 15908143

Name hadcm3n_101k_1980_40_008398013_1
Workunit 8548869
Created 25 Jul 2013, 20:02:06 UTC
Sent 25 Jul 2013, 20:02:41 UTC
Report deadline 25 Oct 2013, 3:29:52 UTC
Received 18 Sep 2013, 20:20:44 UTC
Server state Over
Outcome Computation error
Client state Aborted by user
Exit status 203 (0x000000CB) EXIT_ABORTED_VIA_GUI
Computer ID 896795
Run time 5 days 15 hours 42 min 19 sec
CPU time 5 days 14 hours 52 min 55 sec
Validate state Invalid
Credit 3,110.40
Device peak FLOPS 2.51 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>7.0.27</core_client_version>
<![CDATA[
<message>
aborted by user
</message>
<stderr_txt>
end request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08519fb0 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09a4c798 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
Signal 15 received, exiting...
Called boinc_finish
Signal 1 received, exiting...
Called boinc_finish
Signal 15 received, exiting...
Called boinc_finish
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08b50798 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08367798 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
04:06:44 (27311): No heartbeat from core client for 30 sec - exiting
04:07:55 (27311): No heartbeat from core client for 30 sec - exiting
06:11:01 (27311): No heartbeat from core client for 30 sec - exiting
06:11:02 (27311): No heartbeat from core client for 30 sec - exiting
06:11:03 (27311): No heartbeat from core client for 30 sec - exiting
06:11:04 (27311): No heartbeat from core client for 30 sec - exiting
06:11:05 (27311): No heartbeat from core client for 30 sec - exiting
06:11:06 (27311): No heartbeat from core client for 30 sec - exiting
06:11:07 (27311): No heartbeat from core client for 30 sec - exiting
06:11:10 (27311): No heartbeat from core client for 30 sec - exiting
06:11:11 (27311): No heartbeat from core client for 30 sec - exiting
06:11:12 (27311): No heartbeat from core client for 30 sec - exiting
06:11:13 (27311): No heartbeat from core client for 30 sec - exiting
06:11:16 (27311): No heartbeat from core client for 30 sec - exiting
06:11:17 (27311): No heartbeat from core client for 30 sec - exiting
06:11:18 (27311): No heartbeat from core client for 30 sec - exiting
06:11:19 (27311): No heartbeat from core client for 30 sec - exiting
06:11:20 (27311): No heartbeat from core client for 30 sec - exiting
06:11:21 (27311): No heartbeat from core client for 30 sec - exiting
06:11:24 (27311): No heartbeat from core client for 30 sec - exiting
06:11:25 (27311): No heartbeat from core client for 30 sec - exiting
06:11:26 (27311): No heartbeat from core client for 30 sec - exiting
06:11:27 (27311): No heartbeat from core client for 30 sec - exiting
06:11:28 (27311): No heartbeat from core client for 30 sec - exiting
06:11:29 (27311): No heartbeat from core client for 30 sec - exiting
06:11:32 (27311): No heartbeat from core client for 30 sec - exiting
06:11:33 (27311): No heartbeat from core client for 30 sec - exiting
06:11:34 (27311): No heartbeat from core client for 30 sec - exiting
06:11:37 (27311): No heartbeat from core client for 30 sec - exiting
06:11:38 (27311): No heartbeat from core client for 30 sec - exiting
06:11:39 (27311): No heartbeat from core client for 30 sec - exiting
06:11:40 (27311): No heartbeat from core client for 30 sec - exiting
06:11:42 (27311): No heartbeat from core client for 30 sec - exiting
06:11:43 (27311): No heartbeat from core client for 30 sec - exiting
06:11:44 (27311): No heartbeat from core client for 30 sec - exiting
06:11:45 (27311): No heartbeat from core client for 30 sec - exiting
06:11:46 (27311): No heartbeat from core client for 30 sec - exiting
06:11:47 (27311): No heartbeat from core client for 30 sec - exiting
06:11:50 (27311): No heartbeat from core client for 30 sec - exiting
06:11:51 (27311): No heartbeat from core client for 30 sec - exiting
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09771798 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
01:43:30 (3073): No heartbeat from core client for 30 sec - exiting
01:43:32 (3073): No heartbeat from core client for 30 sec - exiting
01:43:33 (3073): No heartbeat from core client for 30 sec - exiting
01:43:34 (3073): No heartbeat from core client for 30 sec - exiting
01:43:35 (3073): No heartbeat from core client for 30 sec - exiting
01:43:36 (3073): No heartbeat from core client for 30 sec - exiting
01:43:37 (3073): No heartbeat from core client for 30 sec - exiting
01:43:38 (3073): No heartbeat from core client for 30 sec - exiting
01:43:39 (3073): No heartbeat from core client for 30 sec - exiting
01:43:40 (3073): No heartbeat from core client for 30 sec - exiting
01:43:41 (3073): No heartbeat from core client for 30 sec - exiting
01:43:42 (3073): No heartbeat from core client for 30 sec - exiting
01:43:43 (3073): No heartbeat from core client for 30 sec - exiting
01:43:44 (3073): No heartbeat from core client for 30 sec - exiting
01:43:45 (3073): No heartbeat from core client for 30 sec - exiting
01:43:46 (3073): No heartbeat from core client for 30 sec - exiting
01:43:47 (3073): No heartbeat from core client for 30 sec - exiting
01:43:48 (3073): No heartbeat from core client for 30 sec - exiting
01:43:49 (3073): No heartbeat from core client for 30 sec - exiting
01:43:50 (3073): No heartbeat from core client for 30 sec - exiting
01:43:51 (3073): No heartbeat from core client for 30 sec - exiting
01:43:52 (3073): No heartbeat from core client for 30 sec - exiting
01:43:53 (3073): No heartbeat from core client for 30 sec - exiting
01:43:54 (3073): No heartbeat from core client for 30 sec - exiting
01:43:55 (3073): No heartbeat from core client for 30 sec - exiting
01:43:56 (3073): No heartbeat from core client for 30 sec - exiting
01:43:57 (3073): No heartbeat from core client for 30 sec - exiting
01:43:58 (3073): No heartbeat from core client for 30 sec - exiting
01:43:59 (3073): No heartbeat from core client for 30 sec - exiting
01:44:00 (3073): No heartbeat from core client for 30 sec - exiting
01:44:01 (3073): No heartbeat from core client for 30 sec - exiting
01:44:02 (3073): No heartbeat from core client for 30 sec - exiting
01:44:03 (3073): No heartbeat from core client for 30 sec - exiting
01:44:04 (3073): No heartbeat from core client for 30 sec - exiting
01:44:05 (3073): No heartbeat from core client for 30 sec - exiting
04:01:48 (3073): No heartbeat from core client for 30 sec - exiting
04:01:49 (3073): No heartbeat from core client for 30 sec - exiting
04:01:50 (3073): No heartbeat from core client for 30 sec - exiting
04:01:51 (3073): No heartbeat from core client for 30 sec - exiting
04:01:52 (3073): No heartbeat from core client for 30 sec - exiting
04:01:53 (3073): No heartbeat from core client for 30 sec - exiting
04:01:57 (3073): No heartbeat from core client for 30 sec - exiting
04:01:58 (3073): No heartbeat from core client for 30 sec - exiting
04:01:59 (3073): No heartbeat from core client for 30 sec - exiting
04:02:00 (3073): No heartbeat from core client for 30 sec - exiting
04:02:01 (3073): No heartbeat from core client for 30 sec - exiting
04:02:02 (3073): No heartbeat from core client for 30 sec - exiting
04:02:05 (3073): No heartbeat from core client for 30 sec - exiting
04:02:06 (3073): No heartbeat from core client for 30 sec - exiting
04:02:07 (3073): No heartbeat from core client for 30 sec - exiting
04:02:08 (3073): No heartbeat from core client for 30 sec - exiting
04:25:59 (3073): No heartbeat from core client for 30 sec - exiting
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08841798 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
05:14:44 (31425): No heartbeat from core client for 30 sec - exiting
05:16:17 (31425): No heartbeat from core client for 30 sec - exiting
05:16:18 (31425): No heartbeat from core client for 30 sec - exiting
05:16:19 (31425): No heartbeat from core client for 30 sec - exiting
05:16:20 (31425): No heartbeat from core client for 30 sec - exiting
05:16:21 (31425): No heartbeat from core client for 30 sec - exiting
05:16:22 (31425): No heartbeat from core client for 30 sec - exiting
05:16:23 (31425): No heartbeat from core client for 30 sec - exiting
05:16:26 (31425): No heartbeat from core client for 30 sec - exiting
05:16:27 (31425): No heartbeat from core client for 30 sec - exiting
05:16:28 (31425): No heartbeat from core client for 30 sec - exiting
05:16:29 (31425): No heartbeat from core client for 30 sec - exiting
05:16:30 (31425): No heartbeat from core client for 30 sec - exiting
05:16:31 (31425): No heartbeat from core client for 30 sec - exiting
05:16:35 (31425): No heartbeat from core client for 30 sec - exiting
05:16:36 (31425): No heartbeat from core client for 30 sec - exiting
05:16:37 (31425): No heartbeat from core client for 30 sec - exiting
05:16:38 (31425): No heartbeat from core client for 30 sec - exiting
05:16:39 (31425): No heartbeat from core client for 30 sec - exiting
05:16:40 (31425): No heartbeat from core client for 30 sec - exiting
05:16:43 (31425): No heartbeat from core client for 30 sec - exiting
05:16:44 (31425): No heartbeat from core client for 30 sec - exiting
05:16:45 (31425): No heartbeat from core client for 30 sec - exiting
05:16:49 (31425): No heartbeat from core client for 30 sec - exiting
05:16:50 (31425): No heartbeat from core client for 30 sec - exiting
05:16:51 (31425): No heartbeat from core client for 30 sec - exiting
05:16:52 (31425): No heartbeat from core client for 30 sec - exiting
05:16:55 (31425): No heartbeat from core client for 30 sec - exiting
05:16:56 (31425): No heartbeat from core client for 30 sec - exiting
05:16:57 (31425): No heartbeat from core client for 30 sec - exiting
05:17:02 (31425): No heartbeat from core client for 30 sec - exiting
05:17:03 (31425): No heartbeat from core client for 30 sec - exiting
05:17:04 (31425): No heartbeat from core client for 30 sec - exiting
05:17:05 (31425): No heartbeat from core client for 30 sec - exiting
05:17:06 (31425): No heartbeat from core client for 30 sec - exiting
05:17:08 (31425): No heartbeat from core client for 30 sec - exiting
05:17:09 (31425): No heartbeat from core client for 30 sec - exiting
05:17:10 (31425): No heartbeat from core client for 30 sec - exiting
05:17:11 (31425): No heartbeat from core client for 30 sec - exiting
05:17:15 (31425): No heartbeat from core client for 30 sec - exiting
05:17:16 (31425): No heartbeat from core client for 30 sec - exiting
05:17:17 (31425): No heartbeat from core client for 30 sec - exiting
05:17:18 (31425): No heartbeat from core client for 30 sec - exiting
05:17:19 (31425): No heartbeat from core client for 30 sec - exiting
05:17:20 (31425): No heartbeat from core client for 30 sec - exiting
05:17:23 (31425): No heartbeat from core client for 30 sec - exiting
05:17:24 (31425): No heartbeat from core client for 30 sec - exiting
05:17:25 (31425): No heartbeat from core client for 30 sec - exiting
05:17:29 (31425): No heartbeat from core client for 30 sec - exiting
05:17:30 (31425): No heartbeat from core client for 30 sec - exiting
05:17:31 (31425): No heartbeat from core client for 30 sec - exiting
05:17:35 (31425): No heartbeat from core client for 30 sec - exiting
05:17:36 (31425): No heartbeat from core client for 30 sec - exiting
05:17:37 (31425): No heartbeat from core client for 30 sec - exiting
05:17:38 (31425): No heartbeat from core client for 30 sec - exiting
05:17:41 (31425): No heartbeat from core client for 30 sec - exiting
05:17:42 (31425): No heartbeat from core client for 30 sec - exiting
05:17:43 (31425): No heartbeat from core client for 30 sec - exiting
05:17:47 (31425): No heartbeat from core client for 30 sec - exiting
05:17:48 (31425): No heartbeat from core client for 30 sec - exiting
05:17:49 (31425): No heartbeat from core client for 30 sec - exiting
05:17:50 (31425): No heartbeat from core client for 30 sec - exiting
05:17:51 (31425): No heartbeat from core client for 30 sec - exiting
05:17:55 (31425): No heartbeat from core client for 30 sec - exiting
05:17:56 (31425): No heartbeat from core client for 30 sec - exiting
05:17:57 (31425): No heartbeat from core client for 30 sec - exiting
05:17:58 (31425): No heartbeat from core client for 30 sec - exiting
05:18:01 (31425): No heartbeat from core client for 30 sec - exiting
05:18:02 (31425): No heartbeat from core client for 30 sec - exiting
05:18:03 (31425): No heartbeat from core client for 30 sec - exiting
05:18:04 (31425): No heartbeat from core client for 30 sec - exiting
05:18:06 (31425): No heartbeat from core client for 30 sec - exiting
05:18:07 (31425): No heartbeat from core client for 30 sec - exiting
05:18:08 (31425): No heartbeat from core client for 30 sec - exiting
05:18:09 (31425): No heartbeat from core client for 30 sec - exiting
05:18:13 (31425): No heartbeat from core client for 30 sec - exiting
05:18:14 (31425): No heartbeat from core client for 30 sec - exiting
05:18:15 (31425): No heartbeat from core client for 30 sec - exiting
05:18:16 (31425): No heartbeat from core client for 30 sec - exiting
05:18:17 (31425): No heartbeat from core client for 30 sec - exiting
05:18:19 (31425): No heartbeat from core client for 30 sec - exiting
05:18:20 (31425): No heartbeat from core client for 30 sec - exiting
05:18:21 (31425): No heartbeat from core client for 30 sec - exiting
05:18:25 (31425): No heartbeat from core client for 30 sec - exiting
05:18:26 (31425): No heartbeat from core client for 30 sec - exiting
05:18:27 (31425): No heartbeat from core client for 30 sec - exiting
05:18:28 (31425): No heartbeat from core client for 30 sec - exiting
05:18:31 (31425): No heartbeat from core client for 30 sec - exiting
05:18:32 (31425): No heartbeat from core client for 30 sec - exiting
05:18:33 (31425): No heartbeat from core client for 30 sec - exiting
05:18:37 (31425): No heartbeat from core client for 30 sec - exiting
05:18:40 (31425): No heartbeat from core client for 30 sec - exiting
05:18:41 (31425): No heartbeat from core client for 30 sec - exiting
05:18:42 (31425): No heartbeat from core client for 30 sec - exiting
05:18:43 (31425): No heartbeat from core client for 30 sec - exiting
05:18:46 (31425): No heartbeat from core client for 30 sec - exiting
05:18:47 (31425): No heartbeat from core client for 30 sec - exiting
05:18:48 (31425): No heartbeat from core client for 30 sec - exiting
05:18:52 (31425): No heartbeat from core client for 30 sec - exiting
05:18:55 (31425): No heartbeat from core client for 30 sec - exiting
05:18:56 (31425): No heartbeat from core client for 30 sec - exiting
05:18:57 (31425): No heartbeat from core client for 30 sec - exiting
05:18:58 (31425): No heartbeat from core client for 30 sec - exiting
05:19:01 (31425): No heartbeat from core client for 30 sec - exiting
05:19:02 (31425): No heartbeat from core client for 30 sec - exiting
05:19:03 (31425): No heartbeat from core client for 30 sec - exiting
05:19:04 (31425): No heartbeat from core client for 30 sec - exiting
05:46:18 (31425): No heartbeat from core client for 30 sec - exiting
05:46:19 (31425): No heartbeat from core client for 30 sec - exiting
05:46:20 (31425): No heartbeat from core client for 30 sec - exiting
05:46:21 (31425): No heartbeat from core client for 30 sec - exiting
05:46:22 (31425): No heartbeat from core client for 30 sec - exiting
05:46:23 (31425): No heartbeat from core client for 30 sec - exiting
05:46:24 (31425): No heartbeat from core client for 30 sec - exiting
05:46:25 (31425): No heartbeat from core client for 30 sec - exiting
05:46:26 (31425): No heartbeat from core client for 30 sec - exiting
05:46:27 (31425): No heartbeat from core client for 30 sec - exiting
05:46:28 (31425): No heartbeat from core client for 30 sec - exiting
05:46:29 (31425): No heartbeat from core client for 30 sec - exiting
05:46:30 (31425): No heartbeat from core client for 30 sec - exiting
05:46:31 (31425): No heartbeat from core client for 30 sec - exiting
05:46:32 (31425): No heartbeat from core client for 30 sec - exiting
05:46:33 (31425): No heartbeat from core client for 30 sec - exiting
05:46:34 (31425): No heartbeat from core client for 30 sec - exiting
05:46:35 (31425): No heartbeat from core client for 30 sec - exiting
05:46:36 (31425): No heartbeat from core client for 30 sec - exiting
05:46:37 (31425): No heartbeat from core client for 30 sec - exiting
05:46:38 (31425): No heartbeat from core client for 30 sec - exiting
05:46:39 (31425): No heartbeat from core client for 30 sec - exiting
05:46:40 (31425): No heartbeat from core client for 30 sec - exiting
05:46:41 (31425): No heartbeat from core client for 30 sec - exiting
05:46:42 (31425): No heartbeat from core client for 30 sec - exiting
05:46:43 (31425): No heartbeat from core client for 30 sec - exiting
05:46:44 (31425): No heartbeat from core client for 30 sec - exiting
05:46:45 (31425): No heartbeat from core client for 30 sec - exiting
05:46:46 (31425): No heartbeat from core client for 30 sec - exiting
05:46:47 (31425): No heartbeat from core client for 30 sec - exiting
05:46:48 (31425): No heartbeat from core client for 30 sec - exiting
05:46:49 (31425): No heartbeat from core client for 30 sec - exiting
05:46:50 (31425): No heartbeat from core client for 30 sec - exiting
05:46:51 (31425): No heartbeat from core client for 30 sec - exiting
05:46:52 (31425): No heartbeat from core client for 30 sec - exiting
05:46:53 (31425): No heartbeat from core client for 30 sec - exiting
05:46:54 (31425): No heartbeat from core client for 30 sec - exiting
05:46:55 (31425): No heartbeat from core client for 30 sec - exiting
05:46:56 (31425): No heartbeat from core client for 30 sec - exiting
05:46:57 (31425): No heartbeat from core client for 30 sec - exiting
05:46:58 (31425): No heartbeat from core client for 30 sec - exiting
05:46:59 (31425): No heartbeat from core client for 30 sec - exiting
05:47:00 (31425): No heartbeat from core client for 30 sec - exiting
05:47:01 (31425): No heartbeat from core client for 30 sec - exiting
05:47:02 (31425): No heartbeat from core client for 30 sec - exiting
05:47:03 (31425): No heartbeat from core client for 30 sec - exiting
05:47:04 (31425): No heartbeat from core client for 30 sec - exiting
05:47:05 (31425): No heartbeat from core client for 30 sec - exiting
05:47:06 (31425): No heartbeat from core client for 30 sec - exiting
05:47:07 (31425): No heartbeat from core client for 30 sec - exiting
05:47:08 (31425): No heartbeat from core client for 30 sec - exiting
05:47:09 (31425): No heartbeat from core client for 30 sec - exiting
05:47:10 (31425): No heartbeat from core client for 30 sec - exiting
05:47:11 (31425): No heartbeat from core client for 30 sec - exiting
05:47:12 (31425): No heartbeat from core client for 30 sec - exiting
05:47:13 (31425): No heartbeat from core client for 30 sec - exiting
05:47:14 (31425): No heartbeat from core client for 30 sec - exiting
05:47:15 (31425): No heartbeat from core client for 30 sec - exiting
05:47:16 (31425): No heartbeat from core client for 30 sec - exiting
05:47:17 (31425): No heartbeat from core client for 30 sec - exiting
05:47:18 (31425): No heartbeat from core client for 30 sec - exiting
05:47:19 (31425): No heartbeat from core client for 30 sec - exiting
05:47:20 (31425): No heartbeat from core client for 30 sec - exiting
05:47:21 (31425): No heartbeat from core client for 30 sec - exiting
05:47:22 (31425): No heartbeat from core client for 30 sec - exiting
05:47:23 (31425): No heartbeat from core client for 30 sec - exiting
05:47:24 (31425): No heartbeat from core client for 30 sec - exiting
05:47:25 (31425): No heartbeat from core client for 30 sec - exiting
05:47:26 (31425): No heartbeat from core client for 30 sec - exiting
05:47:27 (31425): No heartbeat from core client for 30 sec - exiting
05:47:28 (31425): No heartbeat from core client for 30 sec - exiting
05:47:29 (31425): No heartbeat from core client for 30 sec - exiting
05:47:30 (31425): No heartbeat from core client for 30 sec - exiting
05:47:31 (31425): No heartbeat from core client for 30 sec - exiting
05:47:32 (31425): No heartbeat from core client for 30 sec - exiting
05:47:33 (31425): No heartbeat from core client for 30 sec - exiting
05:47:34 (31425): No heartbeat from core client for 30 sec - exiting
05:47:35 (31425): No heartbeat from core client for 30 sec - exiting
05:47:36 (31425): No heartbeat from core client for 30 sec - exiting
05:47:37 (31425): No heartbeat from core client for 30 sec - exiting
05:47:38 (31425): No heartbeat from core client for 30 sec - exiting
05:47:39 (31425): No heartbeat from core client for 30 sec - exiting
05:47:40 (31425): No heartbeat from core client for 30 sec - exiting
05:47:41 (31425): No heartbeat from core client for 30 sec - exiting
05:47:42 (31425): No heartbeat from core client for 30 sec - exiting
05:47:43 (31425): No heartbeat from core client for 30 sec - exiting
05:47:44 (31425): No heartbeat from core client for 30 sec - exiting
05:47:45 (31425): No heartbeat from core client for 30 sec - exiting
05:47:46 (31425): No heartbeat from core client for 30 sec - exiting
05:47:47 (31425): No heartbeat from core client for 30 sec - exiting
05:47:48 (31425): No heartbeat from core client for 30 sec - exiting
05:47:49 (31425): No heartbeat from core client for 30 sec - exiting
05:47:50 (31425): No heartbeat from core client for 30 sec - exiting
05:47:51 (31425): No heartbeat from core client for 30 sec - exiting
05:47:52 (31425): No heartbeat from core client for 30 sec - exiting
05:47:53 (31425): No heartbeat from core client for 30 sec - exiting
05:47:54 (31425): No heartbeat from core client for 30 sec - exiting
05:47:55 (31425): No heartbeat from core client for 30 sec - exiting
05:47:56 (31425): No heartbeat from core client for 30 sec - exiting
05:47:57 (31425): No heartbeat from core client for 30 sec - exiting
05:47:58 (31425): No heartbeat from core client for 30 sec - exiting
05:47:59 (31425): No heartbeat from core client for 30 sec - exiting
05:48:00 (31425): No heartbeat from core client for 30 sec - exiting
05:48:01 (31425): No heartbeat from core client for 30 sec - exiting
05:48:02 (31425): No heartbeat from core client for 30 sec - exiting
05:48:04 (31425): No heartbeat from core client for 30 sec - exiting
05:48:05 (31425): No heartbeat from core client for 30 sec - exiting
05:48:06 (31425): No heartbeat from core client for 30 sec - exiting
05:48:07 (31425): No heartbeat from core client for 30 sec - exiting
05:48:10 (31425): No heartbeat from core client for 30 sec - exiting
05:48:11 (31425): No heartbeat from core client for 30 sec - exiting
05:48:12 (31425): No heartbeat from core client for 30 sec - exiting
05:48:13 (31425): No heartbeat from core client for 30 sec - exiting
05:48:16 (31425): No heartbeat from core client for 30 sec - exiting
05:48:17 (31425): No heartbeat from core client for 30 sec - exiting
05:48:18 (31425): No heartbeat from core client for 30 sec - exiting
05:48:19 (31425): No heartbeat from core client for 30 sec - exiting
05:48:20 (31425): No heartbeat from core client for 30 sec - exiting
05:48:24 (31425): No heartbeat from core client for 30 sec - exiting
05:48:25 (31425): No heartbeat from core client for 30 sec - exiting
05:48:26 (31425): No heartbeat from core client for 30 sec - exiting
05:48:27 (31425): No heartbeat from core client for 30 sec - exiting
05:48:28 (31425): No heartbeat from core client for 30 sec - exiting
05:48:29 (31425): No heartbeat from core client for 30 sec - exiting
05:48:31 (31425): No heartbeat from core client for 30 sec - exiting
05:48:32 (31425): No heartbeat from core client for 30 sec - exiting
05:48:33 (31425): No heartbeat from core client for 30 sec - exiting
05:48:34 (31425): No heartbeat from core client for 30 sec - exiting
05:48:37 (31425): No heartbeat from core client for 30 sec - exiting
05:48:38 (31425): No heartbeat from core client for 30 sec - exiting
05:48:39 (31425): No heartbeat from core client for 30 sec - exiting
05:48:43 (31425): No heartbeat from core client for 30 sec - exiting
05:48:44 (31425): No heartbeat from core client for 30 sec - exiting
05:48:45 (31425): No heartbeat from core client for 30 sec - exiting
05:48:46 (31425): No heartbeat from core client for 30 sec - exiting
05:48:47 (31425): No heartbeat from core client for 30 sec - exiting
05:48:48 (31425): No heartbeat from core client for 30 sec - exiting
05:48:50 (31425): No heartbeat from core client for 30 sec - exiting
05:48:51 (31425): No heartbeat from core client for 30 sec - exiting
05:48:52 (31425): No heartbeat from core client for 30 sec - exiting
05:48:53 (31425): No heartbeat from core client for 30 sec - exiting
05:48:57 (31425): No heartbeat from core client for 30 sec - exiting
05:48:58 (31425): No heartbeat from core client for 30 sec - exiting
05:48:59 (31425): No heartbeat from core client for 30 sec - exiting
05:49:00 (31425): No heartbeat from core client for 30 sec - exiting
05:49:01 (31425): No heartbeat from core client for 30 sec - exiting
05:49:02 (31425): No heartbeat from core client for 30 sec - exiting
05:49:04 (31425): No heartbeat from core client for 30 sec - exiting
05:49:05 (31425): No heartbeat from core client for 30 sec - exiting
05:49:06 (31425): No heartbeat from core client for 30 sec - exiting
05:49:07 (31425): No heartbeat from core client for 30 sec - exiting
05:49:10 (31425): No heartbeat from core client for 30 sec - exiting
05:49:11 (31425): No heartbeat from core client for 30 sec - exiting
05:49:12 (31425): No heartbeat from core client for 30 sec - exiting
05:49:16 (31425): No heartbeat from core client for 30 sec - exiting
05:49:17 (31425): No heartbeat from core client for 30 sec - exiting
05:49:18 (31425): No heartbeat from core client for 30 sec - exiting
05:49:19 (31425): No heartbeat from core client for 30 sec - exiting
05:49:20 (31425): No heartbeat from core client for 30 sec - exiting
05:49:21 (31425): No heartbeat from core client for 30 sec - exiting
05:49:24 (31425): No heartbeat from core client for 30 sec - exiting
05:49:25 (31425): No heartbeat from core client for 30 sec - exiting
05:49:26 (31425): No heartbeat from core client for 30 sec - exiting
05:49:27 (31425): No heartbeat from core client for 30 sec - exiting
05:49:30 (31425): No heartbeat from core client for 30 sec - exiting
05:49:31 (31425): No heartbeat from core client for 30 sec - exiting
05:49:32 (31425): No heartbeat from core client for 30 sec - exiting
05:49:33 (31425): No heartbeat from core client for 30 sec - exiting
05:49:34 (31425): No heartbeat from core client for 30 sec - exiting
05:49:35 (31425): No heartbeat from core client for 30 sec - exiting
05:49:38 (31425): No heartbeat from core client for 30 sec - exiting
05:49:39 (31425): No heartbeat from core client for 30 sec - exiting
05:49:40 (31425): No heartbeat from core client for 30 sec - exiting
05:49:41 (31425): No heartbeat from core client for 30 sec - exiting
05:49:44 (31425): No heartbeat from core client for 30 sec - exiting
05:49:45 (31425): No heartbeat from core client for 30 sec - exiting
05:49:46 (31425): No heartbeat from core client for 30 sec - exiting
05:49:47 (31425): No heartbeat from core client for 30 sec - exiting
05:49:49 (31425): No heartbeat from core client for 30 sec - exiting
05:49:50 (31425): No heartbeat from core client for 30 sec - exiting
05:49:51 (31425): No heartbeat from core client for 30 sec - exiting
05:49:52 (31425): No heartbeat from core client for 30 sec - exiting
05:49:55 (31425): No heartbeat from core client for 30 sec - exiting
05:49:56 (31425): No heartbeat from core client for 30 sec - exiting
05:49:57 (31425): No heartbeat from core client for 30 sec - exiting
05:49:58 (31425): No heartbeat from core client for 30 sec - exiting
05:50:01 (31425): No heartbeat from core client for 30 sec - exiting
05:50:02 (31425): No heartbeat from core client for 30 sec - exiting
05:50:03 (31425): No heartbeat from core client for 30 sec - exiting
05:50:07 (31425): No heartbeat from core client for 30 sec - exiting
05:50:08 (31425): No heartbeat from core client for 30 sec - exiting
05:50:09 (31425): No heartbeat from core client for 30 sec - exiting
05:50:10 (31425): No heartbeat from core client for 30 sec - exiting
05:50:11 (31425): No heartbeat from core client for 30 sec - exiting
05:50:12 (31425): No heartbeat from core client for 30 sec - exiting
05:50:14 (31425): No heartbeat from core client for 30 sec - exiting
05:50:15 (31425): No heartbeat from core client for 30 sec - exiting
05:50:16 (31425): No heartbeat from core client for 30 sec - exiting
05:50:17 (31425): No heartbeat from core client for 30 sec - exiting
05:50:21 (31425): No heartbeat from core client for 30 sec - exiting
05:50:22 (31425): No heartbeat from core client for 30 sec - exiting
05:50:23 (31425): No heartbeat from core client for 30 sec - exiting
05:50:24 (31425): No heartbeat from core client for 30 sec - exiting
05:50:25 (31425): No heartbeat from core client for 30 sec - exiting
05:50:26 (31425): No heartbeat from core client for 30 sec - exiting
05:50:28 (31425): No heartbeat from core client for 30 sec - exiting
05:50:29 (31425): No heartbeat from core client for 30 sec - exiting
05:50:30 (31425): No heartbeat from core client for 30 sec - exiting
05:50:31 (31425): No heartbeat from core client for 30 sec - exiting
05:50:32 (31425): No heartbeat from core client for 30 sec - exiting
05:50:34 (31425): No heartbeat from core client for 30 sec - exiting
05:50:35 (31425): No heartbeat from core client for 30 sec - exiting
05:50:36 (31425): No heartbeat from core client for 30 sec - exiting
05:50:37 (31425): No heartbeat from core client for 30 sec - exiting
05:50:41 (31425): No heartbeat from core client for 30 sec - exiting
05:50:42 (31425): No heartbeat from core client for 30 sec - exiting
05:50:43 (31425): No heartbeat from core client for 30 sec - exiting
05:50:44 (31425): No heartbeat from core client for 30 sec - exiting
05:50:45 (31425): No heartbeat from core client for 30 sec - exiting
05:50:49 (31425): No heartbeat from core client for 30 sec - exiting
05:50:50 (31425): No heartbeat from core client for 30 sec - exiting
05:50:51 (31425): No heartbeat from core client for 30 sec - exiting
05:50:52 (31425): No heartbeat from core client for 30 sec - exiting
05:50:55 (31425): No heartbeat from core client for 30 sec - exiting
05:50:56 (31425): No heartbeat from core client for 30 sec - exiting
05:50:57 (31425): No heartbeat from core client for 30 sec - exiting
05:50:58 (31425): No heartbeat from core client for 30 sec - exiting
05:51:01 (31425): No heartbeat from core client for 30 sec - exiting
05:51:02 (31425): No heartbeat from core client for 30 sec - exiting
05:51:03 (31425): No heartbeat from core client for 30 sec - exiting
05:51:06 (31425): No heartbeat from core client for 30 sec - exiting
05:51:07 (31425): No heartbeat from core client for 30 sec - exiting
05:51:08 (31425): No heartbeat from core client for 30 sec - exiting
05:51:09 (31425): No heartbeat from core client for 30 sec - exiting
05:51:10 (31425): No heartbeat from core client for 30 sec - exiting
05:51:11 (31425): No heartbeat from core client for 30 sec - exiting
05:51:14 (31425): No heartbeat from core client for 30 sec - exiting
05:51:15 (31425): No heartbeat from core client for 30 sec - exiting
05:51:16 (31425): No heartbeat from core client for 30 sec - exiting
05:51:17 (31425): No heartbeat from core client for 30 sec - exiting
05:51:20 (31425): No heartbeat from core client for 30 sec - exiting
05:51:21 (31425): No heartbeat from core client for 30 sec - exiting
05:51:22 (31425): No heartbeat from core client for 30 sec - exiting
05:51:25 (31425): No heartbeat from core client for 30 sec - exiting
05:51:26 (31425): No heartbeat from core client for 30 sec - exiting
05:51:27 (31425): No heartbeat from core client for 30 sec - exiting
05:51:28 (31425): No heartbeat from core client for 30 sec - exiting
05:51:29 (31425): No heartbeat from core client for 30 sec - exiting
05:51:30 (31425): No heartbeat from core client for 30 sec - exiting
05:51:33 (31425): No heartbeat from core client for 30 sec - exiting
05:51:34 (31425): No heartbeat from core client for 30 sec - exiting
05:51:35 (31425): No heartbeat from core client for 30 sec - exiting
05:51:36 (31425): No heartbeat from core client for 30 sec - exiting
05:51:39 (31425): No heartbeat from core client for 30 sec - exiting
05:51:40 (31425): No heartbeat from core client for 30 sec - exiting
05:51:41 (31425): No heartbeat from core client for 30 sec - exiting
05:51:42 (31425): No heartbeat from core client for 30 sec - exiting
05:51:43 (31425): No heartbeat from core client for 30 sec - exiting
05:51:44 (31425): No heartbeat from core client for 30 sec - exiting
05:51:47 (31425): No heartbeat from core client for 30 sec - exiting
05:51:48 (31425): No heartbeat from core client for 30 sec - exiting
05:51:49 (31425): No heartbeat from core client for 30 sec - exiting
05:51:50 (31425): No heartbeat from core client for 30 sec - exiting
05:51:53 (31425): No heartbeat from core client for 30 sec - exiting
05:51:54 (31425): No heartbeat from core client for 30 sec - exiting
05:51:55 (31425): No heartbeat from core client for 30 sec - exiting
05:51:56 (31425): No heartbeat from core client for 30 sec - exiting
05:51:57 (31425): No heartbeat from core client for 30 sec - exiting
05:51:58 (31425): No heartbeat from core client for 30 sec - exiting
05:51:59 (31425): No heartbeat from core client for 30 sec - exiting
05:52:00 (31425): No heartbeat from core client for 30 sec - exiting
05:52:01 (31425): No heartbeat from core client for 30 sec - exiting
05:52:02 (31425): No heartbeat from core client for 30 sec - exiting
05:52:03 (31425): No heartbeat from core client for 30 sec - exiting
05:52:07 (31425): No heartbeat from core client for 30 sec - exiting
05:52:08 (31425): No heartbeat from core client for 30 sec - exiting
05:52:09 (31425): No heartbeat from core client for 30 sec - exiting
06:09:13 (31425): No heartbeat from core client for 30 sec - exiting
06:09:14 (31425): No heartbeat from core client for 30 sec - exiting
06:09:15 (31425): No heartbeat from core client for 30 sec - exiting
06:09:16 (31425): No heartbeat from core client for 30 sec - exiting
06:09:17 (31425): No heartbeat from core client for 30 sec - exiting
06:09:18 (31425): No heartbeat from core client for 30 sec - exiting
06:09:19 (31425): No heartbeat from core client for 30 sec - exiting
06:09:20 (31425): No heartbeat from core client for 30 sec - exiting
06:09:21 (31425): No heartbeat from core client for 30 sec - exiting
06:09:22 (31425): No heartbeat from core client for 30 sec - exiting
06:09:23 (31425): No heartbeat from core client for 30 sec - exiting
06:09:24 (31425): No heartbeat from core client for 30 sec - exiting
06:09:25 (31425): No heartbeat from core client for 30 sec - exiting
06:09:26 (31425): No heartbeat from core client for 30 sec - exiting
06:09:27 (31425): No heartbeat from core client for 30 sec - exiting
06:09:28 (31425): No heartbeat from core client for 30 sec - exiting
06:09:29 (31425): No heartbeat from core client for 30 sec - exiting
06:09:30 (31425): No heartbeat from core client for 30 sec - exiting
06:09:31 (31425): No heartbeat from core client for 30 sec - exiting
06:09:32 (31425): No heartbeat from core client for 30 sec - exiting
06:09:33 (31425): No heartbeat from core client for 30 sec - exiting
06:09:34 (31425): No heartbeat from core client for 30 sec - exiting
06:09:35 (31425): No heartbeat from core client for 30 sec - exiting
06:09:36 (31425): No heartbeat from core client for 30 sec - exiting
06:09:37 (31425): No heartbeat from core client for 30 sec - exiting
06:09:38 (31425): No heartbeat from core client for 30 sec - exiting
06:09:39 (31425): No heartbeat from core client for 30 sec - exiting
06:09:40 (31425): No heartbeat from core client for 30 sec - exiting
06:09:41 (31425): No heartbeat from core client for 30 sec - exiting
06:09:42 (31425): No heartbeat from core client for 30 sec - exiting
06:09:43 (31425): No heartbeat from core client for 30 sec - exiting
06:09:44 (31425): No heartbeat from core client for 30 sec - exiting
06:09:45 (31425): No heartbeat from core client for 30 sec - exiting
06:09:46 (31425): No heartbeat from core client for 30 sec - exiting
06:09:47 (31425): No heartbeat from core client for 30 sec - exiting
06:09:48 (31425): No heartbeat from core client for 30 sec - exiting
06:09:49 (31425): No heartbeat from core client for 30 sec - exiting
06:09:50 (31425): No heartbeat from core client for 30 sec - exiting
06:09:51 (31425): No heartbeat from core client for 30 sec - exiting
06:09:52 (31425): No heartbeat from core client for 30 sec - exiting
06:09:53 (31425): No heartbeat from core client for 30 sec - exiting
06:09:54 (31425): No heartbeat from core client for 30 sec - exiting
06:09:55 (31425): No heartbeat from core client for 30 sec - exiting
06:09:56 (31425): No heartbeat from core client for 30 sec - exiting
06:09:57 (31425): No heartbeat from core client for 30 sec - exiting
06:09:58 (31425): No heartbeat from core client for 30 sec - exiting
06:09:59 (31425): No heartbeat from core client for 30 sec - exiting
06:10:00 (31425): No heartbeat from core client for 30 sec - exiting
06:10:01 (31425): No heartbeat from core client for 30 sec - exiting
06:10:02 (31425): No heartbeat from core client for 30 sec - exiting
06:10:03 (31425): No heartbeat from core client for 30 sec - exiting
06:10:04 (31425): No heartbeat from core client for 30 sec - exiting
06:10:05 (31425): No heartbeat from core client for 30 sec - exiting
06:10:06 (31425): No heartbeat from core client for 30 sec - exiting
06:10:07 (31425): No heartbeat from core client for 30 sec - exiting
06:10:08 (31425): No heartbeat from core client for 30 sec - exiting
06:10:09 (31425): No heartbeat from core client for 30 sec - exiting
06:10:10 (31425): No heartbeat from core client for 30 sec - exiting
06:10:11 (31425): No heartbeat from core client for 30 sec - exiting
06:10:12 (31425): No heartbeat from core client for 30 sec - exiting
06:10:13 (31425): No heartbeat from core client for 30 sec - exiting
06:10:14 (31425): No heartbeat from core client for 30 sec - exiting
06:10:15 (31425): No heartbeat from core client for 30 sec - exiting
06:10:16 (31425): No heartbeat from core client for 30 sec - exiting
06:10:17 (31425): No heartbeat from core client for 30 sec - exiting
06:10:18 (31425): No heartbeat from core client for 30 sec - exiting
06:10:19 (31425): No heartbeat from core client for 30 sec - exiting
06:10:20 (31425): No heartbeat from core client for 30 sec - exiting
06:10:21 (31425): No heartbeat from core client for 30 sec - exiting
06:10:22 (31425): No heartbeat from core client for 30 sec - exiting
06:10:23 (31425): No heartbeat from core client for 30 sec - exiting
06:10:24 (31425): No heartbeat from core client for 30 sec - exiting
06:10:25 (31425): No heartbeat from core client for 30 sec - exiting
06:10:26 (31425): No heartbeat from core client for 30 sec - exiting
06:10:27 (31425): No heartbeat from core client for 30 sec - exiting
06:10:28 (31425): No heartbeat from core client for 30 sec - exiting
06:10:29 (31425): No heartbeat from core client for 30 sec - exiting
06:10:30 (31425): No heartbeat from core client for 30 sec - exiting
06:10:31 (31425): No heartbeat from core client for 30 sec - exiting
06:10:32 (31425): No heartbeat from core client for 30 sec - exiting
06:10:33 (31425): No heartbeat from core client for 30 sec - exiting
06:10:34 (31425): No heartbeat from core client for 30 sec - exiting
06:10:35 (31425): No heartbeat from core client for 30 sec - exiting
06:10:36 (31425): No heartbeat from core client for 30 sec - exiting
06:10:37 (31425): No heartbeat from core client for 30 sec - exiting
06:10:38 (31425): No heartbeat from core client for 30 sec - exiting
06:10:39 (31425): No heartbeat from core client for 30 sec - exiting
06:10:40 (31425): No heartbeat from core client for 30 sec - exiting
06:10:41 (31425): No heartbeat from core client for 30 sec - exiting
06:10:42 (31425): No heartbeat from core client for 30 sec - exiting
06:10:43 (31425): No heartbeat from core client for 30 sec - exiting
06:10:44 (31425): No heartbeat from core client for 30 sec - exiting
06:10:45 (31425): No heartbeat from core client for 30 sec - exiting
06:10:46 (31425): No heartbeat from core client for 30 sec - exiting
06:10:47 (31425): No heartbeat from core client for 30 sec - exiting
06:10:48 (31425): No heartbeat from core client for 30 sec - exiting
06:10:49 (31425): No heartbeat from core client for 30 sec - exiting
06:10:50 (31425): No heartbeat from core client for 30 sec - exiting
06:10:51 (31425): No heartbeat from core client for 30 sec - exiting
06:10:52 (31425): No heartbeat from core client for 30 sec - exiting
06:10:53 (31425): No heartbeat from core client for 30 sec - exiting
06:10:54 (31425): No heartbeat from core client for 30 sec - exiting
06:10:55 (31425): No heartbeat from core client for 30 sec - exiting
06:10:56 (31425): No heartbeat from core client for 30 sec - exiting
06:10:57 (31425): No heartbeat from core client for 30 sec - exiting
06:10:58 (31425): No heartbeat from core client for 30 sec - exiting
06:10:59 (31425): No heartbeat from core client for 30 sec - exiting
06:11:00 (31425): No heartbeat from core client for 30 sec - exiting
06:11:01 (31425): No heartbeat from core client for 30 sec - exiting
06:11:02 (31425): No heartbeat from core client for 30 sec - exiting
06:11:03 (31425): No heartbeat from core client for 30 sec - exiting
06:11:04 (31425): No heartbeat from core client for 30 sec - exiting
06:11:05 (31425): No heartbeat from core client for 30 sec - exiting
06:11:06 (31425): No heartbeat from core client for 30 sec - exiting
06:11:07 (31425): No heartbeat from core client for 30 sec - exiting
06:11:08 (31425): No heartbeat from core client for 30 sec - exiting
06:11:09 (31425): No heartbeat from core client for 30 sec - exiting
06:11:10 (31425): No heartbeat from core client for 30 sec - exiting
08:13:53 (31425): No heartbeat from core client for 30 sec - exiting
08:13:54 (31425): No heartbeat from core client for 30 sec - exiting
08:13:55 (31425): No heartbeat from core client for 30 sec - exiting
08:13:56 (31425): No heartbeat from core client for 30 sec - exiting
08:13:57 (31425): No heartbeat from core client for 30 sec - exiting
08:13:58 (31425): No heartbeat from core client for 30 sec - exiting
08:13:59 (31425): No heartbeat from core client for 30 sec - exiting
08:14:00 (31425): No heartbeat from core client for 30 sec - exiting
08:14:01 (31425): No heartbeat from core client for 30 sec - exiting
08:14:02 (31425): No heartbeat from core client for 30 sec - exiting
08:14:03 (31425): No heartbeat from core client for 30 sec - exiting
08:14:04 (31425): No heartbeat from core client for 30 sec - exiting
08:14:05 (31425): No heartbeat from core client for 30 sec - exiting
08:14:06 (31425): No heartbeat from core client for 30 sec - exiting
08:14:07 (31425): No heartbeat from core client for 30 sec - exiting
08:14:08 (31425): No heartbeat from core client for 30 sec - exiting
08:14:09 (31425): No heartbeat from core client for 30 sec - exiting
08:14:10 (31425): No heartbeat from core client for 30 sec - exiting
08:14:11 (31425): No heartbeat from core client for 30 sec - exiting
08:14:12 (31425): No heartbeat from core client for 30 sec - exiting
08:14:13 (31425): No heartbeat from core client for 30 sec - exiting
08:14:14 (31425): No heartbeat from core client for 30 sec - exiting
08:14:15 (31425): No heartbeat from core client for 30 sec - exiting
08:14:16 (31425): No heartbeat from core client for 30 sec - exiting
08:14:17 (31425): No heartbeat from core client for 30 sec - exiting
08:14:18 (31425): No heartbeat from core client for 30 sec - exiting
08:14:19 (31425): No heartbeat from core client for 30 sec - exiting
08:14:20 (31425): No heartbeat from core client for 30 sec - exiting
08:14:21 (31425): No heartbeat from core client for 30 sec - exiting
08:14:22 (31425): No heartbeat from core client for 30 sec - exiting
08:14:23 (31425): No heartbeat from core client for 30 sec - exiting
08:14:24 (31425): No heartbeat from core client for 30 sec - exiting
08:14:25 (31425): No heartbeat from core client for 30 sec - exiting
08:14:26 (31425): No heartbeat from core client for 30 sec - exiting
08:14:27 (31425): No heartbeat from core client for 30 sec - exiting
Signal 15 received, exiting...
Called boinc_finish
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08c21798 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x094a2798 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x0958e798 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08ed8798 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x0880a798 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08dfb798 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
03 Sep 2013 02:27:55 896795 15908143 hadcm3n_101k_1980_40_008398013_1 259,200 484,661 1.8698
29 Aug 2013 17:13:56 896795 15908143 hadcm3n_101k_1980_40_008398013_1 233,280 435,944 1.8688
24 Aug 2013 17:25:06 896795 15908143 hadcm3n_101k_1980_40_008398013_1 207,360 387,427 1.8684
20 Aug 2013 08:43:10 896795 15908143 hadcm3n_101k_1980_40_008398013_1 181,440 338,993 1.8683
14 Aug 2013 18:42:53 896795 15908143 hadcm3n_101k_1980_40_008398013_1 155,520 290,559 1.8683
14 Aug 2013 18:42:53 896795 15908143 hadcm3n_101k_1980_40_008398013_1 129,600 242,328 1.8698
14 Aug 2013 18:42:53 896795 15908143 hadcm3n_101k_1980_40_008398013_1 103,680 194,138 1.8725
14 Aug 2013 18:42:53 896795 15908143 hadcm3n_101k_1980_40_008398013_1 77,760 145,682 1.8735
29 Jul 2013 13:54:16 896795 15908143 hadcm3n_101k_1980_40_008398013_1 51,840 97,111 1.8733
29 Jul 2013 13:54:17 896795 15908143 hadcm3n_101k_1980_40_008398013_1 25,920 48,424 1.8682


©2024 climateprediction.net