Task 17381927

Name	hadcm3n_x0ab_1940_40_009147638_1
Workunit	9277974
Created	9 Nov 2014, 17:04:51 UTC
Sent	9 Nov 2014, 17:08:51 UTC
Report deadline	9 Feb 2015, 0:36:02 UTC
Received	8 Dec 2014, 21:45:54 UTC
Server state	Over
Outcome	Computation error
Client state	Aborted by user
Exit status	203 (0x000000CB) EXIT_ABORTED_VIA_GUI
Computer ID	1337234
Run time	4 days 0 hours 57 min
CPU time	3 days 17 hours 36 min 55 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	3.23 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu
Stderr	<core_client_version>7.2.42</core_client_version> <![CDATA[ <message> aborted by user </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:07:42 (23138): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... Called boinc_finish 20:47:41 (11391): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:29:56 (3474): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 11:29:57 (3474): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:30:36 (30774): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:46:16 (3480): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... Called boinc_finish * Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x09473e08 * SIGABRT: abort called hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2372: sysmalloc: Assertion `(old_top == (((mbinptr) (((char ) &((av)->bins[((1) - 1) 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) \|\| ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 (sizeof(size_t))) - 1)) & ~((2 (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed. SIGABRT: abort called Signal 15 received, exiting... Called boinc_finish * Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x08251618 * SIGABRT: abort called hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2372: sysmalloc: Assertion `(old_top == (((mbinptr) (((char ) &((av)->bins[((1) - 1) 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) \|\| ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 (sizeof(size_t))) - 1)) & ~((2 (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed. SIGABRT: abort called 09:15:17 (3578): No heartbeat from core client for 30 sec - exiting 09:15:18 (3578): No heartbeat from core client for 30 sec - exiting 09:15:19 (3578): No heartbeat from core client for 30 sec - exiting 09:15:20 (3578): No heartbeat from core client for 30 sec - exiting 09:15:21 (3578): No heartbeat from core client for 30 sec - exiting 09:15:22 (3578): No heartbeat from core client for 30 sec - exiting 09:15:23 (3578): No heartbeat from core client for 30 sec - exiting 09:15:24 (3578): No heartbeat from core client for 30 sec - exiting * Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x0a026618 * SIGABRT: abort called hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2372: sysmalloc: Assertion `(old_top == (((mbinptr) (((char ) &((av)->bins[((1) - 1) 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) \|\| ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 (sizeof(size_t))) - 1)) & ~((2 (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed. SIGABRT: abort called 16:39:41 (5755): No heartbeat from core client for 30 sec - exiting 16:39:43 (5755): No heartbeat from core client for 30 sec - exiting 16:39:44 (5755): No heartbeat from core client for 30 sec - exiting 16:39:45 (5755): No heartbeat from core client for 30 sec - exiting 16:39:46 (5755): No heartbeat from core client for 30 sec - exiting 16:39:47 (5755): No heartbeat from core client for 30 sec - exiting 16:39:48 (5755): No heartbeat from core client for 30 sec - exiting 16:39:49 (5755): No heartbeat from core client for 30 sec - exiting 16:39:50 (5755): No heartbeat from core client for 30 sec - exiting 16:39:51 (5755): No heartbeat from core client for 30 sec - exiting 16:39:52 (5755): No heartbeat from core client for 30 sec - exiting 16:39:53 (5755): No heartbeat from core client for 30 sec - exiting 16:39:54 (5755): No heartbeat from core client for 30 sec - exiting 16:39:55 (5755): No heartbeat from core client for 30 sec - exiting 16:39:56 (5755): No heartbeat from core client for 30 sec - exiting 16:39:57 (5755): No heartbeat from core client for 30 sec - exiting 16:39:58 (5755): No heartbeat from core client for 30 sec - exiting 16:39:59 (5755): No heartbeat from core client for 30 sec - exiting 16:40:00 (5755): No heartbeat from core client for 30 sec - exiting 16:40:01 (5755): No heartbeat from core client for 30 sec - exiting 16:40:02 (5755): No heartbeat from core client for 30 sec - exiting 16:40:03 (5755): No heartbeat from core client for 30 sec - exiting 16:40:04 (5755): No heartbeat from core client for 30 sec - exiting 16:40:05 (5755): No heartbeat from core client for 30 sec - exiting 16:40:06 (5755): No heartbeat from core client for 30 sec - exiting 16:40:07 (5755): No heartbeat from core client for 30 sec - exiting 16:40:08 (5755): No heartbeat from core client for 30 sec - exiting 16:40:09 (5755): No heartbeat from core client for 30 sec - exiting 16:40:10 (5755): No heartbeat from core client for 30 sec - exiting 16:40:11 (5755): No heartbeat from core client for 30 sec - exiting 16:40:12 (5755): No heartbeat from core client for 30 sec - exiting 16:40:13 (5755): No heartbeat from core client for 30 sec - exiting 16:40:14 (5755): No heartbeat from core client for 30 sec - exiting 16:40:15 (5755): No heartbeat from core client for 30 sec - exiting 16:40:16 (5755): No heartbeat from core client for 30 sec - exiting 16:40:17 (5755): No heartbeat from core client for 30 sec - exiting 16:40:18 (5755): No heartbeat from core client for 30 sec - exiting 16:40:19 (5755): No heartbeat from core client for 30 sec - exiting 16:40:20 (5755): No heartbeat from core client for 30 sec - exiting 16:40:21 (5755): No heartbeat from core client for 30 sec - exiting 16:40:22 (5755): No heartbeat from core client for 30 sec - exiting 16:40:23 (5755): No heartbeat from core client for 30 sec - exiting 16:40:24 (5755): No heartbeat from core client for 30 sec - exiting 16:40:25 (5755): No heartbeat from core client for 30 sec - exiting 16:40:26 (5755): No heartbeat from core client for 30 sec - exiting 16:40:27 (5755): No heartbeat from core client for 30 sec - exiting 16:40:28 (5755): No heartbeat from core client for 30 sec - exiting 16:40:29 (5755): No heartbeat from core client for 30 sec - exiting 16:40:30 (5755): No heartbeat from core client for 30 sec - exiting 16:40:31 (5755): No heartbeat from core client for 30 sec - exiting 16:40:32 (5755): No heartbeat from core client for 30 sec - exiting 16:40:33 (5755): No heartbeat from core client for 30 sec - exiting 16:40:34 (5755): No heartbeat from core client for 30 sec - exiting Signal 15 received, exiting... Called boinc_finish * Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x09d62618 * SIGABRT: abort called hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2372: sysmalloc: Assertion `(old_top == (((mbinptr) (((char ) &((av)->bins[((1) - 1) 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) \|\| ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 (sizeof(size_t))) - 1)) & ~((2 (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed. SIGABRT: abort called Signal 15 received, exiting... Called boinc_finish * Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x08efe618 * SIGABRT: abort called hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2372: sysmalloc: Assertion `(old_top == (((mbinptr) (((char ) &((av)->bins[((1) - 1) 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) \|\| ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 (sizeof(size_t))) - 1)) & ~((2 (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed. SIGABRT: abort called </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
05 Dec 2014 22:47:30	1337234	17381927	hadcm3n_x0ab_1940_40_009147638_1	259,200	318,740	1.2297
04 Dec 2014 20:24:29	1337234	17381927	hadcm3n_x0ab_1940_40_009147638_1	233,280	285,936	1.2257
04 Dec 2014 00:27:45	1337234	17381927	hadcm3n_x0ab_1940_40_009147638_1	207,360	255,070	1.2301
03 Dec 2014 04:58:03	1337234	17381927	hadcm3n_x0ab_1940_40_009147638_1	181,440	224,898	1.2395
02 Dec 2014 15:51:59	1337234	17381927	hadcm3n_x0ab_1940_40_009147638_1	155,520	194,270	1.2492
01 Dec 2014 20:07:32	1337234	17381927	hadcm3n_x0ab_1940_40_009147638_1	129,600	163,412	1.2609
29 Nov 2014 09:56:20	1337234	17381927	hadcm3n_x0ab_1940_40_009147638_1	103,680	132,465	1.2776
24 Nov 2014 06:55:36	1337234	17381927	hadcm3n_x0ab_1940_40_009147638_1	77,760	101,056	1.2996
23 Nov 2014 13:22:17	1337234	17381927	hadcm3n_x0ab_1940_40_009147638_1	51,840	67,809	1.3080
22 Nov 2014 16:34:38	1337234	17381927	hadcm3n_x0ab_1940_40_009147638_1	25,920	34,511	1.3314