climateprediction.net home page
Task 19418348

Task 19418348

Name hadcm3n_xdft_198012_480_374_010412802_0
Workunit 10412802
Created 21 Mar 2016, 15:17:50 UTC
Sent 21 Mar 2016, 20:27:29 UTC
Report deadline 4 Mar 2017, 1:47:29 UTC
Received 13 May 2016, 7:12:18 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1378201
Run time 7 days 14 hours 59 min 41 sec
CPU time 6 days 17 hours 33 min 50 sec
Validate state Invalid
Credit 7,776.00
Device peak FLOPS 3.42 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-apple-darwin
Stderr
<core_client_version>7.6.22</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
m for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(4837,0xa35fc000) malloc: *** error for object 0x281ac00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(4837,0xa35fc000) malloc: *** error for object 0x815e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(4837,0xa35fc000) malloc: *** error for object 0x815e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(4837,0xa35fc000) malloc: *** error for object 0x811e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(4837,0xa35fc000) malloc: *** error for object 0x811e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(4837,0xa35fc000) malloc: *** error for object 0x811e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(4837,0xa35fc000) malloc: *** error for object 0x811e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(4837,0xa35fc000) malloc: *** error for object 0x811e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
08:16:44 (4837): No heartbeat from core client for 30 sec - exiting
08:16:45 (4837): No heartbeat from core client for 30 sec - exiting
08:16:46 (4837): No heartbeat from core client for 30 sec - exiting
08:16:47 (4837): No heartbeat from core client for 30 sec - exiting
08:16:48 (4837): No heartbeat from core client for 30 sec - exiting
08:16:49 (4837): No heartbeat from core client for 30 sec - exiting
08:16:50 (4837): No heartbeat from core client for 30 sec - exiting
08:16:51 (4837): No heartbeat from core client for 30 sec - exiting
08:16:52 (4837): No heartbeat from core client for 30 sec - exiting
08:16:53 (4837): No heartbeat from core client for 30 sec - exiting
08:16:54 (4837): No heartbeat from core client for 30 sec - exiting
08:16:55 (4837): No heartbeat from core client for 30 sec - exiting
08:16:56 (4837): No heartbeat from core client for 30 sec - exiting
08:16:57 (4837): No heartbeat from core client for 30 sec - exiting
08:16:58 (4837): No heartbeat from core client for 30 sec - exiting
08:16:59 (4837): No heartbeat from core client for 30 sec - exiting
08:17:00 (4837): No heartbeat from core client for 30 sec - exiting
08:17:01 (4837): No heartbeat from core client for 30 sec - exiting
08:17:02 (4837): No heartbeat from core client for 30 sec - exiting
08:17:03 (4837): No heartbeat from core client for 30 sec - exiting
08:17:04 (4837): No heartbeat from core client for 30 sec - exiting
08:17:06 (4837): No heartbeat from core client for 30 sec - exiting
08:17:07 (4837): No heartbeat from core client for 30 sec - exiting
08:17:08 (4837): No heartbeat from core client for 30 sec - exiting
08:17:09 (4837): No heartbeat from core client for 30 sec - exiting
08:17:10 (4837): No heartbeat from core client for 30 sec - exiting
08:17:11 (4837): No heartbeat from core client for 30 sec - exiting
08:17:12 (4837): No heartbeat from core client for 30 sec - exiting
08:17:13 (4837): No heartbeat from core client for 30 sec - exiting
hadcm3n_6.07_i686-apple-darwin(5132,0xa35fc000) malloc: *** error for object 0x1811c04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(5132,0xa35fc000) malloc: *** error for object 0x1811c00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(5132,0xa35fc000) malloc: *** error for object 0x1811c04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(5132,0xa35fc000) malloc: *** error for object 0x1811c00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(5132,0xa35fc000) malloc: *** error for object 0x1811c04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(5132,0xa35fc000) malloc: *** error for object 0x1811c00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(5132,0xa35fc000) malloc: *** error for object 0x1811c04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(5132,0xa35fc000) malloc: *** error for object 0x1811c00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(5132,0xa35fc000) malloc: *** error for object 0x1811c00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
10:27:11 (5132): No heartbeat from core client for 30 sec - exiting
10:27:12 (5132): No heartbeat from core client for 30 sec - exiting
10:27:13 (5132): No heartbeat from core client for 30 sec - exiting
10:27:14 (5132): No heartbeat from core client for 30 sec - exiting
10:27:15 (5132): No heartbeat from core client for 30 sec - exiting
10:27:16 (5132): No heartbeat from core client for 30 sec - exiting
10:27:17 (5132): No heartbeat from core client for 30 sec - exiting
10:27:18 (5132): No heartbeat from core client for 30 sec - exiting
10:27:19 (5132): No heartbeat from core client for 30 sec - exiting
10:27:20 (5132): No heartbeat from core client for 30 sec - exiting
10:27:21 (5132): No heartbeat from core client for 30 sec - exiting
10:27:22 (5132): No heartbeat from core client for 30 sec - exiting
10:27:23 (5132): No heartbeat from core client for 30 sec - exiting
10:27:24 (5132): No heartbeat from core client for 30 sec - exiting
10:27:25 (5132): No heartbeat from core client for 30 sec - exiting
10:27:26 (5132): No heartbeat from core client for 30 sec - exiting
10:27:27 (5132): No heartbeat from core client for 30 sec - exiting
10:27:28 (5132): No heartbeat from core client for 30 sec - exiting
10:27:29 (5132): No heartbeat from core client for 30 sec - exiting
10:27:30 (5132): No heartbeat from core client for 30 sec - exiting
10:27:31 (5132): No heartbeat from core client for 30 sec - exiting
10:27:32 (5132): No heartbeat from core client for 30 sec - exiting
10:27:33 (5132): No heartbeat from core client for 30 sec - exiting
10:27:34 (5132): No heartbeat from core client for 30 sec - exiting
10:27:35 (5132): No heartbeat from core client for 30 sec - exiting
10:27:36 (5132): No heartbeat from core client for 30 sec - exiting
10:27:37 (5132): No heartbeat from core client for 30 sec - exiting
10:27:38 (5132): No heartbeat from core client for 30 sec - exiting
10:27:39 (5132): No heartbeat from core client for 30 sec - exiting
hadcm3n_6.07_i686-apple-darwin(12523,0xa35fc000) malloc: *** error for object 0x1825c04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(12523,0xa35fc000) malloc: *** error for object 0x1825c00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(12523,0xa35fc000) malloc: *** error for object 0x1825c04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(12523,0xa35fc000) malloc: *** error for object 0x1825c00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(12523,0xa35fc000) malloc: *** error for object 0x1825c04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(12523,0xa35fc000) malloc: *** error for object 0x1825c00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(12523,0xa35fc000) malloc: *** error for object 0x1825c04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(12523,0xa35fc000) malloc: *** error for object 0x1825c00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(12523,0xa35fc000) malloc: *** error for object 0x1825c00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
hadcm3n_6.07_i686-apple-darwin(2182,0xa35fc000) malloc: *** error for object 0x2005c04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(2182,0xa35fc000) malloc: *** error for object 0x2005c00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(2182,0xa35fc000) malloc: *** error for object 0x2005c04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(2182,0xa35fc000) malloc: *** error for object 0x2005c00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(2182,0xa35fc000) malloc: *** error for object 0x2005c04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(2182,0xa35fc000) malloc: *** error for object 0x2005c00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(2182,0xa35fc000) malloc: *** error for object 0x2005c04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(2182,0xa35fc000) malloc: *** error for object 0x2005c00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(2182,0xa35fc000) malloc: *** error for object 0x2005c00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
hadcm3n_6.07_i686-apple-darwin(7214,0xa35fc000) malloc: *** error for object 0x1000e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(7214,0xa35fc000) malloc: *** error for object 0x1000e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(7214,0xa35fc000) malloc: *** error for object 0x2815e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(7214,0xa35fc000) malloc: *** error for object 0x2815e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(7214,0xa35fc000) malloc: *** error for object 0x2815e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(7214,0xa35fc000) malloc: *** error for object 0x2815e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(7214,0xa35fc000) malloc: *** error for object 0x2815e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
20:42:56 (7214): No heartbeat from core client for 30 sec - exiting
20:42:57 (7214): No heartbeat from core client for 30 sec - exiting
20:42:58 (7214): No heartbeat from core client for 30 sec - exiting
20:42:59 (7214): No heartbeat from core client for 30 sec - exiting
20:43:00 (7214): No heartbeat from core client for 30 sec - exiting
20:43:01 (7214): No heartbeat from core client for 30 sec - exiting
20:43:02 (7214): No heartbeat from core client for 30 sec - exiting
20:43:03 (7214): No heartbeat from core client for 30 sec - exiting
20:43:04 (7214): No heartbeat from core client for 30 sec - exiting
20:43:05 (7214): No heartbeat from core client for 30 sec - exiting
20:43:06 (7214): No heartbeat from core client for 30 sec - exiting
20:43:07 (7214): No heartbeat from core client for 30 sec - exiting
20:43:08 (7214): No heartbeat from core client for 30 sec - exiting
20:43:09 (7214): No heartbeat from core client for 30 sec - exiting
20:43:10 (7214): No heartbeat from core client for 30 sec - exiting
20:43:11 (7214): No heartbeat from core client for 30 sec - exiting
20:43:12 (7214): No heartbeat from core client for 30 sec - exiting
20:43:14 (7214): No heartbeat from core client for 30 sec - exiting
20:43:15 (7214): No heartbeat from core client for 30 sec - exiting
20:43:16 (7214): No heartbeat from core client for 30 sec - exiting
20:43:17 (7214): No heartbeat from core client for 30 sec - exiting
20:43:18 (7214): No heartbeat from core client for 30 sec - exiting
20:43:19 (7214): No heartbeat from core client for 30 sec - exiting
20:43:20 (7214): No heartbeat from core client for 30 sec - exiting
20:43:21 (7214): No heartbeat from core client for 30 sec - exiting
20:43:22 (7214): No heartbeat from core client for 30 sec - exiting
20:43:23 (7214): No heartbeat from core client for 30 sec - exiting
20:43:24 (7214): No heartbeat from core client for 30 sec - exiting
20:43:25 (7214): No heartbeat from core client for 30 sec - exiting
hadcm3n_6.07_i686-apple-darwin(1854,0xa35fc000) malloc: *** error for object 0x1011c04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(1854,0xa35fc000) malloc: *** error for object 0x1011c00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(1854,0xa35fc000) malloc: *** error for object 0x280a004: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(1854,0xa35fc000) malloc: *** error for object 0x280a000: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(1854,0xa35fc000) malloc: *** error for object 0x280a004: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(1854,0xa35fc000) malloc: *** error for object 0x280a000: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(1854,0xa35fc000) malloc: *** error for object 0x280a004: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(1854,0xa35fc000) malloc: *** error for object 0x280a000: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(1854,0xa35fc000) malloc: *** error for object 0x280a000: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
hadcm3n_6.07_i686-apple-darwin(10943,0xa3ead000) malloc: *** error for object 0x81de04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(10943,0xa3ead000) malloc: *** error for object 0x81de00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(10943,0xa3ead000) malloc: *** error for object 0x81de04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(10943,0xa3ead000) malloc: *** error for object 0x81de00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(10943,0xa3ead000) malloc: *** error for object 0x81de04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(10943,0xa3ead000) malloc: *** error for object 0x81de00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(10943,0xa3ead000) malloc: *** error for object 0x81de00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
hadcm3n_6.07_i686-apple-darwin(10943,0xa3ead000) malloc: *** error for object 0x2004e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(10943,0xa3ead000) malloc: *** error for object 0x2004e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug

Crashed executable name: hadcm3n_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.11.4 build 15E65
Wed Apr 27 12:21:34 2016

15:05:00 (10943): No heartbeat from core client for 30 sec - exiting
15:05:01 (10943): No heartbeat from core client for 30 sec - exiting
15:05:02 (10943): No heartbeat from core client for 30 sec - exiting
15:05:03 (10943): No heartbeat from core client for 30 sec - exiting
15:05:04 (10943): No heartbeat from core client for 30 sec - exiting
15:05:05 (10943): No heartbeat from core client for 30 sec - exiting
15:05:06 (10943): No heartbeat from core client for 30 sec - exiting
15:05:07 (10943): No heartbeat from core client for 30 sec - exiting
15:05:08 (10943): No heartbeat from core client for 30 sec - exiting
15:05:09 (10943): No heartbeat from core client for 30 sec - exiting
15:05:10 (10943): No heartbeat from core client for 30 sec - exiting
15:05:11 (10943): No heartbeat from core client for 30 sec - exiting
15:05:12 (10943): No heartbeat from core client for 30 sec - exiting
15:05:13 (10943): No heartbeat from core client for 30 sec - exiting
15:05:14 (10943): No heartbeat from core client for 30 sec - exiting
15:05:15 (10943): No heartbeat from core client for 30 sec - exiting
15:05:16 (10943): No heartbeat from core client for 30 sec - exiting
15:05:17 (10943): No heartbeat from core client for 30 sec - exiting
15:05:18 (10943): No heartbeat from core client for 30 sec - exiting
15:05:20 (10943): No heartbeat from core client for 30 sec - exiting
15:05:21 (10943): No heartbeat from core client for 30 sec - exiting
15:05:22 (10943): No heartbeat from core client for 30 sec - exiting
15:05:23 (10943): No heartbeat from core client for 30 sec - exiting
15:05:24 (10943): No heartbeat from core client for 30 sec - exiting
15:05:25 (10943): No heartbeat from core client for 30 sec - exiting
15:05:26 (10943): No heartbeat from core client for 30 sec - exiting
15:05:27 (10943): No heartbeat from core client for 30 sec - exiting
15:05:28 (10943): No heartbeat from core client for 30 sec - exiting
15:05:29 (10943): No heartbeat from core client for 30 sec - exiting
hadcm3n_6.07_i686-apple-darwin(6186,0xa3ead000) malloc: *** error for object 0x1806c04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(6186,0xa3ead000) malloc: *** error for object 0x1806c00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(6186,0xa3ead000) malloc: *** error for object 0x1800e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(6186,0xa3ead000) malloc: *** error for object 0x1800e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(6186,0xa3ead000) malloc: *** error for object 0x1800e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(6186,0xa3ead000) malloc: *** error for object 0x1800e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(6186,0xa3ead000) malloc: *** error for object 0x1800e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(6186,0xa3ead000) malloc: *** error for object 0x1800e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(6186,0xa3ead000) malloc: *** error for object 0x1800e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
09:58:45 (6186): No heartbeat from core client for 30 sec - exiting
09:58:46 (6186): No heartbeat from core client for 30 sec - exiting
09:58:47 (6186): No heartbeat from core client for 30 sec - exiting
09:58:48 (6186): No heartbeat from core client for 30 sec - exiting
09:58:49 (6186): No heartbeat from core client for 30 sec - exiting
09:58:50 (6186): No heartbeat from core client for 30 sec - exiting
09:58:51 (6186): No heartbeat from core client for 30 sec - exiting
09:58:52 (6186): No heartbeat from core client for 30 sec - exiting
09:58:54 (6186): No heartbeat from core client for 30 sec - exiting
09:58:55 (6186): No heartbeat from core client for 30 sec - exiting
09:58:56 (6186): No heartbeat from core client for 30 sec - exiting
09:58:57 (6186): No heartbeat from core client for 30 sec - exiting
09:58:58 (6186): No heartbeat from core client for 30 sec - exiting
09:58:59 (6186): No heartbeat from core client for 30 sec - exiting
09:59:00 (6186): No heartbeat from core client for 30 sec - exiting
09:59:01 (6186): No heartbeat from core client for 30 sec - exiting
09:59:02 (6186): No heartbeat from core client for 30 sec - exiting
09:59:03 (6186): No heartbeat from core client for 30 sec - exiting
09:59:04 (6186): No heartbeat from core client for 30 sec - exiting
09:59:05 (6186): No heartbeat from core client for 30 sec - exiting
09:59:06 (6186): No heartbeat from core client for 30 sec - exiting
09:59:07 (6186): No heartbeat from core client for 30 sec - exiting
09:59:08 (6186): No heartbeat from core client for 30 sec - exiting
09:59:09 (6186): No heartbeat from core client for 30 sec - exiting
09:59:10 (6186): No heartbeat from core client for 30 sec - exiting
09:59:11 (6186): No heartbeat from core client for 30 sec - exiting
09:59:12 (6186): No heartbeat from core client for 30 sec - exiting
09:59:13 (6186): No heartbeat from core client for 30 sec - exiting
09:59:14 (6186): No heartbeat from core client for 30 sec - exiting
09:59:15 (6186): No heartbeat from core client for 30 sec - exiting
09:59:16 (6186): No heartbeat from core client for 30 sec - exiting
hadcm3n_6.07_i686-apple-darwin(8798,0xa3ead000) malloc: *** error for object 0x200e004: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(8798,0xa3ead000) malloc: *** error for object 0x200e000: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(8798,0xa3ead000) malloc: *** error for object 0x200e004: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(8798,0xa3ead000) malloc: *** error for object 0x200e000: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(8798,0xa3ead000) malloc: *** error for object 0x200e004: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(8798,0xa3ead000) malloc: *** error for object 0x200e000: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(8798,0xa3ead000) malloc: *** error for object 0x200e004: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(8798,0xa3ead000) malloc: *** error for object 0x200e000: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(8798,0xa3ead000) malloc: *** error for object 0x200e000: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
10:24:15 (8798): No heartbeat from core client for 30 sec - exiting
10:24:16 (8798): No heartbeat from core client for 30 sec - exiting
10:24:17 (8798): No heartbeat from core client for 30 sec - exiting
10:24:18 (8798): No heartbeat from core client for 30 sec - exiting
10:24:19 (8798): No heartbeat from core client for 30 sec - exiting
10:24:20 (8798): No heartbeat from core client for 30 sec - exiting
10:24:21 (8798): No heartbeat from core client for 30 sec - exiting
10:24:22 (8798): No heartbeat from core client for 30 sec - exiting
10:24:23 (8798): No heartbeat from core client for 30 sec - exiting
10:24:24 (8798): No heartbeat from core client for 30 sec - exiting
10:24:25 (8798): No heartbeat from core client for 30 sec - exiting
10:24:26 (8798): No heartbeat from core client for 30 sec - exiting
10:24:27 (8798): No heartbeat from core client for 30 sec - exiting
10:24:28 (8798): No heartbeat from core client for 30 sec - exiting
10:24:29 (8798): No heartbeat from core client for 30 sec - exiting
10:24:30 (8798): No heartbeat from core client for 30 sec - exiting
10:24:31 (8798): No heartbeat from core client for 30 sec - exiting
10:24:32 (8798): No heartbeat from core client for 30 sec - exiting
10:24:33 (8798): No heartbeat from core client for 30 sec - exiting
10:24:34 (8798): No heartbeat from core client for 30 sec - exiting
10:24:35 (8798): No heartbeat from core client for 30 sec - exiting
10:24:36 (8798): No heartbeat from core client for 30 sec - exiting
10:24:37 (8798): No heartbeat from core client for 30 sec - exiting
10:24:38 (8798): No heartbeat from core client for 30 sec - exiting
10:24:39 (8798): No heartbeat from core client for 30 sec - exiting
10:24:40 (8798): No heartbeat from core client for 30 sec - exiting
10:24:41 (8798): No heartbeat from core client for 30 sec - exiting
10:24:42 (8798): No heartbeat from core client for 30 sec - exiting
10:24:43 (8798): No heartbeat from core client for 30 sec - exiting
10:24:44 (8798): No heartbeat from core client for 30 sec - exiting
hadcm3n_6.07_i686-apple-darwin(4674,0xa3ead000) malloc: *** error for object 0x2801c04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(4674,0xa3ead000) malloc: *** error for object 0x2801c00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(4674,0xa3ead000) malloc: *** error for object 0x2801c04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(4674,0xa3ead000) malloc: *** error for object 0x2801c00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(4674,0xa3ead000) malloc: *** error for object 0x2801c04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(4674,0xa3ead000) malloc: *** error for object 0x2801c00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(4674,0xa3ead000) malloc: *** error for object 0x2801c00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
19:12:35 (4674): No heartbeat from core client for 30 sec - exiting
19:12:36 (4674): No heartbeat from core client for 30 sec - exiting
19:12:37 (4674): No heartbeat from core client for 30 sec - exiting
19:12:38 (4674): No heartbeat from core client for 30 sec - exiting
19:12:39 (4674): No heartbeat from core client for 30 sec - exiting
19:12:40 (4674): No heartbeat from core client for 30 sec - exiting
19:12:41 (4674): No heartbeat from core client for 30 sec - exiting
19:12:42 (4674): No heartbeat from core client for 30 sec - exiting
19:12:43 (4674): No heartbeat from core client for 30 sec - exiting
19:12:44 (4674): No heartbeat from core client for 30 sec - exiting
19:12:45 (4674): No heartbeat from core client for 30 sec - exiting
19:12:46 (4674): No heartbeat from core client for 30 sec - exiting
19:12:47 (4674): No heartbeat from core client for 30 sec - exiting
19:12:48 (4674): No heartbeat from core client for 30 sec - exiting
19:12:49 (4674): No heartbeat from core client for 30 sec - exiting
19:12:50 (4674): No heartbeat from core client for 30 sec - exiting
19:12:51 (4674): No heartbeat from core client for 30 sec - exiting
19:12:53 (4674): No heartbeat from core client for 30 sec - exiting
19:12:54 (4674): No heartbeat from core client for 30 sec - exiting
19:12:55 (4674): No heartbeat from core client for 30 sec - exiting
19:12:56 (4674): No heartbeat from core client for 30 sec - exiting
19:12:57 (4674): No heartbeat from core client for 30 sec - exiting
19:12:58 (4674): No heartbeat from core client for 30 sec - exiting
19:12:59 (4674): No heartbeat from core client for 30 sec - exiting
19:13:00 (4674): No heartbeat from core client for 30 sec - exiting
19:13:01 (4674): No heartbeat from core client for 30 sec - exiting
19:13:02 (4674): No heartbeat from core client for 30 sec - exiting
19:13:03 (4674): No heartbeat from core client for 30 sec - exiting
19:13:04 (4674): No heartbeat from core client for 30 sec - exiting
hadcm3n_6.07_i686-apple-darwin(792,0xa3ead000) malloc: *** error for object 0x1832004: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(792,0xa3ead000) malloc: *** error for object 0x1832000: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(792,0xa3ead000) malloc: *** error for object 0x801c04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(792,0xa3ead000) malloc: *** error for object 0x801c00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(792,0xa3ead000) malloc: *** error for object 0x801c04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(792,0xa3ead000) malloc: *** error for object 0x801c00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(792,0xa3ead000) malloc: *** error for object 0x801c00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
21:00:59 (792): No heartbeat from core client for 30 sec - exiting
21:01:00 (792): No heartbeat from core client for 30 sec - exiting
21:01:01 (792): No heartbeat from core client for 30 sec - exiting
21:01:02 (792): No heartbeat from core client for 30 sec - exiting
21:01:03 (792): No heartbeat from core client for 30 sec - exiting
21:01:04 (792): No heartbeat from core client for 30 sec - exiting
21:01:05 (792): No heartbeat from core client for 30 sec - exiting
21:01:06 (792): No heartbeat from core client for 30 sec - exiting
21:01:07 (792): No heartbeat from core client for 30 sec - exiting
21:01:08 (792): No heartbeat from core client for 30 sec - exiting
21:01:09 (792): No heartbeat from core client for 30 sec - exiting
21:01:10 (792): No heartbeat from core client for 30 sec - exiting
21:01:11 (792): No heartbeat from core client for 30 sec - exiting
21:01:12 (792): No heartbeat from core client for 30 sec - exiting
21:01:13 (792): No heartbeat from core client for 30 sec - exiting
21:01:14 (792): No heartbeat from core client for 30 sec - exiting
21:01:15 (792): No heartbeat from core client for 30 sec - exiting
21:01:16 (792): No heartbeat from core client for 30 sec - exiting
21:01:17 (792): No heartbeat from core client for 30 sec - exiting
21:01:18 (792): No heartbeat from core client for 30 sec - exiting
21:01:19 (792): No heartbeat from core client for 30 sec - exiting
21:01:20 (792): No heartbeat from core client for 30 sec - exiting
21:01:21 (792): No heartbeat from core client for 30 sec - exiting
21:01:22 (792): No heartbeat from core client for 30 sec - exiting
21:01:23 (792): No heartbeat from core client for 30 sec - exiting
21:01:24 (792): No heartbeat from core client for 30 sec - exiting
21:01:25 (792): No heartbeat from core client for 30 sec - exiting
21:01:26 (792): No heartbeat from core client for 30 sec - exiting
21:01:27 (792): No heartbeat from core client for 30 sec - exiting
hadcm3n_6.07_i686-apple-darwin(1170,0xa3ead000) malloc: *** error for object 0x200e604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(1170,0xa3ead000) malloc: *** error for object 0x200e600: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(1170,0xa3ead000) malloc: *** error for object 0x200e604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(1170,0xa3ead000) malloc: *** error for object 0x200e600: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(1170,0xa3ead000) malloc: *** error for object 0x200e604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(1170,0xa3ead000) malloc: *** error for object 0x200e600: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(1170,0xa3ead000) malloc: *** error for object 0x200e600: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
hadcm3n_6.07_i686-apple-darwin(1429,0xa3ead000) malloc: *** error for object 0x829c04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(1429,0xa3ead000) malloc: *** error for object 0x829c00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(1429,0xa3ead000) malloc: *** error for object 0x829c04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(1429,0xa3ead000) malloc: *** error for object 0x829c00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(1429,0xa3ead000) malloc: *** error for object 0x829c04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(1429,0xa3ead000) malloc: *** error for object 0x829c00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(1429,0xa3ead000) malloc: *** error for object 0x829c04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(1429,0xa3ead000) malloc: *** error for object 0x829c00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(1429,0xa3ead000) malloc: *** error for object 0x829c00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
hadcm3n_6.07_i686-apple-darwin(2152,0xa3ead000) malloc: *** error for object 0x202a004: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(2152,0xa3ead000) malloc: *** error for object 0x202a000: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(2152,0xa3ead000) malloc: *** error for object 0x202a004: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(2152,0xa3ead000) malloc: *** error for object 0x202a000: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(2152,0xa3ead000) malloc: *** error for object 0x202a004: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(2152,0xa3ead000) malloc: *** error for object 0x202a000: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(2152,0xa3ead000) malloc: *** error for object 0x202a004: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(2152,0xa3ead000) malloc: *** error for object 0x202a000: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(2152,0xa3ead000) malloc: *** error for object 0x202a000: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
hadcm3n_6.07_i686-apple-darwin(4644,0xa3ead000) malloc: *** error for object 0x82de04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(4644,0xa3ead000) malloc: *** error for object 0x82de00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(4644,0xa3ead000) malloc: *** error for object 0x82de04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(4644,0xa3ead000) malloc: *** error for object 0x82de00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(4644,0xa3ead000) malloc: *** error for object 0x82de04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(4644,0xa3ead000) malloc: *** error for object 0x82de00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(4644,0xa3ead000) malloc: *** error for object 0x82de04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(4644,0xa3ead000) malloc: *** error for object 0x82de00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(4644,0xa3ead000) malloc: *** error for object 0x82de00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
08:14:50 (4644): No heartbeat from core client for 30 sec - exiting
08:14:51 (4644): No heartbeat from core client for 30 sec - exiting
08:14:52 (4644): No heartbeat from core client for 30 sec - exiting
08:14:53 (4644): No heartbeat from core client for 30 sec - exiting
08:14:54 (4644): No heartbeat from core client for 30 sec - exiting
08:14:55 (4644): No heartbeat from core client for 30 sec - exiting
08:14:56 (4644): No heartbeat from core client for 30 sec - exiting
08:14:57 (4644): No heartbeat from core client for 30 sec - exiting
08:14:58 (4644): No heartbeat from core client for 30 sec - exiting
08:14:59 (4644): No heartbeat from core client for 30 sec - exiting
08:15:00 (4644): No heartbeat from core client for 30 sec - exiting
08:15:01 (4644): No heartbeat from core client for 30 sec - exiting
08:15:02 (4644): No heartbeat from core client for 30 sec - exiting
08:15:03 (4644): No heartbeat from core client for 30 sec - exiting
08:15:04 (4644): No heartbeat from core client for 30 sec - exiting
08:15:05 (4644): No heartbeat from core client for 30 sec - exiting
08:15:06 (4644): No heartbeat from core client for 30 sec - exiting
08:15:07 (4644): No heartbeat from core client for 30 sec - exiting
08:15:08 (4644): No heartbeat from core client for 30 sec - exiting
08:15:09 (4644): No heartbeat from core client for 30 sec - exiting
08:15:10 (4644): No heartbeat from core client for 30 sec - exiting
08:15:11 (4644): No heartbeat from core client for 30 sec - exiting
08:15:12 (4644): No heartbeat from core client for 30 sec - exiting
08:15:13 (4644): No heartbeat from core client for 30 sec - exiting
08:15:14 (4644): No heartbeat from core client for 30 sec - exiting
08:15:15 (4644): No heartbeat from core client for 30 sec - exiting
08:15:16 (4644): No heartbeat from core client for 30 sec - exiting
08:15:17 (4644): No heartbeat from core client for 30 sec - exiting
08:15:18 (4644): No heartbeat from core client for 30 sec - exiting
08:15:19 (4644): No heartbeat from core client for 30 sec - exiting
08:15:20 (4644): No heartbeat from core client for 30 sec - exiting
08:15:22 (4644): No heartbeat from core client for 30 sec - exiting
08:15:23 (4644): No heartbeat from core client for 30 sec - exiting
08:15:24 (4644): No heartbeat from core client for 30 sec - exiting
08:15:25 (4644): No heartbeat from core client for 30 sec - exiting
08:15:26 (4644): No heartbeat from core client for 30 sec - exiting
08:15:27 (4644): No heartbeat from core client for 30 sec - exiting
hadcm3n_6.07_i686-apple-darwin(9724,0xa3ead000) malloc: *** error for object 0x1012c04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(9724,0xa3ead000) malloc: *** error for object 0x1012c00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(9724,0xa3ead000) malloc: *** error for object 0x1000e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(9724,0xa3ead000) malloc: *** error for object 0x1000e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(9724,0xa3ead000) malloc: *** error for object 0x1000e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(9724,0xa3ead000) malloc: *** error for object 0x1000e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(9724,0xa3ead000) malloc: *** error for object 0x1000e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(9724,0xa3ead000) malloc: *** error for object 0x1000e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(9724,0xa3ead000) malloc: *** error for object 0x2801c00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 63 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 65 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 1 received, exiting...
Called boinc_finish
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 1 received, exiting...
Called boinc_finish
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 1 received, exiting...
Called boinc_finish
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 1 received, exiting...
Called boinc_finish
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 1 received, exiting...
Called boinc_finish
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 1 received, exiting...
Called boinc_finish
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
hadcm3n_6.07_i686-apple-darwin(17334,0xa3ead000) malloc: *** error for object 0x830604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(17334,0xa3ead000) malloc: *** error for object 0x183fc04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(17334,0xa3ead000) malloc: *** error for object 0x185b204: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(17334,0xa3ead000) malloc: *** error for object 0x185b200: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(17334,0xa3ead000) malloc: *** error for object 0x1042604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(17334,0xa3ead000) malloc: *** error for object 0x1042600: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(17334,0xa3ead000) malloc: *** error for object 0x830604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(17334,0xa3ead000) malloc: *** error for object 0x84bc04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(17334,0xa3ead000) malloc: *** error for object 0x84bc00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(17334,0xa3ead000) malloc: *** error for object 0x1027004: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(17334,0xa3ead000) malloc: *** error for object 0x1042604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(17334,0xa3ead000) malloc: *** error for object 0x1042600: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
13 May 2016 02:19:22 1378201 19418348 hadcm3n_xdft_198012_480_374_010412802_0 648,000 586,967 0.9058
12 May 2016 14:46:59 1378201 19418348 hadcm3n_xdft_198012_480_374_010412802_0 622,080 563,727 0.9062
11 May 2016 17:10:55 1378201 19418348 hadcm3n_xdft_198012_480_374_010412802_0 596,160 540,448 0.9065
11 May 2016 09:38:51 1378201 19418348 hadcm3n_xdft_198012_480_374_010412802_0 570,240 517,227 0.9070
10 May 2016 06:27:04 1378201 19418348 hadcm3n_xdft_198012_480_374_010412802_0 544,320 493,962 0.9075
06 May 2016 13:35:56 1378201 19418348 hadcm3n_xdft_198012_480_374_010412802_0 518,400 470,827 0.9082
05 May 2016 06:47:27 1378201 19418348 hadcm3n_xdft_198012_480_374_010412802_0 492,480 447,705 0.9091
04 May 2016 01:58:59 1378201 19418348 hadcm3n_xdft_198012_480_374_010412802_0 466,560 424,428 0.9097
03 May 2016 10:45:59 1378201 19418348 hadcm3n_xdft_198012_480_374_010412802_0 440,640 401,197 0.9105
02 May 2016 23:32:00 1378201 19418348 hadcm3n_xdft_198012_480_374_010412802_0 414,720 377,960 0.9114
01 May 2016 16:05:13 1378201 19418348 hadcm3n_xdft_198012_480_374_010412802_0 388,800 354,819 0.9126
01 May 2016 05:32:21 1378201 19418348 hadcm3n_xdft_198012_480_374_010412802_0 362,880 331,576 0.9137
30 Apr 2016 20:19:55 1378201 19418348 hadcm3n_xdft_198012_480_374_010412802_0 336,960 308,435 0.9153
30 Apr 2016 07:48:00 1378201 19418348 hadcm3n_xdft_198012_480_374_010412802_0 311,040 284,854 0.9158
29 Apr 2016 18:55:50 1378201 19418348 hadcm3n_xdft_198012_480_374_010412802_0 285,120 261,520 0.9172
30 Mar 2016 11:54:55 1378201 19418348 hadcm3n_xdft_198012_480_374_010412802_0 259,200 238,378 0.9197
28 Mar 2016 05:28:03 1378201 19418348 hadcm3n_xdft_198012_480_374_010412802_0 233,280 214,291 0.9186
26 Mar 2016 13:09:40 1378201 19418348 hadcm3n_xdft_198012_480_374_010412802_0 207,360 190,510 0.9187
26 Mar 2016 04:23:07 1378201 19418348 hadcm3n_xdft_198012_480_374_010412802_0 181,440 166,567 0.9180
25 Mar 2016 20:18:39 1378201 19418348 hadcm3n_xdft_198012_480_374_010412802_0 155,520 142,581 0.9168


©2024 cpdn.org