Task 19132982

Name	hadcm3n_sah0_198012_480_010221581_0
Workunit	10221581
Created	4 Dec 2015, 19:17:32 UTC
Sent	4 Dec 2015, 21:38:59 UTC
Report deadline	16 Nov 2016, 2:58:59 UTC
Received	17 Mar 2016, 16:24:28 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1331234
Run time	20 days 14 hours 44 min 59 sec
CPU time	18 days 14 hours 26 min 57 sec
Validate state	Invalid
Credit	12,441.60
Device peak FLOPS	3.63 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.6.22</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 16:45:49 (1235): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(30792,0xa2d8a000) malloc: * error for object 0x821e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(30792,0xa2d8a000) malloc: * error for object 0x821e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(30792,0xa2d8a000) malloc: * error for object 0x100a604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(30792,0xa2d8a000) malloc: * error for object 0x100a600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(30792,0xa2d8a000) malloc: * error for object 0x100a604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(30792,0xa2d8a000) malloc: * error for object 0x100a600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(30792,0xa2d8a000) malloc: * error for object 0x100a604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(30792,0xa2d8a000) malloc: * error for object 0x100a600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(30792,0xa2d8a000) malloc: * error for object 0x100a604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(30792,0xa2d8a000) malloc: * error for object 0x100a600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(30792,0xa2d8a000) malloc: * error for object 0x800e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(31933,0xa2d8a000) malloc: * error for object 0x800e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(32122,0xa2d8a000) malloc: * error for object 0x801c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(32122,0xa2d8a000) malloc: * error for object 0x801c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(32162,0xa2d8a000) malloc: * error for object 0x826804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(32162,0xa2d8a000) malloc: * error for object 0x826800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(32162,0xa2d8a000) malloc: * error for object 0x1012004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(32162,0xa2d8a000) malloc: * error for object 0x1012000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(32162,0xa2d8a000) malloc: * error for object 0x1012004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(32162,0xa2d8a000) malloc: * error for object 0x1012000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(32162,0xa2d8a000) malloc: * error for object 0x1012004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(32162,0xa2d8a000) malloc: * error for object 0x1012000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(32162,0xa2d8a000) malloc: * error for object 0x1012004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(32162,0xa2d8a000) malloc: * error for object 0x1012000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(32162,0xa2d8a000) malloc: * error for object 0x800e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(32299,0xa2d8a000) malloc: * error for object 0x825e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(32348,0xa2d8a000) malloc: * error for object 0x826800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(37376,0xa2d8a000) malloc: * error for object 0x82a800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(470,0xa2f20000) malloc: * error for object 0x1015e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(18338,0xa2f20000) malloc: * error for object 0x800e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(18338,0xa2f20000) malloc: * error for object 0x800e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(18338,0xa2f20000) malloc: * error for object 0x102a804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(18338,0xa2f20000) malloc: * error for object 0x102a800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(18338,0xa2f20000) malloc: * error for object 0x102a804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(18338,0xa2f20000) malloc: * error for object 0x102a800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(18338,0xa2f20000) malloc: * error for object 0x102a804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(18338,0xa2f20000) malloc: * error for object 0x102a800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(18338,0xa2f20000) malloc: * error for object 0x800e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(18338,0xa2f20000) malloc: * error for object 0x800e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(19446,0xa2f20000) malloc: * error for object 0x100dc00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(52605,0xa2f20000) malloc: * error for object 0x821e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(52605,0xa2f20000) malloc: * error for object 0x821e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(52605,0xa2f20000) malloc: * error for object 0x101e604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(52605,0xa2f20000) malloc: * error for object 0x101e600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(52605,0xa2f20000) malloc: * error for object 0x101e604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(52605,0xa2f20000) malloc: * error for object 0x101e600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(52605,0xa2f20000) malloc: * error for object 0x101e604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(52605,0xa2f20000) malloc: * error for object 0x101e600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(52605,0xa2f20000) malloc: * error for object 0x101e604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(52605,0xa2f20000) malloc: * error for object 0x101e600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(52605,0xa2f20000) malloc: * error for object 0x1000e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.11.3 build 15D21 hadcm3n_6.07_i686-apple-darwin(57119,0xa2f20000) malloc: * error for object 0x1015e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(57119,0xa2f20000) malloc: * error for object 0x1015e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(57119,0xa2f20000) malloc: * error for object 0x822604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(57119,0xa2f20000) malloc: * error for object 0x822600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(57119,0xa2f20000) malloc: * error for object 0x822604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(57119,0xa2f20000) malloc: * error for object 0x822600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(57119,0xa2f20000) malloc: * error for object 0x822604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(57119,0xa2f20000) malloc: * error for object 0x822600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(57119,0xa2f20000) malloc: * error for object 0x1015e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(57119,0xa2f20000) malloc: * error for object 0x1015e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(57119,0xa2f20000) malloc: * error for object 0x800e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(601,0xa363a000) malloc: * error for object 0x1021e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(601,0xa363a000) malloc: * error for object 0x1021e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(601,0xa363a000) malloc: * error for object 0x1021e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(601,0xa363a000) malloc: * error for object 0x1021e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(601,0xa363a000) malloc: * error for object 0x1021e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(601,0xa363a000) malloc: * error for object 0x1021e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(601,0xa363a000) malloc: * error for object 0x1021e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(601,0xa363a000) malloc: * error for object 0x1021e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(601,0xa363a000) malloc: * error for object 0x1021e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(601,0xa363a000) malloc: * error for object 0x1021e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(601,0xa363a000) malloc: * error for object 0x1000e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(4428,0xa363a000) malloc: * error for object 0x1015e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation 13:53:52 (4428): No heartbeat from core client for 30 sec - exiting 13:53:53 (4428): No heartbeat from core client for 30 sec - exiting 13:53:54 (4428): No heartbeat from core client for 30 sec - exiting 13:53:55 (4428): No heartbeat from core client for 30 sec - exiting 13:53:56 (4428): No heartbeat from core client for 30 sec - exiting 13:53:57 (4428): No heartbeat from core client for 30 sec - exiting 13:53:58 (4428): No heartbeat from core client for 30 sec - exiting 13:53:59 (4428): No heartbeat from core client for 30 sec - exiting 13:54:00 (4428): No heartbeat from core client for 30 sec - exiting 13:54:01 (4428): No heartbeat from core client for 30 sec - exiting 13:54:02 (4428): No heartbeat from core client for 30 sec - exiting 13:54:03 (4428): No heartbeat from core client for 30 sec - exiting 13:54:04 (4428): No heartbeat from core client for 30 sec - exiting 13:54:05 (4428): No heartbeat from core client for 30 sec - exiting 13:54:06 (4428): No heartbeat from core client for 30 sec - exiting 13:54:08 (4428): No heartbeat from core client for 30 sec - exiting 13:54:09 (4428): No heartbeat from core client for 30 sec - exiting 13:54:10 (4428): No heartbeat from core client for 30 sec - exiting 13:54:11 (4428): No heartbeat from core client for 30 sec - exiting 13:54:12 (4428): No heartbeat from core client for 30 sec - exiting 13:54:13 (4428): No heartbeat from core client for 30 sec - exiting 13:54:14 (4428): No heartbeat from core client for 30 sec - exiting 13:54:15 (4428): No heartbeat from core client for 30 sec - exiting 13:54:16 (4428): No heartbeat from core client for 30 sec - exiting 13:54:17 (4428): No heartbeat from core client for 30 sec - exiting 13:54:18 (4428): No heartbeat from core client for 30 sec - exiting 13:54:19 (4428): No heartbeat from core client for 30 sec - exiting 13:54:20 (4428): No heartbeat from core client for 30 sec - exiting 13:54:21 (4428): No heartbeat from core client for 30 sec - exiting 13:54:22 (4428): No heartbeat from core client for 30 sec - exiting hadcm3n_6.07_i686-apple-darwin(530,0xa363a000) malloc: * error for object 0x800e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(530,0xa363a000) malloc: * error for object 0x800e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(530,0xa363a000) malloc: * error for object 0x1000e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(530,0xa363a000) malloc: * error for object 0x1000e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(530,0xa363a000) malloc: * error for object 0x1000e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(530,0xa363a000) malloc: * error for object 0x1000e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(530,0xa363a000) malloc: * error for object 0x1000e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(530,0xa363a000) malloc: * error for object 0x1000e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(530,0xa363a000) malloc: * error for object 0x1000e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(530,0xa363a000) malloc: * error for object 0x1000e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(569,0xa363a000) malloc: * error for object 0x1000e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.11.3 build 15D21 Mon Feb 15 11:56:59 2016 Signal 15 received, exiting... Called boinc_finish hadcm3n_6.07_i686-apple-darwin(486,0xa363a000) malloc: * error for object 0x1801c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(486,0xa363a000) malloc: * error for object 0x1801c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(486,0xa363a000) malloc: * error for object 0x811e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(486,0xa363a000) malloc: * error for object 0x811e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(486,0xa363a000) malloc: * error for object 0x811e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(486,0xa363a000) malloc: * error for object 0x811e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(486,0xa363a000) malloc: * error for object 0x811e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(486,0xa363a000) malloc: * error for object 0x811e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(486,0xa363a000) malloc: * error for object 0x811e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(486,0xa363a000) malloc: * error for object 0x811e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(486,0xa363a000) malloc: * error for object 0x2800e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation 16:38:20 (486): No heartbeat from core client for 30 sec - exiting 16:38:21 (486): No heartbeat from core client for 30 sec - exiting 16:38:22 (486): No heartbeat from core client for 30 sec - exiting 16:38:23 (486): No heartbeat from core client for 30 sec - exiting 16:38:24 (486): No heartbeat from core client for 30 sec - exiting 16:38:25 (486): No heartbeat from core client for 30 sec - exiting 16:38:26 (486): No heartbeat from core client for 30 sec - exiting 16:38:27 (486): No heartbeat from core client for 30 sec - exiting 16:38:28 (486): No heartbeat from core client for 30 sec - exiting 16:38:29 (486): No heartbeat from core client for 30 sec - exiting 16:38:30 (486): No heartbeat from core client for 30 sec - exiting 16:38:31 (486): No heartbeat from core client for 30 sec - exiting 16:38:32 (486): No heartbeat from core client for 30 sec - exiting 16:38:33 (486): No heartbeat from core client for 30 sec - exiting 16:38:34 (486): No heartbeat from core client for 30 sec - exiting 16:38:35 (486): No heartbeat from core client for 30 sec - exiting 16:38:36 (486): No heartbeat from core client for 30 sec - exiting 16:38:38 (486): No heartbeat from core client for 30 sec - exiting 16:38:39 (486): No heartbeat from core client for 30 sec - exiting 16:38:40 (486): No heartbeat from core client for 30 sec - exiting 16:38:41 (486): No heartbeat from core client for 30 sec - exiting 16:38:42 (486): No heartbeat from core client for 30 sec - exiting 16:38:43 (486): No heartbeat from core client for 30 sec - exiting 16:38:44 (486): No heartbeat from core client for 30 sec - exiting 16:38:45 (486): No heartbeat from core client for 30 sec - exiting 16:38:46 (486): No heartbeat from core client for 30 sec - exiting 16:38:47 (486): No heartbeat from core client for 30 sec - exiting 16:38:48 (486): No heartbeat from core client for 30 sec - exiting 16:38:49 (486): No heartbeat from core client for 30 sec - exiting 16:38:50 (486): No heartbeat from core client for 30 sec - exiting hadcm3n_6.07_i686-apple-darwin(30550,0xa363a000) malloc: * error for object 0x805c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(58601,0xa363a000) malloc: * error for object 0x181e604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(58601,0xa363a000) malloc: * error for object 0x181e600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(58601,0xa363a000) malloc: * error for object 0x811e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(58601,0xa363a000) malloc: * error for object 0x811e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(58601,0xa363a000) malloc: * error for object 0x811e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(58601,0xa363a000) malloc: * error for object 0x811e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(58601,0xa363a000) malloc: * error for object 0x811e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(58601,0xa363a000) malloc: * error for object 0x811e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(58601,0xa363a000) malloc: * error for object 0x811e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(58601,0xa363a000) malloc: * error for object 0x811e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(58601,0xa363a000) malloc: * error for object 0x800e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(63062,0xa363a000) malloc: * error for object 0x1822800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(532,0xa363a000) malloc: * error for object 0x1015e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation 00:03:56 (532): No heartbeat from core client for 30 sec - exiting 00:03:57 (532): No heartbeat from core client for 30 sec - exiting 00:03:58 (532): No heartbeat from core client for 30 sec - exiting 00:03:59 (532): No heartbeat from core client for 30 sec - exiting 00:04:00 (532): No heartbeat from core client for 30 sec - exiting 00:04:01 (532): No heartbeat from core client for 30 sec - exiting 00:04:02 (532): No heartbeat from core client for 30 sec - exiting 00:04:03 (532): No heartbeat from core client for 30 sec - exiting 00:04:04 (532): No heartbeat from core client for 30 sec - exiting 00:04:05 (532): No heartbeat from core client for 30 sec - exiting 00:04:06 (532): No heartbeat from core client for 30 sec - exiting 00:04:07 (532): No heartbeat from core client for 30 sec - exiting 00:04:08 (532): No heartbeat from core client for 30 sec - exiting 00:04:09 (532): No heartbeat from core client for 30 sec - exiting 00:04:10 (532): No heartbeat from core client for 30 sec - exiting 00:04:11 (532): No heartbeat from core client for 30 sec - exiting 00:04:12 (532): No heartbeat from core client for 30 sec - exiting 00:04:13 (532): No heartbeat from core client for 30 sec - exiting 00:04:14 (532): No heartbeat from core client for 30 sec - exiting 00:04:15 (532): No heartbeat from core client for 30 sec - exiting 00:04:17 (532): No heartbeat from core client for 30 sec - exiting 00:04:18 (532): No heartbeat from core client for 30 sec - exiting 00:04:19 (532): No heartbeat from core client for 30 sec - exiting 00:04:20 (532): No heartbeat from core client for 30 sec - exiting 00:04:21 (532): No heartbeat from core client for 30 sec - exiting 00:04:22 (532): No heartbeat from core client for 30 sec - exiting 00:04:23 (532): No heartbeat from core client for 30 sec - exiting 00:04:24 (532): No heartbeat from core client for 30 sec - exiting 00:04:25 (532): No heartbeat from core client for 30 sec - exiting hadcm3n_6.07_i686-apple-darwin(14424,0xa363a000) malloc: * error for object 0x102a800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.11.3 build 15D21 hadcm3n_6.07_i686-apple-darwin(19638,0xa363a000) malloc: * error for object 0x101a604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(19638,0xa363a000) malloc: * error for object 0x101a600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(19638,0xa363a000) malloc: * error for object 0x101a604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(19638,0xa363a000) malloc: * error for object 0x101a600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(19638,0xa363a000) malloc: * error for object 0x101a604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(19638,0xa363a000) malloc: * error for object 0x101a600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(19638,0xa363a000) malloc: * error for object 0x101a604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(19638,0xa363a000) malloc: * error for object 0x101a600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(19638,0xa363a000) malloc: * error for object 0x101a604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(19638,0xa363a000) malloc: * error for object 0x101a600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(19638,0xa363a000) malloc: * error for object 0x800e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation 09:50:03 (19638): No heartbeat from core client for 30 sec - exiting 09:50:04 (19638): No heartbeat from core client for 30 sec - exiting 09:50:05 (19638): No heartbeat from core client for 30 sec - exiting 09:50:06 (19638): No heartbeat from core client for 30 sec - exiting 09:50:07 (19638): No heartbeat from core client for 30 sec - exiting 09:50:09 (19638): No heartbeat from core client for 30 sec - exiting 09:50:10 (19638): No heartbeat from core client for 30 sec - exiting 09:50:11 (19638): No heartbeat from core client for 30 sec - exiting 09:50:12 (19638): No heartbeat from core client for 30 sec - exiting 09:50:13 (19638): No heartbeat from core client for 30 sec - exiting 09:50:14 (19638): No heartbeat from core client for 30 sec - exiting 09:50:15 (19638): No heartbeat from core client for 30 sec - exiting 09:50:16 (19638): No heartbeat from core client for 30 sec - exiting 09:50:17 (19638): No heartbeat from core client for 30 sec - exiting 09:50:18 (19638): No heartbeat from core client for 30 sec - exiting 09:50:19 (19638): No heartbeat from core client for 30 sec - exiting 09:50:20 (19638): No heartbeat from core client for 30 sec - exiting 09:50:21 (19638): No heartbeat from core client for 30 sec - exiting 09:50:22 (19638): No heartbeat from core client for 30 sec - exiting 09:50:23 (19638): No heartbeat from core client for 30 sec - exiting 09:50:24 (19638): No heartbeat from core client for 30 sec - exiting 09:50:25 (19638): No heartbeat from core client for 30 sec - exiting 09:50:26 (19638): No heartbeat from core client for 30 sec - exiting 09:50:27 (19638): No heartbeat from core client for 30 sec - exiting 09:50:28 (19638): No heartbeat from core client for 30 sec - exiting 09:50:29 (19638): No heartbeat from core client for 30 sec - exiting 09:50:30 (19638): No heartbeat from core client for 30 sec - exiting 09:50:31 (19638): No heartbeat from core client for 30 sec - exiting 09:50:32 (19638): No heartbeat from core client for 30 sec - exiting 09:50:33 (19638): No heartbeat from core client for 30 sec - exiting hadcm3n_6.07_i686-apple-darwin(34474,0xa363a000) malloc: * error for object 0x835e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(34474,0xa363a000) malloc: * error for object 0x835e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(34474,0xa363a000) malloc: * error for object 0x835e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(34474,0xa363a000) malloc: * error for object 0x835e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(34474,0xa363a000) malloc: * error for object 0x835e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(34474,0xa363a000) malloc: * error for object 0x835e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(34474,0xa363a000) malloc: * error for object 0x835e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(34474,0xa363a000) malloc: * error for object 0x835e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(34474,0xa363a000) malloc: * error for object 0x835e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(34474,0xa363a000) malloc: * error for object 0x835e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(34474,0xa363a000) malloc: * error for object 0x1000e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.11.3 build 15D21 Sat Mar 5 00:53:31 2016 13:39:53 (34474): No heartbeat from core client for 30 sec - exiting 13:39:54 (34474): No heartbeat from core client for 30 sec - exiting 13:39:55 (34474): No heartbeat from core client for 30 sec - exiting 13:39:56 (34474): No heartbeat from core client for 30 sec - exiting 13:39:57 (34474): No heartbeat from core client for 30 sec - exiting 13:39:58 (34474): No heartbeat from core client for 30 sec - exiting 13:39:59 (34474): No heartbeat from core client for 30 sec - exiting 13:40:00 (34474): No heartbeat from core client for 30 sec - exiting 13:40:01 (34474): No heartbeat from core client for 30 sec - exiting 13:40:02 (34474): No heartbeat from core client for 30 sec - exiting 13:40:03 (34474): No heartbeat from core client for 30 sec - exiting 13:40:04 (34474): No heartbeat from core client for 30 sec - exiting 13:40:05 (34474): No heartbeat from core client for 30 sec - exiting 13:40:06 (34474): No heartbeat from core client for 30 sec - exiting 13:40:07 (34474): No heartbeat from core client for 30 sec - exiting 13:40:08 (34474): No heartbeat from core client for 30 sec - exiting 13:40:09 (34474): No heartbeat from core client for 30 sec - exiting 13:40:10 (34474): No heartbeat from core client for 30 sec - exiting 13:40:11 (34474): No heartbeat from core client for 30 sec - exiting 13:40:12 (34474): No heartbeat from core client for 30 sec - exiting 13:40:13 (34474): No heartbeat from core client for 30 sec - exiting 13:40:14 (34474): No heartbeat from core client for 30 sec - exiting 13:40:15 (34474): No heartbeat from core client for 30 sec - exiting 13:40:16 (34474): No heartbeat from core client for 30 sec - exiting 13:40:17 (34474): No heartbeat from core client for 30 sec - exiting 13:40:18 (34474): No heartbeat from core client for 30 sec - exiting 13:40:19 (34474): No heartbeat from core client for 30 sec - exiting 13:40:20 (34474): No heartbeat from core client for 30 sec - exiting 13:40:21 (34474): No heartbeat from core client for 30 sec - exiting 13:40:22 (34474): No heartbeat from core client for 30 sec - exiting hadcm3n_6.07_i686-apple-darwin(482,0xa363a000) malloc: * error for object 0x101e804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(482,0xa363a000) malloc: * error for object 0x101e800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(482,0xa363a000) malloc: * error for object 0x2009c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(482,0xa363a000) malloc: * error for object 0x2009c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(482,0xa363a000) malloc: * error for object 0x2009c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(482,0xa363a000) malloc: * error for object 0x2009c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(482,0xa363a000) malloc: * error for object 0x2800e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(482,0xa363a000) malloc: * error for object 0x2800e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(482,0xa363a000) malloc: * error for object 0x2801e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(482,0xa363a000) malloc: * error for object 0x1000e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) hadcm3n_6.07_i686-apple-darwin(594,0xa363a000) malloc: * error for object 0x81a604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(594,0xa363a000) malloc: * error for object 0x81a600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(594,0xa363a000) malloc: * error for object 0x2009c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(594,0xa363a000) malloc: * error for object 0x2009c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(594,0xa363a000) malloc: * error for object 0x2009c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(594,0xa363a000) malloc: * error for object 0x2009c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(594,0xa363a000) malloc: * error for object 0x2009c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(594,0xa363a000) malloc: * error for object 0x2009c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(594,0xa363a000) malloc: * error for object 0x2009c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(594,0xa363a000) malloc: * error for object 0x2009c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(594,0xa363a000) malloc: * error for object 0x800e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(22471,0xa363a000) malloc: * error for object 0x2000e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.11.3 build 15D21 Fri Mar 18 02:23:44 2016 Thread 0 Crashed: atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386. Thread 1: Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8fda8 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x93fff /Library/Application Support/BOINC Data/slots/5/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin 0x902a3000 - 0x902bcfff /usr/lib/system/libsystem_malloc.dylib 0x90fef000 - 0x90feffff /usr/lib/system/liblaunch.dylib 0x9110c000 - 0x91110fff /usr/lib/system/libcache.dylib 0x91812000 - 0x91845fff /usr/lib/system/libsystem_m.dylib 0x91e2e000 - 0x91e39fff /usr/lib/system/libcommonCrypto.dylib 0x92849000 - 0x92869fff /usr/lib/system/libsystem_kernel.dylib 0x92d7c000 - 0x92da6fff /usr/lib/system/libsystem_info.dylib 0x92f69000 - 0x92fd2fff /usr/lib/system/libsystem_network.dylib 0x9346a000 - 0x93478fff /usr/lib/libz.1.dylib 0x93490000 - 0x93499fff /usr/lib/system/libcopyfile.dylib 0x9349a000 - 0x9349cfff /usr/lib/system/libsystem_coreservices.dylib 0x93a0c000 - 0x93a16fff /usr/lib/system/libsystem_notify.dylib 0x942b5000 - 0x942b5fff /usr/lib/system/libsystem_blocks.dylib 0x9531c000 - 0x9531ffff /usr/lib/system/libsystem_sandbox.dylib 0x95381000 - 0x953d4fff /usr/lib/libstdc++.6.dylib 0x957b8000 - 0x957e2fff /usr/lib/system/libdispatch.dylib 0x95859000 - 0x958eefff /usr/lib/system/libsystem_c.dylib 0x958fc000 - 0x95905fff /usr/lib/system/libsystem_networkextension.dylib 0x9793a000 - 0x97940fff /usr/lib/system/libsystem_platform.dylib 0x97946000 - 0x9796efff /usr/lib/system/libxpc.dylib 0x97f25000 - 0x97f2bfff /usr/lib/system/libunwind.dylib 0x97f2c000 - 0x97f2efff /usr/lib/system/libsystem_secinit.dylib 0x98047000 - 0x9804ffff /usr/lib/system/libsystem_pthread.dylib 0x981b2000 - 0x981b2fff /usr/lib/system/libunc.dylib 0x981c0000 - 0x981e3fff /usr/lib/libc++abi.dylib 0x981e4000 - 0x981e7fff /usr/lib/system/libdyld.dylib 0x981e8000 - 0x981eafff /usr/lib/system/libquarantine.dylib 0x98755000 - 0x98757fff /usr/lib/system/libsystem_configuration.dylib 0x993af000 - 0x993c6fff /usr/lib/system/libsystem_coretls.dylib 0x9a228000 - 0x9a229fff /usr/lib/system/libremovefile.dylib 0x9a553000 - 0x9a554fff /usr/lib/libSystem.B.dylib 0x9c215000 - 0x9c22efff /usr/lib/system/libsystem_asl.dylib 0x9c23d000 - 0x9c24efff /usr/lib/system/libsystem_trace.dylib 0x9cb71000 - 0x9cb76fff /usr/lib/system/libcompiler_rt.dylib 0x9cb78000 - 0x9cb80fff /usr/lib/system/libsystem_dnssd.dylib 0x9e129000 - 0x9e12efff /usr/lib/system/libmacho.dylib 0x9eb03000 - 0x9eb03fff /usr/lib/system/libkeymgr.dylib 0x9ebbb000 - 0x9ec22fff /usr/lib/system/libcorecrypto.dylib Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
15 Jan 2016 02:05:31	1331234	19132982	hadcm3n_sah0_198012_480_010221581_0	1,036,800	1,606,553	1.5495
14 Jan 2016 11:15:56	1331234	19132982	hadcm3n_sah0_198012_480_010221581_0	1,010,880	1,567,809	1.5509
13 Jan 2016 06:38:56	1331234	19132982	hadcm3n_sah0_198012_480_010221581_0	984,960	1,532,850	1.5563
12 Jan 2016 20:32:30	1331234	19132982	hadcm3n_sah0_198012_480_010221581_0	959,040	1,502,373	1.5665
12 Jan 2016 07:34:43	1331234	19132982	hadcm3n_sah0_198012_480_010221581_0	933,120	1,469,887	1.5752
11 Jan 2016 19:59:35	1331234	19132982	hadcm3n_sah0_198012_480_010221581_0	907,200	1,439,152	1.5864
11 Jan 2016 09:42:53	1331234	19132982	hadcm3n_sah0_198012_480_010221581_0	881,280	1,408,471	1.5982
10 Jan 2016 22:28:04	1331234	19132982	hadcm3n_sah0_198012_480_010221581_0	855,360	1,373,119	1.6053
10 Jan 2016 09:26:50	1331234	19132982	hadcm3n_sah0_198012_480_010221581_0	829,440	1,331,876	1.6058
09 Jan 2016 23:20:33	1331234	19132982	hadcm3n_sah0_198012_480_010221581_0	803,520	1,298,923	1.6165
09 Jan 2016 13:44:42	1331234	19132982	hadcm3n_sah0_198012_480_010221581_0	777,600	1,267,539	1.6301
09 Jan 2016 04:02:10	1331234	19132982	hadcm3n_sah0_198012_480_010221581_0	751,680	1,236,309	1.6447
07 Jan 2016 20:28:08	1331234	19132982	hadcm3n_sah0_198012_480_010221581_0	725,760	1,215,824	1.6752
07 Jan 2016 12:37:04	1331234	19132982	hadcm3n_sah0_198012_480_010221581_0	699,840	1,190,979	1.7018
07 Jan 2016 03:03:50	1331234	19132982	hadcm3n_sah0_198012_480_010221581_0	673,920	1,160,541	1.7221
06 Jan 2016 14:30:03	1331234	19132982	hadcm3n_sah0_198012_480_010221581_0	648,000	1,120,564	1.7293
06 Jan 2016 00:54:21	1331234	19132982	hadcm3n_sah0_198012_480_010221581_0	622,080	1,076,492	1.7305
05 Jan 2016 11:57:58	1331234	19132982	hadcm3n_sah0_198012_480_010221581_0	596,160	1,034,731	1.7357
04 Jan 2016 22:29:24	1331234	19132982	hadcm3n_sah0_198012_480_010221581_0	570,240	990,953	1.7378
04 Jan 2016 09:21:48	1331234	19132982	hadcm3n_sah0_198012_480_010221581_0	544,320	948,316	1.7422