Name | hadcm3n_xdft_198012_480_374_010412802_0 |
Workunit | 10412802 |
Created | 21 Mar 2016, 15:17:50 UTC |
Sent | 21 Mar 2016, 20:27:29 UTC |
Report deadline | 4 Mar 2017, 1:47:29 UTC |
Received | 13 May 2016, 7:12:18 UTC |
Server state | Over |
Outcome | Computation error |
Client state | Compute error |
Exit status | 22 (0x00000016) Unknown error code |
Computer ID | 1378201 |
Run time | 7 days 14 hours 59 min 41 sec |
CPU time | 6 days 17 hours 33 min 50 sec |
Validate state | Invalid |
Credit | 7,776.00 |
Device peak FLOPS | 3.42 GFLOPS |
Application version | UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin |
Stderr | <core_client_version>7.6.22</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> m for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(4837,0xa35fc000) malloc: *** error for object 0x281ac00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(4837,0xa35fc000) malloc: *** error for object 0x815e04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(4837,0xa35fc000) malloc: *** error for object 0x815e00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(4837,0xa35fc000) malloc: *** error for object 0x811e04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(4837,0xa35fc000) malloc: *** error for object 0x811e00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(4837,0xa35fc000) malloc: *** error for object 0x811e04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(4837,0xa35fc000) malloc: *** error for object 0x811e00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(4837,0xa35fc000) malloc: *** error for object 0x811e00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation 08:16:44 (4837): No heartbeat from core client for 30 sec - exiting 08:16:45 (4837): No heartbeat from core client for 30 sec - exiting 08:16:46 (4837): No heartbeat from core client for 30 sec - exiting 08:16:47 (4837): No heartbeat from core client for 30 sec - exiting 08:16:48 (4837): No heartbeat from core client for 30 sec - exiting 08:16:49 (4837): No heartbeat from core client for 30 sec - exiting 08:16:50 (4837): No heartbeat from core client for 30 sec - exiting 08:16:51 (4837): No heartbeat from core client for 30 sec - exiting 08:16:52 (4837): No heartbeat from core client for 30 sec - exiting 08:16:53 (4837): No heartbeat from core client for 30 sec - exiting 08:16:54 (4837): No heartbeat from core client for 30 sec - exiting 08:16:55 (4837): No heartbeat from core client for 30 sec - exiting 08:16:56 (4837): No heartbeat from core client for 30 sec - exiting 08:16:57 (4837): No heartbeat from core client for 30 sec - exiting 08:16:58 (4837): No heartbeat from core client for 30 sec - exiting 08:16:59 (4837): No heartbeat from core client for 30 sec - exiting 08:17:00 (4837): No heartbeat from core client for 30 sec - exiting 08:17:01 (4837): No heartbeat from core client for 30 sec - exiting 08:17:02 (4837): No heartbeat from core client for 30 sec - exiting 08:17:03 (4837): No heartbeat from core client for 30 sec - exiting 08:17:04 (4837): No heartbeat from core client for 30 sec - exiting 08:17:06 (4837): No heartbeat from core client for 30 sec - exiting 08:17:07 (4837): No heartbeat from core client for 30 sec - exiting 08:17:08 (4837): No heartbeat from core client for 30 sec - exiting 08:17:09 (4837): No heartbeat from core client for 30 sec - exiting 08:17:10 (4837): No heartbeat from core client for 30 sec - exiting 08:17:11 (4837): No heartbeat from core client for 30 sec - exiting 08:17:12 (4837): No heartbeat from core client for 30 sec - exiting 08:17:13 (4837): No heartbeat from core client for 30 sec - exiting hadcm3n_6.07_i686-apple-darwin(5132,0xa35fc000) malloc: *** error for object 0x1811c04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(5132,0xa35fc000) malloc: *** error for object 0x1811c00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(5132,0xa35fc000) malloc: *** error for object 0x1811c04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(5132,0xa35fc000) malloc: *** error for object 0x1811c00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(5132,0xa35fc000) malloc: *** error for object 0x1811c04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(5132,0xa35fc000) malloc: *** error for object 0x1811c00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(5132,0xa35fc000) malloc: *** error for object 0x1811c04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(5132,0xa35fc000) malloc: *** error for object 0x1811c00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(5132,0xa35fc000) malloc: *** error for object 0x1811c00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation 10:27:11 (5132): No heartbeat from core client for 30 sec - exiting 10:27:12 (5132): No heartbeat from core client for 30 sec - exiting 10:27:13 (5132): No heartbeat from core client for 30 sec - exiting 10:27:14 (5132): No heartbeat from core client for 30 sec - exiting 10:27:15 (5132): No heartbeat from core client for 30 sec - exiting 10:27:16 (5132): No heartbeat from core client for 30 sec - exiting 10:27:17 (5132): No heartbeat from core client for 30 sec - exiting 10:27:18 (5132): No heartbeat from core client for 30 sec - exiting 10:27:19 (5132): No heartbeat from core client for 30 sec - exiting 10:27:20 (5132): No heartbeat from core client for 30 sec - exiting 10:27:21 (5132): No heartbeat from core client for 30 sec - exiting 10:27:22 (5132): No heartbeat from core client for 30 sec - exiting 10:27:23 (5132): No heartbeat from core client for 30 sec - exiting 10:27:24 (5132): No heartbeat from core client for 30 sec - exiting 10:27:25 (5132): No heartbeat from core client for 30 sec - exiting 10:27:26 (5132): No heartbeat from core client for 30 sec - exiting 10:27:27 (5132): No heartbeat from core client for 30 sec - exiting 10:27:28 (5132): No heartbeat from core client for 30 sec - exiting 10:27:29 (5132): No heartbeat from core client for 30 sec - exiting 10:27:30 (5132): No heartbeat from core client for 30 sec - exiting 10:27:31 (5132): No heartbeat from core client for 30 sec - exiting 10:27:32 (5132): No heartbeat from core client for 30 sec - exiting 10:27:33 (5132): No heartbeat from core client for 30 sec - exiting 10:27:34 (5132): No heartbeat from core client for 30 sec - exiting 10:27:35 (5132): No heartbeat from core client for 30 sec - exiting 10:27:36 (5132): No heartbeat from core client for 30 sec - exiting 10:27:37 (5132): No heartbeat from core client for 30 sec - exiting 10:27:38 (5132): No heartbeat from core client for 30 sec - exiting 10:27:39 (5132): No heartbeat from core client for 30 sec - exiting hadcm3n_6.07_i686-apple-darwin(12523,0xa35fc000) malloc: *** error for object 0x1825c04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(12523,0xa35fc000) malloc: *** error for object 0x1825c00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(12523,0xa35fc000) malloc: *** error for object 0x1825c04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(12523,0xa35fc000) malloc: *** error for object 0x1825c00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(12523,0xa35fc000) malloc: *** error for object 0x1825c04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(12523,0xa35fc000) malloc: *** error for object 0x1825c00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(12523,0xa35fc000) malloc: *** error for object 0x1825c04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(12523,0xa35fc000) malloc: *** error for object 0x1825c00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(12523,0xa35fc000) malloc: *** error for object 0x1825c00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(2182,0xa35fc000) malloc: *** error for object 0x2005c04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(2182,0xa35fc000) malloc: *** error for object 0x2005c00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(2182,0xa35fc000) malloc: *** error for object 0x2005c04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(2182,0xa35fc000) malloc: *** error for object 0x2005c00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(2182,0xa35fc000) malloc: *** error for object 0x2005c04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(2182,0xa35fc000) malloc: *** error for object 0x2005c00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(2182,0xa35fc000) malloc: *** error for object 0x2005c04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(2182,0xa35fc000) malloc: *** error for object 0x2005c00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(2182,0xa35fc000) malloc: *** error for object 0x2005c00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(7214,0xa35fc000) malloc: *** error for object 0x1000e04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(7214,0xa35fc000) malloc: *** error for object 0x1000e00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(7214,0xa35fc000) malloc: *** error for object 0x2815e04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(7214,0xa35fc000) malloc: *** error for object 0x2815e00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(7214,0xa35fc000) malloc: *** error for object 0x2815e04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(7214,0xa35fc000) malloc: *** error for object 0x2815e00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(7214,0xa35fc000) malloc: *** error for object 0x2815e00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation 20:42:56 (7214): No heartbeat from core client for 30 sec - exiting 20:42:57 (7214): No heartbeat from core client for 30 sec - exiting 20:42:58 (7214): No heartbeat from core client for 30 sec - exiting 20:42:59 (7214): No heartbeat from core client for 30 sec - exiting 20:43:00 (7214): No heartbeat from core client for 30 sec - exiting 20:43:01 (7214): No heartbeat from core client for 30 sec - exiting 20:43:02 (7214): No heartbeat from core client for 30 sec - exiting 20:43:03 (7214): No heartbeat from core client for 30 sec - exiting 20:43:04 (7214): No heartbeat from core client for 30 sec - exiting 20:43:05 (7214): No heartbeat from core client for 30 sec - exiting 20:43:06 (7214): No heartbeat from core client for 30 sec - exiting 20:43:07 (7214): No heartbeat from core client for 30 sec - exiting 20:43:08 (7214): No heartbeat from core client for 30 sec - exiting 20:43:09 (7214): No heartbeat from core client for 30 sec - exiting 20:43:10 (7214): No heartbeat from core client for 30 sec - exiting 20:43:11 (7214): No heartbeat from core client for 30 sec - exiting 20:43:12 (7214): No heartbeat from core client for 30 sec - exiting 20:43:14 (7214): No heartbeat from core client for 30 sec - exiting 20:43:15 (7214): No heartbeat from core client for 30 sec - exiting 20:43:16 (7214): No heartbeat from core client for 30 sec - exiting 20:43:17 (7214): No heartbeat from core client for 30 sec - exiting 20:43:18 (7214): No heartbeat from core client for 30 sec - exiting 20:43:19 (7214): No heartbeat from core client for 30 sec - exiting 20:43:20 (7214): No heartbeat from core client for 30 sec - exiting 20:43:21 (7214): No heartbeat from core client for 30 sec - exiting 20:43:22 (7214): No heartbeat from core client for 30 sec - exiting 20:43:23 (7214): No heartbeat from core client for 30 sec - exiting 20:43:24 (7214): No heartbeat from core client for 30 sec - exiting 20:43:25 (7214): No heartbeat from core client for 30 sec - exiting hadcm3n_6.07_i686-apple-darwin(1854,0xa35fc000) malloc: *** error for object 0x1011c04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(1854,0xa35fc000) malloc: *** error for object 0x1011c00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(1854,0xa35fc000) malloc: *** error for object 0x280a004: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(1854,0xa35fc000) malloc: *** error for object 0x280a000: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(1854,0xa35fc000) malloc: *** error for object 0x280a004: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(1854,0xa35fc000) malloc: *** error for object 0x280a000: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(1854,0xa35fc000) malloc: *** error for object 0x280a004: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(1854,0xa35fc000) malloc: *** error for object 0x280a000: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(1854,0xa35fc000) malloc: *** error for object 0x280a000: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(10943,0xa3ead000) malloc: *** error for object 0x81de04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(10943,0xa3ead000) malloc: *** error for object 0x81de00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(10943,0xa3ead000) malloc: *** error for object 0x81de04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(10943,0xa3ead000) malloc: *** error for object 0x81de00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(10943,0xa3ead000) malloc: *** error for object 0x81de04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(10943,0xa3ead000) malloc: *** error for object 0x81de00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(10943,0xa3ead000) malloc: *** error for object 0x81de00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(10943,0xa3ead000) malloc: *** error for object 0x2004e04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(10943,0xa3ead000) malloc: *** error for object 0x2004e00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.11.4 build 15E65 Wed Apr 27 12:21:34 2016 15:05:00 (10943): No heartbeat from core client for 30 sec - exiting 15:05:01 (10943): No heartbeat from core client for 30 sec - exiting 15:05:02 (10943): No heartbeat from core client for 30 sec - exiting 15:05:03 (10943): No heartbeat from core client for 30 sec - exiting 15:05:04 (10943): No heartbeat from core client for 30 sec - exiting 15:05:05 (10943): No heartbeat from core client for 30 sec - exiting 15:05:06 (10943): No heartbeat from core client for 30 sec - exiting 15:05:07 (10943): No heartbeat from core client for 30 sec - exiting 15:05:08 (10943): No heartbeat from core client for 30 sec - exiting 15:05:09 (10943): No heartbeat from core client for 30 sec - exiting 15:05:10 (10943): No heartbeat from core client for 30 sec - exiting 15:05:11 (10943): No heartbeat from core client for 30 sec - exiting 15:05:12 (10943): No heartbeat from core client for 30 sec - exiting 15:05:13 (10943): No heartbeat from core client for 30 sec - exiting 15:05:14 (10943): No heartbeat from core client for 30 sec - exiting 15:05:15 (10943): No heartbeat from core client for 30 sec - exiting 15:05:16 (10943): No heartbeat from core client for 30 sec - exiting 15:05:17 (10943): No heartbeat from core client for 30 sec - exiting 15:05:18 (10943): No heartbeat from core client for 30 sec - exiting 15:05:20 (10943): No heartbeat from core client for 30 sec - exiting 15:05:21 (10943): No heartbeat from core client for 30 sec - exiting 15:05:22 (10943): No heartbeat from core client for 30 sec - exiting 15:05:23 (10943): No heartbeat from core client for 30 sec - exiting 15:05:24 (10943): No heartbeat from core client for 30 sec - exiting 15:05:25 (10943): No heartbeat from core client for 30 sec - exiting 15:05:26 (10943): No heartbeat from core client for 30 sec - exiting 15:05:27 (10943): No heartbeat from core client for 30 sec - exiting 15:05:28 (10943): No heartbeat from core client for 30 sec - exiting 15:05:29 (10943): No heartbeat from core client for 30 sec - exiting hadcm3n_6.07_i686-apple-darwin(6186,0xa3ead000) malloc: *** error for object 0x1806c04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(6186,0xa3ead000) malloc: *** error for object 0x1806c00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(6186,0xa3ead000) malloc: *** error for object 0x1800e04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(6186,0xa3ead000) malloc: *** error for object 0x1800e00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(6186,0xa3ead000) malloc: *** error for object 0x1800e04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(6186,0xa3ead000) malloc: *** error for object 0x1800e00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(6186,0xa3ead000) malloc: *** error for object 0x1800e04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(6186,0xa3ead000) malloc: *** error for object 0x1800e00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(6186,0xa3ead000) malloc: *** error for object 0x1800e00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation 09:58:45 (6186): No heartbeat from core client for 30 sec - exiting 09:58:46 (6186): No heartbeat from core client for 30 sec - exiting 09:58:47 (6186): No heartbeat from core client for 30 sec - exiting 09:58:48 (6186): No heartbeat from core client for 30 sec - exiting 09:58:49 (6186): No heartbeat from core client for 30 sec - exiting 09:58:50 (6186): No heartbeat from core client for 30 sec - exiting 09:58:51 (6186): No heartbeat from core client for 30 sec - exiting 09:58:52 (6186): No heartbeat from core client for 30 sec - exiting 09:58:54 (6186): No heartbeat from core client for 30 sec - exiting 09:58:55 (6186): No heartbeat from core client for 30 sec - exiting 09:58:56 (6186): No heartbeat from core client for 30 sec - exiting 09:58:57 (6186): No heartbeat from core client for 30 sec - exiting 09:58:58 (6186): No heartbeat from core client for 30 sec - exiting 09:58:59 (6186): No heartbeat from core client for 30 sec - exiting 09:59:00 (6186): No heartbeat from core client for 30 sec - exiting 09:59:01 (6186): No heartbeat from core client for 30 sec - exiting 09:59:02 (6186): No heartbeat from core client for 30 sec - exiting 09:59:03 (6186): No heartbeat from core client for 30 sec - exiting 09:59:04 (6186): No heartbeat from core client for 30 sec - exiting 09:59:05 (6186): No heartbeat from core client for 30 sec - exiting 09:59:06 (6186): No heartbeat from core client for 30 sec - exiting 09:59:07 (6186): No heartbeat from core client for 30 sec - exiting 09:59:08 (6186): No heartbeat from core client for 30 sec - exiting 09:59:09 (6186): No heartbeat from core client for 30 sec - exiting 09:59:10 (6186): No heartbeat from core client for 30 sec - exiting 09:59:11 (6186): No heartbeat from core client for 30 sec - exiting 09:59:12 (6186): No heartbeat from core client for 30 sec - exiting 09:59:13 (6186): No heartbeat from core client for 30 sec - exiting 09:59:14 (6186): No heartbeat from core client for 30 sec - exiting 09:59:15 (6186): No heartbeat from core client for 30 sec - exiting 09:59:16 (6186): No heartbeat from core client for 30 sec - exiting hadcm3n_6.07_i686-apple-darwin(8798,0xa3ead000) malloc: *** error for object 0x200e004: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(8798,0xa3ead000) malloc: *** error for object 0x200e000: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(8798,0xa3ead000) malloc: *** error for object 0x200e004: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(8798,0xa3ead000) malloc: *** error for object 0x200e000: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(8798,0xa3ead000) malloc: *** error for object 0x200e004: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(8798,0xa3ead000) malloc: *** error for object 0x200e000: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(8798,0xa3ead000) malloc: *** error for object 0x200e004: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(8798,0xa3ead000) malloc: *** error for object 0x200e000: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(8798,0xa3ead000) malloc: *** error for object 0x200e000: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation 10:24:15 (8798): No heartbeat from core client for 30 sec - exiting 10:24:16 (8798): No heartbeat from core client for 30 sec - exiting 10:24:17 (8798): No heartbeat from core client for 30 sec - exiting 10:24:18 (8798): No heartbeat from core client for 30 sec - exiting 10:24:19 (8798): No heartbeat from core client for 30 sec - exiting 10:24:20 (8798): No heartbeat from core client for 30 sec - exiting 10:24:21 (8798): No heartbeat from core client for 30 sec - exiting 10:24:22 (8798): No heartbeat from core client for 30 sec - exiting 10:24:23 (8798): No heartbeat from core client for 30 sec - exiting 10:24:24 (8798): No heartbeat from core client for 30 sec - exiting 10:24:25 (8798): No heartbeat from core client for 30 sec - exiting 10:24:26 (8798): No heartbeat from core client for 30 sec - exiting 10:24:27 (8798): No heartbeat from core client for 30 sec - exiting 10:24:28 (8798): No heartbeat from core client for 30 sec - exiting 10:24:29 (8798): No heartbeat from core client for 30 sec - exiting 10:24:30 (8798): No heartbeat from core client for 30 sec - exiting 10:24:31 (8798): No heartbeat from core client for 30 sec - exiting 10:24:32 (8798): No heartbeat from core client for 30 sec - exiting 10:24:33 (8798): No heartbeat from core client for 30 sec - exiting 10:24:34 (8798): No heartbeat from core client for 30 sec - exiting 10:24:35 (8798): No heartbeat from core client for 30 sec - exiting 10:24:36 (8798): No heartbeat from core client for 30 sec - exiting 10:24:37 (8798): No heartbeat from core client for 30 sec - exiting 10:24:38 (8798): No heartbeat from core client for 30 sec - exiting 10:24:39 (8798): No heartbeat from core client for 30 sec - exiting 10:24:40 (8798): No heartbeat from core client for 30 sec - exiting 10:24:41 (8798): No heartbeat from core client for 30 sec - exiting 10:24:42 (8798): No heartbeat from core client for 30 sec - exiting 10:24:43 (8798): No heartbeat from core client for 30 sec - exiting 10:24:44 (8798): No heartbeat from core client for 30 sec - exiting hadcm3n_6.07_i686-apple-darwin(4674,0xa3ead000) malloc: *** error for object 0x2801c04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(4674,0xa3ead000) malloc: *** error for object 0x2801c00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(4674,0xa3ead000) malloc: *** error for object 0x2801c04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(4674,0xa3ead000) malloc: *** error for object 0x2801c00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(4674,0xa3ead000) malloc: *** error for object 0x2801c04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(4674,0xa3ead000) malloc: *** error for object 0x2801c00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(4674,0xa3ead000) malloc: *** error for object 0x2801c00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation 19:12:35 (4674): No heartbeat from core client for 30 sec - exiting 19:12:36 (4674): No heartbeat from core client for 30 sec - exiting 19:12:37 (4674): No heartbeat from core client for 30 sec - exiting 19:12:38 (4674): No heartbeat from core client for 30 sec - exiting 19:12:39 (4674): No heartbeat from core client for 30 sec - exiting 19:12:40 (4674): No heartbeat from core client for 30 sec - exiting 19:12:41 (4674): No heartbeat from core client for 30 sec - exiting 19:12:42 (4674): No heartbeat from core client for 30 sec - exiting 19:12:43 (4674): No heartbeat from core client for 30 sec - exiting 19:12:44 (4674): No heartbeat from core client for 30 sec - exiting 19:12:45 (4674): No heartbeat from core client for 30 sec - exiting 19:12:46 (4674): No heartbeat from core client for 30 sec - exiting 19:12:47 (4674): No heartbeat from core client for 30 sec - exiting 19:12:48 (4674): No heartbeat from core client for 30 sec - exiting 19:12:49 (4674): No heartbeat from core client for 30 sec - exiting 19:12:50 (4674): No heartbeat from core client for 30 sec - exiting 19:12:51 (4674): No heartbeat from core client for 30 sec - exiting 19:12:53 (4674): No heartbeat from core client for 30 sec - exiting 19:12:54 (4674): No heartbeat from core client for 30 sec - exiting 19:12:55 (4674): No heartbeat from core client for 30 sec - exiting 19:12:56 (4674): No heartbeat from core client for 30 sec - exiting 19:12:57 (4674): No heartbeat from core client for 30 sec - exiting 19:12:58 (4674): No heartbeat from core client for 30 sec - exiting 19:12:59 (4674): No heartbeat from core client for 30 sec - exiting 19:13:00 (4674): No heartbeat from core client for 30 sec - exiting 19:13:01 (4674): No heartbeat from core client for 30 sec - exiting 19:13:02 (4674): No heartbeat from core client for 30 sec - exiting 19:13:03 (4674): No heartbeat from core client for 30 sec - exiting 19:13:04 (4674): No heartbeat from core client for 30 sec - exiting hadcm3n_6.07_i686-apple-darwin(792,0xa3ead000) malloc: *** error for object 0x1832004: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(792,0xa3ead000) malloc: *** error for object 0x1832000: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(792,0xa3ead000) malloc: *** error for object 0x801c04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(792,0xa3ead000) malloc: *** error for object 0x801c00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(792,0xa3ead000) malloc: *** error for object 0x801c04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(792,0xa3ead000) malloc: *** error for object 0x801c00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(792,0xa3ead000) malloc: *** error for object 0x801c00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation 21:00:59 (792): No heartbeat from core client for 30 sec - exiting 21:01:00 (792): No heartbeat from core client for 30 sec - exiting 21:01:01 (792): No heartbeat from core client for 30 sec - exiting 21:01:02 (792): No heartbeat from core client for 30 sec - exiting 21:01:03 (792): No heartbeat from core client for 30 sec - exiting 21:01:04 (792): No heartbeat from core client for 30 sec - exiting 21:01:05 (792): No heartbeat from core client for 30 sec - exiting 21:01:06 (792): No heartbeat from core client for 30 sec - exiting 21:01:07 (792): No heartbeat from core client for 30 sec - exiting 21:01:08 (792): No heartbeat from core client for 30 sec - exiting 21:01:09 (792): No heartbeat from core client for 30 sec - exiting 21:01:10 (792): No heartbeat from core client for 30 sec - exiting 21:01:11 (792): No heartbeat from core client for 30 sec - exiting 21:01:12 (792): No heartbeat from core client for 30 sec - exiting 21:01:13 (792): No heartbeat from core client for 30 sec - exiting 21:01:14 (792): No heartbeat from core client for 30 sec - exiting 21:01:15 (792): No heartbeat from core client for 30 sec - exiting 21:01:16 (792): No heartbeat from core client for 30 sec - exiting 21:01:17 (792): No heartbeat from core client for 30 sec - exiting 21:01:18 (792): No heartbeat from core client for 30 sec - exiting 21:01:19 (792): No heartbeat from core client for 30 sec - exiting 21:01:20 (792): No heartbeat from core client for 30 sec - exiting 21:01:21 (792): No heartbeat from core client for 30 sec - exiting 21:01:22 (792): No heartbeat from core client for 30 sec - exiting 21:01:23 (792): No heartbeat from core client for 30 sec - exiting 21:01:24 (792): No heartbeat from core client for 30 sec - exiting 21:01:25 (792): No heartbeat from core client for 30 sec - exiting 21:01:26 (792): No heartbeat from core client for 30 sec - exiting 21:01:27 (792): No heartbeat from core client for 30 sec - exiting hadcm3n_6.07_i686-apple-darwin(1170,0xa3ead000) malloc: *** error for object 0x200e604: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(1170,0xa3ead000) malloc: *** error for object 0x200e600: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(1170,0xa3ead000) malloc: *** error for object 0x200e604: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(1170,0xa3ead000) malloc: *** error for object 0x200e600: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(1170,0xa3ead000) malloc: *** error for object 0x200e604: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(1170,0xa3ead000) malloc: *** error for object 0x200e600: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(1170,0xa3ead000) malloc: *** error for object 0x200e600: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(1429,0xa3ead000) malloc: *** error for object 0x829c04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(1429,0xa3ead000) malloc: *** error for object 0x829c00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(1429,0xa3ead000) malloc: *** error for object 0x829c04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(1429,0xa3ead000) malloc: *** error for object 0x829c00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(1429,0xa3ead000) malloc: *** error for object 0x829c04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(1429,0xa3ead000) malloc: *** error for object 0x829c00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(1429,0xa3ead000) malloc: *** error for object 0x829c04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(1429,0xa3ead000) malloc: *** error for object 0x829c00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(1429,0xa3ead000) malloc: *** error for object 0x829c00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(2152,0xa3ead000) malloc: *** error for object 0x202a004: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(2152,0xa3ead000) malloc: *** error for object 0x202a000: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(2152,0xa3ead000) malloc: *** error for object 0x202a004: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(2152,0xa3ead000) malloc: *** error for object 0x202a000: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(2152,0xa3ead000) malloc: *** error for object 0x202a004: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(2152,0xa3ead000) malloc: *** error for object 0x202a000: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(2152,0xa3ead000) malloc: *** error for object 0x202a004: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(2152,0xa3ead000) malloc: *** error for object 0x202a000: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(2152,0xa3ead000) malloc: *** error for object 0x202a000: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(4644,0xa3ead000) malloc: *** error for object 0x82de04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(4644,0xa3ead000) malloc: *** error for object 0x82de00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(4644,0xa3ead000) malloc: *** error for object 0x82de04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(4644,0xa3ead000) malloc: *** error for object 0x82de00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(4644,0xa3ead000) malloc: *** error for object 0x82de04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(4644,0xa3ead000) malloc: *** error for object 0x82de00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(4644,0xa3ead000) malloc: *** error for object 0x82de04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(4644,0xa3ead000) malloc: *** error for object 0x82de00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(4644,0xa3ead000) malloc: *** error for object 0x82de00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation 08:14:50 (4644): No heartbeat from core client for 30 sec - exiting 08:14:51 (4644): No heartbeat from core client for 30 sec - exiting 08:14:52 (4644): No heartbeat from core client for 30 sec - exiting 08:14:53 (4644): No heartbeat from core client for 30 sec - exiting 08:14:54 (4644): No heartbeat from core client for 30 sec - exiting 08:14:55 (4644): No heartbeat from core client for 30 sec - exiting 08:14:56 (4644): No heartbeat from core client for 30 sec - exiting 08:14:57 (4644): No heartbeat from core client for 30 sec - exiting 08:14:58 (4644): No heartbeat from core client for 30 sec - exiting 08:14:59 (4644): No heartbeat from core client for 30 sec - exiting 08:15:00 (4644): No heartbeat from core client for 30 sec - exiting 08:15:01 (4644): No heartbeat from core client for 30 sec - exiting 08:15:02 (4644): No heartbeat from core client for 30 sec - exiting 08:15:03 (4644): No heartbeat from core client for 30 sec - exiting 08:15:04 (4644): No heartbeat from core client for 30 sec - exiting 08:15:05 (4644): No heartbeat from core client for 30 sec - exiting 08:15:06 (4644): No heartbeat from core client for 30 sec - exiting 08:15:07 (4644): No heartbeat from core client for 30 sec - exiting 08:15:08 (4644): No heartbeat from core client for 30 sec - exiting 08:15:09 (4644): No heartbeat from core client for 30 sec - exiting 08:15:10 (4644): No heartbeat from core client for 30 sec - exiting 08:15:11 (4644): No heartbeat from core client for 30 sec - exiting 08:15:12 (4644): No heartbeat from core client for 30 sec - exiting 08:15:13 (4644): No heartbeat from core client for 30 sec - exiting 08:15:14 (4644): No heartbeat from core client for 30 sec - exiting 08:15:15 (4644): No heartbeat from core client for 30 sec - exiting 08:15:16 (4644): No heartbeat from core client for 30 sec - exiting 08:15:17 (4644): No heartbeat from core client for 30 sec - exiting 08:15:18 (4644): No heartbeat from core client for 30 sec - exiting 08:15:19 (4644): No heartbeat from core client for 30 sec - exiting 08:15:20 (4644): No heartbeat from core client for 30 sec - exiting 08:15:22 (4644): No heartbeat from core client for 30 sec - exiting 08:15:23 (4644): No heartbeat from core client for 30 sec - exiting 08:15:24 (4644): No heartbeat from core client for 30 sec - exiting 08:15:25 (4644): No heartbeat from core client for 30 sec - exiting 08:15:26 (4644): No heartbeat from core client for 30 sec - exiting 08:15:27 (4644): No heartbeat from core client for 30 sec - exiting hadcm3n_6.07_i686-apple-darwin(9724,0xa3ead000) malloc: *** error for object 0x1012c04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(9724,0xa3ead000) malloc: *** error for object 0x1012c00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(9724,0xa3ead000) malloc: *** error for object 0x1000e04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(9724,0xa3ead000) malloc: *** error for object 0x1000e00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(9724,0xa3ead000) malloc: *** error for object 0x1000e04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(9724,0xa3ead000) malloc: *** error for object 0x1000e00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(9724,0xa3ead000) malloc: *** error for object 0x1000e04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(9724,0xa3ead000) malloc: *** error for object 0x1000e00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(9724,0xa3ead000) malloc: *** error for object 0x2801c00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 1 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 1 received, exiting... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Signal 1 received, exiting... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 1 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 1 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 1 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(17334,0xa3ead000) malloc: *** error for object 0x830604: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(17334,0xa3ead000) malloc: *** error for object 0x183fc04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(17334,0xa3ead000) malloc: *** error for object 0x185b204: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(17334,0xa3ead000) malloc: *** error for object 0x185b200: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(17334,0xa3ead000) malloc: *** error for object 0x1042604: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(17334,0xa3ead000) malloc: *** error for object 0x1042600: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(17334,0xa3ead000) malloc: *** error for object 0x830604: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(17334,0xa3ead000) malloc: *** error for object 0x84bc04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(17334,0xa3ead000) malloc: *** error for object 0x84bc00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(17334,0xa3ead000) malloc: *** error for object 0x1027004: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(17334,0xa3ead000) malloc: *** error for object 0x1042604: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(17334,0xa3ead000) malloc: *** error for object 0x1042600: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]> |
Latest Trickles Received | ||||||
---|---|---|---|---|---|---|
Time Sent (UTC) | Host ID | Result ID | Result Name | Timestep | CPU Time (sec) | Average (sec/TS) |
13 May 2016 02:19:22 | 1378201 | 19418348 | hadcm3n_xdft_198012_480_374_010412802_0 | 648,000 | 586,967 | 0.9058 |
12 May 2016 14:46:59 | 1378201 | 19418348 | hadcm3n_xdft_198012_480_374_010412802_0 | 622,080 | 563,727 | 0.9062 |
11 May 2016 17:10:55 | 1378201 | 19418348 | hadcm3n_xdft_198012_480_374_010412802_0 | 596,160 | 540,448 | 0.9065 |
11 May 2016 09:38:51 | 1378201 | 19418348 | hadcm3n_xdft_198012_480_374_010412802_0 | 570,240 | 517,227 | 0.9070 |
10 May 2016 06:27:04 | 1378201 | 19418348 | hadcm3n_xdft_198012_480_374_010412802_0 | 544,320 | 493,962 | 0.9075 |
06 May 2016 13:35:56 | 1378201 | 19418348 | hadcm3n_xdft_198012_480_374_010412802_0 | 518,400 | 470,827 | 0.9082 |
05 May 2016 06:47:27 | 1378201 | 19418348 | hadcm3n_xdft_198012_480_374_010412802_0 | 492,480 | 447,705 | 0.9091 |
04 May 2016 01:58:59 | 1378201 | 19418348 | hadcm3n_xdft_198012_480_374_010412802_0 | 466,560 | 424,428 | 0.9097 |
03 May 2016 10:45:59 | 1378201 | 19418348 | hadcm3n_xdft_198012_480_374_010412802_0 | 440,640 | 401,197 | 0.9105 |
02 May 2016 23:32:00 | 1378201 | 19418348 | hadcm3n_xdft_198012_480_374_010412802_0 | 414,720 | 377,960 | 0.9114 |
01 May 2016 16:05:13 | 1378201 | 19418348 | hadcm3n_xdft_198012_480_374_010412802_0 | 388,800 | 354,819 | 0.9126 |
01 May 2016 05:32:21 | 1378201 | 19418348 | hadcm3n_xdft_198012_480_374_010412802_0 | 362,880 | 331,576 | 0.9137 |
30 Apr 2016 20:19:55 | 1378201 | 19418348 | hadcm3n_xdft_198012_480_374_010412802_0 | 336,960 | 308,435 | 0.9153 |
30 Apr 2016 07:48:00 | 1378201 | 19418348 | hadcm3n_xdft_198012_480_374_010412802_0 | 311,040 | 284,854 | 0.9158 |
29 Apr 2016 18:55:50 | 1378201 | 19418348 | hadcm3n_xdft_198012_480_374_010412802_0 | 285,120 | 261,520 | 0.9172 |
30 Mar 2016 11:54:55 | 1378201 | 19418348 | hadcm3n_xdft_198012_480_374_010412802_0 | 259,200 | 238,378 | 0.9197 |
28 Mar 2016 05:28:03 | 1378201 | 19418348 | hadcm3n_xdft_198012_480_374_010412802_0 | 233,280 | 214,291 | 0.9186 |
26 Mar 2016 13:09:40 | 1378201 | 19418348 | hadcm3n_xdft_198012_480_374_010412802_0 | 207,360 | 190,510 | 0.9187 |
26 Mar 2016 04:23:07 | 1378201 | 19418348 | hadcm3n_xdft_198012_480_374_010412802_0 | 181,440 | 166,567 | 0.9180 |
25 Mar 2016 20:18:39 | 1378201 | 19418348 | hadcm3n_xdft_198012_480_374_010412802_0 | 155,520 | 142,581 | 0.9168 |
©2024 cpdn.org