Name | hadcm3n_u18h_1980_40_007682174_0 |
Workunit | 7837261 |
Created | 15 Jan 2012, 21:58:47 UTC |
Sent | 15 Jan 2012, 21:58:54 UTC |
Report deadline | 16 Apr 2012, 5:26:05 UTC |
Received | 4 Mar 2012, 19:07:29 UTC |
Server state | Over |
Outcome | Computation error |
Client state | Compute error |
Exit status | 22 (0x00000016) Unknown error code |
Computer ID | 1191378 |
Run time | 10 days 21 hours 36 min 49 sec |
CPU time | 10 days 9 hours 27 min 34 sec |
Validate state | Invalid |
Credit | 8,398.08 |
Device peak FLOPS | 3.17 GFLOPS |
Application version | UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin |
Stderr | <core_client_version>6.12.35</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(10958,0xac5de2c0) malloc: *** error for object 0xa26800: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(10958,0xac5de2c0) malloc: *** error for object 0xa26804: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(10958,0xac5de2c0) malloc: *** error for object 0xa26800: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(10958,0xac5de2c0) malloc: *** error for object 0xa26804: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(10958,0xac5de2c0) malloc: *** error for object 0xa26800: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(10958,0xac5de2c0) malloc: *** error for object 0xa26804: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(10958,0xac5de2c0) malloc: *** error for object 0xa26800: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(10958,0xac5de2c0) malloc: *** error for object 0xa26804: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(10958,0xac5de2c0) malloc: *** error for object 0xa26800: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(15562,0xac5de2c0) malloc: *** error for object 0x9e7804: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.7.2 build 11C74 Sat Feb 4 23:25:42 2012 Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=15565, selfPID=15565, iMonCtr=1 hadcm3n_6.07_i686-apple-darwin(16341,0xac5de2c0) malloc: *** error for object 0x11eac04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(16341,0xac5de2c0) malloc: *** error for object 0x11eac00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(16341,0xac5de2c0) malloc: *** error for object 0x9cdc04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(16341,0xac5de2c0) malloc: *** error for object 0x9cea00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(99409,0xac5de2c0) malloc: *** error for object 0xbda804: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(99409,0xac5de2c0) malloc: *** error for object 0xbda800: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(99409,0xac5de2c0) malloc: *** error for object 0x1bb6604: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(99409,0xac5de2c0) malloc: *** error for object 0x1bb6600: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(99409,0xac5de2c0) malloc: *** error for object 0x1bb6604: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(99409,0xac5de2c0) malloc: *** error for object 0x1bb6600: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(99409,0xac5de2c0) malloc: *** error for object 0x1bb6604: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(99409,0xac5de2c0) malloc: *** error for object 0x1bb6600: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(99409,0xac5de2c0) malloc: *** error for object 0x1bb6604: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(12115,0xac5de2c0) malloc: *** error for object 0x1b1a404: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(12115,0xac5de2c0) malloc: *** error for object 0x1b1a400: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(12115,0xac5de2c0) malloc: *** error for object 0xafbc00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation 10:00:14 (12115): No heartbeat from core client for 30 sec - exiting 10:00:15 (12115): No heartbeat from core client for 30 sec - exiting 10:00:16 (12115): No heartbeat from core client for 30 sec - exiting 10:00:17 (12115): No heartbeat from core client for 30 sec - exiting 10:00:18 (12115): No heartbeat from core client for 30 sec - exiting 10:00:19 (12115): No heartbeat from core client for 30 sec - exiting 10:00:20 (12115): No heartbeat from core client for 30 sec - exiting 10:00:21 (12115): No heartbeat from core client for 30 sec - exiting 10:00:22 (12115): No heartbeat from core client for 30 sec - exiting 10:00:23 (12115): No heartbeat from core client for 30 sec - exiting 10:00:24 (12115): No heartbeat from core client for 30 sec - exiting 10:00:25 (12115): No heartbeat from core client for 30 sec - exiting 10:00:26 (12115): No heartbeat from core client for 30 sec - exiting 10:00:27 (12115): No heartbeat from core client for 30 sec - exiting 10:00:29 (12115): No heartbeat from core client for 30 sec - exiting 10:00:30 (12115): No heartbeat from core client for 30 sec - exiting 10:00:32 (12115): No heartbeat from core client for 30 sec - exiting 10:00:33 (12115): No heartbeat from core client for 30 sec - exiting 10:00:35 (12115): No heartbeat from core client for 30 sec - exiting 10:00:36 (12115): No heartbeat from core client for 30 sec - exiting 10:00:37 (12115): No heartbeat from core client for 30 sec - exiting 10:00:39 (12115): No heartbeat from core client for 30 sec - exiting 10:00:42 (12115): No heartbeat from core client for 30 sec - exiting 10:00:44 (12115): No heartbeat from core client for 30 sec - exiting 10:00:47 (12115): No heartbeat from core client for 30 sec - exiting 10:00:48 (12115): No heartbeat from core client for 30 sec - exiting 10:00:49 (12115): No heartbeat from core client for 30 sec - exiting 10:00:51 (12115): No heartbeat from core client for 30 sec - exiting 10:00:52 (12115): No heartbeat from core client for 30 sec - exiting 10:00:53 (12115): No heartbeat from core client for 30 sec - exiting 10:00:54 (12115): No heartbeat from core client for 30 sec - exiting 10:00:55 (12115): No heartbeat from core client for 30 sec - exiting 10:00:56 (12115): No heartbeat from core client for 30 sec - exiting 10:00:57 (12115): No heartbeat from core client for 30 sec - exiting 10:00:58 (12115): No heartbeat from core client for 30 sec - exiting 10:00:59 (12115): No heartbeat from core client for 30 sec - exiting 10:01:00 (12115): No heartbeat from core client for 30 sec - exiting 10:01:01 (12115): No heartbeat from core client for 30 sec - exiting 10:01:02 (12115): No heartbeat from core client for 30 sec - exiting 10:01:03 (12115): No heartbeat from core client for 30 sec - exiting 10:01:04 (12115): No heartbeat from core client for 30 sec - exiting 10:01:05 (12115): No heartbeat from core client for 30 sec - exiting 10:01:06 (12115): No heartbeat from core client for 30 sec - exiting 10:01:07 (12115): No heartbeat from core client for 30 sec - exiting 10:01:09 (12115): No heartbeat from core client for 30 sec - exiting 10:01:10 (12115): No heartbeat from core client for 30 sec - exiting 10:01:11 (12115): No heartbeat from core client for 30 sec - exiting 10:01:12 (12115): No heartbeat from core client for 30 sec - exiting 10:01:13 (12115): No heartbeat from core client for 30 sec - exiting 10:01:14 (12115): No heartbeat from core client for 30 sec - exiting 10:01:15 (12115): No heartbeat from core client for 30 sec - exiting 10:01:16 (12115): No heartbeat from core client for 30 sec - exiting 10:01:17 (12115): No heartbeat from core client for 30 sec - exiting 10:01:18 (12115): No heartbeat from core client for 30 sec - exiting 10:01:19 (12115): No heartbeat from core client for 30 sec - exiting 10:01:20 (12115): No heartbeat from core client for 30 sec - exiting 10:01:21 (12115): No heartbeat from core client for 30 sec - exiting 10:01:22 (12115): No heartbeat from core client for 30 sec - exiting 10:01:23 (12115): No heartbeat from core client for 30 sec - exiting 10:01:24 (12115): No heartbeat from core client for 30 sec - exiting 10:01:25 (12115): No heartbeat from core client for 30 sec - exiting 10:01:26 (12115): No heartbeat from core client for 30 sec - exiting 10:01:27 (12115): No heartbeat from core client for 30 sec - exiting 10:01:28 (12115): No heartbeat from core client for 30 sec - exiting 10:01:29 (12115): No heartbeat from core client for 30 sec - exiting 10:01:30 (12115): No heartbeat from core client for 30 sec - exiting 10:01:31 (12115): No heartbeat from core client for 30 sec - exiting 10:01:32 (12115): No heartbeat from core client for 30 sec - exiting 10:01:33 (12115): No heartbeat from core client for 30 sec - exiting 10:01:35 (12115): No heartbeat from core client for 30 sec - exiting 10:01:36 (12115): No heartbeat from core client for 30 sec - exiting 10:01:37 (12115): No heartbeat from core client for 30 sec - exiting 10:01:38 (12115): No heartbeat from core client for 30 sec - exiting 10:01:39 (12115): No heartbeat from core client for 30 sec - exiting 10:01:40 (12115): No heartbeat from core client for 30 sec - exiting 10:01:41 (12115): No heartbeat from core client for 30 sec - exiting 10:01:42 (12115): No heartbeat from core client for 30 sec - exiting 10:01:43 (12115): No heartbeat from core client for 30 sec - exiting 10:01:44 (12115): No heartbeat from core client for 30 sec - exiting 10:01:45 (12115): No heartbeat from core client for 30 sec - exiting 10:01:46 (12115): No heartbeat from core client for 30 sec - exiting 10:01:47 (12115): No heartbeat from core client for 30 sec - exiting 10:01:48 (12115): No heartbeat from core client for 30 sec - exiting 10:01:49 (12115): No heartbeat from core client for 30 sec - exiting 10:01:50 (12115): No heartbeat from core client for 30 sec - exiting 10:01:51 (12115): No heartbeat from core client for 30 sec - exiting 10:01:52 (12115): No heartbeat from core client for 30 sec - exiting 10:01:53 (12115): No heartbeat from core client for 30 sec - exiting 10:01:54 (12115): No heartbeat from core client for 30 sec - exiting 10:01:55 (12115): No heartbeat from core client for 30 sec - exiting 10:01:56 (12115): No heartbeat from core client for 30 sec - exiting 10:01:57 (12115): No heartbeat from core client for 30 sec - exiting 10:01:58 (12115): No heartbeat from core client for 30 sec - exiting 10:01:59 (12115): No heartbeat from core client for 30 sec - exiting 10:02:00 (12115): No heartbeat from core client for 30 sec - exiting 10:02:01 (12115): No heartbeat from core client for 30 sec - exiting 10:02:02 (12115): No heartbeat from core client for 30 sec - exiting 10:02:03 (12115): No heartbeat from core client for 30 sec - exiting 10:02:04 (12115): No heartbeat from core client for 30 sec - exiting 10:02:05 (12115): No heartbeat from core client for 30 sec - exiting 10:02:06 (12115): No heartbeat from core client for 30 sec - exiting 10:02:07 (12115): No heartbeat from core client for 30 sec - exiting 10:02:08 (12115): No heartbeat from core client for 30 sec - exiting 10:02:09 (12115): No heartbeat from core client for 30 sec - exiting 10:02:10 (12115): No heartbeat from core client for 30 sec - exiting 10:02:11 (12115): No heartbeat from core client for 30 sec - exiting 10:02:12 (12115): No heartbeat from core client for 30 sec - exiting 10:02:13 (12115): No heartbeat from core client for 30 sec - exiting 10:02:14 (12115): No heartbeat from core client for 30 sec - exiting 10:02:15 (12115): No heartbeat from core client for 30 sec - exiting 10:02:16 (12115): No heartbeat from core client for 30 sec - exiting 10:02:17 (12115): No heartbeat from core client for 30 sec - exiting 10:02:18 (12115): No heartbeat from core client for 30 sec - exiting 10:02:19 (12115): No heartbeat from core client for 30 sec - exiting 10:02:20 (12115): No heartbeat from core client for 30 sec - exiting 10:02:21 (12115): No heartbeat from core client for 30 sec - exiting 10:02:22 (12115): No heartbeat from core client for 30 sec - exiting 10:02:24 (12115): No heartbeat from core client for 30 sec - exiting 10:02:25 (12115): No heartbeat from core client for 30 sec - exiting 10:02:26 (12115): No heartbeat from core client for 30 sec - exiting 10:02:27 (12115): No heartbeat from core client for 30 sec - exiting 10:02:28 (12115): No heartbeat from core client for 30 sec - exiting 10:02:29 (12115): No heartbeat from core client for 30 sec - exiting 10:02:30 (12115): No heartbeat from core client for 30 sec - exiting 10:02:31 (12115): No heartbeat from core client for 30 sec - exiting 10:02:32 (12115): No heartbeat from core client for 30 sec - exiting 10:02:33 (12115): No heartbeat from core client for 30 sec - exiting 10:02:34 (12115): No heartbeat from core client for 30 sec - exiting 10:02:35 (12115): No heartbeat from core client for 30 sec - exiting 10:02:36 (12115): No heartbeat from core client for 30 sec - exiting 10:02:37 (12115): No heartbeat from core client for 30 sec - exiting 10:02:38 (12115): No heartbeat from core client for 30 sec - exiting 10:02:39 (12115): No heartbeat from core client for 30 sec - exiting 10:02:40 (12115): No heartbeat from core client for 30 sec - exiting 10:02:41 (12115): No heartbeat from core client for 30 sec - exiting 10:02:42 (12115): No heartbeat from core client for 30 sec - exiting 10:02:43 (12115): No heartbeat from core client for 30 sec - exiting 10:02:44 (12115): No heartbeat from core client for 30 sec - exiting 10:02:45 (12115): No heartbeat from core client for 30 sec - exiting 10:02:46 (12115): No heartbeat from core client for 30 sec - exiting 10:02:47 (12115): No heartbeat from core client for 30 sec - exiting 10:02:48 (12115): No heartbeat from core client for 30 sec - exiting 10:02:49 (12115): No heartbeat from core client for 30 sec - exiting 10:02:50 (12115): No heartbeat from core client for 30 sec - exiting 10:02:51 (12115): No heartbeat from core client for 30 sec - exiting 10:02:52 (12115): No heartbeat from core client for 30 sec - exiting 10:02:53 (12115): No heartbeat from core client for 30 sec - exiting 10:02:54 (12115): No heartbeat from core client for 30 sec - exiting 10:02:55 (12115): No heartbeat from core client for 30 sec - exiting 10:02:56 (12115): No heartbeat from core client for 30 sec - exiting 10:02:57 (12115): No heartbeat from core client for 30 sec - exiting 10:02:58 (12115): No heartbeat from core client for 30 sec - exiting 10:02:59 (12115): No heartbeat from core client for 30 sec - exiting 10:03:00 (12115): No heartbeat from core client for 30 sec - exiting 10:03:01 (12115): No heartbeat from core client for 30 sec - exiting 10:03:02 (12115): No heartbeat from core client for 30 sec - exiting 10:03:03 (12115): No heartbeat from core client for 30 sec - exiting 10:03:04 (12115): No heartbeat from core client for 30 sec - exiting 10:03:05 (12115): No heartbeat from core client for 30 sec - exiting 10:03:06 (12115): No heartbeat from core client for 30 sec - exiting 10:03:07 (12115): No heartbeat from core client for 30 sec - exiting 10:03:08 (12115): No heartbeat from core client for 30 sec - exiting 10:03:09 (12115): No heartbeat from core client for 30 sec - exiting 10:03:10 (12115): No heartbeat from core client for 30 sec - exiting 10:03:11 (12115): No heartbeat from core client for 30 sec - exiting 10:03:12 (12115): No heartbeat from core client for 30 sec - exiting 10:03:13 (12115): No heartbeat from core client for 30 sec - exiting 10:03:14 (12115): No heartbeat from core client for 30 sec - exiting 10:03:15 (12115): No heartbeat from core client for 30 sec - exiting 10:03:16 (12115): No heartbeat from core client for 30 sec - exiting 10:03:17 (12115): No heartbeat from core client for 30 sec - exiting 10:03:18 (12115): No heartbeat from core client for 30 sec - exiting 10:03:19 (12115): No heartbeat from core client for 30 sec - exiting 10:03:20 (12115): No heartbeat from core client for 30 sec - exiting 10:03:21 (12115): No heartbeat from core client for 30 sec - exiting 10:03:22 (12115): No heartbeat from core client for 30 sec - exiting 10:03:23 (12115): No heartbeat from core client for 30 sec - exiting 10:03:24 (12115): No heartbeat from core client for 30 sec - exiting 10:03:25 (12115): No heartbeat from core client for 30 sec - exiting 10:03:26 (12115): No heartbeat from core client for 30 sec - exiting 10:03:27 (12115): No heartbeat from core client for 30 sec - exiting 10:03:28 (12115): No heartbeat from core client for 30 sec - exiting 10:03:29 (12115): No heartbeat from core client for 30 sec - exiting 10:03:30 (12115): No heartbeat from core client for 30 sec - exiting 10:03:32 (12115): No heartbeat from core client for 30 sec - exiting 10:03:33 (12115): No heartbeat from core client for 30 sec - exiting 10:03:34 (12115): No heartbeat from core client for 30 sec - exiting 10:03:35 (12115): No heartbeat from core client for 30 sec - exiting 10:03:36 (12115): No heartbeat from core client for 30 sec - exiting 10:03:37 (12115): No heartbeat from core client for 30 sec - exiting 10:03:38 (12115): No heartbeat from core client for 30 sec - exiting 10:03:39 (12115): No heartbeat from core client for 30 sec - exiting 10:03:40 (12115): No heartbeat from core client for 30 sec - exiting 10:03:41 (12115): No heartbeat from core client for 30 sec - exiting 10:03:42 (12115): No heartbeat from core client for 30 sec - exiting 10:03:43 (12115): No heartbeat from core client for 30 sec - exiting 10:03:44 (12115): No heartbeat from core client for 30 sec - exiting 10:03:45 (12115): No heartbeat from core client for 30 sec - exiting 10:03:46 (12115): No heartbeat from core client for 30 sec - exiting 10:03:47 (12115): No heartbeat from core client for 30 sec - exiting 10:03:48 (12115): No heartbeat from core client for 30 sec - exiting 10:03:49 (12115): No heartbeat from core client for 30 sec - exiting 10:03:50 (12115): No heartbeat from core client for 30 sec - exiting 10:03:51 (12115): No heartbeat from core client for 30 sec - exiting 10:03:52 (12115): No heartbeat from core client for 30 sec - exiting 10:03:53 (12115): No heartbeat from core client for 30 sec - exiting 10:03:54 (12115): No heartbeat from core client for 30 sec - exiting 10:03:55 (12115): No heartbeat from core client for 30 sec - exiting 10:03:56 (12115): No heartbeat from core client for 30 sec - exiting 10:03:57 (12115): No heartbeat from core client for 30 sec - exiting 10:03:58 (12115): No heartbeat from core client for 30 sec - exiting 10:03:59 (12115): No heartbeat from core client for 30 sec - exiting 10:04:00 (12115): No heartbeat from core client for 30 sec - exiting 10:04:01 (12115): No heartbeat from core client for 30 sec - exiting 10:04:02 (12115): No heartbeat from core client for 30 sec - exiting 10:04:03 (12115): No heartbeat from core client for 30 sec - exiting 10:04:04 (12115): No heartbeat from core client for 30 sec - exiting 10:04:05 (12115): No heartbeat from core client for 30 sec - exiting 10:04:06 (12115): No heartbeat from core client for 30 sec - exiting 10:04:07 (12115): No heartbeat from core client for 30 sec - exiting 10:04:08 (12115): No heartbeat from core client for 30 sec - exiting 10:04:09 (12115): No heartbeat from core client for 30 sec - exiting 10:04:10 (12115): No heartbeat from core client for 30 sec - exiting 10:04:11 (12115): No heartbeat from core client for 30 sec - exiting 10:04:12 (12115): No heartbeat from core client for 30 sec - exiting 10:04:13 (12115): No heartbeat from core client for 30 sec - exiting 10:04:14 (12115): No heartbeat from core client for 30 sec - exiting 10:04:15 (12115): No heartbeat from core client for 30 sec - exiting 10:04:16 (12115): No heartbeat from core client for 30 sec - exiting 10:04:17 (12115): No heartbeat from core client for 30 sec - exiting 10:04:18 (12115): No heartbeat from core client for 30 sec - exiting 10:04:19 (12115): No heartbeat from core client for 30 sec - exiting 10:04:20 (12115): No heartbeat from core client for 30 sec - exiting 10:04:21 (12115): No heartbeat from core client for 30 sec - exiting 10:04:22 (12115): No heartbeat from core client for 30 sec - exiting 10:04:23 (12115): No heartbeat from core client for 30 sec - exiting 10:04:24 (12115): No heartbeat from core client for 30 sec - exiting 10:04:25 (12115): No heartbeat from core client for 30 sec - exiting 10:04:26 (12115): No heartbeat from core client for 30 sec - exiting 10:04:27 (12115): No heartbeat from core client for 30 sec - exiting 10:04:28 (12115): No heartbeat from core client for 30 sec - exiting 10:04:29 (12115): No heartbeat from core client for 30 sec - exiting 10:04:30 (12115): No heartbeat from core client for 30 sec - exiting 10:04:32 (12115): No heartbeat from core client for 30 sec - exiting 10:04:33 (12115): No heartbeat from core client for 30 sec - exiting 10:04:34 (12115): No heartbeat from core client for 30 sec - exiting 10:04:35 (12115): No heartbeat from core client for 30 sec - exiting 10:04:36 (12115): No heartbeat from core client for 30 sec - exiting 10:04:38 (12115): No heartbeat from core client for 30 sec - exiting 10:04:39 (12115): No heartbeat from core client for 30 sec - exiting 10:04:40 (12115): No heartbeat from core client for 30 sec - exiting 10:04:41 (12115): No heartbeat from core client for 30 sec - exiting 10:04:42 (12115): No heartbeat from core client for 30 sec - exiting 10:04:43 (12115): No heartbeat from core client for 30 sec - exiting 10:04:44 (12115): No heartbeat from core client for 30 sec - exiting 10:04:45 (12115): No heartbeat from core client for 30 sec - exiting 10:04:46 (12115): No heartbeat from core client for 30 sec - exiting 10:04:47 (12115): No heartbeat from core client for 30 sec - exiting 10:04:48 (12115): No heartbeat from core client for 30 sec - exiting 10:04:49 (12115): No heartbeat from core client for 30 sec - exiting 10:04:50 (12115): No heartbeat from core client for 30 sec - exiting 10:04:51 (12115): No heartbeat from core client for 30 sec - exiting 10:04:52 (12115): No heartbeat from core client for 30 sec - exiting 10:04:53 (12115): No heartbeat from core client for 30 sec - exiting 10:04:54 (12115): No heartbeat from core client for 30 sec - exiting 10:04:55 (12115): No heartbeat from core client for 30 sec - exiting 10:04:56 (12115): No heartbeat from core client for 30 sec - exiting 10:04:57 (12115): No heartbeat from core client for 30 sec - exiting 10:04:58 (12115): No heartbeat from core client for 30 sec - exiting 10:04:59 (12115): No heartbeat from core client for 30 sec - exiting 10:05:00 (12115): No heartbeat from core client for 30 sec - exiting 10:05:01 (12115): No heartbeat from core client for 30 sec - exiting 10:05:02 (12115): No heartbeat from core client for 30 sec - exiting 10:05:03 (12115): No heartbeat from core client for 30 sec - exiting 10:05:04 (12115): No heartbeat from core client for 30 sec - exiting 10:05:05 (12115): No heartbeat from core client for 30 sec - exiting 10:05:06 (12115): No heartbeat from core client for 30 sec - exiting 10:05:07 (12115): No heartbeat from core client for 30 sec - exiting 10:05:08 (12115): No heartbeat from core client for 30 sec - exiting 10:05:09 (12115): No heartbeat from core client for 30 sec - exiting 10:05:10 (12115): No heartbeat from core client for 30 sec - exiting 10:05:11 (12115): No heartbeat from core client for 30 sec - exiting 10:05:12 (12115): No heartbeat from core client for 30 sec - exiting 10:05:13 (12115): No heartbeat from core client for 30 sec - exiting 10:05:14 (12115): No heartbeat from core client for 30 sec - exiting 10:05:15 (12115): No heartbeat from core client for 30 sec - exiting 10:05:16 (12115): No heartbeat from core client for 30 sec - exiting 10:05:17 (12115): No heartbeat from core client for 30 sec - exiting 10:05:18 (12115): No heartbeat from core client for 30 sec - exiting 10:05:19 (12115): No heartbeat from core client for 30 sec - exiting 10:05:20 (12115): No heartbeat from core client for 30 sec - exiting 10:05:21 (12115): No heartbeat from core client for 30 sec - exiting 10:05:22 (12115): No heartbeat from core client for 30 sec - exiting 10:05:23 (12115): No heartbeat from core client for 30 sec - exiting 10:05:24 (12115): No heartbeat from core client for 30 sec - exiting 10:05:25 (12115): No heartbeat from core client for 30 sec - exiting 10:05:26 (12115): No heartbeat from core client for 30 sec - exiting 10:05:27 (12115): No heartbeat from core client for 30 sec - exiting 10:05:28 (12115): No heartbeat from core client for 30 sec - exiting 10:05:29 (12115): No heartbeat from core client for 30 sec - exiting 10:05:30 (12115): No heartbeat from core client for 30 sec - exiting 10:05:31 (12115): No heartbeat from core client for 30 sec - exiting 10:05:32 (12115): No heartbeat from core client for 30 sec - exiting 10:05:33 (12115): No heartbeat from core client for 30 sec - exiting 10:05:34 (12115): No heartbeat from core client for 30 sec - exiting 10:05:35 (12115): No heartbeat from core client for 30 sec - exiting 10:05:36 (12115): No heartbeat from core client for 30 sec - exiting 10:05:37 (12115): No heartbeat from core client for 30 sec - exiting 10:05:38 (12115): No heartbeat from core client for 30 sec - exiting 10:05:39 (12115): No heartbeat from core client for 30 sec - exiting 10:05:40 (12115): No heartbeat from core client for 30 sec - exiting 10:05:41 (12115): No heartbeat from core client for 30 sec - exiting 10:05:42 (12115): No heartbeat from core client for 30 sec - exiting 10:05:43 (12115): No heartbeat from core client for 30 sec - exiting 10:05:44 (12115): No heartbeat from core client for 30 sec - exiting 10:05:45 (12115): No heartbeat from core client for 30 sec - exiting 10:05:46 (12115): No heartbeat from core client for 30 sec - exiting 10:05:47 (12115): No heartbeat from core client for 30 sec - exiting 10:05:48 (12115): No heartbeat from core client for 30 sec - exiting 10:05:49 (12115): No heartbeat from core client for 30 sec - exiting 10:05:50 (12115): No heartbeat from core client for 30 sec - exiting 10:05:51 (12115): No heartbeat from core client for 30 sec - exiting 10:05:52 (12115): No heartbeat from core client for 30 sec - exiting 10:05:53 (12115): No heartbeat from core client for 30 sec - exiting 10:05:54 (12115): No heartbeat from core client for 30 sec - exiting 10:05:55 (12115): No heartbeat from core client for 30 sec - exiting 10:05:56 (12115): No heartbeat from core client for 30 sec - exiting 10:05:57 (12115): No heartbeat from core client for 30 sec - exiting 10:05:58 (12115): No heartbeat from core client for 30 sec - exiting 10:05:59 (12115): No heartbeat from core client for 30 sec - exiting 10:06:01 (12115): No heartbeat from core client for 30 sec - exiting 10:06:02 (12115): No heartbeat from core client for 30 sec - exiting 10:06:03 (12115): No heartbeat from core client for 30 sec - exiting 10:06:04 (12115): No heartbeat from core client for 30 sec - exiting 10:06:05 (12115): No heartbeat from core client for 30 sec - exiting 10:06:06 (12115): No heartbeat from core client for 30 sec - exiting 10:06:07 (12115): No heartbeat from core client for 30 sec - exiting 10:06:08 (12115): No heartbeat from core client for 30 sec - exiting 10:06:09 (12115): No heartbeat from core client for 30 sec - exiting 10:06:10 (12115): No heartbeat from core client for 30 sec - exiting 10:06:11 (12115): No heartbeat from core client for 30 sec - exiting 10:06:12 (12115): No heartbeat from core client for 30 sec - exiting 10:06:13 (12115): No heartbeat from core client for 30 sec - exiting 10:06:14 (12115): No heartbeat from core client for 30 sec - exiting 10:06:15 (12115): No heartbeat from core client for 30 sec - exiting 10:06:16 (12115): No heartbeat from core client for 30 sec - exiting 10:06:17 (12115): No heartbeat from core client for 30 sec - exiting 10:06:18 (12115): No heartbeat from core client for 30 sec - exiting 10:06:19 (12115): No heartbeat from core client for 30 sec - exiting 10:06:20 (12115): No heartbeat from core client for 30 sec - exiting 10:06:21 (12115): No heartbeat from core client for 30 sec - exiting 10:06:22 (12115): No heartbeat from core client for 30 sec - exiting 10:06:23 (12115): No heartbeat from core client for 30 sec - exiting 10:06:24 (12115): No heartbeat from core client for 30 sec - exiting 10:06:25 (12115): No heartbeat from core client for 30 sec - exiting 10:06:26 (12115): No heartbeat from core client for 30 sec - exiting 10:06:27 (12115): No heartbeat from core client for 30 sec - exiting 10:06:28 (12115): No heartbeat from core client for 30 sec - exiting 10:06:29 (12115): No heartbeat from core client for 30 sec - exiting 10:06:30 (12115): No heartbeat from core client for 30 sec - exiting 10:06:31 (12115): No heartbeat from core client for 30 sec - exiting 10:06:32 (12115): No heartbeat from core client for 30 sec - exiting 10:06:33 (12115): No heartbeat from core client for 30 sec - exiting 10:06:34 (12115): No heartbeat from core client for 30 sec - exiting 10:06:35 (12115): No heartbeat from core client for 30 sec - exiting 10:06:36 (12115): No heartbeat from core client for 30 sec - exiting 10:06:37 (12115): No heartbeat from core client for 30 sec - exiting 10:06:38 (12115): No heartbeat from core client for 30 sec - exiting 10:06:39 (12115): No heartbeat from core client for 30 sec - exiting 10:06:40 (12115): No heartbeat from core client for 30 sec - exiting 10:06:41 (12115): No heartbeat from core client for 30 sec - exiting 10:06:42 (12115): No heartbeat from core client for 30 sec - exiting 10:06:43 (12115): No heartbeat from core client for 30 sec - exiting 10:06:44 (12115): No heartbeat from core client for 30 sec - exiting 10:06:45 (12115): No heartbeat from core client for 30 sec - exiting 10:06:46 (12115): No heartbeat from core client for 30 sec - exiting 10:06:47 (12115): No heartbeat from core client for 30 sec - exiting 10:06:48 (12115): No heartbeat from core client for 30 sec - exiting 10:06:49 (12115): No heartbeat from core client for 30 sec - exiting 10:06:50 (12115): No heartbeat from core client for 30 sec - exiting 10:06:51 (12115): No heartbeat from core client for 30 sec - exiting 10:06:52 (12115): No heartbeat from core client for 30 sec - exiting 10:06:53 (12115): No heartbeat from core client for 30 sec - exiting 10:06:54 (12115): No heartbeat from core client for 30 sec - exiting 10:06:55 (12115): No heartbeat from core client for 30 sec - exiting 10:06:56 (12115): No heartbeat from core client for 30 sec - exiting 10:06:57 (12115): No heartbeat from core client for 30 sec - exiting 10:06:58 (12115): No heartbeat from core client for 30 sec - exiting 10:06:59 (12115): No heartbeat from core client for 30 sec - exiting 10:07:00 (12115): No heartbeat from core client for 30 sec - exiting 10:07:01 (12115): No heartbeat from core client for 30 sec - exiting 10:07:02 (12115): No heartbeat from core client for 30 sec - exiting 10:07:03 (12115): No heartbeat from core client for 30 sec - exiting 10:07:04 (12115): No heartbeat from core client for 30 sec - exiting 10:07:05 (12115): No heartbeat from core client for 30 sec - exiting 10:07:06 (12115): No heartbeat from core client for 30 sec - exiting 10:07:07 (12115): No heartbeat from core client for 30 sec - exiting 10:07:08 (12115): No heartbeat from core client for 30 sec - exiting 10:07:09 (12115): No heartbeat from core client for 30 sec - exiting 10:07:10 (12115): No heartbeat from core client for 30 sec - exiting 10:07:11 (12115): No heartbeat from core client for 30 sec - exiting 10:07:12 (12115): No heartbeat from core client for 30 sec - exiting 10:07:13 (12115): No heartbeat from core client for 30 sec - exiting 10:07:14 (12115): No heartbeat from core client for 30 sec - exiting 10:07:15 (12115): No heartbeat from core client for 30 sec - exiting 10:07:16 (12115): No heartbeat from core client for 30 sec - exiting 10:07:17 (12115): No heartbeat from core client for 30 sec - exiting 10:07:18 (12115): No heartbeat from core client for 30 sec - exiting 10:07:19 (12115): No heartbeat from core client for 30 sec - exiting 10:07:20 (12115): No heartbeat from core client for 30 sec - exiting 10:07:21 (12115): No heartbeat from core client for 30 sec - exiting 10:07:22 (12115): No heartbeat from core client for 30 sec - exiting 10:07:23 (12115): No heartbeat from core client for 30 sec - exiting 10:07:24 (12115): No heartbeat from core client for 30 sec - exiting 10:07:25 (12115): No heartbeat from core client for 30 sec - exiting 10:07:26 (12115): No heartbeat from core client for 30 sec - exiting 10:07:27 (12115): No heartbeat from core client for 30 sec - exiting 10:07:28 (12115): No heartbeat from core client for 30 sec - exiting 10:07:29 (12115): No heartbeat from core client for 30 sec - exiting 10:07:30 (12115): No heartbeat from core client for 30 sec - exiting 10:07:31 (12115): No heartbeat from core client for 30 sec - exiting 10:07:32 (12115): No heartbeat from core client for 30 sec - exiting 10:07:33 (12115): No heartbeat from core client for 30 sec - exiting 10:07:34 (12115): No heartbeat from core client for 30 sec - exiting 10:07:35 (12115): No heartbeat from core client for 30 sec - exiting 10:07:36 (12115): No heartbeat from core client for 30 sec - exiting 10:07:37 (12115): No heartbeat from core client for 30 sec - exiting 10:07:38 (12115): No heartbeat from core client for 30 sec - exiting 10:07:40 (12115): No heartbeat from core client for 30 sec - exiting 10:07:41 (12115): No heartbeat from core client for 30 sec - exiting 10:07:42 (12115): No heartbeat from core client for 30 sec - exiting 10:07:43 (12115): No heartbeat from core client for 30 sec - exiting 10:07:44 (12115): No heartbeat from core client for 30 sec - exiting 10:07:45 (12115): No heartbeat from core client for 30 sec - exiting 10:07:46 (12115): No heartbeat from core client for 30 sec - exiting 10:07:47 (12115): No heartbeat from core client for 30 sec - exiting 10:07:48 (12115): No heartbeat from core client for 30 sec - exiting 10:07:49 (12115): No heartbeat from core client for 30 sec - exiting 10:07:50 (12115): No heartbeat from core client for 30 sec - exiting 10:07:51 (12115): No heartbeat from core client for 30 sec - exiting 10:07:52 (12115): No heartbeat from core client for 30 sec - exiting 10:07:53 (12115): No heartbeat from core client for 30 sec - exiting 10:07:54 (12115): No heartbeat from core client for 30 sec - exiting 10:07:55 (12115): No heartbeat from core client for 30 sec - exiting 10:07:56 (12115): No heartbeat from core client for 30 sec - exiting 10:07:57 (12115): No heartbeat from core client for 30 sec - exiting 10:07:58 (12115): No heartbeat from core client for 30 sec - exiting 10:07:59 (12115): No heartbeat from core client for 30 sec - exiting 10:08:00 (12115): No heartbeat from core client for 30 sec - exiting 10:08:01 (12115): No heartbeat from core client for 30 sec - exiting 10:08:02 (12115): No heartbeat from core client for 30 sec - exiting 10:08:03 (12115): No heartbeat from core client for 30 sec - exiting 10:08:04 (12115): No heartbeat from core client for 30 sec - exiting 10:08:05 (12115): No heartbeat from core client for 30 sec - exiting 10:08:06 (12115): No heartbeat from core client for 30 sec - exiting 10:08:07 (12115): No heartbeat from core client for 30 sec - exiting 10:08:08 (12115): No heartbeat from core client for 30 sec - exiting 10:08:09 (12115): No heartbeat from core client for 30 sec - exiting 10:08:10 (12115): No heartbeat from core client for 30 sec - exiting 10:08:11 (12115): No heartbeat from core client for 30 sec - exiting 10:08:12 (12115): No heartbeat from core client for 30 sec - exiting 10:08:13 (12115): No heartbeat from core client for 30 sec - exiting 10:08:14 (12115): No heartbeat from core client for 30 sec - exiting 10:08:15 (12115): No heartbeat from core client for 30 sec - exiting 10:08:16 (12115): No heartbeat from core client for 30 sec - exiting 10:08:17 (12115): No heartbeat from core client for 30 sec - exiting 10:08:18 (12115): No heartbeat from core client for 30 sec - exiting 10:08:19 (12115): No heartbeat from core client for 30 sec - exiting 10:08:20 (12115): No heartbeat from core client for 30 sec - exiting 10:08:21 (12115): No heartbeat from core client for 30 sec - exiting 10:08:22 (12115): No heartbeat from core client for 30 sec - exiting 10:08:23 (12115): No heartbeat from core client for 30 sec - exiting 10:08:24 (12115): No heartbeat from core client for 30 sec - exiting 10:08:25 (12115): No heartbeat from core client for 30 sec - exiting 10:08:26 (12115): No heartbeat from core client for 30 sec - exiting 10:08:27 (12115): No heartbeat from core client for 30 sec - exiting 10:08:28 (12115): No heartbeat from core client for 30 sec - exiting 10:08:29 (12115): No heartbeat from core client for 30 sec - exiting 10:08:30 (12115): No heartbeat from core client for 30 sec - exiting 10:08:31 (12115): No heartbeat from core client for 30 sec - exiting 10:08:32 (12115): No heartbeat from core client for 30 sec - exiting 10:08:33 (12115): No heartbeat from core client for 30 sec - exiting 10:08:34 (12115): No heartbeat from core client for 30 sec - exiting 10:08:35 (12115): No heartbeat from core client for 30 sec - exiting 10:08:36 (12115): No heartbeat from core client for 30 sec - exiting 10:08:37 (12115): No heartbeat from core client for 30 sec - exiting 10:08:38 (12115): No heartbeat from core client for 30 sec - exiting 10:08:39 (12115): No heartbeat from core client for 30 sec - exiting 10:08:40 (12115): No heartbeat from core client for 30 sec - exiting 10:08:41 (12115): No heartbeat from core client for 30 sec - exiting 10:08:42 (12115): No heartbeat from core client for 30 sec - exiting 10:08:43 (12115): No heartbeat from core client for 30 sec - exiting 10:08:44 (12115): No heartbeat from core client for 30 sec - exiting 10:08:45 (12115): No heartbeat from core client for 30 sec - exiting 10:08:46 (12115): No heartbeat from core client for 30 sec - exiting 10:08:47 (12115): No heartbeat from core client for 30 sec - exiting 10:08:48 (12115): No heartbeat from core client for 30 sec - exiting 10:08:49 (12115): No heartbeat from core client for 30 sec - exiting 10:08:50 (12115): No heartbeat from core client for 30 sec - exiting 10:08:51 (12115): No heartbeat from core client for 30 sec - exiting 10:08:52 (12115): No heartbeat from core client for 30 sec - exiting 10:08:53 (12115): No heartbeat from core client for 30 sec - exiting 10:08:54 (12115): No heartbeat from core client for 30 sec - exiting 10:08:55 (12115): No heartbeat from core client for 30 sec - exiting 10:08:56 (12115): No heartbeat from core client for 30 sec - exiting 10:08:57 (12115): No heartbeat from core client for 30 sec - exiting 10:08:58 (12115): No heartbeat from core client for 30 sec - exiting 10:08:59 (12115): No heartbeat from core client for 30 sec - exiting 10:09:01 (12115): No heartbeat from core client for 30 sec - exiting 10:09:02 (12115): No heartbeat from core client for 30 sec - exiting 10:09:03 (12115): No heartbeat from core client for 30 sec - exiting 10:09:04 (12115): No heartbeat from core client for 30 sec - exiting 10:09:05 (12115): No heartbeat from core client for 30 sec - exiting 10:09:06 (12115): No heartbeat from core client for 30 sec - exiting 10:09:07 (12115): No heartbeat from core client for 30 sec - exiting 10:09:08 (12115): No heartbeat from core client for 30 sec - exiting 10:09:09 (12115): No heartbeat from core client for 30 sec - exiting 10:09:10 (12115): No heartbeat from core client for 30 sec - exiting 10:09:11 (12115): No heartbeat from core client for 30 sec - exiting 10:09:12 (12115): No heartbeat from core client for 30 sec - exiting 10:09:13 (12115): No heartbeat from core client for 30 sec - exiting 10:09:14 (12115): No heartbeat from core client for 30 sec - exiting 10:09:15 (12115): No heartbeat from core client for 30 sec - exiting 10:09:16 (12115): No heartbeat from core client for 30 sec - exiting 10:09:17 (12115): No heartbeat from core client for 30 sec - exiting 10:09:18 (12115): No heartbeat from core client for 30 sec - exiting 10:09:19 (12115): No heartbeat from core client for 30 sec - exiting 10:09:20 (12115): No heartbeat from core client for 30 sec - exiting 10:09:21 (12115): No heartbeat from core client for 30 sec - exiting 10:09:22 (12115): No heartbeat from core client for 30 sec - exiting 10:09:23 (12115): No heartbeat from core client for 30 sec - exiting 10:09:24 (12115): No heartbeat from core client for 30 sec - exiting 10:09:25 (12115): No heartbeat from core client for 30 sec - exiting 10:09:26 (12115): No heartbeat from core client for 30 sec - exiting 10:09:27 (12115): No heartbeat from core client for 30 sec - exiting 10:09:28 (12115): No heartbeat from core client for 30 sec - exiting 10:09:29 (12115): No heartbeat from core client for 30 sec - exiting 10:09:30 (12115): No heartbeat from core client for 30 sec - exiting 10:09:31 (12115): No heartbeat from core client for 30 sec - exiting 10:09:32 (12115): No heartbeat from core client for 30 sec - exiting 10:09:33 (12115): No heartbeat from core client for 30 sec - exiting 10:09:34 (12115): No heartbeat from core client for 30 sec - exiting 10:09:35 (12115): No heartbeat from core client for 30 sec - exiting 10:09:36 (12115): No heartbeat from core client for 30 sec - exiting 10:09:37 (12115): No heartbeat from core client for 30 sec - exiting 10:09:38 (12115): No heartbeat from core client for 30 sec - exiting 10:09:39 (12115): No heartbeat from core client for 30 sec - exiting 10:09:40 (12115): No heartbeat from core client for 30 sec - exiting 10:09:41 (12115): No heartbeat from core client for 30 sec - exiting 10:09:42 (12115): No heartbeat from core client for 30 sec - exiting 10:09:43 (12115): No heartbeat from core client for 30 sec - exiting 10:09:44 (12115): No heartbeat from core client for 30 sec - exiting 10:09:45 (12115): No heartbeat from core client for 30 sec - exiting 10:09:46 (12115): No heartbeat from core client for 30 sec - exiting 10:09:47 (12115): No heartbeat from core client for 30 sec - exiting 10:09:48 (12115): No heartbeat from core client for 30 sec - exiting 10:09:49 (12115): No heartbeat from core client for 30 sec - exiting 10:09:50 (12115): No heartbeat from core client for 30 sec - exiting 10:09:51 (12115): No heartbeat from core client for 30 sec - exiting 10:09:52 (12115): No heartbeat from core client for 30 sec - exiting 10:09:53 (12115): No heartbeat from core client for 30 sec - exiting 10:09:54 (12115): No heartbeat from core client for 30 sec - exiting 10:09:55 (12115): No heartbeat from core client for 30 sec - exiting 10:09:56 (12115): No heartbeat from core client for 30 sec - exiting 10:09:57 (12115): No heartbeat from core client for 30 sec - exiting 10:09:58 (12115): No heartbeat from core client for 30 sec - exiting 10:09:59 (12115): No heartbeat from core client for 30 sec - exiting 10:10:00 (12115): No heartbeat from core client for 30 sec - exiting 10:10:01 (12115): No heartbeat from core client for 30 sec - exiting 10:10:02 (12115): No heartbeat from core client for 30 sec - exiting 10:10:03 (12115): No heartbeat from core client for 30 sec - exiting 10:10:04 (12115): No heartbeat from core client for 30 sec - exiting 10:10:05 (12115): No heartbeat from core client for 30 sec - exiting 10:10:06 (12115): No heartbeat from core client for 30 sec - exiting 10:10:07 (12115): No heartbeat from core client for 30 sec - exiting 10:10:08 (12115): No heartbeat from core client for 30 sec - exiting 10:10:09 (12115): No heartbeat from core client for 30 sec - exiting 10:10:10 (12115): No heartbeat from core client for 30 sec - exiting 10:10:11 (12115): No heartbeat from core client for 30 sec - exiting 10:10:12 (12115): No heartbeat from core client for 30 sec - exiting 10:10:13 (12115): No heartbeat from core client for 30 sec - exiting 10:10:14 (12115): No heartbeat from core client for 30 sec - exiting 10:10:16 (12115): No heartbeat from core client for 30 sec - exiting 10:10:17 (12115): No heartbeat from core client for 30 sec - exiting 10:10:18 (12115): No heartbeat from core client for 30 sec - exiting 10:10:19 (12115): No heartbeat from core client for 30 sec - exiting 10:10:20 (12115): No heartbeat from core client for 30 sec - exiting 10:10:21 (12115): No heartbeat from core client for 30 sec - exiting 10:10:22 (12115): No heartbeat from core client for 30 sec - exiting 10:10:23 (12115): No heartbeat from core client for 30 sec - exiting 10:10:24 (12115): No heartbeat from core client for 30 sec - exiting Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish hadcm3n_6.07_i686-apple-darwin(2894,0xac7102c0) malloc: *** error for object 0x1280804: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(2894,0xac7102c0) malloc: *** error for object 0x1280800: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(2894,0xac7102c0) malloc: *** error for object 0xa7fa04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(2894,0xac7102c0) malloc: *** error for object 0xa7fa00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(2894,0xac7102c0) malloc: *** error for object 0xa7fa04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(2894,0xac7102c0) malloc: *** error for object 0xa7fa00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(2894,0xac7102c0) malloc: *** error for object 0xa7fa04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(2894,0xac7102c0) malloc: *** error for object 0xa7fa00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(2894,0xac7102c0) malloc: *** error for object 0x127fa04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(2894,0xac7102c0) malloc: *** error for object 0x1280804: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(2894,0xac7102c0) malloc: *** error for object 0xaa4a04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(2894,0xac7102c0) malloc: *** error for object 0xaa5c04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(2894,0xac7102c0) malloc: *** error for object 0xaa9c04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(2894,0xac7102c0) malloc: *** error for object 0xaa9c00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.7.3 build 11D50b Sun Feb 12 21:42:18 2012 SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(59871,0xac7102c0) malloc: *** error for object 0x13f6004: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(59871,0xac7102c0) malloc: *** error for object 0x13f6000: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(59871,0xac7102c0) malloc: *** error for object 0x13f6004: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(59871,0xac7102c0) malloc: *** error for object 0x13f6000: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(59871,0xac7102c0) malloc: *** error for object 0x13f6004: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(59871,0xac7102c0) malloc: *** error for object 0x13f6000: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(59871,0xac7102c0) malloc: *** error for object 0x13f6004: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(59871,0xac7102c0) malloc: *** error for object 0x13f6000: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(59871,0xac7102c0) malloc: *** error for object 0x13f6004: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(59871,0xac7102c0) malloc: *** error for object 0x13f6000: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(59871,0xac7102c0) malloc: *** error for object 0x13f6004: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(59871,0xac7102c0) malloc: *** error for object 0x13f6000: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]> |
Latest Trickles Received | ||||||
---|---|---|---|---|---|---|
Time Sent (UTC) | Host ID | Result ID | Result Name | Timestep | CPU Time (sec) | Average (sec/TS) |
03 Mar 2012 17:28:34 | 1191378 | 13923112 | hadcm3n_u18h_1980_40_007682174_0 | 699,840 | 893,566 | 1.2768 |
03 Mar 2012 05:55:48 | 1191378 | 13923112 | hadcm3n_u18h_1980_40_007682174_0 | 673,920 | 860,669 | 1.2771 |
02 Mar 2012 20:00:42 | 1191378 | 13923112 | hadcm3n_u18h_1980_40_007682174_0 | 648,000 | 827,689 | 1.2773 |
01 Mar 2012 17:22:21 | 1191378 | 13923112 | hadcm3n_u18h_1980_40_007682174_0 | 622,080 | 794,603 | 1.2773 |
01 Mar 2012 07:39:41 | 1191378 | 13923112 | hadcm3n_u18h_1980_40_007682174_0 | 596,160 | 761,597 | 1.2775 |
29 Feb 2012 13:06:47 | 1191378 | 13923112 | hadcm3n_u18h_1980_40_007682174_0 | 570,240 | 729,064 | 1.2785 |
22 Feb 2012 04:12:50 | 1191378 | 13923112 | hadcm3n_u18h_1980_40_007682174_0 | 544,320 | 695,278 | 1.2773 |
04 Feb 2012 22:28:53 | 1191378 | 13923112 | hadcm3n_u18h_1980_40_007682174_0 | 518,400 | 662,214 | 1.2774 |
04 Feb 2012 03:15:36 | 1191378 | 13923112 | hadcm3n_u18h_1980_40_007682174_0 | 492,480 | 629,423 | 1.2781 |
03 Feb 2012 08:47:36 | 1191378 | 13923112 | hadcm3n_u18h_1980_40_007682174_0 | 466,560 | 595,827 | 1.2771 |
02 Feb 2012 12:15:38 | 1191378 | 13923112 | hadcm3n_u18h_1980_40_007682174_0 | 440,640 | 562,228 | 1.2759 |
01 Feb 2012 16:43:50 | 1191378 | 13923112 | hadcm3n_u18h_1980_40_007682174_0 | 414,720 | 528,924 | 1.2754 |
31 Jan 2012 22:16:25 | 1191378 | 13923112 | hadcm3n_u18h_1980_40_007682174_0 | 388,800 | 495,942 | 1.2756 |
31 Jan 2012 04:58:11 | 1191378 | 13923112 | hadcm3n_u18h_1980_40_007682174_0 | 362,880 | 463,139 | 1.2763 |
30 Jan 2012 10:30:01 | 1191378 | 13923112 | hadcm3n_u18h_1980_40_007682174_0 | 336,960 | 430,078 | 1.2763 |
29 Jan 2012 03:26:51 | 1191378 | 13923112 | hadcm3n_u18h_1980_40_007682174_0 | 311,040 | 397,056 | 1.2765 |
28 Jan 2012 09:23:26 | 1191378 | 13923112 | hadcm3n_u18h_1980_40_007682174_0 | 285,120 | 363,544 | 1.2751 |
27 Jan 2012 13:28:43 | 1191378 | 13923112 | hadcm3n_u18h_1980_40_007682174_0 | 259,200 | 329,625 | 1.2717 |
25 Jan 2012 15:12:44 | 1191378 | 13923112 | hadcm3n_u18h_1980_40_007682174_0 | 233,280 | 296,011 | 1.2689 |
24 Jan 2012 17:58:48 | 1191378 | 13923112 | hadcm3n_u18h_1980_40_007682174_0 | 207,360 | 263,047 | 1.2686 |
©2024 cpdn.org