climateprediction.net home page
Task 13923112

Task 13923112

Name hadcm3n_u18h_1980_40_007682174_0
Workunit 7837261
Created 15 Jan 2012, 21:58:47 UTC
Sent 15 Jan 2012, 21:58:54 UTC
Report deadline 16 Apr 2012, 5:26:05 UTC
Received 4 Mar 2012, 19:07:29 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1191378
Run time 10 days 21 hours 36 min 49 sec
CPU time 10 days 9 hours 27 min 34 sec
Validate state Invalid
Credit 8,398.08
Device peak FLOPS 3.17 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-apple-darwin
Stderr
<core_client_version>6.12.35</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(10958,0xac5de2c0) malloc: *** error for object 0xa26800: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(10958,0xac5de2c0) malloc: *** error for object 0xa26804: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(10958,0xac5de2c0) malloc: *** error for object 0xa26800: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(10958,0xac5de2c0) malloc: *** error for object 0xa26804: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(10958,0xac5de2c0) malloc: *** error for object 0xa26800: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(10958,0xac5de2c0) malloc: *** error for object 0xa26804: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(10958,0xac5de2c0) malloc: *** error for object 0xa26800: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(10958,0xac5de2c0) malloc: *** error for object 0xa26804: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(10958,0xac5de2c0) malloc: *** error for object 0xa26800: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
hadcm3n_6.07_i686-apple-darwin(15562,0xac5de2c0) malloc: *** error for object 0x9e7804: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation

Crashed executable name: hadcm3n_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.7.2 build 11C74
Sat Feb  4 23:25:42 2012

Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=15565, selfPID=15565, iMonCtr=1
hadcm3n_6.07_i686-apple-darwin(16341,0xac5de2c0) malloc: *** error for object 0x11eac04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(16341,0xac5de2c0) malloc: *** error for object 0x11eac00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(16341,0xac5de2c0) malloc: *** error for object 0x9cdc04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(16341,0xac5de2c0) malloc: *** error for object 0x9cea00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
hadcm3n_6.07_i686-apple-darwin(99409,0xac5de2c0) malloc: *** error for object 0xbda804: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(99409,0xac5de2c0) malloc: *** error for object 0xbda800: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(99409,0xac5de2c0) malloc: *** error for object 0x1bb6604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(99409,0xac5de2c0) malloc: *** error for object 0x1bb6600: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(99409,0xac5de2c0) malloc: *** error for object 0x1bb6604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(99409,0xac5de2c0) malloc: *** error for object 0x1bb6600: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(99409,0xac5de2c0) malloc: *** error for object 0x1bb6604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(99409,0xac5de2c0) malloc: *** error for object 0x1bb6600: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(99409,0xac5de2c0) malloc: *** error for object 0x1bb6604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
hadcm3n_6.07_i686-apple-darwin(12115,0xac5de2c0) malloc: *** error for object 0x1b1a404: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(12115,0xac5de2c0) malloc: *** error for object 0x1b1a400: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(12115,0xac5de2c0) malloc: *** error for object 0xafbc00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
10:00:14 (12115): No heartbeat from core client for 30 sec - exiting
10:00:15 (12115): No heartbeat from core client for 30 sec - exiting
10:00:16 (12115): No heartbeat from core client for 30 sec - exiting
10:00:17 (12115): No heartbeat from core client for 30 sec - exiting
10:00:18 (12115): No heartbeat from core client for 30 sec - exiting
10:00:19 (12115): No heartbeat from core client for 30 sec - exiting
10:00:20 (12115): No heartbeat from core client for 30 sec - exiting
10:00:21 (12115): No heartbeat from core client for 30 sec - exiting
10:00:22 (12115): No heartbeat from core client for 30 sec - exiting
10:00:23 (12115): No heartbeat from core client for 30 sec - exiting
10:00:24 (12115): No heartbeat from core client for 30 sec - exiting
10:00:25 (12115): No heartbeat from core client for 30 sec - exiting
10:00:26 (12115): No heartbeat from core client for 30 sec - exiting
10:00:27 (12115): No heartbeat from core client for 30 sec - exiting
10:00:29 (12115): No heartbeat from core client for 30 sec - exiting
10:00:30 (12115): No heartbeat from core client for 30 sec - exiting
10:00:32 (12115): No heartbeat from core client for 30 sec - exiting
10:00:33 (12115): No heartbeat from core client for 30 sec - exiting
10:00:35 (12115): No heartbeat from core client for 30 sec - exiting
10:00:36 (12115): No heartbeat from core client for 30 sec - exiting
10:00:37 (12115): No heartbeat from core client for 30 sec - exiting
10:00:39 (12115): No heartbeat from core client for 30 sec - exiting
10:00:42 (12115): No heartbeat from core client for 30 sec - exiting
10:00:44 (12115): No heartbeat from core client for 30 sec - exiting
10:00:47 (12115): No heartbeat from core client for 30 sec - exiting
10:00:48 (12115): No heartbeat from core client for 30 sec - exiting
10:00:49 (12115): No heartbeat from core client for 30 sec - exiting
10:00:51 (12115): No heartbeat from core client for 30 sec - exiting
10:00:52 (12115): No heartbeat from core client for 30 sec - exiting
10:00:53 (12115): No heartbeat from core client for 30 sec - exiting
10:00:54 (12115): No heartbeat from core client for 30 sec - exiting
10:00:55 (12115): No heartbeat from core client for 30 sec - exiting
10:00:56 (12115): No heartbeat from core client for 30 sec - exiting
10:00:57 (12115): No heartbeat from core client for 30 sec - exiting
10:00:58 (12115): No heartbeat from core client for 30 sec - exiting
10:00:59 (12115): No heartbeat from core client for 30 sec - exiting
10:01:00 (12115): No heartbeat from core client for 30 sec - exiting
10:01:01 (12115): No heartbeat from core client for 30 sec - exiting
10:01:02 (12115): No heartbeat from core client for 30 sec - exiting
10:01:03 (12115): No heartbeat from core client for 30 sec - exiting
10:01:04 (12115): No heartbeat from core client for 30 sec - exiting
10:01:05 (12115): No heartbeat from core client for 30 sec - exiting
10:01:06 (12115): No heartbeat from core client for 30 sec - exiting
10:01:07 (12115): No heartbeat from core client for 30 sec - exiting
10:01:09 (12115): No heartbeat from core client for 30 sec - exiting
10:01:10 (12115): No heartbeat from core client for 30 sec - exiting
10:01:11 (12115): No heartbeat from core client for 30 sec - exiting
10:01:12 (12115): No heartbeat from core client for 30 sec - exiting
10:01:13 (12115): No heartbeat from core client for 30 sec - exiting
10:01:14 (12115): No heartbeat from core client for 30 sec - exiting
10:01:15 (12115): No heartbeat from core client for 30 sec - exiting
10:01:16 (12115): No heartbeat from core client for 30 sec - exiting
10:01:17 (12115): No heartbeat from core client for 30 sec - exiting
10:01:18 (12115): No heartbeat from core client for 30 sec - exiting
10:01:19 (12115): No heartbeat from core client for 30 sec - exiting
10:01:20 (12115): No heartbeat from core client for 30 sec - exiting
10:01:21 (12115): No heartbeat from core client for 30 sec - exiting
10:01:22 (12115): No heartbeat from core client for 30 sec - exiting
10:01:23 (12115): No heartbeat from core client for 30 sec - exiting
10:01:24 (12115): No heartbeat from core client for 30 sec - exiting
10:01:25 (12115): No heartbeat from core client for 30 sec - exiting
10:01:26 (12115): No heartbeat from core client for 30 sec - exiting
10:01:27 (12115): No heartbeat from core client for 30 sec - exiting
10:01:28 (12115): No heartbeat from core client for 30 sec - exiting
10:01:29 (12115): No heartbeat from core client for 30 sec - exiting
10:01:30 (12115): No heartbeat from core client for 30 sec - exiting
10:01:31 (12115): No heartbeat from core client for 30 sec - exiting
10:01:32 (12115): No heartbeat from core client for 30 sec - exiting
10:01:33 (12115): No heartbeat from core client for 30 sec - exiting
10:01:35 (12115): No heartbeat from core client for 30 sec - exiting
10:01:36 (12115): No heartbeat from core client for 30 sec - exiting
10:01:37 (12115): No heartbeat from core client for 30 sec - exiting
10:01:38 (12115): No heartbeat from core client for 30 sec - exiting
10:01:39 (12115): No heartbeat from core client for 30 sec - exiting
10:01:40 (12115): No heartbeat from core client for 30 sec - exiting
10:01:41 (12115): No heartbeat from core client for 30 sec - exiting
10:01:42 (12115): No heartbeat from core client for 30 sec - exiting
10:01:43 (12115): No heartbeat from core client for 30 sec - exiting
10:01:44 (12115): No heartbeat from core client for 30 sec - exiting
10:01:45 (12115): No heartbeat from core client for 30 sec - exiting
10:01:46 (12115): No heartbeat from core client for 30 sec - exiting
10:01:47 (12115): No heartbeat from core client for 30 sec - exiting
10:01:48 (12115): No heartbeat from core client for 30 sec - exiting
10:01:49 (12115): No heartbeat from core client for 30 sec - exiting
10:01:50 (12115): No heartbeat from core client for 30 sec - exiting
10:01:51 (12115): No heartbeat from core client for 30 sec - exiting
10:01:52 (12115): No heartbeat from core client for 30 sec - exiting
10:01:53 (12115): No heartbeat from core client for 30 sec - exiting
10:01:54 (12115): No heartbeat from core client for 30 sec - exiting
10:01:55 (12115): No heartbeat from core client for 30 sec - exiting
10:01:56 (12115): No heartbeat from core client for 30 sec - exiting
10:01:57 (12115): No heartbeat from core client for 30 sec - exiting
10:01:58 (12115): No heartbeat from core client for 30 sec - exiting
10:01:59 (12115): No heartbeat from core client for 30 sec - exiting
10:02:00 (12115): No heartbeat from core client for 30 sec - exiting
10:02:01 (12115): No heartbeat from core client for 30 sec - exiting
10:02:02 (12115): No heartbeat from core client for 30 sec - exiting
10:02:03 (12115): No heartbeat from core client for 30 sec - exiting
10:02:04 (12115): No heartbeat from core client for 30 sec - exiting
10:02:05 (12115): No heartbeat from core client for 30 sec - exiting
10:02:06 (12115): No heartbeat from core client for 30 sec - exiting
10:02:07 (12115): No heartbeat from core client for 30 sec - exiting
10:02:08 (12115): No heartbeat from core client for 30 sec - exiting
10:02:09 (12115): No heartbeat from core client for 30 sec - exiting
10:02:10 (12115): No heartbeat from core client for 30 sec - exiting
10:02:11 (12115): No heartbeat from core client for 30 sec - exiting
10:02:12 (12115): No heartbeat from core client for 30 sec - exiting
10:02:13 (12115): No heartbeat from core client for 30 sec - exiting
10:02:14 (12115): No heartbeat from core client for 30 sec - exiting
10:02:15 (12115): No heartbeat from core client for 30 sec - exiting
10:02:16 (12115): No heartbeat from core client for 30 sec - exiting
10:02:17 (12115): No heartbeat from core client for 30 sec - exiting
10:02:18 (12115): No heartbeat from core client for 30 sec - exiting
10:02:19 (12115): No heartbeat from core client for 30 sec - exiting
10:02:20 (12115): No heartbeat from core client for 30 sec - exiting
10:02:21 (12115): No heartbeat from core client for 30 sec - exiting
10:02:22 (12115): No heartbeat from core client for 30 sec - exiting
10:02:24 (12115): No heartbeat from core client for 30 sec - exiting
10:02:25 (12115): No heartbeat from core client for 30 sec - exiting
10:02:26 (12115): No heartbeat from core client for 30 sec - exiting
10:02:27 (12115): No heartbeat from core client for 30 sec - exiting
10:02:28 (12115): No heartbeat from core client for 30 sec - exiting
10:02:29 (12115): No heartbeat from core client for 30 sec - exiting
10:02:30 (12115): No heartbeat from core client for 30 sec - exiting
10:02:31 (12115): No heartbeat from core client for 30 sec - exiting
10:02:32 (12115): No heartbeat from core client for 30 sec - exiting
10:02:33 (12115): No heartbeat from core client for 30 sec - exiting
10:02:34 (12115): No heartbeat from core client for 30 sec - exiting
10:02:35 (12115): No heartbeat from core client for 30 sec - exiting
10:02:36 (12115): No heartbeat from core client for 30 sec - exiting
10:02:37 (12115): No heartbeat from core client for 30 sec - exiting
10:02:38 (12115): No heartbeat from core client for 30 sec - exiting
10:02:39 (12115): No heartbeat from core client for 30 sec - exiting
10:02:40 (12115): No heartbeat from core client for 30 sec - exiting
10:02:41 (12115): No heartbeat from core client for 30 sec - exiting
10:02:42 (12115): No heartbeat from core client for 30 sec - exiting
10:02:43 (12115): No heartbeat from core client for 30 sec - exiting
10:02:44 (12115): No heartbeat from core client for 30 sec - exiting
10:02:45 (12115): No heartbeat from core client for 30 sec - exiting
10:02:46 (12115): No heartbeat from core client for 30 sec - exiting
10:02:47 (12115): No heartbeat from core client for 30 sec - exiting
10:02:48 (12115): No heartbeat from core client for 30 sec - exiting
10:02:49 (12115): No heartbeat from core client for 30 sec - exiting
10:02:50 (12115): No heartbeat from core client for 30 sec - exiting
10:02:51 (12115): No heartbeat from core client for 30 sec - exiting
10:02:52 (12115): No heartbeat from core client for 30 sec - exiting
10:02:53 (12115): No heartbeat from core client for 30 sec - exiting
10:02:54 (12115): No heartbeat from core client for 30 sec - exiting
10:02:55 (12115): No heartbeat from core client for 30 sec - exiting
10:02:56 (12115): No heartbeat from core client for 30 sec - exiting
10:02:57 (12115): No heartbeat from core client for 30 sec - exiting
10:02:58 (12115): No heartbeat from core client for 30 sec - exiting
10:02:59 (12115): No heartbeat from core client for 30 sec - exiting
10:03:00 (12115): No heartbeat from core client for 30 sec - exiting
10:03:01 (12115): No heartbeat from core client for 30 sec - exiting
10:03:02 (12115): No heartbeat from core client for 30 sec - exiting
10:03:03 (12115): No heartbeat from core client for 30 sec - exiting
10:03:04 (12115): No heartbeat from core client for 30 sec - exiting
10:03:05 (12115): No heartbeat from core client for 30 sec - exiting
10:03:06 (12115): No heartbeat from core client for 30 sec - exiting
10:03:07 (12115): No heartbeat from core client for 30 sec - exiting
10:03:08 (12115): No heartbeat from core client for 30 sec - exiting
10:03:09 (12115): No heartbeat from core client for 30 sec - exiting
10:03:10 (12115): No heartbeat from core client for 30 sec - exiting
10:03:11 (12115): No heartbeat from core client for 30 sec - exiting
10:03:12 (12115): No heartbeat from core client for 30 sec - exiting
10:03:13 (12115): No heartbeat from core client for 30 sec - exiting
10:03:14 (12115): No heartbeat from core client for 30 sec - exiting
10:03:15 (12115): No heartbeat from core client for 30 sec - exiting
10:03:16 (12115): No heartbeat from core client for 30 sec - exiting
10:03:17 (12115): No heartbeat from core client for 30 sec - exiting
10:03:18 (12115): No heartbeat from core client for 30 sec - exiting
10:03:19 (12115): No heartbeat from core client for 30 sec - exiting
10:03:20 (12115): No heartbeat from core client for 30 sec - exiting
10:03:21 (12115): No heartbeat from core client for 30 sec - exiting
10:03:22 (12115): No heartbeat from core client for 30 sec - exiting
10:03:23 (12115): No heartbeat from core client for 30 sec - exiting
10:03:24 (12115): No heartbeat from core client for 30 sec - exiting
10:03:25 (12115): No heartbeat from core client for 30 sec - exiting
10:03:26 (12115): No heartbeat from core client for 30 sec - exiting
10:03:27 (12115): No heartbeat from core client for 30 sec - exiting
10:03:28 (12115): No heartbeat from core client for 30 sec - exiting
10:03:29 (12115): No heartbeat from core client for 30 sec - exiting
10:03:30 (12115): No heartbeat from core client for 30 sec - exiting
10:03:32 (12115): No heartbeat from core client for 30 sec - exiting
10:03:33 (12115): No heartbeat from core client for 30 sec - exiting
10:03:34 (12115): No heartbeat from core client for 30 sec - exiting
10:03:35 (12115): No heartbeat from core client for 30 sec - exiting
10:03:36 (12115): No heartbeat from core client for 30 sec - exiting
10:03:37 (12115): No heartbeat from core client for 30 sec - exiting
10:03:38 (12115): No heartbeat from core client for 30 sec - exiting
10:03:39 (12115): No heartbeat from core client for 30 sec - exiting
10:03:40 (12115): No heartbeat from core client for 30 sec - exiting
10:03:41 (12115): No heartbeat from core client for 30 sec - exiting
10:03:42 (12115): No heartbeat from core client for 30 sec - exiting
10:03:43 (12115): No heartbeat from core client for 30 sec - exiting
10:03:44 (12115): No heartbeat from core client for 30 sec - exiting
10:03:45 (12115): No heartbeat from core client for 30 sec - exiting
10:03:46 (12115): No heartbeat from core client for 30 sec - exiting
10:03:47 (12115): No heartbeat from core client for 30 sec - exiting
10:03:48 (12115): No heartbeat from core client for 30 sec - exiting
10:03:49 (12115): No heartbeat from core client for 30 sec - exiting
10:03:50 (12115): No heartbeat from core client for 30 sec - exiting
10:03:51 (12115): No heartbeat from core client for 30 sec - exiting
10:03:52 (12115): No heartbeat from core client for 30 sec - exiting
10:03:53 (12115): No heartbeat from core client for 30 sec - exiting
10:03:54 (12115): No heartbeat from core client for 30 sec - exiting
10:03:55 (12115): No heartbeat from core client for 30 sec - exiting
10:03:56 (12115): No heartbeat from core client for 30 sec - exiting
10:03:57 (12115): No heartbeat from core client for 30 sec - exiting
10:03:58 (12115): No heartbeat from core client for 30 sec - exiting
10:03:59 (12115): No heartbeat from core client for 30 sec - exiting
10:04:00 (12115): No heartbeat from core client for 30 sec - exiting
10:04:01 (12115): No heartbeat from core client for 30 sec - exiting
10:04:02 (12115): No heartbeat from core client for 30 sec - exiting
10:04:03 (12115): No heartbeat from core client for 30 sec - exiting
10:04:04 (12115): No heartbeat from core client for 30 sec - exiting
10:04:05 (12115): No heartbeat from core client for 30 sec - exiting
10:04:06 (12115): No heartbeat from core client for 30 sec - exiting
10:04:07 (12115): No heartbeat from core client for 30 sec - exiting
10:04:08 (12115): No heartbeat from core client for 30 sec - exiting
10:04:09 (12115): No heartbeat from core client for 30 sec - exiting
10:04:10 (12115): No heartbeat from core client for 30 sec - exiting
10:04:11 (12115): No heartbeat from core client for 30 sec - exiting
10:04:12 (12115): No heartbeat from core client for 30 sec - exiting
10:04:13 (12115): No heartbeat from core client for 30 sec - exiting
10:04:14 (12115): No heartbeat from core client for 30 sec - exiting
10:04:15 (12115): No heartbeat from core client for 30 sec - exiting
10:04:16 (12115): No heartbeat from core client for 30 sec - exiting
10:04:17 (12115): No heartbeat from core client for 30 sec - exiting
10:04:18 (12115): No heartbeat from core client for 30 sec - exiting
10:04:19 (12115): No heartbeat from core client for 30 sec - exiting
10:04:20 (12115): No heartbeat from core client for 30 sec - exiting
10:04:21 (12115): No heartbeat from core client for 30 sec - exiting
10:04:22 (12115): No heartbeat from core client for 30 sec - exiting
10:04:23 (12115): No heartbeat from core client for 30 sec - exiting
10:04:24 (12115): No heartbeat from core client for 30 sec - exiting
10:04:25 (12115): No heartbeat from core client for 30 sec - exiting
10:04:26 (12115): No heartbeat from core client for 30 sec - exiting
10:04:27 (12115): No heartbeat from core client for 30 sec - exiting
10:04:28 (12115): No heartbeat from core client for 30 sec - exiting
10:04:29 (12115): No heartbeat from core client for 30 sec - exiting
10:04:30 (12115): No heartbeat from core client for 30 sec - exiting
10:04:32 (12115): No heartbeat from core client for 30 sec - exiting
10:04:33 (12115): No heartbeat from core client for 30 sec - exiting
10:04:34 (12115): No heartbeat from core client for 30 sec - exiting
10:04:35 (12115): No heartbeat from core client for 30 sec - exiting
10:04:36 (12115): No heartbeat from core client for 30 sec - exiting
10:04:38 (12115): No heartbeat from core client for 30 sec - exiting
10:04:39 (12115): No heartbeat from core client for 30 sec - exiting
10:04:40 (12115): No heartbeat from core client for 30 sec - exiting
10:04:41 (12115): No heartbeat from core client for 30 sec - exiting
10:04:42 (12115): No heartbeat from core client for 30 sec - exiting
10:04:43 (12115): No heartbeat from core client for 30 sec - exiting
10:04:44 (12115): No heartbeat from core client for 30 sec - exiting
10:04:45 (12115): No heartbeat from core client for 30 sec - exiting
10:04:46 (12115): No heartbeat from core client for 30 sec - exiting
10:04:47 (12115): No heartbeat from core client for 30 sec - exiting
10:04:48 (12115): No heartbeat from core client for 30 sec - exiting
10:04:49 (12115): No heartbeat from core client for 30 sec - exiting
10:04:50 (12115): No heartbeat from core client for 30 sec - exiting
10:04:51 (12115): No heartbeat from core client for 30 sec - exiting
10:04:52 (12115): No heartbeat from core client for 30 sec - exiting
10:04:53 (12115): No heartbeat from core client for 30 sec - exiting
10:04:54 (12115): No heartbeat from core client for 30 sec - exiting
10:04:55 (12115): No heartbeat from core client for 30 sec - exiting
10:04:56 (12115): No heartbeat from core client for 30 sec - exiting
10:04:57 (12115): No heartbeat from core client for 30 sec - exiting
10:04:58 (12115): No heartbeat from core client for 30 sec - exiting
10:04:59 (12115): No heartbeat from core client for 30 sec - exiting
10:05:00 (12115): No heartbeat from core client for 30 sec - exiting
10:05:01 (12115): No heartbeat from core client for 30 sec - exiting
10:05:02 (12115): No heartbeat from core client for 30 sec - exiting
10:05:03 (12115): No heartbeat from core client for 30 sec - exiting
10:05:04 (12115): No heartbeat from core client for 30 sec - exiting
10:05:05 (12115): No heartbeat from core client for 30 sec - exiting
10:05:06 (12115): No heartbeat from core client for 30 sec - exiting
10:05:07 (12115): No heartbeat from core client for 30 sec - exiting
10:05:08 (12115): No heartbeat from core client for 30 sec - exiting
10:05:09 (12115): No heartbeat from core client for 30 sec - exiting
10:05:10 (12115): No heartbeat from core client for 30 sec - exiting
10:05:11 (12115): No heartbeat from core client for 30 sec - exiting
10:05:12 (12115): No heartbeat from core client for 30 sec - exiting
10:05:13 (12115): No heartbeat from core client for 30 sec - exiting
10:05:14 (12115): No heartbeat from core client for 30 sec - exiting
10:05:15 (12115): No heartbeat from core client for 30 sec - exiting
10:05:16 (12115): No heartbeat from core client for 30 sec - exiting
10:05:17 (12115): No heartbeat from core client for 30 sec - exiting
10:05:18 (12115): No heartbeat from core client for 30 sec - exiting
10:05:19 (12115): No heartbeat from core client for 30 sec - exiting
10:05:20 (12115): No heartbeat from core client for 30 sec - exiting
10:05:21 (12115): No heartbeat from core client for 30 sec - exiting
10:05:22 (12115): No heartbeat from core client for 30 sec - exiting
10:05:23 (12115): No heartbeat from core client for 30 sec - exiting
10:05:24 (12115): No heartbeat from core client for 30 sec - exiting
10:05:25 (12115): No heartbeat from core client for 30 sec - exiting
10:05:26 (12115): No heartbeat from core client for 30 sec - exiting
10:05:27 (12115): No heartbeat from core client for 30 sec - exiting
10:05:28 (12115): No heartbeat from core client for 30 sec - exiting
10:05:29 (12115): No heartbeat from core client for 30 sec - exiting
10:05:30 (12115): No heartbeat from core client for 30 sec - exiting
10:05:31 (12115): No heartbeat from core client for 30 sec - exiting
10:05:32 (12115): No heartbeat from core client for 30 sec - exiting
10:05:33 (12115): No heartbeat from core client for 30 sec - exiting
10:05:34 (12115): No heartbeat from core client for 30 sec - exiting
10:05:35 (12115): No heartbeat from core client for 30 sec - exiting
10:05:36 (12115): No heartbeat from core client for 30 sec - exiting
10:05:37 (12115): No heartbeat from core client for 30 sec - exiting
10:05:38 (12115): No heartbeat from core client for 30 sec - exiting
10:05:39 (12115): No heartbeat from core client for 30 sec - exiting
10:05:40 (12115): No heartbeat from core client for 30 sec - exiting
10:05:41 (12115): No heartbeat from core client for 30 sec - exiting
10:05:42 (12115): No heartbeat from core client for 30 sec - exiting
10:05:43 (12115): No heartbeat from core client for 30 sec - exiting
10:05:44 (12115): No heartbeat from core client for 30 sec - exiting
10:05:45 (12115): No heartbeat from core client for 30 sec - exiting
10:05:46 (12115): No heartbeat from core client for 30 sec - exiting
10:05:47 (12115): No heartbeat from core client for 30 sec - exiting
10:05:48 (12115): No heartbeat from core client for 30 sec - exiting
10:05:49 (12115): No heartbeat from core client for 30 sec - exiting
10:05:50 (12115): No heartbeat from core client for 30 sec - exiting
10:05:51 (12115): No heartbeat from core client for 30 sec - exiting
10:05:52 (12115): No heartbeat from core client for 30 sec - exiting
10:05:53 (12115): No heartbeat from core client for 30 sec - exiting
10:05:54 (12115): No heartbeat from core client for 30 sec - exiting
10:05:55 (12115): No heartbeat from core client for 30 sec - exiting
10:05:56 (12115): No heartbeat from core client for 30 sec - exiting
10:05:57 (12115): No heartbeat from core client for 30 sec - exiting
10:05:58 (12115): No heartbeat from core client for 30 sec - exiting
10:05:59 (12115): No heartbeat from core client for 30 sec - exiting
10:06:01 (12115): No heartbeat from core client for 30 sec - exiting
10:06:02 (12115): No heartbeat from core client for 30 sec - exiting
10:06:03 (12115): No heartbeat from core client for 30 sec - exiting
10:06:04 (12115): No heartbeat from core client for 30 sec - exiting
10:06:05 (12115): No heartbeat from core client for 30 sec - exiting
10:06:06 (12115): No heartbeat from core client for 30 sec - exiting
10:06:07 (12115): No heartbeat from core client for 30 sec - exiting
10:06:08 (12115): No heartbeat from core client for 30 sec - exiting
10:06:09 (12115): No heartbeat from core client for 30 sec - exiting
10:06:10 (12115): No heartbeat from core client for 30 sec - exiting
10:06:11 (12115): No heartbeat from core client for 30 sec - exiting
10:06:12 (12115): No heartbeat from core client for 30 sec - exiting
10:06:13 (12115): No heartbeat from core client for 30 sec - exiting
10:06:14 (12115): No heartbeat from core client for 30 sec - exiting
10:06:15 (12115): No heartbeat from core client for 30 sec - exiting
10:06:16 (12115): No heartbeat from core client for 30 sec - exiting
10:06:17 (12115): No heartbeat from core client for 30 sec - exiting
10:06:18 (12115): No heartbeat from core client for 30 sec - exiting
10:06:19 (12115): No heartbeat from core client for 30 sec - exiting
10:06:20 (12115): No heartbeat from core client for 30 sec - exiting
10:06:21 (12115): No heartbeat from core client for 30 sec - exiting
10:06:22 (12115): No heartbeat from core client for 30 sec - exiting
10:06:23 (12115): No heartbeat from core client for 30 sec - exiting
10:06:24 (12115): No heartbeat from core client for 30 sec - exiting
10:06:25 (12115): No heartbeat from core client for 30 sec - exiting
10:06:26 (12115): No heartbeat from core client for 30 sec - exiting
10:06:27 (12115): No heartbeat from core client for 30 sec - exiting
10:06:28 (12115): No heartbeat from core client for 30 sec - exiting
10:06:29 (12115): No heartbeat from core client for 30 sec - exiting
10:06:30 (12115): No heartbeat from core client for 30 sec - exiting
10:06:31 (12115): No heartbeat from core client for 30 sec - exiting
10:06:32 (12115): No heartbeat from core client for 30 sec - exiting
10:06:33 (12115): No heartbeat from core client for 30 sec - exiting
10:06:34 (12115): No heartbeat from core client for 30 sec - exiting
10:06:35 (12115): No heartbeat from core client for 30 sec - exiting
10:06:36 (12115): No heartbeat from core client for 30 sec - exiting
10:06:37 (12115): No heartbeat from core client for 30 sec - exiting
10:06:38 (12115): No heartbeat from core client for 30 sec - exiting
10:06:39 (12115): No heartbeat from core client for 30 sec - exiting
10:06:40 (12115): No heartbeat from core client for 30 sec - exiting
10:06:41 (12115): No heartbeat from core client for 30 sec - exiting
10:06:42 (12115): No heartbeat from core client for 30 sec - exiting
10:06:43 (12115): No heartbeat from core client for 30 sec - exiting
10:06:44 (12115): No heartbeat from core client for 30 sec - exiting
10:06:45 (12115): No heartbeat from core client for 30 sec - exiting
10:06:46 (12115): No heartbeat from core client for 30 sec - exiting
10:06:47 (12115): No heartbeat from core client for 30 sec - exiting
10:06:48 (12115): No heartbeat from core client for 30 sec - exiting
10:06:49 (12115): No heartbeat from core client for 30 sec - exiting
10:06:50 (12115): No heartbeat from core client for 30 sec - exiting
10:06:51 (12115): No heartbeat from core client for 30 sec - exiting
10:06:52 (12115): No heartbeat from core client for 30 sec - exiting
10:06:53 (12115): No heartbeat from core client for 30 sec - exiting
10:06:54 (12115): No heartbeat from core client for 30 sec - exiting
10:06:55 (12115): No heartbeat from core client for 30 sec - exiting
10:06:56 (12115): No heartbeat from core client for 30 sec - exiting
10:06:57 (12115): No heartbeat from core client for 30 sec - exiting
10:06:58 (12115): No heartbeat from core client for 30 sec - exiting
10:06:59 (12115): No heartbeat from core client for 30 sec - exiting
10:07:00 (12115): No heartbeat from core client for 30 sec - exiting
10:07:01 (12115): No heartbeat from core client for 30 sec - exiting
10:07:02 (12115): No heartbeat from core client for 30 sec - exiting
10:07:03 (12115): No heartbeat from core client for 30 sec - exiting
10:07:04 (12115): No heartbeat from core client for 30 sec - exiting
10:07:05 (12115): No heartbeat from core client for 30 sec - exiting
10:07:06 (12115): No heartbeat from core client for 30 sec - exiting
10:07:07 (12115): No heartbeat from core client for 30 sec - exiting
10:07:08 (12115): No heartbeat from core client for 30 sec - exiting
10:07:09 (12115): No heartbeat from core client for 30 sec - exiting
10:07:10 (12115): No heartbeat from core client for 30 sec - exiting
10:07:11 (12115): No heartbeat from core client for 30 sec - exiting
10:07:12 (12115): No heartbeat from core client for 30 sec - exiting
10:07:13 (12115): No heartbeat from core client for 30 sec - exiting
10:07:14 (12115): No heartbeat from core client for 30 sec - exiting
10:07:15 (12115): No heartbeat from core client for 30 sec - exiting
10:07:16 (12115): No heartbeat from core client for 30 sec - exiting
10:07:17 (12115): No heartbeat from core client for 30 sec - exiting
10:07:18 (12115): No heartbeat from core client for 30 sec - exiting
10:07:19 (12115): No heartbeat from core client for 30 sec - exiting
10:07:20 (12115): No heartbeat from core client for 30 sec - exiting
10:07:21 (12115): No heartbeat from core client for 30 sec - exiting
10:07:22 (12115): No heartbeat from core client for 30 sec - exiting
10:07:23 (12115): No heartbeat from core client for 30 sec - exiting
10:07:24 (12115): No heartbeat from core client for 30 sec - exiting
10:07:25 (12115): No heartbeat from core client for 30 sec - exiting
10:07:26 (12115): No heartbeat from core client for 30 sec - exiting
10:07:27 (12115): No heartbeat from core client for 30 sec - exiting
10:07:28 (12115): No heartbeat from core client for 30 sec - exiting
10:07:29 (12115): No heartbeat from core client for 30 sec - exiting
10:07:30 (12115): No heartbeat from core client for 30 sec - exiting
10:07:31 (12115): No heartbeat from core client for 30 sec - exiting
10:07:32 (12115): No heartbeat from core client for 30 sec - exiting
10:07:33 (12115): No heartbeat from core client for 30 sec - exiting
10:07:34 (12115): No heartbeat from core client for 30 sec - exiting
10:07:35 (12115): No heartbeat from core client for 30 sec - exiting
10:07:36 (12115): No heartbeat from core client for 30 sec - exiting
10:07:37 (12115): No heartbeat from core client for 30 sec - exiting
10:07:38 (12115): No heartbeat from core client for 30 sec - exiting
10:07:40 (12115): No heartbeat from core client for 30 sec - exiting
10:07:41 (12115): No heartbeat from core client for 30 sec - exiting
10:07:42 (12115): No heartbeat from core client for 30 sec - exiting
10:07:43 (12115): No heartbeat from core client for 30 sec - exiting
10:07:44 (12115): No heartbeat from core client for 30 sec - exiting
10:07:45 (12115): No heartbeat from core client for 30 sec - exiting
10:07:46 (12115): No heartbeat from core client for 30 sec - exiting
10:07:47 (12115): No heartbeat from core client for 30 sec - exiting
10:07:48 (12115): No heartbeat from core client for 30 sec - exiting
10:07:49 (12115): No heartbeat from core client for 30 sec - exiting
10:07:50 (12115): No heartbeat from core client for 30 sec - exiting
10:07:51 (12115): No heartbeat from core client for 30 sec - exiting
10:07:52 (12115): No heartbeat from core client for 30 sec - exiting
10:07:53 (12115): No heartbeat from core client for 30 sec - exiting
10:07:54 (12115): No heartbeat from core client for 30 sec - exiting
10:07:55 (12115): No heartbeat from core client for 30 sec - exiting
10:07:56 (12115): No heartbeat from core client for 30 sec - exiting
10:07:57 (12115): No heartbeat from core client for 30 sec - exiting
10:07:58 (12115): No heartbeat from core client for 30 sec - exiting
10:07:59 (12115): No heartbeat from core client for 30 sec - exiting
10:08:00 (12115): No heartbeat from core client for 30 sec - exiting
10:08:01 (12115): No heartbeat from core client for 30 sec - exiting
10:08:02 (12115): No heartbeat from core client for 30 sec - exiting
10:08:03 (12115): No heartbeat from core client for 30 sec - exiting
10:08:04 (12115): No heartbeat from core client for 30 sec - exiting
10:08:05 (12115): No heartbeat from core client for 30 sec - exiting
10:08:06 (12115): No heartbeat from core client for 30 sec - exiting
10:08:07 (12115): No heartbeat from core client for 30 sec - exiting
10:08:08 (12115): No heartbeat from core client for 30 sec - exiting
10:08:09 (12115): No heartbeat from core client for 30 sec - exiting
10:08:10 (12115): No heartbeat from core client for 30 sec - exiting
10:08:11 (12115): No heartbeat from core client for 30 sec - exiting
10:08:12 (12115): No heartbeat from core client for 30 sec - exiting
10:08:13 (12115): No heartbeat from core client for 30 sec - exiting
10:08:14 (12115): No heartbeat from core client for 30 sec - exiting
10:08:15 (12115): No heartbeat from core client for 30 sec - exiting
10:08:16 (12115): No heartbeat from core client for 30 sec - exiting
10:08:17 (12115): No heartbeat from core client for 30 sec - exiting
10:08:18 (12115): No heartbeat from core client for 30 sec - exiting
10:08:19 (12115): No heartbeat from core client for 30 sec - exiting
10:08:20 (12115): No heartbeat from core client for 30 sec - exiting
10:08:21 (12115): No heartbeat from core client for 30 sec - exiting
10:08:22 (12115): No heartbeat from core client for 30 sec - exiting
10:08:23 (12115): No heartbeat from core client for 30 sec - exiting
10:08:24 (12115): No heartbeat from core client for 30 sec - exiting
10:08:25 (12115): No heartbeat from core client for 30 sec - exiting
10:08:26 (12115): No heartbeat from core client for 30 sec - exiting
10:08:27 (12115): No heartbeat from core client for 30 sec - exiting
10:08:28 (12115): No heartbeat from core client for 30 sec - exiting
10:08:29 (12115): No heartbeat from core client for 30 sec - exiting
10:08:30 (12115): No heartbeat from core client for 30 sec - exiting
10:08:31 (12115): No heartbeat from core client for 30 sec - exiting
10:08:32 (12115): No heartbeat from core client for 30 sec - exiting
10:08:33 (12115): No heartbeat from core client for 30 sec - exiting
10:08:34 (12115): No heartbeat from core client for 30 sec - exiting
10:08:35 (12115): No heartbeat from core client for 30 sec - exiting
10:08:36 (12115): No heartbeat from core client for 30 sec - exiting
10:08:37 (12115): No heartbeat from core client for 30 sec - exiting
10:08:38 (12115): No heartbeat from core client for 30 sec - exiting
10:08:39 (12115): No heartbeat from core client for 30 sec - exiting
10:08:40 (12115): No heartbeat from core client for 30 sec - exiting
10:08:41 (12115): No heartbeat from core client for 30 sec - exiting
10:08:42 (12115): No heartbeat from core client for 30 sec - exiting
10:08:43 (12115): No heartbeat from core client for 30 sec - exiting
10:08:44 (12115): No heartbeat from core client for 30 sec - exiting
10:08:45 (12115): No heartbeat from core client for 30 sec - exiting
10:08:46 (12115): No heartbeat from core client for 30 sec - exiting
10:08:47 (12115): No heartbeat from core client for 30 sec - exiting
10:08:48 (12115): No heartbeat from core client for 30 sec - exiting
10:08:49 (12115): No heartbeat from core client for 30 sec - exiting
10:08:50 (12115): No heartbeat from core client for 30 sec - exiting
10:08:51 (12115): No heartbeat from core client for 30 sec - exiting
10:08:52 (12115): No heartbeat from core client for 30 sec - exiting
10:08:53 (12115): No heartbeat from core client for 30 sec - exiting
10:08:54 (12115): No heartbeat from core client for 30 sec - exiting
10:08:55 (12115): No heartbeat from core client for 30 sec - exiting
10:08:56 (12115): No heartbeat from core client for 30 sec - exiting
10:08:57 (12115): No heartbeat from core client for 30 sec - exiting
10:08:58 (12115): No heartbeat from core client for 30 sec - exiting
10:08:59 (12115): No heartbeat from core client for 30 sec - exiting
10:09:01 (12115): No heartbeat from core client for 30 sec - exiting
10:09:02 (12115): No heartbeat from core client for 30 sec - exiting
10:09:03 (12115): No heartbeat from core client for 30 sec - exiting
10:09:04 (12115): No heartbeat from core client for 30 sec - exiting
10:09:05 (12115): No heartbeat from core client for 30 sec - exiting
10:09:06 (12115): No heartbeat from core client for 30 sec - exiting
10:09:07 (12115): No heartbeat from core client for 30 sec - exiting
10:09:08 (12115): No heartbeat from core client for 30 sec - exiting
10:09:09 (12115): No heartbeat from core client for 30 sec - exiting
10:09:10 (12115): No heartbeat from core client for 30 sec - exiting
10:09:11 (12115): No heartbeat from core client for 30 sec - exiting
10:09:12 (12115): No heartbeat from core client for 30 sec - exiting
10:09:13 (12115): No heartbeat from core client for 30 sec - exiting
10:09:14 (12115): No heartbeat from core client for 30 sec - exiting
10:09:15 (12115): No heartbeat from core client for 30 sec - exiting
10:09:16 (12115): No heartbeat from core client for 30 sec - exiting
10:09:17 (12115): No heartbeat from core client for 30 sec - exiting
10:09:18 (12115): No heartbeat from core client for 30 sec - exiting
10:09:19 (12115): No heartbeat from core client for 30 sec - exiting
10:09:20 (12115): No heartbeat from core client for 30 sec - exiting
10:09:21 (12115): No heartbeat from core client for 30 sec - exiting
10:09:22 (12115): No heartbeat from core client for 30 sec - exiting
10:09:23 (12115): No heartbeat from core client for 30 sec - exiting
10:09:24 (12115): No heartbeat from core client for 30 sec - exiting
10:09:25 (12115): No heartbeat from core client for 30 sec - exiting
10:09:26 (12115): No heartbeat from core client for 30 sec - exiting
10:09:27 (12115): No heartbeat from core client for 30 sec - exiting
10:09:28 (12115): No heartbeat from core client for 30 sec - exiting
10:09:29 (12115): No heartbeat from core client for 30 sec - exiting
10:09:30 (12115): No heartbeat from core client for 30 sec - exiting
10:09:31 (12115): No heartbeat from core client for 30 sec - exiting
10:09:32 (12115): No heartbeat from core client for 30 sec - exiting
10:09:33 (12115): No heartbeat from core client for 30 sec - exiting
10:09:34 (12115): No heartbeat from core client for 30 sec - exiting
10:09:35 (12115): No heartbeat from core client for 30 sec - exiting
10:09:36 (12115): No heartbeat from core client for 30 sec - exiting
10:09:37 (12115): No heartbeat from core client for 30 sec - exiting
10:09:38 (12115): No heartbeat from core client for 30 sec - exiting
10:09:39 (12115): No heartbeat from core client for 30 sec - exiting
10:09:40 (12115): No heartbeat from core client for 30 sec - exiting
10:09:41 (12115): No heartbeat from core client for 30 sec - exiting
10:09:42 (12115): No heartbeat from core client for 30 sec - exiting
10:09:43 (12115): No heartbeat from core client for 30 sec - exiting
10:09:44 (12115): No heartbeat from core client for 30 sec - exiting
10:09:45 (12115): No heartbeat from core client for 30 sec - exiting
10:09:46 (12115): No heartbeat from core client for 30 sec - exiting
10:09:47 (12115): No heartbeat from core client for 30 sec - exiting
10:09:48 (12115): No heartbeat from core client for 30 sec - exiting
10:09:49 (12115): No heartbeat from core client for 30 sec - exiting
10:09:50 (12115): No heartbeat from core client for 30 sec - exiting
10:09:51 (12115): No heartbeat from core client for 30 sec - exiting
10:09:52 (12115): No heartbeat from core client for 30 sec - exiting
10:09:53 (12115): No heartbeat from core client for 30 sec - exiting
10:09:54 (12115): No heartbeat from core client for 30 sec - exiting
10:09:55 (12115): No heartbeat from core client for 30 sec - exiting
10:09:56 (12115): No heartbeat from core client for 30 sec - exiting
10:09:57 (12115): No heartbeat from core client for 30 sec - exiting
10:09:58 (12115): No heartbeat from core client for 30 sec - exiting
10:09:59 (12115): No heartbeat from core client for 30 sec - exiting
10:10:00 (12115): No heartbeat from core client for 30 sec - exiting
10:10:01 (12115): No heartbeat from core client for 30 sec - exiting
10:10:02 (12115): No heartbeat from core client for 30 sec - exiting
10:10:03 (12115): No heartbeat from core client for 30 sec - exiting
10:10:04 (12115): No heartbeat from core client for 30 sec - exiting
10:10:05 (12115): No heartbeat from core client for 30 sec - exiting
10:10:06 (12115): No heartbeat from core client for 30 sec - exiting
10:10:07 (12115): No heartbeat from core client for 30 sec - exiting
10:10:08 (12115): No heartbeat from core client for 30 sec - exiting
10:10:09 (12115): No heartbeat from core client for 30 sec - exiting
10:10:10 (12115): No heartbeat from core client for 30 sec - exiting
10:10:11 (12115): No heartbeat from core client for 30 sec - exiting
10:10:12 (12115): No heartbeat from core client for 30 sec - exiting
10:10:13 (12115): No heartbeat from core client for 30 sec - exiting
10:10:14 (12115): No heartbeat from core client for 30 sec - exiting
10:10:16 (12115): No heartbeat from core client for 30 sec - exiting
10:10:17 (12115): No heartbeat from core client for 30 sec - exiting
10:10:18 (12115): No heartbeat from core client for 30 sec - exiting
10:10:19 (12115): No heartbeat from core client for 30 sec - exiting
10:10:20 (12115): No heartbeat from core client for 30 sec - exiting
10:10:21 (12115): No heartbeat from core client for 30 sec - exiting
10:10:22 (12115): No heartbeat from core client for 30 sec - exiting
10:10:23 (12115): No heartbeat from core client for 30 sec - exiting
10:10:24 (12115): No heartbeat from core client for 30 sec - exiting
Signal 15 received, exiting...
Called boinc_finish
Signal 15 received, exiting...
Called boinc_finish
hadcm3n_6.07_i686-apple-darwin(2894,0xac7102c0) malloc: *** error for object 0x1280804: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(2894,0xac7102c0) malloc: *** error for object 0x1280800: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(2894,0xac7102c0) malloc: *** error for object 0xa7fa04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(2894,0xac7102c0) malloc: *** error for object 0xa7fa00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(2894,0xac7102c0) malloc: *** error for object 0xa7fa04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(2894,0xac7102c0) malloc: *** error for object 0xa7fa00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(2894,0xac7102c0) malloc: *** error for object 0xa7fa04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(2894,0xac7102c0) malloc: *** error for object 0xa7fa00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(2894,0xac7102c0) malloc: *** error for object 0x127fa04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(2894,0xac7102c0) malloc: *** error for object 0x1280804: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
hadcm3n_6.07_i686-apple-darwin(2894,0xac7102c0) malloc: *** error for object 0xaa4a04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(2894,0xac7102c0) malloc: *** error for object 0xaa5c04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(2894,0xac7102c0) malloc: *** error for object 0xaa9c04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(2894,0xac7102c0) malloc: *** error for object 0xaa9c00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug

Crashed executable name: hadcm3n_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.7.3 build 11D50b
Sun Feb 12 21:42:18 2012

SIGSEGV: segmentation violation
hadcm3n_6.07_i686-apple-darwin(59871,0xac7102c0) malloc: *** error for object 0x13f6004: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(59871,0xac7102c0) malloc: *** error for object 0x13f6000: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(59871,0xac7102c0) malloc: *** error for object 0x13f6004: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(59871,0xac7102c0) malloc: *** error for object 0x13f6000: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(59871,0xac7102c0) malloc: *** error for object 0x13f6004: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(59871,0xac7102c0) malloc: *** error for object 0x13f6000: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(59871,0xac7102c0) malloc: *** error for object 0x13f6004: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(59871,0xac7102c0) malloc: *** error for object 0x13f6000: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(59871,0xac7102c0) malloc: *** error for object 0x13f6004: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(59871,0xac7102c0) malloc: *** error for object 0x13f6000: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(59871,0xac7102c0) malloc: *** error for object 0x13f6004: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(59871,0xac7102c0) malloc: *** error for object 0x13f6000: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
03 Mar 2012 17:28:34 1191378 13923112 hadcm3n_u18h_1980_40_007682174_0 699,840 893,566 1.2768
03 Mar 2012 05:55:48 1191378 13923112 hadcm3n_u18h_1980_40_007682174_0 673,920 860,669 1.2771
02 Mar 2012 20:00:42 1191378 13923112 hadcm3n_u18h_1980_40_007682174_0 648,000 827,689 1.2773
01 Mar 2012 17:22:21 1191378 13923112 hadcm3n_u18h_1980_40_007682174_0 622,080 794,603 1.2773
01 Mar 2012 07:39:41 1191378 13923112 hadcm3n_u18h_1980_40_007682174_0 596,160 761,597 1.2775
29 Feb 2012 13:06:47 1191378 13923112 hadcm3n_u18h_1980_40_007682174_0 570,240 729,064 1.2785
22 Feb 2012 04:12:50 1191378 13923112 hadcm3n_u18h_1980_40_007682174_0 544,320 695,278 1.2773
04 Feb 2012 22:28:53 1191378 13923112 hadcm3n_u18h_1980_40_007682174_0 518,400 662,214 1.2774
04 Feb 2012 03:15:36 1191378 13923112 hadcm3n_u18h_1980_40_007682174_0 492,480 629,423 1.2781
03 Feb 2012 08:47:36 1191378 13923112 hadcm3n_u18h_1980_40_007682174_0 466,560 595,827 1.2771
02 Feb 2012 12:15:38 1191378 13923112 hadcm3n_u18h_1980_40_007682174_0 440,640 562,228 1.2759
01 Feb 2012 16:43:50 1191378 13923112 hadcm3n_u18h_1980_40_007682174_0 414,720 528,924 1.2754
31 Jan 2012 22:16:25 1191378 13923112 hadcm3n_u18h_1980_40_007682174_0 388,800 495,942 1.2756
31 Jan 2012 04:58:11 1191378 13923112 hadcm3n_u18h_1980_40_007682174_0 362,880 463,139 1.2763
30 Jan 2012 10:30:01 1191378 13923112 hadcm3n_u18h_1980_40_007682174_0 336,960 430,078 1.2763
29 Jan 2012 03:26:51 1191378 13923112 hadcm3n_u18h_1980_40_007682174_0 311,040 397,056 1.2765
28 Jan 2012 09:23:26 1191378 13923112 hadcm3n_u18h_1980_40_007682174_0 285,120 363,544 1.2751
27 Jan 2012 13:28:43 1191378 13923112 hadcm3n_u18h_1980_40_007682174_0 259,200 329,625 1.2717
25 Jan 2012 15:12:44 1191378 13923112 hadcm3n_u18h_1980_40_007682174_0 233,280 296,011 1.2689
24 Jan 2012 17:58:48 1191378 13923112 hadcm3n_u18h_1980_40_007682174_0 207,360 263,047 1.2686


©2024 cpdn.org