Task 12775153

Name	hadcm3n_o4tg_1900_40_007201575_2
Workunit	7399855
Created	5 Apr 2011, 16:43:47 UTC
Sent	5 Apr 2011, 16:44:14 UTC
Report deadline	6 Jul 2011, 0:11:25 UTC
Received	12 May 2011, 20:19:10 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	940645
Run time	5 days 8 hours 37 min 1 sec
CPU time	4 days 17 hours 5 min 45 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.93 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:24:49 (29903): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:56:59 (88541): No heartbeat from core client for 30 sec - exiting 08:57:00 (88541): No heartbeat from core client for 30 sec - exiting 08:57:01 (88541): No heartbeat from core client for 30 sec - exiting 08:57:02 (88541): No heartbeat from core client for 30 sec - exiting 08:57:03 (88541): No heartbeat from core client for 30 sec - exiting 08:57:04 (88541): No heartbeat from core client for 30 sec - exiting 08:57:05 (88541): No heartbeat from core client for 30 sec - exiting 08:57:06 (88541): No heartbeat from core client for 30 sec - exiting 08:57:07 (88541): No heartbeat from core client for 30 sec - exiting 08:57:08 (88541): No heartbeat from core client for 30 sec - exiting 08:57:09 (88541): No heartbeat from core client for 30 sec - exiting 08:57:10 (88541): No heartbeat from core client for 30 sec - exiting 08:57:11 (88541): No heartbeat from core client for 30 sec - exiting 08:57:12 (88541): No heartbeat from core client for 30 sec - exiting 08:57:13 (88541): No heartbeat from core client for 30 sec - exiting 08:57:14 (88541): No heartbeat from core client for 30 sec - exiting 08:57:15 (88541): No heartbeat from core client for 30 sec - exiting 08:57:16 (88541): No heartbeat from core client for 30 sec - exiting 08:57:17 (88541): No heartbeat from core client for 30 sec - exiting 08:57:18 (88541): No heartbeat from core client for 30 sec - exiting 08:57:19 (88541): No heartbeat from core client for 30 sec - exiting 08:57:20 (88541): No heartbeat from core client for 30 sec - exiting 08:57:21 (88541): No heartbeat from core client for 30 sec - exiting 08:57:22 (88541): No heartbeat from core client for 30 sec - exiting 08:57:23 (88541): No heartbeat from core client for 30 sec - exiting 08:57:24 (88541): No heartbeat from core client for 30 sec - exiting 08:57:25 (88541): No heartbeat from core client for 30 sec - exiting 08:57:26 (88541): No heartbeat from core client for 30 sec - exiting 08:57:27 (88541): No heartbeat from core client for 30 sec - exiting 08:57:28 (88541): No heartbeat from core client for 30 sec - exiting 08:57:29 (88541): No heartbeat from core client for 30 sec - exiting 08:57:30 (88541): No heartbeat from core client for 30 sec - exiting 08:57:31 (88541): No heartbeat from core client for 30 sec - exiting 08:57:32 (88541): No heartbeat from core client for 30 sec - exiting 08:57:33 (88541): No heartbeat from core client for 30 sec - exiting 08:57:34 (88541): No heartbeat from core client for 30 sec - exiting 08:57:35 (88541): No heartbeat from core client for 30 sec - exiting 08:57:36 (88541): No heartbeat from core client for 30 sec - exiting 08:57:37 (88541): No heartbeat from core client for 30 sec - exiting 08:57:38 (88541): No heartbeat from core client for 30 sec - exiting 08:57:39 (88541): No heartbeat from core client for 30 sec - exiting 08:57:40 (88541): No heartbeat from core client for 30 sec - exiting 08:57:41 (88541): No heartbeat from core client for 30 sec - exiting 08:57:42 (88541): No heartbeat from core client for 30 sec - exiting 08:57:43 (88541): No heartbeat from core client for 30 sec - exiting 08:57:44 (88541): No heartbeat from core client for 30 sec - exiting 08:57:45 (88541): No heartbeat from core client for 30 sec - exiting 08:57:46 (88541): No heartbeat from core client for 30 sec - exiting 08:57:47 (88541): No heartbeat from core client for 30 sec - exiting 08:57:48 (88541): No heartbeat from core client for 30 sec - exiting 08:57:49 (88541): No heartbeat from core client for 30 sec - exiting 08:57:50 (88541): No heartbeat from core client for 30 sec - exiting 08:57:51 (88541): No heartbeat from core client for 30 sec - exiting 08:57:52 (88541): No heartbeat from core client for 30 sec - exiting 08:57:53 (88541): No heartbeat from core client for 30 sec - exiting 08:57:54 (88541): No heartbeat from core client for 30 sec - exiting 08:57:55 (88541): No heartbeat from core client for 30 sec - exiting 08:57:56 (88541): No heartbeat from core client for 30 sec - exiting 08:57:57 (88541): No heartbeat from core client for 30 sec - exiting 08:57:58 (88541): No heartbeat from core client for 30 sec - exiting 08:57:59 (88541): No heartbeat from core client for 30 sec - exiting 08:58:00 (88541): No heartbeat from core client for 30 sec - exiting 08:58:01 (88541): No heartbeat from core client for 30 sec - exiting 08:58:02 (88541): No heartbeat from core client for 30 sec - exiting 08:58:03 (88541): No heartbeat from core client for 30 sec - exiting 08:58:04 (88541): No heartbeat from core client for 30 sec - exiting 08:58:05 (88541): No heartbeat from core client for 30 sec - exiting 08:58:06 (88541): No heartbeat from core client for 30 sec - exiting 08:58:07 (88541): No heartbeat from core client for 30 sec - exiting 08:58:08 (88541): No heartbeat from core client for 30 sec - exiting 08:58:09 (88541): No heartbeat from core client for 30 sec - exiting 08:58:10 (88541): No heartbeat from core client for 30 sec - exiting 08:58:11 (88541): No heartbeat from core client for 30 sec - exiting 08:58:12 (88541): No heartbeat from core client for 30 sec - exiting 08:58:13 (88541): No heartbeat from core client for 30 sec - exiting 08:58:14 (88541): No heartbeat from core client for 30 sec - exiting 08:58:15 (88541): No heartbeat from core client for 30 sec - exiting 08:58:16 (88541): No heartbeat from core client for 30 sec - exiting 08:58:17 (88541): No heartbeat from core client for 30 sec - exiting 08:58:18 (88541): No heartbeat from core client for 30 sec - exiting 08:58:19 (88541): No heartbeat from core client for 30 sec - exiting 08:58:20 (88541): No heartbeat from core client for 30 sec - exiting 08:58:21 (88541): No heartbeat from core client for 30 sec - exiting 08:58:22 (88541): No heartbeat from core client for 30 sec - exiting 08:58:23 (88541): No heartbeat from core client for 30 sec - exiting 08:58:24 (88541): No heartbeat from core client for 30 sec - exiting 08:58:25 (88541): No heartbeat from core client for 30 sec - exiting 08:58:26 (88541): No heartbeat from core client for 30 sec - exiting 08:58:27 (88541): No heartbeat from core client for 30 sec - exiting 08:58:28 (88541): No heartbeat from core client for 30 sec - exiting 08:58:29 (88541): No heartbeat from core client for 30 sec - exiting 08:58:30 (88541): No heartbeat from core client for 30 sec - exiting 08:58:31 (88541): No heartbeat from core client for 30 sec - exiting 08:58:32 (88541): No heartbeat from core client for 30 sec - exiting 08:58:33 (88541): No heartbeat from core client for 30 sec - exiting 08:58:34 (88541): No heartbeat from core client for 30 sec - exiting 08:58:35 (88541): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:16:45 (13828): No heartbeat from core client for 30 sec - exiting 15:16:46 (13828): No heartbeat from core client for 30 sec - exiting 15:16:47 (13828): No heartbeat from core client for 30 sec - exiting 15:16:48 (13828): No heartbeat from core client for 30 sec - exiting 15:16:49 (13828): No heartbeat from core client for 30 sec - exiting 15:16:50 (13828): No heartbeat from core client for 30 sec - exiting 15:16:51 (13828): No heartbeat from core client for 30 sec - exiting 15:16:52 (13828): No heartbeat from core client for 30 sec - exiting 15:16:53 (13828): No heartbeat from core client for 30 sec - exiting 15:16:54 (13828): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 08:56:31 (53514): No heartbeat from core client for 30 sec - exiting 08:56:33 (53514): No heartbeat from core client for 30 sec - exiting 08:56:34 (53514): No heartbeat from core client for 30 sec - exiting 08:56:35 (53514): No heartbeat from core client for 30 sec - exiting 08:56:36 (53514): No heartbeat from core client for 30 sec - exiting 08:56:37 (53514): No heartbeat from core client for 30 sec - exiting 08:56:38 (53514): No heartbeat from core client for 30 sec - exiting 08:56:39 (53514): No heartbeat from core client for 30 sec - exiting 08:56:40 (53514): No heartbeat from core client for 30 sec - exiting 08:56:41 (53514): No heartbeat from core client for 30 sec - exiting 08:56:42 (53514): No heartbeat from core client for 30 sec - exiting 08:56:43 (53514): No heartbeat from core client for 30 sec - exiting 08:56:44 (53514): No heartbeat from core client for 30 sec - exiting 08:56:45 (53514): No heartbeat from core client for 30 sec - exiting 08:56:46 (53514): No heartbeat from core client for 30 sec - exiting 08:56:47 (53514): No heartbeat from core client for 30 sec - exiting 08:56:48 (53514): No heartbeat from core client for 30 sec - exiting 08:56:49 (53514): No heartbeat from core client for 30 sec - exiting 08:56:50 (53514): No heartbeat from core client for 30 sec - exiting 08:56:51 (53514): No heartbeat from core client for 30 sec - exiting 08:56:52 (53514): No heartbeat from core client for 30 sec - exiting 08:56:53 (53514): No heartbeat from core client for 30 sec - exiting 08:56:54 (53514): No heartbeat from core client for 30 sec - exiting 08:56:55 (53514): No heartbeat from core client for 30 sec - exiting 08:56:56 (53514): No heartbeat from core client for 30 sec - exiting 08:56:57 (53514): No heartbeat from core client for 30 sec - exiting 08:56:58 (53514): No heartbeat from core client for 30 sec - exiting 08:56:59 (53514): No heartbeat from core client for 30 sec - exiting 08:57:00 (53514): No heartbeat from core client for 30 sec - exiting 08:57:01 (53514): No heartbeat from core client for 30 sec - exiting 08:57:02 (53514): No heartbeat from core client for 30 sec - exiting 08:57:03 (53514): No heartbeat from core client for 30 sec - exiting 08:57:04 (53514): No heartbeat from core client for 30 sec - exiting 08:57:05 (53514): No heartbeat from core client for 30 sec - exiting 08:57:06 (53514): No heartbeat from core client for 30 sec - exiting 08:57:07 (53514): No heartbeat from core client for 30 sec - exiting 08:57:08 (53514): No heartbeat from core client for 30 sec - exiting 08:57:09 (53514): No heartbeat from core client for 30 sec - exiting 08:57:10 (53514): No heartbeat from core client for 30 sec - exiting 08:57:11 (53514): No heartbeat from core client for 30 sec - exiting 08:57:12 (53514): No heartbeat from core client for 30 sec - exiting 08:57:13 (53514): No heartbeat from core client for 30 sec - exiting 08:57:14 (53514): No heartbeat from core client for 30 sec - exiting 08:57:15 (53514): No heartbeat from core client for 30 sec - exiting 08:57:16 (53514): No heartbeat from core client for 30 sec - exiting 08:57:17 (53514): No heartbeat from core client for 30 sec - exiting 08:57:18 (53514): No heartbeat from core client for 30 sec - exiting 08:57:19 (53514): No heartbeat from core client for 30 sec - exiting 08:57:20 (53514): No heartbeat from core client for 30 sec - exiting 08:57:21 (53514): No heartbeat from core client for 30 sec - exiting 08:57:22 (53514): No heartbeat from core client for 30 sec - exiting 08:57:23 (53514): No heartbeat from core client for 30 sec - exiting 08:57:24 (53514): No heartbeat from core client for 30 sec - exiting 08:57:25 (53514): No heartbeat from core client for 30 sec - exiting 08:57:26 (53514): No heartbeat from core client for 30 sec - exiting 08:57:27 (53514): No heartbeat from core client for 30 sec - exiting 08:57:28 (53514): No heartbeat from core client for 30 sec - exiting 08:57:29 (53514): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:35:34 (517): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:35:35 (517): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:58:58 (24662): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:00:03 (49404): No heartbeat from core client for 30 sec - exiting 09:00:05 (49404): No heartbeat from core client for 30 sec - exiting 09:00:06 (49404): No heartbeat from core client for 30 sec - exiting 09:00:07 (49404): No heartbeat from core client for 30 sec - exiting 09:00:08 (49404): No heartbeat from core client for 30 sec - exiting 09:00:09 (49404): No heartbeat from core client for 30 sec - exiting 09:00:10 (49404): No heartbeat from core client for 30 sec - exiting 09:00:11 (49404): No heartbeat from core client for 30 sec - exiting 09:00:12 (49404): No heartbeat from core client for 30 sec - exiting 09:00:13 (49404): No heartbeat from core client for 30 sec - exiting 09:00:14 (49404): No heartbeat from core client for 30 sec - exiting 09:00:15 (49404): No heartbeat from core client for 30 sec - exiting 09:00:16 (49404): No heartbeat from core client for 30 sec - exiting 09:00:17 (49404): No heartbeat from core client for 30 sec - exiting 09:00:18 (49404): No heartbeat from core client for 30 sec - exiting 09:00:19 (49404): No heartbeat from core client for 30 sec - exiting 09:00:20 (49404): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:09:53 (25675): No heartbeat from core client for 30 sec - exiting 15:09:54 (25675): No heartbeat from core client for 30 sec - exiting 15:09:55 (25675): No heartbeat from core client for 30 sec - exiting 15:09:56 (25675): No heartbeat from core client for 30 sec - exiting 15:09:57 (25675): No heartbeat from core client for 30 sec - exiting 15:09:58 (25675): No heartbeat from core client for 30 sec - exiting 15:09:59 (25675): No heartbeat from core client for 30 sec - exiting 15:10:00 (25675): No heartbeat from core client for 30 sec - exiting 15:10:01 (25675): No heartbeat from core client for 30 sec - exiting 15:10:02 (25675): No heartbeat from core client for 30 sec - exiting 15:10:03 (25675): No heartbeat from core client for 30 sec - exiting 15:10:04 (25675): No heartbeat from core client for 30 sec - exiting 15:10:05 (25675): No heartbeat from core client for 30 sec - exiting 15:10:06 (25675): No heartbeat from core client for 30 sec - exiting 15:10:07 (25675): No heartbeat from core client for 30 sec - exiting 15:10:08 (25675): No heartbeat from core client for 30 sec - exiting 15:10:09 (25675): No heartbeat from core client for 30 sec - exiting 15:10:10 (25675): No heartbeat from core client for 30 sec - exiting 15:10:11 (25675): No heartbeat from core client for 30 sec - exiting 15:10:12 (25675): No heartbeat from core client for 30 sec - exiting 15:10:13 (25675): No heartbeat from core client for 30 sec - exiting 15:10:14 (25675): No heartbeat from core client for 30 sec - exiting 15:10:15 (25675): No heartbeat from core client for 30 sec - exiting 15:10:16 (25675): No heartbeat from core client for 30 sec - exiting 15:10:17 (25675): No heartbeat from core client for 30 sec - exiting 15:10:18 (25675): No heartbeat from core client for 30 sec - exiting 15:10:19 (25675): No heartbeat from core client for 30 sec - exiting 15:10:20 (25675): No heartbeat from core client for 30 sec - exiting 15:10:21 (25675): No heartbeat from core client for 30 sec - exiting 15:10:22 (25675): No heartbeat from core client for 30 sec - exiting 15:10:23 (25675): No heartbeat from core client for 30 sec - exiting 15:10:24 (25675): No heartbeat from core client for 30 sec - exiting 15:10:25 (25675): No heartbeat from core client for 30 sec - exiting 15:10:26 (25675): No heartbeat from core client for 30 sec - exiting 15:10:27 (25675): No heartbeat from core client for 30 sec - exiting 15:10:28 (25675): No heartbeat from core client for 30 sec - exiting 15:10:29 (25675): No heartbeat from core client for 30 sec - exiting 15:10:30 (25675): No heartbeat from core client for 30 sec - exiting 15:10:31 (25675): No heartbeat from core client for 30 sec - exiting 15:10:32 (25675): No heartbeat from core client for 30 sec - exiting 15:10:33 (25675): No heartbeat from core client for 30 sec - exiting 15:10:34 (25675): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:40:01 (29363): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 23:31:11 (44724): No heartbeat from core client for 30 sec - exiting 23:31:12 (44724): No heartbeat from core client for 30 sec - exiting 23:31:13 (44724): No heartbeat from core client for 30 sec - exiting 23:31:14 (44724): No heartbeat from core client for 30 sec - exiting 23:31:15 (44724): No heartbeat from core client for 30 sec - exiting 23:31:16 (44724): No heartbeat from core client for 30 sec - exiting 23:31:17 (44724): No heartbeat from core client for 30 sec - exiting 23:31:18 (44724): No heartbeat from core client for 30 sec - exiting 23:31:19 (44724): No heartbeat from core client for 30 sec - exiting 23:31:20 (44724): No heartbeat from core client for 30 sec - exiting 23:31:21 (44724): No heartbeat from core client for 30 sec - exiting 23:31:22 (44724): No heartbeat from core client for 30 sec - exiting 23:31:23 (44724): No heartbeat from core client for 30 sec - exiting 23:31:24 (44724): No heartbeat from core client for 30 sec - exiting 23:31:25 (44724): No heartbeat from core client for 30 sec - exiting 23:31:26 (44724): No heartbeat from core client for 30 sec - exiting 23:31:27 (44724): No heartbeat from core client for 30 sec - exiting 23:31:28 (44724): No heartbeat from core client for 30 sec - exiting 23:31:29 (44724): No heartbeat from core client for 30 sec - exiting 23:31:30 (44724): No heartbeat from core client for 30 sec - exiting 23:31:31 (44724): No heartbeat from core client for 30 sec - exiting 23:31:33 (44724): No heartbeat from core client for 30 sec - exiting 23:31:34 (44724): No heartbeat from core client for 30 sec - exiting 23:31:35 (44724): No heartbeat from core client for 30 sec - exiting 23:31:36 (44724): No heartbeat from core client for 30 sec - exiting 23:31:37 (44724): No heartbeat from core client for 30 sec - exiting 23:31:38 (44724): No heartbeat from core client for 30 sec - exiting 23:31:39 (44724): No heartbeat from core client for 30 sec - exiting 23:31:40 (44724): No heartbeat from core client for 30 sec - exiting 23:31:41 (44724): No heartbeat from core client for 30 sec - exiting 23:31:42 (44724): No heartbeat from core client for 30 sec - exiting 23:31:43 (44724): No heartbeat from core client for 30 sec - exiting 23:31:44 (44724): No heartbeat from core client for 30 sec - exiting 23:31:45 (44724): No heartbeat from core client for 30 sec - exiting 23:31:46 (44724): No heartbeat from core client for 30 sec - exiting 23:31:47 (44724): No heartbeat from core client for 30 sec - exiting 23:31:48 (44724): No heartbeat from core client for 30 sec - exiting 23:31:49 (44724): No heartbeat from core client for 30 sec - exiting 23:31:50 (44724): No heartbeat from core client for 30 sec - exiting 23:31:51 (44724): No heartbeat from core client for 30 sec - exiting 23:31:52 (44724): No heartbeat from core client for 30 sec - exiting 23:31:53 (44724): No heartbeat from core client for 30 sec - exiting 23:31:54 (44724): No heartbeat from core client for 30 sec - exiting 23:31:55 (44724): No heartbeat from core client for 30 sec - exiting 23:31:56 (44724): No heartbeat from core client for 30 sec - exiting 23:31:57 (44724): No heartbeat from core client for 30 sec - exiting 23:31:58 (44724): No heartbeat from core client for 30 sec - exiting 23:31:59 (44724): No heartbeat from core client for 30 sec - exiting 23:32:00 (44724): No heartbeat from core client for 30 sec - exiting 23:32:01 (44724): No heartbeat from core client for 30 sec - exiting 23:32:02 (44724): No heartbeat from core client for 30 sec - exiting 23:32:03 (44724): No heartbeat from core client for 30 sec - exiting 23:32:04 (44724): No heartbeat from core client for 30 sec - exiting 23:32:05 (44724): No heartbeat from core client for 30 sec - exiting 23:32:06 (44724): No heartbeat from core client for 30 sec - exiting 23:32:07 (44724): No heartbeat from core client for 30 sec - exiting 23:32:08 (44724): No heartbeat from core client for 30 sec - exiting 23:32:09 (44724): No heartbeat from core client for 30 sec - exiting 23:32:10 (44724): No heartbeat from core client for 30 sec - exiting 23:32:11 (44724): No heartbeat from core client for 30 sec - exiting 23:32:12 (44724): No heartbeat from core client for 30 sec - exiting 23:32:13 (44724): No heartbeat from core client for 30 sec - exiting 23:32:14 (44724): No heartbeat from core client for 30 sec - exiting 23:32:15 (44724): No heartbeat from core client for 30 sec - exiting 23:32:16 (44724): No heartbeat from core client for 30 sec - exiting 23:32:17 (44724): No heartbeat from core client for 30 sec - exiting 23:32:18 (44724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:08:42 (78597): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:55:34 (2316): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:55:35 (2316): No heartbeat from core client for 30 sec - exiting 10:55:36 (2316): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(39904,0xa019c540) malloc: * error for object 0x2001c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(39904,0xa019c540) malloc: * error for object 0x2001c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(39904,0xa019c540) malloc: * error for object 0x2804404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(39904,0xa019c540) malloc: * error for object 0x2804400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(39904,0xa019c540) malloc: * error for object 0x2804404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(39904,0xa019c540) malloc: * error for object 0x2804400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(39904,0xa019c540) malloc: * error for object 0x2804404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(39904,0xa019c540) malloc: * error for object 0x2804400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(39904,0xa019c540) malloc: * error for object 0x2804404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(39904,0xa019c540) malloc: * error for object 0x2804400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(39904,0xa019c540) malloc: * error for object 0x2800e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Signal 3 received, exiting... Called boinc_finish hadcm3n_6.07_i686-apple-darwin(46941,0xa019c540) malloc: * error for object 0x82e804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(46941,0xa019c540) malloc: * error for object 0x82e800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(46941,0xa019c540) malloc: * error for object 0x82e804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(46941,0xa019c540) malloc: * error for object 0x82e800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(46941,0xa019c540) malloc: * error for object 0x82e804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation 09:09:43 (46941): No heartbeat from core client for 30 sec - exiting 09:09:44 (46941): No heartbeat from core client for 30 sec - exiting 09:09:45 (46941): No heartbeat from core client for 30 sec - exiting 09:09:46 (46941): No heartbeat from core client for 30 sec - exiting 09:09:47 (46941): No heartbeat from core client for 30 sec - exiting 09:09:48 (46941): No heartbeat from core client for 30 sec - exiting 10:31:26 (53708): No heartbeat from core client for 30 sec - exiting 10:31:27 (53708): No heartbeat from core client for 30 sec - exiting 10:31:28 (53708): No heartbeat from core client for 30 sec - exiting 10:31:29 (53708): No heartbeat from core client for 30 sec - exiting 10:31:30 (53708): No heartbeat from core client for 30 sec - exiting 10:31:31 (53708): No heartbeat from core client for 30 sec - exiting 10:31:32 (53708): No heartbeat from core client for 30 sec - exiting 10:31:33 (53708): No heartbeat from core client for 30 sec - exiting 10:31:34 (53708): No heartbeat from core client for 30 sec - exiting 10:31:35 (53708): No heartbeat from core client for 30 sec - exiting 10:31:36 (53708): No heartbeat from core client for 30 sec - exiting 10:31:37 (53708): No heartbeat from core client for 30 sec - exiting hadcm3n_6.07_i686-apple-darwin(53708,0xa019c540) malloc: * error for object 0x800e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(53708,0xa019c540) malloc: * error for object 0x800e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(53708,0xa019c540) malloc: * error for object 0x800e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(53708,0xa019c540) malloc: * error for object 0x800e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(53708,0xa019c540) malloc: * error for object 0x800e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(53708,0xa019c540) malloc: * error for object 0x800e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(53708,0xa019c540) malloc: * error for object 0x800e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.6.7 build 10J869 Wed May 11 10:32:14 2011 hadcm3n_6.07_i686-apple-darwin(53708,0xa019c540) malloc: * error for object 0x2800e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug Thread 0 Crashed: atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin. 0 libSystem.B.dylib 0x91bb80a3 small_free_list_remove_ptr + 234 1 libSystem.B.dylib 0x91bb4b6c szone_free_definite_size + 3457 2 libSystem.B.dylib 0x91bb3b88 free + 244 3 hadcm3n_6.07_i686-apple-darwin 0x0000ba58 annual_cycle(std::vector<std::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::allocator<std::basic_string<char, std::char_traits<char>, std::allocator<char> > > > const, char const, int, int) + 3482 4 hadcm3n_6.07_i686-apple-darwin 0x0000d36b decadalMeans(int, char const) + 957 5 hadcm3n_6.07_i686-apple-darwin 0x000067ff doCM3Proc() + 185 6 hadcm3n_6.07_i686-apple-darwin 0x0000876a worker() + 2896 7 hadcm3n_6.07_i686-apple-darwin 0x00008aa9 main + 491 8 hadcm3n_6.07_i686-apple-darwin 0x00002676 start + 54 Thread 1: 0 libSystem.B.dylib 0x91bad1ae mach_wait_until + 10 1 libSystem.B.dylib 0x91c34809 nanosleep + 345 2 libSystem.B.dylib 0x91c346aa usleep + 61 3 hadcm3n_6.07_i686-apple-darwin 0x00071a7c boinc_sleep(double) + 188 4 hadcm3n_6.07_i686-apple-darwin 0x00067282 timer_thread(void) + 78 5 libSystem.B.dylib 0x91bda7fd _pthread_start + 345 6 libSystem.B.dylib 0x91bda682 thread_start + 34 Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8fa98 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x93fff /Library/Application Support/BOINC Data/slots/2/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin 0x91bac000 - 0x91d53fff /usr/lib/libSystem.B.dylib 0x931a9000 - 0x931b7fff /usr/lib/libz.1.dylib 0x93dcc000 - 0x93dcffff /usr/lib/system/libmathCommon.A.dylib 0x9720f000 - 0x97279fff /usr/lib/libstdc++.6.dylib Exiting... hadcm3n_6.07_i686-apple-darwin(53823,0xa019c540) malloc: * error for object 0x2829c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(53823,0xa019c540) malloc: * error for object 0x2829c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(53823,0xa019c540) malloc: * error for object 0x2829c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(53823,0xa019c540) malloc: * error for object 0x2829c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(53823,0xa019c540) malloc: * error for object 0x2829c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(53823,0xa019c540) malloc: * error for object 0x2829c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(53823,0xa019c540) malloc: * error for object 0x2829c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(53823,0xa019c540) malloc: * error for object 0x2829c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(53823,0xa019c540) malloc: * error for object 0x2829c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(53823,0xa019c540) malloc: * error for object 0x2829c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(53823,0xa019c540) malloc: * error for object 0x2829c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(53823,0xa019c540) malloc: * error for object 0x2829c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(60247,0xa019c540) malloc: * error for object 0x101d804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(60247,0xa019c540) malloc: * error for object 0x101e604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(60247,0xa019c540) malloc: * error for object 0x101e600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(60247,0xa019c540) malloc: * error for object 0x101e604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(60247,0xa019c540) malloc: * error for object 0x101e600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(60247,0xa019c540) malloc: * error for object 0x101e604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(60247,0xa019c540) malloc: * error for object 0x101e600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.6.7 build 10J869 Wed May 11 12:29:52 2011 Thread 0 Crashed: atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin. hadcm3n_6.07_i686-apple-darwin(62810,0xa019c540) malloc: * error for object 0x83a804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(62810,0xa019c540) malloc: * error for object 0x83a800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(62810,0xa019c540) malloc: * error for object 0x83a800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.6.7 build 10J869 Wed May 11 13:18:58 2011 Thread 0 Crashed: atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin. 0 libSystem.B.dylib 0x91bb80af small_free_list_remove_ptr + 246 1 libSystem.B.dylib 0x91bb4b6c szone_free_definite_size + 3457 2 libSystem.B.dylib 0x91bb3b88 free + 244 3 hadcm3n_6.07_i686-apple-darwin 0x0000ba58 annual_cycle(std::vector<std::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::allocator<std::basic_string<char, std::char_traits<char>, std::allocator<char> > > > const, char const, int, int) + 3482 4 hadcm3n_6.07_i686-apple-darwin 0x0000d36b decadalMeans(int, char const) + 957 5 hadcm3n_6.07_i686-apple-darwin 0x000067ff doCM3Proc() + 185 6 hadcm3n_6.07_i686-apple-darwin 0x0000876a worker() + 2896 7 hadcm3n_6.07_i686-apple-darwin 0x00008aa9 main + 491 8 hadcm3n_6.07_i686-apple-darwin 0x00002676 start + 54 Thread 1: 0 libSystem.B.dylib 0x91bad1ae mach_wait_until + 10 1 libSystem.B.dylib 0x91c34809 nanosleep + 345 2 libSystem.B.dylib 0x91c346aa usleep + 61 3 hadcm3n_6.07_i686-apple-darwin 0x00071a7c boinc_sleep(double) + 188 4 hadcm3n_6.07_i686-apple-darwin 0x00067282 timer_thread(void) + 78 5 libSystem.B.dylib 0x91bda7fd _pthread_start + 345 6 libSystem.B.dylib 0x91bda682 thread_start + 34 Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8fa98 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x93fff /Library/Application Support/BOINC Data/slots/2/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin 0x91bac000 - 0x91d53fff /usr/lib/libSystem.B.dylib 0x931a9000 - 0x931b7fff /usr/lib/libz.1.dylib 0x93dcc000 - 0x93dcffff /usr/lib/system/libmathCommon.A.dylib 0x9720f000 - 0x97279fff /usr/lib/libstdc++.6.dylib Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
11 May 2011 13:59:16	940645	12775153	hadcm3n_o4tg_1900_40_007201575_2	259,200	405,261	1.5635
11 May 2011 01:19:26	940645	12775153	hadcm3n_o4tg_1900_40_007201575_2	233,280	364,437	1.5622
09 May 2011 18:40:59	940645	12775153	hadcm3n_o4tg_1900_40_007201575_2	207,360	323,859	1.5618
05 May 2011 23:05:03	940645	12775153	hadcm3n_o4tg_1900_40_007201575_2	181,440	284,302	1.5669
02 May 2011 17:19:40	940645	12775153	hadcm3n_o4tg_1900_40_007201575_2	155,520	243,024	1.5627
23 Apr 2011 20:33:11	940645	12775153	hadcm3n_o4tg_1900_40_007201575_2	129,600	201,865	1.5576
22 Apr 2011 09:10:21	940645	12775153	hadcm3n_o4tg_1900_40_007201575_2	103,680	161,325	1.5560
21 Apr 2011 03:04:15	940645	12775153	hadcm3n_o4tg_1900_40_007201575_2	77,760	121,631	1.5642
20 Apr 2011 16:12:41	940645	12775153	hadcm3n_o4tg_1900_40_007201575_2	51,840	81,042	1.5633
20 Apr 2011 16:12:41	940645	12775153	hadcm3n_o4tg_1900_40_007201575_2	25,920	41,356	1.5955