Task 13394626

Name	hadcm3n_o27c_1940_40_007444820_4
Workunit	7642323
Created	18 Sep 2011, 0:08:09 UTC
Sent	18 Sep 2011, 0:12:55 UTC
Report deadline	18 Dec 2011, 7:40:06 UTC
Received	1 Oct 2011, 21:42:23 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1170047
Run time	4 days 15 hours 12 min 22 sec
CPU time	1 days 9 hours 4 min 11 sec
Validate state	Invalid
Credit	622.08
Device peak FLOPS	2.68 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>6.10.21</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:47:46 (54384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:47:50 (54384): No heartbeat from core client for 30 sec - exiting 20:47:51 (54384): No heartbeat from core client for 30 sec - exiting 20:47:52 (54384): No heartbeat from core client for 30 sec - exiting 20:47:53 (54384): No heartbeat from core client for 30 sec - exiting 20:47:54 (54384): No heartbeat from core client for 30 sec - exiting 20:47:55 (54384): No heartbeat from core client for 30 sec - exiting 20:47:56 (54384): No heartbeat from core client for 30 sec - exiting 20:47:57 (54384): No heartbeat from core client for 30 sec - exiting 20:47:58 (54384): No heartbeat from core client for 30 sec - exiting 20:47:59 (54384): No heartbeat from core client for 30 sec - exiting 20:48:00 (54384): No heartbeat from core client for 30 sec - exiting 20:48:01 (54384): No heartbeat from core client for 30 sec - exiting 20:48:02 (54384): No heartbeat from core client for 30 sec - exiting 20:48:03 (54384): No heartbeat from core client for 30 sec - exiting 20:48:04 (54384): No heartbeat from core client for 30 sec - exiting 20:48:05 (54384): No heartbeat from core client for 30 sec - exiting 20:48:06 (54384): No heartbeat from core client for 30 sec - exiting 20:48:07 (54384): No heartbeat from core client for 30 sec - exiting 20:48:08 (54384): No heartbeat from core client for 30 sec - exiting 20:48:09 (54384): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:12:06 (55453): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... SIGSEGV: segmentation violation 10:37:02 (11873): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:47:45 (12340): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:48:54 (20907): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:17:27 (21400): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:17:29 (21400): No heartbeat from core client for 30 sec - exiting 06:17:30 (21400): No heartbeat from core client for 30 sec - exiting 06:17:31 (21400): No heartbeat from core client for 30 sec - exiting 06:17:32 (21400): No heartbeat from core client for 30 sec - exiting 06:17:33 (21400): No heartbeat from core client for 30 sec - exiting 06:17:34 (21400): No heartbeat from core client for 30 sec - exiting 06:17:35 (21400): No heartbeat from core client for 30 sec - exiting 07:20:52 (30724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:23:59 (556): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:24:04 (556): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:38:21 (2358): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:09:00 (3333): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:09:03 (3333): No heartbeat from core client for 30 sec - exiting 22:09:04 (3333): No heartbeat from core client for 30 sec - exiting 22:09:05 (3333): No heartbeat from core client for 30 sec - exiting 22:09:06 (3333): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 23:13:14 (3983): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 06:14:35 (6681): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:06:01 (7390): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:06:03 (7390): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:16:39 (247): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:16:42 (247): No heartbeat from core client for 30 sec - exiting 17:16:43 (247): No heartbeat from core client for 30 sec - exiting 17:16:44 (247): No heartbeat from core client for 30 sec - exiting 17:16:45 (247): No heartbeat from core client for 30 sec - exiting 17:16:46 (247): No heartbeat from core client for 30 sec - exiting 17:16:47 (247): No heartbeat from core client for 30 sec - exiting 17:16:48 (247): No heartbeat from core client for 30 sec - exiting 17:16:49 (247): No heartbeat from core client for 30 sec - exiting 17:16:50 (247): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:05:54 (1966): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:27:05 (41875): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 05:45:25 (45386): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:25:30 (60160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:25:35 (60160): No heartbeat from core client for 30 sec - exiting 12:25:36 (60160): No heartbeat from core client for 30 sec - exiting 12:25:37 (60160): No heartbeat from core client for 30 sec - exiting 12:25:38 (60160): No heartbeat from core client for 30 sec - exiting 12:25:39 (60160): No heartbeat from core client for 30 sec - exiting 12:25:40 (60160): No heartbeat from core client for 30 sec - exiting 12:25:41 (60160): No heartbeat from core client for 30 sec - exiting 12:25:42 (60160): No heartbeat from core client for 30 sec - exiting 12:25:43 (60160): No heartbeat from core client for 30 sec - exiting 12:25:44 (60160): No heartbeat from core client for 30 sec - exiting 12:25:45 (60160): No heartbeat from core client for 30 sec - exiting 12:25:46 (60160): No heartbeat from core client for 30 sec - exiting 12:25:47 (60160): No heartbeat from core client for 30 sec - exiting 12:26:54 (62857): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:27:49 (62903): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:28:41 (62919): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:42:37 (62965): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:42:43 (62965): No heartbeat from core client for 30 sec - exiting 17:42:44 (62965): No heartbeat from core client for 30 sec - exiting 17:42:45 (62965): No heartbeat from core client for 30 sec - exiting 17:42:46 (62965): No heartbeat from core client for 30 sec - exiting 17:42:47 (62965): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 02:00:10 (246): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:00:51 (246): No heartbeat from core client for 30 sec - exiting 02:00:52 (246): No heartbeat from core client for 30 sec - exiting 02:00:53 (246): No heartbeat from core client for 30 sec - exiting 02:00:54 (246): No heartbeat from core client for 30 sec - exiting 02:00:55 (246): No heartbeat from core client for 30 sec - exiting 02:00:56 (246): No heartbeat from core client for 30 sec - exiting 02:00:57 (246): No heartbeat from core client for 30 sec - exiting 02:00:58 (246): No heartbeat from core client for 30 sec - exiting 02:00:59 (246): No heartbeat from core client for 30 sec - exiting 02:01:00 (246): No heartbeat from core client for 30 sec - exiting 02:01:01 (246): No heartbeat from core client for 30 sec - exiting 02:01:02 (246): No heartbeat from core client for 30 sec - exiting 02:01:03 (246): No heartbeat from core client for 30 sec - exiting 02:01:04 (246): No heartbeat from core client for 30 sec - exiting 02:01:05 (246): No heartbeat from core client for 30 sec - exiting 02:01:06 (246): No heartbeat from core client for 30 sec - exiting 02:01:07 (246): No heartbeat from core client for 30 sec - exiting 02:01:08 (246): No heartbeat from core client for 30 sec - exiting 02:01:09 (246): No heartbeat from core client for 30 sec - exiting 02:01:10 (246): No heartbeat from core client for 30 sec - exiting 02:01:11 (246): No heartbeat from core client for 30 sec - exiting 02:01:12 (246): No heartbeat from core client for 30 sec - exiting 02:01:13 (246): No heartbeat from core client for 30 sec - exiting 02:01:14 (246): No heartbeat from core client for 30 sec - exiting 02:01:15 (246): No heartbeat from core client for 30 sec - exiting 02:01:16 (246): No heartbeat from core client for 30 sec - exiting 02:01:17 (246): No heartbeat from core client for 30 sec - exiting 02:01:18 (246): No heartbeat from core client for 30 sec - exiting 05:42:24 (714): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:42:27 (714): No heartbeat from core client for 30 sec - exiting 05:43:20 (2271): No heartbeat from core client for 30 sec - exiting 05:43:21 (2271): No heartbeat from core client for 30 sec - exiting 05:43:22 (2271): No heartbeat from core client for 30 sec - exiting 05:43:23 (2271): No heartbeat from core client for 30 sec - exiting 05:43:24 (2271): No heartbeat from core client for 30 sec - exiting 05:43:25 (2271): No heartbeat from core client for 30 sec - exiting 05:43:26 (2271): No heartbeat from core client for 30 sec - exiting 05:43:27 (2271): No heartbeat from core client for 30 sec - exiting 05:43:28 (2271): No heartbeat from core client for 30 sec - exiting 05:43:29 (2271): No heartbeat from core client for 30 sec - exiting 05:43:30 (2271): No heartbeat from core client for 30 sec - exiting 05:43:31 (2271): No heartbeat from core client for 30 sec - exiting 05:43:32 (2271): No heartbeat from core client for 30 sec - exiting 05:43:33 (2271): No heartbeat from core client for 30 sec - exiting 05:43:34 (2271): No heartbeat from core client for 30 sec - exiting 05:43:35 (2271): No heartbeat from core client for 30 sec - exiting 05:43:36 (2271): No heartbeat from core client for 30 sec - exiting 05:43:37 (2271): No heartbeat from core client for 30 sec - exiting 05:43:38 (2271): No heartbeat from core client for 30 sec - exiting 05:43:39 (2271): No heartbeat from core client for 30 sec - exiting 05:43:40 (2271): No heartbeat from core client for 30 sec - exiting 05:43:41 (2271): No heartbeat from core client for 30 sec - exiting 05:43:42 (2271): No heartbeat from core client for 30 sec - exiting 05:43:43 (2271): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:52:24 (2291): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:52:26 (2291): No heartbeat from core client for 30 sec - exiting 07:52:27 (2291): No heartbeat from core client for 30 sec - exiting 07:52:28 (2291): No heartbeat from core client for 30 sec - exiting 07:52:29 (2291): No heartbeat from core client for 30 sec - exiting 07:52:30 (2291): No heartbeat from core client for 30 sec - exiting 07:52:31 (2291): No heartbeat from core client for 30 sec - exiting 07:52:32 (2291): No heartbeat from core client for 30 sec - exiting 07:52:33 (2291): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:52:37 (246): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:52:42 (246): No heartbeat from core client for 30 sec - exiting 03:52:43 (246): No heartbeat from core client for 30 sec - exiting 03:52:44 (246): No heartbeat from core client for 30 sec - exiting 07:56:20 (3226): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:56:23 (3226): No heartbeat from core client for 30 sec - exiting 07:56:24 (3226): No heartbeat from core client for 30 sec - exiting 07:57:24 (4838): No heartbeat from core client for 30 sec - exiting 07:57:25 (4838): No heartbeat from core client for 30 sec - exiting 07:57:26 (4838): No heartbeat from core client for 30 sec - exiting 07:57:27 (4838): No heartbeat from core client for 30 sec - exiting 07:57:28 (4838): No heartbeat from core client for 30 sec - exiting 07:57:29 (4838): No heartbeat from core client for 30 sec - exiting 07:57:30 (4838): No heartbeat from core client for 30 sec - exiting 07:57:31 (4838): No heartbeat from core client for 30 sec - exiting 07:57:32 (4838): No heartbeat from core client for 30 sec - exiting 07:57:33 (4838): No heartbeat from core client for 30 sec - exiting 07:57:34 (4838): No heartbeat from core client for 30 sec - exiting 07:57:35 (4838): No heartbeat from core client for 30 sec - exiting 07:57:36 (4838): No heartbeat from core client for 30 sec - exiting 07:57:37 (4838): No heartbeat from core client for 30 sec - exiting 07:57:38 (4838): No heartbeat from core client for 30 sec - exiting 07:57:39 (4838): No heartbeat from core client for 30 sec - exiting 07:57:41 (4838): No heartbeat from core client for 30 sec - exiting 07:57:42 (4838): No heartbeat from core client for 30 sec - exiting 07:57:43 (4838): No heartbeat from core client for 30 sec - exiting 07:57:44 (4838): No heartbeat from core client for 30 sec - exiting 07:57:45 (4838): No heartbeat from core client for 30 sec - exiting 07:57:46 (4838): No heartbeat from core client for 30 sec - exiting 07:57:47 (4838): No heartbeat from core client for 30 sec - exiting 07:57:48 (4838): No heartbeat from core client for 30 sec - exiting 07:57:49 (4838): No heartbeat from core client for 30 sec - exiting 07:57:50 (4838): No heartbeat from core client for 30 sec - exiting 07:57:51 (4838): No heartbeat from core client for 30 sec - exiting 07:57:52 (4838): No heartbeat from core client for 30 sec - exiting 07:57:53 (4838): No heartbeat from core client for 30 sec - exiting 07:57:54 (4838): No heartbeat from core client for 30 sec - exiting 07:57:55 (4838): No heartbeat from core client for 30 sec - exiting 07:57:56 (4838): No heartbeat from core client for 30 sec - exiting 07:57:57 (4838): No heartbeat from core client for 30 sec - exiting 07:57:58 (4838): No heartbeat from core client for 30 sec - exiting 07:57:59 (4838): No heartbeat from core client for 30 sec - exiting 07:58:00 (4838): No heartbeat from core client for 30 sec - exiting 07:58:01 (4838): No heartbeat from core client for 30 sec - exiting 07:58:02 (4838): No heartbeat from core client for 30 sec - exiting 07:58:03 (4838): No heartbeat from core client for 30 sec - exiting 07:58:04 (4838): No heartbeat from core client for 30 sec - exiting 07:58:05 (4838): No heartbeat from core client for 30 sec - exiting 07:58:06 (4838): No heartbeat from core client for 30 sec - exiting 07:58:07 (4838): No heartbeat from core client for 30 sec - exiting 07:58:08 (4838): No heartbeat from core client for 30 sec - exiting 07:58:09 (4838): No heartbeat from core client for 30 sec - exiting 07:58:10 (4838): No heartbeat from core client for 30 sec - exiting 07:58:11 (4838): No heartbeat from core client for 30 sec - exiting 07:58:12 (4838): No heartbeat from core client for 30 sec - exiting 07:58:13 (4838): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:59:09 (4859): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:00:06 (4913): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:57:22 (4921): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:58:09 (5323): No heartbeat from core client for 30 sec - exiting 08:58:10 (5323): No heartbeat from core client for 30 sec - exiting 08:58:11 (5323): No heartbeat from core client for 30 sec - exiting 08:58:12 (5323): No heartbeat from core client for 30 sec - exiting 08:58:13 (5323): No heartbeat from core client for 30 sec - exiting 08:58:14 (5323): No heartbeat from core client for 30 sec - exiting 08:58:15 (5323): No heartbeat from core client for 30 sec - exiting 08:58:16 (5323): No heartbeat from core client for 30 sec - exiting 08:58:17 (5323): No heartbeat from core client for 30 sec - exiting 08:58:18 (5323): No heartbeat from core client for 30 sec - exiting 08:58:19 (5323): No heartbeat from core client for 30 sec - exiting 08:58:20 (5323): No heartbeat from core client for 30 sec - exiting 08:58:21 (5323): No heartbeat from core client for 30 sec - exiting 08:58:22 (5323): No heartbeat from core client for 30 sec - exiting 08:58:23 (5323): No heartbeat from core client for 30 sec - exiting 08:58:24 (5323): No heartbeat from core client for 30 sec - exiting 08:58:25 (5323): No heartbeat from core client for 30 sec - exiting 08:58:26 (5323): No heartbeat from core client for 30 sec - exiting 08:58:27 (5323): No heartbeat from core client for 30 sec - exiting 08:58:28 (5323): No heartbeat from core client for 30 sec - exiting 08:58:29 (5323): No heartbeat from core client for 30 sec - exiting 08:58:30 (5323): No heartbeat from core client for 30 sec - exiting 08:58:31 (5323): No heartbeat from core client for 30 sec - exiting 08:58:32 (5323): No heartbeat from core client for 30 sec - exiting 08:58:33 (5323): No heartbeat from core client for 30 sec - exiting 08:58:34 (5323): No heartbeat from core client for 30 sec - exiting 08:58:35 (5323): No heartbeat from core client for 30 sec - exiting 08:58:36 (5323): No heartbeat from core client for 30 sec - exiting 08:58:37 (5323): No heartbeat from core client for 30 sec - exiting 08:58:38 (5323): No heartbeat from core client for 30 sec - exiting 08:58:39 (5323): No heartbeat from core client for 30 sec - exiting 08:58:40 (5323): No heartbeat from core client for 30 sec - exiting 08:58:41 (5323): No heartbeat from core client for 30 sec - exiting 08:58:42 (5323): No heartbeat from core client for 30 sec - exiting 08:58:43 (5323): No heartbeat from core client for 30 sec - exiting 08:58:44 (5323): No heartbeat from core client for 30 sec - exiting 08:58:45 (5323): No heartbeat from core client for 30 sec - exiting 08:58:46 (5323): No heartbeat from core client for 30 sec - exiting 08:58:47 (5323): No heartbeat from core client for 30 sec - exiting 08:58:48 (5323): No heartbeat from core client for 30 sec - exiting 08:58:49 (5323): No heartbeat from core client for 30 sec - exiting 08:58:50 (5323): No heartbeat from core client for 30 sec - exiting 08:58:51 (5323): No heartbeat from core client for 30 sec - exiting 08:58:52 (5323): No heartbeat from core client for 30 sec - exiting 08:58:53 (5323): No heartbeat from core client for 30 sec - exiting 08:58:54 (5323): No heartbeat from core client for 30 sec - exiting 08:58:55 (5323): No heartbeat from core client for 30 sec - exiting 08:58:56 (5323): No heartbeat from core client for 30 sec - exiting 08:58:57 (5323): No heartbeat from core client for 30 sec - exiting 08:58:58 (5323): No heartbeat from core client for 30 sec - exiting 08:58:59 (5323): No heartbeat from core client for 30 sec - exiting 08:59:00 (5323): No heartbeat from core client for 30 sec - exiting 08:59:01 (5323): No heartbeat from core client for 30 sec - exiting 08:59:02 (5323): No heartbeat from core client for 30 sec - exiting 08:59:03 (5323): No heartbeat from core client for 30 sec - exiting 08:59:04 (5323): No heartbeat from core client for 30 sec - exiting 08:59:05 (5323): No heartbeat from core client for 30 sec - exiting 08:59:06 (5323): No heartbeat from core client for 30 sec - exiting 08:59:07 (5323): No heartbeat from core client for 30 sec - exiting 08:59:08 (5323): No heartbeat from core client for 30 sec - exiting 08:59:09 (5323): No heartbeat from core client for 30 sec - exiting 08:59:10 (5323): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:34:05 (5338): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:34:08 (5338): No heartbeat from core client for 30 sec - exiting 18:34:09 (5338): No heartbeat from core client for 30 sec - exiting 18:34:10 (5338): No heartbeat from core client for 30 sec - exiting SIGSEGV: segmentation violation Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 02:43:31 (247): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:45:33 (2092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:45:36 (2092): No heartbeat from core client for 30 sec - exiting 03:45:37 (2092): No heartbeat from core client for 30 sec - exiting 03:45:38 (2092): No heartbeat from core client for 30 sec - exiting 03:45:39 (2092): No heartbeat from core client for 30 sec - exiting 05:15:48 (2618): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:20:49 (3206): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:21:01 (3206): No heartbeat from core client for 30 sec - exiting 07:21:02 (3206): No heartbeat from core client for 30 sec - exiting 07:21:03 (3206): No heartbeat from core client for 30 sec - exiting 07:21:04 (3206): No heartbeat from core client for 30 sec - exiting 07:21:05 (3206): No heartbeat from core client for 30 sec - exiting 07:21:06 (3206): No heartbeat from core client for 30 sec - exiting 07:21:07 (3206): No heartbeat from core client for 30 sec - exiting 07:21:08 (3206): No heartbeat from core client for 30 sec - exiting 07:21:09 (3206): No heartbeat from core client for 30 sec - exiting 07:21:10 (3206): No heartbeat from core client for 30 sec - exiting 07:21:11 (3206): No heartbeat from core client for 30 sec - exiting 07:21:42 (3206): No heartbeat from core client for 30 sec - exiting 07:47:52 (4067): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:06:53 (4241): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:07:46 (6353): No heartbeat from core client for 30 sec - exiting 13:07:47 (6353): No heartbeat from core client for 30 sec - exiting 13:07:48 (6353): No heartbeat from core client for 30 sec - exiting 13:07:49 (6353): No heartbeat from core client for 30 sec - exiting 13:07:50 (6353): No heartbeat from core client for 30 sec - exiting 13:07:51 (6353): No heartbeat from core client for 30 sec - exiting 13:07:52 (6353): No heartbeat from core client for 30 sec - exiting 13:07:53 (6353): No heartbeat from core client for 30 sec - exiting 13:07:54 (6353): No heartbeat from core client for 30 sec - exiting 13:07:55 (6353): No heartbeat from core client for 30 sec - exiting 13:07:56 (6353): No heartbeat from core client for 30 sec - exiting 13:07:57 (6353): No heartbeat from core client for 30 sec - exiting 13:07:58 (6353): No heartbeat from core client for 30 sec - exiting 13:07:59 (6353): No heartbeat from core client for 30 sec - exiting 13:08:00 (6353): No heartbeat from core client for 30 sec - exiting 13:08:01 (6353): No heartbeat from core client for 30 sec - exiting 13:08:02 (6353): No heartbeat from core client for 30 sec - exiting 13:08:03 (6353): No heartbeat from core client for 30 sec - exiting 13:08:04 (6353): No heartbeat from core client for 30 sec - exiting 13:08:05 (6353): No heartbeat from core client for 30 sec - exiting 13:08:06 (6353): No heartbeat from core client for 30 sec - exiting 13:08:07 (6353): No heartbeat from core client for 30 sec - exiting 13:08:08 (6353): No heartbeat from core client for 30 sec - exiting 13:08:09 (6353): No heartbeat from core client for 30 sec - exiting 13:08:10 (6353): No heartbeat from core client for 30 sec - exiting 13:08:11 (6353): No heartbeat from core client for 30 sec - exiting 13:08:12 (6353): No heartbeat from core client for 30 sec - exiting 13:08:13 (6353): No heartbeat from core client for 30 sec - exiting 13:08:14 (6353): No heartbeat from core client for 30 sec - exiting 13:08:15 (6353): No heartbeat from core client for 30 sec - exiting 13:08:16 (6353): No heartbeat from core client for 30 sec - exiting 13:08:17 (6353): No heartbeat from core client for 30 sec - exiting 13:08:18 (6353): No heartbeat from core client for 30 sec - exiting 13:08:19 (6353): No heartbeat from core client for 30 sec - exiting 13:08:20 (6353): No heartbeat from core client for 30 sec - exiting 13:08:21 (6353): No heartbeat from core client for 30 sec - exiting 13:08:22 (6353): No heartbeat from core client for 30 sec - exiting 13:08:23 (6353): No heartbeat from core client for 30 sec - exiting 13:08:24 (6353): No heartbeat from core client for 30 sec - exiting 13:08:25 (6353): No heartbeat from core client for 30 sec - exiting 13:08:26 (6353): No heartbeat from core client for 30 sec - exiting 13:08:27 (6353): No heartbeat from core client for 30 sec - exiting 13:08:28 (6353): No heartbeat from core client for 30 sec - exiting 13:08:29 (6353): No heartbeat from core client for 30 sec - exiting 13:08:30 (6353): No heartbeat from core client for 30 sec - exiting 13:08:31 (6353): No heartbeat from core client for 30 sec - exiting 13:08:32 (6353): No heartbeat from core client for 30 sec - exiting 13:08:33 (6353): No heartbeat from core client for 30 sec - exiting 13:08:34 (6353): No heartbeat from core client for 30 sec - exiting 13:08:35 (6353): No heartbeat from core client for 30 sec - exiting 13:08:36 (6353): No heartbeat from core client for 30 sec - exiting 13:08:37 (6353): No heartbeat from core client for 30 sec - exiting 13:08:38 (6353): No heartbeat from core client for 30 sec - exiting 13:08:39 (6353): No heartbeat from core client for 30 sec - exiting 13:08:40 (6353): No heartbeat from core client for 30 sec - exiting 13:08:41 (6353): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Signal 3 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
28 Sep 2011 13:54:26	1170047	13394626	hadcm3n_o27c_1940_40_007444820_4	51,840	90,585	1.7474
25 Sep 2011 10:52:03	1170047	13394626	hadcm3n_o27c_1940_40_007444820_4	25,920	52,600	2.0293