Task 13394040

Name	hadcm3n_o3p3_1940_40_007446176_3
Workunit	7643679
Created	17 Sep 2011, 13:25:46 UTC
Sent	17 Sep 2011, 13:35:45 UTC
Report deadline	17 Dec 2011, 21:02:56 UTC
Received	1 Oct 2011, 21:42:23 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1170047
Run time	6 days 19 hours 33 min 16 sec
CPU time	3 days 2 hours 50 min 37 sec
Validate state	Invalid
Credit	1,555.20
Device peak FLOPS	2.68 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>6.10.21</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:47:46 (49791): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:47:50 (49791): No heartbeat from core client for 30 sec - exiting SIGSEGV: segmentation violation Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:12:06 (55437): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:45:28 (64561): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:32:59 (66035): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:52:17 (72382): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 20:52:23 (72382): No heartbeat from core client for 30 sec - exiting 20:52:24 (72382): No heartbeat from core client for 30 sec - exiting 20:52:25 (72382): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:48:18 (78792): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:48:23 (78792): No heartbeat from core client for 30 sec - exiting 12:48:24 (78792): No heartbeat from core client for 30 sec - exiting 12:48:25 (78792): No heartbeat from core client for 30 sec - exiting 12:48:26 (78792): No heartbeat from core client for 30 sec - exiting 12:48:27 (78792): No heartbeat from core client for 30 sec - exiting 12:48:28 (78792): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 05:02:03 (92932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:02:08 (92932): No heartbeat from core client for 30 sec - exiting 05:02:09 (92932): No heartbeat from core client for 30 sec - exiting 05:02:10 (92932): No heartbeat from core client for 30 sec - exiting 05:02:11 (92932): No heartbeat from core client for 30 sec - exiting 05:02:12 (92932): No heartbeat from core client for 30 sec - exiting 05:02:13 (92932): No heartbeat from core client for 30 sec - exiting 05:02:14 (92932): No heartbeat from core client for 30 sec - exiting 05:02:15 (92932): No heartbeat from core client for 30 sec - exiting 05:02:16 (92932): No heartbeat from core client for 30 sec - exiting 05:02:17 (92932): No heartbeat from core client for 30 sec - exiting 05:02:18 (92932): No heartbeat from core client for 30 sec - exiting 05:02:19 (92932): No heartbeat from core client for 30 sec - exiting 05:02:50 (92932): No heartbeat from core client for 30 sec - exiting 05:02:51 (92932): No heartbeat from core client for 30 sec - exiting 05:02:52 (92932): No heartbeat from core client for 30 sec - exiting 05:02:53 (92932): No heartbeat from core client for 30 sec - exiting 05:02:54 (92932): No heartbeat from core client for 30 sec - exiting 05:02:55 (92932): No heartbeat from core client for 30 sec - exiting 05:02:56 (92932): No heartbeat from core client for 30 sec - exiting 05:02:57 (92932): No heartbeat from core client for 30 sec - exiting 05:02:58 (92932): No heartbeat from core client for 30 sec - exiting 05:02:59 (92932): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 08:36:36 (10049): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:36:42 (10049): No heartbeat from core client for 30 sec - exiting 08:36:43 (10049): No heartbeat from core client for 30 sec - exiting 08:36:44 (10049): No heartbeat from core client for 30 sec - exiting 08:36:45 (10049): No heartbeat from core client for 30 sec - exiting 08:36:46 (10049): No heartbeat from core client for 30 sec - exiting 08:36:47 (10049): No heartbeat from core client for 30 sec - exiting 08:36:48 (10049): No heartbeat from core client for 30 sec - exiting 08:36:49 (10049): No heartbeat from core client for 30 sec - exiting 08:36:50 (10049): No heartbeat from core client for 30 sec - exiting 08:36:51 (10049): No heartbeat from core client for 30 sec - exiting 08:36:52 (10049): No heartbeat from core client for 30 sec - exiting 09:05:41 (11467): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:34:19 (11675): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:37:02 (11885): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:37:04 (11885): No heartbeat from core client for 30 sec - exiting 10:37:05 (11885): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:47:45 (12333): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:48:55 (20913): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:48:57 (20913): No heartbeat from core client for 30 sec - exiting 07:48:58 (20913): No heartbeat from core client for 30 sec - exiting 07:48:59 (20913): No heartbeat from core client for 30 sec - exiting 07:49:00 (20913): No heartbeat from core client for 30 sec - exiting 07:49:01 (20913): No heartbeat from core client for 30 sec - exiting 07:49:02 (20913): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:17:27 (21395): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:17:29 (21395): No heartbeat from core client for 30 sec - exiting 06:17:30 (21395): No heartbeat from core client for 30 sec - exiting 06:17:31 (21395): No heartbeat from core client for 30 sec - exiting 06:17:32 (21395): No heartbeat from core client for 30 sec - exiting 06:17:33 (21395): No heartbeat from core client for 30 sec - exiting 06:17:34 (21395): No heartbeat from core client for 30 sec - exiting 07:20:52 (30730): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:23:59 (551): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:24:04 (551): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:37:10 (2365): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:09:01 (3330): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:13:14 (3987): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:13:17 (3987): No heartbeat from core client for 30 sec - exiting 23:13:18 (3987): No heartbeat from core client for 30 sec - exiting 23:13:19 (3987): No heartbeat from core client for 30 sec - exiting 23:13:20 (3987): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:14:34 (4441): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:14:37 (4441): No heartbeat from core client for 30 sec - exiting 07:06:00 (7392): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:06:02 (7392): No heartbeat from core client for 30 sec - exiting 07:06:03 (7392): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:16:39 (242): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... SIGSEGV: segmentation violation Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:05:54 (1969): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:27:05 (41864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 05:45:24 (45404): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:25:30 (60156): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:25:35 (60156): No heartbeat from core client for 30 sec - exiting 12:25:36 (60156): No heartbeat from core client for 30 sec - exiting 12:25:37 (60156): No heartbeat from core client for 30 sec - exiting 12:25:38 (60156): No heartbeat from core client for 30 sec - exiting 12:25:39 (60156): No heartbeat from core client for 30 sec - exiting 12:25:40 (60156): No heartbeat from core client for 30 sec - exiting 12:25:41 (60156): No heartbeat from core client for 30 sec - exiting 12:25:42 (60156): No heartbeat from core client for 30 sec - exiting 12:25:43 (60156): No heartbeat from core client for 30 sec - exiting 12:25:44 (60156): No heartbeat from core client for 30 sec - exiting 12:25:45 (60156): No heartbeat from core client for 30 sec - exiting 12:25:46 (60156): No heartbeat from core client for 30 sec - exiting 12:25:47 (60156): No heartbeat from core client for 30 sec - exiting 12:25:48 (60156): No heartbeat from core client for 30 sec - exiting 12:25:49 (60156): No heartbeat from core client for 30 sec - exiting 12:25:50 (60156): No heartbeat from core client for 30 sec - exiting 12:25:51 (60156): No heartbeat from core client for 30 sec - exiting 12:25:52 (60156): No heartbeat from core client for 30 sec - exiting 12:25:53 (60156): No heartbeat from core client for 30 sec - exiting 12:25:54 (60156): No heartbeat from core client for 30 sec - exiting 12:25:55 (60156): No heartbeat from core client for 30 sec - exiting 12:25:56 (60156): No heartbeat from core client for 30 sec - exiting 12:25:57 (60156): No heartbeat from core client for 30 sec - exiting 12:26:55 (62860): No heartbeat from core client for 30 sec - exiting 12:26:56 (62860): No heartbeat from core client for 30 sec - exiting 12:26:57 (62860): No heartbeat from core client for 30 sec - exiting 12:26:58 (62860): No heartbeat from core client for 30 sec - exiting 12:26:59 (62860): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:27:48 (62898): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:28:41 (62922): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:42:38 (62960): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:42:44 (62960): No heartbeat from core client for 30 sec - exiting 17:42:45 (62960): No heartbeat from core client for 30 sec - exiting 17:42:46 (62960): No heartbeat from core client for 30 sec - exiting 17:42:47 (62960): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 02:00:10 (241): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:42:24 (720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:43:19 (2262): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:52:25 (2308): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:52:28 (2308): No heartbeat from core client for 30 sec - exiting 07:52:29 (2308): No heartbeat from core client for 30 sec - exiting 07:52:30 (2308): No heartbeat from core client for 30 sec - exiting 07:52:31 (2308): No heartbeat from core client for 30 sec - exiting 07:52:32 (2308): No heartbeat from core client for 30 sec - exiting 07:52:33 (2308): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:52:37 (241): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:52:41 (241): No heartbeat from core client for 30 sec - exiting 03:52:42 (241): No heartbeat from core client for 30 sec - exiting 03:52:43 (241): No heartbeat from core client for 30 sec - exiting 03:52:44 (241): No heartbeat from core client for 30 sec - exiting 03:52:45 (241): No heartbeat from core client for 30 sec - exiting 03:52:46 (241): No heartbeat from core client for 30 sec - exiting 07:56:20 (3231): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:57:25 (4833): No heartbeat from core client for 30 sec - exiting 07:57:26 (4833): No heartbeat from core client for 30 sec - exiting 07:57:27 (4833): No heartbeat from core client for 30 sec - exiting 07:57:28 (4833): No heartbeat from core client for 30 sec - exiting 07:57:29 (4833): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:59:09 (4877): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:00:05 (4898): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:57:22 (4935): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:58:10 (5317): No heartbeat from core client for 30 sec - exiting 08:58:11 (5317): No heartbeat from core client for 30 sec - exiting 08:58:12 (5317): No heartbeat from core client for 30 sec - exiting 08:58:13 (5317): No heartbeat from core client for 30 sec - exiting 08:58:14 (5317): No heartbeat from core client for 30 sec - exiting 08:58:15 (5317): No heartbeat from core client for 30 sec - exiting 08:58:16 (5317): No heartbeat from core client for 30 sec - exiting 08:58:17 (5317): No heartbeat from core client for 30 sec - exiting 08:58:18 (5317): No heartbeat from core client for 30 sec - exiting 08:58:19 (5317): No heartbeat from core client for 30 sec - exiting 08:58:20 (5317): No heartbeat from core client for 30 sec - exiting 08:58:21 (5317): No heartbeat from core client for 30 sec - exiting 08:58:22 (5317): No heartbeat from core client for 30 sec - exiting 08:58:23 (5317): No heartbeat from core client for 30 sec - exiting 08:58:24 (5317): No heartbeat from core client for 30 sec - exiting 08:58:25 (5317): No heartbeat from core client for 30 sec - exiting 08:58:26 (5317): No heartbeat from core client for 30 sec - exiting 08:58:27 (5317): No heartbeat from core client for 30 sec - exiting 08:58:28 (5317): No heartbeat from core client for 30 sec - exiting 08:58:29 (5317): No heartbeat from core client for 30 sec - exiting 08:58:30 (5317): No heartbeat from core client for 30 sec - exiting 08:58:31 (5317): No heartbeat from core client for 30 sec - exiting 08:58:32 (5317): No heartbeat from core client for 30 sec - exiting 08:58:33 (5317): No heartbeat from core client for 30 sec - exiting 08:58:34 (5317): No heartbeat from core client for 30 sec - exiting 08:58:35 (5317): No heartbeat from core client for 30 sec - exiting 08:58:36 (5317): No heartbeat from core client for 30 sec - exiting 08:58:37 (5317): No heartbeat from core client for 30 sec - exiting 08:58:38 (5317): No heartbeat from core client for 30 sec - exiting 08:58:39 (5317): No heartbeat from core client for 30 sec - exiting 08:58:40 (5317): No heartbeat from core client for 30 sec - exiting 08:58:41 (5317): No heartbeat from core client for 30 sec - exiting 08:58:42 (5317): No heartbeat from core client for 30 sec - exiting 08:58:43 (5317): No heartbeat from core client for 30 sec - exiting 08:58:44 (5317): No heartbeat from core client for 30 sec - exiting 08:58:45 (5317): No heartbeat from core client for 30 sec - exiting 08:58:46 (5317): No heartbeat from core client for 30 sec - exiting 08:58:47 (5317): No heartbeat from core client for 30 sec - exiting 08:58:48 (5317): No heartbeat from core client for 30 sec - exiting 08:58:49 (5317): No heartbeat from core client for 30 sec - exiting 08:58:50 (5317): No heartbeat from core client for 30 sec - exiting 08:58:51 (5317): No heartbeat from core client for 30 sec - exiting 08:58:52 (5317): No heartbeat from core client for 30 sec - exiting 08:58:53 (5317): No heartbeat from core client for 30 sec - exiting 08:58:54 (5317): No heartbeat from core client for 30 sec - exiting 08:58:55 (5317): No heartbeat from core client for 30 sec - exiting 08:58:56 (5317): No heartbeat from core client for 30 sec - exiting 08:58:57 (5317): No heartbeat from core client for 30 sec - exiting 08:58:58 (5317): No heartbeat from core client for 30 sec - exiting 08:58:59 (5317): No heartbeat from core client for 30 sec - exiting 08:59:00 (5317): No heartbeat from core client for 30 sec - exiting 08:59:01 (5317): No heartbeat from core client for 30 sec - exiting 08:59:02 (5317): No heartbeat from core client for 30 sec - exiting 08:59:03 (5317): No heartbeat from core client for 30 sec - exiting 08:59:04 (5317): No heartbeat from core client for 30 sec - exiting 08:59:05 (5317): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:34:05 (5346): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 02:43:31 (242): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:45:33 (2081): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:45:36 (2081): No heartbeat from core client for 30 sec - exiting 03:45:37 (2081): No heartbeat from core client for 30 sec - exiting 03:45:38 (2081): No heartbeat from core client for 30 sec - exiting 03:45:39 (2081): No heartbeat from core client for 30 sec - exiting 03:46:22 (2081): No heartbeat from core client for 30 sec - exiting 03:46:23 (2081): No heartbeat from core client for 30 sec - exiting 03:46:24 (2081): No heartbeat from core client for 30 sec - exiting 03:46:25 (2081): No heartbeat from core client for 30 sec - exiting 03:46:26 (2081): No heartbeat from core client for 30 sec - exiting 03:46:27 (2081): No heartbeat from core client for 30 sec - exiting 03:46:28 (2081): No heartbeat from core client for 30 sec - exiting 03:46:29 (2081): No heartbeat from core client for 30 sec - exiting 03:46:30 (2081): No heartbeat from core client for 30 sec - exiting 03:46:31 (2081): No heartbeat from core client for 30 sec - exiting 03:46:32 (2081): No heartbeat from core client for 30 sec - exiting 03:46:33 (2081): No heartbeat from core client for 30 sec - exiting 03:46:34 (2081): No heartbeat from core client for 30 sec - exiting 03:46:35 (2081): No heartbeat from core client for 30 sec - exiting 03:46:36 (2081): No heartbeat from core client for 30 sec - exiting 03:46:37 (2081): No heartbeat from core client for 30 sec - exiting 03:46:38 (2081): No heartbeat from core client for 30 sec - exiting 03:46:39 (2081): No heartbeat from core client for 30 sec - exiting 03:46:40 (2081): No heartbeat from core client for 30 sec - exiting 03:46:41 (2081): No heartbeat from core client for 30 sec - exiting 03:46:42 (2081): No heartbeat from core client for 30 sec - exiting 03:46:43 (2081): No heartbeat from core client for 30 sec - exiting 03:46:44 (2081): No heartbeat from core client for 30 sec - exiting 03:46:45 (2081): No heartbeat from core client for 30 sec - exiting 03:46:46 (2081): No heartbeat from core client for 30 sec - exiting 03:46:47 (2081): No heartbeat from core client for 30 sec - exiting 03:46:48 (2081): No heartbeat from core client for 30 sec - exiting 03:46:49 (2081): No heartbeat from core client for 30 sec - exiting 05:15:48 (2620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:20:49 (3205): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:21:01 (3205): No heartbeat from core client for 30 sec - exiting 07:21:02 (3205): No heartbeat from core client for 30 sec - exiting 07:21:03 (3205): No heartbeat from core client for 30 sec - exiting 07:21:09 (3205): No heartbeat from core client for 30 sec - exiting 07:21:10 (3205): No heartbeat from core client for 30 sec - exiting 07:21:11 (3205): No heartbeat from core client for 30 sec - exiting 07:21:42 (3205): No heartbeat from core client for 30 sec - exiting 07:21:43 (3205): No heartbeat from core client for 30 sec - exiting 07:21:44 (3205): No heartbeat from core client for 30 sec - exiting 07:21:45 (3205): No heartbeat from core client for 30 sec - exiting 07:21:46 (3205): No heartbeat from core client for 30 sec - exiting 07:21:47 (3205): No heartbeat from core client for 30 sec - exiting 07:21:48 (3205): No heartbeat from core client for 30 sec - exiting 07:21:49 (3205): No heartbeat from core client for 30 sec - exiting 07:21:50 (3205): No heartbeat from core client for 30 sec - exiting 07:21:51 (3205): No heartbeat from core client for 30 sec - exiting 07:21:52 (3205): No heartbeat from core client for 30 sec - exiting 07:21:53 (3205): No heartbeat from core client for 30 sec - exiting 07:21:54 (3205): No heartbeat from core client for 30 sec - exiting 07:21:55 (3205): No heartbeat from core client for 30 sec - exiting 07:21:56 (3205): No heartbeat from core client for 30 sec - exiting 07:21:57 (3205): No heartbeat from core client for 30 sec - exiting 07:21:58 (3205): No heartbeat from core client for 30 sec - exiting 07:21:59 (3205): No heartbeat from core client for 30 sec - exiting 07:22:00 (3205): No heartbeat from core client for 30 sec - exiting 07:22:01 (3205): No heartbeat from core client for 30 sec - exiting 07:22:02 (3205): No heartbeat from core client for 30 sec - exiting 07:22:03 (3205): No heartbeat from core client for 30 sec - exiting 07:22:37 (3205): No heartbeat from core client for 30 sec - exiting 07:22:38 (3205): No heartbeat from core client for 30 sec - exiting 07:22:39 (3205): No heartbeat from core client for 30 sec - exiting 07:22:40 (3205): No heartbeat from core client for 30 sec - exiting 07:22:41 (3205): No heartbeat from core client for 30 sec - exiting 07:22:42 (3205): No heartbeat from core client for 30 sec - exiting 07:22:43 (3205): No heartbeat from core client for 30 sec - exiting 07:22:44 (3205): No heartbeat from core client for 30 sec - exiting 07:22:45 (3205): No heartbeat from core client for 30 sec - exiting 07:22:46 (3205): No heartbeat from core client for 30 sec - exiting 07:22:47 (3205): No heartbeat from core client for 30 sec - exiting 07:22:48 (3205): No heartbeat from core client for 30 sec - exiting 07:47:52 (4068): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:06:54 (4240): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:07:46 (6355): No heartbeat from core client for 30 sec - exiting 13:07:47 (6355): No heartbeat from core client for 30 sec - exiting 13:07:48 (6355): No heartbeat from core client for 30 sec - exiting 13:07:49 (6355): No heartbeat from core client for 30 sec - exiting 13:07:50 (6355): No heartbeat from core client for 30 sec - exiting 13:07:51 (6355): No heartbeat from core client for 30 sec - exiting 13:07:52 (6355): No heartbeat from core client for 30 sec - exiting 13:07:53 (6355): No heartbeat from core client for 30 sec - exiting 13:07:54 (6355): No heartbeat from core client for 30 sec - exiting 13:07:55 (6355): No heartbeat from core client for 30 sec - exiting 13:07:56 (6355): No heartbeat from core client for 30 sec - exiting 13:07:57 (6355): No heartbeat from core client for 30 sec - exiting 13:07:58 (6355): No heartbeat from core client for 30 sec - exiting 13:07:59 (6355): No heartbeat from core client for 30 sec - exiting 13:08:00 (6355): No heartbeat from core client for 30 sec - exiting 13:08:01 (6355): No heartbeat from core client for 30 sec - exiting 13:08:02 (6355): No heartbeat from core client for 30 sec - exiting 13:08:03 (6355): No heartbeat from core client for 30 sec - exiting 13:08:04 (6355): No heartbeat from core client for 30 sec - exiting 13:08:05 (6355): No heartbeat from core client for 30 sec - exiting 13:08:06 (6355): No heartbeat from core client for 30 sec - exiting 13:08:07 (6355): No heartbeat from core client for 30 sec - exiting 13:08:08 (6355): No heartbeat from core client for 30 sec - exiting 13:08:09 (6355): No heartbeat from core client for 30 sec - exiting 13:08:10 (6355): No heartbeat from core client for 30 sec - exiting 13:08:11 (6355): No heartbeat from core client for 30 sec - exiting 13:08:12 (6355): No heartbeat from core client for 30 sec - exiting 13:08:13 (6355): No heartbeat from core client for 30 sec - exiting 13:08:14 (6355): No heartbeat from core client for 30 sec - exiting 13:08:15 (6355): No heartbeat from core client for 30 sec - exiting 13:08:16 (6355): No heartbeat from core client for 30 sec - exiting 13:08:17 (6355): No heartbeat from core client for 30 sec - exiting 13:08:18 (6355): No heartbeat from core client for 30 sec - exiting 13:08:19 (6355): No heartbeat from core client for 30 sec - exiting 13:08:20 (6355): No heartbeat from core client for 30 sec - exiting 13:08:21 (6355): No heartbeat from core client for 30 sec - exiting 13:08:22 (6355): No heartbeat from core client for 30 sec - exiting 13:08:23 (6355): No heartbeat from core client for 30 sec - exiting 13:08:24 (6355): No heartbeat from core client for 30 sec - exiting 13:08:25 (6355): No heartbeat from core client for 30 sec - exiting 13:08:26 (6355): No heartbeat from core client for 30 sec - exiting 13:08:27 (6355): No heartbeat from core client for 30 sec - exiting 13:08:28 (6355): No heartbeat from core client for 30 sec - exiting 13:08:29 (6355): No heartbeat from core client for 30 sec - exiting 13:08:30 (6355): No heartbeat from core client for 30 sec - exiting 13:08:31 (6355): No heartbeat from core client for 30 sec - exiting 13:08:32 (6355): No heartbeat from core client for 30 sec - exiting 13:08:33 (6355): No heartbeat from core client for 30 sec - exiting 13:08:34 (6355): No heartbeat from core client for 30 sec - exiting 13:08:35 (6355): No heartbeat from core client for 30 sec - exiting 13:08:36 (6355): No heartbeat from core client for 30 sec - exiting 13:08:37 (6355): No heartbeat from core client for 30 sec - exiting 13:08:38 (6355): No heartbeat from core client for 30 sec - exiting 13:08:39 (6355): No heartbeat from core client for 30 sec - exiting 13:08:40 (6355): No heartbeat from core client for 30 sec - exiting 13:08:41 (6355): No heartbeat from core client for 30 sec - exiting 13:08:42 (6355): No heartbeat from core client for 30 sec - exiting 13:08:43 (6355): No heartbeat from core client for 30 sec - exiting 13:08:44 (6355): No heartbeat from core client for 30 sec - exiting 13:08:45 (6355): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Signal 3 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
29 Sep 2011 14:00:27	1170047	13394040	hadcm3n_o3p3_1940_40_007446176_3	129,600	246,943	1.9054
26 Sep 2011 08:29:37	1170047	13394040	hadcm3n_o3p3_1940_40_007446176_3	103,680	208,663	2.0126
24 Sep 2011 12:13:41	1170047	13394040	hadcm3n_o3p3_1940_40_007446176_3	77,760	157,655	2.0275
22 Sep 2011 20:54:43	1170047	13394040	hadcm3n_o3p3_1940_40_007446176_3	51,840	104,505	2.0159
19 Sep 2011 14:47:21	1170047	13394040	hadcm3n_o3p3_1940_40_007446176_3	25,920	51,867	2.0010