Task 14647731

Name	hadcm3n_202k_1940_40_007957023_1
Workunit	8112135
Created	9 May 2012, 11:15:47 UTC
Sent	11 May 2012, 6:46:30 UTC
Report deadline	10 Aug 2012, 14:13:41 UTC
Received	25 May 2012, 19:51:23 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1168097
Run time	6 days 22 hours 17 min 13 sec
CPU time	6 days 22 hours 17 min 13 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.29 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>5.10.20</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> 19:21:12 (7172): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:38:40 (5208): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:56:05 (7388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:03:09 (10052): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:13:40 (5396): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 02:23:27 (9664): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:29:24 (6764): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:13:48 (7196): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 04:19:59 (4024): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 08:49:03 (7720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 09:25:29 (5032): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:34:23 (4288): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:06:39 (5688): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:08:47 (3088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:18:59 (4244): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:25:32 (3064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:31:31 (4968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 05:28:38 (4980): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:42:16 (5440): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 10:18:58 (9672): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:29:19 (5472): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 02:07:06 (7496): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:04:44 (8008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:58:20 (2564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:16:38 (5764): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:24:59 (5492): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 02:06:00 (4672): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:07:26 (6732): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 05:44:37 (6396): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 09:02:00 (9292): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:27:36 (5580): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:50:10 (7984): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:58:10 (4788): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 17:04:45 (5276): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 02:45:18 (7476): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 04:56:41 (5728): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:02:52 (4652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:41:34 (8048): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:18:47 (6388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:58:29 (4464): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:10:45 (5728): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 22:32:57 (9620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:56:59 (6152): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 04:32:12 (7644): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:41:18 (5676): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:35:51 (1932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:44:04 (11764): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 19:49:26 (3820): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:56:19 (3988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x7C9111DE read attempt to address 0x00000000 Engaging BOINC Windows Runtime Debugger... 02:58:03 (4100): No heartbeat from core client for 30 sec - exiting 02:58:05 (4100): No heartbeat from core client for 30 sec - exiting 02:58:06 (4100): No heartbeat from core client for 30 sec - exiting 02:58:07 (4100): No heartbeat from core client for 30 sec - exiting 02:58:08 (4100): No heartbeat from core client for 30 sec - exiting 02:58:09 (4100): No heartbeat from core client for 30 sec - exiting 02:58:10 (4100): No heartbeat from core client for 30 sec - exiting 02:58:11 (4100): No heartbeat from core client for 30 sec - exiting 02:58:12 (4100): No heartbeat from core client for 30 sec - exiting 02:58:13 (4100): No heartbeat from core client for 30 sec - exiting 02:58:14 (4100): No heartbeat from core client for 30 sec - exiting 02:58:15 (4100): No heartbeat from core client for 30 sec - exiting 02:58:17 (4100): No heartbeat from core client for 30 sec - exiting 02:58:18 (4100): No heartbeat from core client for 30 sec - exiting 02:58:19 (4100): No heartbeat from core client for 30 sec - exiting 02:58:20 (4100): No heartbeat from core client for 30 sec - exiting 02:58:21 (4100): No heartbeat from core client for 30 sec - exiting 02:58:22 (4100): No heartbeat from core client for 30 sec - exiting 02:58:23 (4100): No heartbeat from core client for 30 sec - exiting 02:58:24 (4100): No heartbeat from core client for 30 sec - exiting 02:58:25 (4100): No heartbeat from core client for 30 sec - exiting 02:58:26 (4100): No heartbeat from core client for 30 sec - exiting 02:58:27 (4100): No heartbeat from core client for 30 sec - exiting 02:58:29 (4100): No heartbeat from core client for 30 sec - exiting 02:58:30 (4100): No heartbeat from core client for 30 sec - exiting 02:58:31 (4100): No heartbeat from core client for 30 sec - exiting 02:58:32 (4100): No heartbeat from core client for 30 sec - exiting 02:58:33 (4100): No heartbeat from core client for 30 sec - exiting 02:58:34 (4100): No heartbeat from core client for 30 sec - exiting 02:58:35 (4100): No heartbeat from core client for 30 sec - exiting 02:58:36 (4100): No heartbeat from core client for 30 sec - exiting 02:58:37 (4100): No heartbeat from core client for 30 sec - exiting 02:58:38 (4100): No heartbeat from core client for 30 sec - exiting 02:58:40 (4100): No heartbeat from core client for 30 sec - exiting 02:58:41 (4100): No heartbeat from core client for 30 sec - exiting 02:58:42 (4100): No heartbeat from core client for 30 sec - exiting 02:58:43 (4100): No heartbeat from core client for 30 sec - exiting 02:58:44 (4100): No heartbeat from core client for 30 sec - exiting 02:58:45 (4100): No heartbeat from core client for 30 sec - exiting 02:58:46 (4100): No heartbeat from core client for 30 sec - exiting 02:58:47 (4100): No heartbeat from core client for 30 sec - exiting 02:58:48 (4100): No heartbeat from core client for 30 sec - exiting 02:58:49 (4100): No heartbeat from core client for 30 sec - exiting 02:58:50 (4100): No heartbeat from core client for 30 sec - exiting 02:58:52 (4100): No heartbeat from core client for 30 sec - exiting 02:58:53 (4100): No heartbeat from core client for 30 sec - exiting 02:58:54 (4100): No heartbeat from core client for 30 sec - exiting 02:58:55 (4100): No heartbeat from core client for 30 sec - exiting 02:58:56 (4100): No heartbeat from core client for 30 sec - exiting 03:59:44 (4100): No heartbeat from core client for 30 sec - exiting 03:59:45 (4100): No heartbeat from core client for 30 sec - exiting 03:59:46 (4100): No heartbeat from core client for 30 sec - exiting 03:59:47 (4100): No heartbeat from core client for 30 sec - exiting 03:59:48 (4100): No heartbeat from core client for 30 sec - exiting 03:59:49 (4100): No heartbeat from core client for 30 sec - exiting 03:59:50 (4100): No heartbeat from core client for 30 sec - exiting 03:59:51 (4100): No heartbeat from core client for 30 sec - exiting 03:59:52 (4100): No heartbeat from core client for 30 sec - exiting 03:59:53 (4100): No heartbeat from core client for 30 sec - exiting 03:59:55 (4100): No heartbeat from core client for 30 sec - exiting 03:59:56 (4100): No heartbeat from core client for 30 sec - exiting 03:59:57 (4100): No heartbeat from core client for 30 sec - exiting 03:59:58 (4100): No heartbeat from core client for 30 sec - exiting 03:59:59 (4100): No heartbeat from core client for 30 sec - exiting 04:00:00 (4100): No heartbeat from core client for 30 sec - exiting 04:00:01 (4100): No heartbeat from core client for 30 sec - exiting 04:00:02 (4100): No heartbeat from core client for 30 sec - exiting 04:00:03 (4100): No heartbeat from core client for 30 sec - exiting 04:00:04 (4100): No heartbeat from core client for 30 sec - exiting 04:00:05 (4100): No heartbeat from core client for 30 sec - exiting 04:00:07 (4100): No heartbeat from core client for 30 sec - exiting 04:00:08 (4100): No heartbeat from core client for 30 sec - exiting 04:00:09 (4100): No heartbeat from core client for 30 sec - exiting 04:00:10 (4100): No heartbeat from core client for 30 sec - exiting 04:00:11 (4100): No heartbeat from core client for 30 sec - exiting 04:00:12 (4100): No heartbeat from core client for 30 sec - exiting 04:00:13 (4100): No heartbeat from core client for 30 sec - exiting 04:00:14 (4100): No heartbeat from core client for 30 sec - exiting 04:00:15 (4100): No heartbeat from core client for 30 sec - exiting 04:00:16 (4100): No heartbeat from core client for 30 sec - exiting 04:00:17 (4100): No heartbeat from core client for 30 sec - exiting 04:00:19 (4100): No heartbeat from core client for 30 sec - exiting 04:00:20 (4100): No heartbeat from core client for 30 sec - exiting 04:00:21 (4100): No heartbeat from core client for 30 sec - exiting 04:00:22 (4100): No heartbeat from core client for 30 sec - exiting 04:00:23 (4100): No heartbeat from core client for 30 sec - exiting 04:00:24 (4100): No heartbeat from core client for 30 sec - exiting 04:00:25 (4100): No heartbeat from core client for 30 sec - exiting 04:00:26 (4100): No heartbeat from core client for 30 sec - exiting 04:00:27 (4100): No heartbeat from core client for 30 sec - exiting 04:00:28 (4100): No heartbeat from core client for 30 sec - exiting 04:00:30 (4100): No heartbeat from core client for 30 sec - exiting 04:00:31 (4100): No heartbeat from core client for 30 sec - exiting 04:00:32 (4100): No heartbeat from core client for 30 sec - exiting 04:00:33 (4100): No heartbeat from core client for 30 sec - exiting 04:00:34 (4100): No heartbeat from core client for 30 sec - exiting 04:00:35 (4100): No heartbeat from core client for 30 sec - exiting 04:00:36 (4100): No heartbeat from core client for 30 sec - exiting 04:00:37 (4100): No heartbeat from core client for 30 sec - exiting 04:00:38 (4100): No heartbeat from core client for 30 sec - exiting 04:00:39 (4100): No heartbeat from core client for 30 sec - exiting 04:00:40 (4100): No heartbeat from core client for 30 sec - exiting 04:00:42 (4100): No heartbeat from core client for 30 sec - exiting 04:00:43 (4100): No heartbeat from core client for 30 sec - exiting 04:00:44 (4100): No heartbeat from core client for 30 sec - exiting 04:00:45 (4100): No heartbeat from core client for 30 sec - exiting 04:00:46 (4100): No heartbeat from core client for 30 sec - exiting 04:00:47 (4100): No heartbeat from core client for 30 sec - exiting 04:00:48 (4100): No heartbeat from core client for 30 sec - exiting 04:00:49 (4100): No heartbeat from core client for 30 sec - exiting 04:00:50 (4100): No heartbeat from core client for 30 sec - exiting 04:00:51 (4100): No heartbeat from core client for 30 sec - exiting 04:00:52 (4100): No heartbeat from core client for 30 sec - exiting 04:00:54 (4100): No heartbeat from core client for 30 sec - exiting 04:00:55 (4100): No heartbeat from core client for 30 sec - exiting 04:00:56 (4100): No heartbeat from core client for 30 sec - exiting 04:00:57 (4100): No heartbeat from core client for 30 sec - exiting 04:00:58 (4100): No heartbeat from core client for 30 sec - exiting 04:00:59 (4100): No heartbeat from core client for 30 sec - exiting 04:01:00 (4100): No heartbeat from core client for 30 sec - exiting 04:01:01 (4100): No heartbeat from core client for 30 sec - exiting 04:01:02 (4100): No heartbeat from core client for 30 sec - exiting 04:01:03 (4100): No heartbeat from core client for 30 sec - exiting 04:01:05 (4100): No heartbeat from core client for 30 sec - exiting 04:01:06 (4100): No heartbeat from core client for 30 sec - exiting 04:01:07 (4100): No heartbeat from core client for 30 sec - exiting 04:01:08 (4100): No heartbeat from core client for 30 sec - exiting 04:01:09 (4100): No heartbeat from core client for 30 sec - exiting 04:01:10 (4100): No heartbeat from core client for 30 sec - exiting 04:01:11 (4100): No heartbeat from core client for 30 sec - exiting 04:01:12 (4100): No heartbeat from core client for 30 sec - exiting 04:01:13 (4100): No heartbeat from core client for 30 sec - exiting 04:01:14 (4100): No heartbeat from core client for 30 sec - exiting 04:01:15 (4100): No heartbeat from core client for 30 sec - exiting 04:01:17 (4100): No heartbeat from core client for 30 sec - exiting 04:01:18 (4100): No heartbeat from core client for 30 sec - exiting 04:01:19 (4100): No heartbeat from core client for 30 sec - exiting 04:01:20 (4100): No heartbeat from core client for 30 sec - exiting 04:01:21 (4100): No heartbeat from core client for 30 sec - exiting 04:01:22 (4100): No heartbeat from core client for 30 sec - exiting 04:01:23 (4100): No heartbeat from core client for 30 sec - exiting 04:01:24 (4100): No heartbeat from core client for 30 sec - exiting 04:01:25 (4100): No heartbeat from core client for 30 sec - exiting 04:01:26 (4100): No heartbeat from core client for 30 sec - exiting 04:01:27 (4100): No heartbeat from core client for 30 sec - exiting 04:01:29 (4100): No heartbeat from core client for 30 sec - exiting 04:01:30 (4100): No heartbeat from core client for 30 sec - exiting 04:01:31 (4100): No heartbeat from core client for 30 sec - exiting 04:01:32 (4100): No heartbeat from core client for 30 sec - exiting 04:01:33 (4100): No heartbeat from core client for 30 sec - exiting 04:01:34 (4100): No heartbeat from core client for 30 sec - exiting 04:01:35 (4100): No heartbeat from core client for 30 sec - exiting 04:01:36 (4100): No heartbeat from core client for 30 sec - exiting 04:01:37 (4100): No heartbeat from core client for 30 sec - exiting 14:08:31 (4100): No heartbeat from core client for 30 sec - exiting 14:08:32 (4100): No heartbeat from core client for 30 sec - exiting 14:08:33 (4100): No heartbeat from core client for 30 sec - exiting 14:08:34 (4100): No heartbeat from core client for 30 sec - exiting 14:08:35 (4100): No heartbeat from core client for 30 sec - exiting 14:08:37 (4100): No heartbeat from core client for 30 sec - exiting 14:08:38 (4100): No heartbeat from core client for 30 sec - exiting 14:08:39 (4100): No heartbeat from core client for 30 sec - exiting 14:08:40 (4100): No heartbeat from core client for 30 sec - exiting 14:08:41 (4100): No heartbeat from core client for 30 sec - exiting 14:08:42 (4100): No heartbeat from core client for 30 sec - exiting 14:08:43 (4100): No heartbeat from core client for 30 sec - exiting 14:08:44 (4100): No heartbeat from core client for 30 sec - exiting 14:08:45 (4100): No heartbeat from core client for 30 sec - exiting 14:08:46 (4100): No heartbeat from core client for 30 sec - exiting 14:08:47 (4100): No heartbeat from core client for 30 sec - exiting 14:08:49 (4100): No heartbeat from core client for 30 sec - exiting 14:08:50 (4100): No heartbeat from core client for 30 sec - exiting 14:08:51 (4100): No heartbeat from core client for 30 sec - exiting 14:08:52 (4100): No heartbeat from core client for 30 sec - exiting 14:08:53 (4100): No heartbeat from core client for 30 sec - exiting 14:08:54 (4100): No heartbeat from core client for 30 sec - exiting 14:08:55 (4100): No heartbeat from core client for 30 sec - exiting 14:08:56 (4100): No heartbeat from core client for 30 sec - exiting 14:08:57 (4100): No heartbeat from core client for 30 sec - exiting 14:08:58 (4100): No heartbeat from core client for 30 sec - exiting 14:08:59 (4100): No heartbeat from core client for 30 sec - exiting 14:09:01 (4100): No heartbeat from core client for 30 sec - exiting 14:09:02 (4100): No heartbeat from core client for 30 sec - exiting 14:09:03 (4100): No heartbeat from core client for 30 sec - exiting 14:09:04 (4100): No heartbeat from core client for 30 sec - exiting 14:09:05 (4100): No heartbeat from core client for 30 sec - exiting 14:09:06 (4100): No heartbeat from core client for 30 sec - exiting 14:09:07 (4100): No heartbeat from core client for 30 sec - exiting 14:09:08 (4100): No heartbeat from core client for 30 sec - exiting 14:09:09 (4100): No heartbeat from core client for 30 sec - exiting 14:09:10 (4100): No heartbeat from core client for 30 sec - exiting 14:09:12 (4100): No heartbeat from core client for 30 sec - exiting 17:05:52 (4100): No heartbeat from core client for 30 sec - exiting 17:06:57 (4100): No heartbeat from core client for 30 sec - exiting 17:12:29 (4100): No heartbeat from core client for 30 sec - exiting 19:45:41 (4100): No heartbeat from core client for 30 sec - exiting 19:45:42 (4100): No heartbeat from core client for 30 sec - exiting 19:45:43 (4100): No heartbeat from core client for 30 sec - exiting 19:45:44 (4100): No heartbeat from core client for 30 sec - exiting 19:45:45 (4100): No heartbeat from core client for 30 sec - exiting 19:45:46 (4100): No heartbeat from core client for 30 sec - exiting 19:45:47 (4100): No heartbeat from core client for 30 sec - exiting 19:45:48 (4100): No heartbeat from core client for 30 sec - exiting 19:45:49 (4100): No heartbeat from core client for 30 sec - exiting 19:45:50 (4100): No heartbeat from core client for 30 sec - exiting 19:45:51 (4100): No heartbeat from core client for 30 sec - exiting 19:45:52 (4100): No heartbeat from core client for 30 sec - exiting 19:45:53 (4100): No heartbeat from core client for 30 sec - exiting 19:45:54 (4100): No heartbeat from core client for 30 sec - exiting 19:45:55 (4100): No heartbeat from core client for 30 sec - exiting 19:45:56 (4100): No heartbeat from core client for 30 sec - exiting 19:45:57 (4100): No heartbeat from core client for 30 sec - exiting 19:45:58 (4100): No heartbeat from core client for 30 sec - exiting 19:45:59 (4100): No heartbeat from core client for 30 sec - exiting 19:46:00 (4100): No heartbeat from core client for 30 sec - exiting 19:46:01 (4100): No heartbeat from core client for 30 sec - exiting 19:46:02 (4100): No heartbeat from core client for 30 sec - exiting 19:46:03 (4100): No heartbeat from core client for 30 sec - exiting 19:46:04 (4100): No heartbeat from core client for 30 sec - exiting 19:46:05 (4100): No heartbeat from core client for 30 sec - exiting 19:46:06 (4100): No heartbeat from core client for 30 sec - exiting 19:46:07 (4100): No heartbeat from core client for 30 sec - exiting 19:46:08 (4100): No heartbeat from core client for 30 sec - exiting 19:46:09 (4100): No heartbeat from core client for 30 sec - exiting 19:46:10 (4100): No heartbeat from core client for 30 sec - exiting 19:46:11 (4100): No heartbeat from core client for 30 sec - exiting 19:46:12 (4100): No heartbeat from core client for 30 sec - exiting 19:46:13 (4100): No heartbeat from core client for 30 sec - exiting 19:46:14 (4100): No heartbeat from core client for 30 sec - exiting 19:46:15 (4100): No heartbeat from core client for 30 sec - exiting 19:46:16 (4100): No heartbeat from core client for 30 sec - exiting 19:46:17 (4100): No heartbeat from core client for 30 sec - exiting 19:46:18 (4100): No heartbeat from core client for 30 sec - exiting 19:46:19 (4100): No heartbeat from core client for 30 sec - exiting 19:46:20 (4100): No heartbeat from core client for 30 sec - exiting 19:46:21 (4100): No heartbeat from core client for 30 sec - exiting 19:46:22 (4100): No heartbeat from core client for 30 sec - exiting 19:46:23 (4100): No heartbeat from core client for 30 sec - exiting 19:46:24 (4100): No heartbeat from core client for 30 sec - exiting 22:52:53 (4100): No heartbeat from core client for 30 sec - exiting 22:52:54 (4100): No heartbeat from core client for 30 sec - exiting 22:52:55 (4100): No heartbeat from core client for 30 sec - exiting 22:52:56 (4100): No heartbeat from core client for 30 sec - exiting 22:52:58 (4100): No heartbeat from core client for 30 sec - exiting 22:52:59 (4100): No heartbeat from core client for 30 sec - exiting 22:53:00 (4100): No heartbeat from core client for 30 sec - exiting 22:53:01 (4100): No heartbeat from core client for 30 sec - exiting 22:53:02 (4100): No heartbeat from core client for 30 sec - exiting 22:53:03 (4100): No heartbeat from core client for 30 sec - exiting 22:53:04 (4100): No heartbeat from core client for 30 sec - exiting 22:53:05 (4100): No heartbeat from core client for 30 sec - exiting 22:53:06 (4100): No heartbeat from core client for 30 sec - exiting 22:53:07 (4100): No heartbeat from core client for 30 sec - exiting 22:53:08 (4100): No heartbeat from core client for 30 sec - exiting 22:53:10 (4100): No heartbeat from core client for 30 sec - exiting 22:53:11 (4100): No heartbeat from core client for 30 sec - exiting 22:53:12 (4100): No heartbeat from core client for 30 sec - exiting 22:53:13 (4100): No heartbeat from core client for 30 sec - exiting 22:53:14 (4100): No heartbeat from core client for 30 sec - exiting 22:53:15 (4100): No heartbeat from core client for 30 sec - exiting 22:53:16 (4100): No heartbeat from core client for 30 sec - exiting 22:53:17 (4100): No heartbeat from core client for 30 sec - exiting 22:53:18 (4100): No heartbeat from core client for 30 sec - exiting 22:53:19 (4100): No heartbeat from core client for 30 sec - exiting 22:53:20 (4100): No heartbeat from core client for 30 sec - exiting 22:53:22 (4100): No heartbeat from core client for 30 sec - exiting 22:53:23 (4100): No heartbeat from core client for 30 sec - exiting 22:53:24 (4100): No heartbeat from core client for 30 sec - exiting 22:53:25 (4100): No heartbeat from core client for 30 sec - exiting 22:53:26 (4100): No heartbeat from core client for 30 sec - exiting 22:53:27 (4100): No heartbeat from core client for 30 sec - exiting 22:53:28 (4100): No heartbeat from core client for 30 sec - exiting 22:53:29 (4100): No heartbeat from core client for 30 sec - exiting 22:53:30 (4100): No heartbeat from core client for 30 sec - exiting 22:53:31 (4100): No heartbeat from core client for 30 sec - exiting 22:53:33 (4100): No heartbeat from core client for 30 sec - exiting 22:53:34 (4100): No heartbeat from core client for 30 sec - exiting 22:53:35 (4100): No heartbeat from core client for 30 sec - exiting 22:53:36 (4100): No heartbeat from core client for 30 sec - exiting 22:53:37 (4100): No heartbeat from core client for 30 sec - exiting 22:53:38 (4100): No heartbeat from core client for 30 sec - exiting 22:53:39 (4100): No heartbeat from core client for 30 sec - exiting 22:53:40 (4100): No heartbeat from core client for 30 sec - exiting 23:15:32 (4100): No heartbeat from core client for 30 sec - exiting 23:15:33 (4100): No heartbeat from core client for 30 sec - exiting 23:15:34 (4100): No heartbeat from core client for 30 sec - exiting 23:15:35 (4100): No heartbeat from core client for 30 sec - exiting 23:15:36 (4100): No heartbeat from core client for 30 sec - exiting 23:15:37 (4100): No heartbeat from core client for 30 sec - exiting 23:15:38 (4100): No heartbeat from core client for 30 sec - exiting 23:15:39 (4100): No heartbeat from core client for 30 sec - exiting 23:15:40 (4100): No heartbeat from core client for 30 sec - exiting 23:15:41 (4100): No heartbeat from core client for 30 sec - exiting 23:15:43 (4100): No heartbeat from core client for 30 sec - exiting 23:15:44 (4100): No heartbeat from core client for 30 sec - exiting 23:15:45 (4100): No heartbeat from core client for 30 sec - exiting 23:15:46 (4100): No heartbeat from core client for 30 sec - exiting 23:15:47 (4100): No heartbeat from core client for 30 sec - exiting 23:15:48 (4100): No heartbeat from core client for 30 sec - exiting 23:15:49 (4100): No heartbeat from core client for 30 sec - exiting 23:15:50 (4100): No heartbeat from core client for 30 sec - exiting 23:15:51 (4100): No heartbeat from core client for 30 sec - exiting 23:15:52 (4100): No heartbeat from core client for 30 sec - exiting 23:15:53 (4100): No heartbeat from core client for 30 sec - exiting 23:15:55 (4100): No heartbeat from core client for 30 sec - exiting 23:15:56 (4100): No heartbeat from core client for 30 sec - exiting 23:15:57 (4100): No heartbeat from core client for 30 sec - exiting 23:15:58 (4100): No heartbeat from core client for 30 sec - exiting 23:15:59 (4100): No heartbeat from core client for 30 sec - exiting 23:16:00 (4100): No heartbeat from core client for 30 sec - exiting 23:16:01 (4100): No heartbeat from core client for 30 sec - exiting 23:16:02 (4100): No heartbeat from core client for 30 sec - exiting 23:16:03 (4100): No heartbeat from core client for 30 sec - exiting 23:16:04 (4100): No heartbeat from core client for 30 sec - exiting 23:16:05 (4100): No heartbeat from core client for 30 sec - exiting 23:16:07 (4100): No heartbeat from core client for 30 sec - exiting 23:16:08 (4100): No heartbeat from core client for 30 sec - exiting 23:16:09 (4100): No heartbeat from core client for 30 sec - exiting 23:16:10 (4100): No heartbeat from core client for 30 sec - exiting 23:16:11 (4100): No heartbeat from core client for 30 sec - exiting 23:16:12 (4100): No heartbeat from core client for 30 sec - exiting 23:16:13 (4100): No heartbeat from core client for 30 sec - exiting 23:16:14 (4100): No heartbeat from core client for 30 sec - exiting 05:43:48 (4100): No heartbeat from core client for 30 sec - exiting 05:43:50 (4100): No heartbeat from core client for 30 sec - exiting 05:43:51 (4100): No heartbeat from core client for 30 sec - exiting 05:43:52 (4100): No heartbeat from core client for 30 sec - exiting 05:43:53 (4100): No heartbeat from core client for 30 sec - exiting 05:43:54 (4100): No heartbeat from core client for 30 sec - exiting 05:43:55 (4100): No heartbeat from core client for 30 sec - exiting 05:43:56 (4100): No heartbeat from core client for 30 sec - exiting 05:43:57 (4100): No heartbeat from core client for 30 sec - exiting 05:43:58 (4100): No heartbeat from core client for 30 sec - exiting 05:43:59 (4100): No heartbeat from core client for 30 sec - exiting 05:44:01 (4100): No heartbeat from core client for 30 sec - exiting 05:44:02 (4100): No heartbeat from core client for 30 sec - exiting 05:44:03 (4100): No heartbeat from core client for 30 sec - exiting 05:44:04 (4100): No heartbeat from core client for 30 sec - exiting 05:44:05 (4100): No heartbeat from core client for 30 sec - exiting 05:44:06 (4100): No heartbeat from core client for 30 sec - exiting 05:44:07 (4100): No heartbeat from core client for 30 sec - exiting 05:44:08 (4100): No heartbeat from core client for 30 sec - exiting 05:44:09 (4100): No heartbeat from core client for 30 sec - exiting 05:44:10 (4100): No heartbeat from core client for 30 sec - exiting 05:44:11 (4100): No heartbeat from core client for 30 sec - exiting 05:44:13 (4100): No heartbeat from core client for 30 sec - exiting 05:44:14 (4100): No heartbeat from core client for 30 sec - exiting 05:44:15 (4100): No heartbeat from core client for 30 sec - exiting 05:44:16 (4100): No heartbeat from core client for 30 sec - exiting 05:44:17 (4100): No heartbeat from core client for 30 sec - exiting 05:44:18 (4100): No heartbeat from core client for 30 sec - exiting 05:44:19 (4100): No heartbeat from core client for 30 sec - exiting 05:44:20 (4100): No heartbeat from core client for 30 sec - exiting 05:44:21 (4100): No heartbeat from core client for 30 sec - exiting 05:44:22 (4100): No heartbeat from core client for 30 sec - exiting 05:44:23 (4100): No heartbeat from core client for 30 sec - exiting 05:44:25 (4100): No heartbeat from core client for 30 sec - exiting 05:44:26 (4100): No heartbeat from core client for 30 sec - exiting 05:44:27 (4100): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash d </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
24 May 2012 00:48:54	1168097	14647731	hadcm3n_202k_1940_40_007957023_1	259,200	502,323	1.9380
22 May 2012 19:34:38	1168097	14647731	hadcm3n_202k_1940_40_007957023_1	233,280	450,877	1.9328
21 May 2012 13:01:08	1168097	14647731	hadcm3n_202k_1940_40_007957023_1	207,360	399,840	1.9282
20 May 2012 16:37:08	1168097	14647731	hadcm3n_202k_1940_40_007957023_1	181,440	350,717	1.9330
19 May 2012 21:00:26	1168097	14647731	hadcm3n_202k_1940_40_007957023_1	155,520	301,988	1.9418
19 May 2012 21:00:26	1168097	14647731	hadcm3n_202k_1940_40_007957023_1	129,600	255,681	1.9728
17 May 2012 07:58:19	1168097	14647731	hadcm3n_202k_1940_40_007957023_1	103,680	205,060	1.9778
16 May 2012 03:41:31	1168097	14647731	hadcm3n_202k_1940_40_007957023_1	77,760	153,374	1.9724
15 May 2012 12:27:30	1168097	14647731	hadcm3n_202k_1940_40_007957023_1	51,840	101,854	1.9648
14 May 2012 21:24:02	1168097	14647731	hadcm3n_202k_1940_40_007957023_1	25,920	50,584	1.9515