Task 17057429

Name	hadcm3s_23jx_1991_2_009012580_0
Workunit	9144012
Created	18 Sep 2014, 19:14:45 UTC
Sent	18 Sep 2014, 19:15:24 UTC
Report deadline	19 Dec 2014, 2:42:35 UTC
Received	6 Oct 2014, 15:21:56 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-226 (0xFFFFFF1E) ERR_TOO_MANY_EXITS
Computer ID	1316219
Run time	5 days 10 hours 57 min 46 sec
CPU time	5 days 10 hours 11 min 40 sec
Validate state	Invalid
Credit	311.04
Device peak FLOPS	0.34 GFLOPS
Application version	UK Met Office HadCM3 short v7.24 i686-pc-linux-gnu
Stderr	<core_client_version>7.0.27</core_client_version> <![CDATA[ <message> too many exit(0)s </message> <stderr_txt> MonID=5421, UMPID=5425, RM3PID=0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:33:41 (5421): No heartbeat from client for 30 sec - exiting 06:33:42 (5421): timer handler: client dead, exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... MonID=7391, UMPID=7393, RM3PID=0 03:25:16 (7391): No heartbeat from client for 30 sec - exiting 03:25:19 (7391): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... MonID=8112, UMPID=8117, RM3PID=0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 05:14:56 (8112): No heartbeat from client for 30 sec - exiting 05:15:00 (8112): timer handler: client dead, exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 05:15:02 (8112): No heartbeat from client for 30 sec - exiting 05:15:02 (8112): timer handler: client dead, exiting 05:15:03 (8112): No heartbeat from client for 30 sec - exiting 05:15:03 (8112): timer handler: client dead, exiting MonID=7272, UMPID=7274, RM3PID=0 Suspended CPDN Monitor - Suspend request from BOINC... 05:13:08 (7272): No heartbeat from client for 30 sec - exiting 05:13:08 (7272): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:13:09 (7272): No heartbeat from client for 30 sec - exiting 05:13:09 (7272): timer handler: client dead, exiting MonID=24636, UMPID=24645, RM3PID=0 05:19:03 (24636): No heartbeat from client for 30 sec - exiting 05:19:04 (24636): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... MonID=24701, UMPID=24708, RM3PID=0 05:29:07 (24701): No heartbeat from client for 30 sec - exiting 05:29:07 (24701): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:29:08 (24701): No heartbeat from client for 30 sec - exiting 05:29:08 (24701): timer handler: client dead, exiting MonID=24782, UMPID=24794, RM3PID=0 Suspended CPDN Monitor - Suspend request from BOINC... 05:32:21 (24782): No heartbeat from client for 30 sec - exiting 05:32:26 (24782): timer handler: client dead, exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 05:32:27 (24782): No heartbeat from client for 30 sec - exiting 05:32:27 (24782): timer handler: client dead, exiting MonID=25645, UMPID=25649, RM3PID=0 07:27:57 (25645): No heartbeat from client for 30 sec - exiting 07:27:57 (25645): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... MonID=25675, UMPID=25679, RM3PID=0 07:33:44 (25675): No heartbeat from client for 30 sec - exiting 07:33:45 (25675): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:33:46 (25675): No heartbeat from client for 30 sec - exiting 07:33:46 (25675): timer handler: client dead, exiting MonID=25742, UMPID=25744, RM3PID=0 07:34:53 (25742): No heartbeat from client for 30 sec - exiting 07:34:54 (25742): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:34:55 (25742): No heartbeat from client for 30 sec - exiting 07:34:56 (25742): timer handler: client dead, exiting MonID=25773, UMPID=25775, RM3PID=0 07:39:36 (25773): No heartbeat from client for 30 sec - exiting 07:39:37 (25773): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... MonID=25836, UMPID=25839, RM3PID=0 07:45:26 (25836): No heartbeat from client for 30 sec - exiting 07:45:26 (25836): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... MonID=25893, UMPID=25897, RM3PID=0 07:51:17 (25893): No heartbeat from client for 30 sec - exiting 07:51:18 (25893): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... MonID=25951, UMPID=25953, RM3PID=0 07:57:09 (25951): No heartbeat from client for 30 sec - exiting 07:57:10 (25951): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... MonID=26018, UMPID=26021, RM3PID=0 08:03:09 (26018): No heartbeat from client for 30 sec - exiting 08:03:14 (26018): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:03:15 (26018): No heartbeat from client for 30 sec - exiting 08:03:15 (26018): timer handler: client dead, exiting MonID=26080, UMPID=26084, RM3PID=0 08:09:18 (26080): No heartbeat from client for 30 sec - exiting 08:09:19 (26080): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:09:20 (26080): No heartbeat from client for 30 sec - exiting 08:09:20 (26080): timer handler: client dead, exiting MonID=26139, UMPID=26141, RM3PID=0 08:15:23 (26139): No heartbeat from client for 30 sec - exiting 08:15:23 (26139): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:15:24 (26139): No heartbeat from client for 30 sec - exiting 08:15:24 (26139): timer handler: client dead, exiting MonID=26184, UMPID=26199, RM3PID=0 08:21:14 (26184): No heartbeat from client for 30 sec - exiting 08:21:14 (26184): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... MonID=26256, UMPID=26259, RM3PID=0 08:27:50 (26256): No heartbeat from client for 30 sec - exiting 08:27:52 (26256): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... MonID=26305, UMPID=26322, RM3PID=0 08:33:58 (26305): No heartbeat from client for 30 sec - exiting 08:33:58 (26305): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... MonID=26366, UMPID=26369, RM3PID=0 08:34:58 (26366): No heartbeat from client for 30 sec - exiting 08:34:59 (26366): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... MonID=26387, UMPID=26403, RM3PID=0 08:39:48 (26387): No heartbeat from client for 30 sec - exiting 08:39:50 (26387): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:39:52 (26387): No heartbeat from client for 30 sec - exiting 08:39:52 (26387): timer handler: client dead, exiting MonID=26439, UMPID=26455, RM3PID=0 08:46:07 (26439): No heartbeat from client for 30 sec - exiting 08:46:08 (26439): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... MonID=26496, UMPID=26513, RM3PID=0 08:52:06 (26496): No heartbeat from client for 30 sec - exiting 08:52:07 (26496): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:52:08 (26496): No heartbeat from client for 30 sec - exiting 08:52:08 (26496): timer handler: client dead, exiting 08:52:09 (26496): No heartbeat from client for 30 sec - exiting 08:52:09 (26496): timer handler: client dead, exiting MonID=26551, UMPID=26568, RM3PID=0 08:58:16 (26551): No heartbeat from client for 30 sec - exiting 08:58:18 (26551): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:58:19 (26551): No heartbeat from client for 30 sec - exiting 08:58:19 (26551): timer handler: client dead, exiting MonID=26610, UMPID=26626, RM3PID=0 09:00:27 (26610): No heartbeat from client for 30 sec - exiting 09:00:27 (26610): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... MonID=26644, UMPID=26648, RM3PID=0 09:03:09 (26644): No heartbeat from client for 30 sec - exiting 09:03:09 (26644): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... MonID=26688, UMPID=26693, RM3PID=0 09:04:28 (26688): No heartbeat from client for 30 sec - exiting 09:04:29 (26688): timer handler: client dead, exiting 09:04:30 (26688): No heartbeat from client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:04:33 (26688): timer handler: client dead, exiting MonID=26724, UMPID=26728, RM3PID=0 09:05:32 (26724): No heartbeat from client for 30 sec - exiting 09:05:32 (26724): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:05:33 (26724): No heartbeat from client for 30 sec - exiting 09:05:33 (26724): timer handler: client dead, exiting MonID=26752, UMPID=26771, RM3PID=0 09:21:47 (26752): No heartbeat from client for 30 sec - exiting 09:21:48 (26752): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... MonID=26870, UMPID=26890, RM3PID=0 09:28:02 (26870): No heartbeat from client for 30 sec - exiting 09:28:03 (26870): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:28:04 (26870): No heartbeat from client for 30 sec - exiting 09:28:05 (26870): timer handler: client dead, exiting MonID=26930, UMPID=26948, RM3PID=0 09:34:01 (26930): No heartbeat from client for 30 sec - exiting 09:34:01 (26930): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:34:02 (26930): No heartbeat from client for 30 sec - exiting 09:34:02 (26930): timer handler: client dead, exiting MonID=26993, UMPID=26997, RM3PID=0 09:45:23 (26993): No heartbeat from client for 30 sec - exiting 09:45:24 (26993): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:45:25 (26993): No heartbeat from client for 30 sec - exiting 09:45:25 (26993): timer handler: client dead, exiting MonID=27080, UMPID=27098, RM3PID=0 09:51:18 (27080): No heartbeat from client for 30 sec - exiting 09:51:18 (27080): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... MonID=27137, UMPID=27153, RM3PID=0 09:57:24 (27137): No heartbeat from client for 30 sec - exiting 09:57:25 (27137): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:57:26 (27137): No heartbeat from client for 30 sec - exiting 09:57:26 (27137): timer handler: client dead, exiting MonID=27194, UMPID=27210, RM3PID=0 09:58:25 (27194): No heartbeat from client for 30 sec - exiting 09:58:25 (27194): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:58:26 (27194): No heartbeat from client for 30 sec - exiting 09:58:26 (27194): timer handler: client dead, exiting MonID=27215, UMPID=27237, RM3PID=0 10:03:24 (27215): No heartbeat from client for 30 sec - exiting 10:03:26 (27215): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... MonID=27270, UMPID=27279, RM3PID=0 10:09:27 (27270): No heartbeat from client for 30 sec - exiting 10:09:28 (27270): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:09:29 (27270): No heartbeat from client for 30 sec - exiting 10:09:29 (27270): timer handler: client dead, exiting MonID=27343, UMPID=27362, RM3PID=0 10:15:35 (27343): No heartbeat from client for 30 sec - exiting 10:15:36 (27343): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:15:37 (27343): No heartbeat from client for 30 sec - exiting 10:15:37 (27343): timer handler: client dead, exiting MonID=27399, UMPID=27417, RM3PID=0 10:16:55 (27399): No heartbeat from client for 30 sec - exiting 10:16:56 (27399): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... MonID=27426, UMPID=27433, RM3PID=0 10:33:02 (27426): No heartbeat from client for 30 sec - exiting 10:33:03 (27426): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... MonID=27537, UMPID=27546, RM3PID=0 10:36:21 (27537): No heartbeat from client for 30 sec - exiting 10:36:22 (27537): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:36:23 (27537): No heartbeat from client for 30 sec - exiting 10:36:23 (27537): timer handler: client dead, exiting MonID=27584, UMPID=27588, RM3PID=0 10:39:13 (27584): No heartbeat from client for 30 sec - exiting 10:39:15 (27584): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... MonID=27613, UMPID=27618, RM3PID=0 10:40:51 (27613): No heartbeat from client for 30 sec - exiting 10:40:52 (27613): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:40:53 (27613): No heartbeat from client for 30 sec - exiting 10:40:54 (27613): timer handler: client dead, exiting MonID=27643, UMPID=27647, RM3PID=0 10:56:27 (27643): No heartbeat from client for 30 sec - exiting 10:56:28 (27643): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:56:29 (27643): No heartbeat from client for 30 sec - exiting 10:56:29 (27643): timer handler: client dead, exiting MonID=27767, UMPID=27772, RM3PID=0 11:02:27 (27767): No heartbeat from client for 30 sec - exiting 11:02:29 (27767): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:02:30 (27767): No heartbeat from client for 30 sec - exiting 11:02:30 (27767): timer handler: client dead, exiting MonID=27836, UMPID=27840, RM3PID=0 11:12:40 (27836): No heartbeat from client for 30 sec - exiting 11:12:40 (27836): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... MonID=27907, UMPID=27923, RM3PID=0 11:18:32 (27907): No heartbeat from client for 30 sec - exiting 11:18:33 (27907): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:18:34 (27907): No heartbeat from client for 30 sec - exiting 11:18:34 (27907): timer handler: client dead, exiting 11:18:35 (27907): No heartbeat from client for 30 sec - exiting 11:18:35 (27907): timer handler: client dead, exiting MonID=27978, UMPID=27982, RM3PID=0 11:24:38 (27978): No heartbeat from client for 30 sec - exiting 11:24:39 (27978): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... MonID=28025, UMPID=28029, RM3PID=0 11:37:18 (28025): No heartbeat from client for 30 sec - exiting 11:37:19 (28025): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:37:20 (28025): No heartbeat from client for 30 sec - exiting 11:37:20 (28025): timer handler: client dead, exiting 11:37:21 (28025): No heartbeat from client for 30 sec - exiting 11:37:21 (28025): timer handler: client dead, exiting MonID=28125, UMPID=28129, RM3PID=0 11:41:28 (28125): No heartbeat from client for 30 sec - exiting 11:41:29 (28125): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:41:30 (28125): No heartbeat from client for 30 sec - exiting 11:41:30 (28125): timer handler: client dead, exiting MonID=28172, UMPID=28176, RM3PID=0 11:59:02 (28172): No heartbeat from client for 30 sec - exiting 11:59:03 (28172): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... MonID=28304, UMPID=28310, RM3PID=0 12:00:16 (28304): No heartbeat from client for 30 sec - exiting 12:00:16 (28304): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... MonID=28331, UMPID=28335, RM3PID=0 12:05:11 (28331): No heartbeat from client for 30 sec - exiting 12:05:12 (28331): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:05:13 (28331): No heartbeat from client for 30 sec - exiting 12:05:13 (28331): timer handler: client dead, exiting 12:05:14 (28331): No heartbeat from client for 30 sec - exiting 12:05:14 (28331): timer handler: client dead, exiting MonID=28387, UMPID=28391, RM3PID=0 12:11:20 (28387): No heartbeat from client for 30 sec - exiting 12:11:22 (28387): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:11:23 (28387): No heartbeat from client for 30 sec - exiting 12:11:23 (28387): timer handler: client dead, exiting MonID=28436, UMPID=28449, RM3PID=0 12:24:18 (28436): No heartbeat from client for 30 sec - exiting 12:24:18 (28436): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... MonID=28532, UMPID=28536, RM3PID=0 12:25:49 (28532): No heartbeat from client for 30 sec - exiting 12:25:49 (28532): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:25:50 (28532): No heartbeat from client for 30 sec - exiting 12:25:50 (28532): timer handler: client dead, exiting MonID=28574, UMPID=28587, RM3PID=0 12:31:41 (28574): No heartbeat from client for 30 sec - exiting 12:31:42 (28574): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:31:43 (28574): No heartbeat from client for 30 sec - exiting 12:31:43 (28574): timer handler: client dead, exiting MonID=28640, UMPID=28644, RM3PID=0 12:37:48 (28640): No heartbeat from client for 30 sec - exiting 12:37:48 (28640): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... MonID=28686, UMPID=28706, RM3PID=0 12:43:39 (28686): No heartbeat from client for 30 sec - exiting 12:43:39 (28686): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:43:40 (28686): No heartbeat from client for 30 sec - exiting 12:43:40 (28686): timer handler: client dead, exiting MonID=28742, UMPID=28760, RM3PID=0 12:49:43 (28742): No heartbeat from client for 30 sec - exiting 12:49:43 (28742): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:49:44 (28742): No heartbeat from client for 30 sec - exiting 12:49:44 (28742): timer handler: client dead, exiting MonID=28799, UMPID=28803, RM3PID=0 13:06:45 (28799): No heartbeat from client for 30 sec - exiting 13:06:46 (28799): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:06:47 (28799): No heartbeat from client for 30 sec - exiting 13:06:47 (28799): timer handler: client dead, exiting 13:06:48 (28799):MonID=28916, UMPID=28932, RM3PID=0 13:12:51 (28916): No heartbeat from client for 30 sec - exiting 13:12:51 (28916): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... MonID=28984, UMPID=28988, RM3PID=0 13:18:55 (28984): No heartbeat from client for 30 sec - exiting 13:18:56 (28984): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:18:57 (28984): No heartbeat from client for 30 sec - exiting 13:18:57 (28984): timer handler: client dead, exiting MonID=29044, UMPID=29048, RM3PID=0 13:30:27 (29044): No heartbeat from client for 30 sec - exiting 13:30:27 (29044): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... MonID=29119, UMPID=29123, RM3PID=0 13:36:24 (29119): No heartbeat from client for 30 sec - exiting 13:36:25 (29119): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... MonID=29177, UMPID=29181, RM3PID=0 13:39:24 (29177): No heartbeat from client for 30 sec - exiting 13:39:25 (29177): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:39:26 (29177): No heartbeat from client for 30 sec - exiting 13:39:26 (29177): timer handler: client dead, exiting MonID=29229, UMPID=29233, RM3PID=0 13:42:12 (29229): No heartbeat from client for 30 sec - exiting 13:42:12 (29229): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... MonID=29256, UMPID=29260, RM3PID=0 13:47:59 (29256): No heartbeat from client for 30 sec - exiting 13:48:00 (29256): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:48:01 (29256): No heartbeat from client for 30 sec - exiting 13:48:01 (29256): timer handler: client dead, exiting 13:48:02 (29256): No heartbeat from client for 30 sec - exiting 13:48:02 (29256): timer handler: client dead, exiting MonID=29313, UMPID=29329, RM3PID=0 13:54:27 (29313): No heartbeat from client for 30 sec - exiting 13:54:29 (29313): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:54:30 (29313): No heartbeat from client for 30 sec - exiting 13:54:30 (29313): timer handler: client dead, exiting MonID=29380, UMPID=29384, RM3PID=0 14:00:33 (29380): No heartbeat from client for 30 sec - exiting 14:00:35 (29380): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... MonID=29435, UMPID=29439, RM3PID=0 14:05:20 (29435): No heartbeat from client for 30 sec - exiting 14:05:21 (29435): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... MonID=29466, UMPID=29470, RM3PID=0 14:06:29 (29466): No heartbeat from client for 30 sec - exiting 14:06:30 (29466): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:06:31 (29466): No heartbeat from client for 30 sec - exiting 14:06:31 (29466): timer handler: client dead, exiting 14:06:32 (29466): No heartbeat from client for 30 sec - exiting 14:06:32 (29466): timer handler: client dead, exiting 14:06:33 (29466): No heartbeat from client for 30 sec - exiting 14:06:33 (29466): timer handler: client dead, exiting MonID=29487, UMPID=29503, RM3PID=0 14:12:23 (29487): No heartbeat from client for 30 sec - exiting 14:12:27 (29487): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:12:28 (29487): No heartbeat from client for 30 sec - exiting 14:12:28 (29487): timer handler: client dead, exiting MonID=29543, UMPID=29547, RM3PID=0 14:18:13 (29543): No heartbeat from client for 30 sec - exiting 14:18:13 (29543): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:18:14 (29543): No heartbeat from client for 30 sec - exiting 14:18:14 (29543): timer handler: client dead, exiting MonID=29602, UMPID=29606, RM3PID=0 14:23:13 (29602): No heartbeat from client for 30 sec - exiting 14:23:13 (29602): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... MonID=29659, UMPID=29663, RM3PID=0 14:28:31 (29659): No heartbeat from client for 30 sec - exiting 14:28:33 (29659): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... MonID=29718, UMPID=29722, RM3PID=0 14:30:06 (29718): No heartbeat from client for 30 sec - exiting 14:30:06 (29718): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... MonID=29740, UMPID=29744, RM3PID=0 14:35:57 (29740): No heartbeat from client for 30 sec - exiting 14:35:58 (29740): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... MonID=29812, UMPID=29816, RM3PID=0 14:47:45 (29812): No heartbeat from client for 30 sec - exiting 14:47:45 (29812): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... MonID=29902, UMPID=29908, RM3PID=0 14:51:20 (29902): No heartbeat from client for 30 sec - exiting 14:51:21 (29902): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... MonID=29942, UMPID=29961, RM3PID=0 14:53:34 (29942): No heartbeat from client for 30 sec - exiting 14:53:34 (29942): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... MonID=29979, UMPID=29997, RM3PID=0 14:59:22 (29979): No heartbeat from client for 30 sec - exiting 14:59:23 (29979): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... MonID=30036, UMPID=30057, RM3PID=0 15:02:10 (30036): No heartbeat from client for 30 sec - exiting 15:02:10 (30036): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:02:11 (30036): No heartbeat from client for 30 sec - exiting 15:02:11 (30036): timer handler: client dead, exiting MonID=30082, UMPID=30088, RM3PID=0 15:05:37 (30082): No heartbeat from client for 30 sec - exiting 15:05:37 (30082): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:05:38 (30082): No heartbeat from client for 30 sec - exiting 15:05:39 (30082): timer handler: client dead, exiting MonID=30118, UMPID=30133, RM3PID=0 15:12:19 (30118): No heartbeat from client for 30 sec - exiting 15:12:22 (30118): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:12:23 (30118): No heartbeat from client for 30 sec - exiting 15:12:23 (30118): timer handler: client dead, exiting MonID=30171, UMPID=30177, RM3PID=0 15:17:19 (30171): No heartbeat from client for 30 sec - exiting 15:17:20 (30171): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... MonID=30225, UMPID=30231, RM3PID=0 15:21:29 (30225): No heartbeat from client for 30 sec - exiting 15:21:30 (30225): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:21:31 (30225): No heartbeat from client for 30 sec - exiting 15:21:31 (30225): timer handler: client dead, exiting MonID=30271, UMPID=30291, RM3PID=0 15:23:13 (30271): No heartbeat from client for 30 sec - exiting 15:23:13 (30271): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:23:14 (30271): No heartbeat from client for 30 sec - exiting 15:23:16 (30271): timer handler: client dead, exiting MonID=30307, UMPID=30313, RM3PID=0 15:28:37 (30307): No heartbeat from client for 30 sec - exiting 15:28:37 (30307): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:28:39 (30307): No heartbeat from client for 30 sec - exiting 15:28:39 (30307): timer handler: client dead, exiting MonID=30352, UMPID=30356, RM3PID=0 15:29:23 (30352): No heartbeat from client for 30 sec - exiting 15:29:23 (30352): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... MonID=30380, UMPID=30384, RM3PID=0 15:35:02 (30380): No heartbeat from client for 30 sec - exiting 15:35:07 (30380): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... MonID=30439, UMPID=30443, RM3PID=0 15:41:18 (30439): No heartbeat from client for 30 sec - exiting 15:41:19 (30439): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... MonID=30486, UMPID=30491, RM3PID=0 15:47:15 (30486): No heartbeat from client for 30 sec - exiting 15:47:16 (30486): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:47:17 (30486): No heartbeat from client for 30 sec - exiting 15:47:17 (30486): timer handler: client dead, exiting MonID=30556, UMPID=30560, RM3PID=0 15:53:36 (30556): No heartbeat from client for 30 sec - exiting 15:53:37 (30556): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... MonID=30615, UMPID=30620, RM3PID=0 15:59:40 (30615): No heartbeat from client for 30 sec - exiting 15:59:40 (30615): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:59:41 (30615): No heartbeat from client for 30 sec - exiting 15:59:41 (30615): timer handler: client dead, exiting MonID=30673, UMPID=30677, RM3PID=0 16:05:39 (30673): No heartbeat from client for 30 sec - exiting 16:05:41 (30673): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... MonID=30720, UMPID=30736, RM3PID=0 16:11:29 (30720): No heartbeat from client for 30 sec - exiting 16:11:29 (30720): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:11:30 (30720): No heartbeat from client for 30 sec - exiting 16:11:30 (30720): timer handler: client dead, exiting MonID=30775, UMPID=30791, RM3PID=0 16:17:41 (30775): No heartbeat from client for 30 sec - exiting 16:17:41 (30775): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:17:42 (30775): No heartbeat from client for 30 sec - exiting 16:17:42 (30775): timer handler: client dead, exiting MonID=30846, UMPID=30852, RM3PID=0 16:23:43 (30846): No heartbeat from client for 30 sec - exiting 16:23:44 (30846): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... MonID=30896, UMPID=30914, RM3PID=0 16:35:06 (30896): No heartbeat from client for 30 sec - exiting 16:35:06 (30896): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... MonID=31004, UMPID=31008, RM3PID=0 16:44:36 (31004): No heartbeat from client for 30 sec - exiting 16:44:37 (31004): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... MonID=31069, UMPID=31073, RM3PID=0 16:46:45 (31069): No heartbeat from client for 30 sec - exiting 16:46:45 (31069): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... MonID=31119, UMPID=31123, RM3PID=0 16:53:07 (31119): No heartbeat from client for 30 sec - exiting 16:53:08 (31119): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:53:09 (31119): No heartbeat from client for 30 sec - exiting 16:53:09 (31119): timer handler: client dead, exiting </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
27 Sep 2014 11:22:04	1316219	17057429	hadcm3s_23jx_1991_2_009012580_0	25,920	308,438	11.8996