Task 16840811

Name	hadam3p_eu_nf2y_2013_1_008814042_2
Workunit	8960020
Created	14 Aug 2014, 16:53:01 UTC
Sent	14 Aug 2014, 16:53:05 UTC
Report deadline	27 Jul 2015, 22:13:05 UTC
Received	29 Aug 2014, 10:38:03 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-226 (0xFFFFFF1E) ERR_TOO_MANY_EXITS
Computer ID	1265980
Run time	1 days 22 hours 49 min 18 sec
CPU time	1 days 22 hours 19 min 5 sec
Validate state	Invalid
Credit	995.30
Device peak FLOPS	2.33 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Europe v6.09 i686-pc-linux-gnu
Stderr	<core_client_version>7.0.65</core_client_version> <![CDATA[ <message> too many exit(0)s </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:33:26 (18393): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:33:27 (18393): No heartbeat from core client for 30 sec - exiting 18:39:49 (19152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:40:28 (19152): No heartbeat from core client for 30 sec - exiting 18:40:29 (19152): No heartbeat from core client for 30 sec - exiting 18:44:25 (21582): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:52:43 (24053): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:52:47 (24053): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 19:10:15 (27090): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:16:21 (940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:16:25 (940): No heartbeat from core client for 30 sec - exiting 19:17:20 (3808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:22:33 (3939): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:32:48 (6716): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:38:39 (11504): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:52:12 (13938): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:54:56 (18594): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:54:58 (18594): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:19:13 (19370): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:37:04 (26772): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:42:32 (32336): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:42:34 (32336): No heartbeat from core client for 30 sec - exiting 20:47:56 (2541): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:59:18 (5134): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:59:20 (5134): No heartbeat from core client for 30 sec - exiting 20:59:21 (5134): No heartbeat from core client for 30 sec - exiting 21:04:16 (10610): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:04:19 (10610): No heartbeat from core client for 30 sec - exiting 21:04:20 (10610): No heartbeat from core client for 30 sec - exiting 21:04:21 (10610): No heartbeat from core client for 30 sec - exiting 21:10:54 (13002): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:10:56 (13002): No heartbeat from core client for 30 sec - exiting 21:10:57 (13002): No heartbeat from core client for 30 sec - exiting 21:27:48 (15342): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:27:50 (15342): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 21:33:11 (21952): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:33:17 (21952): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 21:54:54 (24801): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:03:12 (32266): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:08:26 (3194): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:08:34 (3194): No heartbeat from core client for 30 sec - exiting 22:18:39 (5509): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:24:05 (10494): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:35:39 (13151): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:40:37 (18694): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:45:07 (21265): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:45:10 (21265): No heartbeat from core client for 30 sec - exiting 22:50:09 (23828): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:50:13 (23828): No heartbeat from core client for 30 sec - exiting 22:55:13 (26416): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:00:29 (29048): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:04:39 (31865): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:04:45 (31865): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 23:10:21 (2277): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:10:31 (2277): No heartbeat from core client for 30 sec - exiting 23:15:48 (5221): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:21:36 (7765): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:30:20 (10554): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:30:24 (10554): No heartbeat from core client for 30 sec - exiting 23:30:25 (10554): No heartbeat from core client for 30 sec - exiting 23:30:26 (10554): No heartbeat from core client for 30 sec - exiting 23:30:27 (10554): No heartbeat from core client for 30 sec - exiting 23:40:09 (13076): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:47:00 (15898): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:47:03 (15898): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 23:51:44 (18575): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:58:42 (21097): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:05:07 (23793): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:12:01 (26286): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:12:14 (26286): No heartbeat from core client for 30 sec - exiting 00:17:32 (28944): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:22:11 (31602): No heartbeat from core client for 30 sec - exiting 00:22:13 (31602): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:28:10 (2005): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:28:21 (2005): No heartbeat from core client for 30 sec - exiting 00:28:22 (2005): No heartbeat from core client for 30 sec - exiting 00:28:23 (2005): No heartbeat from core client for 30 sec - exiting 00:28:24 (2005): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 00:39:50 (4673): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:39:52 (4673): No heartbeat from core client for 30 sec - exiting 00:39:53 (4673): No heartbeat from core client for 30 sec - exiting 00:39:54 (4673): No heartbeat from core client for 30 sec - exiting 00:39:55 (4673): No heartbeat from core client for 30 sec - exiting 00:39:56 (4673): No heartbeat from core client for 30 sec - exiting 00:39:57 (4673): No heartbeat from core client for 30 sec - exiting 00:45:22 (9945): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:49:40 (12645): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:56:26 (15103): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:03:43 (18055): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:13:41 (20868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:13:43 (20868): No heartbeat from core client for 30 sec - exiting 01:19:42 (25861): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:25:34 (28713): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 01:32:54 (31460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:32:55 (31460): No heartbeat from core client for 30 sec - exiting 01:38:31 (2341): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:42:43 (4074): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:58:52 (6236): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:03:51 (13733): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:03:54 (13733): No heartbeat from core client for 30 sec - exiting 02:03:55 (13733): No heartbeat from core client for 30 sec - exiting 02:09:32 (16199): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:09:42 (16199): No heartbeat from core client for 30 sec - exiting 02:14:45 (18727): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 02:21:53 (21009): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:27:21 (23831): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:27:39 (23831): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 02:32:16 (26323): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:32:18 (26323): No heartbeat from core client for 30 sec - exiting 02:32:19 (26323): No heartbeat from core client for 30 sec - exiting 02:32:20 (26323): No heartbeat from core client for 30 sec - exiting 02:39:06 (28986): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:43:15 (31554): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:43:16 (31554): No heartbeat from core client for 30 sec - exiting 02:50:29 (1798): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:56:55 (4773): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:56:58 (4773): No heartbeat from core client for 30 sec - exiting 02:56:59 (4773): No heartbeat from core client for 30 sec - exiting 02:57:00 (4773): No heartbeat from core client for 30 sec - exiting 02:57:01 (4773): No heartbeat from core client for 30 sec - exiting 02:57:02 (4773): No heartbeat from core client for 30 sec - exiting 02:57:03 (4773): No heartbeat from core client for 30 sec - exiting 03:09:33 (7390): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:11:23 (12581): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:11:30 (12581): No heartbeat from core client for 30 sec - exiting 03:16:20 (12966): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:16:24 (12966): No heartbeat from core client for 30 sec - exiting 03:22:39 (15553): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:27:30 (18077): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:27:33 (18077): No heartbeat from core client for 30 sec - exiting 03:28:55 (20587): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:35:10 (20845): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:35:12 (20845): No heartbeat from core client for 30 sec - exiting 03:40:29 (23324): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:40:36 (23324): No heartbeat from core client for 30 sec - exiting 03:45:59 (25607): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:46:00 (25607): No heartbeat from core client for 30 sec - exiting 03:50:32 (28035): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 04:02:41 (30642): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:02:43 (30642): No heartbeat from core client for 30 sec - exiting 04:02:44 (30642): No heartbeat from core client for 30 sec - exiting 04:02:45 (30642): No heartbeat from core client for 30 sec - exiting 04:02:46 (30642): No heartbeat from core client for 30 sec - exiting 04:02:47 (30642): No heartbeat from core client for 30 sec - exiting 04:02:48 (30642): No heartbeat from core client for 30 sec - exiting 04:02:49 (30642): No heartbeat from core client for 30 sec - exiting 04:02:50 (30642): No heartbeat from core client for 30 sec - exiting 04:02:51 (30642): No heartbeat from core client for 30 sec - exiting 04:02:52 (30642): No heartbeat from core client for 30 sec - exiting 04:02:53 (30642): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 04:09:17 (3826): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 04:16:37 (6581): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:16:40 (6581): No heartbeat from core client for 30 sec - exiting 04:29:33 (9410): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 04:33:46 (12644): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:35:43 (15205): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:40:59 (15661): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:53:29 (18150): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 04:58:33 (23040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:58:36 (23040): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 05:05:42 (25818): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:05:50 (25818): No heartbeat from core client for 30 sec - exiting 05:05:51 (25818): No heartbeat from core client for 30 sec - exiting 05:12:16 (28656): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:13:35 (31409): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:13:49 (31409): No heartbeat from core client for 30 sec - exiting 05:13:50 (31409): No heartbeat from core client for 30 sec - exiting 05:13:51 (31409): No heartbeat from core client for 30 sec - exiting 05:23:48 (31670): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:23:52 (31670): No heartbeat from core client for 30 sec - exiting 05:23:53 (31670): No heartbeat from core client for 30 sec - exiting 05:23:54 (31670): No heartbeat from core client for 30 sec - exiting 05:23:55 (31670): No heartbeat from core client for 30 sec - exiting 05:29:01 (4694): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:29:02 (4694): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 05:35:08 (7292): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:35:10 (7292): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 05:45:31 (12515): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 05:55:20 (12750): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:00:03 (17317): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:05:02 (19685): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:14:28 (22239): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:25:50 (27301): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:30:14 (30874): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:36:19 (1127): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:36:26 (1127): No heartbeat from core client for 30 sec - exiting </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
26 Aug 2014 03:04:03	1265980	16840811	hadam3p_eu_nf2y_2013_1_008814042_2	57,696	147,239	2.5520
21 Aug 2014 07:12:42	1265980	16840811	hadam3p_eu_nf2y_2013_1_008814042_2	46,176	117,837	2.5519
20 Aug 2014 09:38:44	1265980	16840811	hadam3p_eu_nf2y_2013_1_008814042_2	34,656	88,386	2.5504
17 Aug 2014 00:10:55	1265980	16840811	hadam3p_eu_nf2y_2013_1_008814042_2	23,136	58,980	2.5493
15 Aug 2014 10:12:17	1265980	16840811	hadam3p_eu_nf2y_2013_1_008814042_2	11,616	29,701	2.5569