Task 16324103

Name	hadam3p_eu_n1j1_2013_1_008541632_0
Workunit	8689144
Created	3 Mar 2014, 17:51:10 UTC
Sent	3 Mar 2014, 17:56:31 UTC
Report deadline	13 Feb 2015, 23:16:31 UTC
Received	10 Mar 2014, 21:37:25 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-226 (0xFFFFFF1E) ERR_TOO_MANY_EXITS
Computer ID	1314929
Run time	23 hours 19 min 35 sec
CPU time	22 hours 18 min 27 sec
Validate state	Invalid
Credit	796.57
Device peak FLOPS	3.57 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Europe v6.09 windows_intelx86
Stderr	<core_client_version>7.2.33</core_client_version> <![CDATA[ <message> too many exit(0)s </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5648, selfPID=5460, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:01:25 (6720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:03:10 (6280): No heartbeat from core client for 30 sec - exiting 12:03:11 (6280): No heartbeat from core client for 30 sec - exiting 12:03:12 (6280): No heartbeat from core client for 30 sec - exiting 12:03:13 (6280): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:03:14 (6280): No heartbeat from core client for 30 sec - exiting 12:05:01 (5732): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:05:02 (5732): No heartbeat from core client for 30 sec - exiting 12:06:46 (4736): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:06:47 (4736): No heartbeat from core client for 30 sec - exiting 12:08:29 (3004): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:08:30 (3004): No heartbeat from core client for 30 sec - exiting 12:10:11 (5180): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:10:12 (5180): No heartbeat from core client for 30 sec - exiting 12:11:55 (5060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:11:56 (5060): No heartbeat from core client for 30 sec - exiting 12:13:38 (5508): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:13:39 (5508): No heartbeat from core client for 30 sec - exiting 12:15:22 (6892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:15:23 (6892): No heartbeat from core client for 30 sec - exiting 12:17:05 (6660): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:17:06 (6660): No heartbeat from core client for 30 sec - exiting 12:18:47 (5308): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:18:48 (5308): No heartbeat from core client for 30 sec - exiting 12:20:31 (6672): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:20:32 (6672): No heartbeat from core client for 30 sec - exiting 12:22:17 (6664): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:22:18 (6664): No heartbeat from core client for 30 sec - exiting 12:23:59 (6112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:24:01 (6112): No heartbeat from core client for 30 sec - exiting 12:25:43 (6936): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:25:44 (6936): No heartbeat from core client for 30 sec - exiting 12:27:26 (5128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:27:27 (5128): No heartbeat from core client for 30 sec - exiting 12:29:07 (5876): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:29:09 (5876): No heartbeat from core client for 30 sec - exiting 12:30:50 (4428): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:30:51 (4428): No heartbeat from core client for 30 sec - exiting 12:32:33 (7020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:32:34 (7020): No heartbeat from core client for 30 sec - exiting 12:34:17 (7048): No heartbeat from core client for 30 sec - exiting 12:34:18 (7048): No heartbeat from core client for 30 sec - exiting 12:34:19 (7048): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:34:20 (7048): No heartbeat from core client for 30 sec - exiting 12:36:15 (4976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:36:16 (4976): No heartbeat from core client for 30 sec - exiting 12:38:04 (636): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:38:05 (636): No heartbeat from core client for 30 sec - exiting 12:39:53 (6512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:39:54 (6512): No heartbeat from core client for 30 sec - exiting 12:41:38 (6740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:41:39 (6740): No heartbeat from core client for 30 sec - exiting 12:43:28 (5948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:43:29 (5948): No heartbeat from core client for 30 sec - exiting 12:45:20 (3108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:45:21 (3108): No heartbeat from core client for 30 sec - exiting 12:47:12 (3744): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:47:13 (3744): No heartbeat from core client for 30 sec - exiting 12:49:03 (4408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:49:04 (4408): No heartbeat from core client for 30 sec - exiting 12:50:52 (6744): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:50:53 (6744): No heartbeat from core client for 30 sec - exiting 12:52:47 (5104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:52:48 (5104): No heartbeat from core client for 30 sec - exiting 12:54:38 (6464): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:54:40 (6464): No heartbeat from core client for 30 sec - exiting 12:56:28 (6256): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:56:29 (6256): No heartbeat from core client for 30 sec - exiting 12:58:18 (5948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:58:19 (5948): No heartbeat from core client for 30 sec - exiting 13:00:10 (4792): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:00:11 (4792): No heartbeat from core client for 30 sec - exiting 13:02:01 (6388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:02:02 (6388): No heartbeat from core client for 30 sec - exiting 13:03:49 (5928): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:03:50 (5928): No heartbeat from core client for 30 sec - exiting 13:05:37 (4740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:05:38 (4740): No heartbeat from core client for 30 sec - exiting 13:07:28 (6320): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:07:29 (6320): No heartbeat from core client for 30 sec - exiting 13:09:19 (4624): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:09:21 (4624): No heartbeat from core client for 30 sec - exiting 13:11:09 (6028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:11:10 (6028): No heartbeat from core client for 30 sec - exiting 13:12:58 (4008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:12:59 (4008): No heartbeat from core client for 30 sec - exiting 13:14:44 (3300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:14:45 (3300): No heartbeat from core client for 30 sec - exiting 13:16:34 (4996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:16:35 (4996): No heartbeat from core client for 30 sec - exiting 13:18:24 (5904): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:18:25 (5904): No heartbeat from core client for 30 sec - exiting 13:20:14 (6564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:20:15 (6564): No heartbeat from core client for 30 sec - exiting 13:22:05 (4332): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:22:06 (4332): No heartbeat from core client for 30 sec - exiting 13:23:54 (6464): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:23:55 (6464): No heartbeat from core client for 30 sec - exiting 13:25:46 (6436): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:25:47 (6436): No heartbeat from core client for 30 sec - exiting 13:27:36 (5296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:27:37 (5296): No heartbeat from core client for 30 sec - exiting 13:29:28 (6804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:29:29 (6804): No heartbeat from core client for 30 sec - exiting 13:31:18 (6660): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:31:19 (6660): No heartbeat from core client for 30 sec - exiting 13:33:09 (5912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:33:10 (5912): No heartbeat from core client for 30 sec - exiting 13:35:03 (4688): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:35:04 (4688): No heartbeat from core client for 30 sec - exiting 13:37:05 (6804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:37:06 (6804): No heartbeat from core client for 30 sec - exiting 13:39:03 (6584): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:39:04 (6584): No heartbeat from core client for 30 sec - exiting 13:40:58 (4948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:40:59 (4948): No heartbeat from core client for 30 sec - exiting 13:42:46 (6752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:42:47 (6752): No heartbeat from core client for 30 sec - exiting 13:44:36 (5840): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:44:37 (5840): No heartbeat from core client for 30 sec - exiting 13:46:28 (6476): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:46:29 (6476): No heartbeat from core client for 30 sec - exiting 13:48:21 (6384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:48:22 (6384): No heartbeat from core client for 30 sec - exiting 13:50:09 (6908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:50:10 (6908): No heartbeat from core client for 30 sec - exiting 13:51:59 (4996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:52:00 (4996): No heartbeat from core client for 30 sec - exiting 13:53:53 (6200): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:53:54 (6200): No heartbeat from core client for 30 sec - exiting 13:55:43 (6388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:55:44 (6388): No heartbeat from core client for 30 sec - exiting 13:57:32 (6860): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:57:33 (6860): No heartbeat from core client for 30 sec - exiting 13:59:21 (1388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:59:23 (1388): No heartbeat from core client for 30 sec - exiting 14:01:13 (6964): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:01:14 (6964): No heartbeat from core client for 30 sec - exiting 14:03:02 (1788): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:03:03 (1788): No heartbeat from core client for 30 sec - exiting 14:04:50 (5724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:04:51 (5724): No heartbeat from core client for 30 sec - exiting 14:06:43 (1396): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:06:44 (1396): No heartbeat from core client for 30 sec - exiting 14:08:33 (4300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:08:34 (4300): No heartbeat from core client for 30 sec - exiting 14:10:23 (6512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:10:24 (6512): No heartbeat from core client for 30 sec - exiting 14:12:12 (5992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:12:13 (5992): No heartbeat from core client for 30 sec - exiting 14:14:01 (988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:14:02 (988): No heartbeat from core client for 30 sec - exiting 14:15:53 (4740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:15:55 (4740): No heartbeat from core client for 30 sec - exiting 14:17:43 (5188): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:17:44 (5188): No heartbeat from core client for 30 sec - exiting 14:19:33 (3388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:19:34 (3388): No heartbeat from core client for 30 sec - exiting 14:21:22 (6040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:21:23 (6040): No heartbeat from core client for 30 sec - exiting 14:23:12 (5996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:23:13 (5996): No heartbeat from core client for 30 sec - exiting 14:25:03 (6808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:25:04 (6808): No heartbeat from core client for 30 sec - exiting 14:26:53 (6592): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:26:54 (6592): No heartbeat from core client for 30 sec - exiting 14:28:41 (3304): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:28:42 (3304): No heartbeat from core client for 30 sec - exiting 14:30:31 (4228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:30:32 (4228): No heartbeat from core client for 30 sec - exiting 14:32:22 (3104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:32:23 (3104): No heartbeat from core client for 30 sec - exiting 14:34:09 (1388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:34:10 (1388): No heartbeat from core client for 30 sec - exiting 14:35:59 (5216): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:36:00 (5216): No heartbeat from core client for 30 sec - exiting 14:37:48 (4228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:37:49 (4228): No heartbeat from core client for 30 sec - exiting 14:39:39 (4348): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:39:40 (4348): No heartbeat from core client for 30 sec - exiting 14:41:29 (6752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:41:30 (6752): No heartbeat from core client for 30 sec - exiting 14:43:19 (6844): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:43:21 (6844): No heartbeat from core client for 30 sec - exiting 14:45:09 (6748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:45:10 (6748): No heartbeat from core client for 30 sec - exiting 14:46:59 (5216): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:47:00 (5216): No heartbeat from core client for 30 sec - exiting 14:48:50 (6028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:48:51 (6028): No heartbeat from core client for 30 sec - exiting 14:50:41 (3820): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:50:42 (3820): No heartbeat from core client for 30 sec - exiting 14:52:34 (192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:52:35 (192): No heartbeat from core client for 30 sec - exiting 14:54:24 (6020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:54:25 (6020): No heartbeat from core client for 30 sec - exiting 14:56:17 (6880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:56:18 (6880): No heartbeat from core client for 30 sec - exiting 14:58:10 (5052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:58:11 (5052): No heartbeat from core client for 30 sec - exiting 15:00:02 (6544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:00:03 (6544): No heartbeat from core client for 30 sec - exiting 15:01:51 (6752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:01:52 (6752): No heartbeat from core client for 30 sec - exiting 15:03:43 (6988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:03:45 (6988): No heartbeat from core client for 30 sec - exiting </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
09 Mar 2014 16:41:57	1314929	16324103	hadam3p_eu_n1j1_2013_1_008541632_0	46,176	79,938	1.7312
08 Mar 2014 23:58:08	1314929	16324103	hadam3p_eu_n1j1_2013_1_008541632_0	34,656	60,720	1.7521
04 Mar 2014 18:13:31	1314929	16324103	hadam3p_eu_n1j1_2013_1_008541632_0	23,136	41,638	1.7997
04 Mar 2014 00:42:47	1314929	16324103	hadam3p_eu_n1j1_2013_1_008541632_0	11,616	20,587	1.7723