Task 15230152

Name	hadam3p_eu_wfns_1999_1_006834848_1
Workunit	7038164
Created	3 Sep 2012, 20:50:12 UTC
Sent	18 Sep 2012, 8:04:21 UTC
Report deadline	31 Aug 2013, 13:24:21 UTC
Received	13 Dec 2012, 19:50:41 UTC
Server state	Over
Outcome	Computation error
Client state	Done
Exit status	-226 (0xFFFFFF1E) ERR_TOO_MANY_EXITS
Computer ID	903415
Run time	10 hours 38 min 58 sec
CPU time	10 hours 38 min 58 sec
Validate state	Invalid
Credit	200.38
Device peak FLOPS	2.35 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Europe v6.09 windows_intelx86
Stderr	<core_client_version>5.10.45</core_client_version> <![CDATA[ <message> too many normally harmless exit(s) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... 05:33:04 (2788): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:34:59 (3384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=120, selfPID=120, iMonCtr=2 05:36:07 (3252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:36:54 (2124): No heartbeat from core client for 30 sec - exiting 05:36:55 (2124): No heartbeat from core client for 30 sec - exiting 05:36:56 (2124): No heartbeat from core client for 30 sec - exiting 05:36:58 (2124): No heartbeat from core client for 30 sec - exiting 05:36:59 (2124): No heartbeat from core client for 30 sec - exiting 05:37:00 (2124): No heartbeat from core client for 30 sec - exiting 05:37:01 (2124): No heartbeat from core client for 30 sec - exiting 05:37:02 (2124): No heartbeat from core client for 30 sec - exiting 05:37:03 (2124): No heartbeat from core client for 30 sec - exiting 05:37:04 (2124): No heartbeat from core client for 30 sec - exiting 05:37:05 (2124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:37:59 (2532): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:38:47 (1848): No heartbeat from core client for 30 sec - exiting 05:38:48 (1848): No heartbeat from core client for 30 sec - exiting 05:38:49 (1848): No heartbeat from core client for 30 sec - exiting 05:38:50 (1848): No heartbeat from core client for 30 sec - exiting 05:38:51 (1848): No heartbeat from core client for 30 sec - exiting 05:38:52 (1848): No heartbeat from core client for 30 sec - exiting 05:38:53 (1848): No heartbeat from core client for 30 sec - exiting 05:38:54 (1848): No heartbeat from core client for 30 sec - exiting 05:38:56 (1848): No heartbeat from core client for 30 sec - exiting 05:38:57 (1848): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:38:58 (1848): No heartbeat from core client for 30 sec - exiting 05:40:36 (3496): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2864, selfPID=2864, iMonCtr=2 05:42:27 (3788): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:43:19 (2236): No heartbeat from core client for 30 sec - exiting 05:43:20 (2236): No heartbeat from core client for 30 sec - exiting 05:43:21 (2236): No heartbeat from core client for 30 sec - exiting 05:43:22 (2236): No heartbeat from core client for 30 sec - exiting 05:43:24 (2236): No heartbeat from core client for 30 sec - exiting 05:43:25 (2236): No heartbeat from core client for 30 sec - exiting 05:43:26 (2236): No heartbeat from core client for 30 sec - exiting 05:43:27 (2236): No heartbeat from core client for 30 sec - exiting 05:43:28 (2236): No heartbeat from core client for 30 sec - exiting 05:43:29 (2236): No heartbeat from core client for 30 sec - exiting 05:43:30 (2236): No heartbeat from core client for 30 sec - exiting 05:43:31 (2236): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:44:22 (3580): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:45:14 (3228): No heartbeat from core client for 30 sec - exiting 05:45:15 (3228): No heartbeat from core client for 30 sec - exiting 05:45:17 (3228): No heartbeat from core client for 30 sec - exiting 05:45:18 (3228): No heartbeat from core client for 30 sec - exiting 05:45:19 (3228): No heartbeat from core client for 30 sec - exiting 05:45:20 (3228): No heartbeat from core client for 30 sec - exiting 05:45:21 (3228): No heartbeat from core client for 30 sec - exiting 05:45:22 (3228): No heartbeat from core client for 30 sec - exiting 05:45:23 (3228): No heartbeat from core client for 30 sec - exiting 05:45:24 (3228): No heartbeat from core client for 30 sec - exiting 05:45:25 (3228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:46:17 (3512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:47:09 (3980): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:48:11 (2224): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:49:04 (3744): No heartbeat from core client for 30 sec - exiting 05:49:05 (3744): No heartbeat from core client for 30 sec - exiting 05:49:06 (3744): No heartbeat from core client for 30 sec - exiting 05:49:07 (3744): No heartbeat from core client for 30 sec - exiting 05:49:08 (3744): No heartbeat from core client for 30 sec - exiting 05:49:09 (3744): No heartbeat from core client for 30 sec - exiting 05:49:10 (3744): No heartbeat from core client for 30 sec - exiting 05:49:11 (3744): No heartbeat from core client for 30 sec - exiting 05:49:12 (3744): No heartbeat from core client for 30 sec - exiting 05:49:13 (3744): No heartbeat from core client for 30 sec - exiting 05:49:14 (3744): No heartbeat from core client for 30 sec - exiting 05:49:16 (3744): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:50:06 (3552): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:50:59 (2016): No heartbeat from core client for 30 sec - exiting 05:51:00 (2016): No heartbeat from core client for 30 sec - exiting 05:51:01 (2016): No heartbeat from core client for 30 sec - exiting 05:51:02 (2016): No heartbeat from core client for 30 sec - exiting 05:51:03 (2016): No heartbeat from core client for 30 sec - exiting 05:51:04 (2016): No heartbeat from core client for 30 sec - exiting 05:51:05 (2016): No heartbeat from core client for 30 sec - exiting 05:51:06 (2016): No heartbeat from core client for 30 sec - exiting 05:51:07 (2016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:52:01 (1496): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:52:53 (2376): No heartbeat from core client for 30 sec - exiting 05:52:54 (2376): No heartbeat from core client for 30 sec - exiting 05:52:55 (2376): No heartbeat from core client for 30 sec - exiting 05:52:56 (2376): No heartbeat from core client for 30 sec - exiting 05:52:58 (2376): No heartbeat from core client for 30 sec - exiting 05:52:59 (2376): No heartbeat from core client for 30 sec - exiting 05:53:00 (2376): No heartbeat from core client for 30 sec - exiting 05:53:01 (2376): No heartbeat from core client for 30 sec - exiting 05:53:02 (2376): No heartbeat from core client for 30 sec - exiting 05:53:03 (2376): No heartbeat from core client for 30 sec - exiting 05:53:04 (2376): No heartbeat from core client for 30 sec - exiting 05:53:05 (2376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:53:55 (1992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:54:49 (3572): No heartbeat from core client for 30 sec - exiting 05:54:50 (3572): No heartbeat from core client for 30 sec - exiting 05:54:51 (3572): No heartbeat from core client for 30 sec - exiting 05:54:52 (3572): No heartbeat from core client for 30 sec - exiting 05:54:53 (3572): No heartbeat from core client for 30 sec - exiting 05:54:54 (3572): No heartbeat from core client for 30 sec - exiting 05:54:55 (3572): No heartbeat from core client for 30 sec - exiting 05:54:57 (3572): No heartbeat from core client for 30 sec - exiting 05:54:58 (3572): No heartbeat from core client for 30 sec - exiting 05:54:59 (3572): No heartbeat from core client for 30 sec - exiting 05:55:00 (3572): No heartbeat from core client for 30 sec - exiting 05:55:01 (3572): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:55:52 (2960): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:56:44 (2132): No heartbeat from core client for 30 sec - exiting 05:56:45 (2132): No heartbeat from core client for 30 sec - exiting 05:56:46 (2132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:57:45 (3856): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:58:39 (2108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:58:40 (2108): No heartbeat from core client for 30 sec - exiting 05:59:41 (200): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:00:34 (1604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:01:36 (2932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:02:26 (3884): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:03:29 (2672): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:04:20 (960): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:05:22 (1500): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:06:15 (2640): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3144, selfPID=3144, iMonCtr=2 06:07:17 (3192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:08:08 (1616): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:09:11 (320): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:10:03 (180): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:11:04 (3164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:11:56 (2172): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:12:59 (552): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:13:49 (4024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:14:52 (2712): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:15:43 (2552): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:16:46 (3188): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:17:38 (2588): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:18:40 (2280): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:19:31 (3764): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=520, selfPID=520, iMonCtr=2 06:20:34 (3328): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:21:24 (3280): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:22:27 (804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:23:19 (3468): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:24:22 (1388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:25:13 (2140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:26:16 (364): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:27:06 (436): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:28:09 (1404): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:29:02 (924): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:30:04 (2404): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:30:55 (3776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:31:57 (3708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:32:49 (3684): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:33:51 (128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3324, selfPID=3324, iMonCtr=2 06:34:44 (2228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2836, selfPID=2836, iMonCtr=2 06:35:46 (1736): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:36:38 (3704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:37:40 (3192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:38:32 (3676): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:39:34 (2520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:40:27 (3808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3664, selfPID=3664, iMonCtr=2 06:41:29 (3000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:42:21 (2532): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:43:24 (580): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2500, selfPID=2500, iMonCtr=2 06:44:14 (1408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:45:16 (3856): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:46:09 (1504): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4048, selfPID=4048, iMonCtr=2 06:47:11 (2720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3128, selfPID=3128, iMonCtr=2 06:48:03 (3776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2552, selfPID=2552, iMonCtr=2 06:49:06 (3932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:49:57 (2708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:50:59 (3604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:51:52 (1160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:52:55 (4068): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:53:46 (1308): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3268, selfPID=3268, iMonCtr=2 06:54:49 (3524): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:55:39 (3720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2432, selfPID=2432, iMonCtr=2 06:56:42 (3888): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3624, selfPID=3624, iMonCtr=2 06:57:34 (1656): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2880, selfPID=2880, iMonCtr=2 06:58:37 (3808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:59:28 (1676): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... N07:00:31 (3500): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:01:21 (3544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:02:24 (2712): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:03:17 (3320): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:04:19 (1796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:05:11 (1628): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:06:13 (4036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:07:03 (2888): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=916, selfPID=916, iMonCtr=2 07:08:06 (200): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1080, selfPID=1080, iMonCtr=2 07:08:59 (1824): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1940, selfPID=1940, iMonCtr=2 07:10:01 (1052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:10:52 (1540): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1040, selfPID=1040, iMonCtr=2 </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
13 Dec 2012 19:54:18	903415	15230152	hadam3p_eu_wfns_1999_1_006834848_1	11,616	38,332	3.2999