Task 16288453

Name	hadcm3n_83zw_1980_40_008463119_3
Workunit	8613975
Created	8 Feb 2014, 1:16:21 UTC
Sent	8 Feb 2014, 1:16:40 UTC
Report deadline	10 May 2014, 8:43:51 UTC
Received	21 Mar 2014, 19:24:52 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1179495
Run time	26 days 14 hours 13 min 58 sec
CPU time	20 days 14 hours 32 min 46 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	1.37 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.2.42</core_client_version> <![CDATA[ <message> (unknown error) - exit code 193 (0xc1) </message> <stderr_txt> 10:13:10 (6184): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:17:15 (6652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4144, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3804, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4132, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4132, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4132, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4132, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1184, iMonCtr=1 Model crash detected, will try to restart... CController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4056, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4056, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2320, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=512, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3744, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3744, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3744, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4408, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2340, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2340, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3616, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3616, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3616, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4072, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4072, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4072, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1928, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3692, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3692, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 07:30:17 (7124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
21 Mar 2014 19:22:31	1179495	16288453	hadcm3n_83zw_1980_40_008463119_3	518,400	1,780,362	3.4343
18 Mar 2014 22:10:12	1179495	16288453	hadcm3n_83zw_1980_40_008463119_3	492,480	1,683,607	3.4186
16 Mar 2014 07:11:49	1179495	16288453	hadcm3n_83zw_1980_40_008463119_3	466,560	1,586,077	3.3995
14 Mar 2014 19:37:51	1179495	16288453	hadcm3n_83zw_1980_40_008463119_3	440,640	1,486,572	3.3737
11 Mar 2014 20:44:16	1179495	16288453	hadcm3n_83zw_1980_40_008463119_3	414,720	1,393,423	3.3599
09 Mar 2014 14:43:59	1179495	16288453	hadcm3n_83zw_1980_40_008463119_3	388,800	1,296,997	3.3359
07 Mar 2014 06:22:31	1179495	16288453	hadcm3n_83zw_1980_40_008463119_3	362,880	1,200,640	3.3086
04 Mar 2014 22:55:25	1179495	16288453	hadcm3n_83zw_1980_40_008463119_3	336,960	1,104,424	3.2776
02 Mar 2014 13:43:31	1179495	16288453	hadcm3n_83zw_1980_40_008463119_3	311,040	1,003,725	3.2270
28 Feb 2014 19:37:14	1179495	16288453	hadcm3n_83zw_1980_40_008463119_3	285,120	903,577	3.1691
26 Feb 2014 06:23:55	1179495	16288453	hadcm3n_83zw_1980_40_008463119_3	259,200	810,090	3.1253
24 Feb 2014 05:33:35	1179495	16288453	hadcm3n_83zw_1980_40_008463119_3	233,280	726,774	3.1155
22 Feb 2014 15:21:19	1179495	16288453	hadcm3n_83zw_1980_40_008463119_3	207,360	639,870	3.0858
20 Feb 2014 22:21:04	1179495	16288453	hadcm3n_83zw_1980_40_008463119_3	181,440	554,366	3.0554
18 Feb 2014 19:15:35	1179495	16288453	hadcm3n_83zw_1980_40_008463119_3	155,520	469,175	3.0168
16 Feb 2014 15:09:49	1179495	16288453	hadcm3n_83zw_1980_40_008463119_3	129,600	387,883	2.9929
15 Feb 2014 05:06:15	1179495	16288453	hadcm3n_83zw_1980_40_008463119_3	103,680	317,511	3.0624
13 Feb 2014 04:56:53	1179495	16288453	hadcm3n_83zw_1980_40_008463119_3	77,760	239,178	3.0758
11 Feb 2014 00:54:32	1179495	16288453	hadcm3n_83zw_1980_40_008463119_3	51,840	156,976	3.0281
09 Feb 2014 04:44:51	1179495	16288453	hadcm3n_83zw_1980_40_008463119_3	25,920	80,230	3.0953