Task 13551977

Name	hadcm3n_yc35_1900_40_007523141_1
Workunit	7720616
Created	28 Oct 2011, 13:21:20 UTC
Sent	31 Oct 2011, 18:01:53 UTC
Report deadline	31 Jan 2012, 1:29:04 UTC
Received	19 Nov 2011, 23:52:38 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1100678
Run time	5 days 0 hours 9 min 37 sec
CPU time	4 days 16 hours 25 min 37 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	3.24 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... 15:27:31 (2936): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:27:32 (2936): No heartbeat from core client for 30 sec - exiting 15:27:33 (2936): No heartbeat from core client for 30 sec - exiting 15:27:34 (2936): No heartbeat from core client for 30 sec - exiting 15:27:35 (2936): No heartbeat from core client for 30 sec - exiting 15:27:36 (2936): No heartbeat from core client for 30 sec - exiting 15:27:37 (2936): No heartbeat from core client for 30 sec - exiting 15:27:38 (2936): No heartbeat from core client for 30 sec - exiting 15:27:39 (2936): No heartbeat from core client for 30 sec - exiting 15:27:40 (2936): No heartbeat from core client for 30 sec - exiting 15:27:41 (2936): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4100, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4100, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4100, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4100, iMonCtr=1 Model crash detected, will try to restart... 08:08:24 (4100): No heartbeat from core client for 30 sec - exiting 08:08:25 (4100): No heartbeat from core client for 30 sec - exiting 08:08:26 (4100): No heartbeat from core client for 30 sec - exiting 08:08:27 (4100): No heartbeat from core client for 30 sec - exiting 08:08:29 (4100): No heartbeat from core client for 30 sec - exiting 08:08:30 (4100): No heartbeat from core client for 30 sec - exiting 08:08:31 (4100): No heartbeat from core client for 30 sec - exiting 08:08:32 (4100): No heartbeat from core client for 30 sec - exiting 08:08:33 (4100): No heartbeat from core client for 30 sec - exiting 08:08:34 (4100): No heartbeat from core client for 30 sec - exiting 08:08:35 (4100): No heartbeat from core client for 30 sec - exiting 08:08:36 (4100): No heartbeat from core client for 30 sec - exiting 08:08:37 (4100): No heartbeat from core client for 30 sec - exiting 08:08:38 (4100): No heartbeat from core client for 30 sec - exiting 08:08:39 (4100): No heartbeat from core client for 30 sec - exiting 08:08:40 (4100): No heartbeat from core client for 30 sec - exiting 08:08:41 (4100): No heartbeat from core client for 30 sec - exiting 08:08:42 (4100): No heartbeat from core client for 30 sec - exiting 08:08:43 (4100): No heartbeat from core client for 30 sec - exiting 08:08:44 (4100): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4528, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4528, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
19 Nov 2011 23:55:47	1100678	13551977	hadcm3n_yc35_1900_40_007523141_1	259,200	404,734	1.5615
18 Nov 2011 10:44:41	1100678	13551977	hadcm3n_yc35_1900_40_007523141_1	233,280	366,246	1.5700
16 Nov 2011 09:00:05	1100678	13551977	hadcm3n_yc35_1900_40_007523141_1	207,360	330,877	1.5957
16 Nov 2011 07:59:34	1100678	13551977	hadcm3n_yc35_1900_40_007523141_1	181,440	293,138	1.6156
16 Nov 2011 07:59:34	1100678	13551977	hadcm3n_yc35_1900_40_007523141_1	155,520	254,567	1.6369
16 Nov 2011 07:59:34	1100678	13551977	hadcm3n_yc35_1900_40_007523141_1	129,600	216,452	1.6702
10 Nov 2011 07:40:06	1100678	13551977	hadcm3n_yc35_1900_40_007523141_1	103,680	178,637	1.7230
08 Nov 2011 15:33:00	1100678	13551977	hadcm3n_yc35_1900_40_007523141_1	77,760	141,156	1.8153
07 Nov 2011 18:06:14	1100678	13551977	hadcm3n_yc35_1900_40_007523141_1	51,840	102,609	1.9793
06 Nov 2011 11:16:39	1100678	13551977	hadcm3n_yc35_1900_40_007523141_1	25,920	65,064	2.5102