Task 17356502

Name	hadcm3n_xc2c_1940_40_009151930_0
Workunit	9282266
Created	6 Nov 2014, 15:25:27 UTC
Sent	6 Nov 2014, 15:27:38 UTC
Report deadline	5 Feb 2015, 22:54:49 UTC
Received	25 Jan 2015, 11:34:47 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	837459
Run time	35 days 10 hours 26 min 50 sec
CPU time	28 days 4 hours 16 min 20 sec
Validate state	Valid
Credit	12,441.60
Device peak FLOPS	2.61 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.2.42</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:25:21 (12120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4924, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4924, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4924, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4924, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4924, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4924, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:29:22 (8668): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:31:15 (7652): No heartbeat from core client for 30 sec - exiting 22:31:16 (7652): No heartbeat from core client for 30 sec - exiting 22:31:17 (7652): No heartbeat from core client for 30 sec - exiting 22:31:18 (7652): No heartbeat from core client for 30 sec - exiting 22:31:19 (7652): No heartbeat from core client for 30 sec - exiting 22:31:20 (7652): No heartbeat from core client for 30 sec - exiting 22:31:22 (7652): No heartbeat from core client for 30 sec - exiting 22:31:23 (7652): No heartbeat from core client for 30 sec - exiting 22:31:24 (7652): No heartbeat from core client for 30 sec - exiting 22:31:25 (7652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:07:22 (12628): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:07:23 (12628): No heartbeat from core client for 30 sec - exiting 08:07:24 (12628): No heartbeat from core client for 30 sec - exiting 08:07:25 (12628): No heartbeat from core client for 30 sec - exiting 08:07:26 (12628): No heartbeat from core client for 30 sec - exiting 08:07:27 (12628): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 04:44:28 (6292): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:25:30 (16220): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:25:32 (16220): No heartbeat from core client for 30 sec - exiting 09:25:33 (16220): No heartbeat from core client for 30 sec - exiting 09:25:34 (16220): No heartbeat from core client for 30 sec - exiting 09:25:35 (16220): No heartbeat from core client for 30 sec - exiting 09:25:36 (16220): No heartbeat from core client for 30 sec - exiting 09:25:37 (16220): No heartbeat from core client for 30 sec - exiting 09:25:38 (16220): No heartbeat from core client for 30 sec - exiting 09:25:39 (16220): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 07:43:39 (4876): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:43:41 (4876): No heartbeat from core client for 30 sec - exiting 07:43:42 (4876): No heartbeat from core client for 30 sec - exiting 07:43:43 (4876): No heartbeat from core client for 30 sec - exiting 07:43:44 (4876): No heartbeat from core client for 30 sec - exiting 07:43:45 (4876): No heartbeat from core client for 30 sec - exiting 07:43:46 (4876): No heartbeat from core client for 30 sec - exiting 07:43:47 (4876): No heartbeat from core client for 30 sec - exiting 07:43:48 (4876): No heartbeat from core client for 30 sec - exiting 07:43:49 (4876): No heartbeat from core client for 30 sec - exiting 07:43:50 (4876): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:02:42 (17964): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:42:05 (8744): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:06:42 (13316): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:45:15 (26448): No heartbeat from core client for 30 sec - exiting 05:45:16 (26448): No heartbeat from core client for 30 sec - exiting 05:45:17 (26448): No heartbeat from core client for 30 sec - exiting 05:45:18 (26448): No heartbeat from core client for 30 sec - exiting 05:45:19 (26448): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:25:22 (2476): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:44:11 (7808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:44:13 (7808): No heartbeat from core client for 30 sec - exiting 18:44:14 (7808): No heartbeat from core client for 30 sec - exiting 18:44:15 (7808): No heartbeat from core client for 30 sec - exiting 18:44:16 (7808): No heartbeat from core client for 30 sec - exiting 18:44:17 (7808): No heartbeat from core client for 30 sec - exiting 18:44:18 (7808): No heartbeat from core client for 30 sec - exiting 18:44:19 (7808): No heartbeat from core client for 30 sec - exiting 18:44:20 (7808): No heartbeat from core client for 30 sec - exiting 18:44:21 (7808): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 16:28:44 (1416): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:28:46 (1416): No heartbeat from core client for 30 sec - exiting 16:28:47 (1416): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:48:19 (8864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:48:20 (8864): No heartbeat from core client for 30 sec - exiting 03:48:21 (8864): No heartbeat from core client for 30 sec - exiting 03:48:22 (8864): No heartbeat from core client for 30 sec - exiting 13:16:43 (22040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:16:45 (22040): No heartbeat from core client for 30 sec - exiting 13:16:46 (22040): No heartbeat from core client for 30 sec - exiting 13:16:47 (22040): No heartbeat from core client for 30 sec - exiting 13:16:48 (22040): No heartbeat from core client for 30 sec - exiting 13:16:49 (22040): No heartbeat from core client for 30 sec - exiting 13:16:50 (22040): No heartbeat from core client for 30 sec - exiting 13:16:51 (22040): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:17:48 (24632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:17:50 (24632): No heartbeat from core client for 30 sec - exiting 10:17:51 (24632): No heartbeat from core client for 30 sec - exiting 10:17:52 (24632): No heartbeat from core client for 30 sec - exiting 16:01:46 (26152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:19:26 (27856): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:38:14 (32980): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 01:33:24 (34632): No heartbeat from core client for 30 sec - exiting 01:33:25 (34632): No heartbeat from core client for 30 sec - exiting 01:33:26 (34632): No heartbeat from core client for 30 sec - exiting 01:33:27 (34632): No heartbeat from core client for 30 sec - exiting 01:33:28 (34632): No heartbeat from core client for 30 sec - exiting 01:33:29 (34632): No heartbeat from core client for 30 sec - exiting 01:33:30 (34632): No heartbeat from core client for 30 sec - exiting 01:33:31 (34632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:36:56 (51932): No heartbeat from core client for 30 sec - exiting 01:36:57 (51932): No heartbeat from core client for 30 sec - exiting 01:36:58 (51932): No heartbeat from core client for 30 sec - exiting 01:36:59 (51932): No heartbeat from core client for 30 sec - exiting 01:37:00 (51932): No heartbeat from core client for 30 sec - exiting 01:37:01 (51932): No heartbeat from core client for 30 sec - exiting 01:37:02 (51932): No heartbeat from core client for 30 sec - exiting 01:37:03 (51932): No heartbeat from core client for 30 sec - exiting 01:37:04 (51932): No heartbeat from core client for 30 sec - exiting 01:37:05 (51932): No heartbeat from core client for 30 sec - exiting 01:37:06 (51932): No heartbeat from core client for 30 sec - exiting 01:37:07 (51932): No heartbeat from core client for 30 sec - exiting 01:37:08 (51932): No heartbeat from core client for 30 sec - exiting 01:37:09 (51932): No heartbeat from core client for 30 sec - exiting 01:37:10 (51932): No heartbeat from core client for 30 sec - exiting 01:37:11 (51932): No heartbeat from core client for 30 sec - exiting 01:37:12 (51932): No heartbeat from core client for 30 sec - exiting 01:37:13 (51932): No heartbeat from core client for 30 sec - exiting 01:37:14 (51932): No heartbeat from core client for 30 sec - exiting 01:37:15 (51932): No heartbeat from core client for 30 sec - exiting 01:37:16 (51932): No heartbeat from core client for 30 sec - exiting 01:37:17 (51932): No heartbeat from core client for 30 sec - exiting 01:37:18 (51932): No heartbeat from core client for 30 sec - exiting 01:37:19 (51932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:53:50 (3172): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:53:52 (3172): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 09:52:49 (2868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8232, iMonCtr=1 Model crash detected, will try to restart... 10:46:33 (3732): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8312, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:48:03 (8312): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
25 Jan 2015 10:20:40	837459	17356502	hadcm3n_xc2c_1940_40_009151930_0	1,036,800	2,433,764	2.3474
20 Jan 2015 12:07:13	837459	17356502	hadcm3n_xc2c_1940_40_009151930_0	1,010,880	2,379,267	2.3537
16 Jan 2015 10:57:57	837459	17356502	hadcm3n_xc2c_1940_40_009151930_0	984,960	2,319,862	2.3553
13 Jan 2015 12:31:12	837459	17356502	hadcm3n_xc2c_1940_40_009151930_0	959,040	2,279,574	2.3769
09 Jan 2015 04:57:36	837459	17356502	hadcm3n_xc2c_1940_40_009151930_0	933,120	2,226,651	2.3862
08 Jan 2015 17:59:31	837459	17356502	hadcm3n_xc2c_1940_40_009151930_0	907,200	2,174,670	2.3971
01 Jan 2015 14:28:30	837459	17356502	hadcm3n_xc2c_1940_40_009151930_0	881,280	2,121,102	2.4068
31 Dec 2014 15:27:46	837459	17356502	hadcm3n_xc2c_1940_40_009151930_0	855,360	2,064,963	2.4141
30 Dec 2014 09:24:11	837459	17356502	hadcm3n_xc2c_1940_40_009151930_0	829,440	2,003,008	2.4149
28 Dec 2014 15:51:21	837459	17356502	hadcm3n_xc2c_1940_40_009151930_0	803,520	1,942,667	2.4177
26 Dec 2014 16:24:29	837459	17356502	hadcm3n_xc2c_1940_40_009151930_0	777,600	1,880,972	2.4189
24 Dec 2014 15:37:55	837459	17356502	hadcm3n_xc2c_1940_40_009151930_0	751,680	1,821,118	2.4227
23 Dec 2014 06:53:17	837459	17356502	hadcm3n_xc2c_1940_40_009151930_0	725,760	1,760,157	2.4253
22 Dec 2014 11:42:25	837459	17356502	hadcm3n_xc2c_1940_40_009151930_0	699,840	1,699,577	2.4285
21 Dec 2014 19:13:07	837459	17356502	hadcm3n_xc2c_1940_40_009151930_0	673,920	1,646,225	2.4428
19 Dec 2014 13:46:37	837459	17356502	hadcm3n_xc2c_1940_40_009151930_0	648,000	1,594,085	2.4600
18 Dec 2014 13:25:30	837459	17356502	hadcm3n_xc2c_1940_40_009151930_0	622,080	1,539,075	2.4741
17 Dec 2014 19:23:39	837459	17356502	hadcm3n_xc2c_1940_40_009151930_0	596,160	1,486,062	2.4927
17 Dec 2014 00:08:23	837459	17356502	hadcm3n_xc2c_1940_40_009151930_0	570,240	1,427,108	2.5026
16 Dec 2014 05:48:05	837459	17356502	hadcm3n_xc2c_1940_40_009151930_0	544,320	1,369,432	2.5159