Task 19041038

Name	hadcm3n_sbhz_1980_40_010021828_3
Workunit	10019898
Created	28 Oct 2015, 9:15:57 UTC
Sent	28 Oct 2015, 9:16:03 UTC
Report deadline	27 Jan 2016, 16:43:14 UTC
Received	29 Nov 2015, 6:21:19 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1290798
Run time	27 days 14 hours 53 min 36 sec
CPU time	25 days 1 hours 27 min 40 sec
Validate state	Valid
Credit	12,441.60
Device peak FLOPS	2.87 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.6.9</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:56:17 (71668): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:02:36 (78036): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 20:02:37 (78036): No heartbeat from core client for 30 sec - exiting 20:02:38 (78036): No heartbeat from core client for 30 sec - exiting 20:02:39 (78036): No heartbeat from core client for 30 sec - exiting 20:02:40 (78036): No heartbeat from core client for 30 sec - exiting 20:02:41 (78036): No heartbeat from core client for 30 sec - exiting 20:02:42 (78036): No heartbeat from core client for 30 sec - exiting 20:02:43 (78036): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:05:24 (80704): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 03:05:25 (80704): No heartbeat from core client for 30 sec - exiting 03:05:26 (80704): No heartbeat from core client for 30 sec - exiting 03:05:27 (80704): No heartbeat from core client for 30 sec - exiting 03:05:28 (80704): No heartbeat from core client for 30 sec - exiting 03:05:29 (80704): No heartbeat from core client for 30 sec - exiting 03:05:30 (80704): No heartbeat from core client for 30 sec - exiting 03:05:31 (80704): No heartbeat from core client for 30 sec - exiting 03:05:32 (80704): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:01:12 (80192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:01:13 (80192): No heartbeat from core client for 30 sec - exiting 12:01:14 (80192): No heartbeat from core client for 30 sec - exiting 12:01:16 (80192): No heartbeat from core client for 30 sec - exiting 12:01:17 (80192): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 16:05:47 (92560): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 16:05:48 (92560): No heartbeat from core client for 30 sec - exiting 16:05:49 (92560): No heartbeat from core client for 30 sec - exiting 16:05:50 (92560): No heartbeat from core client for 30 sec - exiting 16:05:51 (92560): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 05:30:39 (6944): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:30:40 (6944): No heartbeat from core client for 30 sec - exiting 05:30:41 (6944): No heartbeat from core client for 30 sec - exiting 05:30:42 (6944): No heartbeat from core client for 30 sec - exiting 05:30:43 (6944): No heartbeat from core client for 30 sec - exiting 05:30:44 (6944): No heartbeat from core client for 30 sec - exiting 05:33:44 (5420): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:37:12 (8564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:37:13 (8564): No heartbeat from core client for 30 sec - exiting 05:37:14 (8564): No heartbeat from core client for 30 sec - exiting 05:37:15 (8564): No heartbeat from core client for 30 sec - exiting 05:37:16 (8564): No heartbeat from core client for 30 sec - exiting 00:54:13 (10188): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:54:14 (10188): No heartbeat from core client for 30 sec - exiting 00:54:15 (10188): No heartbeat from core client for 30 sec - exiting 00:54:16 (10188): No heartbeat from core client for 30 sec - exiting 00:54:17 (10188): No heartbeat from core client for 30 sec - exiting 00:54:18 (10188): No heartbeat from core client for 30 sec - exiting 00:54:19 (10188): No heartbeat from core client for 30 sec - exiting 01:39:55 (5988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:43:57 (14312): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:55:33 (15880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:55:35 (15880): No heartbeat from core client for 30 sec - exiting 13:55:36 (15880): No heartbeat from core client for 30 sec - exiting 14:04:44 (22228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:04:45 (22228): No heartbeat from core client for 30 sec - exiting 14:04:46 (22228): No heartbeat from core client for 30 sec - exiting 14:04:47 (22228): No heartbeat from core client for 30 sec - exiting 14:04:48 (22228): No heartbeat from core client for 30 sec - exiting 14:04:49 (22228): No heartbeat from core client for 30 sec - exiting 14:04:50 (22228): No heartbeat from core client for 30 sec - exiting 14:04:52 (22228): No heartbeat from core client for 30 sec - exiting 19:59:06 (20708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:40:59 (19264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:35:48 (23956): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:35:49 (23956): No heartbeat from core client for 30 sec - exiting 01:35:50 (23956): No heartbeat from core client for 30 sec - exiting 01:35:51 (23956): No heartbeat from core client for 30 sec - exiting 01:35:52 (23956): No heartbeat from core client for 30 sec - exiting 01:35:53 (23956): No heartbeat from core client for 30 sec - exiting 01:35:54 (23956): No heartbeat from core client for 30 sec - exiting 01:35:55 (23956): No heartbeat from core client for 30 sec - exiting 01:35:56 (23956): No heartbeat from core client for 30 sec - exiting 01:38:57 (28796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:38:58 (28796): No heartbeat from core client for 30 sec - exiting 01:38:59 (28796): No heartbeat from core client for 30 sec - exiting 01:39:01 (28796): No heartbeat from core client for 30 sec - exiting 01:39:02 (28796): No heartbeat from core client for 30 sec - exiting 01:39:03 (28796): No heartbeat from core client for 30 sec - exiting 01:39:04 (28796): No heartbeat from core client for 30 sec - exiting 09:25:56 (17680): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:26:08 (30576): Can't acquire lockfile (32) - waiting 35s 09:29:05 (30576): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:29:06 (30576): No heartbeat from core client for 30 sec - exiting 09:29:07 (30576): No heartbeat from core client for 30 sec - exiting 09:29:09 (30576): No heartbeat from core client for 30 sec - exiting 09:29:10 (30576): No heartbeat from core client for 30 sec - exiting 09:29:11 (30576): No heartbeat from core client for 30 sec - exiting 09:29:12 (30576): No heartbeat from core client for 30 sec - exiting 03:19:29 (31968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:19:37 (36252): Can't acquire lockfile (32) - waiting 35s 04:29:35 (36252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:29:36 (36252): No heartbeat from core client for 30 sec - exiting 04:29:37 (36252): No heartbeat from core client for 30 sec - exiting 04:29:38 (36252): No heartbeat from core client for 30 sec - exiting 04:29:39 (36252): No heartbeat from core client for 30 sec - exiting 04:29:40 (36252): No heartbeat from core client for 30 sec - exiting forrtl: Access is denied. Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=37552, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 17:53:46 (6924): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:08:57 (968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:08:58 (968): No heartbeat from core client for 30 sec - exiting 17:08:59 (968): No heartbeat from core client for 30 sec - exiting 17:09:00 (968): No heartbeat from core client for 30 sec - exiting 17:09:01 (968): No heartbeat from core client for 30 sec - exiting 17:09:02 (968): No heartbeat from core client for 30 sec - exiting 17:09:03 (968): No heartbeat from core client for 30 sec - exiting 18:56:20 (16320): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 01:45:25 (6512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:49:52 (4260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:49:53 (4260): No heartbeat from core client for 30 sec - exiting 23:49:54 (4260): No heartbeat from core client for 30 sec - exiting 23:49:55 (4260): No heartbeat from core client for 30 sec - exiting 01:02:25 (13604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:11:37 (3512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:11:38 (3512): No heartbeat from core client for 30 sec - exiting 01:11:39 (3512): No heartbeat from core client for 30 sec - exiting 01:11:40 (3512): No heartbeat from core client for 30 sec - exiting 01:11:41 (3512): No heartbeat from core client for 30 sec - exiting 01:11:42 (3512): No heartbeat from core client for 30 sec - exiting 19:12:47 (11536): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:12:48 (11536): No heartbeat from core client for 30 sec - exiting 19:12:49 (11536): No heartbeat from core client for 30 sec - exiting 19:12:50 (11536): No heartbeat from core client for 30 sec - exiting 19:12:51 (11536): No heartbeat from core client for 30 sec - exiting 19:12:52 (11536): No heartbeat from core client for 30 sec - exiting 19:12:53 (11536): No heartbeat from core client for 30 sec - exiting 19:12:54 (11536): No heartbeat from core client for 30 sec - exiting forrtl: Access is denied. Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=16536, iMonCtr=1 Model crash detected, will try to restart... 19:49:04 (16536): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 05:59:50 (6692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:06:09 (17040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:06:10 (17040): No heartbeat from core client for 30 sec - exiting 06:06:12 (17040): No heartbeat from core client for 30 sec - exiting 06:06:13 (17040): No heartbeat from core client for 30 sec - exiting 06:06:14 (17040): No heartbeat from core client for 30 sec - exiting 06:06:15 (17040): No heartbeat from core client for 30 sec - exiting 06:06:16 (17040): No heartbeat from core client for 30 sec - exiting 21:51:19 (12484): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:51:20 (12484): No heartbeat from core client for 30 sec - exiting 21:51:22 (12484): No heartbeat from core client for 30 sec - exiting 21:51:23 (12484): No heartbeat from core client for 30 sec - exiting 21:51:24 (12484): No heartbeat from core client for 30 sec - exiting 21:51:25 (12484): No heartbeat from core client for 30 sec - exiting 22:00:29 (16180): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:00:30 (16180): No heartbeat from core client for 30 sec - exiting 22:00:31 (16180): No heartbeat from core client for 30 sec - exiting 22:00:32 (16180): No heartbeat from core client for 30 sec - exiting 22:00:33 (16180): No heartbeat from core client for 30 sec - exiting 22:00:34 (16180): No heartbeat from core client for 30 sec - exiting 22:00:35 (16180): No heartbeat from core client for 30 sec - exiting 22:00:37 (16180): No heartbeat from core client for 30 sec - exiting 01:49:45 (26256): No heartbeat from core client for 30 sec - exiting 01:49:46 (26256): No heartbeat from core client for 30 sec - exiting 01:49:47 (26256): No heartbeat from core client for 30 sec - exiting 01:49:48 (26256): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:05:57 (36232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:36:41 (41520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:51:29 (40836): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:54:34 (42936): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:57:36 (43284): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:57:37 (43284): No heartbeat from core client for 30 sec - exiting 10:57:39 (43284): No heartbeat from core client for 30 sec - exiting 10:57:40 (43284): No heartbeat from core client for 30 sec - exiting 10:57:41 (43284): No heartbeat from core client for 30 sec - exiting 10:57:42 (43284): No heartbeat from core client for 30 sec - exiting 10:57:43 (43284): No heartbeat from core client for 30 sec - exiting 10:57:44 (43284): No heartbeat from core client for 30 sec - exiting 11:00:39 (38944): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:11:46 (43972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:38:29 (43560): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:44:53 (48712): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:44:54 (48712): No heartbeat from core client for 30 sec - exiting 01:44:55 (48712): No heartbeat from core client for 30 sec - exiting 01:44:56 (48712): No heartbeat from core client for 30 sec - exiting 01:44:57 (48712): No heartbeat from core client for 30 sec - exiting 01:44:58 (48712): No heartbeat from core client for 30 sec - exiting 01:44:59 (48712): No heartbeat from core client for 30 sec - exiting 01:45:00 (48712): No heartbeat from core client for 30 sec - exiting 01:47:55 (48336): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:51:32 (39736): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:24:30 (54524): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:34:42 (71640): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:34:43 (71640): No heartbeat from core client for 30 sec - exiting 06:34:44 (71640): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 08:50:52 (7124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:50:53 (7124): No heartbeat from core client for 30 sec - exiting 08:50:54 (7124): No heartbeat from core client for 30 sec - exiting 08:50:56 (7124): No heartbeat from core client for 30 sec - exiting 08:50:57 (7124): No heartbeat from core client for 30 sec - exiting Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
29 Nov 2015 05:12:11	1290798	19041038	hadcm3n_sbhz_1980_40_010021828_3	1,036,800	2,164,482	2.0877
28 Nov 2015 11:50:32	1290798	19041038	hadcm3n_sbhz_1980_40_010021828_3	1,010,880	2,111,201	2.0885
27 Nov 2015 15:10:58	1290798	19041038	hadcm3n_sbhz_1980_40_010021828_3	984,960	2,056,186	2.0876
27 Nov 2015 00:37:27	1290798	19041038	hadcm3n_sbhz_1980_40_010021828_3	959,040	2,000,954	2.0864
26 Nov 2015 05:10:29	1290798	19041038	hadcm3n_sbhz_1980_40_010021828_3	933,120	1,945,921	2.0854
25 Nov 2015 12:57:01	1290798	19041038	hadcm3n_sbhz_1980_40_010021828_3	907,200	1,891,539	2.0850
24 Nov 2015 20:29:20	1290798	19041038	hadcm3n_sbhz_1980_40_010021828_3	881,280	1,836,206	2.0836
24 Nov 2015 04:35:46	1290798	19041038	hadcm3n_sbhz_1980_40_010021828_3	855,360	1,780,494	2.0816
23 Nov 2015 12:21:33	1290798	19041038	hadcm3n_sbhz_1980_40_010021828_3	829,440	1,725,504	2.0803
22 Nov 2015 18:14:11	1290798	19041038	hadcm3n_sbhz_1980_40_010021828_3	803,520	1,670,021	2.0784
22 Nov 2015 01:23:49	1290798	19041038	hadcm3n_sbhz_1980_40_010021828_3	777,600	1,615,802	2.0779
21 Nov 2015 09:24:39	1290798	19041038	hadcm3n_sbhz_1980_40_010021828_3	751,680	1,561,992	2.0780
20 Nov 2015 17:36:35	1290798	19041038	hadcm3n_sbhz_1980_40_010021828_3	725,760	1,508,939	2.0791
20 Nov 2015 02:05:58	1290798	19041038	hadcm3n_sbhz_1980_40_010021828_3	699,840	1,455,823	2.0802
19 Nov 2015 10:30:59	1290798	19041038	hadcm3n_sbhz_1980_40_010021828_3	673,920	1,402,769	2.0815
18 Nov 2015 18:53:33	1290798	19041038	hadcm3n_sbhz_1980_40_010021828_3	648,000	1,350,418	2.0840
18 Nov 2015 03:20:44	1290798	19041038	hadcm3n_sbhz_1980_40_010021828_3	622,080	1,295,870	2.0831
17 Nov 2015 11:20:46	1290798	19041038	hadcm3n_sbhz_1980_40_010021828_3	596,160	1,242,618	2.0844
16 Nov 2015 19:34:56	1290798	19041038	hadcm3n_sbhz_1980_40_010021828_3	570,240	1,189,147	2.0853
16 Nov 2015 03:55:35	1290798	19041038	hadcm3n_sbhz_1980_40_010021828_3	544,320	1,135,235	2.0856