Task 14271437

Name	hadcm3n_yh5i_1940_40_007616238_4
Workunit	7794368
Created	16 Mar 2012, 5:06:16 UTC
Sent	16 Mar 2012, 5:06:26 UTC
Report deadline	15 Jun 2012, 12:33:37 UTC
Received	6 May 2012, 18:47:04 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	897278
Run time	30 days 21 hours 0 min 43 sec
CPU time	30 days 13 hours 27 min 3 sec
Validate state	Valid
Credit	12,441.60
Device peak FLOPS	3.18 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.25</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 01:29:20 (3692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:29:24 (3692): No heartbeat from core client for 30 sec - exiting 01:29:25 (3692): No heartbeat from core client for 30 sec - exiting 01:29:26 (3692): No heartbeat from core client for 30 sec - exiting 01:29:27 (3692): No heartbeat from core client for 30 sec - exiting 01:29:28 (3692): No heartbeat from core client for 30 sec - exiting 01:38:52 (9632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:32:05 (7204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:10:47 (9720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:10:48 (9720): No heartbeat from core client for 30 sec - exiting 03:11:37 (6540): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:11:38 (6540): No heartbeat from core client for 30 sec - exiting 03:11:39 (6540): No heartbeat from core client for 30 sec - exiting 03:12:47 (10400): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:12:48 (10400): No heartbeat from core client for 30 sec - exiting 03:12:49 (10400): No heartbeat from core client for 30 sec - exiting 03:12:50 (10400): No heartbeat from core client for 30 sec - exiting 03:12:51 (10400): No heartbeat from core client for 30 sec - exiting 03:12:52 (10400): No heartbeat from core client for 30 sec - exiting 03:12:53 (10400): No heartbeat from core client for 30 sec - exiting 03:12:54 (10400): No heartbeat from core client for 30 sec - exiting 03:12:55 (10400): No heartbeat from core client for 30 sec - exiting 03:12:56 (10400): No heartbeat from core client for 30 sec - exiting 03:12:57 (10400): No heartbeat from core client for 30 sec - exiting 03:13:34 (4828): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:32:25 (6508): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:32:57 (10636): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:51:54 (5696): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:52:28 (9040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold 04:02:11 (4924): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:02:48 (6552): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:05:25 (4996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:06:29 (9336): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 07:38:42 (4496): No heartbeat from core client for 30 sec - exiting 07:38:44 (4496): No heartbeat from core client for 30 sec - exiting 07:38:45 (4496): No heartbeat from core client for 30 sec - exiting 07:38:46 (4496): No heartbeat from core client for 30 sec - exiting 07:38:47 (4496): No heartbeat from core client for 30 sec - exiting 07:38:48 (4496): No heartbeat from core client for 30 sec - exiting 07:38:49 (4496): No heartbeat from core client for 30 sec - exiting 07:38:50 (4496): No heartbeat from core client for 30 sec - exiting 07:38:51 (4496): No heartbeat from core client for 30 sec - exiting 07:38:52 (4496): No heartbeat from core client for 30 sec - exiting 07:38:53 (4496): No heartbeat from core client for 30 sec - exiting 07:38:54 (4496): No heartbeat from core client for 30 sec - exiting 07:38:55 (4496): No heartbeat from core client for 30 sec - exiting 07:38:56 (4496): No heartbeat from core client for 30 sec - exiting 07:38:57 (4496): No heartbeat from core client for 30 sec - exiting 07:38:58 (4496): No heartbeat from core client for 30 sec - exiting 07:38:59 (4496): No heartbeat from core client for 30 sec - exiting 07:39:00 (4496): No heartbeat from core client for 30 sec - exiting 07:39:01 (4496): No heartbeat from core client for 30 sec - exiting 07:39:02 (4496): No heartbeat from core client for 30 sec - exiting 07:39:03 (4496): No heartbeat from core client for 30 sec - exiting 07:39:04 (4496): No heartbeat from core client for 30 sec - exiting 07:39:05 (4496): No heartbeat from core client for 30 sec - exiting 07:39:06 (4496): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:50:19 (2148): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:51:21 (4316): No heartbeat from core client for 30 sec - exiting 04:51:22 (4316): No heartbeat from core client for 30 sec - exiting 04:51:23 (4316): No heartbeat from core client for 30 sec - exiting 04:51:24 (4316): No heartbeat from core client for 30 sec - exiting 04:51:25 (4316): No heartbeat from core client for 30 sec - exiting 04:51:26 (4316): No heartbeat from core client for 30 sec - exiting 04:51:27 (4316): No heartbeat from core client for 30 sec - exiting 04:51:28 (4316): No heartbeat from core client for 30 sec - exiting 04:51:29 (4316): No heartbeat from core client for 30 sec - exiting 04:51:30 (4316): No heartbeat from core client for 30 sec - exiting 04:51:31 (4316): No heartbeat from core client for 30 sec - exiting 04:51:32 (4316): No heartbeat from core client for 30 sec - exiting 04:51:33 (4316): No heartbeat from core client for 30 sec - exiting 04:51:34 (4316): No heartbeat from core client for 30 sec - exiting 04:51:35 (4316): No heartbeat from core client for 30 sec - exiting 04:51:36 (4316): No heartbeat from core client for 30 sec - exiting 04:51:37 (4316): No heartbeat from core client for 30 sec - exiting 04:51:38 (4316): No heartbeat from core client for 30 sec - exiting 04:51:39 (4316): No heartbeat from core client for 30 sec - exiting 04:51:40 (4316): No heartbeat from core client for 30 sec - exiting 04:51:41 (4316): No heartbeat from core client for 30 sec - exiting 04:51:42 (4316): No heartbeat from core client for 30 sec - exiting 04:51:43 (4316): No heartbeat from core client for 30 sec - exiting 04:51:44 (4316): No heartbeat from core client for 30 sec - exiting 04:51:45 (4316): No heartbeat from core client for 30 sec - exiting 04:51:46 (4316): No heartbeat from core client for 30 sec - exiting 04:51:47 (4316): No heartbeat from core client for 30 sec - exiting 04:51:48 (4316): No heartbeat from core client for 30 sec - exiting 04:51:49 (4316): No heartbeat from core client for 30 sec - exiting 04:51:50 (4316): No heartbeat from core client for 30 sec - exiting 04:51:51 (4316): No heartbeat from core client for 30 sec - exiting 04:51:52 (4316): No heartbeat from core client for 30 sec - exiting 04:51:53 (4316): No heartbeat from core client for 30 sec - exiting 04:51:54 (4316): No heartbeat from core client for 30 sec - exiting 04:51:55 (4316): No heartbeat from core client for 30 sec - exiting 04:51:56 (4316): No heartbeat from core client for 30 sec - exiting 04:51:57 (4316): No heartbeat from core client for 30 sec - exiting 04:51:58 (4316): No heartbeat from core client for 30 sec - exiting 04:51:59 (4316): No heartbeat from core client for 30 sec - exiting 04:52:00 (4316): No heartbeat from core client for 30 sec - exiting 04:52:01 (4316): No heartbeat from core client for 30 sec - exiting 04:52:02 (4316): No heartbeat from core client for 30 sec - exiting 04:52:03 (4316): No heartbeat from core client for 30 sec - exiting 04:52:04 (4316): No heartbeat from core client for 30 sec - exiting 04:52:05 (4316): No heartbeat from core client for 30 sec - exiting 04:52:06 (4316): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:52:07 (4316): No heartbeat from core client for 30 sec - exiting 04:52:08 (4316): No heartbeat from core client for 30 sec - exiting 04:52:09 (4316): No heartbeat from core client for 30 sec - exiting 04:52:10 (4316): No heartbeat from core client for 30 sec - exiting 04:52:11 (4316): No heartbeat from core client for 30 sec - exiting 04:56:07 (4224): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:56:54 (1000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:57:35 (3048): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:59:02 (5064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:01:01 (5064): No heartbeat from core client for 30 sec - exiting 05:01:02 (5064): No heartbeat from core client for 30 sec - exiting 05:01:03 (5064): No heartbeat from core client for 30 sec - exiting 05:01:04 (5064): No heartbeat from core client for 30 sec - exiting 05:01:05 (5064): No heartbeat from core client for 30 sec - exiting 05:01:06 (5064): No heartbeat from core client for 30 sec - exiting Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3980, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3980, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3980, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3980, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3980, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3980, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish 08:06:15 (5588): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:06:16 (5588): No heartbeat from core client for 30 sec - exiting 08:06:17 (5588): No heartbeat from core client for 30 sec - exiting 08:06:18 (5588): No heartbeat from core client for 30 sec - exiting 08:06:19 (5588): No heartbeat from core client for 30 sec - exiting 08:06:20 (5588): No heartbeat from core client for 30 sec - exiting 08:06:21 (5588): No heartbeat from core client for 30 sec - exiting 08:06:22 (5588): No heartbeat from core client for 30 sec - exiting 08:06:23 (5588): No heartbeat from core client for 30 sec - exiting 08:06:24 (5588): No heartbeat from core client for 30 sec - exiting 08:06:25 (5588): No heartbeat from core client for 30 sec - exiting 11:09:10 (6628): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 00:34:21 (6492): No heartbeat from core client for 30 sec - exiting 00:34:23 (6492): No heartbeat from core client for 30 sec - exiting 00:34:24 (6492): No heartbeat from core client for 30 sec - exiting 00:34:25 (6492): No heartbeat from core client for 30 sec - exiting 00:34:26 (6492): No heartbeat from core client for 30 sec - exiting 00:34:27 (6492): No heartbeat from core client for 30 sec - exiting 00:34:28 (6492): No heartbeat from core client for 30 sec - exiting 00:34:29 (6492): No heartbeat from core client for 30 sec - exiting 00:34:30 (6492): No heartbeat from core client for 30 sec - exiting 00:34:31 (6492): No heartbeat from core client for 30 sec - exiting 00:34:32 (6492): No heartbeat from core client for 30 sec - exiting 00:34:33 (6492): No heartbeat from core client for 30 sec - exiting 00:34:34 (6492): No heartbeat from core client for 30 sec - exiting 00:34:35 (6492): No heartbeat from core client for 30 sec - exiting 00:34:36 (6492): No heartbeat from core client for 30 sec - exiting 00:34:37 (6492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:34:38 (6492): No heartbeat from core client for 30 sec - exiting 00:34:39 (6492): No heartbeat from core client for 30 sec - exiting 00:35:17 (6972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 00:57:23 (5560): No heartbeat from core client for 30 sec - exiting 00:57:25 (5560): No heartbeat from core client for 30 sec - exiting 00:57:26 (5560): No heartbeat from core client for 30 sec - exiting 00:57:27 (5560): No heartbeat from core client for 30 sec - exiting 00:57:28 (5560): No heartbeat from core client for 30 sec - exiting 00:57:29 (5560): No heartbeat from core client for 30 sec - exiting 00:57:30 (5560): No heartbeat from core client for 30 sec - exiting 00:57:31 (5560): No heartbeat from core client for 30 sec - exiting 00:57:32 (5560): No heartbeat from core client for 30 sec - exiting 00:57:33 (5560): No heartbeat from core client for 30 sec - exiting 00:57:34 (5560): No heartbeat from core client for 30 sec - exiting 00:57:35 (5560): No heartbeat from core client for 30 sec - exiting 00:57:36 (5560): No heartbeat from core client for 30 sec - exiting 00:57:37 (5560): No heartbeat from core client for 30 sec - exiting 00:57:38 (5560): No heartbeat from core client for 30 sec - exiting 00:57:39 (5560): No heartbeat from core client for 30 sec - exiting 00:57:40 (5560): No heartbeat from core client for 30 sec - exiting 00:57:41 (5560): No heartbeat from core client for 30 sec - exiting 00:57:42 (5560): No heartbeat from core client for 30 sec - exiting 00:57:43 (5560): No heartbeat from core client for 30 sec - exiting 00:57:44 (5560): No heartbeat from core client for 30 sec - exiting 00:57:45 (5560): No heartbeat from core client for 30 sec - exiting 00:57:46 (5560): No heartbeat from core client for 30 sec - exiting 00:57:47 (5560): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:57:48 (5560): No heartbeat from core client for 30 sec - exiting 00:58:31 (3556): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:17:13 (1584): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:17:19 (1584): No heartbeat from core client for 30 sec - exiting 01:17:20 (1584): No heartbeat from core client for 30 sec - exiting 01:17:21 (1584): No heartbeat from core client for 30 sec - exiting 01:17:22 (1584): No heartbeat from core client for 30 sec - exiting 01:17:23 (1584): No heartbeat from core client for 30 sec - exiting 01:17:24 (1584): No heartbeat from core client for 30 sec - exiting 01:17:25 (1584): No heartbeat from core client for 30 sec - exiting 01:21:10 (5272): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:23:14 (6008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:44:31 (4512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
06 May 2012 17:00:48	897278	14271437	hadcm3n_yh5i_1940_40_007616238_4	1,036,800	2,639,859	2.5462
06 May 2012 07:00:52	897278	14271437	hadcm3n_yh5i_1940_40_007616238_4	1,010,880	2,604,167	2.5761
05 May 2012 21:44:03	897278	14271437	hadcm3n_yh5i_1940_40_007616238_4	984,960	2,568,542	2.6078
05 May 2012 07:36:53	897278	14271437	hadcm3n_yh5i_1940_40_007616238_4	959,040	2,530,757	2.6388
04 May 2012 20:53:32	897278	14271437	hadcm3n_yh5i_1940_40_007616238_4	933,120	2,492,432	2.6711
03 May 2012 22:38:44	897278	14271437	hadcm3n_yh5i_1940_40_007616238_4	907,200	2,448,500	2.6990
03 May 2012 00:51:42	897278	14271437	hadcm3n_yh5i_1940_40_007616238_4	881,280	2,406,971	2.7312
02 May 2012 00:35:38	897278	14271437	hadcm3n_yh5i_1940_40_007616238_4	855,360	2,363,908	2.7636
30 Apr 2012 11:07:59	897278	14271437	hadcm3n_yh5i_1940_40_007616238_4	829,440	2,320,245	2.7974
28 Apr 2012 21:26:38	897278	14271437	hadcm3n_yh5i_1940_40_007616238_4	803,520	2,273,070	2.8289
28 Apr 2012 07:44:54	897278	14271437	hadcm3n_yh5i_1940_40_007616238_4	777,600	2,224,421	2.8606
27 Apr 2012 08:51:59	897278	14271437	hadcm3n_yh5i_1940_40_007616238_4	751,680	2,181,840	2.9026
12 Apr 2012 20:08:00	897278	14271437	hadcm3n_yh5i_1940_40_007616238_4	725,760	1,023,646	1.4104
12 Apr 2012 09:45:25	897278	14271437	hadcm3n_yh5i_1940_40_007616238_4	699,840	986,541	1.4097
11 Apr 2012 22:53:28	897278	14271437	hadcm3n_yh5i_1940_40_007616238_4	673,920	949,740	1.4093
11 Apr 2012 10:30:03	897278	14271437	hadcm3n_yh5i_1940_40_007616238_4	648,000	908,965	1.4027
10 Apr 2012 23:11:01	897278	14271437	hadcm3n_yh5i_1940_40_007616238_4	622,080	870,364	1.3991
10 Apr 2012 12:32:44	897278	14271437	hadcm3n_yh5i_1940_40_007616238_4	596,160	832,068	1.3957
10 Apr 2012 02:34:29	897278	14271437	hadcm3n_yh5i_1940_40_007616238_4	570,240	796,321	1.3965
09 Apr 2012 15:48:35	897278	14271437	hadcm3n_yh5i_1940_40_007616238_4	544,320	758,738	1.3939