Task 15643662

Name	hadcm3n_3gp9_1940_40_008258917_1
Workunit	8414041
Created	28 Feb 2013, 17:59:42 UTC
Sent	28 Feb 2013, 17:59:49 UTC
Report deadline	31 May 2013, 1:27:00 UTC
Received	25 Mar 2013, 19:34:16 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1169080
Run time	10 days 11 hours 49 min 40 sec
CPU time	10 days 10 hours 35 min 52 sec
Validate state	Valid
Credit	12,441.60
Device peak FLOPS	3.12 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <stderr_txt> Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7728, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3536, iMonCtr=1 Model crash detected, will try to restart... 11:52:10 (3392): No heartbeat from core client for 30 sec - exiting 11:52:11 (3392): No heartbeat from core client for 30 sec - exiting 11:52:12 (3392): No heartbeat from core client for 30 sec - exiting 11:52:14 (3392): No heartbeat from core client for 30 sec - exiting 11:52:15 (3392): No heartbeat from core client for 30 sec - exiting 11:52:16 (3392): No heartbeat from core client for 30 sec - exiting 11:52:17 (3392): No heartbeat from core client for 30 sec - exiting 11:52:18 (3392): No heartbeat from core client for 30 sec - exiting 11:52:19 (3392): No heartbeat from core client for 30 sec - exiting 11:52:20 (3392): No heartbeat from core client for 30 sec - exiting 11:52:21 (3392): No heartbeat from core client for 30 sec - exiting 11:52:22 (3392): No heartbeat from core client for 30 sec - exiting 11:52:23 (3392): No heartbeat from core client for 30 sec - exiting 11:52:25 (3392): No heartbeat from core client for 30 sec - exiting 11:52:26 (3392): No heartbeat from core client for 30 sec - exiting 11:52:27 (3392): No heartbeat from core client for 30 sec - exiting 11:52:28 (3392): No heartbeat from core client for 30 sec - exiting 11:52:29 (3392): No heartbeat from core client for 30 sec - exiting 11:52:30 (3392): No heartbeat from core client for 30 sec - exiting 11:52:31 (3392): No heartbeat from core client for 30 sec - exiting 11:52:33 (3392): No heartbeat from core client for 30 sec - exiting 11:52:34 (3392): No heartbeat from core client for 30 sec - exiting 11:52:35 (3392): No heartbeat from core client for 30 sec - exiting 11:52:36 (3392): No heartbeat from core client for 30 sec - exiting 11:52:37 (3392): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:11:31 (2288): No heartbeat from core client for 30 sec - exiting 09:11:32 (2288): No heartbeat from core client for 30 sec - exiting 09:11:33 (2288): No heartbeat from core client for 30 sec - exiting 09:11:34 (2288): No heartbeat from core client for 30 sec - exiting 09:11:35 (2288): No heartbeat from core client for 30 sec - exiting 09:11:36 (2288): No heartbeat from core client for 30 sec - exiting 09:11:37 (2288): No heartbeat from core client for 30 sec - exiting 09:11:39 (2288): No heartbeat from core client for 30 sec - exiting 09:11:40 (2288): No heartbeat from core client for 30 sec - exiting 09:11:41 (2288): No heartbeat from core client for 30 sec - exiting 09:11:42 (2288): No heartbeat from core client for 30 sec - exiting 09:11:43 (2288): No heartbeat from core client for 30 sec - exiting 09:11:44 (2288): No heartbeat from core client for 30 sec - exiting 09:11:45 (2288): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:10:04 (4472): No heartbeat from core client for 30 sec - exiting 09:10:05 (4472): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=744, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... 14:37:19 (4216): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:43:19 (3940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3584, iMonCtr=1 Model crash detected, will try to restart... 19:00:02 (4860): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:20:08 (4324): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:20:09 (4324): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:03:09 (3124): No heartbeat from core client for 30 sec - exiting 09:03:11 (3124): No heartbeat from core client for 30 sec - exiting 09:03:12 (3124): No heartbeat from core client for 30 sec - exiting 09:03:13 (3124): No heartbeat from core client for 30 sec - exiting 09:03:14 (3124): No heartbeat from core client for 30 sec - exiting 09:03:15 (3124): No heartbeat from core client for 30 sec - exiting 09:03:16 (3124): No heartbeat from core client for 30 sec - exiting 09:03:17 (3124): No heartbeat from core client for 30 sec - exiting 09:03:18 (3124): No heartbeat from core client for 30 sec - exiting 09:03:19 (3124): No heartbeat from core client for 30 sec - exiting 09:03:20 (3124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:23:39 (3784): No heartbeat from core client for 30 sec - exiting 10:23:40 (3784): No heartbeat from core client for 30 sec - exiting 10:23:41 (3784): No heartbeat from core client for 30 sec - exiting 10:23:42 (3784): No heartbeat from core client for 30 sec - exiting 10:23:43 (3784): No heartbeat from core client for 30 sec - exiting 10:23:44 (3784): No heartbeat from core client for 30 sec - exiting 10:23:45 (3784): No heartbeat from core client for 30 sec - exiting 10:23:46 (3784): No heartbeat from core client for 30 sec - exiting 10:23:47 (3784): No heartbeat from core client for 30 sec - exiting 10:23:48 (3784): No heartbeat from core client for 30 sec - exiting 10:23:49 (3784): No heartbeat from core client for 30 sec - exiting 10:23:51 (3784): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:21:41 (4732): No heartbeat from core client for 30 sec - exiting 18:21:42 (4732): No heartbeat from core client for 30 sec - exiting 18:21:44 (4732): No heartbeat from core client for 30 sec - exiting 18:21:45 (4732): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:11:44 (4128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:39:04 (3712): No heartbeat from core client for 30 sec - exiting 16:39:05 (3712): No heartbeat from core client for 30 sec - exiting 16:39:06 (3712): No heartbeat from core client for 30 sec - exiting 16:39:07 (3712): No heartbeat from core client for 30 sec - exiting 16:39:08 (3712): No heartbeat from core client for 30 sec - exiting 16:39:09 (3712): No heartbeat from core client for 30 sec - exiting 16:39:10 (3712): No heartbeat from core client for 30 sec - exiting 16:39:11 (3712): No heartbeat from core client for 30 sec - exiting 16:39:12 (3712): No heartbeat from core client for 30 sec - exiting 16:39:14 (3712): No heartbeat from core client for 30 sec - exiting 16:39:15 (3712): No heartbeat from core client for 30 sec - exiting 16:39:16 (3712): No heartbeat from core client for 30 sec - exiting 16:39:17 (3712): No heartbeat from core client for 30 sec - exiting 16:39:18 (3712): No heartbeat from core client for 30 sec - exiting 16:39:19 (3712): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:56:44 (528): No heartbeat from core client for 30 sec - exiting 13:56:45 (528): No heartbeat from core client for 30 sec - exiting 13:56:46 (528): No heartbeat from core client for 30 sec - exiting 13:56:47 (528): No heartbeat from core client for 30 sec - exiting 13:56:48 (528): No heartbeat from core client for 30 sec - exiting 13:56:49 (528): No heartbeat from core client for 30 sec - exiting 13:56:50 (528): No heartbeat from core client for 30 sec - exiting 13:56:51 (528): No heartbeat from core client for 30 sec - exiting 13:56:53 (528): No heartbeat from core client for 30 sec - exiting 13:56:54 (528): No heartbeat from core client for 30 sec - exiting 13:56:55 (528): No heartbeat from core client for 30 sec - exiting 13:56:56 (528): No heartbeat from core client for 30 sec - exiting 13:56:57 (528): No heartbeat from core client for 30 sec - exiting 13:56:58 (528): No heartbeat from core client for 30 sec - exiting 13:56:59 (528): No heartbeat from core client for 30 sec - exiting 13:57:00 (528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3220, iMonCtr=1 Model crash detected, will try to restart... 18:50:32 (4192): No heartbeat from core client for 30 sec - exiting 18:50:33 (4192): No heartbeat from core client for 30 sec - exiting 18:50:34 (4192): No heartbeat from core client for 30 sec - exiting 18:50:35 (4192): No heartbeat from core client for 30 sec - exiting 18:50:37 (4192): No heartbeat from core client for 30 sec - exiting 18:50:38 (4192): No heartbeat from core client for 30 sec - exiting 18:50:39 (4192): No heartbeat from core client for 30 sec - exiting 18:50:40 (4192): No heartbeat from core client for 30 sec - exiting 18:50:41 (4192): No heartbeat from core client for 30 sec - exiting 18:50:42 (4192): No heartbeat from core client for 30 sec - exiting 18:50:43 (4192): No heartbeat from core client for 30 sec - exiting 18:50:44 (4192): No heartbeat from core client for 30 sec - exiting 18:50:45 (4192): No heartbeat from core client for 30 sec - exiting 18:50:46 (4192): No heartbeat from core client for 30 sec - exiting 18:50:47 (4192): No heartbeat from core client for 30 sec - exiting 18:50:48 (4192): No heartbeat from core client for 30 sec - exiting 18:50:49 (4192): No heartbeat from core client for 30 sec - exiting 18:50:50 (4192): No heartbeat from core client for 30 sec - exiting 18:50:51 (4192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:50:53 (4192): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:36:39 (2752): No heartbeat from core client for 30 sec - exiting 08:36:40 (2752): No heartbeat from core client for 30 sec - exiting 08:36:41 (2752): No heartbeat from core client for 30 sec - exiting 08:36:42 (2752): No heartbeat from core client for 30 sec - exiting 08:36:43 (2752): No heartbeat from core client for 30 sec - exiting 08:36:44 (2752): No heartbeat from core client for 30 sec - exiting 08:36:46 (2752): No heartbeat from core client for 30 sec - exiting 08:36:47 (2752): No heartbeat from core client for 30 sec - exiting 08:36:48 (2752): No heartbeat from core client for 30 sec - exiting 08:36:49 (2752): No heartbeat from core client for 30 sec - exiting 08:36:50 (2752): No heartbeat from core client for 30 sec - exiting 08:36:51 (2752): No heartbeat from core client for 30 sec - exiting 08:36:52 (2752): No heartbeat from core client for 30 sec - exiting 08:36:53 (2752): No heartbeat from core client for 30 sec - exiting 08:36:54 (2752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:37:07 (4148): No heartbeat from core client for 30 sec - exiting 08:37:08 (4148): No heartbeat from core client for 30 sec - exiting 08:37:09 (4148): No heartbeat from core client for 30 sec - exiting 08:37:10 (4148): No heartbeat from core client for 30 sec - exiting 08:37:11 (4148): No heartbeat from core client for 30 sec - exiting 08:37:12 (4148): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:10:34 (1048): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4440, iMonCtr=1 Model crash detected, will try to restart... 08:33:37 (4260): No heartbeat from core client for 30 sec - exiting 08:33:38 (4260): No heartbeat from core client for 30 sec - exiting 08:33:39 (4260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:16:26 (2972): No heartbeat from core client for 30 sec - exiting 08:16:28 (2972): No heartbeat from core client for 30 sec - exiting 08:16:29 (2972): No heartbeat from core client for 30 sec - exiting 08:16:30 (2972): No heartbeat from core client for 30 sec - exiting 08:16:31 (2972): No heartbeat from core client for 30 sec - exiting 08:16:32 (2972): No heartbeat from core client for 30 sec - exiting 08:16:33 (2972): No heartbeat from core client for 30 sec - exiting 08:16:34 (2972): No heartbeat from core client for 30 sec - exiting 08:16:35 (2972): No heartbeat from core client for 30 sec - exiting 08:16:36 (2972): No heartbeat from core client for 30 sec - exiting 08:16:37 (2972): No heartbeat from core client for 30 sec - exiting 08:16:38 (2972): No heartbeat from core client for 30 sec - exiting 08:16:39 (2972): No heartbeat from core client for 30 sec - exiting 08:16:40 (2972): No heartbeat from core client for 30 sec - exiting 08:16:41 (2972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:51:01 (4136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:35:13 (3260): No heartbeat from core client for 30 sec - exiting 09:35:15 (3260): No heartbeat from core client for 30 sec - exiting 09:35:16 (3260): No heartbeat from core client for 30 sec - exiting 09:35:17 (3260): No heartbeat from core client for 30 sec - exiting 09:35:18 (3260): No heartbeat from core client for 30 sec - exiting 09:35:19 (3260): No heartbeat from core client for 30 sec - exiting 09:35:20 (3260): No heartbeat from core client for 30 sec - exiting 09:35:21 (3260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:35:22 (3260): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
25 Mar 2013 19:48:24	1169080	15643662	hadcm3n_3gp9_1940_40_008258917_1	1,036,800	901,818	0.8698
24 Mar 2013 19:51:44	1169080	15643662	hadcm3n_3gp9_1940_40_008258917_1	1,010,880	879,387	0.8699
24 Mar 2013 13:55:07	1169080	15643662	hadcm3n_3gp9_1940_40_008258917_1	984,960	857,970	0.8711
23 Mar 2013 08:23:06	1169080	15643662	hadcm3n_3gp9_1940_40_008258917_1	959,040	834,934	0.8706
22 Mar 2013 16:45:48	1169080	15643662	hadcm3n_3gp9_1940_40_008258917_1	933,120	811,329	0.8695
22 Mar 2013 08:28:52	1169080	15643662	hadcm3n_3gp9_1940_40_008258917_1	907,200	788,307	0.8689
21 Mar 2013 11:34:54	1169080	15643662	hadcm3n_3gp9_1940_40_008258917_1	881,280	765,509	0.8686
20 Mar 2013 18:06:07	1169080	15643662	hadcm3n_3gp9_1940_40_008258917_1	855,360	742,243	0.8678
20 Mar 2013 11:37:47	1169080	15643662	hadcm3n_3gp9_1940_40_008258917_1	829,440	719,422	0.8674
19 Mar 2013 18:49:37	1169080	15643662	hadcm3n_3gp9_1940_40_008258917_1	803,520	696,781	0.8672
19 Mar 2013 08:44:02	1169080	15643662	hadcm3n_3gp9_1940_40_008258917_1	777,600	674,705	0.8677
18 Mar 2013 16:00:35	1169080	15643662	hadcm3n_3gp9_1940_40_008258917_1	751,680	652,111	0.8675
18 Mar 2013 09:28:53	1169080	15643662	hadcm3n_3gp9_1940_40_008258917_1	725,760	628,772	0.8664
17 Mar 2013 13:45:16	1169080	15643662	hadcm3n_3gp9_1940_40_008258917_1	699,840	606,203	0.8662
16 Mar 2013 19:43:46	1169080	15643662	hadcm3n_3gp9_1940_40_008258917_1	673,920	583,247	0.8655
16 Mar 2013 09:48:30	1169080	15643662	hadcm3n_3gp9_1940_40_008258917_1	648,000	561,220	0.8661
15 Mar 2013 15:45:35	1169080	15643662	hadcm3n_3gp9_1940_40_008258917_1	622,080	538,408	0.8655
15 Mar 2013 07:58:17	1169080	15643662	hadcm3n_3gp9_1940_40_008258917_1	596,160	516,012	0.8656
14 Mar 2013 11:55:42	1169080	15643662	hadcm3n_3gp9_1940_40_008258917_1	570,240	493,683	0.8657
13 Mar 2013 14:50:24	1169080	15643662	hadcm3n_3gp9_1940_40_008258917_1	544,320	470,991	0.8653