Task 12767910

Name	hadcm3n_o42s_1900_40_007200615_2
Workunit	7398895
Created	2 Apr 2011, 9:36:26 UTC
Sent	2 Apr 2011, 9:43:18 UTC
Report deadline	2 Jul 2011, 17:10:29 UTC
Received	5 Jul 2011, 15:35:48 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1133529
Run time	23 days 17 hours 55 min 6 sec
CPU time	21 days 8 hours 44 min 32 sec
Validate state	Valid
Credit	12,441.60
Device peak FLOPS	2.87 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.33</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:08:58 (9652): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 21:09:00 (9652): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5292, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5292, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5292, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6752, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6752, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6752, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( cpdnmonitor: cannot open input file D:\BOINC\Data Files/projects/climateprediction.net/hadcm3n_o42s_1900_40_007200615/dataout/atmos_restart.day after 11 attempts Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5528, iMonCtr=1 Model crash detected, will try to restart... cpdnmonitor: cannot open input file D:\BOINC\Data Files/projects/climateprediction.net/hadcm3n_o42s_1900_40_007200615/dataout/atmos_restart.day after 11 attempts Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5528, iMonCtr=1 Model crash detected, will try to restart... cpdnmonitor: cannot open input file D:\BOINC\Data Files/projects/climateprediction.net/hadcm3n_o42s_1900_40_007200615/dataout/atmos_restart.day after 11 attempts Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5528, iMonCtr=1 Model crash detected, will try to restart... cpdnmonitor: cannot open input file D:\BOINC\Data Files/projects/climateprediction.net/hadcm3n_o42s_1900_40_007200615/dataout/atmos_restart.day after 11 attempts Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5528, iMonCtr=1 Model crash detected, will try to restart... cpdnmonitor: cannot open input file D:\BOINC\Data Files/projects/climateprediction.net/hadcm3n_o42s_1900_40_007200615/dataout/atmos_restart.day after 11 attempts Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5528, iMonCtr=1 Model crash detected, will try to restart... cpdnmonitor: cannot open input file D:\BOINC\Data Files/projects/climateprediction.net/hadcm3n_o42s_1900_40_007200615/dataout/atmos_restart.day after 11 attempts Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5528, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:22:53 (4332): No heartbeat from core client for 30 sec - exiting 18:22:54 (4332): No heartbeat from core client for 30 sec - exiting 18:22:55 (4332): No heartbeat from core client for 30 sec - exiting 18:22:56 (4332): No heartbeat from core client for 30 sec - exiting 18:22:57 (4332): No heartbeat from core client for 30 sec - exiting 18:22:58 (4332): No heartbeat from core client for 30 sec - exiting 18:22:59 (4332): No heartbeat from core client for 30 sec - exiting 18:23:00 (4332): No heartbeat from core client for 30 sec - exiting 18:23:01 (4332): No heartbeat from core client for 30 sec - exiting 18:23:02 (4332): No heartbeat from core client for 30 sec - exiting 18:23:03 (4332): No heartbeat from core client for 30 sec - exiting 18:23:04 (4332): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5044, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:43:44 (4352): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:47:29 (3652): No heartbeat from core client for 30 sec - exiting 15:47:30 (3652): No heartbeat from core client for 30 sec - exiting 15:47:31 (3652): No heartbeat from core client for 30 sec - exiting 15:47:32 (3652): No heartbeat from core client for 30 sec - exiting 15:47:33 (3652): No heartbeat from core client for 30 sec - exiting 15:47:34 (3652): No heartbeat from core client for 30 sec - exiting 15:47:35 (3652): No heartbeat from core client for 30 sec - exiting 15:47:36 (3652): No heartbeat from core client for 30 sec - exiting 15:47:37 (3652): No heartbeat from core client for 30 sec - exiting 15:47:38 (3652): No heartbeat from core client for 30 sec - exiting 15:47:39 (3652): No heartbeat from core client for 30 sec - exiting 15:47:40 (3652): No heartbeat from core client for 30 sec - exiting 15:47:41 (3652): No heartbeat from core client for 30 sec - exiting 15:48:13 (3652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:48:14 (3652): No heartbeat from core client for 30 sec - exiting 15:48:15 (3652): No heartbeat from core client for 30 sec - exiting 15:48:16 (3652): No heartbeat from core client for 30 sec - exiting 15:48:17 (3652): No heartbeat from core client for 30 sec - exiting 15:48:18 (3652): No heartbeat from core client for 30 sec - exiting 15:48:19 (3652): No heartbeat from core client for 30 sec - exiting 15:48:20 (3652): No heartbeat from core client for 30 sec - exiting 15:48:21 (3652): No heartbeat from core client for 30 sec - exiting 15:48:22 (3652): No heartbeat from core client for 30 sec - exiting 15:48:23 (3652): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4792, iMonCtr=1 Model crash detected, will try to restart... 11:05:15 (5552): No heartbeat from core client for 30 sec - exiting 11:05:16 (5552): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4892, iMonCtr=1 Model crash detected, will try to restart... 12:48:13 (5256): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5208, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5780, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:00:50 (4232): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 07:00:51 (4232): No heartbeat from core client for 30 sec - exiting 07:00:52 (4232): No heartbeat from core client for 30 sec - exiting 07:00:53 (4232): No heartbeat from core client for 30 sec - exiting 07:00:54 (4232): No heartbeat from core client for 30 sec - exiting 07:00:55 (4232): No heartbeat from core client for 30 sec - exiting 07:00:56 (4232): No heartbeat from core client for 30 sec - exiting 07:00:57 (4232): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 04:09:35 (6148): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 04:09:36 (6148): No heartbeat from core client for 30 sec - exiting 04:09:37 (6148): No heartbeat from core client for 30 sec - exiting 04:09:38 (6148): No heartbeat from core client for 30 sec - exiting 04:09:39 (6148): No heartbeat from core client for 30 sec - exiting 04:09:40 (6148): No heartbeat from core client for 30 sec - exiting 04:09:41 (6148): No heartbeat from core client for 30 sec - exiting 04:09:42 (6148): No heartbeat from core client for 30 sec - exiting 04:09:43 (6148): No heartbeat from core client for 30 sec - exiting 04:09:44 (6148): No heartbeat from core client for 30 sec - exiting 04:09:45 (6148): No heartbeat from core client for 30 sec - exiting 04:09:46 (6148): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
05 Jul 2011 14:36:39	1133529	12767910	hadcm3n_o42s_1900_40_007200615_2	1,036,800	1,845,361	1.7799
05 Jul 2011 05:07:26	1133529	12767910	hadcm3n_o42s_1900_40_007200615_2	1,010,880	1,811,901	1.7924
04 Jul 2011 19:31:30	1133529	12767910	hadcm3n_o42s_1900_40_007200615_2	984,960	1,778,385	1.8055
04 Jul 2011 10:24:27	1133529	12767910	hadcm3n_o42s_1900_40_007200615_2	959,040	1,745,548	1.8201
04 Jul 2011 00:57:50	1133529	12767910	hadcm3n_o42s_1900_40_007200615_2	933,120	1,712,284	1.8350
03 Jul 2011 15:42:58	1133529	12767910	hadcm3n_o42s_1900_40_007200615_2	907,200	1,679,087	1.8508
03 Jul 2011 05:30:09	1133529	12767910	hadcm3n_o42s_1900_40_007200615_2	881,280	1,643,396	1.8648
02 Jul 2011 17:19:12	1133529	12767910	hadcm3n_o42s_1900_40_007200615_2	855,360	1,604,189	1.8755
02 Jul 2011 03:07:25	1133529	12767910	hadcm3n_o42s_1900_40_007200615_2	829,440	1,565,027	1.8868
01 Jul 2011 14:47:12	1133529	12767910	hadcm3n_o42s_1900_40_007200615_2	803,520	1,524,629	1.8974
01 Jul 2011 02:05:51	1133529	12767910	hadcm3n_o42s_1900_40_007200615_2	777,600	1,482,760	1.9068
30 Jun 2011 14:33:59	1133529	12767910	hadcm3n_o42s_1900_40_007200615_2	751,680	1,443,091	1.9198
30 Jun 2011 03:27:35	1133529	12767910	hadcm3n_o42s_1900_40_007200615_2	725,760	1,407,469	1.9393
29 Jun 2011 15:42:37	1133529	12767910	hadcm3n_o42s_1900_40_007200615_2	699,840	1,369,964	1.9575
29 Jun 2011 04:49:55	1133529	12767910	hadcm3n_o42s_1900_40_007200615_2	673,920	1,334,179	1.9797
28 Jun 2011 17:45:10	1133529	12767910	hadcm3n_o42s_1900_40_007200615_2	648,000	1,299,296	2.0051
28 Jun 2011 07:03:04	1133529	12767910	hadcm3n_o42s_1900_40_007200615_2	622,080	1,264,599	2.0329
27 Jun 2011 21:09:34	1133529	12767910	hadcm3n_o42s_1900_40_007200615_2	596,160	1,230,482	2.0640
27 Jun 2011 10:34:31	1133529	12767910	hadcm3n_o42s_1900_40_007200615_2	570,240	1,197,800	2.1005
14 Jun 2011 21:28:59	1133529	12767910	hadcm3n_o42s_1900_40_007200615_2	544,320	1,163,759	2.1380