Task 13290646

Name	hadcm3n_p5xz_1940_40_007421209_1
Workunit	7618844
Created	25 Aug 2011, 1:32:35 UTC
Sent	25 Aug 2011, 1:37:42 UTC
Report deadline	24 Nov 2011, 9:04:53 UTC
Received	1 Oct 2011, 17:29:01 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	932722
Run time	23 days 9 hours 24 min 2 sec
CPU time	18 days 15 hours 30 min 37 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	2.26 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.26</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5164, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5164, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5164, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2592, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2592, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3584, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3584, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3584, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6048, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6048, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6048, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6048, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5208, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5208, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5208, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4972, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4972, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2440, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2440, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2440, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2440, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2440, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4332, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5252, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5252, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5324, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5324, iMonCtr=1 Model crash detected, will try to restart... 17:09:40 (5176): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1644, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5456, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4628, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2544, iMonCtr=1 Model crash detected, will try to restart... CSuspended CPDN Monitor - Suspend request from BOINC... Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
01 Oct 2011 12:47:16	932722	13290646	hadcm3n_p5xz_1940_40_007421209_1	777,600	1,611,023	2.0718
30 Sep 2011 08:35:54	932722	13290646	hadcm3n_p5xz_1940_40_007421209_1	751,680	1,559,178	2.0743
29 Sep 2011 02:48:00	932722	13290646	hadcm3n_p5xz_1940_40_007421209_1	725,760	1,507,065	2.0765
27 Sep 2011 07:27:15	932722	13290646	hadcm3n_p5xz_1940_40_007421209_1	699,840	1,452,003	2.0748
26 Sep 2011 02:45:50	932722	13290646	hadcm3n_p5xz_1940_40_007421209_1	673,920	1,402,714	2.0814
25 Sep 2011 09:36:09	932722	13290646	hadcm3n_p5xz_1940_40_007421209_1	648,000	1,352,298	2.0869
23 Sep 2011 07:52:06	932722	13290646	hadcm3n_p5xz_1940_40_007421209_1	622,080	1,299,922	2.0896
22 Sep 2011 02:03:21	932722	13290646	hadcm3n_p5xz_1940_40_007421209_1	596,160	1,249,234	2.0955
20 Sep 2011 06:41:35	932722	13290646	hadcm3n_p5xz_1940_40_007421209_1	570,240	1,198,063	2.1010
18 Sep 2011 19:42:10	932722	13290646	hadcm3n_p5xz_1940_40_007421209_1	544,320	1,145,608	2.1047
18 Sep 2011 01:35:49	932722	13290646	hadcm3n_p5xz_1940_40_007421209_1	518,400	1,091,599	2.1057
17 Sep 2011 15:38:44	932722	13290646	hadcm3n_p5xz_1940_40_007421209_1	492,480	1,039,822	2.1114
16 Sep 2011 03:53:56	932722	13290646	hadcm3n_p5xz_1940_40_007421209_1	466,560	985,639	2.1126
14 Sep 2011 10:06:16	932722	13290646	hadcm3n_p5xz_1940_40_007421209_1	440,640	929,290	2.1090
13 Sep 2011 02:04:46	932722	13290646	hadcm3n_p5xz_1940_40_007421209_1	414,720	869,034	2.0955
11 Sep 2011 11:51:24	932722	13290646	hadcm3n_p5xz_1940_40_007421209_1	388,800	808,148	2.0786
10 Sep 2011 09:06:17	932722	13290646	hadcm3n_p5xz_1940_40_007421209_1	362,880	746,351	2.0567
09 Sep 2011 01:50:48	932722	13290646	hadcm3n_p5xz_1940_40_007421209_1	336,960	684,002	2.0299
06 Sep 2011 04:28:59	932722	13290646	hadcm3n_p5xz_1940_40_007421209_1	311,040	631,055	2.0289
05 Sep 2011 11:14:39	932722	13290646	hadcm3n_p5xz_1940_40_007421209_1	285,120	578,311	2.0283