Task 19150188

Name	hadcm3n_xda6_198012_480_010218796_2
Workunit	10218796
Created	14 Dec 2015, 12:14:54 UTC
Sent	14 Dec 2015, 12:15:09 UTC
Report deadline	25 Nov 2016, 17:35:09 UTC
Received	6 Jan 2016, 13:20:10 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1327724
Run time	10 days 4 hours 53 min 11 sec
CPU time	8 days 6 hours 30 min 21 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	3.87 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.6.9</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5336, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4580, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4400, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4400, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4400, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4656, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3428, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4780, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4508, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4040, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4040, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3596, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3596, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2552, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3696, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=580, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4076, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=988, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4336, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4336, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3480, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3480, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3480, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5112, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=220, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=220, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=220, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=220, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=220, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=220, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
05 Jan 2016 22:24:04	1327724	19150188	hadcm3n_xda6_198012_480_010218796_2	777,600	707,355	0.9097
05 Jan 2016 13:58:12	1327724	19150188	hadcm3n_xda6_198012_480_010218796_2	751,680	679,573	0.9041
04 Jan 2016 17:02:57	1327724	19150188	hadcm3n_xda6_198012_480_010218796_2	725,760	655,958	0.9038
03 Jan 2016 21:22:45	1327724	19150188	hadcm3n_xda6_198012_480_010218796_2	699,840	632,450	0.9037
03 Jan 2016 13:06:50	1327724	19150188	hadcm3n_xda6_198012_480_010218796_2	673,920	605,151	0.8980
02 Jan 2016 15:53:12	1327724	19150188	hadcm3n_xda6_198012_480_010218796_2	648,000	579,771	0.8947
01 Jan 2016 19:05:38	1327724	19150188	hadcm3n_xda6_198012_480_010218796_2	622,080	556,853	0.8951
31 Dec 2015 20:42:03	1327724	19150188	hadcm3n_xda6_198012_480_010218796_2	596,160	532,182	0.8927
31 Dec 2015 11:51:04	1327724	19150188	hadcm3n_xda6_198012_480_010218796_2	570,240	506,730	0.8886
30 Dec 2015 16:38:08	1327724	19150188	hadcm3n_xda6_198012_480_010218796_2	544,320	483,175	0.8877
29 Dec 2015 18:56:12	1327724	19150188	hadcm3n_xda6_198012_480_010218796_2	518,400	460,168	0.8877
29 Dec 2015 11:00:13	1327724	19150188	hadcm3n_xda6_198012_480_010218796_2	492,480	436,490	0.8863
28 Dec 2015 16:10:33	1327724	19150188	hadcm3n_xda6_198012_480_010218796_2	466,560	412,763	0.8847
27 Dec 2015 14:37:10	1327724	19150188	hadcm3n_xda6_198012_480_010218796_2	440,640	388,463	0.8816
26 Dec 2015 12:29:17	1327724	19150188	hadcm3n_xda6_198012_480_010218796_2	414,720	364,057	0.8778
25 Dec 2015 16:08:55	1327724	19150188	hadcm3n_xda6_198012_480_010218796_2	388,800	337,736	0.8687
24 Dec 2015 18:17:21	1327724	19150188	hadcm3n_xda6_198012_480_010218796_2	362,880	313,667	0.8644
23 Dec 2015 22:28:05	1327724	19150188	hadcm3n_xda6_198012_480_010218796_2	336,960	290,225	0.8613
23 Dec 2015 15:27:00	1327724	19150188	hadcm3n_xda6_198012_480_010218796_2	311,040	266,839	0.8579
22 Dec 2015 14:09:39	1327724	19150188	hadcm3n_xda6_198012_480_010218796_2	285,120	240,551	0.8437