Task 13548770

Name	hadcm3n_y9ia_1900_40_007521541_0
Workunit	7719016
Created	28 Oct 2011, 13:13:24 UTC
Sent	2 Nov 2011, 11:33:11 UTC
Report deadline	1 Feb 2012, 19:00:22 UTC
Received	19 Dec 2011, 6:04:00 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1049275
Run time	14 days 3 hours 19 min 40 sec
CPU time	13 days 17 hours 37 min 27 sec
Validate state	Invalid
Credit	7,776.00
Device peak FLOPS	2.58 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=16260, selfPID=16260, iMonCtr=1 BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/y9iako.pja1c10 Error converting file to netcdf: dataout/y9iako.pia1c10 Error converting file to netcdf: dataout/y9iako.pfa1c10 Error converting file to netcdf: dataout/y9iaka.pha1c10 Error converting file to netcdf: dataout/y9iaka.pga1c10 Error converting file to netcdf: dataout/y9iaka.pea1c10 Error converting file to netcdf: dataout/y9iaka.pda1c10 Signal 11 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4912, iMonCtr=1 Model crash detected, will try to restart... Model crashed: P_TH_ADJ : NEGATIVE PRESSURE VALUE CREATED. tmp/pipe_dummy 2048 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 11 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=592, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=592, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=592, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=592, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=592, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=592, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
16 Dec 2011 13:07:59	1049275	13548770	hadcm3n_y9ia_1900_40_007521541_0	648,000	1,171,103	1.8073
14 Dec 2011 18:43:04	1049275	13548770	hadcm3n_y9ia_1900_40_007521541_0	622,080	1,123,036	1.8053
13 Dec 2011 16:28:29	1049275	13548770	hadcm3n_y9ia_1900_40_007521541_0	596,160	1,074,402	1.8022
12 Dec 2011 18:01:52	1049275	13548770	hadcm3n_y9ia_1900_40_007521541_0	570,240	1,026,417	1.8000
11 Dec 2011 14:58:21	1049275	13548770	hadcm3n_y9ia_1900_40_007521541_0	544,320	978,886	1.7984
11 Dec 2011 00:09:27	1049275	13548770	hadcm3n_y9ia_1900_40_007521541_0	518,400	931,639	1.7971
10 Dec 2011 07:45:51	1049275	13548770	hadcm3n_y9ia_1900_40_007521541_0	492,480	884,607	1.7962
03 Dec 2011 11:51:57	1049275	13548770	hadcm3n_y9ia_1900_40_007521541_0	466,560	837,540	1.7951
02 Dec 2011 06:21:12	1049275	13548770	hadcm3n_y9ia_1900_40_007521541_0	440,640	789,677	1.7921
29 Nov 2011 14:17:12	1049275	13548770	hadcm3n_y9ia_1900_40_007521541_0	414,720	741,219	1.7873
28 Nov 2011 10:51:13	1049275	13548770	hadcm3n_y9ia_1900_40_007521541_0	388,800	692,588	1.7813
25 Nov 2011 10:21:22	1049275	13548770	hadcm3n_y9ia_1900_40_007521541_0	362,880	644,724	1.7767
24 Nov 2011 16:28:39	1049275	13548770	hadcm3n_y9ia_1900_40_007521541_0	336,960	598,868	1.7773
22 Nov 2011 13:40:11	1049275	13548770	hadcm3n_y9ia_1900_40_007521541_0	311,040	551,649	1.7736
21 Nov 2011 10:34:00	1049275	13548770	hadcm3n_y9ia_1900_40_007521541_0	285,120	506,048	1.7749
19 Nov 2011 09:18:47	1049275	13548770	hadcm3n_y9ia_1900_40_007521541_0	259,200	459,745	1.7737
18 Nov 2011 02:07:24	1049275	13548770	hadcm3n_y9ia_1900_40_007521541_0	233,280	414,046	1.7749
17 Nov 2011 06:32:44	1049275	13548770	hadcm3n_y9ia_1900_40_007521541_0	207,360	368,348	1.7764
16 Nov 2011 05:58:27	1049275	13548770	hadcm3n_y9ia_1900_40_007521541_0	181,440	322,161	1.7756
16 Nov 2011 05:58:27	1049275	13548770	hadcm3n_y9ia_1900_40_007521541_0	155,520	275,258	1.7699