Task 15674546

Name	hadcm3n_4i9y_1940_40_008306391_4
Workunit	8457526
Created	21 Mar 2013, 9:17:35 UTC
Sent	21 Mar 2013, 9:17:45 UTC
Report deadline	20 Jun 2013, 16:44:56 UTC
Received	13 Apr 2013, 8:00:22 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1216036
Run time	10 days 20 hours 40 min 39 sec
CPU time	10 days 1 hours 28 min
Validate state	Invalid
Credit	6,531.84
Device peak FLOPS	2.48 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.31</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Ocean Restart file copy failed on 4i9yko.dae2ap0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Hold Restart file rename failed on atmos_restart.hold CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/4i9yko.pjf9c10 Error converting file to netcdf: dataout/4i9yko.pif9c10 Error converting file to netcdf: dataout/4i9yko.pff9c10 Error converting file to netcdf: dataout/4i9yka.phf9c10 Error converting file to netcdf: dataout/4i9yka.pgf9c10 Error converting file to netcdf: dataout/4i9yka.pef9c10 Error converting file to netcdf: dataout/4i9yka.pdf9c10 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3412, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3412, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3412, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3412, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3412, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3412, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
12 Apr 2013 20:58:45	1216036	15674546	hadcm3n_4i9y_1940_40_008306391_4	544,320	844,893	1.5522
12 Apr 2013 09:14:29	1216036	15674546	hadcm3n_4i9y_1940_40_008306391_4	518,400	805,937	1.5547
08 Apr 2013 18:41:15	1216036	15674546	hadcm3n_4i9y_1940_40_008306391_4	492,480	764,872	1.5531
08 Apr 2013 05:20:49	1216036	15674546	hadcm3n_4i9y_1940_40_008306391_4	466,560	723,744	1.5512
07 Apr 2013 12:08:59	1216036	15674546	hadcm3n_4i9y_1940_40_008306391_4	440,640	683,135	1.5503
04 Apr 2013 17:45:25	1216036	15674546	hadcm3n_4i9y_1940_40_008306391_4	414,720	643,670	1.5521
04 Apr 2013 04:54:09	1216036	15674546	hadcm3n_4i9y_1940_40_008306391_4	388,800	601,630	1.5474
03 Apr 2013 12:47:08	1216036	15674546	hadcm3n_4i9y_1940_40_008306391_4	362,880	558,824	1.5400
02 Apr 2013 22:51:31	1216036	15674546	hadcm3n_4i9y_1940_40_008306391_4	336,960	518,344	1.5383
02 Apr 2013 04:26:58	1216036	15674546	hadcm3n_4i9y_1940_40_008306391_4	311,040	478,868	1.5396
01 Apr 2013 15:05:45	1216036	15674546	hadcm3n_4i9y_1940_40_008306391_4	285,120	440,270	1.5442
31 Mar 2013 00:41:55	1216036	15674546	hadcm3n_4i9y_1940_40_008306391_4	259,200	401,707	1.5498
29 Mar 2013 22:00:22	1216036	15674546	hadcm3n_4i9y_1940_40_008306391_4	233,280	361,889	1.5513
29 Mar 2013 03:13:05	1216036	15674546	hadcm3n_4i9y_1940_40_008306391_4	207,360	321,410	1.5500
28 Mar 2013 03:41:58	1216036	15674546	hadcm3n_4i9y_1940_40_008306391_4	181,440	282,354	1.5562
27 Mar 2013 00:54:04	1216036	15674546	hadcm3n_4i9y_1940_40_008306391_4	155,520	242,717	1.5607
25 Mar 2013 13:09:44	1216036	15674546	hadcm3n_4i9y_1940_40_008306391_4	103,680	158,966	1.5332
25 Mar 2013 00:55:13	1216036	15674546	hadcm3n_4i9y_1940_40_008306391_4	77,760	117,999	1.5175
23 Mar 2013 02:25:41	1216036	15674546	hadcm3n_4i9y_1940_40_008306391_4	51,840	78,320	1.5108
22 Mar 2013 01:31:44	1216036	15674546	hadcm3n_4i9y_1940_40_008306391_4	25,920	38,457	1.4837