Task 11926598

Name	famous_v1qr_1999_200_006729882_0
Workunit	6933223
Created	9 Oct 2010, 21:50:34 UTC
Sent	29 Oct 2010, 15:25:53 UTC
Report deadline	28 Jan 2011, 22:53:04 UTC
Received	7 Dec 2010, 22:13:25 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	324134
Run time	16 days 7 hours 36 min 28 sec
CPU time	9 days 12 hours 28 min 53 sec
Validate state	Invalid
Credit	2,223.56
Device peak FLOPS	1.06 GFLOPS
Application version	UK Met Office FAMOUS v6.11 windows_intelx86
Stderr	<core_client_version>6.6.20</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Moforrtl: severe (47): write to READONLY file, unit 6, file E:\Documents and Settings\All Users\Application Data\BOINC\projects\climateprediction.net\famous_v1qr_1999_200_006729882\dataout\stdout_um.txt Image PC Routine Line Source famous_um_6.11_wi 008846D2 Unknown Unknown Unknown famous_um_6.11_wi 0088196C Unknown Unknown Unknown famous_um_6.11_wi 0080BD3E Unknown Unknown Unknown famous_um_6.11_wi 0080B95B Unknown Unknown Unknown famous_um_6.11_wi 007F028D Unknown Unknown Unknown famous_um_6.11_wi 007BA86B Unknown Unknown Unknown famous_um_6.11_wi 007BA0FF Unknown Unknown Unknown famous_um_6.11_wi 007BA0A0 Unknown Unknown Unknown famous_um_6.11_wi 00776C15 Unknown Unknown Unknown famous_um_6.11_wi 007CA0F6 Unknown Unknown Unknown kernel32.dll 7C817077 Unknown Unknown Unknown Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2300, iMonCtr=1 Model crash detected, will try to restart... forrtl: severe (47): write to READONLY file, unit 6, file E:\Documents and Settings\All Users\Application Data\BOINC\projects\climateprediction.net\famous_v1qr_1999_200_006729882\dataout\stdout_um.txt Image PC Routine Line Source famous_um_6.11_wi 008846D2 Unknown Unknown Unknown famous_um_6.11_wi 0088196C Unknown Unknown Unknown famous_um_6.11_wi 0080BD3E Unknown Unknown Unknown famous_um_6.11_wi 0080B95B Unknown Unknown Unknown famous_um_6.11_wi 007F028D Unknown Unknown Unknown famous_um_6.11_wi 007BA86B Unknown Unknown Unknown famous_um_6.11_wi 007BA0FF Unknown Unknown Unknown famous_um_6.11_wi 007BA0A0 Unknown Unknown Unknown famous_um_6.11_wi 00776C15 Unknown Unknown Unknown famous_um_6.11_wi 007CA0F6 Unknown Unknown Unknown kernel32.dll 7C817077 Unknown Unknown Unknown CPDN Monitor - Quit request from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=532, selfPID=532, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3392, selfPID=3392, iMonCtr=1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1460, selfPID=1460, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CNo Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3076, selfPID=3076, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN MoNo Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1672, selfPID=1672, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2992, selfPID=2992, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3172, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 CPDN MonitorNo Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3100, selfPID=3100, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN MonitorNo Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6856, selfPID=6856, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3468, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3468, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3468, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3468, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3468, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3468, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( cpdnmonitor: cannot open input file E:\Documents and Settings\All Users\Application Data\BOINC/projects/climateprediction.net/famous_v1qr_1999_200_006729882/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file E:\Documents and Settings\All Users\Application Data\BOINC/projects/climateprediction.net/famous_v1qr_1999_200_006729882/dataout/ocean_restart.day after 11 attempts Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/pipe_dummy cpdnmonitor: cannot open input file E:\Documents and Settings\All Users\Application Data\BOINC/projects/climateprediction.net/famous_v1qr_1999_200_006729882/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file E:\Documents and Settings\All Users\Application Data\BOINC/projects/climateprediction.net/famous_v1qr_1999_200_006729882/dataout/ocean_restart.day after 11 attempts Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/pipe_dummy cpdnmonitor: cannot open input file E:\Documents and Settings\All Users\Application Data\BOINC/projects/climateprediction.net/famous_v1qr_1999_200_006729882/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file E:\Documents and Settings\All Users\Application Data\BOINC/projects/climateprediction.net/famous_v1qr_1999_200_006729882/dataout/ocean_restart.day after 11 attempts Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/pipe_dummy cpdnmonitor: cannot open input file E:\Documents and Settings\All Users\Application Data\BOINC/projects/climateprediction.net/famous_v1qr_1999_200_006729882/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file E:\Documents and Settings\All Users\Application Data\BOINC/projects/climateprediction.net/famous_v1qr_1999_200_006729882/dataout/ocean_restart.day after 11 attempts Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/pipe_dummy cpdnmonitor: cannot open input file E:\Documents and Settings\All Users\Application Data\BOINC/projects/climateprediction.net/famous_v1qr_1999_200_006729882/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file E:\Documents and Settings\All Users\Application Data\BOINC/projects/climateprediction.net/famous_v1qr_1999_200_006729882/dataout/ocean_restart.day after 11 attempts Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/pipe_dummy cpdnmonitor: cannot open input file E:\Documents and Settings\All Users\Application Data\BOINC/projects/climateprediction.net/famous_v1qr_1999_200_006729882/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file E:\Documents and Settings\All Users\Application Data\BOINC/projects/climateprediction.net/famous_v1qr_1999_200_006729882/dataout/ocean_restart.day after 11 attempts Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/pipe_dummy Sorry, too many model crashes! :-( 17:12:20 (2956): called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
07 Dec 2010 20:11:13	324134	11926598	famous_v1qr_1999_200_006729882_0	673,946	818,090	1.2139
07 Dec 2010 16:59:33	324134	11926598	famous_v1qr_1999_200_006729882_0	664,586	807,005	1.2143
07 Dec 2010 13:44:11	324134	11926598	famous_v1qr_1999_200_006729882_0	655,226	795,918	1.2147
05 Dec 2010 16:35:38	324134	11926598	famous_v1qr_1999_200_006729882_0	645,866	784,017	1.2139
05 Dec 2010 13:35:56	324134	11926598	famous_v1qr_1999_200_006729882_0	636,506	772,476	1.2136
04 Dec 2010 18:34:13	324134	11926598	famous_v1qr_1999_200_006729882_0	627,146	759,820	1.2116
04 Dec 2010 15:04:35	324134	11926598	famous_v1qr_1999_200_006729882_0	617,786	748,467	1.2115
03 Dec 2010 23:51:33	324134	11926598	famous_v1qr_1999_200_006729882_0	608,426	737,261	1.2118
03 Dec 2010 19:26:47	324134	11926598	famous_v1qr_1999_200_006729882_0	599,066	726,363	1.2125
03 Dec 2010 15:50:39	324134	11926598	famous_v1qr_1999_200_006729882_0	589,706	715,564	1.2134
03 Dec 2010 00:48:16	324134	11926598	famous_v1qr_1999_200_006729882_0	580,346	704,629	1.2142
02 Dec 2010 21:34:53	324134	11926598	famous_v1qr_1999_200_006729882_0	570,986	693,938	1.2153
02 Dec 2010 18:13:49	324134	11926598	famous_v1qr_1999_200_006729882_0	561,626	683,209	1.2165
02 Dec 2010 14:20:32	324134	11926598	famous_v1qr_1999_200_006729882_0	552,266	671,855	1.2165
01 Dec 2010 17:36:53	324134	11926598	famous_v1qr_1999_200_006729882_0	542,906	659,057	1.2139
01 Dec 2010 14:50:29	324134	11926598	famous_v1qr_1999_200_006729882_0	533,546	647,334	1.2133
30 Nov 2010 19:35:33	324134	11926598	famous_v1qr_1999_200_006729882_0	524,186	635,621	1.2126
30 Nov 2010 15:29:02	324134	11926598	famous_v1qr_1999_200_006729882_0	514,826	624,087	1.2122
29 Nov 2010 14:15:32	324134	11926598	famous_v1qr_1999_200_006729882_0	505,466	612,479	1.2117
28 Nov 2010 22:59:27	324134	11926598	famous_v1qr_1999_200_006729882_0	496,106	599,873	1.2092