Task 13855134

Name	hadcm3n_o1pf_1980_40_007539308_4
Workunit	7736540
Created	3 Jan 2012, 23:58:42 UTC
Sent	3 Jan 2012, 23:58:58 UTC
Report deadline	4 Apr 2012, 7:26:09 UTC
Received	10 Feb 2012, 15:31:12 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1188779
Run time	23 days 16 hours 32 min 28 sec
CPU time	22 days 6 hours 30 min 20 sec
Validate state	Invalid
Credit	11,508.48
Device peak FLOPS	2.06 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=10216, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=15612, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4560, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4560, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4560, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4560, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4560, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4560, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o1pf_1980_40_007539308/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o1pf_1980_40_007539308/dataout/ocean_restart.day after 11 attempts cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o1pf_1980_40_007539308/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o1pf_1980_40_007539308/dataout/ocean_restart.day after 11 attempts Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1964, iMonCtr=1 Model crash detected, will try to restart... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o1pf_1980_40_007539308/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o1pf_1980_40_007539308/dataout/ocean_restart.day after 11 attempts Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1964, iMonCtr=1 Model crash detected, will try to restart... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o1pf_1980_40_007539308/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o1pf_1980_40_007539308/dataout/ocean_restart.day after 11 attempts Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1964, iMonCtr=1 Model crash detected, will try to restart... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o1pf_1980_40_007539308/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o1pf_1980_40_007539308/dataout/ocean_restart.day after 11 attempts Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1964, iMonCtr=1 Model crash detected, will try to restart... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o1pf_1980_40_007539308/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o1pf_1980_40_007539308/dataout/ocean_restart.day after 11 attempts Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1964, iMonCtr=1 Model crash detected, will try to restart... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o1pf_1980_40_007539308/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o1pf_1980_40_007539308/dataout/ocean_restart.day after 11 attempts Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1964, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
10 Feb 2012 03:43:04	1188779	13855134	hadcm3n_o1pf_1980_40_007539308_4	959,040	1,890,149	1.9709
09 Feb 2012 08:45:40	1188779	13855134	hadcm3n_o1pf_1980_40_007539308_4	933,120	1,838,926	1.9707
08 Feb 2012 07:01:21	1188779	13855134	hadcm3n_o1pf_1980_40_007539308_4	907,200	1,787,290	1.9701
07 Feb 2012 16:24:31	1188779	13855134	hadcm3n_o1pf_1980_40_007539308_4	881,280	1,736,156	1.9700
06 Feb 2012 23:41:46	1188779	13855134	hadcm3n_o1pf_1980_40_007539308_4	855,360	1,684,772	1.9697
06 Feb 2012 00:40:57	1188779	13855134	hadcm3n_o1pf_1980_40_007539308_4	829,440	1,634,164	1.9702
05 Feb 2012 10:36:23	1188779	13855134	hadcm3n_o1pf_1980_40_007539308_4	803,520	1,583,751	1.9710
04 Feb 2012 21:27:34	1188779	13855134	hadcm3n_o1pf_1980_40_007539308_4	777,600	1,533,379	1.9719
04 Feb 2012 05:27:48	1188779	13855134	hadcm3n_o1pf_1980_40_007539308_4	751,680	1,481,758	1.9713
03 Feb 2012 14:19:56	1188779	13855134	hadcm3n_o1pf_1980_40_007539308_4	725,760	1,429,973	1.9703
02 Feb 2012 23:27:56	1188779	13855134	hadcm3n_o1pf_1980_40_007539308_4	699,840	1,378,008	1.9690
02 Feb 2012 04:22:33	1188779	13855134	hadcm3n_o1pf_1980_40_007539308_4	673,920	1,325,879	1.9674
01 Feb 2012 06:57:53	1188779	13855134	hadcm3n_o1pf_1980_40_007539308_4	648,000	1,274,560	1.9669
31 Jan 2012 13:07:45	1188779	13855134	hadcm3n_o1pf_1980_40_007539308_4	622,080	1,221,854	1.9641
30 Jan 2012 21:44:18	1188779	13855134	hadcm3n_o1pf_1980_40_007539308_4	596,160	1,169,272	1.9613
29 Jan 2012 12:06:27	1188779	13855134	hadcm3n_o1pf_1980_40_007539308_4	570,240	1,116,872	1.9586
28 Jan 2012 21:20:05	1188779	13855134	hadcm3n_o1pf_1980_40_007539308_4	544,320	1,065,000	1.9566
27 Jan 2012 12:22:38	1188779	13855134	hadcm3n_o1pf_1980_40_007539308_4	518,400	1,013,526	1.9551
26 Jan 2012 02:56:22	1188779	13855134	hadcm3n_o1pf_1980_40_007539308_4	492,480	961,477	1.9523
25 Jan 2012 11:49:07	1188779	13855134	hadcm3n_o1pf_1980_40_007539308_4	466,560	909,479	1.9493