Task 13751233

Name	hadcm3n_yf3n_1940_40_007614679_2
Workunit	7792809
Created	8 Dec 2011, 8:47:43 UTC
Sent	8 Dec 2011, 9:00:26 UTC
Report deadline	8 Mar 2012, 16:27:37 UTC
Received	23 Dec 2011, 6:13:21 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-226 (0xFFFFFF1E) ERR_TOO_MANY_EXITS
Computer ID	1077908
Run time	7 days 13 hours 41 min 56 sec
CPU time	6 days 14 hours 49 min 44 sec
Validate state	Invalid
Credit	5,287.68
Device peak FLOPS	3.07 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> too many exit(0)s </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... 21:50:08 (4288): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 09:09:43 (5076): No heartbeat from core client for 30 sec - exiting 09:09:44 (5076): No heartbeat from core client for 30 sec - exiting 09:09:45 (5076): No heartbeat from core client for 30 sec - exiting 09:09:46 (5076): No heartbeat from core client for 30 sec - exiting 09:09:47 (5076): No heartbeat from core client for 30 sec - exiting 09:09:48 (5076): No heartbeat from core client for 30 sec - exiting 09:09:49 (5076): No heartbeat from core client for 30 sec - exiting 09:09:50 (5076): No heartbeat from core client for 30 sec - exiting 09:09:51 (5076): No heartbeat from core client for 30 sec - exiting 09:09:52 (5076): No heartbeat from core client for 30 sec - exiting 09:09:53 (5076): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:01:19 (4004): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/yf3nko.pjf3c10 Error converting file to netcdf: dataout/yf3nko.pif3c10 Error converting file to netcdf: dataout/yf3nko.pff3c10 Error converting file to netcdf: dataout/yf3nka.phf3c10 Error converting file to netcdf: dataout/yf3nka.pgf3c10 Error converting file to netcdf: dataout/yf3nka.pef3c10 Error converting file to netcdf: dataout/yf3nka.pdf3c10 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4484, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4484, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4484, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4484, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4484, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4484, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4484, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4484, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4484, iMonCtr=1 Model crash detected, will try to restart... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/yf3nko.pjf3c10 Error converting file to netcdf: dataout/yf3nko.pif3c10 Error converting file to netcdf: dataout/yf3nko.pff3c10 Error converting file to netcdf: dataout/yf3nka.phf3c10 Error converting file to netcdf: dataout/yf3nka.pgf3c10 Error converting file to netcdf: dataout/yf3nka.pef3c10 Error converting file to netcdf: dataout/yf3nka.pdf3c10 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
20 Dec 2011 18:48:04	1077908	13751233	hadcm3n_yf3n_1940_40_007614679_2	440,640	560,885	1.2729
20 Dec 2011 08:27:45	1077908	13751233	hadcm3n_yf3n_1940_40_007614679_2	414,720	528,047	1.2733
19 Dec 2011 22:35:12	1077908	13751233	hadcm3n_yf3n_1940_40_007614679_2	388,800	495,167	1.2736
19 Dec 2011 12:13:28	1077908	13751233	hadcm3n_yf3n_1940_40_007614679_2	362,880	462,331	1.2741
18 Dec 2011 09:47:42	1077908	13751233	hadcm3n_yf3n_1940_40_007614679_2	336,960	429,988	1.2761
13 Dec 2011 22:34:56	1077908	13751233	hadcm3n_yf3n_1940_40_007614679_2	311,040	397,298	1.2773
13 Dec 2011 12:32:32	1077908	13751233	hadcm3n_yf3n_1940_40_007614679_2	285,120	364,325	1.2778
13 Dec 2011 01:58:35	1077908	13751233	hadcm3n_yf3n_1940_40_007614679_2	259,200	331,130	1.2775
12 Dec 2011 16:05:51	1077908	13751233	hadcm3n_yf3n_1940_40_007614679_2	233,280	297,790	1.2765
12 Dec 2011 04:22:16	1077908	13751233	hadcm3n_yf3n_1940_40_007614679_2	207,360	264,899	1.2775
11 Dec 2011 17:39:34	1077908	13751233	hadcm3n_yf3n_1940_40_007614679_2	181,440	231,974	1.2785
11 Dec 2011 06:51:23	1077908	13751233	hadcm3n_yf3n_1940_40_007614679_2	155,520	198,816	1.2784
10 Dec 2011 20:03:04	1077908	13751233	hadcm3n_yf3n_1940_40_007614679_2	129,600	165,726	1.2788
10 Dec 2011 09:11:10	1077908	13751233	hadcm3n_yf3n_1940_40_007614679_2	103,680	132,559	1.2785
09 Dec 2011 22:18:26	1077908	13751233	hadcm3n_yf3n_1940_40_007614679_2	77,760	99,416	1.2785
09 Dec 2011 10:53:09	1077908	13751233	hadcm3n_yf3n_1940_40_007614679_2	51,840	66,668	1.2860
08 Dec 2011 21:04:32	1077908	13751233	hadcm3n_yf3n_1940_40_007614679_2	25,920	33,537	1.2939