Task 13651708

Name	hadcm3n_yf11_1900_40_007517600_3
Workunit	7715075
Created	21 Nov 2011, 17:50:12 UTC
Sent	21 Nov 2011, 18:33:54 UTC
Report deadline	21 Feb 2012, 2:01:05 UTC
Received	13 Dec 2011, 2:27:37 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1057717
Run time	12 days 1 hours 10 min 11 sec
CPU time	9 days 17 hours 1 min 2 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	3.06 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> - exit code -1073741819 (0xc0000005) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6016, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6016, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6016, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6016, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6016, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6016, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6016, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6016, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6016, iMonCtr=1 Model crash detected, will try to restart... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/yf11ko.pja4c10 Error converting file to netcdf: dataout/yf11ko.pia4c10 Error converting file to netcdf: dataout/yf11ko.pfa4c10 Error converting file to netcdf: dataout/yf11ka.pha4c10 Error converting file to netcdf: dataout/yf11ka.pga4c10 Error converting file to netcdf: dataout/yf11ka.pea4c10 Error converting file to netcdf: dataout/yf11ka.pda4c10 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2212, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2212, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2212, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2212, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2212, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2212, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2212, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2212, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2212, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2212, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2212, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2212, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2212, iMonCtr=1 Model crash detected, will try to restart... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/yf11ko.pja4c10 Error converting file to netcdf: dataout/yf11ko.pia4c10 Error converting file to netcdf: dataout/yf11ko.pfa4c10 Error converting file to netcdf: dataout/yf11ka.pha4c10 Error converting file to netcdf: dataout/yf11ka.pga4c10 Error converting file to netcdf: dataout/yf11ka.pea4c10 Error converting file to netcdf: dataout/yf11ka.pda4c10 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:49:37 (6140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 02:04:44 (7184): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77C53A93 read attempt to address 0x405886F5 Engaging BOINC Windows Runtime Debugger... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5656, selfPID=5656, iMonCtr=1 Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77C53A93 read attempt to address 0x405886F5 Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
13 Dec 2011 01:28:27	1057717	13651708	hadcm3n_yf11_1900_40_007517600_3	518,400	837,048	1.6147
10 Dec 2011 00:03:56	1057717	13651708	hadcm3n_yf11_1900_40_007517600_3	492,480	796,384	1.6171
09 Dec 2011 11:13:16	1057717	13651708	hadcm3n_yf11_1900_40_007517600_3	466,560	756,186	1.6208
08 Dec 2011 06:02:21	1057717	13651708	hadcm3n_yf11_1900_40_007517600_3	440,640	714,566	1.6217
07 Dec 2011 04:44:35	1057717	13651708	hadcm3n_yf11_1900_40_007517600_3	414,720	672,595	1.6218
06 Dec 2011 10:45:31	1057717	13651708	hadcm3n_yf11_1900_40_007517600_3	388,800	629,360	1.6187
05 Dec 2011 13:27:17	1057717	13651708	hadcm3n_yf11_1900_40_007517600_3	362,880	587,234	1.6183
04 Dec 2011 04:28:55	1057717	13651708	hadcm3n_yf11_1900_40_007517600_3	336,960	546,025	1.6204
03 Dec 2011 12:42:09	1057717	13651708	hadcm3n_yf11_1900_40_007517600_3	311,040	503,647	1.6192
02 Dec 2011 08:41:59	1057717	13651708	hadcm3n_yf11_1900_40_007517600_3	285,120	461,910	1.6201
01 Dec 2011 17:53:51	1057717	13651708	hadcm3n_yf11_1900_40_007517600_3	259,200	418,462	1.6144
30 Nov 2011 15:51:08	1057717	13651708	hadcm3n_yf11_1900_40_007517600_3	233,280	375,305	1.6088
30 Nov 2011 01:29:18	1057717	13651708	hadcm3n_yf11_1900_40_007517600_3	207,360	333,393	1.6078
29 Nov 2011 11:26:06	1057717	13651708	hadcm3n_yf11_1900_40_007517600_3	181,440	292,768	1.6136
27 Nov 2011 21:01:21	1057717	13651708	hadcm3n_yf11_1900_40_007517600_3	155,520	253,200	1.6281
27 Nov 2011 06:34:59	1057717	13651708	hadcm3n_yf11_1900_40_007517600_3	129,600	210,287	1.6226
26 Nov 2011 16:26:25	1057717	13651708	hadcm3n_yf11_1900_40_007517600_3	103,680	167,516	1.6157
26 Nov 2011 03:18:11	1057717	13651708	hadcm3n_yf11_1900_40_007517600_3	77,760	124,960	1.6070
25 Nov 2011 12:36:59	1057717	13651708	hadcm3n_yf11_1900_40_007517600_3	51,840	82,687	1.5950
23 Nov 2011 08:17:41	1057717	13651708	hadcm3n_yf11_1900_40_007517600_3	25,920	41,554	1.6032