Task 14958925

Name	hadcm3n_zmfw_1880_40_008026493_2
Workunit	8181607
Created	20 Jul 2012, 22:50:54 UTC
Sent	20 Jul 2012, 22:51:15 UTC
Report deadline	20 Oct 2012, 6:18:26 UTC
Received	13 Oct 2012, 11:40:17 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1176646
Run time	15 days 22 hours 33 min 25 sec
CPU time	15 days 3 hours 36 min 10 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	2.33 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> - exit code -1073741819 (0xc0000005) </message> <stderr_txt> Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5880, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3744, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3664, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3976, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4012, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3848, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3988, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3700, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3824, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3672, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3640, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3840, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3724, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4016, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3796, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3872, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2428, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3732, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3892, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3860, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3284, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3788, iMonCtr=1 Model crash detected, will try to restart... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/zmfwko.pj96c10 Error converting file to netcdf: dataout/zmfwko.pi96c10 Error converting file to netcdf: dataout/zmfwko.pf96c10 Error converting file to netcdf: dataout/zmfwka.ph96c10 Error converting file to netcdf: dataout/zmfwka.pg96c10 Error converting file to netcdf: dataout/zmfwka.pe96c10 Error converting file to netcdf: dataout/zmfwka.pd96c10 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3104, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2192, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2260, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3256, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3844, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3960, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3828, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3796, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3948, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2888, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2604, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3708, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3936, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1308, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2316, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3928, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3728, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3968, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3996, iMonCtr=1 Model crash detected, will try to restart... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x779959C7 read attempt to address 0x00000000 Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x772EB92E read attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
07 Oct 2012 11:20:28	1176646	14958925	hadcm3n_zmfw_1880_40_008026493_2	777,600	1,301,695	1.6740
29 Sep 2012 23:14:35	1176646	14958925	hadcm3n_zmfw_1880_40_008026493_2	751,680	1,252,922	1.6668
23 Sep 2012 14:02:19	1176646	14958925	hadcm3n_zmfw_1880_40_008026493_2	725,760	1,206,947	1.6630
16 Sep 2012 21:07:06	1176646	14958925	hadcm3n_zmfw_1880_40_008026493_2	699,840	1,152,071	1.6462
15 Sep 2012 22:42:03	1176646	14958925	hadcm3n_zmfw_1880_40_008026493_2	673,920	1,104,426	1.6388
14 Sep 2012 18:51:23	1176646	14958925	hadcm3n_zmfw_1880_40_008026493_2	648,000	1,056,681	1.6307
09 Sep 2012 20:58:48	1176646	14958925	hadcm3n_zmfw_1880_40_008026493_2	622,080	1,013,512	1.6292
08 Sep 2012 13:27:48	1176646	14958925	hadcm3n_zmfw_1880_40_008026493_2	596,160	971,628	1.6298
07 Sep 2012 08:59:56	1176646	14958925	hadcm3n_zmfw_1880_40_008026493_2	570,240	929,888	1.6307
05 Sep 2012 08:25:25	1176646	14958925	hadcm3n_zmfw_1880_40_008026493_2	544,320	888,145	1.6317
03 Sep 2012 19:56:23	1176646	14958925	hadcm3n_zmfw_1880_40_008026493_2	518,400	844,955	1.6299
02 Sep 2012 13:46:43	1176646	14958925	hadcm3n_zmfw_1880_40_008026493_2	492,480	801,465	1.6274
01 Sep 2012 14:56:38	1176646	14958925	hadcm3n_zmfw_1880_40_008026493_2	466,560	758,129	1.6249
31 Aug 2012 18:39:01	1176646	14958925	hadcm3n_zmfw_1880_40_008026493_2	440,640	715,207	1.6231
26 Aug 2012 22:08:44	1176646	14958925	hadcm3n_zmfw_1880_40_008026493_2	414,720	673,115	1.6231
26 Aug 2012 09:40:25	1176646	14958925	hadcm3n_zmfw_1880_40_008026493_2	388,800	630,430	1.6215
25 Aug 2012 11:15:15	1176646	14958925	hadcm3n_zmfw_1880_40_008026493_2	362,880	586,099	1.6151
22 Aug 2012 20:53:23	1176646	14958925	hadcm3n_zmfw_1880_40_008026493_2	336,960	543,262	1.6122
19 Aug 2012 20:41:41	1176646	14958925	hadcm3n_zmfw_1880_40_008026493_2	311,040	502,108	1.6143
08 Aug 2012 18:15:36	1176646	14958925	hadcm3n_zmfw_1880_40_008026493_2	285,120	460,624	1.6155