Task 13388950

Name	hadcm3n_o6si_1940_40_007448540_2
Workunit	7646043
Created	15 Sep 2011, 6:27:53 UTC
Sent	15 Sep 2011, 6:32:07 UTC
Report deadline	15 Dec 2011, 13:59:18 UTC
Received	4 Nov 2011, 1:03:28 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1102379
Run time	17 days 16 hours 36 min 27 sec
CPU time	16 days 20 hours 39 min 53 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	2.91 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.60</core_client_version> <![CDATA[ <message> - exit code -1073741819 (0xc0000005) </message> <stderr_txt> Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3764, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4100, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3444, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3452, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3528, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3440, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3392, iMonCtr=1 Model crash detected, will try to restart... 00:01:47 (3752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:02:47 (1336): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:15:01 (3772): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:53:52 (3500): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:54:52 (2564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:01:57 (3856): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:02:34 (3148): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:27:04 (4764): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:46:59 (3708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:48:43 (3632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:49:43 (2744): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5092, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3552, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3956, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4052, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3704, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3932, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3676, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77573A93 read attempt to address 0x40D1E779 Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77D93A93 read attempt to address 0x40D1E779 Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
03 Nov 2011 08:13:02	1102379	13388950	hadcm3n_o6si_1940_40_007448540_2	777,600	1,451,798	1.8670
02 Nov 2011 03:49:24	1102379	13388950	hadcm3n_o6si_1940_40_007448540_2	751,680	1,405,412	1.8697
01 Nov 2011 05:19:24	1102379	13388950	hadcm3n_o6si_1940_40_007448540_2	725,760	1,357,973	1.8711
31 Oct 2011 19:31:31	1102379	13388950	hadcm3n_o6si_1940_40_007448540_2	699,840	1,311,917	1.8746
31 Oct 2011 17:17:59	1102379	13388950	hadcm3n_o6si_1940_40_007448540_2	673,920	1,266,010	1.8786
31 Oct 2011 16:33:59	1102379	13388950	hadcm3n_o6si_1940_40_007448540_2	648,000	1,218,774	1.8808
31 Oct 2011 16:33:59	1102379	13388950	hadcm3n_o6si_1940_40_007448540_2	622,080	1,169,402	1.8798
19 Oct 2011 03:14:30	1102379	13388950	hadcm3n_o6si_1940_40_007448540_2	596,160	1,120,185	1.8790
17 Oct 2011 21:35:35	1102379	13388950	hadcm3n_o6si_1940_40_007448540_2	570,240	1,071,074	1.8783
17 Oct 2011 07:09:31	1102379	13388950	hadcm3n_o6si_1940_40_007448540_2	544,320	1,021,902	1.8774
15 Oct 2011 20:30:28	1102379	13388950	hadcm3n_o6si_1940_40_007448540_2	518,400	972,692	1.8763
14 Oct 2011 05:41:36	1102379	13388950	hadcm3n_o6si_1940_40_007448540_2	492,480	923,552	1.8753
13 Oct 2011 07:07:39	1102379	13388950	hadcm3n_o6si_1940_40_007448540_2	466,560	874,742	1.8749
12 Oct 2011 06:53:34	1102379	13388950	hadcm3n_o6si_1940_40_007448540_2	440,640	826,308	1.8752
11 Oct 2011 08:15:46	1102379	13388950	hadcm3n_o6si_1940_40_007448540_2	414,720	777,062	1.8737
09 Oct 2011 18:49:46	1102379	13388950	hadcm3n_o6si_1940_40_007448540_2	388,800	727,891	1.8721
06 Oct 2011 10:04:33	1102379	13388950	hadcm3n_o6si_1940_40_007448540_2	362,880	678,768	1.8705
05 Oct 2011 23:54:43	1102379	13388950	hadcm3n_o6si_1940_40_007448540_2	336,960	629,597	1.8685
05 Oct 2011 00:06:14	1102379	13388950	hadcm3n_o6si_1940_40_007448540_2	311,040	580,565	1.8665
03 Oct 2011 19:58:47	1102379	13388950	hadcm3n_o6si_1940_40_007448540_2	285,120	531,159	1.8629