Task 13558182

Name	hadcm3n_yhd2_1900_40_007526212_1
Workunit	7723687
Created	28 Oct 2011, 13:44:48 UTC
Sent	29 Oct 2011, 17:32:40 UTC
Report deadline	29 Jan 2012, 0:59:51 UTC
Received	20 Nov 2011, 17:57:54 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1116570
Run time	6 days 6 hours 43 min
CPU time	5 days 23 hours 59 min 54 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.64 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> - exit code -1073741819 (0xc0000005) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... 17:16:58 (3816): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:57:34 (5184): No heartbeat from core client for 30 sec - exiting 07:57:35 (5184): No heartbeat from core client for 30 sec - exiting 07:57:36 (5184): No heartbeat from core client for 30 sec - exiting 07:57:37 (5184): No heartbeat from core client for 30 sec - exiting 07:57:38 (5184): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3764, iMonCtr=1 Model crash detected, will try to restart... 17:40:49 (3324): No heartbeat from core client for 30 sec - exiting 17:40:51 (3324): No heartbeat from core client for 30 sec - exiting 17:40:52 (3324): No heartbeat from core client for 30 sec - exiting 17:40:53 (3324): No heartbeat from core client for 30 sec - exiting 17:40:54 (3324): No heartbeat from core client for 30 sec - exiting 17:40:55 (3324): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3500, iMonCtr=1 Model crash detected, will try to restart... 17:25:30 (5232): No heartbeat from core client for 30 sec - exiting 17:25:31 (5232): No heartbeat from core client for 30 sec - exiting 17:25:32 (5232): No heartbeat from core client for 30 sec - exiting 17:25:33 (5232): No heartbeat from core client for 30 sec - exiting 17:25:34 (5232): No heartbeat from core client for 30 sec - exiting 17:25:35 (5232): No heartbeat from core client for 30 sec - exiting 17:25:37 (5232): No heartbeat from core client for 30 sec - exiting 17:25:38 (5232): No heartbeat from core client for 30 sec - exiting 17:25:39 (5232): No heartbeat from core client for 30 sec - exiting 17:25:40 (5232): No heartbeat from core client for 30 sec - exiting 17:25:41 (5232): No heartbeat from core client for 30 sec - exiting 17:25:42 (5232): No heartbeat from core client for 30 sec - exiting 17:25:43 (5232): No heartbeat from core client for 30 sec - exiting 17:25:44 (5232): No heartbeat from core client for 30 sec - exiting 17:25:45 (5232): No heartbeat from core client for 30 sec - exiting 17:25:46 (5232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4560, iMonCtr=1 Model crash detected, will try to restart... 07:50:10 (3276): No heartbeat from core client for 30 sec - exiting 07:50:11 (3276): No heartbeat from core client for 30 sec - exiting 07:50:12 (3276): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:53:07 (1880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5628, iMonCtr=1 Model crash detected, will try to restart... 08:26:40 (5180): No heartbeat from core client for 30 sec - exiting 08:26:41 (5180): No heartbeat from core client for 30 sec - exiting 08:26:42 (5180): No heartbeat from core client for 30 sec - exiting 08:26:43 (5180): No heartbeat from core client for 30 sec - exiting 08:26:45 (5180): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3196, iMonCtr=1 Model crash detected, will try to restart... 17:47:16 (5528): No heartbeat from core client for 30 sec - exiting 17:47:17 (5528): No heartbeat from core client for 30 sec - exiting 17:47:18 (5528): No heartbeat from core client for 30 sec - exiting 17:47:19 (5528): No heartbeat from core client for 30 sec - exiting 17:47:20 (5528): No heartbeat from core client for 30 sec - exiting 17:47:21 (5528): No heartbeat from core client for 30 sec - exiting 17:47:23 (5528): No heartbeat from core client for 30 sec - exiting 17:47:24 (5528): No heartbeat from core client for 30 sec - exiting 17:47:25 (5528): No heartbeat from core client for 30 sec - exiting 17:47:26 (5528): No heartbeat from core client for 30 sec - exiting 17:47:27 (5528): No heartbeat from core client for 30 sec - exiting 17:47:28 (5528): No heartbeat from core client for 30 sec - exiting 17:47:29 (5528): No heartbeat from core client for 30 sec - exiting 17:47:30 (5528): No heartbeat from core client for 30 sec - exiting 17:47:31 (5528): No heartbeat from core client for 30 sec - exiting 17:47:32 (5528): No heartbeat from core client for 30 sec - exiting 17:47:33 (5528): No heartbeat from core client for 30 sec - exiting 17:47:35 (5528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:47:36 (5528): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2820, iMonCtr=1 Model crash detected, will try to restart... 17:34:34 (4060): No heartbeat from core client for 30 sec - exiting 17:34:35 (4060): No heartbeat from core client for 30 sec - exiting 17:34:36 (4060): No heartbeat from core client for 30 sec - exiting 17:34:37 (4060): No heartbeat from core client for 30 sec - exiting 17:34:38 (4060): No heartbeat from core client for 30 sec - exiting 17:34:39 (4060): No heartbeat from core client for 30 sec - exiting 17:34:40 (4060): No heartbeat from core client for 30 sec - exiting 17:34:41 (4060): No heartbeat from core client for 30 sec - exiting 17:34:42 (4060): No heartbeat from core client for 30 sec - exiting 17:34:44 (4060): No heartbeat from core client for 30 sec - exiting 17:34:45 (4060): No heartbeat from core client for 30 sec - exiting 17:34:46 (4060): No heartbeat from core client for 30 sec - exiting 17:34:47 (4060): No heartbeat from core client for 30 sec - exiting 17:34:48 (4060): No heartbeat from core client for 30 sec - exiting 17:34:49 (4060): No heartbeat from core client for 30 sec - exiting 17:34:50 (4060): No heartbeat from core client for 30 sec - exiting 17:34:51 (4060): No heartbeat from core client for 30 sec - exiting 17:34:52 (4060): No heartbeat from core client for 30 sec - exiting 17:34:53 (4060): No heartbeat from core client for 30 sec - exiting 17:34:54 (4060): No heartbeat from core client for 30 sec - exiting 17:34:56 (4060): No heartbeat from core client for 30 sec - exiting 17:34:57 (4060): No heartbeat from core client for 30 sec - exiting 17:34:58 (4060): No heartbeat from core client for 30 sec - exiting 17:34:59 (4060): No heartbeat from core client for 30 sec - exiting 17:35:00 (4060): No heartbeat from core client for 30 sec - exiting 17:35:01 (4060): No heartbeat from core client for 30 sec - exiting 17:35:02 (4060): No heartbeat from core client for 30 sec - exiting 17:35:03 (4060): No heartbeat from core client for 30 sec - exiting 17:35:04 (4060): No heartbeat from core client for 30 sec - exiting 17:35:05 (4060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5012, iMonCtr=1 Model crash detected, will try to restart... 17:45:41 (5092): No heartbeat from core client for 30 sec - exiting 17:45:42 (5092): No heartbeat from core client for 30 sec - exiting 17:45:43 (5092): No heartbeat from core client for 30 sec - exiting 17:45:44 (5092): No heartbeat from core client for 30 sec - exiting 17:45:45 (5092): No heartbeat from core client for 30 sec - exiting 17:45:46 (5092): No heartbeat from core client for 30 sec - exiting 17:45:48 (5092): No heartbeat from core client for 30 sec - exiting 17:45:49 (5092): No heartbeat from core client for 30 sec - exiting 17:45:50 (5092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4312, iMonCtr=1 Model crash detected, will try to restart... 20:12:33 (5792): No heartbeat from core client for 30 sec - exiting 20:12:34 (5792): No heartbeat from core client for 30 sec - exiting 20:12:35 (5792): No heartbeat from core client for 30 sec - exiting 20:12:36 (5792): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:03:46 (3204): No heartbeat from core client for 30 sec - exiting 18:03:47 (3204): No heartbeat from core client for 30 sec - exiting 18:03:48 (3204): No heartbeat from core client for 30 sec - exiting 18:03:49 (3204): No heartbeat from core client for 30 sec - exiting 18:03:50 (3204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2512, iMonCtr=1 Model crash detected, will try to restart... 17:43:44 (3908): No heartbeat from core client for 30 sec - exiting 17:43:45 (3908): No heartbeat from core client for 30 sec - exiting 17:43:46 (3908): No heartbeat from core client for 30 sec - exiting 17:43:47 (3908): No heartbeat from core client for 30 sec - exiting 17:43:48 (3908): No heartbeat from core client for 30 sec - exiting 17:43:49 (3908): No heartbeat from core client for 30 sec - exiting 17:43:50 (3908): No heartbeat from core client for 30 sec - exiting 17:43:51 (3908): No heartbeat from core client for 30 sec - exiting 17:43:52 (3908): No heartbeat from core client for 30 sec - exiting 17:43:53 (3908): No heartbeat from core client for 30 sec - exiting 17:43:54 (3908): No heartbeat from core client for 30 sec - exiting 17:43:56 (3908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:57:09 (3008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:26:13 (4864): No heartbeat from core client for 30 sec - exiting 08:26:14 (4864): No heartbeat from core client for 30 sec - exiting 08:26:15 (4864): No heartbeat from core client for 30 sec - exiting 08:26:16 (4864): No heartbeat from core client for 30 sec - exiting 08:26:18 (4864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:30:39 (2944): No heartbeat from core client for 30 sec - exiting 08:30:40 (2944): No heartbeat from core client for 30 sec - exiting 08:30:41 (2944): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:31:33 (3400): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77C75F1B read attempt to address 0x4300A58B Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
20 Nov 2011 16:59:41	1116570	13558182	hadcm3n_yhd2_1900_40_007526212_1	259,200	518,379	1.9999
19 Nov 2011 17:31:18	1116570	13558182	hadcm3n_yhd2_1900_40_007526212_1	233,280	465,126	1.9939
17 Nov 2011 19:54:34	1116570	13558182	hadcm3n_yhd2_1900_40_007526212_1	207,360	412,681	1.9902
15 Nov 2011 18:24:25	1116570	13558182	hadcm3n_yhd2_1900_40_007526212_1	181,440	360,833	1.9887
08 Nov 2011 19:34:50	1116570	13558182	hadcm3n_yhd2_1900_40_007526212_1	155,520	309,182	1.9881
06 Nov 2011 12:56:27	1116570	13558182	hadcm3n_yhd2_1900_40_007526212_1	129,600	258,535	1.9949
05 Nov 2011 14:16:01	1116570	13558182	hadcm3n_yhd2_1900_40_007526212_1	103,680	206,858	1.9952
03 Nov 2011 19:15:05	1116570	13558182	hadcm3n_yhd2_1900_40_007526212_1	77,760	155,349	1.9978
01 Nov 2011 12:13:18	1116570	13558182	hadcm3n_yhd2_1900_40_007526212_1	51,840	102,438	1.9760
31 Oct 2011 19:17:00	1116570	13558182	hadcm3n_yhd2_1900_40_007526212_1	25,920	50,669	1.9548