Task 15782195

Name	hadcm3n_4g4g_1940_40_008302839_4
Workunit	8453974
Created	14 May 2013, 0:26:24 UTC
Sent	14 May 2013, 0:26:33 UTC
Report deadline	13 Aug 2013, 7:53:44 UTC
Received	19 Jul 2013, 15:38:20 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1169946
Run time	7 days 18 hours 55 min 44 sec
CPU time	7 days 9 hours 1 min 17 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	3.29 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> - exit code -1073741819 (0xc0000005) </message> <stderr_txt> 19:55:18 (6184): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6708, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2140, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4628, iMonCtr=1 Model crash detected, will try to restart... 21:03:22 (6472): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:43:39 (5712): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:31:40 (5644): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:59:23 (5484): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:11:32 (3256): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6808, iMonCtr=1 Model crash detected, will try to restart... 10:32:49 (4904): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:52:22 (6588): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:59:00 (3432): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:42:26 (5168): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:27:38 (504): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:23:39 (3420): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:59:24 (6080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:35:03 (6408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:32:12 (5992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2412, iMonCtr=1 Model crash detected, will try to restart... 08:06:25 (5160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:26:52 (6036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:44:25 (5056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5952, iMonCtr=1 Model crash detected, will try to restart... 20:56:07 (5084): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:57:08 (4972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:21:32 (6696): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:25:48 (7384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... C14:13:43 (6060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:22:48 (3644): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:47:09 (5832): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:56:33 (5656): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:26:34 (5136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:44:41 (5404): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:58:08 (5388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:27:00 (7016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4984, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5604, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4212, iMonCtr=1 Model crash detected, will try to restart... 21:26:12 (1376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:07:44 (3800): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:33:04 (5492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:47:19 (6528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1836, iMonCtr=1 Model crash detected, will try to restart... 10:27:04 (5688): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:10:44 (7036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:56:47 (2136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:47:45 (5512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:11:53 (4700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:37:53 (6948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:38:02 (5620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:30:33 (5596): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:48:43 (4388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:19:06 (5864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:01:20 (4984): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:20:44 (6120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5796, iMonCtr=1 Model crash detected, will try to restart... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x772B331F read attempt to address 0x00000004 Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77643AB3 read attempt to address 0x3F42F1A8 Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
23 Jul 2013 19:54:24	1169946	15782195	hadcm3n_4g4g_1940_40_008302839_4	518,400	624,156	1.2040
23 Jul 2013 19:54:24	1169946	15782195	hadcm3n_4g4g_1940_40_008302839_4	492,480	592,681	1.2035
23 Jul 2013 19:54:24	1169946	15782195	hadcm3n_4g4g_1940_40_008302839_4	466,560	560,897	1.2022
08 Jul 2013 03:26:11	1169946	15782195	hadcm3n_4g4g_1940_40_008302839_4	440,640	529,228	1.2010
07 Jul 2013 06:00:32	1169946	15782195	hadcm3n_4g4g_1940_40_008302839_4	414,720	497,961	1.2007
06 Jul 2013 20:24:35	1169946	15782195	hadcm3n_4g4g_1940_40_008302839_4	388,800	466,378	1.1995
06 Jul 2013 05:28:20	1169946	15782195	hadcm3n_4g4g_1940_40_008302839_4	362,880	434,432	1.1972
04 Jul 2013 14:10:57	1169946	15782195	hadcm3n_4g4g_1940_40_008302839_4	336,960	402,871	1.1956
26 Jun 2013 04:47:51	1169946	15782195	hadcm3n_4g4g_1940_40_008302839_4	311,040	371,354	1.1939
24 Jun 2013 03:37:42	1169946	15782195	hadcm3n_4g4g_1940_40_008302839_4	285,120	340,342	1.1937
23 Jun 2013 03:19:24	1169946	15782195	hadcm3n_4g4g_1940_40_008302839_4	259,200	310,724	1.1988
20 Jun 2013 06:06:49	1169946	15782195	hadcm3n_4g4g_1940_40_008302839_4	233,280	279,425	1.1978
07 Jun 2013 03:58:24	1169946	15782195	hadcm3n_4g4g_1940_40_008302839_4	207,360	247,900	1.1955
03 Jun 2013 03:34:27	1169946	15782195	hadcm3n_4g4g_1940_40_008302839_4	181,440	216,951	1.1957
01 Jun 2013 17:17:26	1169946	15782195	hadcm3n_4g4g_1940_40_008302839_4	155,520	186,411	1.1986
28 May 2013 18:55:22	1169946	15782195	hadcm3n_4g4g_1940_40_008302839_4	129,600	155,829	1.2024
24 May 2013 13:19:21	1169946	15782195	hadcm3n_4g4g_1940_40_008302839_4	103,680	126,181	1.2170
24 May 2013 05:11:43	1169946	15782195	hadcm3n_4g4g_1940_40_008302839_4	77,760	95,379	1.2266
21 May 2013 03:56:14	1169946	15782195	hadcm3n_4g4g_1940_40_008302839_4	51,840	64,339	1.2411
16 May 2013 15:50:12	1169946	15782195	hadcm3n_4g4g_1940_40_008302839_4	25,920	32,509	1.2542