Task 15972443

Name	hadcm3n_7lkv_1980_40_008439250_0
Workunit	8590106
Created	30 Aug 2013, 8:30:24 UTC
Sent	30 Aug 2013, 8:38:19 UTC
Report deadline	29 Nov 2013, 16:05:30 UTC
Received	1 Nov 2013, 10:49:37 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1245167
Run time	5 days 7 hours 19 min 25 sec
CPU time	5 days 3 hours 52 min 31 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.68 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> (unknown error) - exit code -1073741819 (0xc0000005) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5060, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5060, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3152, iMonCtr=1 Model crash detected, will try to restart... 08:42:55 (1256): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... 14:48:43 (2536): No heartbeat from core client for 30 sec - exiting 14:48:44 (2536): No heartbeat from core client for 30 sec - exiting 14:48:45 (2536): No heartbeat from core client for 30 sec - exiting 14:48:46 (2536): No heartbeat from core client for 30 sec - exiting 14:48:47 (2536): No heartbeat from core client for 30 sec - exiting 14:48:48 (2536): No heartbeat from core client for 30 sec - exiting 14:48:49 (2536): No heartbeat from core client for 30 sec - exiting 14:48:51 (2536): No heartbeat from core client for 30 sec - exiting 14:48:52 (2536): No heartbeat from core client for 30 sec - exiting 14:48:53 (2536): No heartbeat from core client for 30 sec - exiting 14:48:54 (2536): No heartbeat from core client for 30 sec - exiting 14:48:55 (2536): No heartbeat from core client for 30 sec - exiting 14:48:56 (2536): No heartbeat from core client for 30 sec - exiting 14:48:57 (2536): No heartbeat from core client for 30 sec - exiting 14:48:58 (2536): No heartbeat from core client for 30 sec - exiting 14:48:59 (2536): No heartbeat from core client for 30 sec - exiting 14:49:00 (2536): No heartbeat from core client for 30 sec - exiting 14:49:01 (2536): No heartbeat from core client for 30 sec - exiting 14:49:03 (2536): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... 08:28:02 (5016): No heartbeat from core client for 30 sec - exiting 08:28:03 (5016): No heartbeat from core client for 30 sec - exiting 08:28:04 (5016): No heartbeat from core client for 30 sec - exiting 08:28:05 (5016): No heartbeat from core client for 30 sec - exiting 08:28:06 (5016): No heartbeat from core client for 30 sec - exiting 08:28:08 (5016): No heartbeat from core client for 30 sec - exiting 08:28:09 (5016): No heartbeat from core client for 30 sec - exiting 08:28:10 (5016): No heartbeat from core client for 30 sec - exiting 08:28:11 (5016): No heartbeat from core client for 30 sec - exiting 08:28:12 (5016): No heartbeat from core client for 30 sec - exiting 08:28:13 (5016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... 15:19:07 (4548): No heartbeat from core client for 30 sec - exiting 15:19:08 (4548): No heartbeat from core client for 30 sec - exiting 15:19:09 (4548): No heartbeat from core client for 30 sec - exiting 15:19:10 (4548): No heartbeat from core client for 30 sec - exiting 15:19:11 (4548): No heartbeat from core client for 30 sec - exiting 15:19:12 (4548): No heartbeat from core client for 30 sec - exiting 15:19:13 (4548): No heartbeat from core client for 30 sec - exiting 15:19:15 (4548): No heartbeat from core client for 30 sec - exiting 15:19:16 (4548): No heartbeat from core client for 30 sec - exiting 15:19:17 (4548): No heartbeat from core client for 30 sec - exiting 15:19:18 (4548): No heartbeat from core client for 30 sec - exiting 15:19:19 (4548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:39:23 (4684): No heartbeat from core client for 30 sec - exiting 08:39:24 (4684): No heartbeat from core client for 30 sec - exiting 08:39:25 (4684): No heartbeat from core client for 30 sec - exiting 08:39:26 (4684): No heartbeat from core client for 30 sec - exiting 08:39:28 (4684): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:39:29 (4684): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5024, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... 11:06:39 (5984): No heartbeat from core client for 30 sec - exiting 11:06:40 (5984): No heartbeat from core client for 30 sec - exiting 11:06:41 (5984): No heartbeat from core client for 30 sec - exiting 11:06:42 (5984): No heartbeat from core client for 30 sec - exiting 11:06:43 (5984): No heartbeat from core client for 30 sec - exiting 11:06:44 (5984): No heartbeat from core client for 30 sec - exiting 11:06:45 (5984): No heartbeat from core client for 30 sec - exiting 11:06:46 (5984): No heartbeat from core client for 30 sec - exiting 11:06:47 (5984): No heartbeat from core client for 30 sec - exiting 11:06:49 (5984): No heartbeat from core client for 30 sec - exiting 11:06:50 (5984): No heartbeat from core client for 30 sec - exiting 11:06:51 (5984): No heartbeat from core client for 30 sec - exiting 11:06:52 (5984): No heartbeat from core client for 30 sec - exiting 11:06:53 (5984): No heartbeat from core client for 30 sec - exiting 11:06:54 (5984): No heartbeat from core client for 30 sec - exiting 11:06:55 (5984): No heartbeat from core client for 30 sec - exiting 11:06:56 (5984): No heartbeat from core client for 30 sec - exiting 11:06:57 (5984): No heartbeat from core client for 30 sec - exiting 11:06:58 (5984): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... 08:36:08 (3432): No heartbeat from core client for 30 sec - exiting 08:36:09 (3432): No heartbeat from core client for 30 sec - exiting 08:36:10 (3432): No heartbeat from core client for 30 sec - exiting 08:36:11 (3432): No heartbeat from core client for 30 sec - exiting 08:36:12 (3432): No heartbeat from core client for 30 sec - exiting 08:36:14 (3432): No heartbeat from core client for 30 sec - exiting 08:36:15 (3432): No heartbeat from core client for 30 sec - exiting 08:36:16 (3432): No heartbeat from core client for 30 sec - exiting 08:36:17 (3432): No heartbeat from core client for 30 sec - exiting 08:36:18 (3432): No heartbeat from core client for 30 sec - exiting 08:36:19 (3432): No heartbeat from core client for 30 sec - exiting 08:36:20 (3432): No heartbeat from core client for 30 sec - exiting 08:36:21 (3432): No heartbeat from core client for 30 sec - exiting 08:36:22 (3432): No heartbeat from core client for 30 sec - exiting 08:36:23 (3432): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... 09:05:13 (3464): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... 08:32:14 (4932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:54:20 (4768): No heartbeat from core client for 30 sec - exiting 08:54:21 (4768): No heartbeat from core client for 30 sec - exiting 08:54:22 (4768): No heartbeat from core client for 30 sec - exiting 08:54:23 (4768): No heartbeat from core client for 30 sec - exiting 08:54:25 (4768): No heartbeat from core client for 30 sec - exiting 08:54:26 (4768): No heartbeat from core client for 30 sec - exiting 08:54:27 (4768): No heartbeat from core client for 30 sec - exiting 08:54:28 (4768): No heartbeat from core client for 30 sec - exiting 08:54:29 (4768): No heartbeat from core client for 30 sec - exiting 08:54:30 (4768): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... 08:40:09 (5680): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77747B34 read attempt to address 0x41FB7220 Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x777A2DC2 read attempt to address 0x4202E452 Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
31 Oct 2013 16:19:27	1245167	15972443	hadcm3n_7lkv_1980_40_008439250_0	259,200	445,915	1.7204
29 Oct 2013 08:42:49	1245167	15972443	hadcm3n_7lkv_1980_40_008439250_0	233,280	402,082	1.7236
24 Oct 2013 11:21:31	1245167	15972443	hadcm3n_7lkv_1980_40_008439250_0	207,360	356,526	1.7194
18 Oct 2013 09:30:31	1245167	15972443	hadcm3n_7lkv_1980_40_008439250_0	181,440	310,878	1.7134
09 Oct 2013 07:51:56	1245167	15972443	hadcm3n_7lkv_1980_40_008439250_0	155,520	264,826	1.7028
04 Oct 2013 13:24:35	1245167	15972443	hadcm3n_7lkv_1980_40_008439250_0	129,600	219,255	1.6918
02 Oct 2013 10:11:06	1245167	15972443	hadcm3n_7lkv_1980_40_008439250_0	103,680	174,316	1.6813
25 Sep 2013 11:21:39	1245167	15972443	hadcm3n_7lkv_1980_40_008439250_0	77,760	131,644	1.6930
10 Sep 2013 11:25:12	1245167	15972443	hadcm3n_7lkv_1980_40_008439250_0	51,840	88,568	1.7085
05 Sep 2013 14:15:13	1245167	15972443	hadcm3n_7lkv_1980_40_008439250_0	25,920	44,992	1.7358