Task 13512427

Name	hadcm3n_t5te_1940_40_007448333_2
Workunit	7645836
Created	19 Oct 2011, 1:31:33 UTC
Sent	19 Oct 2011, 1:31:48 UTC
Report deadline	18 Jan 2012, 8:58:59 UTC
Received	5 Nov 2011, 1:33:30 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1176129
Run time	12 days 14 hours 20 min 12 sec
CPU time	7 days 16 hours 34 min 12 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.02 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> - exit code -1073741819 (0xc0000005) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:46:38 (1216): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 10:46:39 (1216): No heartbeat from core client for 30 sec - exiting 10:46:40 (1216): No heartbeat from core client for 30 sec - exiting 10:46:41 (1216): No heartbeat from core client for 30 sec - exiting 10:46:42 (1216): No heartbeat from core client for 30 sec - exiting 10:46:43 (1216): No heartbeat from core client for 30 sec - exiting 10:46:44 (1216): No heartbeat from core client for 30 sec - exiting 10:46:45 (1216): No heartbeat from core client for 30 sec - exiting 10:46:46 (1216): No heartbeat from core client for 30 sec - exiting 10:46:47 (1216): No heartbeat from core client for 30 sec - exiting 10:46:48 (1216): No heartbeat from core client for 30 sec - exiting 10:46:49 (1216): No heartbeat from core client for 30 sec - exiting 10:46:50 (1216): No heartbeat from core client for 30 sec - exiting 10:46:51 (1216): No heartbeat from core client for 30 sec - exiting 10:46:52 (1216): No heartbeat from core client for 30 sec - exiting 10:46:53 (1216): No heartbeat from core client for 30 sec - exiting 10:46:54 (1216): No heartbeat from core client for 30 sec - exiting 10:46:55 (1216): No heartbeat from core client for 30 sec - exiting 10:46:56 (1216): No heartbeat from core client for 30 sec - exiting 10:46:57 (1216): No heartbeat from core client for 30 sec - exiting 10:46:58 (1216): No heartbeat from core client for 30 sec - exiting 10:46:59 (1216): No heartbeat from core client for 30 sec - exiting 10:47:00 (1216): No heartbeat from core client for 30 sec - exiting 10:47:01 (1216): No heartbeat from core client for 30 sec - exiting 10:47:02 (1216): No heartbeat from core client for 30 sec - exiting 10:47:03 (1216): No heartbeat from core client for 30 sec - exiting 10:47:04 (1216): No heartbeat from core client for 30 sec - exiting 10:47:05 (1216): No heartbeat from core client for 30 sec - exiting 10:47:06 (1216): No heartbeat from core client for 30 sec - exiting 10:47:07 (1216): No heartbeat from core client for 30 sec - exiting 10:47:08 (1216): No heartbeat from core client for 30 sec - exiting 10:47:09 (1216): No heartbeat from core client for 30 sec - exiting 10:47:10 (1216): No heartbeat from core client for 30 sec - exiting 10:47:11 (1216): No heartbeat from core client for 30 sec - exiting 10:47:12 (1216): No heartbeat from core client for 30 sec - exiting 10:47:13 (1216): No heartbeat from core client for 30 sec - exiting 10:47:14 (1216): No heartbeat from core client for 30 sec - exiting 10:47:15 (1216): No heartbeat from core client for 30 sec - exiting 10:47:16 (1216): No heartbeat from core client for 30 sec - exiting 10:47:17 (1216): No heartbeat from core client for 30 sec - exiting 10:47:18 (1216): No heartbeat from core client for 30 sec - exiting 10:47:19 (1216): No heartbeat from core client for 30 sec - exiting 10:47:20 (1216): No heartbeat from core client for 30 sec - exiting 10:47:21 (1216): No heartbeat from core client for 30 sec - exiting 10:47:22 (1216): No heartbeat from core client for 30 sec - exiting 10:47:23 (1216): No heartbeat from core client for 30 sec - exiting 10:47:24 (1216): No heartbeat from core client for 30 sec - exiting 10:47:25 (1216): No heartbeat from core client for 30 sec - exiting 10:47:26 (1216): No heartbeat from core client for 30 sec - exiting 10:47:27 (1216): No heartbeat from core client for 30 sec - exiting 10:47:28 (1216): No heartbeat from core client for 30 sec - exiting 10:47:29 (1216): No heartbeat from core client for 30 sec - exiting 10:47:30 (1216): No heartbeat from core client for 30 sec - exiting 10:47:31 (1216): No heartbeat from core client for 30 sec - exiting 10:47:32 (1216): No heartbeat from core client for 30 sec - exiting 10:47:33 (1216): No heartbeat from core client for 30 sec - exiting 10:47:34 (1216): No heartbeat from core client for 30 sec - exiting 10:47:35 (1216): No heartbeat from core client for 30 sec - exiting 10:47:36 (1216): No heartbeat from core client for 30 sec - exiting 10:47:37 (1216): No heartbeat from core client for 30 sec - exiting 10:47:38 (1216): No heartbeat from core client for 30 sec - exiting 10:47:39 (1216): No heartbeat from core client for 30 sec - exiting 10:47:40 (1216): No heartbeat from core client for 30 sec - exiting 10:47:41 (1216): No heartbeat from core client for 30 sec - exiting 10:47:42 (1216): No heartbeat from core client for 30 sec - exiting 10:47:43 (1216): No heartbeat from core client for 30 sec - exiting 10:47:44 (1216): No heartbeat from core client for 30 sec - exiting 10:47:45 (1216): No heartbeat from core client for 30 sec - exiting 10:47:46 (1216): No heartbeat from core client for 30 sec - exiting 10:47:47 (1216): No heartbeat from core client for 30 sec - exiting 10:47:48 (1216): No heartbeat from core client for 30 sec - exiting 10:47:49 (1216): No heartbeat from core client for 30 sec - exiting 10:47:50 (1216): No heartbeat from core client for 30 sec - exiting 10:47:51 (1216): No heartbeat from core client for 30 sec - exiting 10:47:52 (1216): No heartbeat from core client for 30 sec - exiting 10:47:53 (1216): No heartbeat from core client for 30 sec - exiting 10:47:54 (1216): No heartbeat from core client for 30 sec - exiting 10:47:55 (1216): No heartbeat from core client for 30 sec - exiting 10:47:56 (1216): No heartbeat from core client for 30 sec - exiting 10:47:57 (1216): No heartbeat from core client for 30 sec - exiting 10:47:58 (1216): No heartbeat from core client for 30 sec - exiting 10:47:59 (1216): No heartbeat from core client for 30 sec - exiting 10:48:00 (1216): No heartbeat from core client for 30 sec - exiting 10:48:01 (1216): No heartbeat from core client for 30 sec - exiting 10:48:02 (1216): No heartbeat from core client for 30 sec - exiting 10:48:03 (1216): No heartbeat from core client for 30 sec - exiting 10:48:04 (1216): No heartbeat from core client for 30 sec - exiting 10:48:05 (1216): No heartbeat from core client for 30 sec - exiting 10:48:06 (1216): No heartbeat from core client for 30 sec - exiting 10:48:07 (1216): No heartbeat from core client for 30 sec - exiting 10:48:08 (1216): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 01:11:01 (3828): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:59:38 (4220): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:02:31 (4184): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 16:02:32 (4184): No heartbeat from core client for 30 sec - exiting 16:02:33 (4184): No heartbeat from core client for 30 sec - exiting 16:02:34 (4184): No heartbeat from core client for 30 sec - exiting 16:02:35 (4184): No heartbeat from core client for 30 sec - exiting 16:02:36 (4184): No heartbeat from core client for 30 sec - exiting 16:02:37 (4184): No heartbeat from core client for 30 sec - exiting 16:02:38 (4184): No heartbeat from core client for 30 sec - exiting 16:02:39 (4184): No heartbeat from core client for 30 sec - exiting 16:02:40 (4184): No heartbeat from core client for 30 sec - exiting 16:02:41 (4184): No heartbeat from core client for 30 sec - exiting 16:02:42 (4184): No heartbeat from core client for 30 sec - exiting 16:02:43 (4184): No heartbeat from core client for 30 sec - exiting 16:02:44 (4184): No heartbeat from core client for 30 sec - exiting 16:02:45 (4184): No heartbeat from core client for 30 sec - exiting 16:02:46 (4184): No heartbeat from core client for 30 sec - exiting 16:02:47 (4184): No heartbeat from core client for 30 sec - exiting 16:02:48 (4184): No heartbeat from core client for 30 sec - exiting 16:02:49 (4184): No heartbeat from core client for 30 sec - exiting 16:02:50 (4184): No heartbeat from core client for 30 sec - exiting 16:02:51 (4184): No heartbeat from core client for 30 sec - exiting 16:02:52 (4184): No heartbeat from core client for 30 sec - exiting 16:02:53 (4184): No heartbeat from core client for 30 sec - exiting 16:02:54 (4184): No heartbeat from core client for 30 sec - exiting 16:02:55 (4184): No heartbeat from core client for 30 sec - exiting 16:02:56 (4184): No heartbeat from core client for 30 sec - exiting 16:02:57 (4184): No heartbeat from core client for 30 sec - exiting 16:02:58 (4184): No heartbeat from core client for 30 sec - exiting 16:02:59 (4184): No heartbeat from core client for 30 sec - exiting 16:03:00 (4184): No heartbeat from core client for 30 sec - exiting 16:03:01 (4184): No heartbeat from core client for 30 sec - exiting 16:03:02 (4184): No heartbeat from core client for 30 sec - exiting 16:03:03 (4184): No heartbeat from core client for 30 sec - exiting 16:03:04 (4184): No heartbeat from core client for 30 sec - exiting 16:03:05 (4184): No heartbeat from core client for 30 sec - exiting 16:03:06 (4184): No heartbeat from core client for 30 sec - exiting 16:03:07 (4184): No heartbeat from core client for 30 sec - exiting 16:03:08 (4184): No heartbeat from core client for 30 sec - exiting 16:03:09 (4184): No heartbeat from core client for 30 sec - exiting 16:03:10 (4184): No heartbeat from core client for 30 sec - exiting 16:03:11 (4184): No heartbeat from core client for 30 sec - exiting 16:03:12 (4184): No heartbeat from core client for 30 sec - exiting 16:03:13 (4184): No heartbeat from core client for 30 sec - exiting 16:03:14 (4184): No heartbeat from core client for 30 sec - exiting 16:03:15 (4184): No heartbeat from core client for 30 sec - exiting 16:03:16 (4184): No heartbeat from core client for 30 sec - exiting 16:03:17 (4184): No heartbeat from core client for 30 sec - exiting 16:03:18 (4184): No heartbeat from core client for 30 sec - exiting 16:03:19 (4184): No heartbeat from core client for 30 sec - exiting 16:03:20 (4184): No heartbeat from core client for 30 sec - exiting 16:03:21 (4184): No heartbeat from core client for 30 sec - exiting 16:03:22 (4184): No heartbeat from core client for 30 sec - exiting 16:03:23 (4184): No heartbeat from core client for 30 sec - exiting 16:03:24 (4184): No heartbeat from core client for 30 sec - exiting 16:03:25 (4184): No heartbeat from core client for 30 sec - exiting 16:03:26 (4184): No heartbeat from core client for 30 sec - exiting 16:03:27 (4184): No heartbeat from core client for 30 sec - exiting 16:03:28 (4184): No heartbeat from core client for 30 sec - exiting 16:03:29 (4184): No heartbeat from core client for 30 sec - exiting 16:03:30 (4184): No heartbeat from core client for 30 sec - exiting 16:03:31 (4184): No heartbeat from core client for 30 sec - exiting 16:03:32 (4184): No heartbeat from core client for 30 sec - exiting 16:03:33 (4184): No heartbeat from core client for 30 sec - exiting 16:03:34 (4184): No heartbeat from core client for 30 sec - exiting 16:03:35 (4184): No heartbeat from core client for 30 sec - exiting 16:03:36 (4184): No heartbeat from core client for 30 sec - exiting 16:03:37 (4184): No heartbeat from core client for 30 sec - exiting 16:03:38 (4184): No heartbeat from core client for 30 sec - exiting 16:03:39 (4184): No heartbeat from core client for 30 sec - exiting 16:03:40 (4184): No heartbeat from core client for 30 sec - exiting 16:03:41 (4184): No heartbeat from core client for 30 sec - exiting 16:03:42 (4184): No heartbeat from core client for 30 sec - exiting 16:03:43 (4184): No heartbeat from core client for 30 sec - exiting 16:03:44 (4184): No heartbeat from core client for 30 sec - exiting 16:03:45 (4184): No heartbeat from core client for 30 sec - exiting 16:03:46 (4184): No heartbeat from core client for 30 sec - exiting 16:03:47 (4184): No heartbeat from core client for 30 sec - exiting 16:03:48 (4184): No heartbeat from core client for 30 sec - exiting 16:03:49 (4184): No heartbeat from core client for 30 sec - exiting 16:03:50 (4184): No heartbeat from core client for 30 sec - exiting 16:03:51 (4184): No heartbeat from core client for 30 sec - exiting 16:03:52 (4184): No heartbeat from core client for 30 sec - exiting 16:03:53 (4184): No heartbeat from core client for 30 sec - exiting 16:03:54 (4184): No heartbeat from core client for 30 sec - exiting 16:03:55 (4184): No heartbeat from core client for 30 sec - exiting 16:03:56 (4184): No heartbeat from core client for 30 sec - exiting 16:03:57 (4184): No heartbeat from core client for 30 sec - exiting 16:03:58 (4184): No heartbeat from core client for 30 sec - exiting 16:03:59 (4184): No heartbeat from core client for 30 sec - exiting 16:04:00 (4184): No heartbeat from core client for 30 sec - exiting 16:04:01 (4184): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5336, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x771071D3 read attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77BF71D3 read attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
03 Nov 2011 14:43:29	1176129	13512427	hadcm3n_t5te_1940_40_007448333_2	259,200	611,333	2.3585
01 Nov 2011 22:57:35	1176129	13512427	hadcm3n_t5te_1940_40_007448333_2	233,280	548,034	2.3493
31 Oct 2011 19:46:02	1176129	13512427	hadcm3n_t5te_1940_40_007448333_2	207,360	483,445	2.3314
31 Oct 2011 18:59:03	1176129	13512427	hadcm3n_t5te_1940_40_007448333_2	181,440	420,527	2.3177
31 Oct 2011 18:31:42	1176129	13512427	hadcm3n_t5te_1940_40_007448333_2	155,520	362,820	2.3329
31 Oct 2011 17:16:28	1176129	13512427	hadcm3n_t5te_1940_40_007448333_2	129,600	302,547	2.3345
31 Oct 2011 15:52:46	1176129	13512427	hadcm3n_t5te_1940_40_007448333_2	103,680	238,542	2.3008
31 Oct 2011 15:16:45	1176129	13512427	hadcm3n_t5te_1940_40_007448333_2	77,760	178,053	2.2898
31 Oct 2011 15:16:45	1176129	13512427	hadcm3n_t5te_1940_40_007448333_2	51,840	121,318	2.3402
31 Oct 2011 15:16:45	1176129	13512427	hadcm3n_t5te_1940_40_007448333_2	25,920	61,440	2.3704