Task 13315361

Name	hadcm3n_yawq_1940_40_007432073_1
Workunit	7629576
Created	30 Aug 2011, 9:34:14 UTC
Sent	30 Aug 2011, 9:34:21 UTC
Report deadline	29 Nov 2011, 17:01:32 UTC
Received	2 Oct 2011, 16:56:34 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1129647
Run time	10 days 18 hours 6 min 16 sec
CPU time	10 days 2 hours 32 min 42 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	3.14 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> - exit code -1073741819 (0xc0000005) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 05:40:41 (5132): No heartbeat from core client for 30 sec - exiting 05:40:42 (5132): No heartbeat from core client for 30 sec - exiting 05:40:43 (5132): No heartbeat from core client for 30 sec - exiting 05:40:44 (5132): No heartbeat from core client for 30 sec - exiting 05:40:45 (5132): No heartbeat from core client for 30 sec - exiting 05:40:46 (5132): No heartbeat from core client for 30 sec - exiting 05:40:47 (5132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:40:48 (5132): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:38:02 (5208): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5624, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 05:37:32 (5024): No heartbeat from core client for 30 sec - exiting 05:37:33 (5024): No heartbeat from core client for 30 sec - exiting 05:37:34 (5024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:39:08 (2708): No heartbeat from core client for 30 sec - exiting 05:39:10 (2708): No heartbeat from core client for 30 sec - exiting 05:39:11 (2708): No heartbeat from core client for 30 sec - exiting 05:39:12 (2708): No heartbeat from core client for 30 sec - exiting 05:39:13 (2708): No heartbeat from core client for 30 sec - exiting 05:39:14 (2708): No heartbeat from core client for 30 sec - exiting 05:39:15 (2708): No heartbeat from core client for 30 sec - exiting 05:39:16 (2708): No heartbeat from core client for 30 sec - exiting 05:39:17 (2708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3520, iMonCtr=1 Model crash detected, will try to restart... 05:38:17 (9196): No heartbeat from core client for 30 sec - exiting 05:38:18 (9196): No heartbeat from core client for 30 sec - exiting 05:38:19 (9196): No heartbeat from core client for 30 sec - exiting 05:38:20 (9196): No heartbeat from core client for 30 sec - exiting 05:38:21 (9196): No heartbeat from core client for 30 sec - exiting 05:38:22 (9196): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:31:08 (4456): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:54:23 (4744): No heartbeat from core client for 30 sec - exiting 06:54:25 (4744): No heartbeat from core client for 30 sec - exiting 06:54:26 (4744): No heartbeat from core client for 30 sec - exiting 06:54:27 (4744): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Signal 11 received, exiting... Called boinc_finish Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x775E3740 read attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
02 Oct 2011 12:08:29	1129647	13315361	hadcm3n_yawq_1940_40_007432073_1	518,400	873,158	1.6843
01 Oct 2011 13:38:00	1129647	13315361	hadcm3n_yawq_1940_40_007432073_1	492,480	826,375	1.6780
29 Sep 2011 23:32:24	1129647	13315361	hadcm3n_yawq_1940_40_007432073_1	466,560	780,741	1.6734
27 Sep 2011 23:17:26	1129647	13315361	hadcm3n_yawq_1940_40_007432073_1	440,640	734,264	1.6664
26 Sep 2011 00:03:56	1129647	13315361	hadcm3n_yawq_1940_40_007432073_1	414,720	689,817	1.6633
25 Sep 2011 10:57:06	1129647	13315361	hadcm3n_yawq_1940_40_007432073_1	388,800	643,636	1.6554
24 Sep 2011 20:50:26	1129647	13315361	hadcm3n_yawq_1940_40_007432073_1	362,880	598,353	1.6489
24 Sep 2011 07:00:29	1129647	13315361	hadcm3n_yawq_1940_40_007432073_1	336,960	551,711	1.6373
23 Sep 2011 17:07:30	1129647	13315361	hadcm3n_yawq_1940_40_007432073_1	311,040	505,261	1.6244
23 Sep 2011 02:56:25	1129647	13315361	hadcm3n_yawq_1940_40_007432073_1	285,120	458,260	1.6073
21 Sep 2011 02:02:24	1129647	13315361	hadcm3n_yawq_1940_40_007432073_1	259,200	410,474	1.5836
18 Sep 2011 22:35:24	1129647	13315361	hadcm3n_yawq_1940_40_007432073_1	233,280	364,397	1.5621
17 Sep 2011 21:27:42	1129647	13315361	hadcm3n_yawq_1940_40_007432073_1	207,360	320,597	1.5461
15 Sep 2011 23:46:25	1129647	13315361	hadcm3n_yawq_1940_40_007432073_1	181,440	275,896	1.5206
11 Sep 2011 13:32:45	1129647	13315361	hadcm3n_yawq_1940_40_007432073_1	155,520	230,193	1.4802
10 Sep 2011 17:19:43	1129647	13315361	hadcm3n_yawq_1940_40_007432073_1	129,600	190,951	1.4734
09 Sep 2011 22:40:36	1129647	13315361	hadcm3n_yawq_1940_40_007432073_1	103,680	156,266	1.5072
09 Sep 2011 06:42:39	1129647	13315361	hadcm3n_yawq_1940_40_007432073_1	77,760	121,592	1.5637
04 Sep 2011 21:15:04	1129647	13315361	hadcm3n_yawq_1940_40_007432073_1	51,840	76,171	1.4693
02 Sep 2011 00:56:17	1129647	13315361	hadcm3n_yawq_1940_40_007432073_1	25,920	36,474	1.4072