Task 13955911

Name	hadcm3n_o0bw_1940_40_007693711_1
Workunit	7848819
Created	23 Jan 2012, 18:25:43 UTC
Sent	23 Jan 2012, 18:28:33 UTC
Report deadline	24 Apr 2012, 1:55:44 UTC
Received	1 Mar 2012, 10:23:25 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1096508
Run time	15 days 15 hours 18 min 41 sec
CPU time	13 days 17 hours 36 min 11 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	2.16 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> - exit code -1073741819 (0xc0000005) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:08:44 (8884): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:08:58 (8884): No heartbeat from core client for 30 sec - exiting 11:08:59 (8884): No heartbeat from core client for 30 sec - exiting 11:09:00 (8884): No heartbeat from core client for 30 sec - exiting 11:09:01 (8884): No heartbeat from core client for 30 sec - exiting 11:09:02 (8884): No heartbeat from core client for 30 sec - exiting 11:09:03 (8884): No heartbeat from core client for 30 sec - exiting 11:09:04 (8884): No heartbeat from core client for 30 sec - exiting 11:09:05 (8884): No heartbeat from core client for 30 sec - exiting 11:09:06 (8884): No heartbeat from core client for 30 sec - exiting 11:53:22 (4124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:53:35 (4124): No heartbeat from core client for 30 sec - exiting 11:53:36 (4124): No heartbeat from core client for 30 sec - exiting 11:53:37 (4124): No heartbeat from core client for 30 sec - exiting 11:53:38 (4124): No heartbeat from core client for 30 sec - exiting 11:53:39 (4124): No heartbeat from core client for 30 sec - exiting 11:53:40 (4124): No heartbeat from core client for 30 sec - exiting 11:53:41 (4124): No heartbeat from core client for 30 sec - exiting 11:53:42 (4124): No heartbeat from core client for 30 sec - exiting 11:53:43 (4124): No heartbeat from core client for 30 sec - exiting 11:54:52 (7580): No heartbeat from core client for 30 sec - exiting 11:55:41 (7580): No heartbeat from core client for 30 sec - exiting 11:55:42 (7580): No heartbeat from core client for 30 sec - exiting 11:55:43 (7580): No heartbeat from core client for 30 sec - exiting 11:55:44 (7580): No heartbeat from core client for 30 sec - exiting 11:55:45 (7580): No heartbeat from core client for 30 sec - exiting 11:55:46 (7580): No heartbeat from core client for 30 sec - exiting 11:55:47 (7580): No heartbeat from core client for 30 sec - exiting 11:55:48 (7580): No heartbeat from core client for 30 sec - exiting 11:55:49 (7580): No heartbeat from core client for 30 sec - exiting 11:55:50 (7580): No heartbeat from core client for 30 sec - exiting 11:55:51 (7580): No heartbeat from core client for 30 sec - exiting 11:55:52 (7580): No heartbeat from core client for 30 sec - exiting 11:55:53 (7580): No heartbeat from core client for 30 sec - exiting 11:55:54 (7580): No heartbeat from core client for 30 sec - exiting 11:55:55 (7580): No heartbeat from core client for 30 sec - exiting 11:55:56 (7580): No heartbeat from core client for 30 sec - exiting 11:55:57 (7580): No heartbeat from core client for 30 sec - exiting 11:55:58 (7580): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 11 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6936, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6936, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... 17:12:20 (4016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 01:56:02 (6760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 01:46:05 (2868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77AE3AB3 read attempt to address 0x40323BFB Engaging BOINC Windows Runtime Debugger... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7924, selfPID=7924, iMonCtr=1 Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77AE3AB3 read attempt to address 0x40323BFB Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
01 Mar 2012 05:12:04	1096508	13955911	hadcm3n_o0bw_1940_40_007693711_1	518,400	1,175,674	2.2679
28 Feb 2012 19:17:32	1096508	13955911	hadcm3n_o0bw_1940_40_007693711_1	492,480	1,114,933	2.2639
23 Feb 2012 00:45:12	1096508	13955911	hadcm3n_o0bw_1940_40_007693711_1	466,560	1,058,769	2.2693
22 Feb 2012 06:25:19	1096508	13955911	hadcm3n_o0bw_1940_40_007693711_1	440,640	1,006,588	2.2844
21 Feb 2012 03:10:31	1096508	13955911	hadcm3n_o0bw_1940_40_007693711_1	414,720	945,173	2.2791
20 Feb 2012 08:53:03	1096508	13955911	hadcm3n_o0bw_1940_40_007693711_1	388,800	886,501	2.2801
19 Feb 2012 13:49:28	1096508	13955911	hadcm3n_o0bw_1940_40_007693711_1	362,880	826,246	2.2769
18 Feb 2012 17:04:59	1096508	13955911	hadcm3n_o0bw_1940_40_007693711_1	336,960	765,449	2.2716
17 Feb 2012 21:03:12	1096508	13955911	hadcm3n_o0bw_1940_40_007693711_1	311,040	704,036	2.2635
16 Feb 2012 19:20:52	1096508	13955911	hadcm3n_o0bw_1940_40_007693711_1	285,120	644,447	2.2603
16 Feb 2012 02:41:49	1096508	13955911	hadcm3n_o0bw_1940_40_007693711_1	259,200	591,686	2.2827
14 Feb 2012 19:41:29	1096508	13955911	hadcm3n_o0bw_1940_40_007693711_1	233,280	532,820	2.2840
14 Feb 2012 00:27:50	1096508	13955911	hadcm3n_o0bw_1940_40_007693711_1	207,360	474,184	2.2868
13 Feb 2012 06:54:08	1096508	13955911	hadcm3n_o0bw_1940_40_007693711_1	181,440	415,960	2.2925
11 Feb 2012 19:12:50	1096508	13955911	hadcm3n_o0bw_1940_40_007693711_1	155,520	356,396	2.2916
10 Feb 2012 23:59:30	1096508	13955911	hadcm3n_o0bw_1940_40_007693711_1	129,600	296,754	2.2898
09 Feb 2012 06:53:39	1096508	13955911	hadcm3n_o0bw_1940_40_007693711_1	103,680	237,964	2.2952
08 Feb 2012 12:32:15	1096508	13955911	hadcm3n_o0bw_1940_40_007693711_1	77,760	177,103	2.2776
02 Feb 2012 02:25:41	1096508	13955911	hadcm3n_o0bw_1940_40_007693711_1	51,840	116,679	2.2508
01 Feb 2012 09:56:09	1096508	13955911	hadcm3n_o0bw_1940_40_007693711_1	25,920	59,122	2.2809