Task 13816877

Name	hadcm3n_u7n5_1980_40_007618040_0
Workunit	7796170
Created	24 Dec 2011, 23:11:49 UTC
Sent	24 Dec 2011, 23:30:58 UTC
Report deadline	25 Mar 2012, 6:58:09 UTC
Received	18 Mar 2012, 17:54:36 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1083674
Run time	6 days 22 hours 29 min 43 sec
CPU time	5 days 19 hours 11 min 21 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.27 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.56</core_client_version> <![CDATA[ <message> - exit code -1073741819 (0xc0000005) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:01:28 (6896): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:45:16 (4144): No heartbeat from core client for 30 sec - exiting 17:45:17 (4144): No heartbeat from core client for 30 sec - exiting 17:45:18 (4144): No heartbeat from core client for 30 sec - exiting 17:45:20 (4144): No heartbeat from core client for 30 sec - exiting 17:45:21 (4144): No heartbeat from core client for 30 sec - exiting 17:45:22 (4144): No heartbeat from core client for 30 sec - exiting 17:45:23 (4144): No heartbeat from core client for 30 sec - exiting 17:45:24 (4144): No heartbeat from core client for 30 sec - exiting 17:45:25 (4144): No heartbeat from core client for 30 sec - exiting 17:45:26 (4144): No heartbeat from core client for 30 sec - exiting 17:45:27 (4144): No heartbeat from core client for 30 sec - exiting 17:45:28 (4144): No heartbeat from core client for 30 sec - exiting 17:45:30 (4144): No heartbeat from core client for 30 sec - exiting 17:45:31 (4144): No heartbeat from core client for 30 sec - exiting 17:45:32 (4144): No heartbeat from core client for 30 sec - exiting 17:45:33 (4144): No heartbeat from core client for 30 sec - exiting 17:45:34 (4144): No heartbeat from core client for 30 sec - exiting 17:45:35 (4144): No heartbeat from core client for 30 sec - exiting 17:45:36 (4144): No heartbeat from core client for 30 sec - exiting 17:45:37 (4144): No heartbeat from core client for 30 sec - exiting 17:45:38 (4144): No heartbeat from core client for 30 sec - exiting 17:45:39 (4144): No heartbeat from core client for 30 sec - exiting 17:45:40 (4144): No heartbeat from core client for 30 sec - exiting 17:45:42 (4144): No heartbeat from core client for 30 sec - exiting 17:45:43 (4144): No heartbeat from core client for 30 sec - exiting 17:45:44 (4144): No heartbeat from core client for 30 sec - exiting 17:45:45 (4144): No heartbeat from core client for 30 sec - exiting 17:45:46 (4144): No heartbeat from core client for 30 sec - exiting 17:45:47 (4144): No heartbeat from core client for 30 sec - exiting 17:45:48 (4144): No heartbeat from core client for 30 sec - exiting 17:45:49 (4144): No heartbeat from core client for 30 sec - exiting 17:45:50 (4144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:30:48 (7948): No heartbeat from core client for 30 sec - exiting 19:30:49 (7948): No heartbeat from core client for 30 sec - exiting 19:30:50 (7948): No heartbeat from core client for 30 sec - exiting 19:30:51 (7948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:42:55 (10216): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:06:36 (6812): No heartbeat from core client for 30 sec - exiting 21:06:37 (6812): No heartbeat from core client for 30 sec - exiting 21:06:38 (6812): No heartbeat from core client for 30 sec - exiting 21:06:39 (6812): No heartbeat from core client for 30 sec - exiting 21:06:40 (6812): No heartbeat from core client for 30 sec - exiting 21:06:41 (6812): No heartbeat from core client for 30 sec - exiting 21:06:43 (6812): No heartbeat from core client for 30 sec - exiting 21:06:44 (6812): No heartbeat from core client for 30 sec - exiting 21:06:45 (6812): No heartbeat from core client for 30 sec - exiting 21:06:46 (6812): No heartbeat from core client for 30 sec - exiting 21:06:47 (6812): No heartbeat from core client for 30 sec - exiting 21:06:48 (6812): No heartbeat from core client for 30 sec - exiting 21:06:49 (6812): No heartbeat from core client for 30 sec - exiting 21:06:50 (6812): No heartbeat from core client for 30 sec - exiting 21:06:51 (6812): No heartbeat from core client for 30 sec - exiting 21:06:52 (6812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:26:14 (7288): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:29:35 (5144): No heartbeat from core client for 30 sec - exiting 14:29:36 (5144): No heartbeat from core client for 30 sec - exiting 14:29:37 (5144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:22:38 (3688): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:45:30 (6308): No heartbeat from core client for 30 sec - exiting 13:45:31 (6308): No heartbeat from core client for 30 sec - exiting 13:45:33 (6308): No heartbeat from core client for 30 sec - exiting 13:45:34 (6308): No heartbeat from core client for 30 sec - exiting 13:45:35 (6308): No heartbeat from core client for 30 sec - exiting 13:45:36 (6308): No heartbeat from core client for 30 sec - exiting 13:45:37 (6308): No heartbeat from core client for 30 sec - exiting 13:45:38 (6308): No heartbeat from core client for 30 sec - exiting 13:45:39 (6308): No heartbeat from core client for 30 sec - exiting 13:45:40 (6308): No heartbeat from core client for 30 sec - exiting 13:45:41 (6308): No heartbeat from core client for 30 sec - exiting 13:45:42 (6308): No heartbeat from core client for 30 sec - exiting 13:45:43 (6308): No heartbeat from core client for 30 sec - exiting 13:45:44 (6308): No heartbeat from core client for 30 sec - exiting 13:45:45 (6308): No heartbeat from core client for 30 sec - exiting 13:45:46 (6308): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:45:47 (6308): No heartbeat from core client for 30 sec - exiting 13:45:48 (6308): No heartbeat from core client for 30 sec - exiting 13:45:49 (6308): No heartbeat from core client for 30 sec - exiting 13:45:50 (6308): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/u7n5ko.pji9c10 Error converting file to netcdf: dataout/u7n5ko.pii9c10 Error converting file to netcdf: dataout/u7n5ko.pfi9c10 Error converting file to netcdf: dataout/u7n5ka.phi9c10 Error converting file to netcdf: dataout/u7n5ka.pgi9c10 Error converting file to netcdf: dataout/u7n5ka.pei9c10 Error converting file to netcdf: dataout/u7n5ka.pdi9c10 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77337ACE read attempt to address 0x003458BC Engaging BOINC Windows Runtime Debugger... 18:05:06 (1828): No heartbeat from core client for 30 sec - exiting 18:05:08 (1828): No heartbeat from core client for 30 sec - exiting 18:05:09 (1828): No heartbeat from core client for 30 sec - exiting 18:05:10 (1828): No heartbeat from core client for 30 sec - exiting 18:05:11 (1828): No heartbeat from core client for 30 sec - exiting 18:05:12 (1828): No heartbeat from core client for 30 sec - exiting 18:05:13 (1828): No heartbeat from core client for 30 sec - exiting 18:05:14 (1828): No heartbeat from core client for 30 sec - exiting 18:05:15 (1828): No heartbeat from core client for 30 sec - exiting 18:05:16 (1828): No heartbeat from core client for 30 sec - exiting 18:05:17 (1828): No heartbeat from core client for 30 sec - exiting 18:05:18 (1828): No heartbeat from core client for 30 sec - exiting 18:05:20 (1828): No heartbeat from core client for 30 sec - exiting 18:05:21 (1828): No heartbeat from core client for 30 sec - exiting 18:05:22 (1828): No heartbeat from core client for 30 sec - exiting 18:05:23 (1828): No heartbeat from core client for 30 sec - exiting 18:05:24 (1828): No heartbeat from core client for 30 sec - exiting 18:05:25 (1828): No heartbeat from core client for 30 sec - exiting 18:05:26 (1828): No heartbeat from core client for 30 sec - exiting 18:05:27 (1828): No heartbeat from core client for 30 sec - exiting 18:05:28 (1828): No heartbeat from core client for 30 sec - exiting 18:05:29 (1828): No heartbeat from core client for 30 sec - exiting 18:05:31 (1828): No heartbeat from core client for 30 sec - exiting 18:05:32 (1828): No heartbeat from core client for 30 sec - exiting 18:05:33 (1828): No heartbeat from core client for 30 sec - exiting 18:05:34 (1828): No heartbeat from core client for 30 sec - exiting 18:05:35 (1828): No heartbeat from core client for 30 sec - exiting 18:05:36 (1828): No heartbeat from core client for 30 sec - exiting 18:05:37 (1828): No heartbeat from core client for 30 sec - exiting 18:05:38 (1828): No heartbeat from core client for 30 sec - exiting 18:05:39 (1828): No heartbeat from core client for 30 sec - exiting 18:05:40 (1828): No heartbeat from core client for 30 sec - exiting 18:05:41 (1828): No heartbeat from core client for 30 sec - exiting Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77B63AB3 read attempt to address 0x3F1B14AB Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
17 Mar 2012 17:45:26	1083674	13816877	hadcm3n_u7n5_1980_40_007618040_0	259,200	491,552	1.8964
02 Mar 2012 21:56:23	1083674	13816877	hadcm3n_u7n5_1980_40_007618040_0	233,280	442,645	1.8975
04 Feb 2012 21:42:55	1083674	13816877	hadcm3n_u7n5_1980_40_007618040_0	207,360	393,808	1.8992
29 Jan 2012 20:35:06	1083674	13816877	hadcm3n_u7n5_1980_40_007618040_0	181,440	343,213	1.8916
28 Jan 2012 11:00:04	1083674	13816877	hadcm3n_u7n5_1980_40_007618040_0	155,520	292,102	1.8782
20 Jan 2012 20:17:01	1083674	13816877	hadcm3n_u7n5_1980_40_007618040_0	129,600	243,788	1.8811
04 Jan 2012 19:17:54	1083674	13816877	hadcm3n_u7n5_1980_40_007618040_0	103,680	195,599	1.8866
31 Dec 2011 19:11:59	1083674	13816877	hadcm3n_u7n5_1980_40_007618040_0	77,760	147,576	1.8978
29 Dec 2011 21:56:23	1083674	13816877	hadcm3n_u7n5_1980_40_007618040_0	51,840	99,443	1.9183
26 Dec 2011 21:39:26	1083674	13816877	hadcm3n_u7n5_1980_40_007618040_0	25,920	51,126	1.9725