Task 13398967

Name	hadcm3n_y8oa_1940_40_007456892_0
Workunit	7654395
Created	19 Sep 2011, 3:00:10 UTC
Sent	19 Sep 2011, 8:06:43 UTC
Report deadline	19 Dec 2011, 15:33:54 UTC
Received	4 Oct 2011, 12:04:22 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1170477
Run time	7 days 3 hours 37 min 30 sec
CPU time	6 days 11 hours 10 min 27 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.76 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> - exit code -1073741819 (0xc0000005) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:05:28 (2544): No heartbeat from core client for 30 sec - exiting 15:05:29 (2544): No heartbeat from core client for 30 sec - exiting 15:05:30 (2544): No heartbeat from core client for 30 sec - exiting 15:05:31 (2544): No heartbeat from core client for 30 sec - exiting 15:05:32 (2544): No heartbeat from core client for 30 sec - exiting 15:05:33 (2544): No heartbeat from core client for 30 sec - exiting 15:05:34 (2544): No heartbeat from core client for 30 sec - exiting 15:05:35 (2544): No heartbeat from core client for 30 sec - exiting 15:05:36 (2544): No heartbeat from core client for 30 sec - exiting 15:05:37 (2544): No heartbeat from core client for 30 sec - exiting 15:05:38 (2544): No heartbeat from core client for 30 sec - exiting 15:05:39 (2544): No heartbeat from core client for 30 sec - exiting 15:05:40 (2544): No heartbeat from core client for 30 sec - exiting 15:05:41 (2544): No heartbeat from core client for 30 sec - exiting 15:05:42 (2544): No heartbeat from core client for 30 sec - exiting 15:05:43 (2544): No heartbeat from core client for 30 sec - exiting 15:05:44 (2544): No heartbeat from core client for 30 sec - exiting 15:05:45 (2544): No heartbeat from core client for 30 sec - exiting 15:05:46 (2544): No heartbeat from core client for 30 sec - exiting 15:05:47 (2544): No heartbeat from core client for 30 sec - exiting 15:05:48 (2544): No heartbeat from core client for 30 sec - exiting 15:05:49 (2544): No heartbeat from core client for 30 sec - exiting 15:05:50 (2544): No heartbeat from core client for 30 sec - exiting 15:05:51 (2544): No heartbeat from core client for 30 sec - exiting 15:05:52 (2544): No heartbeat from core client for 30 sec - exiting 15:05:53 (2544): No heartbeat from core client for 30 sec - exiting 15:05:54 (2544): No heartbeat from core client for 30 sec - exiting 15:05:55 (2544): No heartbeat from core client for 30 sec - exiting 15:05:56 (2544): No heartbeat from core client for 30 sec - exiting 15:05:57 (2544): No heartbeat from core client for 30 sec - exiting 15:05:58 (2544): No heartbeat from core client for 30 sec - exiting 15:05:59 (2544): No heartbeat from core client for 30 sec - exiting 15:06:00 (2544): No heartbeat from core client for 30 sec - exiting 15:06:01 (2544): No heartbeat from core client for 30 sec - exiting 15:06:02 (2544): No heartbeat from core client for 30 sec - exiting 15:06:03 (2544): No heartbeat from core client for 30 sec - exiting 15:06:04 (2544): No heartbeat from core client for 30 sec - exiting 15:06:05 (2544): No heartbeat from core client for 30 sec - exiting 15:06:06 (2544): No heartbeat from core client for 30 sec - exiting 15:06:07 (2544): No heartbeat from core client for 30 sec - exiting 15:06:08 (2544): No heartbeat from core client for 30 sec - exiting 15:06:09 (2544): No heartbeat from core client for 30 sec - exiting 15:06:10 (2544): No heartbeat from core client for 30 sec - exiting 15:06:11 (2544): No heartbeat from core client for 30 sec - exiting 15:06:12 (2544): No heartbeat from core client for 30 sec - exiting 15:06:13 (2544): No heartbeat from core client for 30 sec - exiting 15:06:14 (2544): No heartbeat from core client for 30 sec - exiting 15:06:15 (2544): No heartbeat from core client for 30 sec - exiting 15:06:16 (2544): No heartbeat from core client for 30 sec - exiting 15:06:17 (2544): No heartbeat from core client for 30 sec - exiting 15:06:18 (2544): No heartbeat from core client for 30 sec - exiting 15:06:19 (2544): No heartbeat from core client for 30 sec - exiting 15:06:20 (2544): No heartbeat from core client for 30 sec - exiting 15:06:21 (2544): No heartbeat from core client for 30 sec - exiting 15:06:22 (2544): No heartbeat from core client for 30 sec - exiting 15:06:23 (2544): No heartbeat from core client for 30 sec - exiting 15:06:24 (2544): No heartbeat from core client for 30 sec - exiting 15:06:25 (2544): No heartbeat from core client for 30 sec - exiting 15:06:26 (2544): No heartbeat from core client for 30 sec - exiting 15:06:27 (2544): No heartbeat from core client for 30 sec - exiting 15:06:28 (2544): No heartbeat from core client for 30 sec - exiting 15:06:30 (2544): No heartbeat from core client for 30 sec - exiting 15:06:31 (2544): No heartbeat from core client for 30 sec - exiting 15:06:32 (2544): No heartbeat from core client for 30 sec - exiting 15:06:33 (2544): No heartbeat from core client for 30 sec - exiting 15:06:34 (2544): No heartbeat from core client for 30 sec - exiting 15:06:35 (2544): No heartbeat from core client for 30 sec - exiting 15:06:36 (2544): No heartbeat from core client for 30 sec - exiting 15:06:37 (2544): No heartbeat from core client for 30 sec - exiting 15:06:38 (2544): No heartbeat from core client for 30 sec - exiting 15:06:39 (2544): No heartbeat from core client for 30 sec - exiting 15:06:40 (2544): No heartbeat from core client for 30 sec - exiting 15:06:41 (2544): No heartbeat from core client for 30 sec - exiting 15:06:42 (2544): No heartbeat from core client for 30 sec - exiting 15:06:43 (2544): No heartbeat from core client for 30 sec - exiting 15:06:44 (2544): No heartbeat from core client for 30 sec - exiting 15:06:45 (2544): No heartbeat from core client for 30 sec - exiting 15:06:46 (2544): No heartbeat from core client for 30 sec - exiting 15:06:47 (2544): No heartbeat from core client for 30 sec - exiting 15:06:48 (2544): No heartbeat from core client for 30 sec - exiting 15:06:49 (2544): No heartbeat from core client for 30 sec - exiting 15:06:50 (2544): No heartbeat from core client for 30 sec - exiting 15:06:51 (2544): No heartbeat from core client for 30 sec - exiting 15:06:52 (2544): No heartbeat from core client for 30 sec - exiting 15:06:53 (2544): No heartbeat from core client for 30 sec - exiting 15:06:54 (2544): No heartbeat from core client for 30 sec - exiting 15:06:55 (2544): No heartbeat from core client for 30 sec - exiting 15:06:56 (2544): No heartbeat from core client for 30 sec - exiting 15:06:57 (2544): No heartbeat from core client for 30 sec - exiting 15:06:58 (2544): No heartbeat from core client for 30 sec - exiting 15:06:59 (2544): No heartbeat from core client for 30 sec - exiting 15:07:00 (2544): No heartbeat from core client for 30 sec - exiting 15:07:01 (2544): No heartbeat from core client for 30 sec - exiting 15:07:02 (2544): No heartbeat from core client for 30 sec - exiting 15:07:03 (2544): No heartbeat from core client for 30 sec - exiting 15:07:04 (2544): No heartbeat from core client for 30 sec - exiting 15:07:05 (2544): No heartbeat from core client for 30 sec - exiting 15:07:06 (2544): No heartbeat from core client for 30 sec - exiting 15:07:07 (2544): No heartbeat from core client for 30 sec - exiting 15:07:08 (2544): No heartbeat from core client for 30 sec - exiting 15:07:09 (2544): No heartbeat from core client for 30 sec - exiting 15:07:10 (2544): No heartbeat from core client for 30 sec - exiting 15:07:11 (2544): No heartbeat from core client for 30 sec - exiting 15:07:12 (2544): No heartbeat from core client for 30 sec - exiting 15:07:13 (2544): No heartbeat from core client for 30 sec - exiting 15:07:14 (2544): No heartbeat from core client for 30 sec - exiting 15:07:15 (2544): No heartbeat from core client for 30 sec - exiting 15:07:16 (2544): No heartbeat from core client for 30 sec - exiting 15:07:17 (2544): No heartbeat from core client for 30 sec - exiting 15:07:18 (2544): No heartbeat from core client for 30 sec - exiting 15:07:19 (2544): No heartbeat from core client for 30 sec - exiting 15:07:20 (2544): No heartbeat from core client for 30 sec - exiting 15:07:21 (2544): No heartbeat from core client for 30 sec - exiting 15:07:22 (2544): No heartbeat from core client for 30 sec - exiting 15:07:23 (2544): No heartbeat from core client for 30 sec - exiting 15:07:24 (2544): No heartbeat from core client for 30 sec - exiting 15:07:25 (2544): No heartbeat from core client for 30 sec - exiting 15:07:26 (2544): No heartbeat from core client for 30 sec - exiting 15:07:27 (2544): No heartbeat from core client for 30 sec - exiting 15:07:28 (2544): No heartbeat from core client for 30 sec - exiting 15:07:29 (2544): No heartbeat from core client for 30 sec - exiting 15:07:30 (2544): No heartbeat from core client for 30 sec - exiting 15:07:31 (2544): No heartbeat from core client for 30 sec - exiting 15:07:32 (2544): No heartbeat from core client for 30 sec - exiting 15:07:33 (2544): No heartbeat from core client for 30 sec - exiting 15:07:34 (2544): No heartbeat from core client for 30 sec - exiting 15:07:35 (2544): No heartbeat from core client for 30 sec - exiting 15:07:36 (2544): No heartbeat from core client for 30 sec - exiting 15:07:37 (2544): No heartbeat from core client for 30 sec - exiting 15:07:38 (2544): No heartbeat from core client for 30 sec - exiting 15:07:39 (2544): No heartbeat from core client for 30 sec - exiting 15:07:40 (2544): No heartbeat from core client for 30 sec - exiting 15:07:41 (2544): No heartbeat from core client for 30 sec - exiting 15:07:42 (2544): No heartbeat from core client for 30 sec - exiting 15:07:43 (2544): No heartbeat from core client for 30 sec - exiting 15:07:44 (2544): No heartbeat from core client for 30 sec - exiting 15:07:45 (2544): No heartbeat from core client for 30 sec - exiting 15:07:46 (2544): No heartbeat from core client for 30 sec - exiting 15:07:47 (2544): No heartbeat from core client for 30 sec - exiting 15:07:48 (2544): No heartbeat from core client for 30 sec - exiting 15:07:49 (2544): No heartbeat from core client for 30 sec - exiting 15:07:50 (2544): No heartbeat from core client for 30 sec - exiting 15:07:51 (2544): No heartbeat from core client for 30 sec - exiting 15:07:52 (2544): No heartbeat from core client for 30 sec - exiting 15:07:53 (2544): No heartbeat from core client for 30 sec - exiting Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3368, selfPID=3368, iMonCtr=1 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/y8oako.pje1c10 Error converting file to netcdf: dataout/y8oako.pie1c10 Error converting file to netcdf: dataout/y8oako.pfe1c10 Error converting file to netcdf: dataout/y8oaka.phe1c10 Error converting file to netcdf: dataout/y8oaka.pge1c10 Error converting file to netcdf: dataout/y8oaka.pee1c10 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:02:21 (5980): Can't acquire lockfile (32) - waiting 35s CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x7C91AA21 read attempt to address 0x01223D00 Engaging BOINC Windows Runtime Debugger... Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x7C910F1E read attempt to address 0x40B9261E Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
04 Oct 2011 11:03:53	1170477	13398967	hadcm3n_y8oa_1940_40_007456892_0	259,200	557,710	2.1517
01 Oct 2011 16:45:45	1170477	13398967	hadcm3n_y8oa_1940_40_007456892_0	207,360	446,483	2.1532
30 Sep 2011 09:52:17	1170477	13398967	hadcm3n_y8oa_1940_40_007456892_0	181,440	391,722	2.1590
29 Sep 2011 07:52:25	1170477	13398967	hadcm3n_y8oa_1940_40_007456892_0	155,520	336,573	2.1642
27 Sep 2011 15:01:19	1170477	13398967	hadcm3n_y8oa_1940_40_007456892_0	129,600	280,547	2.1647
26 Sep 2011 10:25:46	1170477	13398967	hadcm3n_y8oa_1940_40_007456892_0	103,680	224,604	2.1663
23 Sep 2011 13:29:18	1170477	13398967	hadcm3n_y8oa_1940_40_007456892_0	77,760	166,595	2.1424
21 Sep 2011 18:00:00	1170477	13398967	hadcm3n_y8oa_1940_40_007456892_0	51,840	112,315	2.1666
20 Sep 2011 14:11:33	1170477	13398967	hadcm3n_y8oa_1940_40_007456892_0	25,920	56,434	2.1772