Task 14035619

Name	hadcm3n_ymat_1980_40_007743611_3
Workunit	7898719
Created	31 Jan 2012, 2:05:03 UTC
Sent	31 Jan 2012, 2:12:28 UTC
Report deadline	1 May 2012, 9:39:39 UTC
Received	7 Mar 2012, 4:49:21 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1078613
Run time	24 days 21 hours 37 min 19 sec
CPU time	18 days 16 hours 46 min 6 sec
Validate state	Invalid
Credit	12,441.60
Device peak FLOPS	2.52 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> - exit code -1073741819 (0xc0000005) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:42:54 (12780): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 01:06:21 (6416): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5404, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5052, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3600, iMonCtr=1 Model crash detected, will try to restart... 05:31:17 (1340): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:31:18 (1340): No heartbeat from core client for 30 sec - exiting 05:33:02 (8908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:35:18 (7972): No heartbeat from core client for 30 sec - exiting 05:35:19 (7972): No heartbeat from core client for 30 sec - exiting 05:35:20 (7972): No heartbeat from core client for 30 sec - exiting 05:35:21 (7972): No heartbeat from core client for 30 sec - exiting 05:35:22 (7972): No heartbeat from core client for 30 sec - exiting 05:35:23 (7972): No heartbeat from core client for 30 sec - exiting 05:35:24 (7972): No heartbeat from core client for 30 sec - exiting 05:35:25 (7972): No heartbeat from core client for 30 sec - exiting 05:35:26 (7972): No heartbeat from core client for 30 sec - exiting 05:35:27 (7972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:38:10 (8660): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:03:36 (7192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:05:21 (8284): No heartbeat from core client for 30 sec - exiting 07:05:22 (8284): No heartbeat from core client for 30 sec - exiting 07:05:23 (8284): No heartbeat from core client for 30 sec - exiting 07:05:24 (8284): No heartbeat from core client for 30 sec - exiting 07:05:25 (8284): No heartbeat from core client for 30 sec - exiting 07:05:26 (8284): No heartbeat from core client for 30 sec - exiting 07:05:27 (8284): No heartbeat from core client for 30 sec - exiting 07:05:28 (8284): No heartbeat from core client for 30 sec - exiting 07:05:29 (8284): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3884, iMonCtr=1 Model crash detected, will try to restart... 00:05:45 (5300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:12:15 (4368): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:36:12 (6300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:36:13 (6300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9372, selfPID=9372, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x76F43AB3 read attempt to address 0x40B9141B Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x76F43AB3 read attempt to address 0x40B9141B Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
06 Mar 2012 15:46:11	1078613	14035619	hadcm3n_ymat_1980_40_007743611_3	1,036,800	1,614,984	1.5577
05 Mar 2012 23:04:49	1078613	14035619	hadcm3n_ymat_1980_40_007743611_3	1,010,880	1,574,145	1.5572
05 Mar 2012 07:00:34	1078613	14035619	hadcm3n_ymat_1980_40_007743611_3	984,960	1,533,608	1.5570
04 Mar 2012 16:16:39	1078613	14035619	hadcm3n_ymat_1980_40_007743611_3	959,040	1,493,584	1.5574
03 Mar 2012 21:55:05	1078613	14035619	hadcm3n_ymat_1980_40_007743611_3	933,120	1,453,139	1.5573
03 Mar 2012 03:53:42	1078613	14035619	hadcm3n_ymat_1980_40_007743611_3	907,200	1,412,493	1.5570
02 Mar 2012 12:12:44	1078613	14035619	hadcm3n_ymat_1980_40_007743611_3	881,280	1,370,620	1.5553
01 Mar 2012 20:01:07	1078613	14035619	hadcm3n_ymat_1980_40_007743611_3	855,360	1,330,304	1.5553
01 Mar 2012 03:10:00	1078613	14035619	hadcm3n_ymat_1980_40_007743611_3	829,440	1,289,894	1.5551
29 Feb 2012 13:32:26	1078613	14035619	hadcm3n_ymat_1980_40_007743611_3	803,520	1,249,862	1.5555
28 Feb 2012 22:36:03	1078613	14035619	hadcm3n_ymat_1980_40_007743611_3	777,600	1,209,597	1.5556
28 Feb 2012 05:53:17	1078613	14035619	hadcm3n_ymat_1980_40_007743611_3	751,680	1,169,574	1.5559
27 Feb 2012 03:25:53	1078613	14035619	hadcm3n_ymat_1980_40_007743611_3	725,760	1,129,080	1.5557
26 Feb 2012 14:34:53	1078613	14035619	hadcm3n_ymat_1980_40_007743611_3	699,840	1,087,761	1.5543
25 Feb 2012 22:10:38	1078613	14035619	hadcm3n_ymat_1980_40_007743611_3	673,920	1,047,502	1.5543
25 Feb 2012 04:20:48	1078613	14035619	hadcm3n_ymat_1980_40_007743611_3	648,000	1,007,799	1.5552
24 Feb 2012 14:14:49	1078613	14035619	hadcm3n_ymat_1980_40_007743611_3	622,080	967,830	1.5558
23 Feb 2012 21:55:35	1078613	14035619	hadcm3n_ymat_1980_40_007743611_3	596,160	927,751	1.5562
23 Feb 2012 06:42:38	1078613	14035619	hadcm3n_ymat_1980_40_007743611_3	570,240	886,539	1.5547
22 Feb 2012 16:22:21	1078613	14035619	hadcm3n_ymat_1980_40_007743611_3	544,320	845,704	1.5537