Task 15823495

Name	hadcm3n_o2w6_1980_40_008387626_0
Workunit	8538485
Created	3 Jun 2013, 10:35:24 UTC
Sent	3 Jun 2013, 10:48:10 UTC
Report deadline	2 Sep 2013, 18:15:21 UTC
Received	19 Jun 2013, 3:16:08 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1276055
Run time	3 days 8 hours 5 min 6 sec
CPU time	3 days 7 hours 5 min 37 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	3.00 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> - exit code -1073741819 (0xc0000005) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:57:27 (6908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:57:28 (6908): No heartbeat from core client for 30 sec - exiting 18:57:29 (6908): No heartbeat from core client for 30 sec - exiting 18:57:30 (6908): No heartbeat from core client for 30 sec - exiting 18:57:31 (6908): No heartbeat from core client for 30 sec - exiting 18:57:32 (6908): No heartbeat from core client for 30 sec - exiting 18:57:33 (6908): No heartbeat from core client for 30 sec - exiting 18:57:34 (6908): No heartbeat from core client for 30 sec - exiting 18:57:35 (6908): No heartbeat from core client for 30 sec - exiting 18:57:36 (6908): No heartbeat from core client for 30 sec - exiting 18:57:37 (6908): No heartbeat from core client for 30 sec - exiting 18:59:09 (668): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:59:10 (668): No heartbeat from core client for 30 sec - exiting 18:59:11 (668): No heartbeat from core client for 30 sec - exiting 18:59:12 (668): No heartbeat from core client for 30 sec - exiting 18:59:13 (668): No heartbeat from core client for 30 sec - exiting 18:59:14 (668): No heartbeat from core client for 30 sec - exiting 18:59:15 (668): No heartbeat from core client for 30 sec - exiting 18:59:16 (668): No heartbeat from core client for 30 sec - exiting 18:59:17 (668): No heartbeat from core client for 30 sec - exiting 18:59:18 (668): No heartbeat from core client for 30 sec - exiting 18:59:19 (668): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:56:43 (3960): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:22:44 (6656): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:22:45 (6656): No heartbeat from core client for 30 sec - exiting 19:22:46 (6656): No heartbeat from core client for 30 sec - exiting 19:22:47 (6656): No heartbeat from core client for 30 sec - exiting 19:22:48 (6656): No heartbeat from core client for 30 sec - exiting 19:22:49 (6656): No heartbeat from core client for 30 sec - exiting 19:22:50 (6656): No heartbeat from core client for 30 sec - exiting 19:22:51 (6656): No heartbeat from core client for 30 sec - exiting 19:22:52 (6656): No heartbeat from core client for 30 sec - exiting 19:22:53 (6656): No heartbeat from core client for 30 sec - exiting 19:22:54 (6656): No heartbeat from core client for 30 sec - exiting 19:26:15 (8412): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:32:49 (7636): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:46:38 (9064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:49:57 (5492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:00:08 (6016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 CPDN Monitor - Quit request from BOINC... 18:43:18 (2480): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold 18:46:07 (7200): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:46:08 (7200): No heartbeat from core client for 30 sec - exiting 18:46:09 (7200): No heartbeat from core client for 30 sec - exiting 18:46:10 (7200): No heartbeat from core client for 30 sec - exiting 18:46:11 (7200): No heartbeat from core client for 30 sec - exiting 18:46:12 (7200): No heartbeat from core client for 30 sec - exiting 18:46:13 (7200): No heartbeat from core client for 30 sec - exiting 18:46:14 (7200): No heartbeat from core client for 30 sec - exiting 18:46:15 (7200): No heartbeat from core client for 30 sec - exiting 18:46:16 (7200): No heartbeat from core client for 30 sec - exiting 18:46:17 (7200): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold 18:47:13 (5708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold 18:50:57 (7664): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:50:58 (7664): No heartbeat from core client for 30 sec - exiting 18:50:59 (7664): No heartbeat from core client for 30 sec - exiting 18:51:00 (7664): No heartbeat from core client for 30 sec - exiting 18:51:01 (7664): No heartbeat from core client for 30 sec - exiting 18:51:02 (7664): No heartbeat from core client for 30 sec - exiting 18:51:03 (7664): No heartbeat from core client for 30 sec - exiting 18:51:04 (7664): No heartbeat from core client for 30 sec - exiting 18:51:05 (7664): No heartbeat from core client for 30 sec - exiting 18:51:06 (7664): No heartbeat from core client for 30 sec - exiting 18:51:07 (7664): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:47:22 (5000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:50:10 (6856): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:50:11 (6856): No heartbeat from core client for 30 sec - exiting 09:50:12 (6856): No heartbeat from core client for 30 sec - exiting 09:50:13 (6856): No heartbeat from core client for 30 sec - exiting 09:50:14 (6856): No heartbeat from core client for 30 sec - exiting 09:50:15 (6856): No heartbeat from core client for 30 sec - exiting 09:50:16 (6856): No heartbeat from core client for 30 sec - exiting 09:50:17 (6856): No heartbeat from core client for 30 sec - exiting 09:50:18 (6856): No heartbeat from core client for 30 sec - exiting 09:50:19 (6856): No heartbeat from core client for 30 sec - exiting 09:50:20 (6856): No heartbeat from core client for 30 sec - exiting 09:54:47 (7636): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CNo Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7972, selfPID=7972, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77CC3AB3 read attempt to address 0x00000000 Engaging BOINC Windows Runtime Debugger... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7736, selfPID=7736, iMonCtr=1 Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77CC3AB3 read attempt to address 0x00000000 Engaging BOINC Windows Runtime Debugger... 11:26:57 (3780): Can't acquire lockfile (32) - waiting 35s Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77CC3AB3 read attempt to address 0x00000000 Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
14 Jun 2013 23:30:26	1276055	15823495	hadcm3n_o2w6_1980_40_008387626_0	259,200	280,304	1.0814
14 Jun 2013 11:44:03	1276055	15823495	hadcm3n_o2w6_1980_40_008387626_0	233,280	251,533	1.0782
14 Jun 2013 11:44:03	1276055	15823495	hadcm3n_o2w6_1980_40_008387626_0	207,360	223,200	1.0764
14 Jun 2013 11:44:03	1276055	15823495	hadcm3n_o2w6_1980_40_008387626_0	181,440	194,872	1.0740
12 Jun 2013 12:30:05	1276055	15823495	hadcm3n_o2w6_1980_40_008387626_0	155,520	166,666	1.0717
12 Jun 2013 12:30:05	1276055	15823495	hadcm3n_o2w6_1980_40_008387626_0	129,600	138,213	1.0665
12 Jun 2013 12:30:05	1276055	15823495	hadcm3n_o2w6_1980_40_008387626_0	103,680	109,867	1.0597
12 Jun 2013 12:30:05	1276055	15823495	hadcm3n_o2w6_1980_40_008387626_0	77,760	81,197	1.0442
12 Jun 2013 12:30:05	1276055	15823495	hadcm3n_o2w6_1980_40_008387626_0	51,840	51,221	0.9881
05 Jun 2013 03:07:54	1276055	15823495	hadcm3n_o2w6_1980_40_008387626_0	25,920	24,286	0.9370