Task 15925315

Name	hadcm3n_o3jg_1980_40_008400506_3
Workunit	8551362
Created	18 Aug 2013, 15:06:12 UTC
Sent	18 Aug 2013, 15:06:21 UTC
Report deadline	17 Nov 2013, 22:33:32 UTC
Received	2 Oct 2013, 12:38:05 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1188287
Run time	6 days 4 hours 51 min 54 sec
CPU time	5 days 11 hours 2 min 48 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.31 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> (unknown error) - exit code -1073741819 (0xc0000005) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:33:53 (4456): No heartbeat from core client for 30 sec - exiting 13:33:54 (4456): No heartbeat from core client for 30 sec - exiting 13:33:55 (4456): No heartbeat from core client for 30 sec - exiting 13:33:56 (4456): No heartbeat from core client for 30 sec - exiting 13:33:58 (4456): No heartbeat from core client for 30 sec - exiting 13:33:59 (4456): No heartbeat from core client for 30 sec - exiting 13:34:00 (4456): No heartbeat from core client for 30 sec - exiting 13:34:01 (4456): No heartbeat from core client for 30 sec - exiting 13:34:02 (4456): No heartbeat from core client for 30 sec - exiting 13:34:03 (4456): No heartbeat from core client for 30 sec - exiting 13:34:04 (4456): No heartbeat from core client for 30 sec - exiting 13:34:05 (4456): No heartbeat from core client for 30 sec - exiting 13:34:06 (4456): No heartbeat from core client for 30 sec - exiting 13:34:07 (4456): No heartbeat from core client for 30 sec - exiting 13:34:08 (4456): No heartbeat from core client for 30 sec - exiting 13:34:10 (4456): No heartbeat from core client for 30 sec - exiting 13:34:11 (4456): No heartbeat from core client for 30 sec - exiting 13:34:12 (4456): No heartbeat from core client for 30 sec - exiting 13:34:13 (4456): No heartbeat from core client for 30 sec - exiting 13:34:14 (4456): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1784, iMonCtr=1 Model crash detected, will try to restart... 15:40:23 (956): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:57:15 (6168): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:58:00 (7160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 17:44:26 (5808): No heartbeat from core client for 30 sec - exiting 17:44:27 (5808): No heartbeat from core client for 30 sec - exiting 17:44:28 (5808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:44:29 (5808): No heartbeat from core client for 30 sec - exiting 17:44:31 (5808): No heartbeat from core client for 30 sec - exiting 17:44:32 (5808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... C10:20:48 (5992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:25:05 (2224): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7076, iMonCtr=1 Model crash detected, will try to restart... 08:17:15 (980): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:17:17 (980): No heartbeat from core client for 30 sec - exiting 08:18:22 (720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:19:01 (3532): No heartbeat from core client for 30 sec - exiting 08:19:02 (3532): No heartbeat from core client for 30 sec - exiting 08:19:03 (3532): No heartbeat from core client for 30 sec - exiting 08:19:04 (3532): No heartbeat from core client for 30 sec - exiting 08:19:05 (3532): No heartbeat from core client for 30 sec - exiting 08:19:06 (3532): No heartbeat from core client for 30 sec - exiting 08:19:07 (3532): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:24:00 (3604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:24:01 (3604): No heartbeat from core client for 30 sec - exiting 12:24:02 (3604): No heartbeat from core client for 30 sec - exiting 12:24:03 (3604): No heartbeat from core client for 30 sec - exiting 12:24:04 (3604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:07:52 (4624): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:08:50 (7984): No heartbeat from core client for 30 sec - exiting 18:08:51 (7984): No heartbeat from core client for 30 sec - exiting 18:08:52 (7984): No heartbeat from core client for 30 sec - exiting 18:08:53 (7984): No heartbeat from core client for 30 sec - exiting 18:08:54 (7984): No heartbeat from core client for 30 sec - exiting 18:08:55 (7984): No heartbeat from core client for 30 sec - exiting 18:08:56 (7984): No heartbeat from core client for 30 sec - exiting 18:08:57 (7984): No heartbeat from core client for 30 sec - exiting 18:08:58 (7984): No heartbeat from core client for 30 sec - exiting 18:08:59 (7984): No heartbeat from core client for 30 sec - exiting 18:09:00 (7984): No heartbeat from core client for 30 sec - exiting 18:09:01 (7984): No heartbeat from core client for 30 sec - exiting 18:09:02 (7984): No heartbeat from core client for 30 sec - exiting 18:09:03 (7984): No heartbeat from core client for 30 sec - exiting 18:09:04 (7984): No heartbeat from core client for 30 sec - exiting 18:09:05 (7984): No heartbeat from core client for 30 sec - exiting 18:09:06 (7984): No heartbeat from core client for 30 sec - exiting 18:09:07 (7984): No heartbeat from core client for 30 sec - exiting 18:09:08 (7984): No heartbeat from core client for 30 sec - exiting 18:09:09 (7984): No heartbeat from core client for 30 sec - exiting 18:09:10 (7984): No heartbeat from core client for 30 sec - exiting 18:09:11 (7984): No heartbeat from core client for 30 sec - exiting 18:09:12 (7984): No heartbeat from core client for 30 sec - exiting 18:09:13 (7984): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:09:14 (7984): No heartbeat from core client for 30 sec - exiting 18:09:15 (7984): No heartbeat from core client for 30 sec - exiting 18:09:16 (7984): No heartbeat from core client for 30 sec - exiting 18:09:17 (7984): No heartbeat from core client for 30 sec - exiting 18:09:18 (7984): No heartbeat from core client for 30 sec - exiting 18:09:19 (7984): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 14:31:06 (6048): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:31:08 (6048): No heartbeat from core client for 30 sec - exiting 14:31:50 (4808): No heartbeat from core client for 30 sec - exiting 14:31:51 (4808): No heartbeat from core client for 30 sec - exiting 14:31:52 (4808): No heartbeat from core client for 30 sec - exiting 14:31:53 (4808): No heartbeat from core client for 30 sec - exiting 14:31:55 (4808): No heartbeat from core client for 30 sec - exiting 14:31:56 (4808): No heartbeat from core client for 30 sec - exiting 14:31:57 (4808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:50:38 (11508): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:50:39 (11508): No heartbeat from core client for 30 sec - exiting 17:51:45 (6128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:27:17 (5592): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:28:01 (6920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:30:24 (7060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:31:32 (6896): No heartbeat from core client for 30 sec - exiting 15:31:33 (6896): No heartbeat from core client for 30 sec - exiting 15:31:34 (6896): No heartbeat from core client for 30 sec - exiting 15:31:35 (6896): No heartbeat from core client for 30 sec - exiting 15:31:36 (6896): No heartbeat from core client for 30 sec - exiting 15:31:37 (6896): No heartbeat from core client for 30 sec - exiting 15:31:38 (6896): No heartbeat from core client for 30 sec - exiting 15:31:39 (6896): No heartbeat from core client for 30 sec - exiting 15:31:40 (6896): No heartbeat from core client for 30 sec - exiting 15:31:41 (6896): No heartbeat from core client for 30 sec - exiting 15:31:42 (6896): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7272, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:15:12 (5064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:16:58 (4400): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:17:04 (4400): No heartbeat from core client for 30 sec - exiting 18:17:05 (4400): No heartbeat from core client for 30 sec - exiting 18:17:06 (4400): No heartbeat from core client for 30 sec - exiting 18:17:07 (4400): No heartbeat from core client for 30 sec - exiting 18:17:08 (4400): No heartbeat from core client for 30 sec - exiting 18:17:09 (4400): No heartbeat from core client for 30 sec - exiting 18:17:10 (4400): No heartbeat from core client for 30 sec - exiting 18:17:11 (4400): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold CPDN Monitor - Quit request from BOINC... 18:33:43 (8032): No heartbeat from core client for 30 sec - exiting 18:33:44 (8032): No heartbeat from core client for 30 sec - exiting 18:33:45 (8032): No heartbeat from core client for 30 sec - exiting 18:33:46 (8032): No heartbeat from core client for 30 sec - exiting 18:33:47 (8032): No heartbeat from core client for 30 sec - exiting 18:33:48 (8032): No heartbeat from core client for 30 sec - exiting 18:33:49 (8032): No heartbeat from core client for 30 sec - exiting 18:33:51 (8032): No heartbeat from core client for 30 sec - exiting 18:33:52 (8032): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:33:53 (8032): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:10:37 (4944): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 16:16:07 (6600): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x770FC3EB write attempt to address 0x3EE861E1 Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
29 Sep 2013 19:39:16	1188287	15925315	hadcm3n_o3jg_1980_40_008400506_3	259,200	471,685	1.8198
19 Sep 2013 16:21:34	1188287	15925315	hadcm3n_o3jg_1980_40_008400506_3	233,280	421,938	1.8087
13 Sep 2013 20:38:42	1188287	15925315	hadcm3n_o3jg_1980_40_008400506_3	207,360	374,176	1.8045
10 Sep 2013 18:52:08	1188287	15925315	hadcm3n_o3jg_1980_40_008400506_3	181,440	328,724	1.8118
01 Sep 2013 19:38:51	1188287	15925315	hadcm3n_o3jg_1980_40_008400506_3	155,520	281,354	1.8091
28 Aug 2013 14:35:05	1188287	15925315	hadcm3n_o3jg_1980_40_008400506_3	129,600	235,633	1.8182
27 Aug 2013 09:30:52	1188287	15925315	hadcm3n_o3jg_1980_40_008400506_3	103,680	189,007	1.8230
23 Aug 2013 16:58:30	1188287	15925315	hadcm3n_o3jg_1980_40_008400506_3	77,760	140,118	1.8019
21 Aug 2013 16:38:29	1188287	15925315	hadcm3n_o3jg_1980_40_008400506_3	51,840	92,151	1.7776
19 Aug 2013 21:38:59	1188287	15925315	hadcm3n_o3jg_1980_40_008400506_3	25,920	44,907	1.7325