Task 13555015

Name	hadcm3n_yj8d_1900_40_007524651_0
Workunit	7722126
Created	28 Oct 2011, 13:32:05 UTC
Sent	30 Oct 2011, 19:31:34 UTC
Report deadline	30 Jan 2012, 2:58:45 UTC
Received	30 Nov 2011, 21:55:03 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1021505
Run time	8 days 7 hours 9 min 6 sec
CPU time	7 days 4 hours 32 min 48 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.35 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> - exit code -1073741819 (0xc0000005) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 05:54:33 (9548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:54:34 (9548): No heartbeat from core client for 30 sec - exiting 05:54:35 (9548): No heartbeat from core client for 30 sec - exiting 05:54:36 (9548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8308, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 00:06:53 (7136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:06:54 (7136): No heartbeat from core client for 30 sec - exiting 00:06:55 (7136): No heartbeat from core client for 30 sec - exiting 00:06:56 (7136): No heartbeat from core client for 30 sec - exiting 00:06:57 (7136): No heartbeat from core client for 30 sec - exiting 00:06:58 (7136): No heartbeat from core client for 30 sec - exiting 00:06:59 (7136): No heartbeat from core client for 30 sec - exiting 00:07:01 (7136): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:28:45 (664): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 01:01:27 (6020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 04:38:48 (8760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:19:20 (8156): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:19:21 (8156): No heartbeat from core client for 30 sec - exiting 05:19:22 (8156): No heartbeat from core client for 30 sec - exiting 05:19:23 (8156): No heartbeat from core client for 30 sec - exiting 05:19:24 (8156): No heartbeat from core client for 30 sec - exiting 05:19:25 (8156): No heartbeat from core client for 30 sec - exiting 05:19:26 (8156): No heartbeat from core client for 30 sec - exiting 05:19:27 (8156): No heartbeat from core client for 30 sec - exiting 05:19:28 (8156): No heartbeat from core client for 30 sec - exiting 05:19:29 (8156): No heartbeat from core client for 30 sec - exiting 05:19:30 (8156): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:06:04 (6476): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:06:29 (6476): No heartbeat from core client for 30 sec - exiting 00:07:00 (9372): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:07:01 (9372): No heartbeat from core client for 30 sec - exiting 00:07:02 (9372): No heartbeat from core client for 30 sec - exiting 00:07:04 (9372): No heartbeat from core client for 30 sec - exiting 00:07:05 (9372): No heartbeat from core client for 30 sec - exiting 00:07:06 (9372): No heartbeat from core client for 30 sec - exiting 00:07:07 (9372): No heartbeat from core client for 30 sec - exiting 00:07:08 (9372): No heartbeat from core client for 30 sec - exiting 00:07:09 (9372): No heartbeat from core client for 30 sec - exiting 00:07:10 (9372): No heartbeat from core client for 30 sec - exiting 00:07:11 (9372): No heartbeat from core client for 30 sec - exiting 00:08:16 (8428): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:10:12 (8844): No heartbeat from core client for 30 sec - exiting 00:10:13 (8844): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:11:32 (8924): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:12:29 (7248): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:14:45 (6536): No heartbeat from core client for 30 sec - exiting 00:14:46 (6536): No heartbeat from core client for 30 sec - exiting 00:14:47 (6536): No heartbeat from core client for 30 sec - exiting 00:14:48 (6536): No heartbeat from core client for 30 sec - exiting 00:14:49 (6536): No heartbeat from core client for 30 sec - exiting 00:14:50 (6536): No heartbeat from core client for 30 sec - exiting 00:14:51 (6536): No heartbeat from core client for 30 sec - exiting 00:14:52 (6536): No heartbeat from core client for 30 sec - exiting 00:14:53 (6536): No heartbeat from core client for 30 sec - exiting 00:14:54 (6536): No heartbeat from core client for 30 sec - exiting 00:14:55 (6536): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:18:03 (9484): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:20:10 (9580): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:21:07 (7084): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:22:14 (9864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:22:15 (9864): No heartbeat from core client for 30 sec - exiting 00:22:16 (9864): No heartbeat from core client for 30 sec - exiting 00:22:17 (9864): No heartbeat from core client for 30 sec - exiting 00:22:18 (9864): No heartbeat from core client for 30 sec - exiting 00:22:51 (8964): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:22:52 (8964): No heartbeat from core client for 30 sec - exiting 00:22:53 (8964): No heartbeat from core client for 30 sec - exiting 00:22:54 (8964): No heartbeat from core client for 30 sec - exiting 00:22:55 (8964): No heartbeat from core client for 30 sec - exiting 00:22:56 (8964): No heartbeat from core client for 30 sec - exiting 00:22:57 (8964): No heartbeat from core client for 30 sec - exiting 00:22:58 (8964): No heartbeat from core client for 30 sec - exiting 00:22:59 (8964): No heartbeat from core client for 30 sec - exiting 00:23:00 (8964): No heartbeat from core client for 30 sec - exiting 00:23:01 (8964): No heartbeat from core client for 30 sec - exiting 00:23:50 (1864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:27:38 (8328): No heartbeat from core client for 30 sec - exiting 00:27:41 (8328): No heartbeat from core client for 30 sec - exiting 00:27:46 (8328): No heartbeat from core client for 30 sec - exiting 00:27:47 (8328): No heartbeat from core client for 30 sec - exiting 00:27:53 (8328): No heartbeat from core client for 30 sec - exiting 00:27:54 (8328): No heartbeat from core client for 30 sec - exiting 00:27:55 (8328): No heartbeat from core client for 30 sec - exiting 00:27:56 (8328): No heartbeat from core client for 30 sec - exiting 00:27:58 (8328): No heartbeat from core client for 30 sec - exiting 00:28:02 (8328): No heartbeat from core client for 30 sec - exiting 00:28:04 (8328): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:28:06 (8328): No heartbeat from core client for 30 sec - exiting 00:29:55 (9116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:29:56 (9116): No heartbeat from core client for 30 sec - exiting 00:29:57 (9116): No heartbeat from core client for 30 sec - exiting 00:29:58 (9116): No heartbeat from core client for 30 sec - exiting 00:29:59 (9116): No heartbeat from core client for 30 sec - exiting 00:30:00 (9116): No heartbeat from core client for 30 sec - exiting 00:30:01 (9116): No heartbeat from core client for 30 sec - exiting 00:31:27 (8444): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:32:40 (6784): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:34:22 (9420): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:34:25 (9420): No heartbeat from core client for 30 sec - exiting 00:37:08 (7276): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:37:09 (7276): No heartbeat from core client for 30 sec - exiting 00:37:10 (7276): No heartbeat from core client for 30 sec - exiting 00:37:11 (7276): No heartbeat from core client for 30 sec - exiting 00:37:12 (7276): No heartbeat from core client for 30 sec - exiting 00:37:13 (7276): No heartbeat from core client for 30 sec - exiting 00:38:39 (10160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:38:40 (10160): No heartbeat from core client for 30 sec - exiting 00:38:41 (10160): No heartbeat from core client for 30 sec - exiting 00:38:42 (10160): No heartbeat from core client for 30 sec - exiting 00:38:43 (10160): No heartbeat from core client for 30 sec - exiting 00:38:44 (10160): No heartbeat from core client for 30 sec - exiting 00:38:45 (10160): No heartbeat from core client for 30 sec - exiting 00:38:46 (10160): No heartbeat from core client for 30 sec - exiting 00:38:47 (10160): No heartbeat from core client for 30 sec - exiting 00:38:48 (10160): No heartbeat from core client for 30 sec - exiting 00:38:49 (10160): No heartbeat from core client for 30 sec - exiting 00:41:08 (9200): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:42:01 (8056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:42:56 (9548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:44:26 (8588): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:44:29 (8588): No heartbeat from core client for 30 sec - exiting 00:49:06 (7016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x770271F5 read attempt to address 0x404EE316 Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x771C3A93 read attempt to address 0x404EE316 Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
30 Nov 2011 18:09:24	1021505	13555015	hadcm3n_yj8d_1900_40_007524651_0	259,200	611,595	2.3595
27 Nov 2011 19:40:37	1021505	13555015	hadcm3n_yj8d_1900_40_007524651_0	233,280	552,505	2.3684
24 Nov 2011 17:39:01	1021505	13555015	hadcm3n_yj8d_1900_40_007524651_0	207,360	491,759	2.3715
19 Nov 2011 18:47:53	1021505	13555015	hadcm3n_yj8d_1900_40_007524651_0	181,440	424,794	2.3412
16 Nov 2011 20:54:43	1021505	13555015	hadcm3n_yj8d_1900_40_007524651_0	155,520	367,165	2.3609
15 Nov 2011 17:16:46	1021505	13555015	hadcm3n_yj8d_1900_40_007524651_0	129,600	302,656	2.3353
15 Nov 2011 17:16:46	1021505	13555015	hadcm3n_yj8d_1900_40_007524651_0	103,680	236,656	2.2826
07 Nov 2011 20:29:30	1021505	13555015	hadcm3n_yj8d_1900_40_007524651_0	77,760	177,481	2.2824
05 Nov 2011 16:37:29	1021505	13555015	hadcm3n_yj8d_1900_40_007524651_0	51,840	120,947	2.3331
02 Nov 2011 19:34:19	1021505	13555015	hadcm3n_yj8d_1900_40_007524651_0	25,920	61,573	2.3755