Task 15668377

Name	hadcm3n_39mb_1940_40_008257535_2
Workunit	8412659
Created	15 Mar 2013, 14:21:38 UTC
Sent	15 Mar 2013, 14:22:41 UTC
Report deadline	14 Jun 2013, 21:49:52 UTC
Received	7 Apr 2013, 23:39:28 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1262249
Run time	7 days 5 hours 41 min 45 sec
CPU time	5 days 16 hours 28 min 32 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.14 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> - exit code -1073741819 (0xc0000005) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 16:55:14 (8220): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 20:57:32 (7112): No heartbeat from core client for 30 sec - exiting 20:57:33 (7112): No heartbeat from core client for 30 sec - exiting 20:57:34 (7112): No heartbeat from core client for 30 sec - exiting 20:57:35 (7112): No heartbeat from core client for 30 sec - exiting 20:57:36 (7112): No heartbeat from core client for 30 sec - exiting 20:57:38 (7112): No heartbeat from core client for 30 sec - exiting 20:57:39 (7112): No heartbeat from core client for 30 sec - exiting 20:57:40 (7112): No heartbeat from core client for 30 sec - exiting 20:57:41 (7112): No heartbeat from core client for 30 sec - exiting 20:57:42 (7112): No heartbeat from core client for 30 sec - exiting 20:57:43 (7112): No heartbeat from core client for 30 sec - exiting 20:57:44 (7112): No heartbeat from core client for 30 sec - exiting 20:57:45 (7112): No heartbeat from core client for 30 sec - exiting 20:57:46 (7112): No heartbeat from core client for 30 sec - exiting 20:57:47 (7112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:57:49 (7112): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:37:14 (9116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:37:16 (9116): No heartbeat from core client for 30 sec - exiting 13:38:31 (11272): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:17:19 (6124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7628, iMonCtr=1 Model crash detected, will try to restart... 11:16:57 (5444): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 07:23:10 (4408): No heartbeat from core client for 30 sec - exiting 07:23:12 (4408): No heartbeat from core client for 30 sec - exiting 07:23:13 (4408): No heartbeat from core client for 30 sec - exiting 07:23:14 (4408): No heartbeat from core client for 30 sec - exiting 07:23:15 (4408): No heartbeat from core client for 30 sec - exiting 07:23:16 (4408): No heartbeat from core client for 30 sec - exiting 07:23:17 (4408): No heartbeat from core client for 30 sec - exiting 07:23:18 (4408): No heartbeat from core client for 30 sec - exiting 07:23:19 (4408): No heartbeat from core client for 30 sec - exiting 07:23:20 (4408): No heartbeat from core client for 30 sec - exiting 07:23:21 (4408): No heartbeat from core client for 30 sec - exiting 07:23:23 (4408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 17:26:33 (6336): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 21:50:51 (8948): No heartbeat from core client for 30 sec - exiting 21:50:52 (8948): No heartbeat from core client for 30 sec - exiting 21:50:53 (8948): No heartbeat from core client for 30 sec - exiting 21:50:55 (8948): No heartbeat from core client for 30 sec - exiting 21:50:56 (8948): No heartbeat from core client for 30 sec - exiting 21:50:57 (8948): No heartbeat from core client for 30 sec - exiting 21:50:58 (8948): No heartbeat from core client for 30 sec - exiting 21:50:59 (8948): No heartbeat from core client for 30 sec - exiting 21:51:00 (8948): No heartbeat from core client for 30 sec - exiting 21:51:01 (8948): No heartbeat from core client for 30 sec - exiting 21:51:02 (8948): No heartbeat from core client for 30 sec - exiting 21:51:03 (8948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x771F3FBB read attempt to address 0x00000000 Engaging BOINC Windows Runtime Debugger... 10:47:39 (10688): No heartbeat from core client for 30 sec - exiting 10:47:42 (10688): No heartbeat from core client for 30 sec - exiting 10:47:43 (10688): No heartbeat from core client for 30 sec - exiting 10:47:44 (10688): No heartbeat from core client for 30 sec - exiting 10:47:45 (10688): No heartbeat from core client for 30 sec - exiting 10:47:46 (10688): No heartbeat from core client for 30 sec - exiting 10:47:47 (10688): No heartbeat from core client for 30 sec - exiting 10:47:48 (10688): No heartbeat from core client for 30 sec - exiting 10:47:49 (10688): No heartbeat from core client for 30 sec - exiting 10:47:50 (10688): No heartbeat from core client for 30 sec - exiting 10:47:51 (10688): No heartbeat from core client for 30 sec - exiting 10:47:52 (10688): No heartbeat from core client for 30 sec - exiting 10:47:53 (10688): No heartbeat from core client for 30 sec - exiting 10:47:54 (10688): No heartbeat from core client for 30 sec - exiting 10:47:55 (10688): No heartbeat from core client for 30 sec - exiting 10:47:56 (10688): No heartbeat from core client for 30 sec - exiting 10:47:57 (10688): No heartbeat from core client for 30 sec - exiting 10:47:58 (10688): No heartbeat from core client for 30 sec - exiting 10:47:59 (10688): No heartbeat from core client for 30 sec - exiting 10:48:00 (10688): No heartbeat from core client for 30 sec - exiting 10:48:01 (10688): No heartbeat from core client for 30 sec - exiting 10:48:02 (10688): No heartbeat from core client for 30 sec - exiting 10:48:03 (10688): No heartbeat from core client for 30 sec - exiting 10:48:04 (10688): No heartbeat from core client for 30 sec - exiting 10:48:05 (10688): No heartbeat from core client for 30 sec - exiting 10:48:06 (10688): No heartbeat from core client for 30 sec - exiting 10:48:07 (10688): No heartbeat from core client for 30 sec - exiting 10:48:08 (10688): No heartbeat from core client for 30 sec - exiting 10:48:09 (10688): No heartbeat from core client for 30 sec - exiting 10:48:10 (10688): No heartbeat from core client for 30 sec - exiting 10:48:11 (10688): No heartbeat from core client for 30 sec - exiting 10:48:12 (10688): No heartbeat from core client for 30 sec - exiting 10:48:13 (10688): No heartbeat from core client for 30 sec - exiting 10:48:14 (10688): No heartbeat from core client for 30 sec - exiting 10:48:15 (10688): No heartbeat from core client for 30 sec - exiting 10:48:16 (10688): No heartbeat from core client for 30 sec - exiting 10:48:17 (10688): No heartbeat from core client for 30 sec - exiting 10:48:18 (10688): No heartbeat from core client for 30 sec - exiting 10:48:19 (10688): No heartbeat from core client for 30 sec - exiting 10:48:20 (10688): No heartbeat from core client for 30 sec - exiting 10:48:21 (10688): No heartbeat from core client for 30 sec - exiting 10:48:22 (10688): No heartbeat from core client for 30 sec - exiting 10:48:23 (10688): No heartbeat from core client for 30 sec - exiting 10:48:24 (10688): No heartbeat from core client for 30 sec - exiting 10:48:25 (10688): No heartbeat from core client for 30 sec - exiting Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x771F71F3 read attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
06 Apr 2013 07:13:01	1262249	15668377	hadcm3n_39mb_1940_40_008257535_2	259,200	473,810	1.8280
05 Apr 2013 06:28:39	1262249	15668377	hadcm3n_39mb_1940_40_008257535_2	233,280	428,348	1.8362
02 Apr 2013 13:20:31	1262249	15668377	hadcm3n_39mb_1940_40_008257535_2	207,360	380,764	1.8362
01 Apr 2013 00:26:21	1262249	15668377	hadcm3n_39mb_1940_40_008257535_2	181,440	335,693	1.8502
30 Mar 2013 21:15:15	1262249	15668377	hadcm3n_39mb_1940_40_008257535_2	155,520	291,454	1.8741
30 Mar 2013 05:23:20	1262249	15668377	hadcm3n_39mb_1940_40_008257535_2	129,600	242,689	1.8726
29 Mar 2013 11:16:50	1262249	15668377	hadcm3n_39mb_1940_40_008257535_2	103,680	195,048	1.8813
26 Mar 2013 02:38:44	1262249	15668377	hadcm3n_39mb_1940_40_008257535_2	77,760	147,572	1.8978
23 Mar 2013 00:24:09	1262249	15668377	hadcm3n_39mb_1940_40_008257535_2	51,840	98,952	1.9088
16 Mar 2013 22:56:32	1262249	15668377	hadcm3n_39mb_1940_40_008257535_2	25,920	50,216	1.9373