Task 11686183

Name	hadam3p_saf_v7jk_1991_1_006683406_0
Workunit	6886659
Created	26 Aug 2010, 11:59:33 UTC
Sent	28 Aug 2010, 4:41:58 UTC
Report deadline	10 Aug 2011, 10:01:58 UTC
Received	22 Sep 2010, 23:21:00 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1016159
Run time	4 days 6 hours 26 min 49 sec
CPU time	2 days 8 hours 11 min 45 sec
Validate state	Invalid
Credit	749.07
Device peak FLOPS	1.26 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Southern Africa v6.05 windows_intelx86
Stderr	<core_client_version>6.10.36</core_client_version> <![CDATA[ <message> - exit code -1073741819 (0xc0000005) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3864, selfPID=3864, iMonCtr=2 18:12:22 (5392): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4844, selfPID=4844, iMonCtr=2 error: cannot create hadam3p_saf_v7jk_1991_1_006683406/jobs/xaakg.namelists error: cannot create hadam3p_saf_v7jk_1991_1_006683406/jobs/xaakm.stashc error: cannot create hadam3p_saf_v7jk_1991_1_006683406/jobs/xaakg.stashc SetEntriesInAcl Error 1114 Could not create shared memory region hadam3p_saf_v7jk_1991_1_006683406, 24797344 Error in creating shared memory region! Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x00406083 write attempt to address 0x00000100 Engaging BOINC Windows Runtime Debugger... ****************** BOINC Windows Runtime Debugger Version 6.11.1 Dump Timestamp : 09/09/10 20:33:20 Install Directory : Data Directory : C:\Documents and Settings\All Users\Application Data\BOINC Project Symstore : LoadLibraryA( C:\Documents and Settings\All Users\Application Data\BOINC\dbghelp.dll ): GetLastError = 126 Loaded Library : dbghelp.dll LoadLibraryA( C:\Documents and Settings\All Users\Application Data\BOINC\symsrv.dll ): GetLastError = 126 LoadLibraryA( symsrv.dll ): GetLastError = 126 LoadLibraryA( C:\Documents and Settings\All Users\Application Data\BOINC\srcsrv.dll ): GetLastError = 126 LoadLibraryA( srcsrv.dll ): GetLastError = 126 LoadLibraryA( C:\Documents and Settings\All Users\Application Data\BOINC\version.dll ): GetLastError = 126 Loaded Library : version.dll SymInitialize(): GetLastError = 8 * Dump of the Process Statistics: * - I/O Operations Counters - Read: 11, Write: 0, Other 360 - I/O Transfers Counters - Read: 0, Write: 238, Other 0 - Paged Pool Usage - QuotaPagedPoolUsage: 23996, QuotaPeakPagedPoolUsage: 28004 QuotaNonPagedPoolUsage: 1872, QuotaPeakNonPagedPoolUsage: 2272 - Virtual Memory Usage - VirtualSize: 15454208, PeakVirtualSize: 17571840 - Pagefile Usage - PagefileUsage: 1298432, PeakPagefileUsage: 1343488 - Working Set Size - WorkingSetSize: 2117632, PeakWorkingSetSize: 2314240, PageFaultCount: 616 * Dump of thread ID 2400 (state: Waiting): * - Information - Status: Wait Reason: UserRequest, , Kernel Time: 625000.000000, User Time: 156250.000000, Wait Time: 7801133.000000 - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x00406083 write attempt to address 0x00000100 * Dump of thread ID 2988 (state: Waiting): * - Information - Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 7801133.000000 * Debug Message Dump ** * Foreground Window Data * Window Name : Window Class : Window Process ID: 0 Window Thread ID : 0 Exiting... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:02:09 (3408): No heartbeat from core client for 30 sec - exiting 15:02:10 (3408): No heartbeat from core client for 30 sec - exiting 15:02:11 (3408): No heartbeat from core client for 30 sec - exiting 15:02:12 (3408): No heartbeat from core client for 30 sec - exiting 15:02:13 (3408): No heartbeat from core client for 30 sec - exiting 15:02:14 (3408): No heartbeat from core client for 30 sec - exiting 15:02:15 (3408): No heartbeat from core client for 30 sec - exiting 15:02:17 (3408): No heartbeat from core client for 30 sec - exiting 15:02:18 (3408): No heartbeat from core client for 30 sec - exiting 15:02:19 (3408): No heartbeat from core client for 30 sec - exiting 15:02:20 (3408): No heartbeat from core client for 30 sec - exiting 15:02:21 (3408): No heartbeat from core client for 30 sec - exiting 15:02:22 (3408): No heartbeat from core client for 30 sec - exiting 15:02:23 (3408): No heartbeat from core client for 30 sec - exiting 15:02:24 (3408): No heartbeat from core client for 30 sec - exiting 15:02:25 (3408): No heartbeat from core client for 30 sec - exiting 15:02:26 (3408): No heartbeat from core client for 30 sec - exiting 15:02:28 (3408): No heartbeat from core client for 30 sec - exiting 15:02:29 (3408): No heartbeat from core client for 30 sec - exiting 15:02:30 (3408): No heartbeat from core client for 30 sec - exiting 15:02:31 (3408): No heartbeat from core client for 30 sec - exiting 15:02:32 (3408): No heartbeat from core client for 30 sec - exiting 15:02:33 (3408): No heartbeat from core client for 30 sec - exiting 15:02:34 (3408): No heartbeat from core client for 30 sec - exiting 15:02:35 (3408): No heartbeat from core client for 30 sec - exiting 15:02:36 (3408): No heartbeat from core client for 30 sec - exiting 15:02:37 (3408): No heartbeat from core client for 30 sec - exiting 15:02:38 (3408): No heartbeat from core client for 30 sec - exiting 15:02:40 (3408): No heartbeat from core client for 30 sec - exiting 15:02:41 (3408): No heartbeat from core client for 30 sec - exiting 15:02:42 (3408): No heartbeat from core client for 30 sec - exiting 15:02:43 (3408): No heartbeat from core client for 30 sec - exiting 15:02:44 (3408): No heartbeat from core client for 30 sec - exiting 15:02:45 (3408): No heartbeat from core client for 30 sec - exiting 15:02:46 (3408): No heartbeat from core client for 30 sec - exiting 15:02:47 (3408): No heartbeat from core client for 30 sec - exiting 15:02:48 (3408): No heartbeat from core client for 30 sec - exiting 15:02:49 (3408): No heartbeat from core client for 30 sec - exiting 15:02:51 (3408): No heartbeat from core client for 30 sec - exiting 15:02:52 (3408): No heartbeat from core client for 30 sec - exiting 15:02:53 (3408): No heartbeat from core client for 30 sec - exiting 15:02:54 (3408): No heartbeat from core client for 30 sec - exiting 15:02:55 (3408): No heartbeat from core client for 30 sec - exiting 15:02:56 (3408): No heartbeat from core client for 30 sec - exiting 15:02:57 (3408): No heartbeat from core client for 30 sec - exiting 15:02:58 (3408): No heartbeat from core client for 30 sec - exiting 15:02:59 (3408): No heartbeat from core client for 30 sec - exiting 15:03:00 (3408): No heartbeat from core client for 30 sec - exiting 15:03:02 (3408): No heartbeat from core client for 30 sec - exiting 15:03:03 (3408): No heartbeat from core client for 30 sec - exiting 15:03:04 (3408): No heartbeat from core client for 30 sec - exiting 15:03:05 (3408): No heartbeat from core client for 30 sec - exiting 15:03:06 (3408): No heartbeat from core client for 30 sec - exiting 15:03:07 (3408): No heartbeat from core client for 30 sec - exiting 15:03:08 (3408): No heartbeat from core client for 30 sec - exiting 15:03:09 (3408): No heartbeat from core client for 30 sec - exiting 15:03:10 (3408): No heartbeat from core client for 30 sec - exiting 15:03:11 (3408): No heartbeat from core client for 30 sec - exiting 15:03:12 (3408): No heartbeat from core client for 30 sec - exiting 15:03:14 (3408): No heartbeat from core client for 30 sec - exiting 15:03:15 (3408): No heartbeat from core client for 30 sec - exiting 15:03:16 (3408): No heartbeat from core client for 30 sec - exiting 15:03:17 (3408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3468, selfPID=3468, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1040, selfPID=1040, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2776, selfPID=2776, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1508, selfPID=1508, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 11:07:25 (2372): No heartbeat from core client for 30 sec - exiting 11:07:26 (2372): No heartbeat from core client for 30 sec - exiting 11:07:27 (2372): No heartbeat from core client for 30 sec - exiting 11:07:28 (2372): No heartbeat from core client for 30 sec - exiting 11:07:29 (2372): No heartbeat from core client for 30 sec - exiting 11:07:30 (2372): No heartbeat from core client for 30 sec - exiting 11:07:31 (2372): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2200, selfPID=2200, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 12:43:17 (3600): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3648, selfPID=3648, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 12:51:27 (3360): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:18:46 (2904): No heartbeat from core client for 30 sec - exiting 15:18:47 (2904): No heartbeat from core client for 30 sec - exiting 15:18:48 (2904): No heartbeat from core client for 30 sec - exiting 15:18:49 (2904): No heartbeat from core client for 30 sec - exiting 15:18:50 (2904): No heartbeat from core client for 30 sec - exiting 15:18:51 (2904): No heartbeat from core client for 30 sec - exiting 15:18:52 (2904): No heartbeat from core client for 30 sec - exiting 15:18:53 (2904): No heartbeat from core client for 30 sec - exiting 15:18:54 (2904): No heartbeat from core client for 30 sec - exiting 15:18:55 (2904): No heartbeat from core client for 30 sec - exiting 15:18:56 (2904): No heartbeat from core client for 30 sec - exiting 15:18:58 (2904): No heartbeat from core client for 30 sec - exiting 15:18:59 (2904): No heartbeat from core client for 30 sec - exiting 15:19:00 (2904): No heartbeat from core client for 30 sec - exiting 15:19:01 (2904): No heartbeat from core client for 30 sec - exiting 15:19:02 (2904): No heartbeat from core client for 30 sec - exiting 15:19:03 (2904): No heartbeat from core client for 30 sec - exiting 15:19:04 (2904): No heartbeat from core client for 30 sec - exiting 15:19:05 (2904): No heartbeat from core client for 30 sec - exiting 15:19:06 (2904): No heartbeat from core client for 30 sec - exiting 15:19:07 (2904): No heartbeat from core client for 30 sec - exiting 15:19:08 (2904): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:33:44 (1764): No heartbeat from core client for 30 sec - exiting 15:33:45 (1764): No heartbeat from core client for 30 sec - exiting 15:33:47 (1764): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2904, selfPID=2904, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Could not create shared memory region hadam3p_saf_v7jk_1991_1_006683406, 24797344 Error in creating shared memory region! Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x00406083 write attempt to address 0x00000100 Engaging BOINC Windows Runtime Debugger... **************** BOINC Windows Runtime Debugger Version 6.11.1 Dump Timestamp : 09/22/10 19:19:54 Install Directory : C:\Program Files\BOINC\ Data Directory : C:\Documents and Settings\All Users\Application Data\BOINC Project Symstore : Loaded Library : C:\Program Files\BOINC\\dbghelp.dll Loaded Library : C:\Program Files\BOINC\\symsrv.dll Loaded Library : C:\Program Files\BOINC\\srcsrv.dll LoadLibraryA( C:\Program Files\BOINC\\version.dll ): GetLastError = 126 Loaded Library : version.dll SymInitialize(): GetLastError = 8 * Dump of the Process Statistics: * - I/O Operations Counters - Read: 7, Write: 0, Other 329 - I/O Transfers Counters - Read: 0, Write: 142, Other 0 - Paged Pool Usage - QuotaPagedPoolUsage: 28004, QuotaPeakPagedPoolUsage: 28004 QuotaNonPagedPoolUsage: 2072, QuotaPeakNonPagedPoolUsage: 2224 - Virtual Memory Usage - VirtualSize: 16523264, PeakVirtualSize: 16523264 - Pagefile Usage - PagefileUsage: 1425408, PeakPagefileUsage: 1425408 - Working Set Size - WorkingSetSize: 2293760, PeakWorkingSetSize: 2293760, PageFaultCount: 555 * Dump of thread ID 3620 (state: Ready): * - Information - Status: Base Priority: Above Normal, Priority: Above Normal, , Kernel Time: 625000.000000, User Time: 156250.000000, Wait Time: 13364056.000000 - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x00406083 write attempt to address 0x00000100 * Dump of thread ID 572 (state: Waiting): * - Information - Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 13364053.000000 * Debug Message Dump ** * Foreground Window Data *** Window Name : Window Class : Window Process ID: 0 Window Thread ID : 0 Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
21 Sep 2010 22:51:56	1016159	11686183	hadam3p_saf_v7jk_1991_1_006683406_0	46,176	158,588	3.4344
15 Sep 2010 18:27:14	1016159	11686183	hadam3p_saf_v7jk_1991_1_006683406_0	34,656	88,258	2.5467
14 Sep 2010 04:20:17	1016159	11686183	hadam3p_saf_v7jk_1991_1_006683406_0	23,136	17,376	0.7510
08 Sep 2010 21:51:01	1016159	11686183	hadam3p_saf_v7jk_1991_1_006683406_0	11,619	73,349	6.3128
08 Sep 2010 20:32:30	1016159	11686183	hadam3p_saf_v7jk_1991_1_006683406_0	11,616	72,354	6.2288