climateprediction.net home page
Task 17363737

Task 17363737

Name hadcm3s_499q_1997_2_009155416_0
Workunit 9285752
Created 7 Nov 2014, 14:51:05 UTC
Sent 18 Nov 2014, 9:07:26 UTC
Report deadline 17 Feb 2015, 16:34:37 UTC
Received 19 Nov 2014, 19:59:06 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1344481
Run time 18 hours 25 min 11 sec
CPU time 17 hours 29 min 8 sec
Validate state Invalid
Credit 311.04
Device peak FLOPS 3.64 GFLOPS
Application version UK Met Office HadCM3 short v7.24
windows_intelx86
Stderr
<core_client_version>7.4.27</core_client_version>
<![CDATA[
<message>
The device does not recognize the command.
 (0x16) - exit code 22 (0x16)
</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    
Sorry, too many model crashes! :-(
13:43:47 (33256): called boinc_finish
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Access Violation (0xc0000005) at address 0x00459BA7 read attempt to address 0x012103AC

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.2.4


Dump Timestamp    : 11/18/14 13:59:52
Install Directory : 
Data Directory    : C:\ProgramData\BOINC
Project Symstore  : 
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\slots\3;C:\ProgramData\BOINC\projects\climateprediction.net


ModLoad: 0000000000400000 0000000000140000 C:\ProgramData\BOINC\projects\climateprediction.net\hadcm3s_7.24_windows_intelx86.exe (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000077b10000 0000000000180000 C:\Windows\SysWOW64\ntdll.dll (6.1.7601.18247) (-exported- Symbols Loaded)
    Linked PDB Filename   : wntdll.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 0000000075c80000 0000000000110000 C:\Windows\syswow64\kernel32.dll (6.1.7601.18409) (-exported- Symbols Loaded)
    Linked PDB Filename   : wkernel32.pdb
    File Version          : 6.1.7601.18015 (win7sp1_gdr.121129-1432)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.18015

ModLoad: 0000000075b00000 0000000000047000 C:\Windows\syswow64\KERNELBASE.dll (6.1.7601.18409) (-exported- Symbols Loaded)
    Linked PDB Filename   : wkernelbase.pdb
    File Version          : 6.1.7601.18015 (win7sp1_gdr.121129-1432)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.18015

ModLoad: 0000000076cb0000 0000000000100000 C:\Windows\syswow64\USER32.dll (6.1.7601.17514) (-exported- Symbols Loaded)
    Linked PDB Filename   : wuser32.pdb
    File Version          : 6.1.7601.17514 (win7sp1_rtm.101119-1850)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.17514

ModLoad: 0000000076c10000 0000000000090000 C:\Windows\syswow64\GDI32.dll (6.1.7601.18577) (-exported- Symbols Loaded)
    Linked PDB Filename   : wgdi32.pdb
    File Version          : 6.1.7601.18577 (win7sp1_gdr.140822-1508)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.18577

ModLoad: 0000000075be0000 000000000000a000 C:\Windows\syswow64\LPK.dll (6.1.7601.18177) (-exported- Symbols Loaded)
    Linked PDB Filename   : wlpk.pdb
    File Version          : 6.1.7601.18177 (win7sp1_gdr.130605-1534)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.18177

ModLoad: 0000000075900000 000000000009d000 C:\Windows\syswow64\USP10.dll (1.626.7601.18454) (-exported- Symbols Loaded)
    Linked PDB Filename   : usp10.pdb
    File Version          : 1.0626.7601.18454 (win7sp1_gdr.140424-1533)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft(R) Uniscribe Unicode script processor
    Product Version       : 1.0626.7601.18454

ModLoad: 0000000075510000 00000000000ac000 C:\Windows\syswow64\msvcrt.dll (7.0.7601.17744) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.7601.17744 (win7sp1_gdr.111215-1535)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.7601.17744

ModLoad: 0000000077670000 00000000000a0000 C:\Windows\syswow64\ADVAPI32.dll (6.1.7601.18247) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 00000000757a0000 0000000000019000 C:\Windows\SysWOW64\sechost.dll (6.1.7600.16385) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 00000000759a0000 00000000000f0000 C:\Windows\syswow64\RPCRT4.dll (6.1.7601.18532) (-exported- Symbols Loaded)
    Linked PDB Filename   : wrpcrt4.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 00000000754b0000 0000000000060000 C:\Windows\syswow64\SspiCli.dll (6.1.7601.18637) (-exported- Symbols Loaded)
    Linked PDB Filename   : wsspicli.pdb
    File Version          : 6.1.7601.18637 (win7sp1_gdr.141013-1517)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.18637

ModLoad: 00000000754a0000 000000000000c000 C:\Windows\syswow64\CRYPTBASE.dll (6.1.7600.16385) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptbase.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 0000000076e50000 0000000000060000 C:\Windows\system32\IMM32.DLL (6.1.7601.17514) (-exported- Symbols Loaded)
    Linked PDB Filename   : wimm32.pdb
    File Version          : 6.1.7601.17514 (win7sp1_rtm.101119-1850)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.17514

ModLoad: 00000000755c0000 00000000000cc000 C:\Windows\syswow64\MSCTF.dll (6.1.7600.16385) (-exported- Symbols Loaded)
    Linked PDB Filename   : msctf.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 0000000075440000 0000000000021000 C:\Windows\system32\ntmarta.dll (6.1.7600.16385) (-exported- Symbols Loaded)
    Linked PDB Filename   : ntmarta.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 0000000075bf0000 0000000000045000 C:\Windows\syswow64\WLDAP32.dll (6.1.7601.17514) (-exported- Symbols Loaded)
    Linked PDB Filename   : wldap32.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 00000000753f0000 000000000004c000 C:\Windows\system32\apphelp.dll (6.1.7601.17514) (-exported- Symbols Loaded)
    Linked PDB Filename   : apphelp.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 0000000073400000 00000000000eb000 C:\Windows\system32\dbghelp.dll (6.1.7601.17514) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 6.1.7601.17514 (win7sp1_rtm.101119-1850)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.17514

ModLoad: 0000000073c00000 0000000000009000 C:\Windows\system32\version.dll (6.1.7600.16385) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 0, Write: 0, Other 0

- I/O Transfers Counters -
Read: 0, Write: 0, Other 0

- Paged Pool Usage -
QuotaPagedPoolUsage: 0, QuotaPeakPagedPoolUsage: 0
QuotaNonPagedPoolUsage: 0, QuotaPeakNonPagedPoolUsage: 0

- Virtual Memory Usage -
VirtualSize: 0, PeakVirtualSize: 0

- Pagefile Usage -
PagefileUsage: 0, PeakPagefileUsage: 0

- Working Set Size -
WorkingSetSize: 0, PeakWorkingSetSize: 0, PageFaultCount: 0

*** Dump of thread ID 34176 (state: Initialized): ***

- Information -
Status: Base Priority: Normal, Priority: Normal, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 0.000000

- Unhandled Exception Record -
Reason: Access Violation (0xc0000005) at address 0x00459BA7 read attempt to address 0x012103AC

- Registers -
eax=00000015 ebx=80000000 ecx=00000000 edx=003ae8b8 esi=01140020 edi=00000000
eip=00459ba7 esp=0189fe90 ebp=0189fe94
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00010216

- Callstack -
ChildEBP RetAddr  Args to Child
0189fe94 0043ed7f 01140020 00000000 01140020 80000000 hadcm3s_7.24_windows_intelx86!+0x0 
0189feac 00446578 01140020 00000000 0050b458 0189fefc hadcm3s_7.24_windows_intelx86!+0x0 
0189fec0 0047ba9c 00000015 e1714f66 00000001 00000006 hadcm3s_7.24_windows_intelx86!+0x0 
0189fefc 75d373b1 00000006 e1712108 00000000 00000000 hadcm3s_7.24_windows_intelx86!+0x0 
0189ff88 75c9338a 00000006 0189ffd4 77b49f72 80000006 kernel32!CtrlRoutine+0x0 
0189ff94 77b49f72 80000006 7581f573 00000000 00000000 kernel32!BaseThreadInitThunk+0x0 
0189ffd4 77b49f45 75d371fc 80000006 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 
0189ffec 00000000 75d371fc 80000006 00000000 0f999195 ntdll!RtlInitializeExceptionChain+0x0 

*** Dump of thread ID 5468 (state: Initialized): ***

- Information -
Status: Base Priority: Normal, Priority: Normal, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 0.000000

- Registers -
eax=00000000 ebx=00000000 ecx=00000000 edx=00000000 esi=0018f99c edi=00000000
eip=77b2fd91 esp=0018f958 ebp=0018f9c0
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
0018f9c0 75b144a5 000000c8 00000000 0018f9e4 0045ed31 ntdll!ZwDelayExecution+0x0 
0018f9d0 0045ed31 000000c8 000000c8 00000000 0018fa2c KERNELBASE!Sleep+0x0 
0018f9e4 004074c9 a0000000 027f9999 004c1341 00000000 hadcm3s_7.24_windows_intelx86!+0x0 
0018fa2c 0040790a 00000001 00000000 004c1308 00000000 hadcm3s_7.24_windows_intelx86!+0x0 
0018fa5c 004086bf 00000000 e0e04cd2 00000000 00000000 hadcm3s_7.24_windows_intelx86!+0x0 
0018fd48 00408866 0018fef8 004088e5 004c1530 0018fd68 hadcm3s_7.24_windows_intelx86!+0x0 
0018fd50 004088e5 004c1530 0018fd68 00672eb0 0018fd68 hadcm3s_7.24_windows_intelx86!+0x0 
0018fef8 0047c57b 00400000 00000000 00672ef1 0000000a hadcm3s_7.24_windows_intelx86!+0x0 
0018ff88 75c9338a 7efde000 0018ffd4 77b49f72 7efde000 hadcm3s_7.24_windows_intelx86!+0x0 
0018ff94 77b49f72 7efde000 7410f573 00000000 00000000 kernel32!BaseThreadInitThunk+0x0 
0018ffd4 77b49f45 0047c5ce 7efde000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 
0018ffec 00000000 0047c5ce 7efde000 00000000 78746341 ntdll!RtlInitializeExceptionChain+0x0 

*** Dump of thread ID 31848 (state: Initialized): ***

- Information -
Status: Base Priority: Normal, Priority: Normal, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 0.000000

- Registers -
eax=00000000 ebx=00000000 ecx=00000000 edx=00000000 esi=0113fd24 edi=00000000
eip=77b2fd91 esp=0113fce0 ebp=0113fd48
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
0113fd48 75b144a5 00000064 00000000 0113ff88 0046f454 ntdll!ZwDelayExecution+0x0 
0113fd58 0046f454 00000064 00000000 00000000 00000000 KERNELBASE!Sleep+0x0 
0113ff88 75c9338a 00000000 0113ffd4 77b49f72 00000000 hadcm3s_7.24_windows_intelx86!+0x0 
0113ff94 77b49f72 00000000 751bf573 00000000 00000000 kernel32!BaseThreadInitThunk+0x0 
0113ffd4 77b49f45 0046f430 00000000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 
0113ffec 00000000 0046f430 00000000 00000000 01f40000 ntdll!RtlInitializeExceptionChain+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Signal 22 received, exiting...
12:58:16 (2748): called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2464, iMonCtr=1
Model crash detected, will try to restart...
Signal 22 received, exiting...
12:58:21 (4008): called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2464, iMonCtr=1
Model crash detected, will try to restart...
Signal 22 received, exiting...
12:58:25 (4464): called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2464, iMonCtr=1
Model crash detected, will try to restart...
Signal 22 received, exiting...
12:58:29 (4536): called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2464, iMonCtr=1
Model crash detected, will try to restart...
Signal 22 received, exiting...
12:58:32 (4552): called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2464, iMonCtr=1
Model crash detected, will try to restart...
Signal 22 received, exiting...
12:58:36 (4568): called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2464, iMonCtr=1
Model crash detected, will try to restart...
Sorry, too many model crashes! :-(
12:58:40 (2464): called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
19 Nov 2014 13:37:20 1344481 17363737 hadcm3s_499q_1997_2_009155416_0 25,920 42,676 1.6465


©2024 cpdn.org