climateprediction.net home page
Task 18975100

Task 18975100

Name hadam3p_pnw_g4st_2015_0_010294260_0
Workunit 10152957
Created 21 Sep 2015, 19:22:02 UTC
Sent 23 Sep 2015, 14:25:01 UTC
Report deadline 4 Sep 2016, 19:45:01 UTC
Received 24 Sep 2015, 14:46:32 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 0 (0x00000000)
Computer ID 1365752
Run time 11 hours 43 min 8 sec
CPU time 11 hours 41 min 20 sec
Validate state Invalid
Credit 507.13
Device peak FLOPS 4.22 GFLOPS
Application version UK Met Office HadAM3P-HadRM3P Pacific North West v7.27
windows_intelx86
Stderr
<core_client_version>7.6.9</core_client_version>
<![CDATA[
<stderr_txt>
08:54:11 (8988): start_timer_thread(): CreateThread() failed, errno 0
08:54:13 (12864): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
17:41:12 (7184): start_timer_thread(): CreateThread() failed, errno 0
17:41:14 (6540): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
02:43:25 (14816): start_timer_thread(): CreateThread() failed, errno 0
02:43:27 (11460): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
05:59:24 (12476): start_timer_thread(): CreateThread() failed, errno 0
05:59:26 (3412): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
08:45:10 (12884): start_timer_thread(): CreateThread() failed, errno 0
Signal 11 received, exiting...
08:45:11 (12884): called boinc_finish(193)
08:45:12 (4504): start_timer_thread(): CreateThread() failed, errno 0


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x74C53E28

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.5.1


Dump Timestamp    : 09/24/15 08:45:12
Install Directory : C:\BOINC\
Data Directory    : E:\temp\BOINC
Project Symstore  : 
LoadLibraryA( C:\BOINC\\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( C:\BOINC\\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\BOINC\\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\BOINC\\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: E:\temp\BOINC\projects\climateprediction.net\hadam3p_pnw_g4st_2015_0_010294260;E:\temp\BOINC\projects\climateprediction.net


ModLoad: 00000000002e0000 00000000008c0000 E:\temp\BOINC\projects\climateprediction.net\hadrm3p_pnw_um_7.27_windows_intelx86.exe (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : F:\cpdn\cpdn\cpdnboinc\monitor\win_build\Release\hadrm3p.pdb

ModLoad: 0000000076e90000 0000000000179000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.10240.16430) (-exported- Symbols Loaded)
    Linked PDB Filename   : wntdll.pdb
    File Version          : 10.0.10240.16384 (th1.150709-1700)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.10240.16384

ModLoad: 0000000074ef0000 00000000000f0000 C:\WINDOWS\SYSTEM32\KERNEL32.DLL (6.2.10240.16384) (-exported- Symbols Loaded)
    Linked PDB Filename   : wkernel32.pdb
    File Version          : 10.0.10240.16384 (th1.150709-1700)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.10240.16384

ModLoad: 0000000074ba0000 0000000000176000 C:\WINDOWS\SYSTEM32\KERNELBASE.dll (6.2.10240.16384) (-exported- Symbols Loaded)
    Linked PDB Filename   : wkernelbase.pdb
    File Version          : 10.0.10240.16384 (th1.150709-1700)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.10240.16384

ModLoad: 0000000075340000 0000000000140000 C:\WINDOWS\SYSTEM32\USER32.dll (6.2.10240.16384) (-exported- Symbols Loaded)
    Linked PDB Filename   : wuser32.pdb
    File Version          : 10.0.10240.16384 (th1.150709-1700)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.10240.16384

ModLoad: 00000000750e0000 000000000014d000 C:\WINDOWS\SYSTEM32\GDI32.dll (6.2.10240.16390) (-exported- Symbols Loaded)
    Linked PDB Filename   : wgdi32.pdb
    File Version          : 10.0.10240.16390 (th1_st1.150714-1601)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.10240.16390

ModLoad: 00000000757f0000 000000000007b000 C:\WINDOWS\SYSTEM32\ADVAPI32.dll (6.2.10240.16384) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 10.0.10240.16384 (th1.150709-1700)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.10240.16384

ModLoad: 0000000076dd0000 00000000000be000 C:\WINDOWS\SYSTEM32\msvcrt.dll (7.0.10240.16384) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.10240.16384 (th1.150709-1700)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.10240.16384

ModLoad: 0000000076cf0000 0000000000043000 C:\WINDOWS\SYSTEM32\sechost.dll (6.2.10240.16384) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 10.0.10240.16384 (th1.150709-1700)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.10240.16384

ModLoad: 00000000755c0000 00000000000ac000 C:\WINDOWS\SYSTEM32\RPCRT4.dll (6.2.10240.16412) (-exported- Symbols Loaded)
    Linked PDB Filename   : wrpcrt4.pdb
    File Version          : 10.0.10240.16384 (th1.150709-1700)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.10240.16384

ModLoad: 0000000073f80000 000000000001e000 C:\WINDOWS\SYSTEM32\SspiCli.dll (6.2.10240.16384) (-exported- Symbols Loaded)
    Linked PDB Filename   : wsspicli.pdb
    File Version          : 10.0.10240.16384 (th1.150709-1700)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.10240.16384

ModLoad: 0000000073f70000 000000000000a000 C:\WINDOWS\SYSTEM32\CRYPTBASE.dll (6.2.10240.16384) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptbase.pdb
    File Version          : 10.0.10240.16384 (th1.150709-1700)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.10240.16384

ModLoad: 0000000073f10000 0000000000059000 C:\WINDOWS\SYSTEM32\bcryptPrimitives.dll (6.2.10240.16384) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcryptprimitives.pdb
    File Version          : 10.0.10240.16384 (th1.150709-1700)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.10240.16384

ModLoad: 0000000075480000 0000000000019000 C:\WINDOWS\SYSTEM32\imagehlp.dll (6.2.10240.16384) (-exported- Symbols Loaded)
    Linked PDB Filename   : imagehlp.pdb
    File Version          : 10.0.10240.16384 (th1.150709-1700)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.10240.16384

ModLoad: 0000000076c90000 000000000002b000 C:\WINDOWS\SYSTEM32\IMM32.DLL (6.2.10240.16384) (-exported- Symbols Loaded)
    Linked PDB Filename   : wimm32.pdb
    File Version          : 10.0.10240.16384 (th1.150709-1700)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.10240.16384

ModLoad: 00000000754a0000 0000000000120000 C:\WINDOWS\SYSTEM32\MSCTF.dll (6.2.10240.16384) (-exported- Symbols Loaded)
    Linked PDB Filename   : msctf.pdb
    File Version          : 10.0.10240.16384 (th1.150709-1700)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.10240.16384

ModLoad: 000000006f3a0000 000000000013f000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.10240.16384) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 10.0.10240.16384 (th1.150709-1700)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.10240.16384

ModLoad: 0000000073dc0000 0000000000008000 C:\WINDOWS\SYSTEM32\version.dll (6.2.10240.16384) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 10.0.10240.16384 (th1.150709-1700)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.10240.16384



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 6, Write: 0, Other 256

- I/O Transfers Counters -
Read: 0, Write: 194, Other 0

- Paged Pool Usage -
QuotaPagedPoolUsage: 150408, QuotaPeakPagedPoolUsage: 150488
QuotaNonPagedPoolUsage: 8832, QuotaPeakNonPagedPoolUsage: 8832

- Virtual Memory Usage -
VirtualSize: 1573408768, PeakVirtualSize: 1573408768

- Pagefile Usage -
PagefileUsage: 24428544, PeakPagefileUsage: 39882752

- Working Set Size -
WorkingSetSize: 5009408, PeakWorkingSetSize: 5009408, PageFaultCount: 1316

*** Dump of thread ID 13632 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 14323782.000000

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x74C53E28

- Registers -
eax=1234f2c0 ebx=7f76e000 ecx=00000003 edx=00000000 esi=006490b0 edi=0073f148
eip=74c53e28 esp=1234f2c0 ebp=1234f31c
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000216

- Callstack -
ChildEBP RetAddr  Args to Child
1234f31c 005f0a97 e06d7363 00000001 00000003 1234f348 KERNELBASE!RaiseException+0x0 
1234f354 005edc42 1234f364 00665bf4 006490b0 0065dd2c hadrm3p_pnw_um_7.27_windows_int!+0x0 
1234f374 002e8271 00fd9f80 01000000 002e7b49 48470000 hadrm3p_pnw_um_7.27_windows_int!+0x0 
1234f7a4 005efa6d 002e0000 00000000 125a2ed0 0000000a hadrm3p_pnw_um_7.27_windows_int!+0x0 
1234f834 74f03744 7f76e000 74f03720 f9990672 1234f890 hadrm3p_pnw_um_7.27_windows_int!+0x0 
1234f848 76eea064 7f76e000 5ef970ef 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
1234f890 76eea02f ffffffff 76f0d7ca 00000000 00000000 ntdll!RtlSetCurrentTransaction+0x0 
1234f8a0 00000000 005efac0 7f76e000 00000000 00000000 ntdll!RtlSetCurrentTransaction+0x0 

*** Dump of thread ID 5352 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 14323779.000000

- Registers -
eax=00000000 ebx=125a6df0 ecx=00000000 edx=00000000 esi=125a6c30 edi=125a3730
eip=76efa74c esp=23dbfa70 ebp=23dbfc24
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000212

- Callstack -
ChildEBP RetAddr  Args to Child
23dbfc24 74f03744 125a3730 74f03720 c8760202 23dbfc80 ntdll!ZwWaitForWorkViaWorkerFactory+0x0 
23dbfc38 76eea064 125a3730 6f1674ff 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
23dbfc80 76eea02f ffffffff 76f0d7ca 00000000 00000000 ntdll!RtlSetCurrentTransaction+0x0 
23dbfc90 00000000 76ec45b0 125a3730 00000000 00000000 ntdll!RtlSetCurrentTransaction+0x0 

*** Dump of thread ID 6596 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 14323779.000000

- Registers -
eax=00000000 ebx=125a7c20 ecx=00000000 edx=00000000 esi=125a7a60 edi=125a3730
eip=76efa74c esp=354dfad0 ebp=354dfc84
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000212

- Callstack -
ChildEBP RetAddr  Args to Child
354dfc84 74f03744 125a3730 74f03720 dee002a2 354dfce0 ntdll!ZwWaitForWorkViaWorkerFactory+0x0 
354dfc98 76eea064 125a3730 7980749f 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
354dfce0 76eea02f ffffffff 76f0d7ca 00000000 00000000 ntdll!RtlSetCurrentTransaction+0x0 
354dfcf0 00000000 76ec45b0 125a3730 00000000 00000000 ntdll!RtlSetCurrentTransaction+0x0 

*** Dump of thread ID 5076 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 14323779.000000

- Registers -
eax=00000000 ebx=125a8d68 ecx=00000000 edx=00000000 esi=125a8ba8 edi=125a3730
eip=76efa74c esp=46bff7c8 ebp=46bff97c
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000202

- Callstack -
ChildEBP RetAddr  Args to Child
46bff97c 74f03744 125a3730 74f03720 ad1207aa 46bff9d8 ntdll!ZwWaitForWorkViaWorkerFactory+0x0 
46bff990 76eea064 125a3730 0a7271a7 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
46bff9d8 76eea02f ffffffff 76f0d7ca 00000000 00000000 ntdll!RtlSetCurrentTransaction+0x0 
46bff9e8 00000000 76ec45b0 125a3730 00000000 00000000 ntdll!RtlSetCurrentTransaction+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4504, selfPID=14888, iMonCtr=1
Model crash detected, will try to restart...
Leaving CPDN_Main::Monitor...
08:45:20 (14888): called boinc_finish(0)

</stderr_txt>
<message>
upload failure: <file_xfer_error>
  <file_name>hadam3p_pnw_g4st_2015_0_010294260_0_3.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>hadam3p_pnw_g4st_2015_0_010294260_0_4.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>hadam3p_pnw_g4st_2015_0_010294260_0_5.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>hadam3p_pnw_g4st_2015_0_010294260_0_6.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>hadam3p_pnw_g4st_2015_0_010294260_0_7.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>hadam3p_pnw_g4st_2015_0_010294260_0_8.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>

</message>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
24 Sep 2015 01:54:32 1365752 18975100 hadam3p_pnw_g4st_2015_0_010294260_0 23,339 35,799 1.5339
23 Sep 2015 20:42:19 1365752 18975100 hadam3p_pnw_g4st_2015_0_010294260_0 11,819 17,944 1.5182


©2024 climateprediction.net