climateprediction.net home page
Task 19715143

Task 19715143

Name hadam3p_afr_d1p9_1999_1_010173058_1
Workunit 10127214
Created 24 May 2016, 16:01:05 UTC
Sent 24 May 2016, 16:16:02 UTC
Report deadline 6 May 2017, 21:36:02 UTC
Received 27 Jun 2016, 20:42:00 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 0 (0x00000000)
Computer ID 1394895
Run time 3 days 1 hours 50 min 44 sec
CPU time 3 days 0 hours 26 min 55 sec
Validate state Invalid
Credit 6,287.02
Device peak FLOPS 3.21 GFLOPS
Application version UK Met Office HadAM3P-HadRM3P Africa v7.22
windows_intelx86
Stderr
<core_client_version>7.6.22</core_client_version>
<![CDATA[
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
07:42:12 (8068): start_timer_thread(): CreateThread() failed, errno 0
07:42:13 (8288): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
17:15:43 (8972): start_timer_thread(): CreateThread() failed, errno 0
17:15:44 (9464): start_timer_thread(): CreateThread() failed, errno 0
07:42:51 (2140): start_timer_thread(): CreateThread() failed, errno 0
07:42:53 (8572): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
08:08:30 (7500): start_timer_thread(): CreateThread() failed, errno 0
08:08:32 (7756): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
20:51:15 (8172): start_timer_thread(): CreateThread() failed, errno 0
20:51:17 (6656): start_timer_thread(): CreateThread() failed, errno 0
18:43:08 (2068): start_timer_thread(): CreateThread() failed, errno 0
18:43:10 (5892): start_timer_thread(): CreateThread() failed, errno 0
19:56:55 (10236): start_timer_thread(): CreateThread() failed, errno 0
19:56:57 (7344): start_timer_thread(): CreateThread() failed, errno 0


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x753CDAE8

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.2.4


Dump Timestamp    : 06/27/16 19:56:57
Install Directory : 
Data Directory    : C:\ProgramData\BOINC
Project Symstore  : 
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\projects\climateprediction.net\hadam3p_afr_d1p9_1999_1_010173058;C:\ProgramData\BOINC\projects\climateprediction.net


ModLoad: 0000000000150000 00000000008ce000 C:\ProgramData\BOINC\projects\climateprediction.net\hadrm3p_afr_um_7.22_windows_intelx86.exe (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : G:\CPDN\cpdn\cpdn\cpdnboinc\monitor\win_build\Release\hadrm3p.pdb

ModLoad: 0000000077b20000 000000000017b000 C:\Windows\SYSTEM32\ntdll.dll (6.2.10586.306) (-exported- Symbols Loaded)
    Linked PDB Filename   : wntdll.pdb
    File Version          : 10.0.10586.0 (th2_release.151029-1700)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.10586.0

ModLoad: 0000000077810000 00000000000e0000 C:\Windows\SYSTEM32\KERNEL32.DLL (6.2.10586.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : wkernel32.pdb
    File Version          : 10.0.10586.0 (th2_release.151029-1700)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.10586.0

ModLoad: 0000000075310000 000000000017e000 C:\Windows\SYSTEM32\KERNELBASE.dll (6.2.10586.306) (-exported- Symbols Loaded)
    Linked PDB Filename   : wkernelbase.pdb
    File Version          : 10.0.10586.0 (th2_release.151029-1700)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.10586.0

ModLoad: 0000000074c20000 0000000000147000 C:\Windows\SYSTEM32\USER32.dll (6.2.10586.306) (-exported- Symbols Loaded)
    Linked PDB Filename   : wuser32.pdb
    File Version          : 10.0.10586.0 (th2_release.151029-1700)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.10586.0

ModLoad: 0000000074e60000 000000000014f000 C:\Windows\SYSTEM32\GDI32.dll (6.2.10586.420) (-exported- Symbols Loaded)
    Linked PDB Filename   : wgdi32.pdb
    File Version          : 10.0.10586.420 (th2_release_sec.160527-1834)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.10586.420

ModLoad: 00000000750c0000 000000000007b000 C:\Windows\SYSTEM32\ADVAPI32.dll (6.2.10586.63) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 10.0.10586.0 (th2_release.151029-1700)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.10586.0

ModLoad: 0000000074900000 00000000000be000 C:\Windows\SYSTEM32\msvcrt.dll (7.0.10586.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.10586.0 (th2_release.151029-1700)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.10586.0

ModLoad: 00000000758f0000 0000000000044000 C:\Windows\SYSTEM32\sechost.dll (6.2.10586.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 10.0.10586.0 (th2_release.151029-1700)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.10586.0

ModLoad: 0000000075490000 00000000000ad000 C:\Windows\SYSTEM32\RPCRT4.dll (6.2.10586.306) (-exported- Symbols Loaded)
    Linked PDB Filename   : wrpcrt4.pdb
    File Version          : 10.0.10586.0 (th2_release.151029-1700)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.10586.0

ModLoad: 0000000074850000 000000000001e000 C:\Windows\SYSTEM32\SspiCli.dll (6.2.10586.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : wsspicli.pdb
    File Version          : 10.0.10586.0 (th2_release.151029-1700)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.10586.0

ModLoad: 0000000074840000 000000000000a000 C:\Windows\SYSTEM32\CRYPTBASE.dll (6.2.10586.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptbase.pdb
    File Version          : 10.0.10586.0 (th2_release.151029-1700)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.10586.0

ModLoad: 0000000077200000 0000000000058000 C:\Windows\SYSTEM32\bcryptPrimitives.dll (6.2.10586.420) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcryptprimitives.pdb
    File Version          : 10.0.10586.420 (th2_release_sec.160527-1834)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.10586.420

ModLoad: 0000000074a80000 000000000001b000 C:\Windows\SYSTEM32\imagehlp.dll (6.2.10586.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : imagehlp.pdb
    File Version          : 10.0.10586.0 (th2_release.151029-1700)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.10586.0

ModLoad: 00000000771c0000 000000000002b000 C:\Windows\SYSTEM32\IMM32.DLL (6.2.10586.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : wimm32.pdb
    File Version          : 10.0.10586.0 (th2_release.151029-1700)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.10586.0

ModLoad: 0000000073780000 000000000013f000 C:\Windows\SYSTEM32\dbghelp.dll (6.2.10586.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 10.0.10586.0 (th2_release.151029-1700)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.10586.0

ModLoad: 0000000074830000 0000000000008000 C:\Windows\SYSTEM32\version.dll (6.2.10586.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 10.0.10586.0 (th2_release.151029-1700)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.10586.0



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 0, Write: 0, Other 0

- I/O Transfers Counters -
Read: 0, Write: 0, Other 0

- Paged Pool Usage -
QuotaPagedPoolUsage: 0, QuotaPeakPagedPoolUsage: 0
QuotaNonPagedPoolUsage: 0, QuotaPeakNonPagedPoolUsage: 0

- Virtual Memory Usage -
VirtualSize: 0, PeakVirtualSize: 0

- Pagefile Usage -
PagefileUsage: 0, PeakPagefileUsage: 0

- Working Set Size -
WorkingSetSize: 0, PeakWorkingSetSize: 0, PageFaultCount: 0

*** Dump of thread ID 9600 (state: Initialized): ***

- Information -
Status: Base Priority: Normal, Priority: Normal, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 0.000000

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x753CDAE8

- Registers -
eax=1271f828 ebx=00f7e000 ecx=00000003 edx=00000000 esi=004ba090 edi=005be720
eip=753cdae8 esp=1271f828 ebp=1271f884
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000216

- Callstack -
ChildEBP RetAddr  Args to Child
1271f884 004611b7 e06d7363 00000001 00000003 1271f8b0 KERNELBASE!RaiseException+0x0 
1271f8bc 0045e362 1271f8cc 004d6e84 004ba090 004cec4c hadrm3p_afr_um_7.22_windows_int!+0x0 
1271f8dc 00158201 00fd9f80 01000000 00157ad5 48920000 hadrm3p_afr_um_7.22_windows_int!+0x0 
1271fd0c 0046018d 00150000 00000000 129b2fff 0000000a hadrm3p_afr_um_7.22_windows_int!+0x0 
1271fd9c 778238f4 00f7e000 778238d0 aa4f5fa5 1271fdf8 hadrm3p_afr_um_7.22_windows_int!+0x0 
1271fdb0 77b85de3 00f7e000 aa01be09 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
1271fdf8 77b85dae ffffffff 77bab7c7 00000000 00000000 ntdll!RtlUnicodeStringToInteger+0x0 
1271fe08 00000000 004601e0 00f7e000 00000000 00000000 ntdll!RtlUnicodeStringToInteger+0x0 

*** Dump of thread ID 9604 (state: Initialized): ***

- Information -
Status: Base Priority: Normal, Priority: Normal, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 0.000000

- Registers -
eax=00000000 ebx=129b6fb8 ecx=00000000 edx=00000000 esi=129b6df8 edi=129b3888
eip=77b9876c esp=241cf7dc ebp=241cf994
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000202

- Callstack -
ChildEBP RetAddr  Args to Child
241cf994 778238f4 129b3888 778238d0 9c225bbd 241cf9f0 ntdll!NtWaitForWorkViaWorkerFactory+0x0 
241cf9a8 77b85de3 129b3888 9c6cba01 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
241cf9f0 77b85dae ffffffff 77bab7c7 00000000 00000000 ntdll!RtlUnicodeStringToInteger+0x0 
241cfa00 00000000 77b4c6d0 129b3888 00000000 00000000 ntdll!RtlUnicodeStringToInteger+0x0 

*** Dump of thread ID 9608 (state: Initialized): ***

- Information -
Status: Base Priority: Normal, Priority: Normal, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 0.000000

- Registers -
eax=00000000 ebx=129b7c28 ecx=00000000 edx=00000000 esi=129b7a68 edi=129b3888
eip=77b9876c esp=358efb2c ebp=358efce4
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000202

- Callstack -
ChildEBP RetAddr  Args to Child
358efce4 778238f4 129b3888 778238d0 8db05eed 358efd40 ntdll!NtWaitForWorkViaWorkerFactory+0x0 
358efcf8 77b85de3 129b3888 8dfebeb1 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
358efd40 77b85dae ffffffff 77bab7c7 00000000 00000000 ntdll!RtlUnicodeStringToInteger+0x0 
358efd50 00000000 77b4c6d0 129b3888 00000000 00000000 ntdll!RtlUnicodeStringToInteger+0x0 

*** Dump of thread ID 9612 (state: Initialized): ***

- Information -
Status: Base Priority: Normal, Priority: Normal, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 0.000000

- Registers -
eax=00000000 ebx=129b80a8 ecx=00000000 edx=00000000 esi=129b7ee8 edi=129b3888
eip=77b9876c esp=4700f760 ebp=4700f918
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000216

- Callstack -
ChildEBP RetAddr  Args to Child
4700f918 778238f4 129b3888 778238d0 ff3e5b39 4700f974 ntdll!NtWaitForWorkViaWorkerFactory+0x0 
4700f92c 77b85de3 129b3888 ff70ba85 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
4700f974 77b85dae ffffffff 77bab7c7 00000000 00000000 ntdll!RtlUnicodeStringToInteger+0x0 
4700f984 00000000 77b4c6d0 129b3888 00000000 00000000 ntdll!RtlUnicodeStringToInteger+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8036, iMonCtr=2
Model crash detected, will try to restart...
Leaving CPDN_Main::Monitor...
19:57:06 (8036): called boinc_finish

</stderr_txt>
<message>
upload failure: <file_xfer_error>
  <file_name>hadam3p_afr_d1p9_1999_1_010173058_1_7.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>hadam3p_afr_d1p9_1999_1_010173058_1_8.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>hadam3p_afr_d1p9_1999_1_010173058_1_9.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>hadam3p_afr_d1p9_1999_1_010173058_1_10.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>hadam3p_afr_d1p9_1999_1_010173058_1_11.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>hadam3p_afr_d1p9_1999_1_010173058_1_12.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>

</message>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
30 Jun 2016 15:59:15 1394895 19715143 hadam3p_afr_d1p9_1999_1_010173058_1 69,419 256,119 3.6895
20 Jun 2016 09:18:57 1394895 19715143 hadam3p_afr_d1p9_1999_1_010173058_1 57,899 214,097 3.6978
02 Jun 2016 20:21:51 1394895 19715143 hadam3p_afr_d1p9_1999_1_010173058_1 46,379 170,526 3.6768
31 May 2016 19:25:26 1394895 19715143 hadam3p_afr_d1p9_1999_1_010173058_1 34,859 127,587 3.6601
25 May 2016 17:05:37 1394895 19715143 hadam3p_afr_d1p9_1999_1_010173058_1 23,339 85,453 3.6614
25 May 2016 04:57:35 1394895 19715143 hadam3p_afr_d1p9_1999_1_010173058_1 11,819 43,693 3.6968


©2024 climateprediction.net