climateprediction.net home page
Task 18645855

Task 18645855

Name hadam3p_pnw_pppi_2013_1_009980899_0
Workunit 9987257
Created 29 Jun 2015, 18:33:47 UTC
Sent 12 Jul 2015, 12:27:23 UTC
Report deadline 23 Jun 2016, 17:47:23 UTC
Received 15 Aug 2015, 12:28:06 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status -529697949 (0xE06D7363) Unknown error code
Computer ID 1241225
Run time 28 days 8 hours 21 min 40 sec
CPU time 19 days 8 hours 55 min 56 sec
Validate state Invalid
Credit 3,761.23
Device peak FLOPS 1.33 GFLOPS
Application version UK Met Office HadAM3P-HadRM3P Pacific North West v7.27
windows_intelx86
Stderr
<core_client_version>7.2.28</core_client_version>
<![CDATA[
<message>
(unknown error) - exit code -529697949 (0xe06d7363)
</message>
<stderr_txt>


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x76D3C42D

Engaging BOINC Windows Runtime Debugger...



Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Access Violation (0xc0000005) at address 0x0046FA60 read attempt to address 0x00000044

Engaging BOINC Windows Runtime Debugger...

BUFFOUT: C I/O Error - Return code = 32

Model crashed: 
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3760, iMonCtr=2
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7512, iMonCtr=2
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3960, selfPID=4872, iMonCtr=1
Model crash detected, will try to restart...
Leaving CPDN_Main::Monitor...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
GController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6876, selfPID=3064, iMonCtr=1
Model crash detected, will try to restart...
Leaving CPDN_Main::Monitor...


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x74A7C42D

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.5.1


Dump Timestamp    : 08/14/15 13:27:13
Install Directory : 
Data Directory    : C:\ProgramData\BOINC
Project Symstore  : 
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\projects\climateprediction.net\hadam3p_pnw_pppi_2013_1_009980899;C:\ProgramData\BOINC\projects\climateprediction.net


ModLoad: 0000000000400000 000000000018e000 C:\ProgramData\BOINC\projects\climateprediction.net\hadam3p_pnw_7.27_windows_intelx86.exe (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000077020000 0000000000180000 C:\Windows\SysWOW64\ntdll.dll (6.1.7601.18933) (-exported- Symbols Loaded)
    Linked PDB Filename   : wntdll.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 0000000075f80000 0000000000110000 C:\Windows\syswow64\kernel32.dll (6.1.7601.18933) (-exported- Symbols Loaded)
    Linked PDB Filename   : wkernel32.pdb
    File Version          : 6.1.7601.18015 (win7sp1_gdr.121129-1432)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.18015

ModLoad: 0000000074a70000 0000000000047000 C:\Windows\syswow64\KERNELBASE.dll (6.1.7601.18933) (-exported- Symbols Loaded)
    Linked PDB Filename   : wkernelbase.pdb
    File Version          : 6.1.7601.18015 (win7sp1_gdr.121129-1432)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.18015

ModLoad: 0000000076480000 0000000000100000 C:\Windows\syswow64\USER32.dll (6.1.7601.17514) (-exported- Symbols Loaded)
    Linked PDB Filename   : wuser32.pdb
    File Version          : 6.1.7601.17514 (win7sp1_rtm.101119-1850)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.17514

ModLoad: 0000000075060000 0000000000090000 C:\Windows\syswow64\GDI32.dll (6.1.7601.18898) (-exported- Symbols Loaded)
    Linked PDB Filename   : wgdi32.pdb
    File Version          : 6.1.7601.18898 (win7sp1_gdr.150617-0600)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.18898

ModLoad: 0000000076470000 000000000000a000 C:\Windows\syswow64\LPK.dll (6.1.7601.18946) (-exported- Symbols Loaded)
    Linked PDB Filename   : wlpk.pdb
    File Version          : 6.1.7601.18946 (win7sp1_gdr.150730-0600)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.18946

ModLoad: 0000000074ad0000 000000000009d000 C:\Windows\syswow64\USP10.dll (1.626.7601.18454) (-exported- Symbols Loaded)
    Linked PDB Filename   : usp10.pdb
    File Version          : 1.0626.7601.18454 (win7sp1_gdr.140424-1533)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft(R) Uniscribe Unicode script processor
    Product Version       : 1.0626.7601.18454

ModLoad: 0000000076390000 00000000000ac000 C:\Windows\syswow64\msvcrt.dll (7.0.7601.17744) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.7601.17744 (win7sp1_gdr.111215-1535)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.7601.17744

ModLoad: 0000000076090000 00000000000a1000 C:\Windows\syswow64\ADVAPI32.dll (6.1.7601.18869) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 6.1.7601.18869 (win7sp1_gdr.150525-0603)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.18869

ModLoad: 0000000074cf0000 0000000000019000 C:\Windows\SysWOW64\sechost.dll (6.1.7601.18869) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 00000000767c0000 00000000000f0000 C:\Windows\syswow64\RPCRT4.dll (6.1.7601.18933) (-exported- Symbols Loaded)
    Linked PDB Filename   : wrpcrt4.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 0000000074990000 0000000000060000 C:\Windows\syswow64\SspiCli.dll (6.1.7601.18933) (-exported- Symbols Loaded)
    Linked PDB Filename   : wsspicli.pdb
    File Version          : 6.1.7601.18933 (win7sp1_gdr.150715-0600)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.18933

ModLoad: 0000000074980000 000000000000c000 C:\Windows\syswow64\CRYPTBASE.dll (6.1.7601.18933) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptbase.pdb
    File Version          : 6.1.7601.18933 (win7sp1_gdr.150715-0600)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.18933

ModLoad: 00000000768b0000 0000000000060000 C:\Windows\system32\IMM32.DLL (6.1.7601.17514) (-exported- Symbols Loaded)
    Linked PDB Filename   : wimm32.pdb
    File Version          : 6.1.7601.17514 (win7sp1_rtm.101119-1850)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.17514

ModLoad: 0000000074c00000 00000000000cc000 C:\Windows\syswow64\MSCTF.dll (6.1.7601.18731) (-exported- Symbols Loaded)
    Linked PDB Filename   : msctf.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 000000006d480000 0000000000021000 C:\Windows\system32\ntmarta.dll (6.1.7600.16385) (-exported- Symbols Loaded)
    Linked PDB Filename   : ntmarta.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 0000000074e60000 0000000000045000 C:\Windows\syswow64\WLDAP32.dll (6.1.7601.17514) (-exported- Symbols Loaded)
    Linked PDB Filename   : wldap32.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 00000000743d0000 000000000004c000 C:\Windows\system32\apphelp.dll (6.1.7601.18777) (-exported- Symbols Loaded)
    Linked PDB Filename   : apphelp.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 000000006de10000 0000000000085000 C:\ProgramData\BOINC\projects\climateprediction.net\hadam3p_pnw_se_7.27_windows_intelx86.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : F:\cpdn\cpdn\cpdnboinc\monitor\win_build\Release\umtonc.pdb

ModLoad: 000000006d2a0000 00000000000eb000 C:\Windows\system32\dbghelp.dll (6.1.7601.17514) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 6.1.7601.17514 (win7sp1_rtm.101119-1850)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.17514

ModLoad: 0000000074530000 0000000000009000 C:\Windows\system32\version.dll (6.1.7600.16385) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 22838, Write: 0, Other 9427

- I/O Transfers Counters -
Read: 0, Write: 11556, Other 0

- Paged Pool Usage -
QuotaPagedPoolUsage: 138744, QuotaPeakPagedPoolUsage: 138744
QuotaNonPagedPoolUsage: 7928, QuotaPeakNonPagedPoolUsage: 8528

- Virtual Memory Usage -
VirtualSize: 78487552, PeakVirtualSize: 96624640

- Pagefile Usage -
PagefileUsage: 3268608, PeakPagefileUsage: 23625728

- Working Set Size -
WorkingSetSize: 10457088, PeakWorkingSetSize: 50638848, PageFaultCount: 18418

*** Dump of thread ID 6592 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 27300176.000000, User Time: 134628864.000000, Wait Time: 12295369.000000

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x74A7C42D

- Registers -
eax=0018f21c ebx=03d48cc8 ecx=00000003 edx=00000000 esi=6de78228 edi=6de8b450
eip=74a7c42d esp=0018f21c ebp=0018f26c
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000202

- Callstack -
ChildEBP RetAddr  Args to Child
0018f26c 6de5c859 e06d7363 00000001 00000003 0018f298 KERNELBASE!RaiseException+0x0 
0018f2a4 6de59d5c 0018f2b4 6de849b8 6de78228 6de7a27c hadam3p_pnw_se_7.27_windows_int!umtonc+0x0 
0018f2c4 6de1e4fb 0135a918 03d48cc8 00521e99 03e38110 hadam3p_pnw_se_7.27_windows_int!umtonc+0x0 
0018f2e4 6de129f1 0018f31c 0018f408 0018f3f0 0018f3e4 hadam3p_pnw_se_7.27_windows_int!+0x0 
0018f52c 6de1f03c 03d39798 0018f5c1 00000000 0018f6c8 hadam3p_pnw_se_7.27_windows_int!+0x0 
0018f6c8 0040b96c 00521e98 00521fd0 00521d90 00000000 hadam3p_pnw_se_7.27_windows_int!umtonc+0x0 
0018f700 00401e45 00299bf8 00299c84 00299c84 00000000 hadam3p_pnw_7.27_windows_intelx!+0x0 
0018f750 00401f24 000007df 00000003 004cdfe0 004a3538 hadam3p_pnw_7.27_windows_intelx!+0x0 
0018f9f8 004022d6 000007df 00000003 020a0040 0018fa58 hadam3p_pnw_7.27_windows_intelx!+0x0 
0018fa0c 00403593 000007df 020a0040 004cdfe0 004a3d8c hadam3p_pnw_7.27_windows_intelx!+0x0 
0018fa58 00404d76 00000000 70e4c529 00000000 00000000 hadam3p_pnw_7.27_windows_intelx!+0x0 
0018fd48 00404f67 0018fef8 00404fe5 004d02a8 0018fd68 hadam3p_pnw_7.27_windows_intelx!+0x0 
0018fd50 00404fe5 004d02a8 0018fd68 006827e8 0018fd68 hadam3p_pnw_7.27_windows_intelx!+0x0 
0018fef8 00484e1b 00400000 00000000 0068282d 0000000a hadam3p_pnw_7.27_windows_intelx!+0x0 
0018ff88 75f9336a 7efde000 0018ffd4 77059882 7efde000 hadam3p_pnw_7.27_windows_intelx!+0x0 
0018ff94 77059882 7efde000 77027bba 00000000 00000000 kernel32!BaseThreadInitThunk+0x0 
0018ffd4 77059855 00484e6e 7efde000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 
0018ffec 00000000 00484e6e 7efde000 00000000 78746341 ntdll!RtlInitializeExceptionChain+0x0 

*** Dump of thread ID 6456 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 6084039.000000, User Time: 17472112.000000, Wait Time: 12295364.000000

- Registers -
eax=00000000 ebx=00000000 ecx=00000000 edx=00000000 esi=0209fd24 edi=00000000
eip=7703fdd1 esp=0209fce0 ebp=0209fd48
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
0209fd48 74a844ab 00000064 00000000 0209ff88 00477e94 ntdll!ZwDelayExecution+0x0 
0209fd58 00477e94 00000064 00000000 00000000 00000000 KERNELBASE!Sleep+0x0 
0209ff88 75f9336a 00000000 0209ffd4 77059882 00000000 hadam3p_pnw_7.27_windows_intelx!+0x0 
0209ff94 77059882 00000000 75137bba 00000000 00000000 kernel32!BaseThreadInitThunk+0x0 
0209ffd4 77059855 00477e70 00000000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 
0209ffec 00000000 00477e70 00000000 00000000 61646168 ntdll!RtlInitializeExceptionChain+0x0 

*** Dump of thread ID 11372 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 5396952.000000

- Registers -
eax=00000000 ebx=7705c4f8 ecx=00000000 edx=00000000 esi=006a7d38 edi=00000000
eip=7704019d esp=03a2fdf4 ebp=03a2ff88
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
03a2ff88 75f9336a 00000000 03a2ffd4 77059882 006a7d38 ntdll!NtWaitForMultipleObjects+0x0 
03a2ff94 77059882 006a7d38 74b87bba 00000000 00000000 kernel32!BaseThreadInitThunk+0x0 
03a2ffd4 77059855 7705c557 006a7d38 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 
03a2ffec 00000000 7705c557 006a7d38 00000000 00000010 ntdll!RtlInitializeExceptionChain+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6080, selfPID=6080, iMonCtr=1

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
13 Aug 2015 06:32:55 1241225 18645855 hadam3p_pnw_pppi_2013_1_009980899_0 173,099 1,572,688 9.0855
11 Aug 2015 13:12:20 1241225 18645855 hadam3p_pnw_pppi_2013_1_009980899_0 161,579 1,470,979 9.1038
10 Aug 2015 10:19:31 1241225 18645855 hadam3p_pnw_pppi_2013_1_009980899_0 150,059 1,377,388 9.1790
09 Aug 2015 06:09:02 1241225 18645855 hadam3p_pnw_pppi_2013_1_009980899_0 138,539 1,281,931 9.2532
07 Aug 2015 10:51:26 1241225 18645855 hadam3p_pnw_pppi_2013_1_009980899_0 127,019 1,171,862 9.2259
05 Aug 2015 05:38:10 1241225 18645855 hadam3p_pnw_pppi_2013_1_009980899_0 115,499 1,062,428 9.1986
03 Aug 2015 11:56:12 1241225 18645855 hadam3p_pnw_pppi_2013_1_009980899_0 103,979 959,417 9.2270
01 Aug 2015 22:49:29 1241225 18645855 hadam3p_pnw_pppi_2013_1_009980899_0 92,459 860,488 9.3067
31 Jul 2015 00:34:16 1241225 18645855 hadam3p_pnw_pppi_2013_1_009980899_0 80,939 749,569 9.2609
28 Jul 2015 20:27:07 1241225 18645855 hadam3p_pnw_pppi_2013_1_009980899_0 69,419 638,209 9.1936
26 Jul 2015 14:17:36 1241225 18645855 hadam3p_pnw_pppi_2013_1_009980899_0 57,899 527,884 9.1173
24 Jul 2015 15:35:13 1241225 18645855 hadam3p_pnw_pppi_2013_1_009980899_0 46,379 424,549 9.1539
20 Jul 2015 20:34:58 1241225 18645855 hadam3p_pnw_pppi_2013_1_009980899_0 34,859 322,911 9.2633
19 Jul 2015 02:32:27 1241225 18645855 hadam3p_pnw_pppi_2013_1_009980899_0 23,339 222,152 9.5185
16 Jul 2015 21:23:00 1241225 18645855 hadam3p_pnw_pppi_2013_1_009980899_0 11,819 116,613 9.8666


©2024 cpdn.org