climateprediction.net home page
Task 18744228

Task 18744228

Name hadam3p_pnw_pwag_2013_1_009988955_1
Workunit 9995313
Created 29 Jul 2015, 13:20:41 UTC
Sent 29 Jul 2015, 13:21:15 UTC
Report deadline 10 Jul 2016, 18:41:15 UTC
Received 1 Aug 2015, 8:31:22 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 0 (0x00000000)
Computer ID 1342123
Run time 2 days 6 hours 59 min 23 sec
CPU time 2 days 4 hours 47 min 53 sec
Validate state Invalid
Credit 2,009.02
Device peak FLOPS 4.55 GFLOPS
Application version UK Met Office HadAM3P-HadRM3P Pacific North West v7.27
windows_intelx86
Stderr 
<core_client_version>7.4.42</core_client_version>
<![CDATA[
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
10:09:09 (2420): start_timer_thread(): CreateThread() failed, errno 0
10:09:10 (3008): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
18:05:45 (3160): start_timer_thread(): CreateThread() failed, errno 0
18:05:47 (184): start_timer_thread(): CreateThread() failed, errno 0
22:45:00 (7244): Can't acquire lockfile (32) - waiting 35s
22:45:35 (7244): Can't acquire lockfile (32) - exiting
22:45:35 (7244): Error: Het proces heeft geen toegang tot het bestand omdat het door een ander

proces wordt gebruikt.

 (0x20)
23:09:39 (3140): BOINC client no longer exists - exiting
23:09:39 (3140): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:11:17 (7552): start_timer_thread(): CreateThread() failed, errno 0
23:11:18 (9564): start_timer_thread(): CreateThread() failed, errno 0
23:11:50 (1152): BOINC client no longer exists - exiting
23:11:50 (1152): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:15:06 (11132): start_timer_thread(): CreateThread() failed, errno 0
23:15:08 (8868): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
01:14:36 (8632): start_timer_thread(): CreateThread() failed, errno 0
01:14:38 (7424): start_timer_thread(): CreateThread() failed, errno 0
01:48:51 (9848): Can't acquire lockfile (32) - waiting 35s
01:49:16 (4316): Can't acquire lockfile (32) - waiting 35s
01:49:26 (9848): Can't acquire lockfile (32) - exiting
01:49:27 (9848): Error: Het proces heeft geen toegang tot het bestand omdat het door een ander

proces wordt gebruikt.

 (0x20)
01:49:51 (4316): Can't acquire lockfile (32) - exiting
01:49:51 (4316): Error: Het proces heeft geen toegang tot het bestand omdat het door een ander

proces wordt gebruikt.

 (0x20)


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x777A3E28

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.5.1


Dump Timestamp    : 07/31/15 02:03:17
Install Directory : 
Data Directory    : D:\ProgramData\BOINC
Project Symstore  : 
LoadLibraryA( D:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( D:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( D:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( D:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: D:\ProgramData\BOINC\projects\climateprediction.net\hadam3p_pnw_pwag_2013_1_009988955;D:\ProgramData\BOINC\projects\climateprediction.net


ModLoad: 0000000000400000 000000000018e000 D:\ProgramData\BOINC\projects\climateprediction.net\hadam3p_pnw_7.27_windows_intelx86.exe (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000077900000 0000000000179000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.10240.16392) (-exported- Symbols Loaded)
    Linked PDB Filename   : wntdll.pdb
    File Version          : 10.0.10240.16384 (th1.150709-1700)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174;-besturingssysteem
    Product Version       : 10.0.10240.16384

ModLoad: 0000000074e20000 00000000000f0000 C:\WINDOWS\SYSTEM32\KERNEL32.DLL (6.2.10240.16384) (-exported- Symbols Loaded)
    Linked PDB Filename   : wkernel32.pdb
    File Version          : 10.0.10240.16384 (th1.150709-1700)
    Company Name          : Microsoft Corporation
    Product Name          : Besturingssysteem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.10240.16384

ModLoad: 00000000776f0000 0000000000176000 C:\WINDOWS\SYSTEM32\KERNELBASE.dll (6.2.10240.16384) (-exported- Symbols Loaded)
    Linked PDB Filename   : wkernelbase.pdb
    File Version          : 10.0.10240.16384 (th1.150709-1700)
    Company Name          : Microsoft Corporation
    Product Name          : Besturingssysteem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.10240.16384

ModLoad: 00000000774e0000 0000000000140000 C:\WINDOWS\SYSTEM32\USER32.dll (6.2.10240.16384) (-exported- Symbols Loaded)
    Linked PDB Filename   : wuser32.pdb
    File Version          : 10.0.10240.16384 (th1.150709-1700)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174;-besturingssysteem
    Product Version       : 10.0.10240.16384

ModLoad: 0000000074a40000 000000000014d000 C:\WINDOWS\SYSTEM32\GDI32.dll (6.2.10240.16390) (-exported- Symbols Loaded)
    Linked PDB Filename   : wgdi32.pdb
    File Version          : 10.0.10240.16390 (th1_st1.150714-1601)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.10240.16390

ModLoad: 0000000074f10000 000000000007b000 C:\WINDOWS\SYSTEM32\ADVAPI32.dll (6.2.10240.16384) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 10.0.10240.16384 (th1.150709-1700)
    Company Name          : Microsoft Corporation
    Product Name          : Besturingssysteem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.10240.16384

ModLoad: 0000000077630000 00000000000be000 C:\WINDOWS\SYSTEM32\msvcrt.dll (7.0.10240.16384) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.10240.16384 (th1.150709-1700)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.10240.16384

ModLoad: 0000000074ba0000 0000000000043000 C:\WINDOWS\SYSTEM32\sechost.dll (6.2.10240.16384) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 10.0.10240.16384 (th1.150709-1700)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.10240.16384

ModLoad: 0000000077430000 00000000000ac000 C:\WINDOWS\SYSTEM32\RPCRT4.dll (6.2.10240.16384) (-exported- Symbols Loaded)
    Linked PDB Filename   : wrpcrt4.pdb
    File Version          : 10.0.10240.16384 (th1.150709-1700)
    Company Name          : Microsoft Corporation
    Product Name          : Besturingssysteem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.10240.16384

ModLoad: 00000000749f0000 000000000001e000 C:\WINDOWS\SYSTEM32\SspiCli.dll (6.2.10240.16384) (-exported- Symbols Loaded)
    Linked PDB Filename   : wsspicli.pdb
    File Version          : 10.0.10240.16384 (th1.150709-1700)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.10240.16384

ModLoad: 00000000749e0000 000000000000a000 C:\WINDOWS\SYSTEM32\CRYPTBASE.dll (6.2.10240.16384) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptbase.pdb
    File Version          : 10.0.10240.16384 (th1.150709-1700)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.10240.16384

ModLoad: 0000000074980000 0000000000059000 C:\WINDOWS\SYSTEM32\bcryptPrimitives.dll (6.2.10240.16384) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcryptprimitives.pdb
    File Version          : 10.0.10240.16384 (th1.150709-1700)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.10240.16384

ModLoad: 0000000074a10000 000000000002b000 C:\WINDOWS\SYSTEM32\IMM32.DLL (6.2.10240.16384) (-exported- Symbols Loaded)
    Linked PDB Filename   : wimm32.pdb
    File Version          : 10.0.10240.16384 (th1.150709-1700)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.10240.16384

ModLoad: 0000000074fe0000 0000000000120000 C:\WINDOWS\SYSTEM32\MSCTF.dll (6.2.10240.16384) (-exported- Symbols Loaded)
    Linked PDB Filename   : msctf.pdb
    File Version          : 10.0.10240.16384 (th1.150709-1700)
    Company Name          : Microsoft Corporation
    Product Name          : Besturingssysteem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.10240.16384

ModLoad: 00000000725c0000 000000000007f000 D:\Program Files (x86)\AVG\AVG2015\avghookx.dll (15.0.0.6081) (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : D:\build\user\2015_0630_090501_SmallUpdate2015-06_release_AvCompile\source\build\avcli_smoke_utils\RU_MT_SLL!Win32_vs110\bin\Release_Unicode_MT_SLL_vs110\Win32\avghookx.pdb
    File Version          : 15.0.0.6081
    Company Name          : AVG Technologies CZ, s.r.o.
    Product Name          : AVG Internet Security
    Product Version       : 15.0.0.6081

ModLoad: 0000000070a10000 0000000000028000 C:\WINDOWS\SYSTEM32\ntmarta.dll (6.2.10240.16384) (-exported- Symbols Loaded)
    Linked PDB Filename   : ntmarta.pdb
    File Version          : 10.0.10240.16384 (th1.150709-1700)
    Company Name          : Microsoft Corporation
    Product Name          : Besturingssysteem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.10240.16384

ModLoad: 000000006cf70000 0000000000085000 D:\ProgramData\BOINC\projects\climateprediction.net\hadam3p_pnw_se_7.27_windows_intelx86.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : F:\cpdn\cpdn\cpdnboinc\monitor\win_build\Release\umtonc.pdb

ModLoad: 000000006c830000 000000000013f000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.10240.16384) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 10.0.10240.16384 (th1.150709-1700)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.10240.16384

ModLoad: 0000000074970000 0000000000008000 C:\WINDOWS\SYSTEM32\version.dll (6.2.10240.16384) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 10.0.10240.16384 (th1.150709-1700)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.10240.16384



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 5872, Write: 0, Other 282

- I/O Transfers Counters -
Read: 0, Write: 2805, Other 0

- Paged Pool Usage -
QuotaPagedPoolUsage: 137864, QuotaPeakPagedPoolUsage: 137864
QuotaNonPagedPoolUsage: 8768, QuotaPeakNonPagedPoolUsage: 8896

- Virtual Memory Usage -
VirtualSize: 94769152, PeakVirtualSize: 94769152

- Pagefile Usage -
PagefileUsage: 3563520, PeakPagefileUsage: 23126016

- Working Set Size -
WorkingSetSize: 3362816, PeakWorkingSetSize: 29765632, PageFaultCount: 69724

*** Dump of thread ID 8196 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 2031250.000000, User Time: 7812500.000000, Wait Time: 3671435.000000

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x777A3E28

- Registers -
eax=0019f208 ebx=007db1c8 ecx=00000003 edx=00000000 esi=6cfd8228 edi=6cfeb450
eip=777a3e28 esp=0019f208 ebp=0019f264
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000212

- Callstack -
ChildEBP RetAddr  Args to Child
0019f264 6cfbc859 e06d7363 00000001 00000003 0019f290 KERNELBASE!RaiseException+0x0 
0019f29c 6cfb9d5c 0019f2ac 6cfe49b8 6cfd8228 6cfda27c hadam3p_pnw_se_7.27_windows_int!umtonc+0x0 
0019f2bc 6cf7e4fb 0135a918 007db1c8 00521e99 00920b90 hadam3p_pnw_se_7.27_windows_int!umtonc+0x0 
0019f2dc 6cf729f1 0019f314 0019f400 0019f3e8 0019f3dc hadam3p_pnw_se_7.27_windows_int!+0x0 
0019f524 6cf7f03c 00920840 0019f5b9 00000000 0019f6c0 hadam3p_pnw_se_7.27_windows_int!+0x0 
0019f6c0 0040b96c 00521e98 00521fd0 00521d90 00000000 hadam3p_pnw_se_7.27_windows_int!umtonc+0x0 
0019f6f8 00401e45 022e04d0 022e055c 022e055c 00000000 hadam3p_pnw_7.27_windows_intelx!+0x0 
0019f748 00401f24 000007de 00000005 004cdfe0 004a3538 hadam3p_pnw_7.27_windows_intelx!+0x0 
0019f9f0 004022d6 000007de 00000005 024f0040 0019fa50 hadam3p_pnw_7.27_windows_intelx!+0x0 
0019fa04 00403593 000007de 024f0040 004cdfe0 004a3d8c hadam3p_pnw_7.27_windows_intelx!+0x0 
0019fa50 00404d76 00000000 2fb48669 00484e6e 00000000 hadam3p_pnw_7.27_windows_intelx!+0x0 
0019fd40 00404f67 0019fef0 00404fe5 004d02a8 0019fd60 hadam3p_pnw_7.27_windows_intelx!+0x0 
0019fd48 00404fe5 004d02a8 0019fd60 00293590 0019fd60 hadam3p_pnw_7.27_windows_intelx!+0x0 
0019fef0 00484e1b 00400000 00000000 002935d5 0000000a hadam3p_pnw_7.27_windows_intelx!+0x0 
0019ff80 74e33744 7ffde000 74e33720 fd6ad4f2 0019ffdc hadam3p_pnw_7.27_windows_intelx!+0x0 
0019ff94 7795a064 7ffde000 6f5f9e8b 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
0019ffdc 7795a02f ffffffff 7797d7cb 00000000 00000000 ntdll!RtlSetCurrentTransaction+0x0 
0019ffec 00000000 00484e6e 7ffde000 00000000 78746341 ntdll!RtlSetCurrentTransaction+0x0 

*** Dump of thread ID 216 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 3671429.000000

- Registers -
eax=00000000 ebx=024efd1c ecx=00000000 edx=00000000 esi=00000000 edi=00000001
eip=77968f2c esp=024efcdc ebp=024efd40
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000202

- Callstack -
ChildEBP RetAddr  Args to Child
024efd40 777a131f 00000064 00000000 024eff80 00477e94 ntdll!NtDelayExecution+0x0 
024efd50 00477e94 00000064 00477e70 00477e70 00000000 KERNELBASE!Sleep+0x0 
024eff80 74e33744 00000000 74e33720 ff3dd4f2 024effdc hadam3p_pnw_7.27_windows_intelx!+0x0 
024eff94 7795a064 00000000 6d089e8b 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
024effdc 7795a02f ffffffff 7797d7cb 00000000 00000000 ntdll!RtlSetCurrentTransaction+0x0 
024f008c 02600001 07de07dd 000043e0 0000cb50 00000000 ntdll!RtlSetCurrentTransaction+0x0 
00000000 00000000 00000000 00000000 00000000 00000000 ntdll!+0x0 SymFromAddr(): GetLastError = '126' SymGetLineFromAddr(): GetLastError = '126' SymGetModuleInfo(): GetLastError = '126' Address = '02600001'


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...
No Process Handle
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8632, selfPID=8632, iMonCtr=1
No Process Handle
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8632, selfPID=7424, iMonCtr=1
09:56:20 (7208): start_timer_thread(): CreateThread() failed, errno 0
09:33:09 (7588): BOINC client no longer exists - exiting
09:33:09 (7588): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:13:30 (9524): start_timer_thread(): CreateThread() failed, errno 0
10:13:32 (8456): start_timer_thread(): CreateThread() failed, errno 0
Signal 11 received, exiting...
10:13:56 (9524): called boinc_finish(193)
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8456, selfPID=8456, iMonCtr=2
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8456, selfPID=4404, iMonCtr=1
Model crash detected, will try to restart...
Leaving CPDN_Main::Monitor...
10:14:22 (4404): called boinc_finish(0)

</stderr_txt>
<message>
upload failure: <file_xfer_error>
  <file_name>hadam3p_pnw_pwag_2013_1_009988955_1_9.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>hadam3p_pnw_pwag_2013_1_009988955_1_10.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>hadam3p_pnw_pwag_2013_1_009988955_1_11.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>hadam3p_pnw_pwag_2013_1_009988955_1_12.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>hadam3p_pnw_pwag_2013_1_009988955_1_13.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>hadam3p_pnw_pwag_2013_1_009988955_1_14.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>hadam3p_pnw_pwag_2013_1_009988955_1_15.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>hadam3p_pnw_pwag_2013_1_009988955_1_16.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>hadam3p_pnw_pwag_2013_1_009988955_1_17.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>hadam3p_pnw_pwag_2013_1_009988955_1_18.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>

</message>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
31 Jul 2015 23:50:20 1342123 18744228 hadam3p_pnw_pwag_2013_1_009988955_1 92,459 164,944 1.7840
31 Jul 2015 15:16:49 1342123 18744228 hadam3p_pnw_pwag_2013_1_009988955_1 80,939 137,734 1.7017
31 Jul 2015 08:13:47 1342123 18744228 hadam3p_pnw_pwag_2013_1_009988955_1 69,419 113,444 1.6342
30 Jul 2015 18:52:32 1342123 18744228 hadam3p_pnw_pwag_2013_1_009988955_1 57,899 96,483 1.6664
30 Jul 2015 13:50:51 1342123 18744228 hadam3p_pnw_pwag_2013_1_009988955_1 46,379 77,577 1.6727
30 Jul 2015 07:48:10 1342123 18744228 hadam3p_pnw_pwag_2013_1_009988955_1 34,859 57,947 1.6623
30 Jul 2015 01:48:38 1342123 18744228 hadam3p_pnw_pwag_2013_1_009988955_1 23,339 36,907 1.5813
29 Jul 2015 19:39:10 1342123 18744228 hadam3p_pnw_pwag_2013_1_009988955_1 11,819 18,919 1.6007


©2024 climateprediction.net