climateprediction.net home page
Task 21386656

Task 21386656

Name wah2_global_e0my_200412_145_766_011655198_1
Workunit 11655198
Created 19 Nov 2018, 6:43:30 UTC
Sent 19 Nov 2018, 7:00:18 UTC
Report deadline 1 Nov 2019, 12:20:18 UTC
Received 23 Nov 2018, 12:16:38 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 0 (0x00000000)
Computer ID 1456908
Run time 2 days 9 hours 9 min 49 sec
CPU time 2 days 9 hours 9 min 49 sec
Validate state Invalid
Credit 11,403.47
Device peak FLOPS 5.14 GFLOPS
Application version Weather At Home 2 (wah2) v8.24
windows_intelx86
Peak working set size 238.51 MB
Peak swap size 175.69 MB
Peak disk usage 1,818.24 MB
Stderr
<core_client_version>7.14.2</core_client_version>
<![CDATA[
<stderr_txt>
03:14:26 (12048): Can't acquire lockfile (32) - waiting 35s
03:15:01 (12048): Can't acquire lockfile (32) - exiting
03:15:01 (12048): Error: The process cannot access the file because it is being used by another process.

 (0x20)


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x75ED1812

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.7.0


Dump Timestamp    : 11/23/18 03:35:45
Install Directory : 
Data Directory    : E:\ProgramData\BOINC
Project Symstore  : 
LoadLibraryA( E:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( E:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( E:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( E:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: E:\ProgramData\BOINC\projects\climateprediction.net\wah2_global_e0my_200412_145_766_011655198;E:\ProgramData\BOINC\projects\climateprediction.net


ModLoad: 0000000000400000 0000000000152000 E:\ProgramData\BOINC\projects\climateprediction.net\wah2_8.24_windows_intelx86.exe (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000077de0000 0000000000190000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.17134.376) (-exported- Symbols Loaded)
    Linked PDB Filename   : wntdll.pdb
    File Version          : 10.0.17134.228 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.228

ModLoad: 00000000746d0000 00000000000e0000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.17134.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : wkernel32.pdb
    File Version          : 10.0.17134.376 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.376

ModLoad: 0000000075dc0000 00000000001e4000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.17134.407) (-exported- Symbols Loaded)
    Linked PDB Filename   : wkernelbase.pdb
    File Version          : 10.0.17134.376 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.376

ModLoad: 0000000076f70000 000000000018d000 C:\WINDOWS\System32\USER32.dll (6.2.17134.376) (-exported- Symbols Loaded)
    Linked PDB Filename   : wuser32.pdb
    File Version          : 10.0.17134.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.1

ModLoad: 0000000075b30000 0000000000017000 C:\WINDOWS\System32\win32u.dll (6.2.17134.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : wwin32u.pdb
    File Version          : 10.0.17134.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.1

ModLoad: 00000000747b0000 0000000000022000 C:\WINDOWS\System32\GDI32.dll (6.2.17134.285) (-exported- Symbols Loaded)
    Linked PDB Filename   : wgdi32.pdb
    File Version          : 10.0.17134.285 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.285

ModLoad: 00000000779f0000 0000000000164000 C:\WINDOWS\System32\gdi32full.dll (6.2.17134.345) (-exported- Symbols Loaded)
    Linked PDB Filename   : wgdi32full.pdb
    File Version          : 10.0.17134.345 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.345

ModLoad: 0000000076e40000 000000000007d000 C:\WINDOWS\System32\msvcp_win.dll (6.2.17134.1) (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : msvcp_win.pdb
    File Version          : 10.0.17134.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.1

ModLoad: 0000000076c10000 000000000011e000 C:\WINDOWS\System32\ucrtbase.dll (6.2.17134.319) (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : ucrtbase.pdb
    File Version          : 10.0.17134.319 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.319

ModLoad: 0000000076ef0000 0000000000078000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.17134.319) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 10.0.17134.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.1

ModLoad: 0000000076570000 00000000000bf000 C:\WINDOWS\System32\msvcrt.dll (7.0.17134.1) (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.17134.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.17134.1

ModLoad: 0000000077710000 0000000000044000 C:\WINDOWS\System32\sechost.dll (6.2.17134.319) (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 10.0.17134.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.1

ModLoad: 0000000077910000 00000000000c0000 C:\WINDOWS\System32\RPCRT4.dll (6.2.17134.407) (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : wrpcrt4.pdb
    File Version          : 10.0.17134.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.1

ModLoad: 00000000746a0000 0000000000020000 C:\WINDOWS\System32\SspiCli.dll (6.2.17134.376) (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : wsspicli.pdb
    File Version          : 10.0.17134.376 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.376

ModLoad: 0000000074690000 000000000000a000 C:\WINDOWS\System32\CRYPTBASE.dll (6.2.17134.1) (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : cryptbase.pdb
    File Version          : 10.0.17134.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.1

ModLoad: 0000000076d30000 0000000000058000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.17134.345) (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : bcryptprimitives.pdb
    File Version          : 10.0.17134.345 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.345

ModLoad: 0000000076630000 0000000000026000 C:\WINDOWS\System32\IMM32.DLL (6.2.17134.1) (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : wimm32.pdb
    File Version          : 10.0.17134.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.1

ModLoad: 0000000073a90000 0000000000029000 C:\WINDOWS\SYSTEM32\ntmarta.dll (6.2.17134.1) (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : ntmarta.pdb
    File Version          : 10.0.17134.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.1

ModLoad: 0000000067940000 0000000000086000 E:\ProgramData\BOINC\projects\climateprediction.net\wah2_se_8.24_windows_intelx86.dll (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : F:\cpdn\cpdn\cpdnboinc\monitor\win_build\Release\umtonc.pdb

ModLoad: 0000000070200000 0000000000182000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.17134.1) (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 10.0.17134.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.1

ModLoad: 0000000074620000 0000000000008000 C:\WINDOWS\SYSTEM32\version.dll (6.2.17134.1) (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 10.0.17134.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.1



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 2038748, Write: 0, Other 1242554

- I/O Transfers Counters -
Read: 0, Write: 32796, Other 0

- Paged Pool Usage -
QuotaPagedPoolUsage: 243064, QuotaPeakPagedPoolUsage: 243064
QuotaNonPagedPoolUsage: 9504, QuotaPeakNonPagedPoolUsage: 9504

- Virtual Memory Usage -
VirtualSize: 221360128, PeakVirtualSize: 221360128

- Pagefile Usage -
PagefileUsage: 4071424, PeakPagefileUsage: 92327936

- Working Set Size -
WorkingSetSize: 81268736, PeakWorkingSetSize: 169705472, PageFaultCount: 1010047

*** Dump of thread ID 13588 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 225000000.000000, User Time: 2987812608.000000, Wait Time: 11952616.000000

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x75ED1812

- Registers -
eax=0019e690 ebx=07000048 ecx=00000003 edx=00000000 esi=679a922c edi=679bc450
eip=75ed1812 esp=0019e690 ebp=0019e6ec
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000216

- Callstack -
ChildEBP RetAddr  Args to Child
0019e6ec 6798caf9 e06d7363 00000001 00000003 0019e718 KERNELBASE!RaiseException+0x0 
0019e724 67989ebc 0019e734 679b59d8 679a922c 679ab27c wah2_se_8.24_windows_intelx86!+0x0 
0019e744 6794e42b 053ff300 07000048 004e4d99 0096e678 wah2_se_8.24_windows_intelx86!+0x0 
0019e760 679429b1 0019e798 0019e884 0019e86c 0019e860 wah2_se_8.24_windows_intelx86!+0x0 
0019e9a8 6794efac 008804a0 0019ea3d 00000000 0019eb44 wah2_se_8.24_windows_intelx86!+0x0 
0019eb44 0040bdf2 004e4d98 004e4ed0 004e4c90 00000000 wah2_se_8.24_windows_intelx86!+0x0 
0019eb7c 00401f39 001e7828 001e7860 001e7860 00000000 wah2_8.24_windows_intelx86!+0x0 
0019ebd0 004021ad 000007d9 0000000c 00000000 004cefe0 wah2_8.24_windows_intelx86!+0x0 
0019ed98 00402703 000007d9 0000000c 02590040 0019edf8 wah2_8.24_windows_intelx86!+0x0 
0019edac 0040724e 000007d9 02590040 004cefe0 004a56b0 wah2_8.24_windows_intelx86!+0x0 
0019edf8 004092c5 00000000 25059d9f 00485cce 00000000 wah2_8.24_windows_intelx86!+0x0 
0019fd40 004094b7 0019fef0 00409535 004d1370 0019fd60 wah2_8.24_windows_intelx86!+0x0 
0019fd48 00409535 004d1370 0019fd60 00714170 0019fd60 wah2_8.24_windows_intelx86!+0x0 
0019fef0 00485c7b 00400000 00000000 007141ae 0000000a wah2_8.24_windows_intelx86!+0x0 
0019ff80 746e8484 003d9000 746e8460 e52e294c 0019ffdc wah2_8.24_windows_intelx86!+0x0 
0019ff94 77e4302c 003d9000 3f86e7ec 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
0019ffdc 77e42ffa ffffffff 77e5ec66 00000000 00000000 ntdll!RtlValidSecurityDescriptor+0x0 
0019ffec 00000000 00485cce 003d9000 00000000 78746341 ntdll!RtlValidSecurityDescriptor+0x0 

*** Dump of thread ID 4740 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 1093750.000000, User Time: 156250.000000, Wait Time: 11952611.000000

- Registers -
eax=00000000 ebx=00000000 ecx=00000000 edx=00000000 esi=00000000 edi=00000001
eip=77e4a57c esp=0258fcdc ebp=0258fd40
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000202

- Callstack -
ChildEBP RetAddr  Args to Child
0258fd40 75ec70ef 00000064 00000000 0258ff80 00478b44 ntdll!NtDelayExecution+0x0 
0258fd50 00478b44 00000064 00478b20 00478b20 00000000 KERNELBASE!Sleep+0x0 
0258ff80 746e8484 00000000 746e8460 e76f294c 0258ffdc wah2_8.24_windows_intelx86!+0x0 
0258ff94 77e4302c 00000000 3dc7e7ec 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
0258ffdc 77e42ffa ffffffff 77e5ec66 00000000 00000000 ntdll!RtlValidSecurityDescriptor+0x0 
0258ffec 00000000 00478b20 00000000 00000000 32686177 ntdll!RtlValidSecurityDescriptor+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...
No Process Handle
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=12728, selfPID=9720, iMonCtr=1
No Process Handle
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=12728, selfPID=12728, iMonCtr=1
Signal 11 received: Segment violation
Signal 11 received: Software termination signal from kill 
Signal 11 received: Abnormal termination triggered by abort call
Signal 11 received, exiting...
04:15:25 (1484): called boinc_finish(193)
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6420, selfPID=6420, iMonCtr=2
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6420, selfPID=10808, iMonCtr=1
Model crash detected, will try to restart...
Leaving CPDN_ain::Monitor...
04:15:29 (10808): called boinc_finish(0)

</stderr_txt>
<message>
upload failure: <file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_61.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_62.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_63.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_64.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_65.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_66.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_67.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_68.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_69.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_70.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_71.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_72.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_73.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_74.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_75.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_76.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_77.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_78.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_79.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_80.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_81.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_82.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_83.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_84.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_85.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_86.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_87.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_88.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_89.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_90.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_91.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_92.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_93.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_94.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_95.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_96.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_97.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_98.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_99.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_100.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_101.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_102.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_103.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_104.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_105.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_106.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_107.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_108.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_109.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_110.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_111.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_112.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_113.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_114.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_115.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_116.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_117.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_118.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_119.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_120.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_121.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_122.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_123.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_124.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_125.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_126.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_127.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_128.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_129.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_130.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_131.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_132.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_133.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_134.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_135.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_136.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_137.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_138.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_139.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_140.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_141.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_142.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_143.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_144.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_145.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0my_200412_145_766_011655198_1_r1257917215_restart.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
</message>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
23 Nov 2018 10:05:25 1456908 21386656 wah2_global_e0my_200412_145_766_011655198_1 172,867 202,371 1.1707
23 Nov 2018 09:03:33 1456908 21386656 wah2_global_e0my_200412_145_766_011655198_1 169,987 199,121 1.1714
23 Nov 2018 08:01:20 1456908 21386656 wah2_global_e0my_200412_145_766_011655198_1 167,107 195,843 1.1720
23 Nov 2018 07:04:28 1456908 21386656 wah2_global_e0my_200412_145_766_011655198_1 164,227 192,558 1.1725
23 Nov 2018 07:04:28 1456908 21386656 wah2_global_e0my_200412_145_766_011655198_1 161,347 189,258 1.1730
23 Nov 2018 07:04:28 1456908 21386656 wah2_global_e0my_200412_145_766_011655198_1 158,467 185,872 1.1729
23 Nov 2018 07:04:28 1456908 21386656 wah2_global_e0my_200412_145_766_011655198_1 155,587 182,626 1.1738
23 Nov 2018 07:04:28 1456908 21386656 wah2_global_e0my_200412_145_766_011655198_1 152,707 179,388 1.1747
23 Nov 2018 07:04:28 1456908 21386656 wah2_global_e0my_200412_145_766_011655198_1 149,827 176,161 1.1758
23 Nov 2018 07:04:28 1456908 21386656 wah2_global_e0my_200412_145_766_011655198_1 146,947 172,940 1.1769
23 Nov 2018 07:04:28 1456908 21386656 wah2_global_e0my_200412_145_766_011655198_1 144,067 169,741 1.1782
23 Nov 2018 07:04:28 1456908 21386656 wah2_global_e0my_200412_145_766_011655198_1 141,187 166,536 1.1795
23 Nov 2018 07:04:28 1456908 21386656 wah2_global_e0my_200412_145_766_011655198_1 138,307 163,269 1.1805
23 Nov 2018 07:04:28 1456908 21386656 wah2_global_e0my_200412_145_766_011655198_1 135,427 159,966 1.1812
23 Nov 2018 07:04:28 1456908 21386656 wah2_global_e0my_200412_145_766_011655198_1 132,547 156,604 1.1815
23 Nov 2018 07:04:28 1456908 21386656 wah2_global_e0my_200412_145_766_011655198_1 129,667 153,224 1.1817
23 Nov 2018 07:04:28 1456908 21386656 wah2_global_e0my_200412_145_766_011655198_1 126,787 149,845 1.1819
23 Nov 2018 07:04:28 1456908 21386656 wah2_global_e0my_200412_145_766_011655198_1 123,907 146,465 1.1821
23 Nov 2018 07:04:28 1456908 21386656 wah2_global_e0my_200412_145_766_011655198_1 121,027 143,102 1.1824
23 Nov 2018 07:04:28 1456908 21386656 wah2_global_e0my_200412_145_766_011655198_1 118,147 139,729 1.1827


©2024 climateprediction.net