climateprediction.net home page
Task 16151926

Task 16151926

Name hadcm3n_8593_1980_40_008464763_1
Workunit 8615602
Created 20 Dec 2013, 19:39:46 UTC
Sent 20 Dec 2013, 19:39:59 UTC
Report deadline 22 Mar 2014, 3:07:10 UTC
Received 22 Apr 2014, 15:41:19 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status -529697949 (0xE06D7363) Unknown error code
Computer ID 1283167
Run time 12 days 20 hours 59 min 58 sec
CPU time 12 days 4 hours 33 min 13 sec
Validate state Invalid
Credit 5,598.72
Device peak FLOPS 3.22 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
windows_intelx86
Stderr 
<core_client_version>7.2.33</core_client_version>
<![CDATA[
<message>
(unknown error) - exit code -529697949 (0xe06d7363)
</message>
<stderr_txt>
15:13:51 (2056): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:36:58 (3364): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...

Model crashed: TEMPHIST: Write ERROR on history file for namelistNLIHISTO                                                                                                                                                                                                      tmp/pipe_dummy                                                                  2048    
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 22 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=12364, iMonCtr=1
Model crash detected, will try to restart...
Signal 22 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=12364, iMonCtr=1
Model crash detected, will try to restart...
Signal 22 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=12364, iMonCtr=1
Model crash detected, will try to restart...
Signal 22 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=12364, iMonCtr=1
Model crash detected, will try to restart...
Signal 22 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=12364, iMonCtr=1
Model crash detected, will try to restart...
Sorry, too many model crashes! :-(
Called boinc_finish
20:17:03 (3044): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x7776C41F

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 6.13.0


Dump Timestamp    : 04/22/14 17:34:47
Install Directory : 
Data Directory    : C:\ProgramData\BOINC
Project Symstore  : 
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\projects\climateprediction.net\hadcm3n_8593_1980_40_008464763;C:\ProgramData\BOINC\projects\climateprediction.net


ModLoad: 00400000 00111000 C:\ProgramData\BOINC\projects\climateprediction.net\hadcm3n_6.07_windows_intelx86.exe (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 77bb0000 00180000 C:\Windows\SysWOW64\ntdll.dll (6.1.7601.17725) (-exported- Symbols Loaded)
    Linked PDB Filename   : wntdll.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : System operacyjny Microsoft&#174; Windows&#174;
    Product Version       : 6.1.7600.16385

ModLoad: 76a30000 00110000 C:\Windows\syswow64\kernel32.dll (6.1.7601.18015) (-exported- Symbols Loaded)
    Linked PDB Filename   : wkernel32.pdb
    File Version          : 6.1.7601.18015 (win7sp1_gdr.121129-1432)
    Company Name          : Microsoft Corporation
    Product Name          : System operacyjny Microsoft&#174; Windows&#174;
    Product Version       : 6.1.7601.18015

ModLoad: 77760000 00047000 C:\Windows\syswow64\KERNELBASE.dll (6.1.7601.18015) (-exported- Symbols Loaded)
    Linked PDB Filename   : wkernelbase.pdb
    File Version          : 6.1.7601.18015 (win7sp1_gdr.121129-1432)
    Company Name          : Microsoft Corporation
    Product Name          : System operacyjny Microsoft&#174; Windows&#174;
    Product Version       : 6.1.7601.18015

ModLoad: 76dd0000 00100000 C:\Windows\syswow64\USER32.dll (6.1.7601.17514) (-exported- Symbols Loaded)
    Linked PDB Filename   : wuser32.pdb
    File Version          : 6.1.7601.17514 (win7sp1_rtm.101119-1850)
    Company Name          : Microsoft Corporation
    Product Name          : System operacyjny Microsoft&#174; Windows&#174;
    Product Version       : 6.1.7601.17514

ModLoad: 76720000 00090000 C:\Windows\syswow64\GDI32.dll (6.1.7601.17514) (-exported- Symbols Loaded)
    Linked PDB Filename   : wgdi32.pdb
    File Version          : 6.1.7601.17514 (win7sp1_rtm.101119-1850)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.17514

ModLoad: 76dc0000 0000a000 C:\Windows\syswow64\LPK.dll (6.1.7600.16385) (-exported- Symbols Loaded)
    Linked PDB Filename   : wlpk.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 767b0000 0009d000 C:\Windows\syswow64\USP10.dll (1.626.7601.18009) (-exported- Symbols Loaded)
    Linked PDB Filename   : usp10.pdb
    File Version          : 1.0626.7601.18009 (win7sp1_gdr.121121-1431)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft(R) Uniscribe Unicode script processor
    Product Version       : 1.0626.7601.18009

ModLoad: 76380000 000ac000 C:\Windows\syswow64\msvcrt.dll (7.0.7601.17744) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.7601.17744 (win7sp1_gdr.111215-1535)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.7601.17744

ModLoad: 77480000 000a0000 C:\Windows\syswow64\ADVAPI32.dll (6.1.7601.17514) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : System operacyjny Microsoft&#174; Windows&#174;
    Product Version       : 6.1.7600.16385

ModLoad: 76d40000 00019000 C:\Windows\SysWOW64\sechost.dll (6.1.7600.16385) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 770f0000 000f0000 C:\Windows\syswow64\RPCRT4.dll (6.1.7601.17514) (-exported- Symbols Loaded)
    Linked PDB Filename   : wrpcrt4.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : System operacyjny Microsoft&#174; Windows&#174;
    Product Version       : 6.1.7600.16385

ModLoad: 75600000 00060000 C:\Windows\syswow64\SspiCli.dll (6.1.7601.17856) (-exported- Symbols Loaded)
    Linked PDB Filename   : wsspicli.pdb
    File Version          : 6.1.7601.17856 (win7sp1_gdr.120601-1505)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.17856

ModLoad: 755f0000 0000c000 C:\Windows\syswow64\CRYPTBASE.dll (6.1.7600.16385) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptbase.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 77540000 00060000 C:\Windows\system32\IMM32.DLL (6.1.7601.17514) (-exported- Symbols Loaded)
    Linked PDB Filename   : wimm32.pdb
    File Version          : 6.1.7601.17514 (win7sp1_rtm.101119-1850)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.17514

ModLoad: 76bd0000 000cc000 C:\Windows\syswow64\MSCTF.dll (6.1.7600.16385) (-exported- Symbols Loaded)
    Linked PDB Filename   : msctf.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : System operacyjny Microsoft&#174; Windows&#174;
    Product Version       : 6.1.7600.16385

ModLoad: 75040000 00021000 C:\Windows\system32\ntmarta.dll (6.1.7600.16385) (-exported- Symbols Loaded)
    Linked PDB Filename   : ntmarta.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : System operacyjny Microsoft&#174; Windows&#174;
    Product Version       : 6.1.7600.16385

ModLoad: 76ed0000 00045000 C:\Windows\syswow64\WLDAP32.dll (6.1.7601.17514) (-exported- Symbols Loaded)
    Linked PDB Filename   : wldap32.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : System operacyjny Microsoft&#174; Windows&#174;
    Product Version       : 6.1.7600.16385

ModLoad: 75580000 0004c000 C:\Windows\system32\apphelp.dll (6.1.7601.17514) (-exported- Symbols Loaded)
    Linked PDB Filename   : apphelp.pdb
    File Version          : 6.1.7601.17514 (win7sp1_rtm.101119-1850)
    Company Name          : Microsoft Corporation
    Product Name          : System operacyjny Microsoft&#174; Windows&#174;
    Product Version       : 6.1.7601.17514

ModLoad: 74e00000 000a4000 C:\ProgramData\BOINC\projects\climateprediction.net\hadcm3n_se_6.07_windows_intelx86.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : d:\cpdn\cpdnboinc\hadcm3\test\projects\reqs.comlab.ox.ac.uk_cpdn\hadcm3n_se_6.07_windows_intelx86.pdb

ModLoad: 742f0000 000eb000 C:\Windows\system32\dbghelp.dll (6.1.7601.17514) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 6.1.7601.17514 (win7sp1_rtm.101119-1850)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.17514

ModLoad: 75560000 00009000 C:\Windows\system32\version.dll (6.1.7600.16385) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 0, Write: 0, Other 0

- I/O Transfers Counters -
Read: 0, Write: 0, Other 0

- Paged Pool Usage -
QuotaPagedPoolUsage: 0, QuotaPeakPagedPoolUsage: 0
QuotaNonPagedPoolUsage: 0, QuotaPeakNonPagedPoolUsage: 0

- Virtual Memory Usage -
VirtualSize: 0, PeakVirtualSize: 0

- Pagefile Usage -
PagefileUsage: 0, PeakPagefileUsage: 0

- Working Set Size -
WorkingSetSize: 0, PeakWorkingSetSize: 0, PageFaultCount: 0

*** Dump of thread ID 2432 (state: Initialized): ***

- Information -
Status: Base Priority: Normal, Priority: Normal, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 0.000000

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x7776C41F

- Registers -
eax=0018f228 ebx=02f1d838 ecx=00000003 edx=00000000 esi=74e9a484 edi=013afa00
eip=7776c41f esp=0018f228 ebp=0018f278
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000216

- Callstack -
ChildEBP RetAddr  Args to Child
0018f278 74e5e730 e06d7363 00000001 00000003 0018f2a4 KERNELBASE!RaiseException+0x0 
0018f2b0 74e5bcdc 0018f2c0 74e91fe0 74e813f4 74e8b230 hadcm3n_se_6.07_windows_intelx8!umtonc+0x0 
0018f2cc 74e0fa97 04ebe800 00000010 003c3f50 00000000 hadcm3n_se_6.07_windows_intelx8!umtonc+0x0 
0018f2e4 74e036b8 6781e266 004bb848 004bb710 0018f6e4 hadcm3n_se_6.07_windows_intelx8!+0x0 
00000000 00000000 00000000 00000000 00000000 00000000 hadcm3n_se_6.07_windows_intelx8!+0x0 

*** Dump of thread ID 5288 (state: Initialized): ***

- Information -
Status: Base Priority: Normal, Priority: Normal, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 0.000000

- Registers -
eax=00000000 ebx=00000000 ecx=00000000 edx=00000000 esi=0247ff48 edi=00000000
eip=77bcfd71 esp=0247ff04 ebp=0247ff6c
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
0247ff6c 77774498 00000064 00000000 0247ff88 00413da4 ntdll!ZwDelayExecution+0x0 
0247ff7c 00413da4 00000064 0247ff94 76a433aa 00000000 KERNELBASE!Sleep+0x0 
0247ff88 76a433aa 00000000 0247ffd4 77be9ef2 00000000 hadcm3n_6.07_windows_intelx86!+0x0 
0247ff94 77be9ef2 00000000 69c038ae 00000000 00000000 kernel32!BaseThreadInitThunk+0x0 
0247ffd4 77be9ec5 00413d90 00000000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 
0247ffec 00000000 00413d90 00000000 00000000 63646168 ntdll!RtlInitializeExceptionChain+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
22 Apr 2014 05:30:03 1283167 16151926 hadcm3n_8593_1980_40_008464763_1 466,560 1,016,925 2.1796
21 Apr 2014 19:27:53 1283167 16151926 hadcm3n_8593_1980_40_008464763_1 440,640 980,425 2.2250
21 Apr 2014 08:45:13 1283167 16151926 hadcm3n_8593_1980_40_008464763_1 414,720 943,111 2.2741
20 Apr 2014 22:18:03 1283167 16151926 hadcm3n_8593_1980_40_008464763_1 388,800 906,262 2.3309
20 Apr 2014 11:53:39 1283167 16151926 hadcm3n_8593_1980_40_008464763_1 362,880 868,965 2.3946
20 Apr 2014 01:31:54 1283167 16151926 hadcm3n_8593_1980_40_008464763_1 336,960 832,397 2.4703
19 Apr 2014 15:21:44 1283167 16151926 hadcm3n_8593_1980_40_008464763_1 311,040 795,892 2.5588
19 Apr 2014 04:48:46 1283167 16151926 hadcm3n_8593_1980_40_008464763_1 285,120 758,894 2.6617
25 Dec 2013 04:59:47 1283167 16151926 hadcm3n_8593_1980_40_008464763_1 259,200 371,282 1.4324
24 Dec 2013 19:32:05 1283167 16151926 hadcm3n_8593_1980_40_008464763_1 233,280 335,318 1.4374
24 Dec 2013 08:18:31 1283167 16151926 hadcm3n_8593_1980_40_008464763_1 207,360 298,122 1.4377
23 Dec 2013 21:35:47 1283167 16151926 hadcm3n_8593_1980_40_008464763_1 181,440 260,136 1.4337
23 Dec 2013 10:51:42 1283167 16151926 hadcm3n_8593_1980_40_008464763_1 155,520 222,464 1.4305
22 Dec 2013 23:33:42 1283167 16151926 hadcm3n_8593_1980_40_008464763_1 129,600 182,590 1.4089
22 Dec 2013 13:20:37 1283167 16151926 hadcm3n_8593_1980_40_008464763_1 103,680 146,415 1.4122
22 Dec 2013 03:13:04 1283167 16151926 hadcm3n_8593_1980_40_008464763_1 77,760 110,464 1.4206
21 Dec 2013 17:00:16 1283167 16151926 hadcm3n_8593_1980_40_008464763_1 51,840 74,597 1.4390
21 Dec 2013 06:45:53 1283167 16151926 hadcm3n_8593_1980_40_008464763_1 25,920 38,007 1.4663


©2024 cpdn.org