<core_client_version>7.16.6</core_client_version>
<![CDATA[
<message>
process exited with code 1 (0x1, -255)</message>
<stderr_txt>
(argv0) ../../projects/climateprediction.net/oifs_43r3_1.21_x86_64-pc-linux-gnu
(argv1) start_date: 2019110100
(argv2) exptid: hnw4
(argv3) unique_member_id: 010w
(argv4) batchid: 993
(argv5) wuid: 12214766
(argv6) fclen: 123
(argv7) app_name: oifs_43r3
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/13
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3
version: 1.21
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214766
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_app_1.21_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/13/oifs_43r3_app_1.21_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/13/oifs_43r3_app_1.21_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_c99b1973aac008b54611a24e8400828a to: /var/lib/boinc-client/slots/13/oifs_43r3_010w_2019110100_123_993_12214766.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/13/oifs_43r3_010w_2019110100_123_993_12214766.zip
ic_ancil_file: ic_ancil_12214766
ifsdata_file: ifsdata_12214766
climate_data_file: clim_data_12214766
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_966b45579d4abfff11f45905dfe9373e to: /var/lib/boinc-client/slots/13/ic_ancil_12214766.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/13/ic_ancil_12214766.zip
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_871f96a4e4c5bd828a691b00819eed69 to: /var/lib/boinc-client/slots/13/ifsdata/ifsdata_12214766.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/13/ifsdata/ifsdata_12214766.zip
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/13/159l_2/clim_data_12214766.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/13/159l_2/clim_data_12214766.zip
Checking for progress XML file: /var/lib/boinc-client/slots/13/progress_file_12214766.xml
Creating progress file: /var/lib/boinc-client/slots/13/progress_file_12214766.xml
last_cpu_time: 0
upload_file_number: 0
last_iter: 0
last_upload: 0
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_010w_2019110100_123_993_12214766_0_r486761466
The child process has been launched with process id: 1860812
Executing the command: /var/lib/boinc-client/slots/13/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:wolta:1:1:1860812:1860812] [20230224:101521:1677255321:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2091] fp = 0x3124020
[EC_DRHOOK:wolta:1:1:1860812:1860812] [20230224:101521:1677255321:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:wolta:1:1:1860812:1860812] [20230224:101521:1677255321:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:wolta:1:1:1860812:1860812] [20230224:101521:1677255321:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:wolta:1:1:1860812:1860812] [20230224:101521:1677255321:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:wolta:1:1:1860812:1860812] [20230224:101521:1677255321:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:wolta:1:1:1860812:1860812] [20230224:101521:1677255321:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:wolta:1:1:1860812:1860812] [20230224:101521:1677255321:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:wolta:1:1:1860812:1860812] [20230224:101521:1677255321:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:wolta:1:1:1860812:1860812] [20230224:101521:1677255321:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:wolta:1:1:1860812:1860812] [20230224:101521:1677255321:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:wolta:1:1:1860812:1860812] [20230224:101521:1677255321:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:wolta:1:1:1860812:1860812] [20230224:101521:1677255321:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:wolta:1:1:1860812:1860812] [20230224:101521:1677255321:0.000] [ignore_signals@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:wolta:1:1:1860812:1860812] [20230224:101521:1677255321:0.000] [restore_default_signals@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:wolta:1:1:1860812:1860812] [20230224:101521:1677255321:0.000] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x810730 (old at 0x1ce8440)
[EC_DRHOOK:wolta:1:1:1860812:1860812] [20230224:101521:1677255321:0.000] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x810730 (old at (nil))
[EC_DRHOOK:wolta:1:1:1860812:1860812] [20230224:101521:1677255321:0.000] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x810730 (old at 0x1ce8440)
[EC_DRHOOK:wolta:1:1:1860812:1860812] [20230224:101521:1677255321:0.000] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x810730 (old at (nil))
[EC_DRHOOK:wolta:1:1:1860812:1860812] [20230224:101521:1677255321:0.000] [trapfpe_treatment@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:wolta:1:1:1860812:1860812] [20230224:101521:1677255321:0.000] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x810730 (old at 0x1ce8440)
[EC_DRHOOK:wolta:1:1:1860812:1860812] [20230224:101521:1677255321:0.000] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x810730 (old at 0x1ce8440)
[EC_DRHOOK:wolta:1:1:1860812:1860812] [20230224:101521:1677255321:0.000] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x810730 (old at (nil))
[EC_DRHOOK:wolta:1:1:1860812:1860812] [20230224:101521:1677255321:0.000] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x810730 (old at 0x1ce8440)
[EC_DRHOOK:wolta:1:1:1860812:1860812] [20230224:101521:1677255321:0.000] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x810730 (old at 0x1ce8440)
[EC_DRHOOK:wolta:1:1:1860812:1860812] [20230224:101521:1677255321:0.000] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x810730 (old at 0x1ce8440)
[EC_DRHOOK:wolta:1:1:1860812:1860812] [20230224:101521:1677255321:0.001] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x810730 (old at (nil))
[EC_DRHOOK:wolta:1:1:1860812:1860812] [20230224:101521:1677255321:0.001] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x810730 (old at (nil))
[EC_DRHOOK:wolta:1:1:1860812:1860812] [20230224:101521:1677255321:0.001] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x810730 (old at (nil))
[EC_DRHOOK:wolta:1:1:1860812:1860812] [20230224:101521:1677255321:0.001] [catch_signals@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
10:16:43 STEP 0 H= 0:00 +CPU= 78.414
Moving to projects directory: /var/lib/boinc-client/slots/13/ICMGGhnw4+000000
Moving to projects directory: /var/lib/boinc-client/slots/13/ICMSHhnw4+000000
Moving to projects directory: /var/lib/boinc-client/slots/13/ICMUAhnw4+000000
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
10:18:29 STEP 1 H= 1:00 +CPU= 60.302
10:19:21 STEP 2 H= 2:00 +CPU= 51.755
..The child process has been killed with signal: 9
>>> Printing last 70 lines from file: NODE.001_01
ARE TO BE INTERPOLATED ONTO WAVEMODEL GRID
WAM_IFSTOWAM - VARIABLE AIR DENSITY RUN
WAM_IFSTOWAM - GUSTINESS RUN
*GLOBAL* NORMS OF INPUT ATMOSPHERIC FIELDS :
Neutral 10m U -0.511765048228697 -16.0007971450489
17.4966078978880 35718
HEX: BFE06061182C1988 C03000343DDFEA48 40317F21B1F85D35
Neutral 10m V 0.164405287736514 -18.5684695598332
20.9985208596233 35718
HEX: 3FC50B3B830F1404 C03291873898415C 4034FF9F102474B9
Air density 1.19012724527089 0.695590751934318
1.43242833729837 35718
HEX: 3FF30AC2DDC845C9 3FE64247895EA777 3FF6EB39F9E8F677
w* 0.562028514297257 0.000000000000000E+000
2.52560997935153 35718
HEX: 3FE1FC23390A701D 0000000000000000 40043473013E20EC
Sea ice fraction -291.811725444166 -999.000000000000
1.00000000000000 35718
HEX: C0723CFCD3D1C062 C08F380000000000 3FF0000000000000
SUB. INITMDL: PREWIND DONE
SUB. INITMDL: CIREDUCE DONE
SPECTRUM FILE READ IN............... CDTPRO = 20191101000000
SUB. INITMDL: SPECTRA READ IN
WAMNORM ON 20191101000000
AVERAGE MINIMUM MAXIMUM SEA POINTS
!!!!!!!!!!!!!! WAVE FIELDS INTEGRATED. DATE IS: 20191101001500 !!!!!!!!!!!!
!!!!!!!!!!!!!! WAVE FIELDS INTEGRATED. DATE IS: 20191101003000 !!!!!!!!!!!!
!!!!!!!!!!!!!! WAVE FIELDS INTEGRATED. DATE IS: 20191101004500 !!!!!!!!!!!!
!!!!!!!!!!!!!! WAVE FIELDS INTEGRATED. DATE IS: 20191101010000 !!!!!!!!!!!!
10:18:29 STEP 1 H= 1:00 +CPU= 60.302
NSTEP = 2 STEPO 0AAA00AAA
SPECTRAL NORMS: Pattern 1
STEPO, YSPSDT_AR1 ( 1,...), SP NORMS 2D: 6.187080350472E-01 2.018243974807E-01 7.028876213267E-02
STEPO, YSPSDT_AR1 (SUM,...), SP NORMS 2D: 6.523829794696E-01
STEPO, YGPSDT ( 1,...), Grid Point Norms
FIELD LEV AVERAGE MINIMUM MAXIMUM
101 60 1.54340810605124E-02 -2.38285209765512E+00 2.44674923566585E+00
STEPO, YGPSDT[clipped]( 1,...), Grid Point Norms
FIELD LEV AVERAGE MINIMUM MAXIMUM
101 60 1.24111435714900E-02 -1.00000000000000E+00 1.00000000000000E+00
STEPO: evolving YSPSDT_AR1( 1)
!!!!!!!!!!!!!! WAVE FIELDS INTEGRATED. DATE IS: 20191101011500 !!!!!!!!!!!!
!!!!!!!!!!!!!! WAVE FIELDS INTEGRATED. DATE IS: 20191101013000 !!!!!!!!!!!!
!!!!!!!!!!!!!! WAVE FIELDS INTEGRATED. DATE IS: 20191101014500 !!!!!!!!!!!!
!!!!!!!!!!!!!! WAVE FIELDS INTEGRATED. DATE IS: 20191101020000 !!!!!!!!!!!!
10:19:21 STEP 2 H= 2:00 +CPU= 51.755
DATE= 2019 11 1
ISTEP= 3: Reset RSOLINC= 1361.0304 RIP0= 1381.7050
SU_GHGCLIM, RCARDI,RCH4,RN2O,RCFC11,RCFC12,RNO2: 6.240006412635001E-004
9.628461857022168E-007 4.996611132045250E-007 9.607432727722499E-010
2.027017283006666E-009 7.940283000000001E-011
SUECAEC: GLOBAL AVERAGE VOLCANIC SULPHATE FOR (KINDAT,KMINUT) 20191101
270 9.999999999999998E-005
SUECSO4: USE AVAILABLE FILES FOR DECADES: 2010 2020
SUBROUTINE SUECSO4:, UNWEIGHTED AVERAGE: 2.324872755409407E-003
NSTEP = 3 STEPO 0AAA00AAA
SPECTRAL NORMS: Pattern 1
STEPO, YSPSDT_AR1 ( 1,...), SP NORMS 2D: 5.868988634923E-01 2.005456466804E-01 7.027207616554E-02
STEPO, YSPSDT_AR1 (SUM,...), SP NORMS 2D: 6.319522573900E-01
STEPO, YGPSDT ( 1,...), Grid Point Norms
FIELD LEV AVERAGE MINIMUM MAXIMUM
101 60 1.90064762804055E-02 -2.41054346073671E+00 2.34436231683939E+00
STEPO, YGPSDT[clipped]( 1,...), Grid Point Norms
FIELD LEV AVERAGE MINIMUM MAXIMUM
101 60 1.91208188411297E-02 -1.00000000000000E+00 1.00000000000000E+00
------------------------------------------------
CNT0 not found; string returned was: 'STEPO'
>>> Printing last 8 lines from file: ifs.stat
10:15:27 A00000000 STEPO 0 5.596 5.596 5.636 0:05 0:05 0.21672817181671E-04 1GB 0MB
10:15:27 0AA000000 STEPO 0 0.175 0.175 0.175 0:05 0:05 0.21672817181671E-04 1GB 0MB
10:15:29 FULLPOS-B DYNFPOS 0 1.954 1.954 1.958 0:07 0:07 0.21672817181671E-04 1GB 0MB
10:15:32 0AAA00AAA STEPO 0 3.230 3.230 3.235 0:10 0:11 0.21672817181671E-04 1GB 0MB
10:16:43 0AAA00AAA STEPO 1 71.192 71.192 71.418 1:22 1:22 0.21672817181671E-04 1GB 0MB
10:18:29 0AAA00AAA STEPO 2 60.302 60.302 105.430 2:22 3:07 0.21672817181671E-04 2GB 0MB
10:19:21 0AAA00AAA STEPO 3 51.760 51.760 51.940 3:14 3:59 0.21672817181671E-04 2GB 0MB
------------------------------------------------
>>> Printing last 8 lines from file: /var/lib/boinc-client/slots/13/progress_file_12214766.xml
<running_values>
<last_cpu_time>230.490000</last_cpu_time>
<upload_file_number>0</upload_file_number>
<last_iter>3</last_iter>
<last_upload>0</last_upload>
<model_completed>0</model_completed>
</running_values>
------------------------------------------------
..Failed, model did not complete successfully
</stderr_txt>
]]>
