<core_client_version>7.16.17</core_client_version>
<![CDATA[
<message>
process exited with code 1 (0x1, -255)</message>
<stderr_txt>
(argv0) ../../projects/climateprediction.net/oifs_43r3_1.21_x86_64-pc-linux-gnu
(argv1) start_date: 2019110100
(argv2) exptid: hnw4
(argv3) unique_member_id: 01bm
(argv4) batchid: 993
(argv5) wuid: 12215152
(argv6) fclen: 123
(argv7) app_name: oifs_43r3
(argv8) nthreads: 1
Working directory is: /var/lib/boinc/slots/1
Project directory is: /var/lib/boinc/projects/climateprediction.net/
app name: oifs_43r3
version: 1.21
Location of temp folder: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215152
Copying: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_app_1.21_x86_64-pc-linux-gnu.zip to: /var/lib/boinc/slots/1/oifs_43r3_app_1.21_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc/slots/1/oifs_43r3_app_1.21_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_24d901bfc054929e766549cf5640212e to: /var/lib/boinc/slots/1/oifs_43r3_01bm_2019110100_123_993_12215152.zip
Unzipping the namelist zip file: /var/lib/boinc/slots/1/oifs_43r3_01bm_2019110100_123_993_12215152.zip
ic_ancil_file: ic_ancil_12215152
ifsdata_file: ifsdata_12215152
climate_data_file: clim_data_12215152
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_cf3d6f56d5796673c6a38c6c2c3b5513 to: /var/lib/boinc/slots/1/ic_ancil_12215152.zip
Unzipping the IC ancils zip file: /var/lib/boinc/slots/1/ic_ancil_12215152.zip
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_7164e9e670f7ea941f689b8efc867ea8 to: /var/lib/boinc/slots/1/ifsdata/ifsdata_12215152.zip
Unzipping the ifsdata_zip file: /var/lib/boinc/slots/1/ifsdata/ifsdata_12215152.zip
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc/slots/1/159l_2/clim_data_12215152.zip
Unzipping the climate data zip file: /var/lib/boinc/slots/1/159l_2/clim_data_12215152.zip
Checking for progress XML file: /var/lib/boinc/slots/1/progress_file_12215152.xml
Creating progress file: /var/lib/boinc/slots/1/progress_file_12215152.xml
last_cpu_time: 0
upload_file_number: 0
last_iter: 0
last_upload: 0
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_01bm_2019110100_123_993_12215152_0_r601970021
The child process has been launched with process id: 3662
Executing the command: /var/lib/boinc/slots/1/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:Tower:1:1:3662:3662] [20230224:225403:1677297243:0.001] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2091] fp = 0x3124020
[EC_DRHOOK:Tower:1:1:3662:3662] [20230224:225403:1677297243:0.001] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:Tower:1:1:3662:3662] [20230224:225403:1677297243:0.001] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:Tower:1:1:3662:3662] [20230224:225403:1677297243:0.001] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:Tower:1:1:3662:3662] [20230224:225403:1677297243:0.001] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:Tower:1:1:3662:3662] [20230224:225403:1677297243:0.001] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:Tower:1:1:3662:3662] [20230224:225403:1677297243:0.001] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:Tower:1:1:3662:3662] [20230224:225403:1677297243:0.001] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:Tower:1:1:3662:3662] [20230224:225403:1677297243:0.002] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:Tower:1:1:3662:3662] [20230224:225403:1677297243:0.002] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:Tower:1:1:3662:3662] [20230224:225403:1677297243:0.002] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:Tower:1:1:3662:3662] [20230224:225403:1677297243:0.002] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:Tower:1:1:3662:3662] [20230224:225403:1677297243:0.002] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:Tower:1:1:3662:3662] [20230224:225403:1677297243:0.002] [ignore_signals@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:Tower:1:1:3662:3662] [20230224:225403:1677297243:0.002] [restore_default_signals@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:Tower:1:1:3662:3662] [20230224:225403:1677297243:0.002] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x810730 (old at 0x1ce8440)
[EC_DRHOOK:Tower:1:1:3662:3662] [20230224:225403:1677297243:0.002] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x810730 (old at (nil))
[EC_DRHOOK:Tower:1:1:3662:3662] [20230224:225403:1677297243:0.002] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x810730 (old at 0x1ce8440)
[EC_DRHOOK:Tower:1:1:3662:3662] [20230224:225403:1677297243:0.002] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x810730 (old at (nil))
[EC_DRHOOK:Tower:1:1:3662:3662] [20230224:225403:1677297243:0.002] [trapfpe_treatment@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:Tower:1:1:3662:3662] [20230224:225403:1677297243:0.003] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x810730 (old at 0x1ce8440)
[EC_DRHOOK:Tower:1:1:3662:3662] [20230224:225403:1677297243:0.003] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x810730 (old at 0x1ce8440)
[EC_DRHOOK:Tower:1:1:3662:3662] [20230224:225403:1677297243:0.003] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x810730 (old at (nil))
[EC_DRHOOK:Tower:1:1:3662:3662] [20230224:225403:1677297243:0.003] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x810730 (old at 0x1ce8440)
[EC_DRHOOK:Tower:1:1:3662:3662] [20230224:225403:1677297243:0.003] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x810730 (old at 0x1ce8440)
[EC_DRHOOK:Tower:1:1:3662:3662] [20230224:225403:1677297243:0.003] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x810730 (old at 0x1ce8440)
[EC_DRHOOK:Tower:1:1:3662:3662] [20230224:225403:1677297243:0.003] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x810730 (old at (nil))
[EC_DRHOOK:Tower:1:1:3662:3662] [20230224:225403:1677297243:0.003] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x810730 (old at (nil))
[EC_DRHOOK:Tower:1:1:3662:3662] [20230224:225403:1677297243:0.003] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x810730 (old at (nil))
[EC_DRHOOK:Tower:1:1:3662:3662] [20230224:225403:1677297243:0.003] [catch_signals@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:56:09 STEP 0 H= 0:00 +CPU= 38.353
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+000000
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+000000
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+000000
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:57:13 STEP 1 H= 1:00 +CPU= 27.043
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:00:53 STEP 2 H= 2:00 +CPU= 26.351
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:02:20 STEP 3 H= 3:00 +CPU= 34.372
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
..The child process has been killed with signal: 9
>>> Printing last 70 lines from file: NODE.001_01
2.46170953021123 35718
HEX: 3FE1A89AA8645C3C 0000000000000000 4003B194C42411EA
Sea ice fraction -291.811725444166 -999.000000000000
1.00000000000000 35718
HEX: C0723CFCD3D1C062 C08F380000000000 3FF0000000000000
SUB. INITMDL: PREWIND DONE
SUB. INITMDL: CIREDUCE DONE
SPECTRUM FILE READ IN............... CDTPRO = 20191101000000
SUB. INITMDL: SPECTRA READ IN
WAMNORM ON 20191101000000
AVERAGE MINIMUM MAXIMUM SEA POINTS
!!!!!!!!!!!!!! WAVE FIELDS INTEGRATED. DATE IS: 20191101001500 !!!!!!!!!!!!
!!!!!!!!!!!!!! WAVE FIELDS INTEGRATED. DATE IS: 20191101003000 !!!!!!!!!!!!
!!!!!!!!!!!!!! WAVE FIELDS INTEGRATED. DATE IS: 20191101004500 !!!!!!!!!!!!
!!!!!!!!!!!!!! WAVE FIELDS INTEGRATED. DATE IS: 20191101010000 !!!!!!!!!!!!
22:57:13 STEP 1 H= 1:00 +CPU= 27.043
NSTEP = 2 STEPO 0AAA00AAA
SPECTRAL NORMS: Pattern 1
STEPO, YSPSDT_AR1 ( 1,...), SP NORMS 2D: 6.187080350472E-01 2.018243974807E-01 7.028876213267E-02
STEPO, YSPSDT_AR1 (SUM,...), SP NORMS 2D: 6.523829794696E-01
STEPO, YGPSDT ( 1,...), Grid Point Norms
FIELD LEV AVERAGE MINIMUM MAXIMUM
101 60 1.54340810605124E-02 -2.38285209765512E+00 2.44674923566585E+00
STEPO, YGPSDT[clipped]( 1,...), Grid Point Norms
FIELD LEV AVERAGE MINIMUM MAXIMUM
101 60 1.24111435714900E-02 -1.00000000000000E+00 1.00000000000000E+00
STEPO: evolving YSPSDT_AR1( 1)
!!!!!!!!!!!!!! WAVE FIELDS INTEGRATED. DATE IS: 20191101011500 !!!!!!!!!!!!
!!!!!!!!!!!!!! WAVE FIELDS INTEGRATED. DATE IS: 20191101013000 !!!!!!!!!!!!
!!!!!!!!!!!!!! WAVE FIELDS INTEGRATED. DATE IS: 20191101014500 !!!!!!!!!!!!
!!!!!!!!!!!!!! WAVE FIELDS INTEGRATED. DATE IS: 20191101020000 !!!!!!!!!!!!
23:00:53 STEP 2 H= 2:00 +CPU= 26.351
DATE= 2019 11 1
ISTEP= 3: Reset RSOLINC= 1361.0304 RIP0= 1381.7050
SU_GHGCLIM, RCARDI,RCH4,RN2O,RCFC11,RCFC12,RNO2: 6.240006412635001E-004
9.628461857022168E-007 4.996611132045250E-007 9.607432727722499E-010
2.027017283006666E-009 7.940283000000001E-011
SUECAEC: GLOBAL AVERAGE VOLCANIC SULPHATE FOR (KINDAT,KMINUT) 20191101
270 9.999999999999998E-005
SUECSO4: USE AVAILABLE FILES FOR DECADES: 2010 2020
SUBROUTINE SUECSO4:, UNWEIGHTED AVERAGE: 2.324872755409407E-003
NSTEP = 3 STEPO 0AAA00AAA
SPECTRAL NORMS: Pattern 1
STEPO, YSPSDT_AR1 ( 1,...), SP NORMS 2D: 5.868988634923E-01 2.005456466804E-01 7.027207616554E-02
STEPO, YSPSDT_AR1 (SUM,...), SP NORMS 2D: 6.319522573900E-01
STEPO, YGPSDT ( 1,...), Grid Point Norms
FIELD LEV AVERAGE MINIMUM MAXIMUM
101 60 1.90064762804055E-02 -2.41054346073671E+00 2.34436231683939E+00
STEPO, YGPSDT[clipped]( 1,...), Grid Point Norms
FIELD LEV AVERAGE MINIMUM MAXIMUM
101 60 1.91208188411297E-02 -1.00000000000000E+00 1.00000000000000E+00
STEPO: evolving YSPSDT_AR1( 1)
!!!!!!!!!!!!!! WAVE FIELDS INTEGRATED. DATE IS: 20191101021500 !!!!!!!!!!!!
!!!!!!!!!!!!!! WAVE FIELDS INTEGRATED. DATE IS: 20191101023000 !!!!!!!!!!!!
!!!!!!!!!!!!!! WAVE FIELDS INTEGRATED. DATE IS: 20191101024500 !!!!!!!!!!!!
!!!!!!!!!!!!!! WAVE FIELDS INTEGRATED. DATE IS: 20191101030000 !!!!!!!!!!!!
23:02:20 STEP 3 H= 3:00 +CPU= 34.372
NSTEP = 4 STEPO 0AAA00AAA
SPECTRAL NORMS: Pattern 1
STEPO, YSPSDT_AR1 ( 1,...), SP NORMS 2D: 5.676406917809E-01 2.008749193750E-01 6.972931572051E-02
STEPO, YSPSDT_AR1 (SUM,...), SP NORMS 2D: 6.128958122767E-01
STEPO, YGPSDT ( 1,...), Grid Point Norms
FIELD LEV AVERAGE MINIMUM MAXIMUM
101 60 2.88639387539912E-02 -2.30052130700533E+00 1.98587823058121E+00
STEPO, YGPSDT[clipped]( 1,...), Grid Point Norms
FIELD LEV AVERAGE MINIMUM MAXIMUM
101 60 2.68987936169600E-02 -1.00000000000000E+00 1.00000000000000E+00
------------------------------------------------
CNT0 not found; string returned was: 'STEPO'
>>> Printing last 8 lines from file: ifs.stat
22:54:16 0AA000000 STEPO 0 0.063 0.063 0.093 0:04 0:12 0.21666239474660E-04 1GB 0MB
22:54:17 FULLPOS-B DYNFPOS 0 0.756 0.756 1.061 0:05 0:13 0.21666239474660E-04 1GB 0MB
22:54:21 0AAA00AAA STEPO 0 1.437 1.437 3.972 0:06 0:17 0.21666239474660E-04 1GB 0MB
22:56:09 0AAA00AAA STEPO 1 34.400 34.400 108.395 0:40 2:06 0.21666239474660E-04 1GB 0MB
22:57:13 0AAA00AAA STEPO 2 27.043 27.043 63.623 1:07 3:09 0.21666239474660E-04 2GB 0MB
23:00:53 0AAA00AAA STEPO 3 26.353 26.353 219.576 1:34 6:49 0.21666239474660E-04 2GB 0MB
23:02:20 0AAA00AAA STEPO 4 34.371 34.371 87.434 2:08 8:16 0.21666239474660E-04 2GB 0MB
------------------------------------------------
>>> Printing last 8 lines from file: /var/lib/boinc/slots/1/progress_file_12215152.xml
<running_values>
<last_cpu_time>132.770000</last_cpu_time>
<upload_file_number>0</upload_file_number>
<last_iter>4</last_iter>
<last_upload>0</last_upload>
<model_completed>0</model_completed>
</running_values>
------------------------------------------------
..Failed, model did not complete successfully
</stderr_txt>
]]>
