climateprediction.net home page
Task 22445998

Task 22445998

Name oifs_43r3_bl_a34x_2016092300_20_1018_12292392_0
Workunit 12292392
Created 13 Jun 2024, 1:54:49 UTC
Sent 14 Jun 2024, 7:10:23 UTC
Report deadline 13 Aug 2024, 7:10:23 UTC
Received 15 Jun 2024, 0:07:08 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 1 (0x00000001) Unknown error code
Computer ID 1537264
Run time 1 hours 19 min 19 sec
CPU time 1 hours 17 min 14 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 6.55 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.13
x86_64-pc-linux-gnu
Peak working set size 5,549.73 MB
Peak swap size 5,981.07 MB
Peak disk usage 1,353.06 MB
Stderr
<core_client_version>7.18.1</core_client_version>
<![CDATA[
<message>
process exited with code 1 (0x1, -255)</message>
<stderr_txt>
(argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.13_x86_64-pc-linux-gnu
(argv1) start_date: 2016092300
(argv2) exptid: h7zg
(argv3) unique_member_id: a34x
(argv4) batchid: 1018
(argv5) wuid: 12292392
(argv6) fclen: 20
(argv7) app_name: oifs_43r3_bl
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/3
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_bl
version: 1.13
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292392
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/3/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/3/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_d4904582dd7fd55734b37ba222c57adf to: /var/lib/boinc-client/slots/3/oifs_43r3_bl_a34x_2016092300_20_1018_12292392.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/3/oifs_43r3_bl_a34x_2016092300_20_1018_12292392.zip
ic_ancil_file: ic_ancil_12292392
ifsdata_file: ifsdata_12292392
climate_data_file: clim_data_12292392
horiz_resolution: 159
vert_resolution: 91
grid_type: l_2
upload_interval: 96
utstep: 900
nfrres: restart dump frequency (steps) 48
Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /var/lib/boinc-client/slots/3/ic_ancil_12292392.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/3/ic_ancil_12292392.zip
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_f394670c964b880925912d68a4b6bd93 to: /var/lib/boinc-client/slots/3/ifsdata/ifsdata_12292392.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/3/ifsdata/ifsdata_12292392.zip
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/3/159l_2/clim_data_12292392.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/3/159l_2/clim_data_12292392.zip
Checking for progress XML file: /var/lib/boinc-client/slots/3/progress_file_12292392.xml
Creating progress file: /var/lib/boinc-client/slots/3/progress_file_12292392.xml
last_cpu_time: 0
upload_file_number: 0
last_iter: 0
last_upload: 0
model_completed: 0
total_length_of_simulation: 1728000
result_base_name: oifs_43r3_bl_a34x_2016092300_20_1018_12292392_0_r2116072582
The child process has been launched with process id: 483
Executing the command: /var/lib/boinc-client/slots/3/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:483:483] [20240614:001442:1718349282:0.001] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2091] fp = 0x314f440
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:483:483] [20240614:001442:1718349282:0.002] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:483:483] [20240614:001442:1718349282:0.002] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:483:483] [20240614:001442:1718349282:0.002] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:483:483] [20240614:001442:1718349282:0.002] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:483:483] [20240614:001442:1718349282:0.002] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:483:483] [20240614:001442:1718349282:0.002] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:483:483] [20240614:001442:1718349282:0.002] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:483:483] [20240614:001442:1718349282:0.002] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:483:483] [20240614:001442:1718349282:0.002] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:483:483] [20240614:001442:1718349282:0.002] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:483:483] [20240614:001442:1718349282:0.002] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:483:483] [20240614:001442:1718349282:0.002] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:483:483] [20240614:001442:1718349282:0.002] [ignore_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:483:483] [20240614:001442:1718349282:0.002] [restore_default_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:483:483] [20240614:001442:1718349282:0.002] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:483:483] [20240614:001442:1718349282:0.002] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:483:483] [20240614:001442:1718349282:0.002] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:483:483] [20240614:001442:1718349282:0.002] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x820cf0 (old at (nil))
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:483:483] [20240614:001442:1718349282:0.002] [trapfpe_treatment@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:483:483] [20240614:001442:1718349282:0.002] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:483:483] [20240614:001442:1718349282:0.002] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:483:483] [20240614:001442:1718349282:0.002] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x820cf0 (old at (nil))
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:483:483] [20240614:001442:1718349282:0.002] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:483:483] [20240614:001442:1718349282:0.002] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:483:483] [20240614:001442:1718349282:0.002] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:483:483] [20240614:001442:1718349282:0.002] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x820cf0 (old at (nil))
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:483:483] [20240614:001442:1718349282:0.002] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x820cf0 (old at (nil))
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:483:483] [20240614:001442:1718349282:0.002] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:483:483] [20240614:001442:1718349282:0.002] [catch_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  00:17:45 STEP    0 H=   0:00 +CPU=131.349
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+000000
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+000000
(argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.13_x86_64-pc-linux-gnu
(argv1) start_date: 2016092300
(argv2) exptid: h7zg
(argv3) unique_member_id: a34x
(argv4) batchid: 1018
(argv5) wuid: 12292392
(argv6) fclen: 20
(argv7) app_name: oifs_43r3_bl
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/3
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_bl
version: 1.13
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292392
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/3/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/3/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_d4904582dd7fd55734b37ba222c57adf to: /var/lib/boinc-client/slots/3/oifs_43r3_bl_a34x_2016092300_20_1018_12292392.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/3/oifs_43r3_bl_a34x_2016092300_20_1018_12292392.zip
ic_ancil_file: ic_ancil_12292392
ifsdata_file: ifsdata_12292392
climate_data_file: clim_data_12292392
horiz_resolution: 159
vert_resolution: 91
grid_type: l_2
upload_interval: 96
utstep: 900
nfrres: restart dump frequency (steps) 48
Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /var/lib/boinc-client/slots/3/ic_ancil_12292392.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/3/ic_ancil_12292392.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_f394670c964b880925912d68a4b6bd93 to: /var/lib/boinc-client/slots/3/ifsdata/ifsdata_12292392.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/3/ifsdata/ifsdata_12292392.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/3/159l_2/clim_data_12292392.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/3/159l_2/clim_data_12292392.zip
Checking for progress XML file: /var/lib/boinc-client/slots/3/progress_file_12292392.xml
Opened progress file ok : /var/lib/boinc-client/slots/3/progress_file_12292392.xml
-- Model is restarting --
Adjusting last_iter, 0, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/3/progress_file_12292392.xml
last_cpu_time: 146
upload_file_number: 0
last_iter: 1
last_upload: 0
model_completed: 0
total_length_of_simulation: 1728000
result_base_name: oifs_43r3_bl_a34x_2016092300_20_1018_12292392_0_r2116072582
The child process has been launched with process id: 557
Executing the command: /var/lib/boinc-client/slots/3/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:557:557] [20240614:150550:1718402750:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2091] fp = 0x314f440
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:557:557] [20240614:150550:1718402750:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:557:557] [20240614:150550:1718402750:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:557:557] [20240614:150550:1718402750:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:557:557] [20240614:150550:1718402750:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:557:557] [20240614:150550:1718402750:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:557:557] [20240614:150550:1718402750:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:557:557] [20240614:150550:1718402750:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:557:557] [20240614:150550:1718402750:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:557:557] [20240614:150550:1718402750:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:557:557] [20240614:150550:1718402750:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:557:557] [20240614:150550:1718402750:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:557:557] [20240614:150550:1718402750:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:557:557] [20240614:150550:1718402750:0.000] [ignore_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:557:557] [20240614:150550:1718402750:0.000] [restore_default_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:557:557] [20240614:150550:1718402750:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:557:557] [20240614:150550:1718402750:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:557:557] [20240614:150550:1718402750:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:557:557] [20240614:150550:1718402750:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x820cf0 (old at (nil))
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:557:557] [20240614:150550:1718402750:0.000] [trapfpe_treatment@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:557:557] [20240614:150550:1718402750:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:557:557] [20240614:150550:1718402750:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:557:557] [20240614:150550:1718402750:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x820cf0 (old at (nil))
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:557:557] [20240614:150550:1718402750:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:557:557] [20240614:150550:1718402750:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:557:557] [20240614:150550:1718402750:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:557:557] [20240614:150550:1718402750:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x820cf0 (old at (nil))
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:557:557] [20240614:150550:1718402750:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x820cf0 (old at (nil))
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:557:557] [20240614:150550:1718402750:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:557:557] [20240614:150550:1718402750:0.000] [catch_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  15:06:29 STEP    0 H=   0:00 +CPU= 32.412
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+000000
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+000000
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+000000
  15:06:55 STEP    1 H=   0:15 +CPU= 26.728
  15:07:22 STEP    2 H=   0:30 +CPU= 26.856
  15:07:50 STEP    3 H=   0:45 +CPU= 27.985
  15:08:17 STEP    4 H=   1:00 +CPU= 27.028
  15:08:44 STEP    5 H=   1:15 +CPU= 26.976
  15:09:13 STEP    6 H=   1:30 +CPU= 28.470
  15:09:40 STEP    7 H=   1:45 +CPU= 27.208
  15:10:08 STEP    8 H=   2:00 +CPU= 27.882
  15:10:35 STEP    9 H=   2:15 +CPU= 27.113
  15:11:02 STEP   10 H=   2:30 +CPU= 27.108
  15:11:29 STEP   11 H=   2:45 +CPU= 27.243
  15:12:03 STEP   12 H=   3:00 +CPU= 33.463
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+000012
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+000012
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+000012
  15:12:31 STEP   13 H=   3:15 +CPU= 28.042
  15:13:02 STEP   14 H=   3:30 +CPU= 31.568
  15:13:30 STEP   15 H=   3:45 +CPU= 27.239
  15:13:56 STEP   16 H=   4:00 +CPU= 26.042
  15:14:24 STEP   17 H=   4:15 +CPU= 28.402
  15:14:52 STEP   18 H=   4:30 +CPU= 27.751
  15:15:20 STEP   19 H=   4:45 +CPU= 28.009
  15:15:50 STEP   20 H=   5:00 +CPU= 29.785
  15:16:20 STEP   21 H=   5:15 +CPU= 29.755
  15:16:47 STEP   22 H=   5:30 +CPU= 27.382
  15:17:14 STEP   23 H=   5:45 +CPU= 27.127
  15:17:51 STEP   24 H=   6:00 +CPU= 37.144
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+000024
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+000024
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+000024
  15:18:18 STEP   25 H=   6:15 +CPU= 27.123
  15:18:45 STEP   26 H=   6:30 +CPU= 26.740
  15:19:13 STEP   27 H=   6:45 +CPU= 27.742
  15:19:41 STEP   28 H=   7:00 +CPU= 27.961
  15:20:08 STEP   29 H=   7:15 +CPU= 26.951
  15:20:35 STEP   30 H=   7:30 +CPU= 27.434
  15:21:03 STEP   31 H=   7:45 +CPU= 28.039
  15:21:31 STEP   32 H=   8:00 +CPU= 27.723
  15:21:57 STEP   33 H=   8:15 +CPU= 26.321
  15:22:25 STEP   34 H=   8:30 +CPU= 27.940
  15:22:53 STEP   35 H=   8:45 +CPU= 28.209
  15:23:28 STEP   36 H=   9:00 +CPU= 34.731
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+000036
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+000036
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+000036
  15:23:56 STEP   37 H=   9:15 +CPU= 27.551
  15:24:23 STEP   38 H=   9:30 +CPU= 27.260
  15:24:51 STEP   39 H=   9:45 +CPU= 27.603
  15:25:20 STEP   40 H=  10:00 +CPU= 28.918
  15:25:47 STEP   41 H=  10:15 +CPU= 27.954
  15:26:15 STEP   42 H=  10:30 +CPU= 27.422
  15:26:42 STEP   43 H=  10:45 +CPU= 27.437
  15:27:10 STEP   44 H=  11:00 +CPU= 27.582
  15:27:37 STEP   45 H=  11:15 +CPU= 26.868
  15:28:05 STEP   46 H=  11:30 +CPU= 28.058
  15:28:33 STEP   47 H=  11:45 +CPU= 27.917
  15:29:09 STEP   48 H=  12:00 +CPU= 35.442
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+000048
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+000048
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+000048
  15:29:35 STEP   49 H=  12:15 +CPU= 26.662
  15:30:01 STEP   50 H=  12:30 +CPU= 25.701
  15:30:27 STEP   51 H=  12:45 +CPU= 26.165
  15:30:54 STEP   52 H=  13:00 +CPU= 27.132
  15:31:22 STEP   53 H=  13:15 +CPU= 27.604
  15:31:49 STEP   54 H=  13:30 +CPU= 26.832
  15:32:16 STEP   55 H=  13:45 +CPU= 26.922
  15:32:43 STEP   56 H=  14:00 +CPU= 26.879
  15:33:09 STEP   57 H=  14:15 +CPU= 25.833
  15:33:34 STEP   58 H=  14:30 +CPU= 25.925
  15:34:00 STEP   59 H=  14:45 +CPU= 25.683
  15:34:34 STEP   60 H=  15:00 +CPU= 33.940
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+000060
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+000060
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+000060
  15:35:02 STEP   61 H=  15:15 +CPU= 27.804
  15:35:30 STEP   62 H=  15:30 +CPU= 27.772
  15:35:57 STEP   63 H=  15:45 +CPU= 27.313
  15:36:26 STEP   64 H=  16:00 +CPU= 28.691
  15:36:53 STEP   65 H=  16:15 +CPU= 27.241
  15:37:23 STEP   66 H=  16:30 +CPU= 29.732
  15:37:50 STEP   67 H=  16:45 +CPU= 26.988
  15:38:16 STEP   68 H=  17:00 +CPU= 26.745
  15:38:42 STEP   69 H=  17:15 +CPU= 26.024
  15:39:10 STEP   70 H=  17:30 +CPU= 27.116
  15:39:36 STEP   71 H=  17:45 +CPU= 26.531
  15:40:08 STEP   72 H=  18:00 +CPU= 32.043
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+000072
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+000072
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+000072
  15:40:33 STEP   73 H=  18:15 +CPU= 25.016
  15:41:00 STEP   74 H=  18:30 +CPU= 26.477
  15:41:27 STEP   75 H=  18:45 +CPU= 27.090
  15:41:54 STEP   76 H=  19:00 +CPU= 27.159
  15:42:21 STEP   77 H=  19:15 +CPU= 26.617
  15:42:47 STEP   78 H=  19:30 +CPU= 26.327
  15:43:14 STEP   79 H=  19:45 +CPU= 27.215
  15:43:41 STEP   80 H=  20:00 +CPU= 27.278
  15:44:09 STEP   81 H=  20:15 +CPU= 27.437
  15:44:36 STEP   82 H=  20:30 +CPU= 27.369
  15:45:04 STEP   83 H=  20:45 +CPU= 27.280
  15:45:36 STEP   84 H=  21:00 +CPU= 32.517
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+000084
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+000084
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+000084
  15:46:02 STEP   85 H=  21:15 +CPU= 26.341
  15:46:28 STEP   86 H=  21:30 +CPU= 25.920
  15:46:55 STEP   87 H=  21:45 +CPU= 26.801
  15:47:21 STEP   88 H=  22:00 +CPU= 26.191
  15:47:47 STEP   89 H=  22:15 +CPU= 25.958
  15:48:15 STEP   90 H=  22:30 +CPU= 27.724
  15:48:43 STEP   91 H=  22:45 +CPU= 27.522
  15:49:09 STEP   92 H=  23:00 +CPU= 26.865
  15:49:35 STEP   93 H=  23:15 +CPU= 26.001
  15:50:02 STEP   94 H=  23:30 +CPU= 26.707
  15:50:28 STEP   95 H=  23:45 +CPU= 26.356
  15:51:06 STEP   96 H=  24:00 +CPU= 32.494
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+000096
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+000096
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+000096
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292392/ICMGGh7zg+000000
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292392/ICMSHh7zg+000000
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292392/ICMUAh7zg+000000
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292392/ICMGGh7zg+000012
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292392/ICMSHh7zg+000012
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292392/ICMUAh7zg+000012
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292392/ICMGGh7zg+000024
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292392/ICMSHh7zg+000024
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292392/ICMUAh7zg+000024
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292392/ICMGGh7zg+000036
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292392/ICMSHh7zg+000036
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292392/ICMUAh7zg+000036
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292392/ICMGGh7zg+000048
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292392/ICMSHh7zg+000048
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292392/ICMUAh7zg+000048
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292392/ICMGGh7zg+000060
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292392/ICMSHh7zg+000060
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292392/ICMUAh7zg+000060
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292392/ICMGGh7zg+000072
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292392/ICMSHh7zg+000072
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292392/ICMUAh7zg+000072
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292392/ICMGGh7zg+000084
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292392/ICMSHh7zg+000084
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292392/ICMUAh7zg+000084
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a34x_2016092300_20_1018_12292392_0_r2116072582_0.zip
Uploading the intermediate file: upload_file_0.zip
  15:51:34 STEP   97 H=  24:15 +CPU= 27.692
  15:52:01 STEP   98 H=  24:30 +CPU= 27.438
  15:52:29 STEP   99 H=  24:45 +CPU= 27.241
  15:52:57 STEP  100 H=  25:00 +CPU= 27.949
  15:53:23 STEP  101 H=  25:15 +CPU= 26.086
  15:53:49 STEP  102 H=  25:30 +CPU= 25.934
  15:54:15 STEP  103 H=  25:45 +CPU= 26.881
  15:54:42 STEP  104 H=  26:00 +CPU= 26.678
  15:55:09 STEP  105 H=  26:15 +CPU= 26.536
  15:55:35 STEP  106 H=  26:30 +CPU= 26.653
  15:56:01 STEP  107 H=  26:45 +CPU= 25.302
  15:56:32 STEP  108 H=  27:00 +CPU= 31.048
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+000108
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+000108
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+000108
  15:57:02 STEP  109 H=  27:15 +CPU= 30.044
  15:57:28 STEP  110 H=  27:30 +CPU= 26.492
  15:57:53 STEP  111 H=  27:45 +CPU= 25.080
  15:58:19 STEP  112 H=  28:00 +CPU= 25.584
  15:58:45 STEP  113 H=  28:15 +CPU= 25.653
  15:59:10 STEP  114 H=  28:30 +CPU= 25.553
  15:59:37 STEP  115 H=  28:45 +CPU= 26.451
  16:00:07 STEP  116 H=  29:00 +CPU= 30.848
  16:00:37 STEP  117 H=  29:15 +CPU= 29.964
  16:01:08 STEP  118 H=  29:30 +CPU= 30.222
  16:01:36 STEP  119 H=  29:45 +CPU= 28.120
  16:02:11 STEP  120 H=  30:00 +CPU= 35.474
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+000120
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+000120
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+000120
  16:02:41 STEP  121 H=  30:15 +CPU= 29.334
  16:03:09 STEP  122 H=  30:30 +CPU= 28.700
  16:03:38 STEP  123 H=  30:45 +CPU= 28.895
  16:04:09 STEP  124 H=  31:00 +CPU= 30.229
  16:04:40 STEP  125 H=  31:15 +CPU= 31.244
  16:05:09 STEP  126 H=  31:30 +CPU= 29.622
  16:05:38 STEP  127 H=  31:45 +CPU= 28.578
  16:06:08 STEP  128 H=  32:00 +CPU= 29.708
  16:06:36 STEP  129 H=  32:15 +CPU= 28.203
  16:07:05 STEP  130 H=  32:30 +CPU= 28.701
  16:07:36 STEP  131 H=  32:45 +CPU= 31.128
  16:08:11 STEP  132 H=  33:00 +CPU= 35.475
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+000132
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+000132
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+000132
  16:08:41 STEP  133 H=  33:15 +CPU= 29.892
  16:09:11 STEP  134 H=  33:30 +CPU= 29.320
  16:09:40 STEP  135 H=  33:45 +CPU= 29.611
  16:10:09 STEP  136 H=  34:00 +CPU= 28.883
  16:10:38 STEP  137 H=  34:15 +CPU= 28.464
  16:11:06 STEP  138 H=  34:30 +CPU= 28.798
  16:11:35 STEP  139 H=  34:45 +CPU= 28.394
  16:12:03 STEP  140 H=  35:00 +CPU= 28.741
  16:12:32 STEP  141 H=  35:15 +CPU= 28.769
  16:13:00 STEP  142 H=  35:30 +CPU= 27.733
  16:13:29 STEP  143 H=  35:45 +CPU= 28.738
  16:14:08 STEP  144 H=  36:00 +CPU= 38.554
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+000144
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+000144
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+000144
  16:14:37 STEP  145 H=  36:15 +CPU= 28.998
  16:15:05 STEP  146 H=  36:30 +CPU= 28.083
  16:15:35 STEP  147 H=  36:45 +CPU= 30.071
  16:16:04 STEP  148 H=  37:00 +CPU= 29.055
  16:16:32 STEP  149 H=  37:15 +CPU= 27.473
  16:16:59 STEP  150 H=  37:30 +CPU= 26.923
  16:17:26 STEP  151 H=  37:45 +CPU= 27.729
  16:17:55 STEP  152 H=  38:00 +CPU= 28.745
  16:18:26 STEP  153 H=  38:15 +CPU= 30.722
  16:18:54 STEP  154 H=  38:30 +CPU= 28.387
  16:19:22 STEP  155 H=  38:45 +CPU= 28.125
  16:19:58 STEP  156 H=  39:00 +CPU= 35.151
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+000156
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+000156
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+000156
  16:20:26 STEP  157 H=  39:15 +CPU= 28.633
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:557:557] [20240614:162046:1718407246:4495.865] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1538] Received signal#8 (SIGFPE) :: 4412MB (heap), 5555MB (maxrss), 0MB (maxstack), 0 (paging), nsigs = 1
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:557:557] [20240614:162046:1718407246:4495.897] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1542] Also activating Harakiri-alarm (SIGALRM=14) to expire after 500s elapsed to prevent hangs, nsigs = 1
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:557:557] [20240614:162046:1718407246:4495.897] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1544] Harakiri signal handler 'signal_harakiri' for signal#14 (SIGALRM) installed at 0x820890 (old at (nil))
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:557:557] [20240614:162046:1718407246:4495.897] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1617] Signal#8 was caused by floating-point overflow [memaddr=0x1cc6692], nsigs = 1
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:557:557] [20240614:162046:1718407246:4495.897] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1686] Starting DrHook backtrace for signal#8, nsigs = 1
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:557:557] [20240614:162046:1718407246:4495.897] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3843] 4412 MB (maxheap), 5555 MB (maxrss), 0 MB (maxstack)
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:557:557] [20240614:162046:1718407246:4495.898] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :  MASTER 
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:557:557] [20240614:162046:1718407246:4495.950] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :   CNT0 
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:557:557] [20240614:162046:1718407246:4495.950] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :    CNT1 
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:557:557] [20240614:162046:1718407246:4495.950] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :     CNT2 
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:557:557] [20240614:162046:1718407246:4495.950] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :      CNT3 
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:557:557] [20240614:162046:1718407246:4495.950] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :       CNT4 
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:557:557] [20240614:162046:1718407246:4495.950] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :        STEPO 
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:557:557] [20240614:162046:1718407246:4495.950] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :         SCAN2M 
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:557:557] [20240614:162046:1718407246:4495.950] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :          GP_MODEL_HEAP 
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:557:557] [20240614:162046:1718407246:4495.950] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :           GP_MODEL 
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:557:557] [20240614:162046:1718407246:4495.950] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :            EC_PHYS_DRV 
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:557:557] [20240614:162046:1718407246:4495.950] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :             >OMP-PHYSICS              (1001) 
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:557:557] [20240614:162046:1718407246:4495.950] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :              EC_PHYS 
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:557:557] [20240614:162046:1718407246:4495.950] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :               CALLPAR 
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:557:557] [20240614:162046:1718407246:4495.950] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :                TURBULENCE_LAYER 
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:557:557] [20240614:162046:1718407246:4495.950] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :                 VDFOUTER 
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:557:557] [20240614:162046:1718407246:4495.950] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :                  VDFMAIN 
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:557:557] [20240614:162047:1718407247:4496.950] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:240] Backtrace(s) for program '/var/lib/boinc-client/slots/3/oifs_43r3_model.exe' : sigcontextptr=0x7ffc5c1d7b90
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:557:557] [20240614:162047:1718407247:4496.950] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:277] Backtrace (size = 24) with addr2line-cmd
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:557:557] [20240614:162047:1718407247:4496.950] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:302] /usr/bin/addr2line -fs -e '/var/lib/boinc-client/slots/3/oifs_43r3_model.exe' 0x83a8f3 0x83aef9 0x1dd5490 0x1cc6692 0x121fd8b 0x1207e29 0x11fdcb2 0xfac003 0xf5fa6b 0xf4dbc4 0xbd7131 0x12c5002 0xbacbae 0x688153 0x4cd1dc 0x4b5d85 0x4b4f52 0x49d638 0x406fbd 0x401e7f 0x401e12 0x1dcc34a 0x1dcdbe7 0x401cd5
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:557:557] [20240614:162047:1718407247:4496.950] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [0]: [0x83a8f3] : ??() at ??:0
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:557:557] [20240614:162047:1718407247:4496.950] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [1]: [0x83aef9] : ??() at ??:0
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:557:557] [20240614:162047:1718407247:4496.950] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [2]: [0x1dd5490] : ??() at ??:0
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:557:557] [20240614:162047:1718407247:4496.950] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [3]: [0x1cc6692] : ??() at ??:0
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:557:557] [20240614:162047:1718407247:4496.950] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [4]: [0x121fd8b] : ??() at ??:0
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:557:557] [20240614:162047:1718407247:4496.950] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [5]: [0x1207e29] : ??() at ??:0
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:557:557] [20240614:162047:1718407247:4496.950] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [6]: [0x11fdcb2] : ??() at ??:0
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:557:557] [20240614:162047:1718407247:4496.950] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [7]: [0xfac003] : ??() at ??:0
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:557:557] [20240614:162047:1718407247:4496.950] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [8]: [0xf5fa6b] : ??() at ??:0
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:557:557] [20240614:162047:1718407247:4496.950] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [9]: [0xf4dbc4] : ??() at ??:0
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:557:557] [20240614:162047:1718407247:4496.950] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [10]: [0xbd7131] : ??() at ??:0
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:557:557] [20240614:162047:1718407247:4496.950] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [11]: [0x12c5002] : ??() at ??:0
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:557:557] [20240614:162047:1718407247:4496.950] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [12]: [0xbacbae] : ??() at ??:0
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:557:557] [20240614:162047:1718407247:4496.950] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [13]: [0x688153] : ??() at ??:0
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:557:557] [20240614:162047:1718407247:4496.950] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [14]: [0x4cd1dc] : ??() at ??:0
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:557:557] [20240614:162047:1718407247:4496.950] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [15]: [0x4b5d85] : ??() at ??:0
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:557:557] [20240614:162047:1718407247:4496.950] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [16]: [0x4b4f52] : ??() at ??:0
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:557:557] [20240614:162047:1718407247:4496.950] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [17]: [0x49d638] : ??() at ??:0
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:557:557] [20240614:162047:1718407247:4496.950] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [18]: [0x406fbd] : ??() at ??:0
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:557:557] [20240614:162047:1718407247:4496.950] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [19]: [0x401e7f] : ??() at ??:0
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:557:557] [20240614:162047:1718407247:4496.950] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [20]: [0x401e12] : ??() at ??:0
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:557:557] [20240614:162047:1718407247:4496.950] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [21]: [0x1dcc34a] : ??() at ??:0
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:557:557] [20240614:162047:1718407247:4496.950] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [22]: [0x1dcdbe7] : ??() at ??:0
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:557:557] [20240614:162047:1718407247:4496.950] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [23]: [0x401cd5] : ??() at ??:0
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:557:557] [20240614:162047:1718407247:4496.950] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:370] End of backtrace(s)
 Process            1  thread            1  calling linux_trbk from intel_trbk()
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:240] Backtrace(s) for program '/var/lib/boinc-client/slots/3/oifs_43r3_model.exe' : sigcontextptr=0x7ffc5c1d7aa0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:277] Backtrace (size = 25) with addr2line-cmd
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:302] /usr/bin/addr2line -fs -e '/var/lib/boinc-client/slots/3/oifs_43r3_model.exe' 0x83a8f3 0x83aef9 0x822540 0x1dd5490 0x1cc6692 0x121fd8b 0x1207e29 0x11fdcb2 0xfac003 0xf5fa6b 0xf4dbc4 0xbd7131 0x12c5002 0xbacbae 0x688153 0x4cd1dc 0x4b5d85 0x4b4f52 0x49d638 0x406fbd 0x401e7f 0x401e12 0x1dcc34a 0x1dcdbe7 0x401cd5
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [0]: [0x83a8f3] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [1]: [0x83aef9] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [2]: [0x822540] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [3]: [0x1dd5490] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [4]: [0x1cc6692] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [5]: [0x121fd8b] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [6]: [0x1207e29] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [7]: [0x11fdcb2] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [8]: [0xfac003] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [9]: [0xf5fa6b] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [10]: [0xf4dbc4] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [11]: [0xbd7131] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [12]: [0x12c5002] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [13]: [0xbacbae] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [14]: [0x688153] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [15]: [0x4cd1dc] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [16]: [0x4b5d85] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [17]: [0x4b4f52] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [18]: [0x49d638] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [19]: [0x406fbd] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [20]: [0x401e7f] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [21]: [0x401e12] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [22]: [0x1dcc34a] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [23]: [0x1dcdbe7] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [24]: [0x401cd5] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:370] End of backtrace(s)
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:557:557] [20240614:162050:1718407250:4500.273] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1734] DrHook backtrace done for signal#8, nsigs = 1
[EC_DRHOOK:DESKTOP-D83U8LO:1:1:557:557] [20240614:162050:1718407250:4500.273] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1785] Calling previous signal handler at 0x1cf8da0 for signal#8, nsigs = 1
forrtl: error (72): floating overflow
Image              PC                Routine            Line        Source             
oifs_43r3_model.e  0000000001CF935B  Unknown               Unknown  Unknown
oifs_43r3_model.e  00000000008214C1  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DD5490  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001CC6692  Unknown               Unknown  Unknown
oifs_43r3_model.e  000000000121FD8B  vdfmain_                  874  vdfmain.F90
oifs_43r3_model.e  0000000001207E29  vdfouter_                 739  vdfouter.F90
oifs_43r3_model.e  00000000011FDCB2  turbulence_layer_         158  turbulence_layer.F90
oifs_43r3_model.e  0000000000FAC003  callpar_                  869  callpar.F90
oifs_43r3_model.e  0000000000F5FA6B  ec_phys_                  670  ec_phys.F90
oifs_43r3_model.e  0000000000F4DBC4  ec_phys_drv_              599  ec_phys_drv.F90
oifs_43r3_model.e  0000000000BD7131  gp_model_                 613  gp_model.F90
oifs_43r3_model.e  00000000012C5002  gp_model_heap_             74  gp_model_heap.F90
oifs_43r3_model.e  0000000000BACBAE  scan2m_                   535  scan2m.F90
oifs_43r3_model.e  0000000000688153  stepo_                    327  stepo.F90
oifs_43r3_model.e  00000000004CD1DC  cnt4_                    1133  cnt4.F90
oifs_43r3_model.e  00000000004B5D85  cnt3_                     267  cnt3.F90
oifs_43r3_model.e  00000000004B4F52  cnt2_                      88  cnt2.F90
oifs_43r3_model.e  000000000049D638  cnt1_                      92  cnt1.F90
oifs_43r3_model.e  0000000000406FBD  cnt0_                     146  cnt0.F90
oifs_43r3_model.e  0000000000401E7F  MAIN__                     96  master.F90
oifs_43r3_model.e  0000000000401E12  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DCC34A  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DCDBE7  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000000401CD5  Unknown               Unknown  Unknown
..The child process has been killed with signal: 6
>>> Printing last 70 lines from file: NODE.001_01

         990  9.999999999999998E-005
 GPNORM  HUMIDITY            AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.268666443614569E-02 0.999999999951667E-08 0.302380369248767E-01
 GPNORM  LIQUID WATER        AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.129663378691884E-05 0.000000000000000E+00 0.393603812698624E-02
 GPNORM  ICE WATER           AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.290973426322106E-05 0.000000000000000E+00 0.400546551738974E-02
 GPNORM SNOW                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.130394307211675E-04 0.000000000000000E+00 0.155512925784344E-01
 GPNORM RAIN                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.227062323426010E-05 0.000000000000000E+00 0.525965978856348E-02
 GPNORM  CLOUD FRACTION      AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.213762751729814E+00 0.000000000000000E+00 0.100000000000000E+01
 GPNORM CLW                  AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.129549999115680E-05 0.000000000000000E+00 0.398956782335363E-02
 GPNORM CIW                  AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.295526621803103E-05 0.000000000000000E+00 0.361092947542982E-02
 GPNORM CC                   AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.213669472592590E+00 0.000000000000000E+00 0.100000000000000E+01
 GPNORM RFL                  AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.831896548347187E-05 0.000000000000000E+00 0.188613218378857E-01
 GPNORM SFL                  AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.460835035390497E-05 0.000000000000000E+00 0.543148373071657E-02
 GPNORM CRFL                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.328460768340749E-05 0.000000000000000E+00 0.306243181228421E-02
 GPNORM CSFL                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.258801568033008E-06 0.000000000000000E+00 0.349873283335784E-02
 GPNORM PFRC                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.108837678155781E+00 0.000000000000000E+00 0.100000000000000E+01
 NSTEP =   156 STEPO   A00000000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =   156 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+000156 MODE=w
 IO-STREAM CLOSED - ICMGGh7zg+000156
 MPI-TASK:   1 -    325117092 BYTES IN      6 RECORDS TRANSFERRED IN    0.0004 SECONDS812792.8 Mbytes/s, TOTAL TIME=    0.0074( 5.4%)
 NSTEP =   156 STEPO   0AA000000
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMSHh7zg+000156 MODE=w
 IO-STREAM CLOSED - ./ICMSHh7zg+000156
 MPI-TASK:   1 -    707399250 BYTES IN    202 RECORDS TRANSFERRED IN    0.0087 SECONDS 81310.3 Mbytes/s, TOTAL TIME=    0.3187( 2.7%)
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMUAh7zg+000156 MODE=w
 IO-STREAM CLOSED - ./ICMUAh7zg+000156
 MPI-TASK:   1 -   5201873472 BYTES IN    125 RECORDS TRANSFERRED IN    0.0063 SECONDS825694.2 Mbytes/s, TOTAL TIME=    0.2669( 2.4%)
 STEPO_FPOS WAS : B00000F00E
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMUAh7zg+000156 MODE=a
 IO-STREAM CLOSED - ./ICMUAh7zg+000156
 MPI-TASK:   1 -           10 BYTES IN      2 RECORDS TRANSFERRED IN    0.0001 SECONDS     0.1 Mbytes/s, TOTAL TIME=    0.0053( 1.9%)
 STEPO_FPOS WAS : V00000000Y
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMUAh7zg+000156 MODE=a
 IO-STREAM CLOSED - ./ICMUAh7zg+000156
 MPI-TASK:   1 -    316537363 BYTES IN      4 RECORDS TRANSFERRED IN    0.0003 SECONDS******** Mbytes/s, TOTAL TIME=    0.0078( 3.8%)
 STEPO_FPOS WAS : T00000000M
 NSTEP =   156 STEPO   0AAA00AAA
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =   156 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+000156 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+000156
 MPI-TASK:   1 -    325117092 BYTES IN      7 RECORDS TRANSFERRED IN    0.0005 SECONDS650234.2 Mbytes/s, TOTAL TIME=    0.0138( 3.6%)
 16:19:58 STEP  156 H=  39:00 +CPU= 35.151
 NSTEP =   157 STEPO   0AAA00AAA
 16:20:26 STEP  157 H=  39:15 +CPU= 28.633
 NSTEP =   158 STEPO   0AAA00AAA
------------------------------------------------
CNT0 not found; string returned was: 'STEPO'
>>> Printing last 8 lines from file: ifs.stat

 16:19:23 0AA000000 STEPO      156     0.017    0.017    0.017     73:24     73:32 0.31398507145933E-04       2GB       0MB
 16:19:24 FULLPOS-B DYNFPOS    156     1.220    1.220    1.220     73:25     73:33 0.31398507145933E-04       2GB       0MB
 16:19:27 FULLPOS-V DYNFPOS    156     3.095    3.095    3.095     73:29     73:36 0.31398507145933E-04       2GB       0MB
 16:19:28 FULLPOS-T DYNFPOS    156     0.617    0.617    0.617     73:29     73:37 0.31398507145933E-04       2GB       0MB
 16:19:28 0AAA00AAA STEPO      156     0.547    0.547    0.548     73:30     73:37 0.31398507145933E-04       2GB       0MB
 16:19:58 0AAA00AAA STEPO      157    29.558   29.558   29.560     73:59     74:07 0.31398507145933E-04       2GB       0MB
 16:20:26 0AAA00AAA STEPO      158    28.634   28.634   28.642     74:28     74:36 0.31398507145933E-04       2GB       0MB
------------------------------------------------
>>> Printing last 11 lines from file: rcf

 CSTEP   = "     144",
 CTIME   = "00011200      ",
 NSTEPLPP        =         201,         202,          49,      228226,      228227, 2*0,         132, 2*0,
 IPRGPNSRES      =           1,
 IPRGPEWRES      =           1,
 IPRTRWRES       =           1,
 IPRTRVRES       =           1,
 GMASS0  =  0.000000000000000E+000,
 GMASSI  =  0.000000000000000E+000
 /
------------------------------------------------
>>> Printing last 8 lines from file: /var/lib/boinc-client/slots/3/progress_file_12292392.xml

<running_values>
  <last_cpu_time>4632.020000</last_cpu_time>
  <upload_file_number>1</upload_file_number>
  <last_iter>158</last_iter>
  <last_upload>86400</last_upload>
  <model_completed>0</model_completed>
</running_values>
------------------------------------------------
..Failed, model did not complete successfully

</stderr_txt>
]]>
No trickles!


©2024 cpdn.org