climateprediction.net (CPDN) home page
Task 22503848

Task 22503848

Name oifs_43r3_bl_a1hc_2016092300_20_1018_12290247_2
Workunit 12290247
Created 3 Aug 2024, 18:15:50 UTC
Sent 3 Aug 2024, 18:16:18 UTC
Report deadline 2 Oct 2024, 18:16:18 UTC
Received 4 Aug 2024, 11:31:28 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 1 (0x00000001) Unknown error code
Computer ID 1541083
Run time 5 hours 7 min 18 sec
CPU time 5 hours 5 min 40 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 2.81 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.13
x86_64-pc-linux-gnu
Peak working set size 4.91 GB
Peak swap size 5.84 GB
Peak disk usage 1.26 GB
Stderr
<core_client_version>8.0.2</core_client_version>
<![CDATA[
<message>
process exited with code 1 (0x1, -255)</message>
<stderr_txt>
(argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.13_x86_64-pc-linux-gnu
(argv1) start_date: 2016092300
(argv2) exptid: h7zg
(argv3) unique_member_id: a1hc
(argv4) batchid: 1018
(argv5) wuid: 12290247
(argv6) fclen: 20
(argv7) app_name: oifs_43r3_bl
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/24
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_bl
version: 1.13
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290247
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/24/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/24/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_3f65c3730852479e9a4e6ae3b3b150c5 to: /var/lib/boinc-client/slots/24/oifs_43r3_bl_a1hc_2016092300_20_1018_12290247.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/24/oifs_43r3_bl_a1hc_2016092300_20_1018_12290247.zip
ic_ancil_file: ic_ancil_12290247
ifsdata_file: ifsdata_12290247
climate_data_file: clim_data_12290247
horiz_resolution: 159
vert_resolution: 91
grid_type: l_2
upload_interval: 96
utstep: 900
nfrres: restart dump frequency (steps) 48
Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /var/lib/boinc-client/slots/24/ic_ancil_12290247.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/24/ic_ancil_12290247.zip
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_0b2b3b8a21486b4cf20695283b33a6de to: /var/lib/boinc-client/slots/24/ifsdata/ifsdata_12290247.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/24/ifsdata/ifsdata_12290247.zip
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/24/159l_2/clim_data_12290247.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/24/159l_2/clim_data_12290247.zip
Checking for progress XML file: /var/lib/boinc-client/slots/24/progress_file_12290247.xml
Creating progress file: /var/lib/boinc-client/slots/24/progress_file_12290247.xml
last_cpu_time: 0
upload_file_number: 0
last_iter: 0
last_upload: 0
model_completed: 0
total_length_of_simulation: 1728000
result_base_name: oifs_43r3_bl_a1hc_2016092300_20_1018_12290247_2_r2046576065
The child process has been launched with process id: 69592
Executing the command: /var/lib/boinc-client/slots/24/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:hpc1:1:1:69592:69592] [20240804:061701:1722709021:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2091] fp = 0x314f440
[EC_DRHOOK:hpc1:1:1:69592:69592] [20240804:061701:1722709021:0.001] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:hpc1:1:1:69592:69592] [20240804:061701:1722709021:0.001] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:hpc1:1:1:69592:69592] [20240804:061701:1722709021:0.001] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:hpc1:1:1:69592:69592] [20240804:061701:1722709021:0.001] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:hpc1:1:1:69592:69592] [20240804:061701:1722709021:0.001] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:hpc1:1:1:69592:69592] [20240804:061701:1722709021:0.001] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:hpc1:1:1:69592:69592] [20240804:061701:1722709021:0.001] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:hpc1:1:1:69592:69592] [20240804:061701:1722709021:0.001] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:hpc1:1:1:69592:69592] [20240804:061701:1722709021:0.001] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:hpc1:1:1:69592:69592] [20240804:061701:1722709021:0.001] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:hpc1:1:1:69592:69592] [20240804:061701:1722709021:0.001] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:hpc1:1:1:69592:69592] [20240804:061701:1722709021:0.001] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:hpc1:1:1:69592:69592] [20240804:061701:1722709021:0.001] [ignore_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:hpc1:1:1:69592:69592] [20240804:061701:1722709021:0.001] [restore_default_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:hpc1:1:1:69592:69592] [20240804:061701:1722709021:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:hpc1:1:1:69592:69592] [20240804:061701:1722709021:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:hpc1:1:1:69592:69592] [20240804:061701:1722709021:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:hpc1:1:1:69592:69592] [20240804:061701:1722709021:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x820cf0 (old at (nil))
[EC_DRHOOK:hpc1:1:1:69592:69592] [20240804:061701:1722709021:0.001] [trapfpe_treatment@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:hpc1:1:1:69592:69592] [20240804:061701:1722709021:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:hpc1:1:1:69592:69592] [20240804:061701:1722709021:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:hpc1:1:1:69592:69592] [20240804:061701:1722709021:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x820cf0 (old at (nil))
[EC_DRHOOK:hpc1:1:1:69592:69592] [20240804:061701:1722709021:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:hpc1:1:1:69592:69592] [20240804:061701:1722709021:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:hpc1:1:1:69592:69592] [20240804:061701:1722709021:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:hpc1:1:1:69592:69592] [20240804:061701:1722709021:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x820cf0 (old at (nil))
[EC_DRHOOK:hpc1:1:1:69592:69592] [20240804:061701:1722709021:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x820cf0 (old at (nil))
[EC_DRHOOK:hpc1:1:1:69592:69592] [20240804:061701:1722709021:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:hpc1:1:1:69592:69592] [20240804:061701:1722709021:0.001] [catch_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  06:19:16 STEP    0 H=   0:00 +CPU=102.831
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMGGh7zg+000000
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMSHh7zg+000000
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMUAh7zg+000000
  06:20:14 STEP    1 H=   0:15 +CPU= 57.283
  06:21:25 STEP    2 H=   0:30 +CPU= 70.104
  06:22:34 STEP    3 H=   0:45 +CPU= 68.502
  06:23:46 STEP    4 H=   1:00 +CPU= 71.093
  06:25:02 STEP    5 H=   1:15 +CPU= 75.006
  06:26:17 STEP    6 H=   1:30 +CPU= 74.244
  06:27:35 STEP    7 H=   1:45 +CPU= 77.750
  06:28:49 STEP    8 H=   2:00 +CPU= 72.767
  06:29:59 STEP    9 H=   2:15 +CPU= 69.369
  06:31:08 STEP   10 H=   2:30 +CPU= 68.269
  06:32:30 STEP   11 H=   2:45 +CPU= 80.974
  06:34:15 STEP   12 H=   3:00 +CPU=104.382
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMGGh7zg+000012
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMSHh7zg+000012
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMUAh7zg+000012
  06:35:26 STEP   13 H=   3:15 +CPU= 70.532
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  06:37:54 STEP   14 H=   3:30 +CPU=105.029
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  06:39:29 STEP   15 H=   3:45 +CPU= 73.841
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  06:41:43 STEP   16 H=   4:00 +CPU= 70.800
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  06:44:35 STEP   17 H=   4:15 +CPU=106.763
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  06:47:02 STEP   18 H=   4:30 +CPU= 82.091
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  06:49:32 STEP   19 H=   4:45 +CPU= 85.083
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  06:52:13 STEP   20 H=   5:00 +CPU= 96.117
  06:53:37 STEP   21 H=   5:15 +CPU= 83.270
  06:55:04 STEP   22 H=   5:30 +CPU= 85.213
  06:56:30 STEP   23 H=   5:45 +CPU= 84.777
  06:58:21 STEP   24 H=   6:00 +CPU=108.921
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMGGh7zg+000024
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMSHh7zg+000024
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMUAh7zg+000024
  06:59:53 STEP   25 H=   6:15 +CPU= 90.392
  07:01:20 STEP   26 H=   6:30 +CPU= 85.181
  07:03:05 STEP   27 H=   6:45 +CPU=103.439
  07:04:55 STEP   28 H=   7:00 +CPU=109.760
  07:06:30 STEP   29 H=   7:15 +CPU= 94.391
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  07:08:20 STEP   30 H=   7:30 +CPU= 88.433
  07:09:55 STEP   31 H=   7:45 +CPU= 94.437
  07:11:35 STEP   32 H=   8:00 +CPU= 99.951
  07:13:06 STEP   33 H=   8:15 +CPU= 89.532
  07:15:04 STEP   34 H=   8:30 +CPU=115.931
  07:16:18 STEP   35 H=   8:45 +CPU= 74.020
  07:18:17 STEP   36 H=   9:00 +CPU=116.822
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMGGh7zg+000036
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMSHh7zg+000036
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMUAh7zg+000036
  07:19:53 STEP   37 H=   9:15 +CPU= 95.876
  07:21:36 STEP   38 H=   9:30 +CPU=101.896
  07:23:21 STEP   39 H=   9:45 +CPU=104.376
  07:24:49 STEP   40 H=  10:00 +CPU= 87.018
  07:26:34 STEP   41 H=  10:15 +CPU=104.684
  07:28:01 STEP   42 H=  10:30 +CPU= 86.236
  07:29:18 STEP   43 H=  10:45 +CPU= 77.489
  07:30:44 STEP   44 H=  11:00 +CPU= 84.899
  07:32:27 STEP   45 H=  11:15 +CPU=102.396
  07:33:53 STEP   46 H=  11:30 +CPU= 85.668
  07:35:13 STEP   47 H=  11:45 +CPU= 79.766
  07:37:32 STEP   48 H=  12:00 +CPU=137.913
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMGGh7zg+000048
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMSHh7zg+000048
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMUAh7zg+000048
  07:38:45 STEP   49 H=  12:15 +CPU= 72.899
  07:39:55 STEP   50 H=  12:30 +CPU= 69.940
  07:41:19 STEP   51 H=  12:45 +CPU= 83.863
  07:43:00 STEP   52 H=  13:00 +CPU= 99.788
  07:44:26 STEP   53 H=  13:15 +CPU= 85.606
  07:45:35 STEP   54 H=  13:30 +CPU= 68.498
  07:46:51 STEP   55 H=  13:45 +CPU= 76.401
  07:48:21 STEP   56 H=  14:00 +CPU= 89.064
  07:49:42 STEP   57 H=  14:15 +CPU= 80.589
  07:50:57 STEP   58 H=  14:30 +CPU= 74.992
  07:52:12 STEP   59 H=  14:45 +CPU= 74.694
  07:53:47 STEP   60 H=  15:00 +CPU= 94.677
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMGGh7zg+000060
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMSHh7zg+000060
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMUAh7zg+000060
  07:55:09 STEP   61 H=  15:15 +CPU= 82.343
  07:56:23 STEP   62 H=  15:30 +CPU= 73.278
  07:57:33 STEP   63 H=  15:45 +CPU= 70.737
  07:58:46 STEP   64 H=  16:00 +CPU= 72.315
  08:00:08 STEP   65 H=  16:15 +CPU= 82.363
  08:01:31 STEP   66 H=  16:30 +CPU= 82.571
  08:02:48 STEP   67 H=  16:45 +CPU= 76.343
  08:03:55 STEP   68 H=  17:00 +CPU= 67.067
  08:05:12 STEP   69 H=  17:15 +CPU= 77.438
  08:06:32 STEP   70 H=  17:30 +CPU= 79.010
  08:07:52 STEP   71 H=  17:45 +CPU= 80.588
  08:09:28 STEP   72 H=  18:00 +CPU= 95.914
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMGGh7zg+000072
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMSHh7zg+000072
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMUAh7zg+000072
  08:10:45 STEP   73 H=  18:15 +CPU= 76.576
  08:11:52 STEP   74 H=  18:30 +CPU= 67.126
  08:13:12 STEP   75 H=  18:45 +CPU= 79.440
  08:14:27 STEP   76 H=  19:00 +CPU= 75.116
  08:15:46 STEP   77 H=  19:15 +CPU= 78.993
  08:16:55 STEP   78 H=  19:30 +CPU= 67.836
  08:18:06 STEP   79 H=  19:45 +CPU= 71.239
  08:19:20 STEP   80 H=  20:00 +CPU= 73.717
  08:20:40 STEP   81 H=  20:15 +CPU= 80.253
  08:22:01 STEP   82 H=  20:30 +CPU= 80.431
  08:23:11 STEP   83 H=  20:45 +CPU= 69.620
  08:24:35 STEP   84 H=  21:00 +CPU= 84.421
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMGGh7zg+000084
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMSHh7zg+000084
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMUAh7zg+000084
  08:25:55 STEP   85 H=  21:15 +CPU= 79.196
  08:27:20 STEP   86 H=  21:30 +CPU= 84.349
  08:28:33 STEP   87 H=  21:45 +CPU= 73.108
  08:29:50 STEP   88 H=  22:00 +CPU= 77.283
  08:31:01 STEP   89 H=  22:15 +CPU= 70.817
  08:32:16 STEP   90 H=  22:30 +CPU= 74.371
  08:33:32 STEP   91 H=  22:45 +CPU= 76.019
  08:34:46 STEP   92 H=  23:00 +CPU= 74.135
  08:35:57 STEP   93 H=  23:15 +CPU= 70.291
  08:37:00 STEP   94 H=  23:30 +CPU= 62.904
  08:38:20 STEP   95 H=  23:45 +CPU= 79.071
  08:40:21 STEP   96 H=  24:00 +CPU=121.096
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMGGh7zg+000096
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMSHh7zg+000096
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMUAh7zg+000096
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290247/ICMGGh7zg+000000
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290247/ICMSHh7zg+000000
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290247/ICMUAh7zg+000000
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290247/ICMGGh7zg+000012
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290247/ICMSHh7zg+000012
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290247/ICMUAh7zg+000012
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290247/ICMGGh7zg+000024
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290247/ICMSHh7zg+000024
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290247/ICMUAh7zg+000024
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290247/ICMGGh7zg+000036
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290247/ICMSHh7zg+000036
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290247/ICMUAh7zg+000036
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290247/ICMGGh7zg+000048
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290247/ICMSHh7zg+000048
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290247/ICMUAh7zg+000048
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290247/ICMGGh7zg+000060
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290247/ICMSHh7zg+000060
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290247/ICMUAh7zg+000060
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290247/ICMGGh7zg+000072
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290247/ICMSHh7zg+000072
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290247/ICMUAh7zg+000072
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290247/ICMGGh7zg+000084
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290247/ICMSHh7zg+000084
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290247/ICMUAh7zg+000084
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a1hc_2016092300_20_1018_12290247_2_r2046576065_0.zip
Uploading the intermediate file: upload_file_0.zip
  08:41:38 STEP   97 H=  24:15 +CPU= 75.680
  08:42:52 STEP   98 H=  24:30 +CPU= 73.966
  08:44:04 STEP   99 H=  24:45 +CPU= 71.004
  08:45:22 STEP  100 H=  25:00 +CPU= 78.669
  08:46:45 STEP  101 H=  25:15 +CPU= 82.142
  08:47:57 STEP  102 H=  25:30 +CPU= 71.862
  08:49:10 STEP  103 H=  25:45 +CPU= 72.951
  08:50:33 STEP  104 H=  26:00 +CPU= 82.336
  08:52:02 STEP  105 H=  26:15 +CPU= 88.401
  08:53:17 STEP  106 H=  26:30 +CPU= 74.970
  08:54:28 STEP  107 H=  26:45 +CPU= 71.188
  08:55:48 STEP  108 H=  27:00 +CPU= 79.684
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMGGh7zg+000108
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMSHh7zg+000108
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMUAh7zg+000108
  08:56:59 STEP  109 H=  27:15 +CPU= 70.546
  08:58:14 STEP  110 H=  27:30 +CPU= 75.424
  08:59:36 STEP  111 H=  27:45 +CPU= 81.418
  09:00:48 STEP  112 H=  28:00 +CPU= 72.108
  09:02:02 STEP  113 H=  28:15 +CPU= 74.014
  09:03:20 STEP  114 H=  28:30 +CPU= 77.640
  09:04:40 STEP  115 H=  28:45 +CPU= 79.240
  09:05:57 STEP  116 H=  29:00 +CPU= 76.883
  09:07:02 STEP  117 H=  29:15 +CPU= 65.204
  09:08:13 STEP  118 H=  29:30 +CPU= 70.215
  09:09:24 STEP  119 H=  29:45 +CPU= 71.703
  09:11:01 STEP  120 H=  30:00 +CPU= 95.901
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMGGh7zg+000120
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMSHh7zg+000120
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMUAh7zg+000120
  09:12:20 STEP  121 H=  30:15 +CPU= 79.326
  09:13:39 STEP  122 H=  30:30 +CPU= 78.572
  09:14:49 STEP  123 H=  30:45 +CPU= 69.808
  09:15:58 STEP  124 H=  31:00 +CPU= 69.524
  09:17:14 STEP  125 H=  31:15 +CPU= 75.291
  09:18:38 STEP  126 H=  31:30 +CPU= 83.652
  09:19:52 STEP  127 H=  31:45 +CPU= 73.241
  09:21:04 STEP  128 H=  32:00 +CPU= 71.987
  09:22:16 STEP  129 H=  32:15 +CPU= 72.284
  09:23:25 STEP  130 H=  32:30 +CPU= 68.905
  09:24:38 STEP  131 H=  32:45 +CPU= 72.693
  09:26:18 STEP  132 H=  33:00 +CPU= 99.922
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMGGh7zg+000132
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMSHh7zg+000132
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMUAh7zg+000132
  09:27:32 STEP  133 H=  33:15 +CPU= 73.851
  09:28:38 STEP  134 H=  33:30 +CPU= 65.485
  09:29:51 STEP  135 H=  33:45 +CPU= 72.910
  09:31:12 STEP  136 H=  34:00 +CPU= 81.122
  09:32:34 STEP  137 H=  34:15 +CPU= 81.766
  09:33:53 STEP  138 H=  34:30 +CPU= 78.604
  09:35:03 STEP  139 H=  34:45 +CPU= 70.249
  09:36:08 STEP  140 H=  35:00 +CPU= 64.201
  09:37:29 STEP  141 H=  35:15 +CPU= 80.912
  09:38:49 STEP  142 H=  35:30 +CPU= 80.404
  09:40:03 STEP  143 H=  35:45 +CPU= 72.977
  09:41:44 STEP  144 H=  36:00 +CPU=101.141
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMGGh7zg+000144
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMSHh7zg+000144
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMUAh7zg+000144
  09:42:51 STEP  145 H=  36:15 +CPU= 66.332
  09:44:08 STEP  146 H=  36:30 +CPU= 77.493
  09:45:31 STEP  147 H=  36:45 +CPU= 82.455
  09:47:00 STEP  148 H=  37:00 +CPU= 88.634
  09:48:18 STEP  149 H=  37:15 +CPU= 77.995
  09:49:37 STEP  150 H=  37:30 +CPU= 78.680
  09:51:03 STEP  151 H=  37:45 +CPU= 85.713
  09:52:20 STEP  152 H=  38:00 +CPU= 77.700
  09:53:35 STEP  153 H=  38:15 +CPU= 74.673
  09:54:51 STEP  154 H=  38:30 +CPU= 75.555
  09:56:11 STEP  155 H=  38:45 +CPU= 80.169
  09:57:49 STEP  156 H=  39:00 +CPU= 97.826
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMGGh7zg+000156
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMSHh7zg+000156
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMUAh7zg+000156
  09:59:12 STEP  157 H=  39:15 +CPU= 82.486
  10:00:23 STEP  158 H=  39:30 +CPU= 71.028
  10:01:33 STEP  159 H=  39:45 +CPU= 70.011
  10:02:46 STEP  160 H=  40:00 +CPU= 72.391
  10:04:11 STEP  161 H=  40:15 +CPU= 84.465
  10:05:35 STEP  162 H=  40:30 +CPU= 83.834
  10:06:50 STEP  163 H=  40:45 +CPU= 75.297
  10:08:04 STEP  164 H=  41:00 +CPU= 73.756
  10:09:18 STEP  165 H=  41:15 +CPU= 73.356
  10:10:36 STEP  166 H=  41:30 +CPU= 78.044
  10:11:42 STEP  167 H=  41:45 +CPU= 66.354
  10:13:20 STEP  168 H=  42:00 +CPU= 97.282
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMGGh7zg+000168
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMSHh7zg+000168
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMUAh7zg+000168
  10:14:35 STEP  169 H=  42:15 +CPU= 74.869
  10:15:51 STEP  170 H=  42:30 +CPU= 75.849
  10:17:15 STEP  171 H=  42:45 +CPU= 84.212
  10:18:36 STEP  172 H=  43:00 +CPU= 80.401
  10:19:52 STEP  173 H=  43:15 +CPU= 76.131
  10:21:05 STEP  174 H=  43:30 +CPU= 73.118
  10:22:26 STEP  175 H=  43:45 +CPU= 79.808
  10:24:03 STEP  176 H=  44:00 +CPU= 96.775
  10:25:22 STEP  177 H=  44:15 +CPU= 78.972
  10:26:42 STEP  178 H=  44:30 +CPU= 80.352
  10:27:55 STEP  179 H=  44:45 +CPU= 72.928
  10:29:32 STEP  180 H=  45:00 +CPU= 96.843
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMGGh7zg+000180
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMSHh7zg+000180
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMUAh7zg+000180
  10:30:59 STEP  181 H=  45:15 +CPU= 85.968
  10:32:16 STEP  182 H=  45:30 +CPU= 77.526
  10:33:45 STEP  183 H=  45:45 +CPU= 88.407
  10:34:58 STEP  184 H=  46:00 +CPU= 73.085
  10:36:31 STEP  185 H=  46:15 +CPU= 92.284
  10:38:09 STEP  186 H=  46:30 +CPU= 97.640
  10:39:28 STEP  187 H=  46:45 +CPU= 78.877
  10:40:40 STEP  188 H=  47:00 +CPU= 71.624
  10:42:05 STEP  189 H=  47:15 +CPU= 85.062
  10:43:36 STEP  190 H=  47:30 +CPU= 90.701
  10:45:04 STEP  191 H=  47:45 +CPU= 87.184
  10:47:10 STEP  192 H=  48:00 +CPU=125.616
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMGGh7zg+000192
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMSHh7zg+000192
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMUAh7zg+000192
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290247/ICMGGh7zg+000096
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290247/ICMSHh7zg+000096
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290247/ICMUAh7zg+000096
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290247/ICMGGh7zg+000108
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290247/ICMSHh7zg+000108
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290247/ICMUAh7zg+000108
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290247/ICMGGh7zg+000120
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290247/ICMSHh7zg+000120
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290247/ICMUAh7zg+000120
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290247/ICMGGh7zg+000132
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290247/ICMSHh7zg+000132
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290247/ICMUAh7zg+000132
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290247/ICMGGh7zg+000144
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290247/ICMSHh7zg+000144
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290247/ICMUAh7zg+000144
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290247/ICMGGh7zg+000156
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290247/ICMSHh7zg+000156
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290247/ICMUAh7zg+000156
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290247/ICMGGh7zg+000168
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290247/ICMSHh7zg+000168
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290247/ICMUAh7zg+000168
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290247/ICMGGh7zg+000180
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290247/ICMSHh7zg+000180
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290247/ICMUAh7zg+000180
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a1hc_2016092300_20_1018_12290247_2_r2046576065_1.zip
Uploading the intermediate file: upload_file_1.zip
  10:48:21 STEP  193 H=  48:15 +CPU= 69.633
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  10:50:32 STEP  194 H=  48:30 +CPU= 89.014
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  10:52:35 STEP  195 H=  48:45 +CPU= 81.099
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  10:54:20 STEP  196 H=  49:00 +CPU= 83.025
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  10:57:18 STEP  197 H=  49:15 +CPU= 92.618
  10:58:38 STEP  198 H=  49:30 +CPU= 79.602
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  11:00:38 STEP  199 H=  49:45 +CPU= 76.427
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  11:02:29 STEP  200 H=  50:00 +CPU= 89.558
  11:04:00 STEP  201 H=  50:15 +CPU= 90.810
  11:05:27 STEP  202 H=  50:30 +CPU= 86.335
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  11:06:59 STEP  203 H=  50:45 +CPU= 70.905
  11:08:43 STEP  204 H=  51:00 +CPU=104.083
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMGGh7zg+000204
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMSHh7zg+000204
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMUAh7zg+000204
  11:10:18 STEP  205 H=  51:15 +CPU= 94.297
  11:11:55 STEP  206 H=  51:30 +CPU= 97.337
  11:13:19 STEP  207 H=  51:45 +CPU= 83.778
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  11:15:13 STEP  208 H=  52:00 +CPU= 91.233
  11:16:47 STEP  209 H=  52:15 +CPU= 93.282
  11:18:02 STEP  210 H=  52:30 +CPU= 75.133
  11:19:22 STEP  211 H=  52:45 +CPU= 80.071
  11:20:34 STEP  212 H=  53:00 +CPU= 71.289
  11:22:08 STEP  213 H=  53:15 +CPU= 93.628
  11:23:32 STEP  214 H=  53:30 +CPU= 83.825
  11:24:54 STEP  215 H=  53:45 +CPU= 81.687
  11:26:33 STEP  216 H=  54:00 +CPU= 99.296
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMGGh7zg+000216
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMSHh7zg+000216
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMUAh7zg+000216
  11:28:11 STEP  217 H=  54:15 +CPU= 96.713
  11:29:50 STEP  218 H=  54:30 +CPU= 98.856
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  22:31:58 STEP  219 H=  54:45 +CPU=104.757
  MAX U WIND=   250.457783375912     
  22:33:26 STEP  220 H=  55:00 +CPU= 87.316
  MAX V WIND=   250.455206231749     
  MAX U WIND=   251.773511128515     
  MAX U WIND=   256.259573969322     
  22:34:58 STEP  221 H=  55:15 +CPU= 91.634
  MAX U WIND=   255.241326814548     
  MAX U WIND=   263.017952544044     
[EC_DRHOOK:hpc1:1:1:69592:69592] [20240804:223607:1722767767:58746.450] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1538] Received signal#8 (SIGFPE) :: 4412MB (heap), 5025MB (maxrss), 0MB (maxstack), 0 (paging), nsigs = 1
[EC_DRHOOK:hpc1:1:1:69592:69592] [20240804:223607:1722767767:58746.451] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1542] Also activating Harakiri-alarm (SIGALRM=14) to expire after 500s elapsed to prevent hangs, nsigs = 1
[EC_DRHOOK:hpc1:1:1:69592:69592] [20240804:223607:1722767767:58746.451] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1544] Harakiri signal handler 'signal_harakiri' for signal#14 (SIGALRM) installed at 0x820890 (old at (nil))
[EC_DRHOOK:hpc1:1:1:69592:69592] [20240804:223607:1722767767:58746.451] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1617] Signal#8 was caused by floating-point overflow [memaddr=0x1cc6692], nsigs = 1
[EC_DRHOOK:hpc1:1:1:69592:69592] [20240804:223607:1722767767:58746.451] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1686] Starting DrHook backtrace for signal#8, nsigs = 1
[EC_DRHOOK:hpc1:1:1:69592:69592] [20240804:223607:1722767767:58746.451] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3843] 4412 MB (maxheap), 5025 MB (maxrss), 0 MB (maxstack)
[EC_DRHOOK:hpc1:1:1:69592:69592] [20240804:223607:1722767767:58746.451] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :  MASTER 
[EC_DRHOOK:hpc1:1:1:69592:69592] [20240804:223607:1722767767:58746.452] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :   CNT0 
[EC_DRHOOK:hpc1:1:1:69592:69592] [20240804:223607:1722767767:58746.452] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :    CNT1 
[EC_DRHOOK:hpc1:1:1:69592:69592] [20240804:223607:1722767767:58746.452] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :     CNT2 
[EC_DRHOOK:hpc1:1:1:69592:69592] [20240804:223607:1722767767:58746.452] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :      CNT3 
[EC_DRHOOK:hpc1:1:1:69592:69592] [20240804:223607:1722767767:58746.452] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :       CNT4 
[EC_DRHOOK:hpc1:1:1:69592:69592] [20240804:223607:1722767767:58746.452] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :        STEPO 
[EC_DRHOOK:hpc1:1:1:69592:69592] [20240804:223607:1722767767:58746.452] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :         SCAN2M 
[EC_DRHOOK:hpc1:1:1:69592:69592] [20240804:223607:1722767767:58746.452] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :          GP_MODEL_HEAP 
[EC_DRHOOK:hpc1:1:1:69592:69592] [20240804:223607:1722767767:58746.452] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :           GP_MODEL 
[EC_DRHOOK:hpc1:1:1:69592:69592] [20240804:223607:1722767767:58746.452] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :            EC_PHYS_DRV 
[EC_DRHOOK:hpc1:1:1:69592:69592] [20240804:223607:1722767767:58746.452] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :             >OMP-PHYSICS              (1001) 
[EC_DRHOOK:hpc1:1:1:69592:69592] [20240804:223607:1722767767:58746.452] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :              EC_PHYS 
[EC_DRHOOK:hpc1:1:1:69592:69592] [20240804:223607:1722767767:58746.452] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :               CALLPAR 
[EC_DRHOOK:hpc1:1:1:69592:69592] [20240804:223607:1722767767:58746.452] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :                TURBULENCE_LAYER 
[EC_DRHOOK:hpc1:1:1:69592:69592] [20240804:223607:1722767767:58746.452] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :                 VDFOUTER 
[EC_DRHOOK:hpc1:1:1:69592:69592] [20240804:223607:1722767767:58746.452] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :                  VDFMAIN 
[EC_DRHOOK:hpc1:1:1:69592:69592] [20240804:223608:1722767768:58747.453] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:240] Backtrace(s) for program '/var/lib/boinc-client/slots/24/oifs_43r3_model.exe' : sigcontextptr=0x7ffcf7023310
[EC_DRHOOK:hpc1:1:1:69592:69592] [20240804:223608:1722767768:58747.453] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:277] Backtrace (size = 24) with addr2line-cmd
[EC_DRHOOK:hpc1:1:1:69592:69592] [20240804:223608:1722767768:58747.453] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:302] /usr/bin/addr2line -fs -e '/var/lib/boinc-client/slots/24/oifs_43r3_model.exe' 0x83a8f3 0x83aef9 0x1dd5490 0x1cc6692 0x121fd8b 0x1207e29 0x11fdcb2 0xfac003 0xf5fa6b 0xf4dbc4 0xbd7131 0x12c5002 0xbacbae 0x688153 0x4cd1dc 0x4b5d85 0x4b4f52 0x49d638 0x406fbd 0x401e7f 0x401e12 0x1dcc34a 0x1dcdbe7 0x401cd5
[EC_DRHOOK:hpc1:1:1:69592:69592] [20240804:223608:1722767768:58747.453] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [0]: [0x83a8f3] : ??() at ??:0
[EC_DRHOOK:hpc1:1:1:69592:69592] [20240804:223608:1722767768:58747.453] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [1]: [0x83aef9] : ??() at ??:0
[EC_DRHOOK:hpc1:1:1:69592:69592] [20240804:223608:1722767768:58747.453] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [2]: [0x1dd5490] : ??() at ??:0
[EC_DRHOOK:hpc1:1:1:69592:69592] [20240804:223608:1722767768:58747.453] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [3]: [0x1cc6692] : ??() at ??:0
[EC_DRHOOK:hpc1:1:1:69592:69592] [20240804:223608:1722767768:58747.453] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [4]: [0x121fd8b] : ??() at ??:0
[EC_DRHOOK:hpc1:1:1:69592:69592] [20240804:223608:1722767768:58747.453] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [5]: [0x1207e29] : ??() at ??:0
[EC_DRHOOK:hpc1:1:1:69592:69592] [20240804:223608:1722767768:58747.453] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [6]: [0x11fdcb2] : ??() at ??:0
[EC_DRHOOK:hpc1:1:1:69592:69592] [20240804:223608:1722767768:58747.453] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [7]: [0xfac003] : ??() at ??:0
[EC_DRHOOK:hpc1:1:1:69592:69592] [20240804:223608:1722767768:58747.453] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [8]: [0xf5fa6b] : ??() at ??:0
[EC_DRHOOK:hpc1:1:1:69592:69592] [20240804:223608:1722767768:58747.453] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [9]: [0xf4dbc4] : ??() at ??:0
[EC_DRHOOK:hpc1:1:1:69592:69592] [20240804:223608:1722767768:58747.453] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [10]: [0xbd7131] : ??() at ??:0
[EC_DRHOOK:hpc1:1:1:69592:69592] [20240804:223608:1722767768:58747.453] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [11]: [0x12c5002] : ??() at ??:0
[EC_DRHOOK:hpc1:1:1:69592:69592] [20240804:223608:1722767768:58747.453] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [12]: [0xbacbae] : ??() at ??:0
[EC_DRHOOK:hpc1:1:1:69592:69592] [20240804:223608:1722767768:58747.453] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [13]: [0x688153] : ??() at ??:0
[EC_DRHOOK:hpc1:1:1:69592:69592] [20240804:223608:1722767768:58747.453] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [14]: [0x4cd1dc] : ??() at ??:0
[EC_DRHOOK:hpc1:1:1:69592:69592] [20240804:223608:1722767768:58747.453] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [15]: [0x4b5d85] : ??() at ??:0
[EC_DRHOOK:hpc1:1:1:69592:69592] [20240804:223608:1722767768:58747.453] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [16]: [0x4b4f52] : ??() at ??:0
[EC_DRHOOK:hpc1:1:1:69592:69592] [20240804:223608:1722767768:58747.453] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [17]: [0x49d638] : ??() at ??:0
[EC_DRHOOK:hpc1:1:1:69592:69592] [20240804:223608:1722767768:58747.453] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [18]: [0x406fbd] : ??() at ??:0
[EC_DRHOOK:hpc1:1:1:69592:69592] [20240804:223608:1722767768:58747.453] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [19]: [0x401e7f] : ??() at ??:0
[EC_DRHOOK:hpc1:1:1:69592:69592] [20240804:223608:1722767768:58747.453] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [20]: [0x401e12] : ??() at ??:0
[EC_DRHOOK:hpc1:1:1:69592:69592] [20240804:223608:1722767768:58747.453] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [21]: [0x1dcc34a] : ??() at ??:0
[EC_DRHOOK:hpc1:1:1:69592:69592] [20240804:223608:1722767768:58747.453] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [22]: [0x1dcdbe7] : ??() at ??:0
[EC_DRHOOK:hpc1:1:1:69592:69592] [20240804:223608:1722767768:58747.453] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [23]: [0x401cd5] : ??() at ??:0
[EC_DRHOOK:hpc1:1:1:69592:69592] [20240804:223608:1722767768:58747.453] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:370] End of backtrace(s)
 Process            1  thread            1  calling linux_trbk from intel_trbk()
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:240] Backtrace(s) for program '/var/lib/boinc-client/slots/24/oifs_43r3_model.exe' : sigcontextptr=0x7ffcf7023220
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:277] Backtrace (size = 25) with addr2line-cmd
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:302] /usr/bin/addr2line -fs -e '/var/lib/boinc-client/slots/24/oifs_43r3_model.exe' 0x83a8f3 0x83aef9 0x822540 0x1dd5490 0x1cc6692 0x121fd8b 0x1207e29 0x11fdcb2 0xfac003 0xf5fa6b 0xf4dbc4 0xbd7131 0x12c5002 0xbacbae 0x688153 0x4cd1dc 0x4b5d85 0x4b4f52 0x49d638 0x406fbd 0x401e7f 0x401e12 0x1dcc34a 0x1dcdbe7 0x401cd5
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [0]: [0x83a8f3] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [1]: [0x83aef9] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [2]: [0x822540] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [3]: [0x1dd5490] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [4]: [0x1cc6692] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [5]: [0x121fd8b] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [6]: [0x1207e29] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [7]: [0x11fdcb2] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [8]: [0xfac003] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [9]: [0xf5fa6b] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [10]: [0xf4dbc4] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [11]: [0xbd7131] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [12]: [0x12c5002] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [13]: [0xbacbae] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [14]: [0x688153] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [15]: [0x4cd1dc] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [16]: [0x4b5d85] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [17]: [0x4b4f52] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [18]: [0x49d638] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [19]: [0x406fbd] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [20]: [0x401e7f] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [21]: [0x401e12] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [22]: [0x1dcc34a] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [23]: [0x1dcdbe7] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [24]: [0x401cd5] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:370] End of backtrace(s)
[EC_DRHOOK:hpc1:1:1:69592:69592] [20240804:223608:1722767768:58747.516] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1734] DrHook backtrace done for signal#8, nsigs = 1
[EC_DRHOOK:hpc1:1:1:69592:69592] [20240804:223608:1722767768:58747.516] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1785] Calling previous signal handler at 0x1cf8da0 for signal#8, nsigs = 1
forrtl: error (72): floating overflow
Image              PC                Routine            Line        Source             
oifs_43r3_model.e  0000000001CF935B  Unknown               Unknown  Unknown
oifs_43r3_model.e  00000000008214C1  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DD5490  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001CC6692  Unknown               Unknown  Unknown
oifs_43r3_model.e  000000000121FD8B  vdfmain_                  874  vdfmain.F90
oifs_43r3_model.e  0000000001207E29  vdfouter_                 739  vdfouter.F90
oifs_43r3_model.e  00000000011FDCB2  turbulence_layer_         158  turbulence_layer.F90
oifs_43r3_model.e  0000000000FAC003  callpar_                  869  callpar.F90
oifs_43r3_model.e  0000000000F5FA6B  ec_phys_                  670  ec_phys.F90
oifs_43r3_model.e  0000000000F4DBC4  ec_phys_drv_              599  ec_phys_drv.F90
oifs_43r3_model.e  0000000000BD7131  gp_model_                 613  gp_model.F90
oifs_43r3_model.e  00000000012C5002  gp_model_heap_             74  gp_model_heap.F90
oifs_43r3_model.e  0000000000BACBAE  scan2m_                   535  scan2m.F90
oifs_43r3_model.e  0000000000688153  stepo_                    327  stepo.F90
oifs_43r3_model.e  00000000004CD1DC  cnt4_                    1133  cnt4.F90
oifs_43r3_model.e  00000000004B5D85  cnt3_                     267  cnt3.F90
oifs_43r3_model.e  00000000004B4F52  cnt2_                      88  cnt2.F90
oifs_43r3_model.e  000000000049D638  cnt1_                      92  cnt1.F90
oifs_43r3_model.e  0000000000406FBD  cnt0_                     146  cnt0.F90
oifs_43r3_model.e  0000000000401E7F  MAIN__                     96  master.F90
oifs_43r3_model.e  0000000000401E12  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DCC34A  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DCDBE7  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000000401CD5  Unknown               Unknown  Unknown
..The child process has been killed with signal: 6
>>> Printing last 70 lines from file: NODE.001_01

         AVE   0.630723903772764E-05 0.000000000000000E+00 0.931990435243595E-02
 GPNORM  CLOUD FRACTION      AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.198858821557255E+00 0.000000000000000E+00 0.100000000000000E+01
 GPNORM CLW                  AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.378875315669306E-05 0.000000000000000E+00 0.150960891026184E-01
 GPNORM CIW                  AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.857515434523743E-04 0.000000000000000E+00 0.181667178866164E-01
 GPNORM CC                   AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.197028736191607E+00 0.000000000000000E+00 0.100000000000000E+01
 GPNORM RFL                  AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.209596133619083E-04 0.000000000000000E+00 0.254847345720641E-01
 GPNORM SFL                  AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.346476298081901E-04 0.000000000000000E+00 0.797445211471290E-02
 GPNORM CRFL                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.576361417077709E-05 0.000000000000000E+00 0.241262746566924E-01
 GPNORM CSFL                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.322879439250121E-05 0.000000000000000E+00 0.113949758262381E-01
 GPNORM PFRC                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.149177934651391E+00 0.000000000000000E+00 0.100000000000000E+01
 NSTEP =   216 STEPO   A00000000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =   216 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+000216 MODE=w
 IO-STREAM CLOSED - ICMGGh7zg+000216
 MPI-TASK:   1 -    319386500 BYTES IN      6 RECORDS TRANSFERRED IN    0.0020 SECONDS159693.2 Mbytes/s, TOTAL TIME=    0.0259( 7.7%)
 NSTEP =   216 STEPO   0AA000000
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMSHh7zg+000216 MODE=w
 IO-STREAM CLOSED - ./ICMSHh7zg+000216
 MPI-TASK:   1 -    707399250 BYTES IN    202 RECORDS TRANSFERRED IN    0.0429 SECONDS 16489.5 Mbytes/s, TOTAL TIME=    0.6103( 7.0%)
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMUAh7zg+000216 MODE=w
 IO-STREAM CLOSED - ./ICMUAh7zg+000216
 MPI-TASK:   1 -   5110184000 BYTES IN    125 RECORDS TRANSFERRED IN    0.0246 SECONDS207731.1 Mbytes/s, TOTAL TIME=    0.4189( 5.9%)
 STEPO_FPOS WAS : B00000F00E
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMUAh7zg+000216 MODE=a
 IO-STREAM CLOSED - ./ICMUAh7zg+000216
 MPI-TASK:   1 -           10 BYTES IN      2 RECORDS TRANSFERRED IN    0.0008 SECONDS     0.0 Mbytes/s, TOTAL TIME=    0.0091( 8.8%)
 STEPO_FPOS WAS : V00000000Y
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMUAh7zg+000216 MODE=a
 IO-STREAM CLOSED - ./ICMUAh7zg+000216
 MPI-TASK:   1 -    310806771 BYTES IN      4 RECORDS TRANSFERRED IN    0.0012 SECONDS259005.6 Mbytes/s, TOTAL TIME=    0.0134( 9.0%)
 STEPO_FPOS WAS : T00000000M
 NSTEP =   216 STEPO   0AAA00AAA
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =   216 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+000216 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+000216
 MPI-TASK:   1 -    319386500 BYTES IN      7 RECORDS TRANSFERRED IN    0.0031 SECONDS103027.9 Mbytes/s, TOTAL TIME=    0.0305(10.2%)
 11:26:33 STEP  216 H=  54:00 +CPU= 99.296
 NSTEP =   217 STEPO   0AAA00AAA
 11:28:11 STEP  217 H=  54:15 +CPU= 96.713
 NSTEP =   218 STEPO   0AAA00AAA
 11:29:50 STEP  218 H=  54:30 +CPU= 98.856
 NSTEP =   219 STEPO   0AAA00AAA
 22:31:58 STEP  219 H=  54:45 +CPU=104.757
ISTEP=     220 RSOLINC= 1361.4482 RI0= 1365.0000 ZI0= 1361.4482 RIP0= 1361.4482
ISTEP=     220 ZI0= 1361.4482 ZSEASON= 1.000000000 REA=149597870000.00 RDEASO=149597870000.00
 NSTEP =   220 STEPO   0AAA00AAA
 22:33:26 STEP  220 H=  55:00 +CPU= 87.316
 NSTEP =   221 STEPO   0AAA00AAA
 22:34:58 STEP  221 H=  55:15 +CPU= 91.634
 NSTEP =   222 STEPO   0AAA00AAA
------------------------------------------------
CNT0 not found; string returned was: 'STEPO'
>>> Printing last 8 lines from file: ifs.stat

 11:25:07 0AAA00AAA STEPO      216     1.201    1.201    1.201    295:04    308:06 0.68199711305152E-04       2GB       0MB
 11:26:33 0AAA00AAA STEPO      217    85.942   85.942   86.046    296:30    309:32 0.68199711305152E-04       2GB       0MB
 11:28:11 0AAA00AAA STEPO      218    96.714   96.714   97.329    298:07    311:09 0.68199711305152E-04       2GB       0MB
 11:29:50 0AAA00AAA STEPO      219    98.857   98.857   99.369    299:46    312:49 0.68199711305152E-04       2GB       0MB
 22:31:58 0AAA00AAA STEPO      220   104.760  104.76039728.017    301:31    974:57 0.68199711305152E-04       2GB       0MB
 22:33:26 0AAA00AAA STEPO      221    87.315   87.315   87.465    302:58    976:24 0.68199711305152E-04       2GB       0MB
 22:34:58 0AAA00AAA STEPO      222    91.635   91.635   92.417    304:29    977:57 0.68199711305152E-04       2GB       0MB
------------------------------------------------
>>> Printing last 11 lines from file: rcf

 CSTEP   = "     192",
 CTIME   = "00020000      ",
 NSTEPLPP        =         201,         202,          49,      228226,      228227, 2*0,         180, 2*0,
 IPRGPNSRES      =           1,
 IPRGPEWRES      =           1,
 IPRTRWRES       =           1,
 IPRTRVRES       =           1,
 GMASS0  =  0.000000000000000E+000,
 GMASSI  =  0.000000000000000E+000
 /
------------------------------------------------
>>> Printing last 8 lines from file: /var/lib/boinc-client/slots/24/progress_file_12290247.xml

<running_values>
  <last_cpu_time>18339.870000</last_cpu_time>
  <upload_file_number>2</upload_file_number>
  <last_iter>222</last_iter>
  <last_upload>172800</last_upload>
  <model_completed>0</model_completed>
</running_values>
------------------------------------------------
..Failed, model did not complete successfully

</stderr_txt>
]]>
No trickles!


©2024 cpdn.org