climateprediction.net home page
Task 22437808

Task 22437808

Name oifs_43r3_bl_a3da_2016092300_20_1017_12286193_0
Workunit 12286193
Created 7 Jun 2024, 17:09:30 UTC
Sent 7 Jun 2024, 17:21:13 UTC
Report deadline 6 Aug 2024, 17:21:13 UTC
Received 7 Jun 2024, 19:36:48 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 1 (0x00000001) Unknown error code
Computer ID 1540026
Run time 2 hours 11 min 19 sec
CPU time 2 hours 7 min 34 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 5.60 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.13
x86_64-pc-linux-gnu
Peak working set size 5,021.31 MB
Peak swap size 5,980.80 MB
Peak disk usage 1,313.66 MB
Stderr
<core_client_version>8.0.2</core_client_version>
<![CDATA[
<message>
process exited with code 1 (0x1, -255)</message>
<stderr_txt>
(argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.13_x86_64-pc-linux-gnu
(argv1) start_date: 2016092300
(argv2) exptid: h7zg
(argv3) unique_member_id: a3da
(argv4) batchid: 1017
(argv5) wuid: 12286193
(argv6) fclen: 20
(argv7) app_name: oifs_43r3_bl
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/16
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_bl
version: 1.13
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286193
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/16/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/16/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_54220e0295ce0977019e779a0024b7a6 to: /var/lib/boinc-client/slots/16/oifs_43r3_bl_a3da_2016092300_20_1017_12286193.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/16/oifs_43r3_bl_a3da_2016092300_20_1017_12286193.zip
ic_ancil_file: ic_ancil_12286193
ifsdata_file: ifsdata_12286193
climate_data_file: clim_data_12286193
horiz_resolution: 159
vert_resolution: 91
grid_type: l_2
upload_interval: 96
utstep: 900
nfrres: restart dump frequency (steps) 48
Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /var/lib/boinc-client/slots/16/ic_ancil_12286193.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/16/ic_ancil_12286193.zip
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_03ba988d75cf6573732990fecd5a1664 to: /var/lib/boinc-client/slots/16/ifsdata/ifsdata_12286193.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/16/ifsdata/ifsdata_12286193.zip
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/16/159l_2/clim_data_12286193.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/16/159l_2/clim_data_12286193.zip
Checking for progress XML file: /var/lib/boinc-client/slots/16/progress_file_12286193.xml
Creating progress file: /var/lib/boinc-client/slots/16/progress_file_12286193.xml
last_cpu_time: 0
upload_file_number: 0
last_iter: 0
last_upload: 0
model_completed: 0
total_length_of_simulation: 1728000
result_base_name: oifs_43r3_bl_a3da_2016092300_20_1017_12286193_0_r538055791
The child process has been launched with process id: 43061
Executing the command: /var/lib/boinc-client/slots/16/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:Rig-44:1:1:43061:43061] [20240607:102145:1717780905:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2091] fp = 0x314f440
[EC_DRHOOK:Rig-44:1:1:43061:43061] [20240607:102145:1717780905:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:Rig-44:1:1:43061:43061] [20240607:102145:1717780905:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:Rig-44:1:1:43061:43061] [20240607:102145:1717780905:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:Rig-44:1:1:43061:43061] [20240607:102145:1717780905:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:Rig-44:1:1:43061:43061] [20240607:102145:1717780905:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:Rig-44:1:1:43061:43061] [20240607:102145:1717780905:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:Rig-44:1:1:43061:43061] [20240607:102145:1717780905:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:Rig-44:1:1:43061:43061] [20240607:102145:1717780905:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:Rig-44:1:1:43061:43061] [20240607:102145:1717780905:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:Rig-44:1:1:43061:43061] [20240607:102145:1717780905:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:Rig-44:1:1:43061:43061] [20240607:102145:1717780905:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:Rig-44:1:1:43061:43061] [20240607:102145:1717780905:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:Rig-44:1:1:43061:43061] [20240607:102145:1717780905:0.000] [ignore_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:Rig-44:1:1:43061:43061] [20240607:102145:1717780905:0.000] [restore_default_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:Rig-44:1:1:43061:43061] [20240607:102145:1717780905:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Rig-44:1:1:43061:43061] [20240607:102145:1717780905:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Rig-44:1:1:43061:43061] [20240607:102145:1717780905:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Rig-44:1:1:43061:43061] [20240607:102145:1717780905:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Rig-44:1:1:43061:43061] [20240607:102145:1717780905:0.000] [trapfpe_treatment@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:Rig-44:1:1:43061:43061] [20240607:102145:1717780905:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Rig-44:1:1:43061:43061] [20240607:102145:1717780905:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Rig-44:1:1:43061:43061] [20240607:102145:1717780905:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Rig-44:1:1:43061:43061] [20240607:102145:1717780905:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Rig-44:1:1:43061:43061] [20240607:102145:1717780905:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Rig-44:1:1:43061:43061] [20240607:102145:1717780905:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Rig-44:1:1:43061:43061] [20240607:102145:1717780905:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Rig-44:1:1:43061:43061] [20240607:102145:1717780905:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Rig-44:1:1:43061:43061] [20240607:102145:1717780905:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Rig-44:1:1:43061:43061] [20240607:102145:1717780905:0.000] [catch_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  10:23:24 STEP    0 H=   0:00 +CPU= 86.871
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGh7zg+000000
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHh7zg+000000
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAh7zg+000000
  10:24:36 STEP    1 H=   0:15 +CPU= 71.976
  10:25:49 STEP    2 H=   0:30 +CPU= 72.306
  10:27:01 STEP    3 H=   0:45 +CPU= 72.217
  10:28:14 STEP    4 H=   1:00 +CPU= 72.571
  10:29:26 STEP    5 H=   1:15 +CPU= 72.037
  10:30:39 STEP    6 H=   1:30 +CPU= 72.126
  10:31:51 STEP    7 H=   1:45 +CPU= 71.973
  10:33:04 STEP    8 H=   2:00 +CPU= 72.643
  10:34:16 STEP    9 H=   2:15 +CPU= 71.974
  10:35:28 STEP   10 H=   2:30 +CPU= 71.784
  10:36:40 STEP   11 H=   2:45 +CPU= 71.735
  10:38:09 STEP   12 H=   3:00 +CPU= 88.722
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGh7zg+000012
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHh7zg+000012
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAh7zg+000012
  10:39:21 STEP   13 H=   3:15 +CPU= 71.769
  10:40:33 STEP   14 H=   3:30 +CPU= 71.623
  10:41:44 STEP   15 H=   3:45 +CPU= 71.576
  10:42:57 STEP   16 H=   4:00 +CPU= 72.305
  10:44:09 STEP   17 H=   4:15 +CPU= 71.668
  10:45:21 STEP   18 H=   4:30 +CPU= 71.828
  10:46:32 STEP   19 H=   4:45 +CPU= 71.541
  10:47:45 STEP   20 H=   5:00 +CPU= 72.316
  10:48:57 STEP   21 H=   5:15 +CPU= 71.813
  10:50:09 STEP   22 H=   5:30 +CPU= 71.867
  10:51:21 STEP   23 H=   5:45 +CPU= 72.130
  10:52:50 STEP   24 H=   6:00 +CPU= 88.894
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGh7zg+000024
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHh7zg+000024
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAh7zg+000024
  10:54:03 STEP   25 H=   6:15 +CPU= 71.803
  10:55:14 STEP   26 H=   6:30 +CPU= 71.742
  10:56:27 STEP   27 H=   6:45 +CPU= 71.948
  10:57:40 STEP   28 H=   7:00 +CPU= 72.722
  10:58:51 STEP   29 H=   7:15 +CPU= 71.675
  11:00:03 STEP   30 H=   7:30 +CPU= 71.413
  11:01:14 STEP   31 H=   7:45 +CPU= 71.020
  11:02:26 STEP   32 H=   8:00 +CPU= 72.054
  11:03:38 STEP   33 H=   8:15 +CPU= 71.666
  11:04:50 STEP   34 H=   8:30 +CPU= 70.976
  11:06:01 STEP   35 H=   8:45 +CPU= 71.071
  11:07:29 STEP   36 H=   9:00 +CPU= 87.588
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGh7zg+000036
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHh7zg+000036
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAh7zg+000036
  11:08:39 STEP   37 H=   9:15 +CPU= 70.590
  11:09:50 STEP   38 H=   9:30 +CPU= 70.704
  11:11:01 STEP   39 H=   9:45 +CPU= 70.666
  11:12:13 STEP   40 H=  10:00 +CPU= 71.511
  11:13:24 STEP   41 H=  10:15 +CPU= 70.751
  11:14:35 STEP   42 H=  10:30 +CPU= 71.292
  11:15:47 STEP   43 H=  10:45 +CPU= 71.571
  11:17:00 STEP   44 H=  11:00 +CPU= 72.421
  11:18:12 STEP   45 H=  11:15 +CPU= 71.544
  11:19:24 STEP   46 H=  11:30 +CPU= 71.747
  11:20:35 STEP   47 H=  11:45 +CPU= 71.482
  11:22:13 STEP   48 H=  12:00 +CPU= 96.640
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGh7zg+000048
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHh7zg+000048
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAh7zg+000048
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.13_x86_64-pc-linux-gnu
(argv1) start_date: 2016092300
(argv2) exptid: h7zg
(argv3) unique_member_id: a3da
(argv4) batchid: 1017
(argv5) wuid: 12286193
(argv6) fclen: 20
(argv7) app_name: oifs_43r3_bl
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/16
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_bl
version: 1.13
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286193
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/16/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/16/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_54220e0295ce0977019e779a0024b7a6 to: /var/lib/boinc-client/slots/16/oifs_43r3_bl_a3da_2016092300_20_1017_12286193.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/16/oifs_43r3_bl_a3da_2016092300_20_1017_12286193.zip
ic_ancil_file: ic_ancil_12286193
ifsdata_file: ifsdata_12286193
climate_data_file: clim_data_12286193
horiz_resolution: 159
vert_resolution: 91
grid_type: l_2
upload_interval: 96
utstep: 900
nfrres: restart dump frequency (steps) 48
Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /var/lib/boinc-client/slots/16/ic_ancil_12286193.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/16/ic_ancil_12286193.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_03ba988d75cf6573732990fecd5a1664 to: /var/lib/boinc-client/slots/16/ifsdata/ifsdata_12286193.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/16/ifsdata/ifsdata_12286193.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/16/159l_2/clim_data_12286193.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/16/159l_2/clim_data_12286193.zip
Checking for progress XML file: /var/lib/boinc-client/slots/16/progress_file_12286193.xml
Opened progress file ok : /var/lib/boinc-client/slots/16/progress_file_12286193.xml
-- Model is restarting --
Adjusting last_iter, 49, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/16/progress_file_12286193.xml
last_cpu_time: 3625
upload_file_number: 0
last_iter: 49
last_upload: 0
model_completed: 0
total_length_of_simulation: 1728000
result_base_name: oifs_43r3_bl_a3da_2016092300_20_1017_12286193_0_r538055791
The child process has been launched with process id: 82703
Executing the command: /var/lib/boinc-client/slots/16/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:Rig-44:1:1:82703:82703] [20240607:112331:1717784611:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2091] fp = 0x314f440
[EC_DRHOOK:Rig-44:1:1:82703:82703] [20240607:112331:1717784611:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:Rig-44:1:1:82703:82703] [20240607:112331:1717784611:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:Rig-44:1:1:82703:82703] [20240607:112331:1717784611:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:Rig-44:1:1:82703:82703] [20240607:112331:1717784611:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:Rig-44:1:1:82703:82703] [20240607:112331:1717784611:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:Rig-44:1:1:82703:82703] [20240607:112331:1717784611:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:Rig-44:1:1:82703:82703] [20240607:112331:1717784611:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:Rig-44:1:1:82703:82703] [20240607:112331:1717784611:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:Rig-44:1:1:82703:82703] [20240607:112331:1717784611:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:Rig-44:1:1:82703:82703] [20240607:112331:1717784611:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:Rig-44:1:1:82703:82703] [20240607:112331:1717784611:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:Rig-44:1:1:82703:82703] [20240607:112331:1717784611:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:Rig-44:1:1:82703:82703] [20240607:112331:1717784611:0.000] [ignore_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:Rig-44:1:1:82703:82703] [20240607:112331:1717784611:0.000] [restore_default_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:Rig-44:1:1:82703:82703] [20240607:112331:1717784611:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Rig-44:1:1:82703:82703] [20240607:112331:1717784611:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Rig-44:1:1:82703:82703] [20240607:112331:1717784611:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Rig-44:1:1:82703:82703] [20240607:112331:1717784611:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Rig-44:1:1:82703:82703] [20240607:112331:1717784611:0.000] [trapfpe_treatment@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:Rig-44:1:1:82703:82703] [20240607:112331:1717784611:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Rig-44:1:1:82703:82703] [20240607:112331:1717784611:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Rig-44:1:1:82703:82703] [20240607:112331:1717784611:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Rig-44:1:1:82703:82703] [20240607:112331:1717784611:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Rig-44:1:1:82703:82703] [20240607:112331:1717784611:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Rig-44:1:1:82703:82703] [20240607:112331:1717784611:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Rig-44:1:1:82703:82703] [20240607:112331:1717784611:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Rig-44:1:1:82703:82703] [20240607:112331:1717784611:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Rig-44:1:1:82703:82703] [20240607:112331:1717784611:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Rig-44:1:1:82703:82703] [20240607:112331:1717784611:0.000] [catch_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  11:25:11 STEP   48 H=  12:00 +CPU= 73.780
  11:26:36 STEP   49 H=  12:15 +CPU= 72.294
  11:27:59 STEP   50 H=  12:30 +CPU= 72.705
  11:29:24 STEP   51 H=  12:45 +CPU= 74.454
  11:31:02 STEP   52 H=  13:00 +CPU= 75.488
  11:31:52 STEP   53 H=  13:15 +CPU= 44.818
  11:32:31 STEP   54 H=  13:30 +CPU= 34.187
  11:33:32 STEP   55 H=  13:45 +CPU= 42.421
  11:34:17 STEP   56 H=  14:00 +CPU= 35.891
  11:34:54 STEP   57 H=  14:15 +CPU= 36.147
  11:35:32 STEP   58 H=  14:30 +CPU= 37.038
  11:36:08 STEP   59 H=  14:45 +CPU= 35.459
  11:36:52 STEP   60 H=  15:00 +CPU= 43.509
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGh7zg+000060
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHh7zg+000060
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAh7zg+000060
  11:37:28 STEP   61 H=  15:15 +CPU= 36.304
  11:38:04 STEP   62 H=  15:30 +CPU= 35.840
  11:38:41 STEP   63 H=  15:45 +CPU= 36.265
  11:39:21 STEP   64 H=  16:00 +CPU= 39.638
  11:39:59 STEP   65 H=  16:15 +CPU= 35.231
  11:40:34 STEP   66 H=  16:30 +CPU= 35.385
  11:41:11 STEP   67 H=  16:45 +CPU= 36.955
  11:41:51 STEP   68 H=  17:00 +CPU= 39.202
  11:42:31 STEP   69 H=  17:15 +CPU= 40.241
  11:43:06 STEP   70 H=  17:30 +CPU= 35.226
  11:43:43 STEP   71 H=  17:45 +CPU= 36.656
  11:44:31 STEP   72 H=  18:00 +CPU= 47.084
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGh7zg+000072
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHh7zg+000072
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAh7zg+000072
  11:45:11 STEP   73 H=  18:15 +CPU= 36.373
  11:45:51 STEP   74 H=  18:30 +CPU= 37.934
  11:46:27 STEP   75 H=  18:45 +CPU= 35.676
  11:47:04 STEP   76 H=  19:00 +CPU= 36.075
  11:47:38 STEP   77 H=  19:15 +CPU= 34.433
  11:48:12 STEP   78 H=  19:30 +CPU= 33.670
  11:48:47 STEP   79 H=  19:45 +CPU= 35.167
  11:49:25 STEP   80 H=  20:00 +CPU= 38.082
  11:50:02 STEP   81 H=  20:15 +CPU= 36.820
  11:50:43 STEP   82 H=  20:30 +CPU= 40.030
  11:51:16 STEP   83 H=  20:45 +CPU= 33.092
  11:52:03 STEP   84 H=  21:00 +CPU= 46.260
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGh7zg+000084
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHh7zg+000084
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAh7zg+000084
  11:52:44 STEP   85 H=  21:15 +CPU= 41.100
  11:53:21 STEP   86 H=  21:30 +CPU= 36.857
  11:54:09 STEP   87 H=  21:45 +CPU= 37.244
  11:54:51 STEP   88 H=  22:00 +CPU= 36.775
  11:55:26 STEP   89 H=  22:15 +CPU= 34.826
  11:56:04 STEP   90 H=  22:30 +CPU= 37.422
  11:56:39 STEP   91 H=  22:45 +CPU= 35.340
  11:57:16 STEP   92 H=  23:00 +CPU= 36.550
  11:57:53 STEP   93 H=  23:15 +CPU= 36.354
  11:58:30 STEP   94 H=  23:30 +CPU= 36.812
  11:59:05 STEP   95 H=  23:45 +CPU= 34.478
  11:59:54 STEP   96 H=  24:00 +CPU= 48.466
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGh7zg+000096
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHh7zg+000096
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAh7zg+000096
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286193/ICMGGh7zg+000000
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286193/ICMSHh7zg+000000
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286193/ICMUAh7zg+000000
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286193/ICMGGh7zg+000012
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286193/ICMSHh7zg+000012
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286193/ICMUAh7zg+000012
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286193/ICMGGh7zg+000024
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286193/ICMSHh7zg+000024
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286193/ICMUAh7zg+000024
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286193/ICMGGh7zg+000036
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286193/ICMSHh7zg+000036
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286193/ICMUAh7zg+000036
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286193/ICMGGh7zg+000048
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286193/ICMSHh7zg+000048
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286193/ICMUAh7zg+000048
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286193/ICMGGh7zg+000060
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286193/ICMSHh7zg+000060
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286193/ICMUAh7zg+000060
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286193/ICMGGh7zg+000072
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286193/ICMSHh7zg+000072
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286193/ICMUAh7zg+000072
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286193/ICMGGh7zg+000084
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286193/ICMSHh7zg+000084
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286193/ICMUAh7zg+000084
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3da_2016092300_20_1017_12286193_0_r538055791_0.zip
Uploading the intermediate file: upload_file_0.zip
  12:00:30 STEP   97 H=  24:15 +CPU= 35.891
  12:01:07 STEP   98 H=  24:30 +CPU= 36.207
  12:01:40 STEP   99 H=  24:45 +CPU= 33.307
  12:02:16 STEP  100 H=  25:00 +CPU= 36.130
  12:02:54 STEP  101 H=  25:15 +CPU= 37.726
  12:03:30 STEP  102 H=  25:30 +CPU= 35.225
  12:04:07 STEP  103 H=  25:45 +CPU= 36.441
  12:04:41 STEP  104 H=  26:00 +CPU= 34.504
  12:05:16 STEP  105 H=  26:15 +CPU= 34.308
  12:05:51 STEP  106 H=  26:30 +CPU= 35.451
  12:06:32 STEP  107 H=  26:45 +CPU= 39.141
  12:07:20 STEP  108 H=  27:00 +CPU= 47.670
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGh7zg+000108
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHh7zg+000108
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAh7zg+000108
  12:07:54 STEP  109 H=  27:15 +CPU= 33.679
  12:08:30 STEP  110 H=  27:30 +CPU= 35.747
  12:09:04 STEP  111 H=  27:45 +CPU= 34.094
  12:09:42 STEP  112 H=  28:00 +CPU= 37.805
  12:10:16 STEP  113 H=  28:15 +CPU= 34.428
  12:10:50 STEP  114 H=  28:30 +CPU= 33.348
  12:11:27 STEP  115 H=  28:45 +CPU= 36.969
  12:12:04 STEP  116 H=  29:00 +CPU= 37.188
  12:12:42 STEP  117 H=  29:15 +CPU= 37.884
  12:13:19 STEP  118 H=  29:30 +CPU= 36.588
  12:13:56 STEP  119 H=  29:45 +CPU= 36.104
  12:14:39 STEP  120 H=  30:00 +CPU= 42.776
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGh7zg+000120
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHh7zg+000120
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAh7zg+000120
  12:15:14 STEP  121 H=  30:15 +CPU= 35.345
  12:15:50 STEP  122 H=  30:30 +CPU= 35.942
  12:16:29 STEP  123 H=  30:45 +CPU= 38.079
  12:17:06 STEP  124 H=  31:00 +CPU= 37.487
  12:17:41 STEP  125 H=  31:15 +CPU= 34.312
  12:18:17 STEP  126 H=  31:30 +CPU= 36.076
  12:18:52 STEP  127 H=  31:45 +CPU= 34.173
  12:19:31 STEP  128 H=  32:00 +CPU= 38.984
  12:20:07 STEP  129 H=  32:15 +CPU= 35.875
  12:20:48 STEP  130 H=  32:30 +CPU= 40.875
  12:21:25 STEP  131 H=  32:45 +CPU= 37.521
  12:22:13 STEP  132 H=  33:00 +CPU= 47.314
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGh7zg+000132
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHh7zg+000132
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAh7zg+000132
  12:22:50 STEP  133 H=  33:15 +CPU= 36.368
  12:23:24 STEP  134 H=  33:30 +CPU= 34.115
  12:24:01 STEP  135 H=  33:45 +CPU= 36.670
  12:24:39 STEP  136 H=  34:00 +CPU= 37.380
  12:25:20 STEP  137 H=  34:15 +CPU= 41.125
  12:25:56 STEP  138 H=  34:30 +CPU= 36.221
  12:26:30 STEP  139 H=  34:45 +CPU= 34.020
  12:27:06 STEP  140 H=  35:00 +CPU= 35.432
  12:27:44 STEP  141 H=  35:15 +CPU= 36.094
  12:28:19 STEP  142 H=  35:30 +CPU= 35.018
  12:28:54 STEP  143 H=  35:45 +CPU= 34.764
  12:29:46 STEP  144 H=  36:00 +CPU= 51.156
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMGGh7zg+000144
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMSHh7zg+000144
Moving to projects directory: /var/lib/boinc-client/slots/16/ICMUAh7zg+000144
  12:30:25 STEP  145 H=  36:15 +CPU= 38.159
  12:30:59 STEP  146 H=  36:30 +CPU= 33.703
  12:31:37 STEP  147 H=  36:45 +CPU= 37.766
  12:32:19 STEP  148 H=  37:00 +CPU= 41.421
..The child process has been killed with signal: 9
>>> Printing last 70 lines from file: NODE.001_01

 GPNORM CIW                  AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.160972065604078E-07 0.000000000000000E+00 0.170494273568658E-06
 GPNORM CC                   AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.101284377744710E+00 0.000000000000000E+00 0.100000000000000E+01
 GPNORM RFL                  AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.000000000000000E+00 0.000000000000000E+00 0.000000000000000E+00
 GPNORM SFL                  AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.451051804282551E-10 0.000000000000000E+00 0.679521037704729E-09
 GPNORM CRFL                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.000000000000000E+00 0.000000000000000E+00 0.000000000000000E+00
 GPNORM CSFL                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.000000000000000E+00 0.000000000000000E+00 0.000000000000000E+00
 GPNORM PFRC                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.118310745736492E-01 0.000000000000000E+00 0.100000000000000E+01
 NSTEP =   144 STEPO   F00000000
 CREATE RESTART FILE ./srf00011200.0001                                                                                                                                                                                                                                              
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./srf00011200.0001 MODE=w
 IO-STREAM CLOSED - ./srf00011200.0001
 MPI-TASK:   1 - ************ BYTES IN     46 RECORDS TRANSFERRED IN    4.2547 SECONDS******** Mbytes/s, TOTAL TIME=    6.1436(69.3%)
 CREATE RESTART CONTROL FILE ./rcf                                                                                                                   
 WRRESF: DELETED PREVIOUS RESTART FILE OK: ./srf00010000.0001
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =   144 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+000144 MODE=w
 IO-STREAM CLOSED - ICMGGh7zg+000144
 MPI-TASK:   1 -    299200468 BYTES IN      6 RECORDS TRANSFERRED IN    0.0004 SECONDS748001.2 Mbytes/s, TOTAL TIME=    0.0526( 0.8%)
 NSTEP =   144 STEPO   0AA000000
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMSHh7zg+000144 MODE=w
 IO-STREAM CLOSED - ./ICMSHh7zg+000144
 MPI-TASK:   1 -    707399250 BYTES IN    202 RECORDS TRANSFERRED IN    0.0095 SECONDS 74463.1 Mbytes/s, TOTAL TIME=    0.4912( 1.9%)
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMUAh7zg+000144 MODE=w
 IO-STREAM CLOSED - ./ICMUAh7zg+000144
 MPI-TASK:   1 -   4787207488 BYTES IN    125 RECORDS TRANSFERRED IN    0.0027 SECONDS******** Mbytes/s, TOTAL TIME=    0.1948( 1.4%)
 STEPO_FPOS WAS : B00000F00E
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMUAh7zg+000144 MODE=a
 IO-STREAM CLOSED - ./ICMUAh7zg+000144
 MPI-TASK:   1 -           10 BYTES IN      2 RECORDS TRANSFERRED IN    0.0001 SECONDS     0.1 Mbytes/s, TOTAL TIME=    0.0046( 2.2%)
 STEPO_FPOS WAS : V00000000Y
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMUAh7zg+000144 MODE=a
 IO-STREAM CLOSED - ./ICMUAh7zg+000144
 MPI-TASK:   1 -    290620739 BYTES IN      4 RECORDS TRANSFERRED IN    0.0002 SECONDS******** Mbytes/s, TOTAL TIME=    0.0069( 2.9%)
 STEPO_FPOS WAS : T00000000M
 NSTEP =   144 STEPO   0AAA00AAA
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =   144 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+000144 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+000144
 MPI-TASK:   1 -    299200468 BYTES IN      7 RECORDS TRANSFERRED IN    0.0007 SECONDS427429.2 Mbytes/s, TOTAL TIME=    0.0238( 2.9%)
 12:29:46 STEP  144 H=  36:00 +CPU= 51.156
ISTEP=     145 RSOLINC= 1361.4482 RI0= 1365.0000 ZI0= 1361.4482 RIP0= 1361.4482
ISTEP=     145 ZI0= 1361.4482 ZSEASON= 1.000000000 REA=149597870000.00 RDEASO=149597870000.00
 NSTEP =   145 STEPO   0AAA00AAA
 12:30:25 STEP  145 H=  36:15 +CPU= 38.159
 NSTEP =   146 STEPO   0AAA00AAA
 12:30:59 STEP  146 H=  36:30 +CPU= 33.703
 NSTEP =   147 STEPO   0AAA00AAA
 12:31:37 STEP  147 H=  36:45 +CPU= 37.766
 NSTEP =   148 STEPO   0AAA00AAA
 12:32:19 STEP  148 H=  37:00 +CPU= 41.421
 NSTEP =   149 STEPO   0AAA00AAA
------------------------------------------------
CNT0 not found; string returned was: 'STEPO'
>>> Printing last 8 lines from file: ifs.stat

 12:29:09 FULLPOS-T DYNFPOS    144     0.648    0.648    0.648     63:00     65:37 0.14109071002240E-06       2GB       0MB
 12:29:09 0AAA00AAA STEPO      144     0.633    0.633    0.633     63:01     65:38 0.14109071002240E-06       2GB       0MB
 12:29:46 0AAA00AAA STEPO      145    37.008   37.008   37.218     63:38     66:15 0.14109071002240E-06       2GB       0MB
 12:30:25 0AAA00AAA STEPO      146    38.159   38.159   38.325     64:16     66:53 0.14109071002240E-06       2GB       0MB
 12:30:59 0AAA00AAA STEPO      147    33.703   33.703   33.759     64:49     67:27 0.14109071002240E-06       2GB       0MB
 12:31:37 0AAA00AAA STEPO      148    37.767   37.767   38.364     65:27     68:05 0.14109071002240E-06       2GB       0MB
 12:32:19 0AAA00AAA STEPO      149    41.421   41.421   42.013     66:09     68:47 0.14109071002240E-06       2GB       0MB
------------------------------------------------
>>> Printing last 11 lines from file: rcf

 CSTEP   = "     144",
 CTIME   = "00011200      ",
 NSTEPLPP        =         201,         202,          49,      228226,      228227, 2*0,         132, 2*0,
 IPRGPNSRES      =           1,
 IPRGPEWRES      =           1,
 IPRTRWRES       =           1,
 IPRTRVRES       =           1,
 GMASS0  =  0.000000000000000E+000,
 GMASSI  =  0.000000000000000E+000
 /
------------------------------------------------
>>> Printing last 8 lines from file: /var/lib/boinc-client/slots/16/progress_file_12286193.xml

<running_values>
  <last_cpu_time>7652.590000</last_cpu_time>
  <upload_file_number>1</upload_file_number>
  <last_iter>149</last_iter>
  <last_upload>86400</last_upload>
  <model_completed>0</model_completed>
</running_values>
------------------------------------------------
..Failed, model did not complete successfully

</stderr_txt>
]]>
No trickles!


©2024 cpdn.org