<core_client_version>7.16.6</core_client_version>
<![CDATA[
<stderr_txt>
25.472
10:43:26 STEP 1231 H= 307:45 +CPU= 26.273
10:43:49 STEP 1232 H= 308:00 +CPU= 23.021
10:44:13 STEP 1233 H= 308:15 +CPU= 23.944
10:44:38 STEP 1234 H= 308:30 +CPU= 24.701
10:45:02 STEP 1235 H= 308:45 +CPU= 23.385
10:45:34 STEP 1236 H= 309:00 +CPU= 31.666
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGh7zg+001236
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHh7zg+001236
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAh7zg+001236
10:46:00 STEP 1237 H= 309:15 +CPU= 25.817
10:46:23 STEP 1238 H= 309:30 +CPU= 22.800
10:46:48 STEP 1239 H= 309:45 +CPU= 24.005
10:47:12 STEP 1240 H= 310:00 +CPU= 23.989
10:47:37 STEP 1241 H= 310:15 +CPU= 25.119
10:48:03 STEP 1242 H= 310:30 +CPU= 25.377
10:48:28 STEP 1243 H= 310:45 +CPU= 24.265
10:48:55 STEP 1244 H= 311:00 +CPU= 26.492
10:49:20 STEP 1245 H= 311:15 +CPU= 25.137
10:49:45 STEP 1246 H= 311:30 +CPU= 24.433
10:50:09 STEP 1247 H= 311:45 +CPU= 23.424
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.11_x86_64-pc-linux-gnu
(argv1) start_date: 2016092300
(argv2) exptid: h7zg
(argv3) unique_member_id: a4nl
(argv4) batchid: 991
(argv5) wuid: 12212820
(argv6) fclen: 15
(argv7) app_name: oifs_43r3_bl
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/10
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_bl
version: 1.11
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/10/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/10/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_911841787ef8dcd5aee0284312fd6b18 to: /var/lib/boinc-client/slots/10/oifs_43r3_bl_a4nl_2016092300_15_991_12212820.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/10/oifs_43r3_bl_a4nl_2016092300_15_991_12212820.zip
ic_ancil_file: ic_ancil_12212820
ifsdata_file: ifsdata_12212820
climate_data_file: clim_data_12212820
horiz_resolution: 159
vert_resolution: 91
grid_type: l_2
upload_interval: 96
utstep: 900
nfrres: restart dump frequency (steps) 48
Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /var/lib/boinc-client/slots/10/ic_ancil_12212820.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/10/ic_ancil_12212820.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_fce85c99a7f03c8a670ceedc0368a597 to: /var/lib/boinc-client/slots/10/ifsdata/ifsdata_12212820.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/10/ifsdata/ifsdata_12212820.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/10/159l_2/clim_data_12212820.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/10/159l_2/clim_data_12212820.zip
Checking for progress XML file: /var/lib/boinc-client/slots/10/progress_file_12212820.xml
Opened progress file ok : /var/lib/boinc-client/slots/10/progress_file_12212820.xml
-- Model is restarting --
Adjusting last_iter, 1248, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/10/progress_file_12212820.xml
last_cpu_time: 38093
upload_file_number: 12
last_iter: 1249
last_upload: 1037700
model_completed: 0
total_length_of_simulation: 1296000
result_base_name: oifs_43r3_bl_a4nl_2016092300_15_991_12212820_0_r1071169990
The child process has been launched with process id: 3923424
Executing the command: /var/lib/boinc-client/slots/10/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:3923424:3923424] [20230214:105123:1676397083:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2091] fp = 0x30e4a00
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:3923424:3923424] [20230214:105123:1676397083:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:3923424:3923424] [20230214:105123:1676397083:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:3923424:3923424] [20230214:105123:1676397083:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:3923424:3923424] [20230214:105123:1676397083:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:3923424:3923424] [20230214:105123:1676397083:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:3923424:3923424] [20230214:105123:1676397083:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:3923424:3923424] [20230214:105123:1676397083:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:3923424:3923424] [20230214:105123:1676397083:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:3923424:3923424] [20230214:105123:1676397083:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:3923424:3923424] [20230214:105123:1676397083:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:3923424:3923424] [20230214:105123:1676397083:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:3923424:3923424] [20230214:105123:1676397083:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:3923424:3923424] [20230214:105123:1676397083:0.000] [ignore_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:3923424:3923424] [20230214:105123:1676397083:0.000] [restore_default_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:3923424:3923424] [20230214:105123:1676397083:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:3923424:3923424] [20230214:105123:1676397083:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f520 (old at (nil))
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:3923424:3923424] [20230214:105123:1676397083:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:3923424:3923424] [20230214:105123:1676397083:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f520 (old at (nil))
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:3923424:3923424] [20230214:105123:1676397083:0.000] [trapfpe_treatment@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:3923424:3923424] [20230214:105123:1676397083:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:3923424:3923424] [20230214:105123:1676397083:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:3923424:3923424] [20230214:105123:1676397083:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f520 (old at (nil))
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:3923424:3923424] [20230214:105123:1676397083:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:3923424:3923424] [20230214:105123:1676397083:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:3923424:3923424] [20230214:105123:1676397083:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:3923424:3923424] [20230214:105123:1676397083:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f520 (old at (nil))
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:3923424:3923424] [20230214:105123:1676397083:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f520 (old at (nil))
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:3923424:3923424] [20230214:105123:1676397083:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f520 (old at (nil))
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:3923424:3923424] [20230214:105123:1676397083:0.000] [catch_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820/ICMGGh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820/ICMSHh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820/ICMUAh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820/ICMGGh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820/ICMSHh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820/ICMUAh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820/ICMGGh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820/ICMSHh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820/ICMUAh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820/ICMGGh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820/ICMSHh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820/ICMUAh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820/ICMGGh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820/ICMSHh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820/ICMUAh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820/ICMGGh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820/ICMSHh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820/ICMUAh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820/ICMGGh7zg+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820/ICMSHh7zg+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820/ICMUAh7zg+001236
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a4nl_2016092300_15_991_12212820_0_r1071169990_12.zip
Uploading the intermediate file: upload_file_12.zip
10:51:52 STEP 1248 H= 312:00 +CPU= 24.391
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGh7zg+001248
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHh7zg+001248
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAh7zg+001248
10:52:17 STEP 1249 H= 312:15 +CPU= 24.985
10:52:41 STEP 1250 H= 312:30 +CPU= 24.076
10:53:06 STEP 1251 H= 312:45 +CPU= 24.333
10:53:31 STEP 1252 H= 313:00 +CPU= 25.148
10:53:57 STEP 1253 H= 313:15 +CPU= 25.468
10:54:21 STEP 1254 H= 313:30 +CPU= 23.441
10:54:45 STEP 1255 H= 313:45 +CPU= 24.222
10:55:09 STEP 1256 H= 314:00 +CPU= 23.459
10:55:33 STEP 1257 H= 314:15 +CPU= 23.651
10:55:58 STEP 1258 H= 314:30 +CPU= 24.420
10:56:22 STEP 1259 H= 314:45 +CPU= 23.360
10:56:53 STEP 1260 H= 315:00 +CPU= 31.138
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGh7zg+001260
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHh7zg+001260
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAh7zg+001260
10:57:18 STEP 1261 H= 315:15 +CPU= 24.345
10:57:42 STEP 1262 H= 315:30 +CPU= 24.130
10:58:10 STEP 1263 H= 315:45 +CPU= 26.671
10:58:35 STEP 1264 H= 316:00 +CPU= 24.929
10:59:02 STEP 1265 H= 316:15 +CPU= 26.326
10:59:29 STEP 1266 H= 316:30 +CPU= 26.993
10:59:53 STEP 1267 H= 316:45 +CPU= 23.521
11:00:21 STEP 1268 H= 317:00 +CPU= 27.790
11:00:46 STEP 1269 H= 317:15 +CPU= 24.428
11:01:10 STEP 1270 H= 317:30 +CPU= 24.361
11:01:36 STEP 1271 H= 317:45 +CPU= 25.147
11:02:09 STEP 1272 H= 318:00 +CPU= 32.348
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGh7zg+001272
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHh7zg+001272
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAh7zg+001272
11:02:36 STEP 1273 H= 318:15 +CPU= 26.628
11:03:01 STEP 1274 H= 318:30 +CPU= 24.466
11:03:26 STEP 1275 H= 318:45 +CPU= 25.285
11:03:50 STEP 1276 H= 319:00 +CPU= 23.856
11:04:17 STEP 1277 H= 319:15 +CPU= 26.381
11:04:42 STEP 1278 H= 319:30 +CPU= 24.838
11:05:06 STEP 1279 H= 319:45 +CPU= 23.650
11:05:32 STEP 1280 H= 320:00 +CPU= 25.730
11:05:59 STEP 1281 H= 320:15 +CPU= 26.409
11:06:24 STEP 1282 H= 320:30 +CPU= 24.592
11:06:49 STEP 1283 H= 320:45 +CPU= 25.210
11:07:21 STEP 1284 H= 321:00 +CPU= 31.019
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGh7zg+001284
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHh7zg+001284
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAh7zg+001284
11:07:46 STEP 1285 H= 321:15 +CPU= 25.491
11:08:12 STEP 1286 H= 321:30 +CPU= 25.551
11:08:37 STEP 1287 H= 321:45 +CPU= 24.632
11:09:04 STEP 1288 H= 322:00 +CPU= 26.833
11:09:28 STEP 1289 H= 322:15 +CPU= 23.648
11:09:57 STEP 1290 H= 322:30 +CPU= 27.533
11:10:21 STEP 1291 H= 322:45 +CPU= 24.635
11:10:48 STEP 1292 H= 323:00 +CPU= 25.897
11:11:13 STEP 1293 H= 323:15 +CPU= 24.812
11:11:38 STEP 1294 H= 323:30 +CPU= 24.913
11:12:01 STEP 1295 H= 323:45 +CPU= 23.159
11:12:35 STEP 1296 H= 324:00 +CPU= 32.975
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGh7zg+001296
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHh7zg+001296
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAh7zg+001296
11:13:00 STEP 1297 H= 324:15 +CPU= 24.174
11:13:24 STEP 1298 H= 324:30 +CPU= 23.531
11:13:48 STEP 1299 H= 324:45 +CPU= 24.344
11:14:15 STEP 1300 H= 325:00 +CPU= 26.326
11:14:40 STEP 1301 H= 325:15 +CPU= 24.857
11:15:07 STEP 1302 H= 325:30 +CPU= 26.910
11:15:33 STEP 1303 H= 325:45 +CPU= 25.007
11:15:58 STEP 1304 H= 326:00 +CPU= 25.443
11:16:23 STEP 1305 H= 326:15 +CPU= 24.715
11:16:50 STEP 1306 H= 326:30 +CPU= 26.087
11:17:14 STEP 1307 H= 326:45 +CPU= 23.042
11:17:45 STEP 1308 H= 327:00 +CPU= 30.545
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGh7zg+001308
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHh7zg+001308
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAh7zg+001308
11:18:12 STEP 1309 H= 327:15 +CPU= 27.052
11:18:37 STEP 1310 H= 327:30 +CPU= 24.549
11:19:03 STEP 1311 H= 327:45 +CPU= 25.346
11:19:28 STEP 1312 H= 328:00 +CPU= 25.222
11:19:55 STEP 1313 H= 328:15 +CPU= 25.693
11:20:18 STEP 1314 H= 328:30 +CPU= 23.020
11:20:44 STEP 1315 H= 328:45 +CPU= 26.052
11:21:11 STEP 1316 H= 329:00 +CPU= 26.557
11:21:35 STEP 1317 H= 329:15 +CPU= 24.353
11:22:01 STEP 1318 H= 329:30 +CPU= 25.370
11:22:26 STEP 1319 H= 329:45 +CPU= 24.274
11:22:57 STEP 1320 H= 330:00 +CPU= 30.837
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGh7zg+001320
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHh7zg+001320
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAh7zg+001320
11:23:20 STEP 1321 H= 330:15 +CPU= 22.902
11:23:46 STEP 1322 H= 330:30 +CPU= 24.917
11:24:12 STEP 1323 H= 330:45 +CPU= 25.790
11:24:38 STEP 1324 H= 331:00 +CPU= 25.744
11:25:03 STEP 1325 H= 331:15 +CPU= 24.920
11:25:27 STEP 1326 H= 331:30 +CPU= 23.728
11:25:54 STEP 1327 H= 331:45 +CPU= 26.086
11:26:20 STEP 1328 H= 332:00 +CPU= 25.864
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:27:20 STEP 1329 H= 332:15 +CPU= 27.052
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:28:15 STEP 1330 H= 332:30 +CPU= 29.540
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:32:37 STEP 1331 H= 332:45 +CPU= 27.191
11:33:08 STEP 1332 H= 333:00 +CPU= 30.589
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGh7zg+001332
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHh7zg+001332
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAh7zg+001332
11:33:34 STEP 1333 H= 333:15 +CPU= 25.317
11:34:06 STEP 1334 H= 333:30 +CPU= 29.783
Suspend request received from the BOINC client, suspending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.11_x86_64-pc-linux-gnu
(argv1) start_date: 2016092300
(argv2) exptid: h7zg
(argv3) unique_member_id: a4nl
(argv4) batchid: 991
(argv5) wuid: 12212820
(argv6) fclen: 15
(argv7) app_name: oifs_43r3_bl
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/10
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_bl
version: 1.11
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/10/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/10/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_911841787ef8dcd5aee0284312fd6b18 to: /var/lib/boinc-client/slots/10/oifs_43r3_bl_a4nl_2016092300_15_991_12212820.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/10/oifs_43r3_bl_a4nl_2016092300_15_991_12212820.zip
ic_ancil_file: ic_ancil_12212820
ifsdata_file: ifsdata_12212820
climate_data_file: clim_data_12212820
horiz_resolution: 159
vert_resolution: 91
grid_type: l_2
upload_interval: 96
utstep: 900
nfrres: restart dump frequency (steps) 48
Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /var/lib/boinc-client/slots/10/ic_ancil_12212820.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/10/ic_ancil_12212820.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_fce85c99a7f03c8a670ceedc0368a597 to: /var/lib/boinc-client/slots/10/ifsdata/ifsdata_12212820.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/10/ifsdata/ifsdata_12212820.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/10/159l_2/clim_data_12212820.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/10/159l_2/clim_data_12212820.zip
Checking for progress XML file: /var/lib/boinc-client/slots/10/progress_file_12212820.xml
Opened progress file ok : /var/lib/boinc-client/slots/10/progress_file_12212820.xml
-- Model is restarting --
Adjusting last_iter, 1335, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/10/progress_file_12212820.xml
last_cpu_time: 40353
upload_file_number: 13
last_iter: 1297
last_upload: 1124100
model_completed: 0
total_length_of_simulation: 1296000
result_base_name: oifs_43r3_bl_a4nl_2016092300_15_991_12212820_0_r1071169990
The child process has been launched with process id: 8775
Executing the command: /var/lib/boinc-client/slots/10/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:8775:8775] [20230214:115748:1676401068:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2091] fp = 0x30e4a00
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:8775:8775] [20230214:115748:1676401068:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:8775:8775] [20230214:115748:1676401068:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:8775:8775] [20230214:115748:1676401068:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:8775:8775] [20230214:115748:1676401068:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:8775:8775] [20230214:115748:1676401068:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:8775:8775] [20230214:115748:1676401068:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:8775:8775] [20230214:115748:1676401068:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:8775:8775] [20230214:115748:1676401068:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:8775:8775] [20230214:115748:1676401068:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:8775:8775] [20230214:115748:1676401068:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:8775:8775] [20230214:115748:1676401068:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:8775:8775] [20230214:115748:1676401068:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:8775:8775] [20230214:115748:1676401068:0.000] [ignore_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:8775:8775] [20230214:115748:1676401068:0.000] [restore_default_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:8775:8775] [20230214:115748:1676401068:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:8775:8775] [20230214:115748:1676401068:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f520 (old at (nil))
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:8775:8775] [20230214:115748:1676401068:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:8775:8775] [20230214:115748:1676401068:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f520 (old at (nil))
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:8775:8775] [20230214:115748:1676401068:0.000] [trapfpe_treatment@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:8775:8775] [20230214:115748:1676401068:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:8775:8775] [20230214:115748:1676401068:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:8775:8775] [20230214:115748:1676401068:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f520 (old at (nil))
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:8775:8775] [20230214:115748:1676401068:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:8775:8775] [20230214:115748:1676401068:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:8775:8775] [20230214:115748:1676401068:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:8775:8775] [20230214:115748:1676401068:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f520 (old at (nil))
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:8775:8775] [20230214:115748:1676401068:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f520 (old at (nil))
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:8775:8775] [20230214:115748:1676401068:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f520 (old at (nil))
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:8775:8775] [20230214:115748:1676401068:0.000] [catch_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
11:58:25 STEP 1296 H= 324:00 +CPU= 28.381
11:58:52 STEP 1297 H= 324:15 +CPU= 25.758
11:59:19 STEP 1298 H= 324:30 +CPU= 25.650
11:59:46 STEP 1299 H= 324:45 +CPU= 25.787
12:00:14 STEP 1300 H= 325:00 +CPU= 27.088
12:00:45 STEP 1301 H= 325:15 +CPU= 29.194
12:01:16 STEP 1302 H= 325:30 +CPU= 28.740
12:01:44 STEP 1303 H= 325:45 +CPU= 27.026
12:02:15 STEP 1304 H= 326:00 +CPU= 29.092
12:02:44 STEP 1305 H= 326:15 +CPU= 27.759
12:03:13 STEP 1306 H= 326:30 +CPU= 27.255
12:03:43 STEP 1307 H= 326:45 +CPU= 28.616
12:04:19 STEP 1308 H= 327:00 +CPU= 34.420
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGh7zg+001308
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHh7zg+001308
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAh7zg+001308
12:04:50 STEP 1309 H= 327:15 +CPU= 28.803
12:05:19 STEP 1310 H= 327:30 +CPU= 28.035
12:05:47 STEP 1311 H= 327:45 +CPU= 27.120
12:06:18 STEP 1312 H= 328:00 +CPU= 29.072
12:06:48 STEP 1313 H= 328:15 +CPU= 28.293
12:07:18 STEP 1314 H= 328:30 +CPU= 28.400
12:07:48 STEP 1315 H= 328:45 +CPU= 28.675
12:08:17 STEP 1316 H= 329:00 +CPU= 27.933
12:08:45 STEP 1317 H= 329:15 +CPU= 26.308
12:09:15 STEP 1318 H= 329:30 +CPU= 28.643
12:09:45 STEP 1319 H= 329:45 +CPU= 27.886
12:10:22 STEP 1320 H= 330:00 +CPU= 35.507
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGh7zg+001320
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHh7zg+001320
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAh7zg+001320
12:10:52 STEP 1321 H= 330:15 +CPU= 28.022
12:11:20 STEP 1322 H= 330:30 +CPU= 26.292
12:11:50 STEP 1323 H= 330:45 +CPU= 28.210
12:12:19 STEP 1324 H= 331:00 +CPU= 28.107
12:12:49 STEP 1325 H= 331:15 +CPU= 28.024
12:13:19 STEP 1326 H= 331:30 +CPU= 29.115
12:13:49 STEP 1327 H= 331:45 +CPU= 28.558
12:14:19 STEP 1328 H= 332:00 +CPU= 28.286
12:14:49 STEP 1329 H= 332:15 +CPU= 28.743
12:15:18 STEP 1330 H= 332:30 +CPU= 26.860
12:15:46 STEP 1331 H= 332:45 +CPU= 27.292
12:16:22 STEP 1332 H= 333:00 +CPU= 33.493
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGh7zg+001332
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHh7zg+001332
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAh7zg+001332
12:16:52 STEP 1333 H= 333:15 +CPU= 28.907
12:17:20 STEP 1334 H= 333:30 +CPU= 26.501
12:17:48 STEP 1335 H= 333:45 +CPU= 26.503
12:18:16 STEP 1336 H= 334:00 +CPU= 26.357
12:18:44 STEP 1337 H= 334:15 +CPU= 27.336
12:19:12 STEP 1338 H= 334:30 +CPU= 26.973
12:19:37 STEP 1339 H= 334:45 +CPU= 23.479
12:20:05 STEP 1340 H= 335:00 +CPU= 26.938
12:20:32 STEP 1341 H= 335:15 +CPU= 25.470
12:20:58 STEP 1342 H= 335:30 +CPU= 25.175
12:21:29 STEP 1343 H= 335:45 +CPU= 28.310
12:22:09 STEP 1344 H= 336:00 +CPU= 37.015
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGh7zg+001344
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHh7zg+001344
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAh7zg+001344
12:22:36 STEP 1345 H= 336:15 +CPU= 26.633
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820/ICMGGh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820/ICMSHh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820/ICMUAh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820/ICMGGh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820/ICMSHh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820/ICMUAh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820/ICMGGh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820/ICMSHh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820/ICMUAh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820/ICMGGh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820/ICMSHh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820/ICMUAh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820/ICMGGh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820/ICMSHh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820/ICMUAh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820/ICMGGh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820/ICMSHh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820/ICMUAh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820/ICMGGh7zg+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820/ICMSHh7zg+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820/ICMUAh7zg+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820/ICMGGh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820/ICMSHh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820/ICMUAh7zg+001344
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a4nl_2016092300_15_991_12212820_0_r1071169990_13.zip
Uploading the intermediate file: upload_file_13.zip
12:23:05 STEP 1346 H= 336:30 +CPU= 27.078
12:23:33 STEP 1347 H= 336:45 +CPU= 26.539
12:24:00 STEP 1348 H= 337:00 +CPU= 25.759
12:24:30 STEP 1349 H= 337:15 +CPU= 28.497
12:24:57 STEP 1350 H= 337:30 +CPU= 25.545
12:25:25 STEP 1351 H= 337:45 +CPU= 27.396
12:25:56 STEP 1352 H= 338:00 +CPU= 29.136
12:26:24 STEP 1353 H= 338:15 +CPU= 27.038
12:26:54 STEP 1354 H= 338:30 +CPU= 28.346
12:27:24 STEP 1355 H= 338:45 +CPU= 28.084
12:27:58 STEP 1356 H= 339:00 +CPU= 33.032
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGh7zg+001356
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHh7zg+001356
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAh7zg+001356
12:28:27 STEP 1357 H= 339:15 +CPU= 27.105
12:28:54 STEP 1358 H= 339:30 +CPU= 26.088
12:29:25 STEP 1359 H= 339:45 +CPU= 29.157
12:29:55 STEP 1360 H= 340:00 +CPU= 28.682
12:30:24 STEP 1361 H= 340:15 +CPU= 27.891
12:30:54 STEP 1362 H= 340:30 +CPU= 28.421
12:31:24 STEP 1363 H= 340:45 +CPU= 28.275
12:31:55 STEP 1364 H= 341:00 +CPU= 29.989
12:32:22 STEP 1365 H= 341:15 +CPU= 25.633
12:32:50 STEP 1366 H= 341:30 +CPU= 26.980
12:33:21 STEP 1367 H= 341:45 +CPU= 28.728
12:33:57 STEP 1368 H= 342:00 +CPU= 34.719
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGh7zg+001368
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHh7zg+001368
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAh7zg+001368
12:34:24 STEP 1369 H= 342:15 +CPU= 25.794
12:34:52 STEP 1370 H= 342:30 +CPU= 26.895
12:35:22 STEP 1371 H= 342:45 +CPU= 28.030
12:35:53 STEP 1372 H= 343:00 +CPU= 29.656
12:36:23 STEP 1373 H= 343:15 +CPU= 28.951
12:36:53 STEP 1374 H= 343:30 +CPU= 28.561
12:37:23 STEP 1375 H= 343:45 +CPU= 28.459
12:37:53 STEP 1376 H= 344:00 +CPU= 27.908
12:38:20 STEP 1377 H= 344:15 +CPU= 26.152
12:38:47 STEP 1378 H= 344:30 +CPU= 25.493
12:39:16 STEP 1379 H= 344:45 +CPU= 28.063
12:39:50 STEP 1380 H= 345:00 +CPU= 32.536
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGh7zg+001380
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHh7zg+001380
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAh7zg+001380
12:40:19 STEP 1381 H= 345:15 +CPU= 27.307
12:40:47 STEP 1382 H= 345:30 +CPU= 27.050
12:41:15 STEP 1383 H= 345:45 +CPU= 26.174
12:41:45 STEP 1384 H= 346:00 +CPU= 29.362
12:42:15 STEP 1385 H= 346:15 +CPU= 27.809
12:42:43 STEP 1386 H= 346:30 +CPU= 27.383
12:43:13 STEP 1387 H= 346:45 +CPU= 28.095
12:43:42 STEP 1388 H= 347:00 +CPU= 28.375
12:44:09 STEP 1389 H= 347:15 +CPU= 25.827
12:44:37 STEP 1390 H= 347:30 +CPU= 25.906
12:45:06 STEP 1391 H= 347:45 +CPU= 27.609
12:45:48 STEP 1392 H= 348:00 +CPU= 38.577
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGh7zg+001392
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHh7zg+001392
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAh7zg+001392
12:46:14 STEP 1393 H= 348:15 +CPU= 25.036
12:46:43 STEP 1394 H= 348:30 +CPU= 27.135
12:47:11 STEP 1395 H= 348:45 +CPU= 27.035
12:47:40 STEP 1396 H= 349:00 +CPU= 27.205
12:48:08 STEP 1397 H= 349:15 +CPU= 26.456
12:48:37 STEP 1398 H= 349:30 +CPU= 27.699
12:49:05 STEP 1399 H= 349:45 +CPU= 26.891
12:49:33 STEP 1400 H= 350:00 +CPU= 26.529
12:50:02 STEP 1401 H= 350:15 +CPU= 27.818
12:50:30 STEP 1402 H= 350:30 +CPU= 27.275
12:50:59 STEP 1403 H= 350:45 +CPU= 27.109
12:51:34 STEP 1404 H= 351:00 +CPU= 33.290
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGh7zg+001404
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHh7zg+001404
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAh7zg+001404
12:52:02 STEP 1405 H= 351:15 +CPU= 27.053
12:52:28 STEP 1406 H= 351:30 +CPU= 25.212
12:52:56 STEP 1407 H= 351:45 +CPU= 26.725
12:53:25 STEP 1408 H= 352:00 +CPU= 27.233
12:53:53 STEP 1409 H= 352:15 +CPU= 26.786
12:54:20 STEP 1410 H= 352:30 +CPU= 26.179
12:54:47 STEP 1411 H= 352:45 +CPU= 25.155
12:55:14 STEP 1412 H= 353:00 +CPU= 25.745
12:55:40 STEP 1413 H= 353:15 +CPU= 25.590
12:56:09 STEP 1414 H= 353:30 +CPU= 27.110
12:56:36 STEP 1415 H= 353:45 +CPU= 26.349
12:57:13 STEP 1416 H= 354:00 +CPU= 34.849
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGh7zg+001416
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHh7zg+001416
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAh7zg+001416
12:57:40 STEP 1417 H= 354:15 +CPU= 25.966
12:58:08 STEP 1418 H= 354:30 +CPU= 26.837
12:58:34 STEP 1419 H= 354:45 +CPU= 24.873
12:59:00 STEP 1420 H= 355:00 +CPU= 24.697
12:59:27 STEP 1421 H= 355:15 +CPU= 25.868
12:59:55 STEP 1422 H= 355:30 +CPU= 26.522
13:00:21 STEP 1423 H= 355:45 +CPU= 24.916
13:00:49 STEP 1424 H= 356:00 +CPU= 26.818
13:01:16 STEP 1425 H= 356:15 +CPU= 26.196
13:01:43 STEP 1426 H= 356:30 +CPU= 25.609
13:02:12 STEP 1427 H= 356:45 +CPU= 27.296
13:02:47 STEP 1428 H= 357:00 +CPU= 32.989
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGh7zg+001428
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHh7zg+001428
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAh7zg+001428
13:03:16 STEP 1429 H= 357:15 +CPU= 28.076
13:03:44 STEP 1430 H= 357:30 +CPU= 26.334
13:04:11 STEP 1431 H= 357:45 +CPU= 26.194
13:04:40 STEP 1432 H= 358:00 +CPU= 27.906
13:05:09 STEP 1433 H= 358:15 +CPU= 27.184
13:05:37 STEP 1434 H= 358:30 +CPU= 26.916
13:06:04 STEP 1435 H= 358:45 +CPU= 25.713
13:06:33 STEP 1436 H= 359:00 +CPU= 27.541
13:07:02 STEP 1437 H= 359:15 +CPU= 27.561
13:07:30 STEP 1438 H= 359:30 +CPU= 26.830
13:08:01 STEP 1439 H= 359:45 +CPU= 29.203
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.11_x86_64-pc-linux-gnu
(argv1) start_date: 2016092300
(argv2) exptid: h7zg
(argv3) unique_member_id: a4nl
(argv4) batchid: 991
(argv5) wuid: 12212820
(argv6) fclen: 15
(argv7) app_name: oifs_43r3_bl
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/10
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_bl
version: 1.11
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/10/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/10/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_911841787ef8dcd5aee0284312fd6b18 to: /var/lib/boinc-client/slots/10/oifs_43r3_bl_a4nl_2016092300_15_991_12212820.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/10/oifs_43r3_bl_a4nl_2016092300_15_991_12212820.zip
ic_ancil_file: ic_ancil_12212820
ifsdata_file: ifsdata_12212820
climate_data_file: clim_data_12212820
horiz_resolution: 159
vert_resolution: 91
grid_type: l_2
upload_interval: 96
utstep: 900
nfrres: restart dump frequency (steps) 48
Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /var/lib/boinc-client/slots/10/ic_ancil_12212820.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/10/ic_ancil_12212820.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_fce85c99a7f03c8a670ceedc0368a597 to: /var/lib/boinc-client/slots/10/ifsdata/ifsdata_12212820.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/10/ifsdata/ifsdata_12212820.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/10/159l_2/clim_data_12212820.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/10/159l_2/clim_data_12212820.zip
Checking for progress XML file: /var/lib/boinc-client/slots/10/progress_file_12212820.xml
Opened progress file ok : /var/lib/boinc-client/slots/10/progress_file_12212820.xml
-- Model is restarting --
Adjusting last_iter, 1440, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/10/progress_file_12212820.xml
last_cpu_time: 44360
upload_file_number: 14
last_iter: 1441
last_upload: 1210500
model_completed: 0
total_length_of_simulation: 1296000
result_base_name: oifs_43r3_bl_a4nl_2016092300_15_991_12212820_0_r1071169990
The child process has been launched with process id: 190781
Executing the command: /var/lib/boinc-client/slots/10/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:190781:190781] [20230214:130912:1676405352:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2091] fp = 0x30e4a00
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:190781:190781] [20230214:130912:1676405352:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:190781:190781] [20230214:130912:1676405352:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:190781:190781] [20230214:130912:1676405352:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:190781:190781] [20230214:130912:1676405352:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:190781:190781] [20230214:130912:1676405352:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:190781:190781] [20230214:130912:1676405352:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:190781:190781] [20230214:130912:1676405352:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:190781:190781] [20230214:130912:1676405352:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:190781:190781] [20230214:130912:1676405352:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:190781:190781] [20230214:130912:1676405352:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:190781:190781] [20230214:130912:1676405352:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:190781:190781] [20230214:130912:1676405352:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:190781:190781] [20230214:130912:1676405352:0.000] [ignore_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:190781:190781] [20230214:130912:1676405352:0.000] [restore_default_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:190781:190781] [20230214:130912:1676405352:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:190781:190781] [20230214:130912:1676405352:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f520 (old at (nil))
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:190781:190781] [20230214:130912:1676405352:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:190781:190781] [20230214:130912:1676405352:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f520 (old at (nil))
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:190781:190781] [20230214:130912:1676405352:0.000] [trapfpe_treatment@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:190781:190781] [20230214:130912:1676405352:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:190781:190781] [20230214:130912:1676405352:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:190781:190781] [20230214:130912:1676405352:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f520 (old at (nil))
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:190781:190781] [20230214:130912:1676405352:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:190781:190781] [20230214:130912:1676405352:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:190781:190781] [20230214:130912:1676405352:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:190781:190781] [20230214:130912:1676405352:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f520 (old at (nil))
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:190781:190781] [20230214:130912:1676405352:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f520 (old at (nil))
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:190781:190781] [20230214:130912:1676405352:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f520 (old at (nil))
[EC_DRHOOK:wkst-01.kalnet.xyz:1:1:190781:190781] [20230214:130912:1676405352:0.000] [catch_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
13:09:42 STEP 1440 H= 360:00 +CPU= 24.621
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01
I I Hor. Flux of PEII 0.00000 I I I I I
I I Vert.Flux of PEII 0.00000 I I I I I
I I Work Pres.G.F II I 0.00007 I I I I
I I Conv. Ad.-Int. II -0.00007 I I I I I
DDH--------------------------------------------------------------------------------------------------I
I DYN- Horizont. Flux II -0.00003 I 0.00000 I -0.00050 I 0.00000 I 0.00000 I
I I Vertical Flux II 0.00000 I 0.00000 I 0.00000 I 0.00000 I 0.00000 I
DDH--------------------------------------------------------------------------------------------------I
DDH----------------------------------------------------------------------------------------------------------------------------------
I - Mass balance (10**(-6) KG/M**2)
I INITIAL I HORIZ. FLUX I DYN. FLUX I DYN. FLUX I PHYS. FLUX I PHYS. FLUX I CURRENT I I I RESIDUAL I
I MASS I I TOA I SURFACE I TOA I SURFACE I MASS I I I I
---------------------------------------------------------------------------------------------------------- I ----------------
- - - - - - - - I - -
- 10206523039. I 0. . 0. . 0. . 0. . 0. I 10206523432. - I - 393. -
- - - - - - - - I - -
---------------------------------------------------------------------------------------------------------- I ----------------
DDH------------------------------------------------------------------------
I I
I TIME = 360.000H DDH * Diagnostic Var., AREA GLOBAL I
I I
I-------------------------------------------------------------------------I
I VARIABLE I Initial value I Current value I
I-------------------------------------------------------------------------I
I OMEGA (P/S) I -0.1943167293E-22 I 0.1502122262E-09 I
ICloud fractionI 0.0000000000E+00 I 0.7525306473E-05 I
I Relat. Hum. I 0.4647340602E-01 I 0.7127453293E-01 I
I PASS 01 I 0.0000000000E+00 I 0.5552036626E+00 I
DDH------------------------------------------------------------------------
13:09:42 STEP 1440 H= 360:00 +CPU= 24.621
END CNT3
NSTEP = 1440 CNT0 000000000 24.537 24.537 25.712 0.954 0 0 0 0 0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ 34/ 1069125708 WRITTEN 0/ 0
-TASK-OPENED-OPEN-RECS IN -KBYTE IN -RECS OUT-KBYTE OUT-WALL -WALL IN-WALL
OU-TOT IN -TOT OUT
1 3 0 34 1044068 0 0 2.4 2.4 0.0 3.4 0.0
===-=== START OF TIMING STATISTICS ===-===
STATS FOR ALL TASKS
NUM ROUTINE CALLS MEAN(ms) MAX(ms) FRAC(%) UNBAL(%)
0 CNT0 - COMPLETE EXECUTION 1 30690.2 30690.2 100.00 0.00
1 CNT4 - FORWARD INTEGRATION 1 25794.6 25794.6 84.05 0.00
8 SCAN2M - GRID-POINT DYNAMICS 1 6025.9 6025.9 19.63 0.00
10 SCAN2M - PHYSICS 1 11768.2 11768.2 38.35 0.00
12 SPNORM - SPECTRAL NORM COMP. 1 71.9 71.9 0.23 0.00
28 RESTART FILES - READING 1 4358.4 4358.4 14.20 0.00
31 POSDDH IN STEPO 1 0.7 0.7 0.00 0.00
37 CPGLAG - SL COMPUTATIONS 1 6307.0 6307.0 20.55 0.00
39 SU0YOMB 1 308.0 308.0 1.00 0.00
51 SCAN2M - SL COMM. PART 1 1 38.0 38.0 0.12 0.00
56 SPNORM - SPECTRAL NORM COMM. 1 0.2 0.2 0.00 0.00
102 LTINV_CTL - INVERSE LEGENDRE TRANSFORM 4 187.7 187.7 2.45 0.00
107 FTINV_CTL - INVERSE FOURIER TRANSFORM 4 49.3 49.3 0.64 0.00
140 SULEG - COMP. OF LEGENDRE POL. 1 38.6 38.6 0.13 0.00
152 LTINV_CTL - M TO L TRANSPOSITION 4 32.5 32.5 0.42 0.00
157 FTINV_CTL - L TO G TRANSPOSITION 4 78.9 78.9 1.03 0.00
400 GSTATS 1083 0.0 0.0 0.00 0.00
401 GSTATS HOOK 963 0.0 0.0 0.00 0.00
TOTAL MEASURED IMBALANCE = 0.0 SECONDS, 0.0 PERCENT
TOTAL WALLCLOCK TIME 30.7 CPU TIME 29.0 VECTOR TIME 29.0
===-=== END OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY 50243.1
*** END CNT0 ***
------------------------------------------------
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGh7zg+001440
Adding to the zip: /var/lib/boinc-client/slots/10/NODE.001_01
Adding to the zip: /var/lib/boinc-client/slots/10/ifs.stat
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820/ICMGGh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820/ICMSHh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820/ICMSHh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820/ICMGGh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820/ICMSHh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820/ICMSHh7zg+000672
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820/ICMUAh7zg+000288
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820/ICMSHh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820/ICMSHh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820/ICMGGh7zg+000480
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820/ICMGGh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820/ICMSHh7zg+000288
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820/ICMGGh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820/ICMGGh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820/ICMUAh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820/ICMUAh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820/ICMUAh7zg+000480
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820/ICMGGh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820/ICMSHh7zg+000480
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820/ICMGGh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820/ICMUAh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820/ICMUAh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820/ICMGGh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820/ICMUAh7zg+000672
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820/ICMGGh7zg+000288
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820/ICMSHh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820/ICMGGh7zg+000672
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820/ICMSHh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820/ICMSHh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820/ICMUAh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820/ICMSHh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820/ICMGGh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820/ICMUAh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820/ICMUAh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212820/ICMGGh7zg+001416
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a4nl_2016092300_15_991_12212820_0_r1071169990_14.zip
Uploading the final file: upload_file_14.zip
Uploading trickle at timestep: 1296900
13:13:15 (190776): called boinc_finish(0)
</stderr_txt>
]]>
