<core_client_version>7.16.6</core_client_version>
<![CDATA[
<message>
Disk usage limit exceeded</message>
<stderr_txt>
+CPU= 19.673
09:01:19 STEP 1203 H=1203:00 +CPU= 35.159
09:01:45 STEP 1204 H=1204:00 +CPU= 25.300
09:02:08 STEP 1205 H=1205:00 +CPU= 22.257
09:02:45 STEP 1206 H=1206:00 +CPU= 36.448
09:03:08 STEP 1207 H=1207:00 +CPU= 22.821
09:03:32 STEP 1208 H=1208:00 +CPU= 23.507
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Quit request received from BOINC client, ending the child process
..Failed, model did not complete successfully
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1982050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0753
(argv4) batchid: 951
(argv5) wuid: 12168397
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/6
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168397
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/6/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/6/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_ae5a3c266540fadd30b7e7e76879ef34 to: /var/lib/boinc-client/slots/6/oifs_43r3_ps_0753_1982050100_123_951_12168397.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/6/oifs_43r3_ps_0753_1982050100_123_951_12168397.zip
ic_ancil_file: ic_ancil_12168397
ifsdata_file: ifsdata_12168397
climate_data_file: clim_data_12168397
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_ea25124f498afd2578b95025936a8071 to: /var/lib/boinc-client/slots/6/ic_ancil_12168397.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/6/ic_ancil_12168397.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_8946c5f39c69730cdaca9b6c09fac619 to: /var/lib/boinc-client/slots/6/ifsdata/ifsdata_12168397.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/6/ifsdata/ifsdata_12168397.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/6/159l_2/clim_data_12168397.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/6/159l_2/clim_data_12168397.zip
Checking for progress XML file: /var/lib/boinc-client/slots/6/progress_file_12168397.xml
Opened progress file ok : /var/lib/boinc-client/slots/6/progress_file_12168397.xml
-- Model is restarting --
Adjusting last_iter, 1209, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/6/progress_file_12168397.xml
last_cpu_time: 31322
upload_file_number: 50
last_iter: 1199
last_upload: 4320000
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0753_1982050100_123_951_12168397_1_r745526984
The child process has been launched with process id: 59026
Executing the command: /var/lib/boinc-client/slots/6/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:LinuxMint:1:1:59026:59026] [20230118:090927:1674029367:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:LinuxMint:1:1:59026:59026] [20230118:090927:1674029367:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:LinuxMint:1:1:59026:59026] [20230118:090927:1674029367:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:LinuxMint:1:1:59026:59026] [20230118:090927:1674029367:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:LinuxMint:1:1:59026:59026] [20230118:090927:1674029367:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:LinuxMint:1:1:59026:59026] [20230118:090927:1674029367:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:LinuxMint:1:1:59026:59026] [20230118:090927:1674029367:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:LinuxMint:1:1:59026:59026] [20230118:090927:1674029367:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:LinuxMint:1:1:59026:59026] [20230118:090927:1674029367:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:LinuxMint:1:1:59026:59026] [20230118:090927:1674029367:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:LinuxMint:1:1:59026:59026] [20230118:090927:1674029367:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:LinuxMint:1:1:59026:59026] [20230118:090927:1674029367:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:LinuxMint:1:1:59026:59026] [20230118:090927:1674029367:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:LinuxMint:1:1:59026:59026] [20230118:090927:1674029367:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:LinuxMint:1:1:59026:59026] [20230118:090927:1674029367:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:LinuxMint:1:1:59026:59026] [20230118:090927:1674029367:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:LinuxMint:1:1:59026:59026] [20230118:090927:1674029367:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:LinuxMint:1:1:59026:59026] [20230118:090927:1674029367:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:LinuxMint:1:1:59026:59026] [20230118:090927:1674029367:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:LinuxMint:1:1:59026:59026] [20230118:090927:1674029367:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:LinuxMint:1:1:59026:59026] [20230118:090927:1674029367:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:LinuxMint:1:1:59026:59026] [20230118:090927:1674029367:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:LinuxMint:1:1:59026:59026] [20230118:090927:1674029367:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:LinuxMint:1:1:59026:59026] [20230118:090927:1674029367:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:LinuxMint:1:1:59026:59026] [20230118:090927:1674029367:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:LinuxMint:1:1:59026:59026] [20230118:090927:1674029367:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:LinuxMint:1:1:59026:59026] [20230118:090927:1674029367:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:LinuxMint:1:1:59026:59026] [20230118:090927:1674029367:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:LinuxMint:1:1:59026:59026] [20230118:090927:1674029367:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:LinuxMint:1:1:59026:59026] [20230118:090927:1674029367:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
09:10:16 STEP 1200 H=1200:00 +CPU= 41.189
09:10:40 STEP 1201 H=1201:00 +CPU= 23.681
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:11:15 STEP 1202 H=1202:00 +CPU= 23.269
09:11:50 STEP 1203 H=1203:00 +CPU= 34.525
09:12:12 STEP 1204 H=1204:00 +CPU= 22.143
09:12:34 STEP 1205 H=1205:00 +CPU= 21.551
09:13:11 STEP 1206 H=1206:00 +CPU= 36.714
09:13:34 STEP 1207 H=1207:00 +CPU= 22.750
09:13:58 STEP 1208 H=1208:00 +CPU= 23.689
09:14:34 STEP 1209 H=1209:00 +CPU= 35.163
09:14:57 STEP 1210 H=1210:00 +CPU= 22.795
09:15:20 STEP 1211 H=1211:00 +CPU= 22.781
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:16:02 STEP 1212 H=1212:00 +CPU= 39.738
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001212
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001212
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001212
09:16:25 STEP 1213 H=1213:00 +CPU= 23.169
09:16:49 STEP 1214 H=1214:00 +CPU= 23.127
09:17:25 STEP 1215 H=1215:00 +CPU= 35.975
09:17:49 STEP 1216 H=1216:00 +CPU= 23.480
09:18:12 STEP 1217 H=1217:00 +CPU= 22.623
09:18:49 STEP 1218 H=1218:00 +CPU= 36.429
09:19:12 STEP 1219 H=1219:00 +CPU= 23.035
09:19:35 STEP 1220 H=1220:00 +CPU= 23.186
09:20:12 STEP 1221 H=1221:00 +CPU= 36.336
09:20:35 STEP 1222 H=1222:00 +CPU= 22.674
09:20:59 STEP 1223 H=1223:00 +CPU= 23.932
09:21:40 STEP 1224 H=1224:00 +CPU= 40.235
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001224
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001224
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168397/ICMGGhq0f+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168397/ICMSHhq0f+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168397/ICMUAhq0f+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168397/ICMGGhq0f+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168397/ICMSHhq0f+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168397/ICMUAhq0f+001212
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0753_1982050100_123_951_12168397_1_r745526984_50.zip
Uploading the intermediate file: upload_file_50.zip
09:22:02 STEP 1225 H=1225:00 +CPU= 21.846
09:22:25 STEP 1226 H=1226:00 +CPU= 22.262
09:23:01 STEP 1227 H=1227:00 +CPU= 36.048
09:23:26 STEP 1228 H=1228:00 +CPU= 24.194
09:23:50 STEP 1229 H=1229:00 +CPU= 23.628
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:24:39 STEP 1230 H=1230:00 +CPU= 37.539
09:25:00 STEP 1231 H=1231:00 +CPU= 21.032
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:25:36 STEP 1232 H=1232:00 +CPU= 23.675
09:26:09 STEP 1233 H=1233:00 +CPU= 31.808
09:26:34 STEP 1234 H=1234:00 +CPU= 25.271
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:27:10 STEP 1235 H=1235:00 +CPU= 24.380
09:27:47 STEP 1236 H=1236:00 +CPU= 36.641
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001236
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001236
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001236
09:28:08 STEP 1237 H=1237:00 +CPU= 21.036
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:28:36 STEP 1238 H=1238:00 +CPU= 25.104
09:29:15 STEP 1239 H=1239:00 +CPU= 38.362
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:29:49 STEP 1240 H=1240:00 +CPU= 22.720
09:30:11 STEP 1241 H=1241:00 +CPU= 21.670
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:30:59 STEP 1242 H=1242:00 +CPU= 35.987
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:31:26 STEP 1243 H=1243:00 +CPU= 24.713
09:31:52 STEP 1244 H=1244:00 +CPU= 26.076
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:32:39 STEP 1245 H=1245:00 +CPU= 35.034
09:33:00 STEP 1246 H=1246:00 +CPU= 21.015
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:33:26 STEP 1247 H=1247:00 +CPU= 23.821
09:34:12 STEP 1248 H=1248:00 +CPU= 45.075
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001248
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001248
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168397/ICMGGhq0f+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168397/ICMSHhq0f+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168397/ICMUAhq0f+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168397/ICMGGhq0f+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168397/ICMSHhq0f+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168397/ICMUAhq0f+001236
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0753_1982050100_123_951_12168397_1_r745526984_51.zip
Uploading the intermediate file: upload_file_51.zip
09:34:35 STEP 1249 H=1249:00 +CPU= 22.249
09:34:56 STEP 1250 H=1250:00 +CPU= 20.800
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:35:46 STEP 1251 H=1251:00 +CPU= 38.417
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:36:21 STEP 1252 H=1252:00 +CPU= 24.020
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:36:48 STEP 1253 H=1253:00 +CPU= 24.415
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:37:39 STEP 1254 H=1254:00 +CPU= 39.385
09:38:04 STEP 1255 H=1255:00 +CPU= 24.624
09:38:29 STEP 1256 H=1256:00 +CPU= 24.482
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:39:19 STEP 1257 H=1257:00 +CPU= 38.681
09:39:45 STEP 1258 H=1258:00 +CPU= 25.582
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:40:19 STEP 1259 H=1259:00 +CPU= 22.834
09:40:58 STEP 1260 H=1260:00 +CPU= 38.705
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001260
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001260
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001260
09:41:21 STEP 1261 H=1261:00 +CPU= 22.530
09:41:45 STEP 1262 H=1262:00 +CPU= 23.134
09:42:19 STEP 1263 H=1263:00 +CPU= 34.467
09:42:42 STEP 1264 H=1264:00 +CPU= 22.421
09:43:04 STEP 1265 H=1265:00 +CPU= 21.993
09:43:41 STEP 1266 H=1266:00 +CPU= 36.633
09:44:03 STEP 1267 H=1267:00 +CPU= 21.969
09:44:26 STEP 1268 H=1268:00 +CPU= 22.672
09:45:02 STEP 1269 H=1269:00 +CPU= 35.150
09:45:25 STEP 1270 H=1270:00 +CPU= 22.716
09:45:48 STEP 1271 H=1271:00 +CPU= 23.050
09:46:29 STEP 1272 H=1272:00 +CPU= 40.582
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001272
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001272
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168397/ICMGGhq0f+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168397/ICMSHhq0f+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168397/ICMUAhq0f+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168397/ICMGGhq0f+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168397/ICMSHhq0f+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168397/ICMUAhq0f+001260
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0753_1982050100_123_951_12168397_1_r745526984_52.zip
Uploading the intermediate file: upload_file_52.zip
09:46:51 STEP 1273 H=1273:00 +CPU= 22.360
09:47:15 STEP 1274 H=1274:00 +CPU= 23.208
09:47:50 STEP 1275 H=1275:00 +CPU= 35.175
09:48:14 STEP 1276 H=1276:00 +CPU= 23.188
09:48:36 STEP 1277 H=1277:00 +CPU= 22.045
09:49:12 STEP 1278 H=1278:00 +CPU= 35.959
09:49:35 STEP 1279 H=1279:00 +CPU= 22.058
09:49:57 STEP 1280 H=1280:00 +CPU= 22.628
09:50:33 STEP 1281 H=1281:00 +CPU= 35.163
09:50:56 STEP 1282 H=1282:00 +CPU= 22.463
09:51:19 STEP 1283 H=1283:00 +CPU= 22.774
09:51:57 STEP 1284 H=1284:00 +CPU= 38.140
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001284
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001284
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001284
09:52:20 STEP 1285 H=1285:00 +CPU= 22.561
09:52:44 STEP 1286 H=1286:00 +CPU= 23.311
09:53:19 STEP 1287 H=1287:00 +CPU= 35.186
09:53:42 STEP 1288 H=1288:00 +CPU= 23.004
09:54:04 STEP 1289 H=1289:00 +CPU= 21.231
09:54:40 STEP 1290 H=1290:00 +CPU= 35.927
09:55:02 STEP 1291 H=1291:00 +CPU= 21.881
09:55:25 STEP 1292 H=1292:00 +CPU= 22.830
09:56:00 STEP 1293 H=1293:00 +CPU= 34.908
09:56:23 STEP 1294 H=1294:00 +CPU= 22.741
09:56:47 STEP 1295 H=1295:00 +CPU= 23.334
09:57:28 STEP 1296 H=1296:00 +CPU= 41.122
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001296
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001296
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168397/ICMGGhq0f+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168397/ICMSHhq0f+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168397/ICMUAhq0f+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168397/ICMGGhq0f+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168397/ICMSHhq0f+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168397/ICMUAhq0f+001284
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0753_1982050100_123_951_12168397_1_r745526984_53.zip
Uploading the intermediate file: upload_file_53.zip
09:57:51 STEP 1297 H=1297:00 +CPU= 22.464
09:58:14 STEP 1298 H=1298:00 +CPU= 22.976
09:58:49 STEP 1299 H=1299:00 +CPU= 34.041
09:59:12 STEP 1300 H=1300:00 +CPU= 22.804
09:59:33 STEP 1301 H=1301:00 +CPU= 21.590
10:00:11 STEP 1302 H=1302:00 +CPU= 37.105
10:00:33 STEP 1303 H=1303:00 +CPU= 21.777
10:00:56 STEP 1304 H=1304:00 +CPU= 22.620
10:01:32 STEP 1305 H=1305:00 +CPU= 35.590
10:01:55 STEP 1306 H=1306:00 +CPU= 22.958
10:02:18 STEP 1307 H=1307:00 +CPU= 22.803
10:02:55 STEP 1308 H=1308:00 +CPU= 37.191
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001308
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001308
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001308
10:03:18 STEP 1309 H=1309:00 +CPU= 22.495
10:03:41 STEP 1310 H=1310:00 +CPU= 22.945
10:04:16 STEP 1311 H=1311:00 +CPU= 34.803
10:04:39 STEP 1312 H=1312:00 +CPU= 22.391
10:05:02 STEP 1313 H=1313:00 +CPU= 22.460
10:05:38 STEP 1314 H=1314:00 +CPU= 35.919
10:06:00 STEP 1315 H=1315:00 +CPU= 21.517
10:06:21 STEP 1316 H=1316:00 +CPU= 20.802
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
10:06:52 STEP 1317 H=1317:00 +CPU= 28.626
10:07:15 STEP 1318 H=1318:00 +CPU= 23.326
10:07:38 STEP 1319 H=1319:00 +CPU= 22.234
10:08:19 STEP 1320 H=1320:00 +CPU= 40.814
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001320
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001320
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168397/ICMGGhq0f+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168397/ICMSHhq0f+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168397/ICMUAhq0f+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168397/ICMGGhq0f+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168397/ICMSHhq0f+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168397/ICMUAhq0f+001308
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0753_1982050100_123_951_12168397_1_r745526984_54.zip
Uploading the intermediate file: upload_file_54.zip
10:08:41 STEP 1321 H=1321:00 +CPU= 21.691
10:09:04 STEP 1322 H=1322:00 +CPU= 22.539
10:09:39 STEP 1323 H=1323:00 +CPU= 35.049
10:10:02 STEP 1324 H=1324:00 +CPU= 22.367
10:10:24 STEP 1325 H=1325:00 +CPU= 21.909
10:11:00 STEP 1326 H=1326:00 +CPU= 35.729
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
10:11:24 STEP 1327 H=1327:00 +CPU= 22.251
10:11:47 STEP 1328 H=1328:00 +CPU= 22.725
10:12:22 STEP 1329 H=1329:00 +CPU= 34.858
10:12:46 STEP 1330 H=1330:00 +CPU= 23.017
10:13:08 STEP 1331 H=1331:00 +CPU= 22.510
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1982050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0753
(argv4) batchid: 951
(argv5) wuid: 12168397
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/6
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168397
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/6/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/6/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_ae5a3c266540fadd30b7e7e76879ef34 to: /var/lib/boinc-client/slots/6/oifs_43r3_ps_0753_1982050100_123_951_12168397.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/6/oifs_43r3_ps_0753_1982050100_123_951_12168397.zip
ic_ancil_file: ic_ancil_12168397
ifsdata_file: ifsdata_12168397
climate_data_file: clim_data_12168397
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_ea25124f498afd2578b95025936a8071 to: /var/lib/boinc-client/slots/6/ic_ancil_12168397.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/6/ic_ancil_12168397.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_8946c5f39c69730cdaca9b6c09fac619 to: /var/lib/boinc-client/slots/6/ifsdata/ifsdata_12168397.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/6/ifsdata/ifsdata_12168397.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/6/159l_2/clim_data_12168397.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/6/159l_2/clim_data_12168397.zip
Checking for progress XML file: /var/lib/boinc-client/slots/6/progress_file_12168397.xml
Opened progress file ok : /var/lib/boinc-client/slots/6/progress_file_12168397.xml
-- Model is restarting --
Adjusting last_iter, 1332, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/6/progress_file_12168397.xml
last_cpu_time: 34964
upload_file_number: 55
last_iter: 1319
last_upload: 4752000
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0753_1982050100_123_951_12168397_1_r745526984
The child process has been launched with process id: 60588
Executing the command: /var/lib/boinc-client/slots/6/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:LinuxMint:1:1:60588:60588] [20230118:103600:1674034560:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:LinuxMint:1:1:60588:60588] [20230118:103600:1674034560:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:LinuxMint:1:1:60588:60588] [20230118:103600:1674034560:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:LinuxMint:1:1:60588:60588] [20230118:103600:1674034560:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:LinuxMint:1:1:60588:60588] [20230118:103600:1674034560:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:LinuxMint:1:1:60588:60588] [20230118:103600:1674034560:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:LinuxMint:1:1:60588:60588] [20230118:103600:1674034560:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:LinuxMint:1:1:60588:60588] [20230118:103600:1674034560:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:LinuxMint:1:1:60588:60588] [20230118:103600:1674034560:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:LinuxMint:1:1:60588:60588] [20230118:103600:1674034560:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:LinuxMint:1:1:60588:60588] [20230118:103600:1674034560:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:LinuxMint:1:1:60588:60588] [20230118:103600:1674034560:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:LinuxMint:1:1:60588:60588] [20230118:103600:1674034560:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:LinuxMint:1:1:60588:60588] [20230118:103600:1674034560:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:LinuxMint:1:1:60588:60588] [20230118:103600:1674034560:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:LinuxMint:1:1:60588:60588] [20230118:103600:1674034560:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:LinuxMint:1:1:60588:60588] [20230118:103600:1674034560:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:LinuxMint:1:1:60588:60588] [20230118:103600:1674034560:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:LinuxMint:1:1:60588:60588] [20230118:103600:1674034560:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:LinuxMint:1:1:60588:60588] [20230118:103600:1674034560:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:LinuxMint:1:1:60588:60588] [20230118:103600:1674034560:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:LinuxMint:1:1:60588:60588] [20230118:103600:1674034560:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:LinuxMint:1:1:60588:60588] [20230118:103600:1674034560:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:LinuxMint:1:1:60588:60588] [20230118:103600:1674034560:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:LinuxMint:1:1:60588:60588] [20230118:103600:1674034560:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:LinuxMint:1:1:60588:60588] [20230118:103600:1674034560:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:LinuxMint:1:1:60588:60588] [20230118:103600:1674034560:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:LinuxMint:1:1:60588:60588] [20230118:103600:1674034560:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:LinuxMint:1:1:60588:60588] [20230118:103600:1674034560:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:LinuxMint:1:1:60588:60588] [20230118:103600:1674034560:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
10:36:43 STEP 1320 H=1320:00 +CPU= 39.567
10:37:04 STEP 1321 H=1321:00 +CPU= 20.762
10:37:25 STEP 1322 H=1322:00 +CPU= 20.791
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
10:38:00 STEP 1323 H=1323:00 +CPU= 32.187
10:38:23 STEP 1324 H=1324:00 +CPU= 23.191
10:38:45 STEP 1325 H=1325:00 +CPU= 22.038
10:39:20 STEP 1326 H=1326:00 +CPU= 34.654
10:39:43 STEP 1327 H=1327:00 +CPU= 22.282
10:40:05 STEP 1328 H=1328:00 +CPU= 22.331
10:40:41 STEP 1329 H=1329:00 +CPU= 35.205
10:41:03 STEP 1330 H=1330:00 +CPU= 22.235
10:41:25 STEP 1331 H=1331:00 +CPU= 21.464
10:42:04 STEP 1332 H=1332:00 +CPU= 38.707
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001332
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001332
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001332
10:42:27 STEP 1333 H=1333:00 +CPU= 22.133
10:42:49 STEP 1334 H=1334:00 +CPU= 22.341
10:43:24 STEP 1335 H=1335:00 +CPU= 34.091
10:43:47 STEP 1336 H=1336:00 +CPU= 23.016
10:44:09 STEP 1337 H=1337:00 +CPU= 21.652
10:44:45 STEP 1338 H=1338:00 +CPU= 35.547
10:45:06 STEP 1339 H=1339:00 +CPU= 21.491
10:45:30 STEP 1340 H=1340:00 +CPU= 23.144
10:46:02 STEP 1341 H=1341:00 +CPU= 32.160
10:46:22 STEP 1342 H=1342:00 +CPU= 19.866
10:46:42 STEP 1343 H=1343:00 +CPU= 19.948
10:47:22 STEP 1344 H=1344:00 +CPU= 38.590
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001344
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001344
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168397/ICMGGhq0f+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168397/ICMSHhq0f+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168397/ICMUAhq0f+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168397/ICMGGhq0f+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168397/ICMSHhq0f+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168397/ICMUAhq0f+001332
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0753_1982050100_123_951_12168397_1_r745526984_55.zip
Uploading the intermediate file: upload_file_55.zip
10:47:45 STEP 1345 H=1345:00 +CPU= 22.974
10:48:05 STEP 1346 H=1346:00 +CPU= 20.326
10:48:35 STEP 1347 H=1347:00 +CPU= 29.107
10:48:54 STEP 1348 H=1348:00 +CPU= 18.926
10:49:16 STEP 1349 H=1349:00 +CPU= 22.087
10:49:52 STEP 1350 H=1350:00 +CPU= 35.189
10:50:14 STEP 1351 H=1351:00 +CPU= 22.326
10:50:36 STEP 1352 H=1352:00 +CPU= 21.921
10:51:11 STEP 1353 H=1353:00 +CPU= 34.584
10:51:34 STEP 1354 H=1354:00 +CPU= 22.886
10:51:56 STEP 1355 H=1355:00 +CPU= 21.402
10:52:34 STEP 1356 H=1356:00 +CPU= 37.284
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001356
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001356
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001356
10:52:53 STEP 1357 H=1357:00 +CPU= 18.746
10:53:16 STEP 1358 H=1358:00 +CPU= 22.781
10:53:51 STEP 1359 H=1359:00 +CPU= 35.361
10:54:15 STEP 1360 H=1360:00 +CPU= 23.177
10:54:36 STEP 1361 H=1361:00 +CPU= 21.136
10:55:08 STEP 1362 H=1362:00 +CPU= 31.474
10:55:27 STEP 1363 H=1363:00 +CPU= 18.778
10:55:51 STEP 1364 H=1364:00 +CPU= 23.943
10:56:26 STEP 1365 H=1365:00 +CPU= 34.628
10:56:49 STEP 1366 H=1366:00 +CPU= 22.810
10:57:12 STEP 1367 H=1367:00 +CPU= 22.850
10:57:51 STEP 1368 H=1368:00 +CPU= 38.460
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001368
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001368
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168397/ICMGGhq0f+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168397/ICMSHhq0f+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168397/ICMUAhq0f+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168397/ICMGGhq0f+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168397/ICMSHhq0f+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168397/ICMUAhq0f+001356
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0753_1982050100_123_951_12168397_1_r745526984_56.zip
Uploading the intermediate file: upload_file_56.zip
10:58:13 STEP 1369 H=1369:00 +CPU= 22.230
10:58:36 STEP 1370 H=1370:00 +CPU= 22.198
10:59:10 STEP 1371 H=1371:00 +CPU= 34.357
10:59:33 STEP 1372 H=1372:00 +CPU= 21.965
10:59:55 STEP 1373 H=1373:00 +CPU= 21.814
11:00:32 STEP 1374 H=1374:00 +CPU= 37.276
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:00:56 STEP 1375 H=1375:00 +CPU= 21.819
11:01:20 STEP 1376 H=1376:00 +CPU= 23.487
11:01:55 STEP 1377 H=1377:00 +CPU= 34.523
11:02:19 STEP 1378 H=1378:00 +CPU= 24.011
11:02:42 STEP 1379 H=1379:00 +CPU= 22.198
11:03:23 STEP 1380 H=1380:00 +CPU= 40.756
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001380
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001380
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001380
11:03:54 STEP 1381 H=1381:00 +CPU= 20.619
11:04:18 STEP 1382 H=1382:00 +CPU= 23.105
11:04:52 STEP 1383 H=1383:00 +CPU= 33.734
11:05:14 STEP 1384 H=1384:00 +CPU= 22.170
11:05:36 STEP 1385 H=1385:00 +CPU= 21.626
11:06:10 STEP 1386 H=1386:00 +CPU= 34.018
11:06:31 STEP 1387 H=1387:00 +CPU= 21.052
11:06:53 STEP 1388 H=1388:00 +CPU= 22.139
11:07:27 STEP 1389 H=1389:00 +CPU= 33.168
11:07:49 STEP 1390 H=1390:00 +CPU= 22.558
11:08:11 STEP 1391 H=1391:00 +CPU= 21.449
11:08:50 STEP 1392 H=1392:00 +CPU= 38.648
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001392
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001392
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168397/ICMGGhq0f+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168397/ICMSHhq0f+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168397/ICMUAhq0f+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168397/ICMGGhq0f+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168397/ICMSHhq0f+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168397/ICMUAhq0f+001380
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0753_1982050100_123_951_12168397_1_r745526984_57.zip
Uploading the intermediate file: upload_file_57.zip
11:09:12 STEP 1393 H=1393:00 +CPU= 22.221
11:09:34 STEP 1394 H=1394:00 +CPU= 21.707
11:10:09 STEP 1395 H=1395:00 +CPU= 34.374
11:10:31 STEP 1396 H=1396:00 +CPU= 22.127
11:10:53 STEP 1397 H=1397:00 +CPU= 21.447
11:11:27 STEP 1398 H=1398:00 +CPU= 34.257
11:11:49 STEP 1399 H=1399:00 +CPU= 21.962
11:12:12 STEP 1400 H=1400:00 +CPU= 22.883
11:12:46 STEP 1401 H=1401:00 +CPU= 33.455
11:13:08 STEP 1402 H=1402:00 +CPU= 22.195
11:13:29 STEP 1403 H=1403:00 +CPU= 20.423
11:14:06 STEP 1404 H=1404:00 +CPU= 37.063
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001404
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001404
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001404
11:14:26 STEP 1405 H=1405:00 +CPU= 19.372
11:14:45 STEP 1406 H=1406:00 +CPU= 18.848
11:15:16 STEP 1407 H=1407:00 +CPU= 30.857
11:15:39 STEP 1408 H=1408:00 +CPU= 22.694
11:16:00 STEP 1409 H=1409:00 +CPU= 21.306
11:16:33 STEP 1410 H=1410:00 +CPU= 32.434
11:16:52 STEP 1411 H=1411:00 +CPU= 18.593
11:17:12 STEP 1412 H=1412:00 +CPU= 20.341
11:17:47 STEP 1413 H=1413:00 +CPU= 34.658
11:18:10 STEP 1414 H=1414:00 +CPU= 22.147
11:18:31 STEP 1415 H=1415:00 +CPU= 21.362
11:19:07 STEP 1416 H=1416:00 +CPU= 36.083
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001416
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001416
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168397/ICMGGhq0f+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168397/ICMSHhq0f+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168397/ICMUAhq0f+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168397/ICMGGhq0f+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168397/ICMSHhq0f+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168397/ICMUAhq0f+001404
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0753_1982050100_123_951_12168397_1_r745526984_58.zip
Uploading the intermediate file: upload_file_58.zip
11:19:27 STEP 1417 H=1417:00 +CPU= 19.189
11:19:48 STEP 1418 H=1418:00 +CPU= 21.561
11:20:23 STEP 1419 H=1419:00 +CPU= 34.318
11:20:45 STEP 1420 H=1420:00 +CPU= 21.768
11:21:06 STEP 1421 H=1421:00 +CPU= 21.345
11:21:42 STEP 1422 H=1422:00 +CPU= 34.985
11:22:03 STEP 1423 H=1423:00 +CPU= 21.531
11:22:25 STEP 1424 H=1424:00 +CPU= 21.267
11:22:59 STEP 1425 H=1425:00 +CPU= 33.785
11:23:21 STEP 1426 H=1426:00 +CPU= 22.304
11:23:43 STEP 1427 H=1427:00 +CPU= 21.172
11:24:20 STEP 1428 H=1428:00 +CPU= 36.729
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001428
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001428
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001428
11:24:41 STEP 1429 H=1429:00 +CPU= 21.603
11:25:03 STEP 1430 H=1430:00 +CPU= 21.533
11:25:36 STEP 1431 H=1431:00 +CPU= 32.783
11:25:58 STEP 1432 H=1432:00 +CPU= 22.054
11:26:19 STEP 1433 H=1433:00 +CPU= 20.498
11:26:54 STEP 1434 H=1434:00 +CPU= 34.768
11:27:16 STEP 1435 H=1435:00 +CPU= 21.438
11:27:38 STEP 1436 H=1436:00 +CPU= 22.389
11:28:12 STEP 1437 H=1437:00 +CPU= 33.484
11:28:34 STEP 1438 H=1438:00 +CPU= 22.285
11:28:56 STEP 1439 H=1439:00 +CPU= 21.467
11:29:36 STEP 1440 H=1440:00 +CPU= 39.823
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001440
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001440
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168397/ICMGGhq0f+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168397/ICMSHhq0f+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168397/ICMUAhq0f+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168397/ICMGGhq0f+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168397/ICMSHhq0f+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168397/ICMUAhq0f+001428
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0753_1982050100_123_951_12168397_1_r745526984_59.zip
Uploading the intermediate file: upload_file_59.zip
11:29:57 STEP 1441 H=1441:00 +CPU= 20.443
11:30:19 STEP 1442 H=1442:00 +CPU= 22.308
11:30:53 STEP 1443 H=1443:00 +CPU= 34.143
11:31:16 STEP 1444 H=1444:00 +CPU= 22.371
11:31:38 STEP 1445 H=1445:00 +CPU= 21.450
11:32:13 STEP 1446 H=1446:00 +CPU= 34.898
11:32:34 STEP 1447 H=1447:00 +CPU= 21.486
11:32:56 STEP 1448 H=1448:00 +CPU= 21.378
11:33:29 STEP 1449 H=1449:00 +CPU= 32.774
11:33:51 STEP 1450 H=1450:00 +CPU= 22.010
11:34:12 STEP 1451 H=1451:00 +CPU= 21.298
11:34:50 STEP 1452 H=1452:00 +CPU= 37.471
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001452
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001452
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001452
11:35:12 STEP 1453 H=1453:00 +CPU= 21.605
11:35:34 STEP 1454 H=1454:00 +CPU= 21.550
11:36:08 STEP 1455 H=1455:00 +CPU= 34.033
11:36:29 STEP 1456 H=1456:00 +CPU= 21.331
11:36:51 STEP 1457 H=1457:00 +CPU= 21.177
11:37:25 STEP 1458 H=1458:00 +CPU= 34.426
11:37:47 STEP 1459 H=1459:00 +CPU= 21.875
11:38:09 STEP 1460 H=1460:00 +CPU= 21.676
11:38:43 STEP 1461 H=1461:00 +CPU= 33.443
11:39:04 STEP 1462 H=1462:00 +CPU= 21.406
11:39:26 STEP 1463 H=1463:00 +CPU= 21.844
11:40:06 STEP 1464 H=1464:00 +CPU= 39.652
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001464
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001464
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001464
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168397/ICMGGhq0f+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168397/ICMSHhq0f+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168397/ICMUAhq0f+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168397/ICMGGhq0f+001452
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168397/ICMSHhq0f+001452
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168397/ICMUAhq0f+001452
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0753_1982050100_123_951_12168397_1_r745526984_60.zip
Uploading the intermediate file: upload_file_60.zip
11:40:28 STEP 1465 H=1465:00 +CPU= 21.451
11:40:50 STEP 1466 H=1466:00 +CPU= 21.900
11:41:23 STEP 1467 H=1467:00 +CPU= 32.777
11:41:45 STEP 1468 H=1468:00 +CPU= 21.932
11:42:07 STEP 1469 H=1469:00 +CPU= 21.682
11:42:42 STEP 1470 H=1470:00 +CPU= 34.711
11:43:04 STEP 1471 H=1471:00 +CPU= 21.474
11:43:26 STEP 1472 H=1472:00 +CPU= 21.898
11:44:00 STEP 1473 H=1473:00 +CPU= 34.268
11:44:22 STEP 1474 H=1474:00 +CPU= 21.467
11:44:43 STEP 1475 H=1475:00 +CPU= 21.457
11:45:20 STEP 1476 H=1476:00 +CPU= 36.798
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001476
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001476
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001476
11:45:42 STEP 1477 H=1477:00 +CPU= 21.628
11:46:05 STEP 1478 H=1478:00 +CPU= 22.588
11:46:38 STEP 1479 H=1479:00 +CPU= 33.199
11:47:00 STEP 1480 H=1480:00 +CPU= 21.094
11:47:21 STEP 1481 H=1481:00 +CPU= 21.156
11:47:55 STEP 1482 H=1482:00 +CPU= 33.842
11:48:17 STEP 1483 H=1483:00 +CPU= 21.691
11:48:39 STEP 1484 H=1484:00 +CPU= 21.589
11:49:13 STEP 1485 H=1485:00 +CPU= 33.754
11:49:35 STEP 1486 H=1486:00 +CPU= 21.959
11:49:56 STEP 1487 H=1487:00 +CPU= 21.172
11:50:39 STEP 1488 H=1488:00 +CPU= 41.823
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1982050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0753
(argv4) batchid: 951
(argv5) wuid: 12168397
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/6
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168397
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/6/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/6/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_ae5a3c266540fadd30b7e7e76879ef34 to: /var/lib/boinc-client/slots/6/oifs_43r3_ps_0753_1982050100_123_951_12168397.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/6/oifs_43r3_ps_0753_1982050100_123_951_12168397.zip
ic_ancil_file: ic_ancil_12168397
ifsdata_file: ifsdata_12168397
climate_data_file: clim_data_12168397
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_ea25124f498afd2578b95025936a8071 to: /var/lib/boinc-client/slots/6/ic_ancil_12168397.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/6/ic_ancil_12168397.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_8946c5f39c69730cdaca9b6c09fac619 to: /var/lib/boinc-client/slots/6/ifsdata/ifsdata_12168397.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/6/ifsdata/ifsdata_12168397.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/6/159l_2/clim_data_12168397.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/6/159l_2/clim_data_12168397.zip
Checking for progress XML file: /var/lib/boinc-client/slots/6/progress_file_12168397.xml
Opened progress file ok : /var/lib/boinc-client/slots/6/progress_file_12168397.xml
-- Model is restarting --
Adjusting last_iter, 1488, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/6/progress_file_12168397.xml
last_cpu_time: 39387
upload_file_number: 61
last_iter: 1487
last_upload: 5270400
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0753_1982050100_123_951_12168397_1_r745526984
The child process has been launched with process id: 62084
Executing the command: /var/lib/boinc-client/slots/6/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:LinuxMint:1:1:62084:62084] [20230118:115611:1674039371:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:LinuxMint:1:1:62084:62084] [20230118:115611:1674039371:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:LinuxMint:1:1:62084:62084] [20230118:115611:1674039371:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:LinuxMint:1:1:62084:62084] [20230118:115611:1674039371:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:LinuxMint:1:1:62084:62084] [20230118:115611:1674039371:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:LinuxMint:1:1:62084:62084] [20230118:115611:1674039371:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:LinuxMint:1:1:62084:62084] [20230118:115611:1674039371:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:LinuxMint:1:1:62084:62084] [20230118:115611:1674039371:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:LinuxMint:1:1:62084:62084] [20230118:115611:1674039371:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:LinuxMint:1:1:62084:62084] [20230118:115611:1674039371:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:LinuxMint:1:1:62084:62084] [20230118:115611:1674039371:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:LinuxMint:1:1:62084:62084] [20230118:115611:1674039371:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:LinuxMint:1:1:62084:62084] [20230118:115611:1674039371:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:LinuxMint:1:1:62084:62084] [20230118:115611:1674039371:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:LinuxMint:1:1:62084:62084] [20230118:115611:1674039371:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:LinuxMint:1:1:62084:62084] [20230118:115611:1674039371:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:LinuxMint:1:1:62084:62084] [20230118:115611:1674039371:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:LinuxMint:1:1:62084:62084] [20230118:115611:1674039371:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:LinuxMint:1:1:62084:62084] [20230118:115611:1674039371:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:LinuxMint:1:1:62084:62084] [20230118:115611:1674039371:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:LinuxMint:1:1:62084:62084] [20230118:115611:1674039371:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:LinuxMint:1:1:62084:62084] [20230118:115611:1674039371:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:LinuxMint:1:1:62084:62084] [20230118:115611:1674039371:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:LinuxMint:1:1:62084:62084] [20230118:115611:1674039371:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:LinuxMint:1:1:62084:62084] [20230118:115611:1674039371:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:LinuxMint:1:1:62084:62084] [20230118:115611:1674039371:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:LinuxMint:1:1:62084:62084] [20230118:115611:1674039371:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:LinuxMint:1:1:62084:62084] [20230118:115611:1674039371:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:LinuxMint:1:1:62084:62084] [20230118:115611:1674039371:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:LinuxMint:1:1:62084:62084] [20230118:115611:1674039371:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
11:56:52 STEP 1488 H=1488:00 +CPU= 38.134
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001488
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001488
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001488
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168397/ICMGGhq0f+001464
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168397/ICMSHhq0f+001464
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168397/ICMUAhq0f+001464
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168397/ICMGGhq0f+001476
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168397/ICMSHhq0f+001476
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168397/ICMUAhq0f+001476
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0753_1982050100_123_951_12168397_1_r745526984_61.zip
Uploading the intermediate file: upload_file_61.zip
11:57:13 STEP 1489 H=1489:00 +CPU= 20.943
11:57:33 STEP 1490 H=1490:00 +CPU= 19.519
11:58:03 STEP 1491 H=1491:00 +CPU= 30.230
11:58:25 STEP 1492 H=1492:00 +CPU= 22.125
11:58:47 STEP 1493 H=1493:00 +CPU= 21.628
11:59:20 STEP 1494 H=1494:00 +CPU= 32.174
11:59:39 STEP 1495 H=1495:00 +CPU= 18.820
11:59:58 STEP 1496 H=1496:00 +CPU= 19.312
12:00:37 STEP 1497 H=1497:00 +CPU= 38.349
12:01:03 STEP 1498 H=1498:00 +CPU= 25.533
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:01:38 STEP 1499 H=1499:00 +CPU= 23.125
12:02:15 STEP 1500 H=1500:00 +CPU= 36.634
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001500
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001500
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001500
12:02:39 STEP 1501 H=1501:00 +CPU= 23.246
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:03:05 STEP 1502 H=1502:00 +CPU= 24.725
12:03:45 STEP 1503 H=1503:00 +CPU= 38.681
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:04:20 STEP 1504 H=1504:00 +CPU= 24.473
12:04:44 STEP 1505 H=1505:00 +CPU= 23.568
12:05:23 STEP 1506 H=1506:00 +CPU= 38.827
12:05:48 STEP 1507 H=1507:00 +CPU= 24.364
12:06:14 STEP 1508 H=1508:00 +CPU= 25.579
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:07:03 STEP 1509 H=1509:00 +CPU= 37.297
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:07:31 STEP 1510 H=1510:00 +CPU= 25.413
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:07:59 STEP 1511 H=1511:00 +CPU= 25.124
12:08:46 STEP 1512 H=1512:00 +CPU= 46.710
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001512
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001512
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001512
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168397/ICMGGhq0f+001488
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168397/ICMSHhq0f+001488
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168397/ICMUAhq0f+001488
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168397/ICMGGhq0f+001500
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168397/ICMSHhq0f+001500
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12168397/ICMUAhq0f+001500
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0753_1982050100_123_951_12168397_1_r745526984_62.zip
Uploading the intermediate file: upload_file_62.zip
12:09:13 STEP 1513 H=1513:00 +CPU= 24.382
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:09:41 STEP 1514 H=1514:00 +CPU= 24.636
Abort request received from BOINC client, ending the child process
</stderr_txt>
]]>
