<core_client_version>7.20.2</core_client_version>
<![CDATA[
<message>
Disk usage limit exceeded</message>
<stderr_txt>
0F MAIN__ 96 master.F90
oifs_43r3_model.e 00000000004021A2 Unknown Unknown Unknown
oifs_43r3_model.e 0000000001DCA390 Unknown Unknown Unknown
oifs_43r3_model.e 000000000040206E Unknown Unknown Unknown
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1990050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0138
(argv4) batchid: 959
(argv5) wuid: 12175782
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /data/boinc/boinc-client/slots/4
Project directory is: /data/boinc/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782
..mkdir for temp folder for results failed
Copying: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /data/boinc/boinc-client/slots/4/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /data/boinc/boinc-client/slots/4/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_821fdc31beade791a43ccb577b05773d to: /data/boinc/boinc-client/slots/4/oifs_43r3_ps_0138_1990050100_123_959_12175782.zip
Unzipping the namelist zip file: /data/boinc/boinc-client/slots/4/oifs_43r3_ps_0138_1990050100_123_959_12175782.zip
ic_ancil_file: ic_ancil_12175782
ifsdata_file: ifsdata_12175782
climate_data_file: clim_data_12175782
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_02a85f3688ff39aa035908231beb0b9d to: /data/boinc/boinc-client/slots/4/ic_ancil_12175782.zip
Unzipping the IC ancils zip file: /data/boinc/boinc-client/slots/4/ic_ancil_12175782.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_b6492f8f3b8ba179a849a8bedb304dcb to: /data/boinc/boinc-client/slots/4/ifsdata/ifsdata_12175782.zip
Unzipping the ifsdata_zip file: /data/boinc/boinc-client/slots/4/ifsdata/ifsdata_12175782.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /data/boinc/boinc-client/slots/4/159l_2/clim_data_12175782.zip
Unzipping the climate data zip file: /data/boinc/boinc-client/slots/4/159l_2/clim_data_12175782.zip
Checking for progress XML file: /data/boinc/boinc-client/slots/4/progress_file_12175782.xml
Opened progress file ok : /data/boinc/boinc-client/slots/4/progress_file_12175782.xml
-- Model is restarting --
Adjusting last_iter, 1239, to previous model restart step.
Creating progress file: /data/boinc/boinc-client/slots/4/progress_file_12175782.xml
last_cpu_time: 48289
upload_file_number: 51
last_iter: 1223
last_upload: 4406400
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0138_1990050100_123_959_12175782_0_r262242663
The child process has been launched with process id: 21127
Executing the command: /data/boinc/boinc-client/slots/4/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21127:21127] [20221226:105006:1672051806:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21127:21127] [20221226:105006:1672051806:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21127:21127] [20221226:105006:1672051806:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21127:21127] [20221226:105006:1672051806:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21127:21127] [20221226:105006:1672051806:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21127:21127] [20221226:105006:1672051806:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21127:21127] [20221226:105006:1672051806:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21127:21127] [20221226:105006:1672051806:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21127:21127] [20221226:105006:1672051806:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21127:21127] [20221226:105006:1672051806:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21127:21127] [20221226:105006:1672051806:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21127:21127] [20221226:105006:1672051806:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21127:21127] [20221226:105006:1672051806:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21127:21127] [20221226:105006:1672051806:0.001] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21127:21127] [20221226:105006:1672051806:0.001] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21127:21127] [20221226:105006:1672051806:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21127:21127] [20221226:105006:1672051806:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21127:21127] [20221226:105006:1672051806:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21127:21127] [20221226:105006:1672051806:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21127:21127] [20221226:105006:1672051806:0.001] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21127:21127] [20221226:105006:1672051806:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21127:21127] [20221226:105006:1672051806:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21127:21127] [20221226:105006:1672051806:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21127:21127] [20221226:105006:1672051806:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21127:21127] [20221226:105006:1672051806:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21127:21127] [20221226:105006:1672051806:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21127:21127] [20221226:105006:1672051806:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21127:21127] [20221226:105006:1672051806:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21127:21127] [20221226:105006:1672051806:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21127:21127] [20221226:105006:1672051806:0.001] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:33:02 STEP 1224 H=1224:00 +CPU= 53.313
11:33:33 STEP 1225 H=1225:00 +CPU= 30.077
11:34:04 STEP 1226 H=1226:00 +CPU= 30.938
11:34:50 STEP 1227 H=1227:00 +CPU= 45.801
11:35:21 STEP 1228 H=1228:00 +CPU= 29.839
11:35:51 STEP 1229 H=1229:00 +CPU= 29.968
11:36:39 STEP 1230 H=1230:00 +CPU= 47.794
11:37:10 STEP 1231 H=1231:00 +CPU= 30.097
11:37:41 STEP 1232 H=1232:00 +CPU= 30.469
11:38:28 STEP 1233 H=1233:00 +CPU= 47.064
11:38:59 STEP 1234 H=1234:00 +CPU= 30.093
11:39:29 STEP 1235 H=1235:00 +CPU= 30.248
11:40:23 STEP 1236 H=1236:00 +CPU= 53.159
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMGGhq0f+001236
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMSHhq0f+001236
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMUAhq0f+001236
11:40:52 STEP 1237 H=1237:00 +CPU= 29.203
11:41:24 STEP 1238 H=1238:00 +CPU= 31.452
11:42:11 STEP 1239 H=1239:00 +CPU= 46.840
11:42:43 STEP 1240 H=1240:00 +CPU= 31.298
11:43:13 STEP 1241 H=1241:00 +CPU= 29.835
11:44:01 STEP 1242 H=1242:00 +CPU= 47.286
11:44:30 STEP 1243 H=1243:00 +CPU= 29.413
11:45:03 STEP 1244 H=1244:00 +CPU= 31.997
11:45:50 STEP 1245 H=1245:00 +CPU= 46.664
11:46:21 STEP 1246 H=1246:00 +CPU= 30.417
11:46:51 STEP 1247 H=1247:00 +CPU= 30.142
11:47:48 STEP 1248 H=1248:00 +CPU= 49.249
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMGGhq0f+001248
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMSHhq0f+001248
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMUAhq0f+001248
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782/ICMGGhq0f+001224
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782/ICMGGhq0f+001236
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782/ICMSHhq0f+001236
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782/ICMUAhq0f+001236
Zipping up the intermediate file: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0138_1990050100_123_959_12175782_0_r262242663_51.zip
Uploading the intermediate file: upload_file_51.zip
11:48:18 STEP 1249 H=1249:00 +CPU= 29.922
11:48:49 STEP 1250 H=1250:00 +CPU= 30.602
11:49:35 STEP 1251 H=1251:00 +CPU= 45.129
11:50:05 STEP 1252 H=1252:00 +CPU= 30.261
11:50:34 STEP 1253 H=1253:00 +CPU= 28.867
11:51:21 STEP 1254 H=1254:00 +CPU= 46.313
11:51:51 STEP 1255 H=1255:00 +CPU= 29.201
11:52:21 STEP 1256 H=1256:00 +CPU= 29.830
11:53:06 STEP 1257 H=1257:00 +CPU= 44.389
11:53:35 STEP 1258 H=1258:00 +CPU= 29.292
11:54:05 STEP 1259 H=1259:00 +CPU= 29.713
11:54:57 STEP 1260 H=1260:00 +CPU= 50.577
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMGGhq0f+001260
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMSHhq0f+001260
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMUAhq0f+001260
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:01:05 STEP 1261 H=1261:00 +CPU= 29.211
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:50:25 STEP 1262 H=1262:00 +CPU= 29.712
12:51:11 STEP 1263 H=1263:00 +CPU= 45.396
12:51:42 STEP 1264 H=1264:00 +CPU= 30.808
12:52:11 STEP 1265 H=1265:00 +CPU= 28.262
12:52:57 STEP 1266 H=1266:00 +CPU= 45.878
12:53:26 STEP 1267 H=1267:00 +CPU= 28.851
12:53:56 STEP 1268 H=1268:00 +CPU= 29.873
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:39:45 STEP 1269 H=1269:00 +CPU= 45.394
13:40:15 STEP 1270 H=1270:00 +CPU= 29.446
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:24:36 STEP 1271 H=1271:00 +CPU= 29.325
14:25:33 STEP 1272 H=1272:00 +CPU= 55.532
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMGGhq0f+001272
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMSHhq0f+001272
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMUAhq0f+001272
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782/ICMGGhq0f+001248
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782/ICMSHhq0f+001248
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782/ICMUAhq0f+001248
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782/ICMGGhq0f+001260
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782/ICMSHhq0f+001260
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782/ICMUAhq0f+001260
Zipping up the intermediate file: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0138_1990050100_123_959_12175782_0_r262242663_52.zip
Uploading the intermediate file: upload_file_52.zip
14:26:02 STEP 1273 H=1273:00 +CPU= 28.603
14:26:33 STEP 1274 H=1274:00 +CPU= 29.848
14:27:20 STEP 1275 H=1275:00 +CPU= 45.809
14:27:51 STEP 1276 H=1276:00 +CPU= 30.208
14:28:21 STEP 1277 H=1277:00 +CPU= 29.471
14:29:09 STEP 1278 H=1278:00 +CPU= 47.338
14:29:39 STEP 1279 H=1279:00 +CPU= 29.186
14:30:10 STEP 1280 H=1280:00 +CPU= 30.820
14:30:57 STEP 1281 H=1281:00 +CPU= 45.733
14:31:27 STEP 1282 H=1282:00 +CPU= 29.993
14:31:57 STEP 1283 H=1283:00 +CPU= 29.013
14:32:49 STEP 1284 H=1284:00 +CPU= 51.090
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMGGhq0f+001284
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMSHhq0f+001284
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMUAhq0f+001284
14:33:19 STEP 1285 H=1285:00 +CPU= 29.042
14:33:50 STEP 1286 H=1286:00 +CPU= 30.070
14:34:36 STEP 1287 H=1287:00 +CPU= 45.334
14:35:07 STEP 1288 H=1288:00 +CPU= 30.152
14:35:37 STEP 1289 H=1289:00 +CPU= 29.836
14:36:25 STEP 1290 H=1290:00 +CPU= 46.912
14:36:54 STEP 1291 H=1291:00 +CPU= 28.854
14:37:24 STEP 1292 H=1292:00 +CPU= 29.646
14:38:09 STEP 1293 H=1293:00 +CPU= 44.653
14:38:39 STEP 1294 H=1294:00 +CPU= 29.254
14:39:09 STEP 1295 H=1295:00 +CPU= 29.725
14:40:04 STEP 1296 H=1296:00 +CPU= 54.487
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMGGhq0f+001296
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMSHhq0f+001296
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMUAhq0f+001296
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782/ICMGGhq0f+001272
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782/ICMSHhq0f+001272
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782/ICMUAhq0f+001272
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782/ICMGGhq0f+001284
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782/ICMSHhq0f+001284
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782/ICMUAhq0f+001284
Zipping up the intermediate file: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0138_1990050100_123_959_12175782_0_r262242663_53.zip
Uploading the intermediate file: upload_file_53.zip
14:40:34 STEP 1297 H=1297:00 +CPU= 29.388
14:41:04 STEP 1298 H=1298:00 +CPU= 30.107
14:41:50 STEP 1299 H=1299:00 +CPU= 45.330
14:42:20 STEP 1300 H=1300:00 +CPU= 30.270
14:42:49 STEP 1301 H=1301:00 +CPU= 28.813
14:43:36 STEP 1302 H=1302:00 +CPU= 46.431
14:44:05 STEP 1303 H=1303:00 +CPU= 28.789
14:44:35 STEP 1304 H=1304:00 +CPU= 29.773
14:45:21 STEP 1305 H=1305:00 +CPU= 45.366
14:45:51 STEP 1306 H=1306:00 +CPU= 29.720
14:46:20 STEP 1307 H=1307:00 +CPU= 28.635
14:47:11 STEP 1308 H=1308:00 +CPU= 50.991
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMGGhq0f+001308
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMSHhq0f+001308
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMUAhq0f+001308
14:47:40 STEP 1309 H=1309:00 +CPU= 28.284
14:48:09 STEP 1310 H=1310:00 +CPU= 29.363
14:48:54 STEP 1311 H=1311:00 +CPU= 45.053
14:49:24 STEP 1312 H=1312:00 +CPU= 29.209
14:49:52 STEP 1313 H=1313:00 +CPU= 27.709
14:50:38 STEP 1314 H=1314:00 +CPU= 45.984
14:51:07 STEP 1315 H=1315:00 +CPU= 28.690
14:51:37 STEP 1316 H=1316:00 +CPU= 29.527
14:52:23 STEP 1317 H=1317:00 +CPU= 45.417
14:52:53 STEP 1318 H=1318:00 +CPU= 29.621
14:53:22 STEP 1319 H=1319:00 +CPU= 29.148
14:54:16 STEP 1320 H=1320:00 +CPU= 53.699
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMGGhq0f+001320
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMSHhq0f+001320
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMUAhq0f+001320
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782/ICMGGhq0f+001296
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782/ICMSHhq0f+001296
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782/ICMUAhq0f+001296
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782/ICMGGhq0f+001308
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782/ICMSHhq0f+001308
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782/ICMUAhq0f+001308
Zipping up the intermediate file: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0138_1990050100_123_959_12175782_0_r262242663_54.zip
Uploading the intermediate file: upload_file_54.zip
14:54:45 STEP 1321 H=1321:00 +CPU= 28.890
14:55:14 STEP 1322 H=1322:00 +CPU= 29.045
14:56:00 STEP 1323 H=1323:00 +CPU= 45.228
14:56:29 STEP 1324 H=1324:00 +CPU= 29.332
14:56:59 STEP 1325 H=1325:00 +CPU= 28.838
14:57:45 STEP 1326 H=1326:00 +CPU= 46.291
14:58:14 STEP 1327 H=1327:00 +CPU= 28.661
14:58:45 STEP 1328 H=1328:00 +CPU= 30.670
14:59:30 STEP 1329 H=1329:00 +CPU= 45.032
15:00:00 STEP 1330 H=1330:00 +CPU= 29.410
15:00:29 STEP 1331 H=1331:00 +CPU= 28.818
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
17:25:28 STEP 1332 H=1332:00 +CPU= 50.737
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMGGhq0f+001332
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMSHhq0f+001332
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMUAhq0f+001332
17:25:56 STEP 1333 H=1333:00 +CPU= 27.596
17:26:25 STEP 1334 H=1334:00 +CPU= 29.354
17:27:12 STEP 1335 H=1335:00 +CPU= 45.966
17:27:41 STEP 1336 H=1336:00 +CPU= 29.280
17:28:10 STEP 1337 H=1337:00 +CPU= 28.707
17:28:57 STEP 1338 H=1338:00 +CPU= 46.832
17:29:26 STEP 1339 H=1339:00 +CPU= 28.726
17:29:56 STEP 1340 H=1340:00 +CPU= 29.452
17:30:40 STEP 1341 H=1341:00 +CPU= 44.029
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
17:33:12 STEP 1342 H=1342:00 +CPU= 30.080
17:33:41 STEP 1343 H=1343:00 +CPU= 28.889
17:34:34 STEP 1344 H=1344:00 +CPU= 53.222
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMGGhq0f+001344
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMSHhq0f+001344
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMUAhq0f+001344
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782/ICMGGhq0f+001320
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782/ICMSHhq0f+001320
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782/ICMUAhq0f+001320
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782/ICMGGhq0f+001332
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782/ICMSHhq0f+001332
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782/ICMUAhq0f+001332
Zipping up the intermediate file: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0138_1990050100_123_959_12175782_0_r262242663_55.zip
Uploading the intermediate file: upload_file_55.zip
17:35:02 STEP 1345 H=1345:00 +CPU= 28.091
17:35:32 STEP 1346 H=1346:00 +CPU= 29.395
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
17:38:18 STEP 1347 H=1347:00 +CPU= 45.167
17:38:48 STEP 1348 H=1348:00 +CPU= 30.204
17:39:17 STEP 1349 H=1349:00 +CPU= 28.221
17:40:03 STEP 1350 H=1350:00 +CPU= 46.444
17:40:31 STEP 1351 H=1351:00 +CPU= 28.016
17:41:02 STEP 1352 H=1352:00 +CPU= 30.295
17:41:48 STEP 1353 H=1353:00 +CPU= 46.220
17:42:19 STEP 1354 H=1354:00 +CPU= 30.233
17:42:48 STEP 1355 H=1355:00 +CPU= 29.342
17:43:37 STEP 1356 H=1356:00 +CPU= 48.510
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMGGhq0f+001356
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMSHhq0f+001356
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMUAhq0f+001356
17:44:06 STEP 1357 H=1357:00 +CPU= 28.644
17:44:35 STEP 1358 H=1358:00 +CPU= 28.952
17:45:19 STEP 1359 H=1359:00 +CPU= 43.584
17:45:49 STEP 1360 H=1360:00 +CPU= 29.195
17:46:17 STEP 1361 H=1361:00 +CPU= 27.919
17:47:04 STEP 1362 H=1362:00 +CPU= 46.379
17:47:32 STEP 1363 H=1363:00 +CPU= 28.321
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
17:50:03 STEP 1364 H=1364:00 +CPU= 29.514
17:50:49 STEP 1365 H=1365:00 +CPU= 45.528
17:51:18 STEP 1366 H=1366:00 +CPU= 29.387
17:51:48 STEP 1367 H=1367:00 +CPU= 29.553
17:52:41 STEP 1368 H=1368:00 +CPU= 52.898
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMGGhq0f+001368
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMSHhq0f+001368
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMUAhq0f+001368
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782/ICMGGhq0f+001344
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782/ICMSHhq0f+001344
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782/ICMUAhq0f+001344
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782/ICMGGhq0f+001356
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782/ICMSHhq0f+001356
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782/ICMUAhq0f+001356
Zipping up the intermediate file: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0138_1990050100_123_959_12175782_0_r262242663_56.zip
Uploading the intermediate file: upload_file_56.zip
17:53:10 STEP 1369 H=1369:00 +CPU= 28.648
17:53:40 STEP 1370 H=1370:00 +CPU= 29.386
17:54:25 STEP 1371 H=1371:00 +CPU= 44.612
17:54:55 STEP 1372 H=1372:00 +CPU= 29.371
17:55:23 STEP 1373 H=1373:00 +CPU= 28.628
17:56:10 STEP 1374 H=1374:00 +CPU= 46.034
17:56:39 STEP 1375 H=1375:00 +CPU= 29.179
17:57:09 STEP 1376 H=1376:00 +CPU= 30.017
17:57:55 STEP 1377 H=1377:00 +CPU= 45.266
17:58:25 STEP 1378 H=1378:00 +CPU= 29.641
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
18:01:00 STEP 1379 H=1379:00 +CPU= 28.999
18:01:50 STEP 1380 H=1380:00 +CPU= 48.980
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMGGhq0f+001380
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMSHhq0f+001380
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMUAhq0f+001380
18:02:18 STEP 1381 H=1381:00 +CPU= 27.865
18:02:48 STEP 1382 H=1382:00 +CPU= 29.728
18:03:32 STEP 1383 H=1383:00 +CPU= 44.145
18:04:03 STEP 1384 H=1384:00 +CPU= 30.422
18:04:31 STEP 1385 H=1385:00 +CPU= 28.181
18:05:17 STEP 1386 H=1386:00 +CPU= 45.304
18:05:45 STEP 1387 H=1387:00 +CPU= 28.394
18:06:15 STEP 1388 H=1388:00 +CPU= 29.919
18:07:02 STEP 1389 H=1389:00 +CPU= 46.330
18:07:31 STEP 1390 H=1390:00 +CPU= 29.039
18:08:00 STEP 1391 H=1391:00 +CPU= 28.988
18:08:53 STEP 1392 H=1392:00 +CPU= 52.031
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMGGhq0f+001392
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMSHhq0f+001392
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMUAhq0f+001392
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782/ICMGGhq0f+001368
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782/ICMSHhq0f+001368
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782/ICMUAhq0f+001368
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782/ICMGGhq0f+001380
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782/ICMSHhq0f+001380
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782/ICMUAhq0f+001380
Zipping up the intermediate file: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0138_1990050100_123_959_12175782_0_r262242663_57.zip
Uploading the intermediate file: upload_file_57.zip
18:09:21 STEP 1393 H=1393:00 +CPU= 27.761
18:09:51 STEP 1394 H=1394:00 +CPU= 29.692
18:10:36 STEP 1395 H=1395:00 +CPU= 44.685
18:11:04 STEP 1396 H=1396:00 +CPU= 28.522
18:11:33 STEP 1397 H=1397:00 +CPU= 28.417
18:12:20 STEP 1398 H=1398:00 +CPU= 46.026
18:12:48 STEP 1399 H=1399:00 +CPU= 28.310
18:13:19 STEP 1400 H=1400:00 +CPU= 30.460
18:14:04 STEP 1401 H=1401:00 +CPU= 44.977
18:14:35 STEP 1402 H=1402:00 +CPU= 30.373
18:15:04 STEP 1403 H=1403:00 +CPU= 28.797
18:15:56 STEP 1404 H=1404:00 +CPU= 51.742
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMGGhq0f+001404
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMSHhq0f+001404
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMUAhq0f+001404
18:16:24 STEP 1405 H=1405:00 +CPU= 28.159
18:16:54 STEP 1406 H=1406:00 +CPU= 29.783
18:17:40 STEP 1407 H=1407:00 +CPU= 45.662
18:18:09 STEP 1408 H=1408:00 +CPU= 28.987
18:18:37 STEP 1409 H=1409:00 +CPU= 27.799
18:19:24 STEP 1410 H=1410:00 +CPU= 46.370
18:19:53 STEP 1411 H=1411:00 +CPU= 28.996
18:20:23 STEP 1412 H=1412:00 +CPU= 30.114
18:21:09 STEP 1413 H=1413:00 +CPU= 45.678
18:21:39 STEP 1414 H=1414:00 +CPU= 29.476
18:22:08 STEP 1415 H=1415:00 +CPU= 29.250
18:23:02 STEP 1416 H=1416:00 +CPU= 53.489
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMGGhq0f+001416
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMSHhq0f+001416
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMUAhq0f+001416
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782/ICMGGhq0f+001392
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782/ICMSHhq0f+001392
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782/ICMUAhq0f+001392
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782/ICMGGhq0f+001404
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782/ICMSHhq0f+001404
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782/ICMUAhq0f+001404
Zipping up the intermediate file: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0138_1990050100_123_959_12175782_0_r262242663_58.zip
Uploading the intermediate file: upload_file_58.zip
18:23:31 STEP 1417 H=1417:00 +CPU= 29.035
18:24:00 STEP 1418 H=1418:00 +CPU= 28.095
18:24:44 STEP 1419 H=1419:00 +CPU= 44.132
18:25:13 STEP 1420 H=1420:00 +CPU= 28.834
18:25:42 STEP 1421 H=1421:00 +CPU= 29.049
18:26:28 STEP 1422 H=1422:00 +CPU= 45.726
18:26:58 STEP 1423 H=1423:00 +CPU= 29.104
18:27:28 STEP 1424 H=1424:00 +CPU= 29.847
18:28:13 STEP 1425 H=1425:00 +CPU= 44.920
18:28:43 STEP 1426 H=1426:00 +CPU= 29.329
18:29:11 STEP 1427 H=1427:00 +CPU= 27.762
18:30:00 STEP 1428 H=1428:00 +CPU= 49.166
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMGGhq0f+001428
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMSHhq0f+001428
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMUAhq0f+001428
18:30:28 STEP 1429 H=1429:00 +CPU= 28.161
18:30:58 STEP 1430 H=1430:00 +CPU= 29.757
18:31:43 STEP 1431 H=1431:00 +CPU= 44.424
18:32:13 STEP 1432 H=1432:00 +CPU= 29.470
18:32:41 STEP 1433 H=1433:00 +CPU= 28.747
18:33:28 STEP 1434 H=1434:00 +CPU= 46.310
18:33:57 STEP 1435 H=1435:00 +CPU= 28.413
18:34:26 STEP 1436 H=1436:00 +CPU= 29.227
18:35:11 STEP 1437 H=1437:00 +CPU= 45.029
18:35:42 STEP 1438 H=1438:00 +CPU= 30.012
18:36:12 STEP 1439 H=1439:00 +CPU= 29.983
18:37:04 STEP 1440 H=1440:00 +CPU= 52.448
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMGGhq0f+001440
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMSHhq0f+001440
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMUAhq0f+001440
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782/ICMGGhq0f+001416
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782/ICMSHhq0f+001416
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782/ICMUAhq0f+001416
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782/ICMGGhq0f+001428
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782/ICMSHhq0f+001428
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782/ICMUAhq0f+001428
Zipping up the intermediate file: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0138_1990050100_123_959_12175782_0_r262242663_59.zip
Uploading the intermediate file: upload_file_59.zip
18:37:34 STEP 1441 H=1441:00 +CPU= 28.894
18:38:03 STEP 1442 H=1442:00 +CPU= 29.519
18:38:48 STEP 1443 H=1443:00 +CPU= 44.503
18:39:17 STEP 1444 H=1444:00 +CPU= 29.103
18:39:46 STEP 1445 H=1445:00 +CPU= 29.022
18:40:33 STEP 1446 H=1446:00 +CPU= 45.887
18:41:01 STEP 1447 H=1447:00 +CPU= 27.987
18:41:29 STEP 1448 H=1448:00 +CPU= 28.183
18:42:15 STEP 1449 H=1449:00 +CPU= 45.792
18:42:45 STEP 1450 H=1450:00 +CPU= 30.097
18:43:14 STEP 1451 H=1451:00 +CPU= 28.668
18:44:05 STEP 1452 H=1452:00 +CPU= 50.676
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMGGhq0f+001452
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMSHhq0f+001452
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMUAhq0f+001452
18:44:33 STEP 1453 H=1453:00 +CPU= 27.495
18:45:04 STEP 1454 H=1454:00 +CPU= 30.587
18:45:49 STEP 1455 H=1455:00 +CPU= 45.373
18:46:19 STEP 1456 H=1456:00 +CPU= 29.793
18:46:47 STEP 1457 H=1457:00 +CPU= 27.624
18:47:32 STEP 1458 H=1458:00 +CPU= 44.930
18:48:00 STEP 1459 H=1459:00 +CPU= 27.331
18:48:28 STEP 1460 H=1460:00 +CPU= 27.912
18:49:14 STEP 1461 H=1461:00 +CPU= 45.717
18:49:43 STEP 1462 H=1462:00 +CPU= 28.589
18:50:12 STEP 1463 H=1463:00 +CPU= 29.743
18:51:05 STEP 1464 H=1464:00 +CPU= 52.502
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMGGhq0f+001464
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMSHhq0f+001464
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMUAhq0f+001464
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782/ICMGGhq0f+001440
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782/ICMSHhq0f+001440
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782/ICMUAhq0f+001440
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782/ICMGGhq0f+001452
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782/ICMSHhq0f+001452
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782/ICMUAhq0f+001452
Zipping up the intermediate file: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0138_1990050100_123_959_12175782_0_r262242663_60.zip
Uploading the intermediate file: upload_file_60.zip
18:51:34 STEP 1465 H=1465:00 +CPU= 28.938
Uploading trickle at timestep: 5270400
18:52:04 STEP 1466 H=1466:00 +CPU= 29.112
18:52:49 STEP 1467 H=1467:00 +CPU= 44.696
18:53:18 STEP 1468 H=1468:00 +CPU= 29.052
18:53:47 STEP 1469 H=1469:00 +CPU= 28.482
18:54:33 STEP 1470 H=1470:00 +CPU= 46.211
18:55:01 STEP 1471 H=1471:00 +CPU= 27.296
18:55:31 STEP 1472 H=1472:00 +CPU= 29.976
18:56:16 STEP 1473 H=1473:00 +CPU= 44.873
18:56:45 STEP 1474 H=1474:00 +CPU= 29.219
18:57:14 STEP 1475 H=1475:00 +CPU= 28.505
18:58:06 STEP 1476 H=1476:00 +CPU= 51.129
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMGGhq0f+001476
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMSHhq0f+001476
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMUAhq0f+001476
18:58:34 STEP 1477 H=1477:00 +CPU= 28.344
18:59:05 STEP 1478 H=1478:00 +CPU= 30.384
18:59:48 STEP 1479 H=1479:00 +CPU= 43.646
19:00:18 STEP 1480 H=1480:00 +CPU= 29.346
19:00:47 STEP 1481 H=1481:00 +CPU= 28.526
19:01:34 STEP 1482 H=1482:00 +CPU= 47.004
19:02:03 STEP 1483 H=1483:00 +CPU= 28.620
19:02:34 STEP 1484 H=1484:00 +CPU= 30.567
19:03:19 STEP 1485 H=1485:00 +CPU= 45.094
19:03:48 STEP 1486 H=1486:00 +CPU= 29.043
19:04:17 STEP 1487 H=1487:00 +CPU= 28.716
19:05:12 STEP 1488 H=1488:00 +CPU= 54.769
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMGGhq0f+001488
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMSHhq0f+001488
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMUAhq0f+001488
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782/ICMGGhq0f+001464
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782/ICMSHhq0f+001464
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782/ICMUAhq0f+001464
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782/ICMGGhq0f+001476
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782/ICMSHhq0f+001476
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782/ICMUAhq0f+001476
Zipping up the intermediate file: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0138_1990050100_123_959_12175782_0_r262242663_61.zip
Uploading the intermediate file: upload_file_61.zip
19:05:41 STEP 1489 H=1489:00 +CPU= 28.072
19:06:09 STEP 1490 H=1490:00 +CPU= 28.791
19:06:54 STEP 1491 H=1491:00 +CPU= 44.331
19:07:24 STEP 1492 H=1492:00 +CPU= 29.572
19:07:52 STEP 1493 H=1493:00 +CPU= 27.956
19:08:38 STEP 1494 H=1494:00 +CPU= 46.004
19:09:07 STEP 1495 H=1495:00 +CPU= 28.076
19:09:36 STEP 1496 H=1496:00 +CPU= 29.559
19:10:21 STEP 1497 H=1497:00 +CPU= 44.645
19:10:51 STEP 1498 H=1498:00 +CPU= 29.819
19:11:20 STEP 1499 H=1499:00 +CPU= 28.086
19:12:08 STEP 1500 H=1500:00 +CPU= 48.657
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMGGhq0f+001500
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMSHhq0f+001500
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMUAhq0f+001500
19:12:37 STEP 1501 H=1501:00 +CPU= 28.632
19:13:07 STEP 1502 H=1502:00 +CPU= 29.733
19:13:52 STEP 1503 H=1503:00 +CPU= 44.702
19:14:21 STEP 1504 H=1504:00 +CPU= 28.950
19:14:50 STEP 1505 H=1505:00 +CPU= 28.746
19:15:37 STEP 1506 H=1506:00 +CPU= 46.292
19:16:04 STEP 1507 H=1507:00 +CPU= 27.254
19:16:33 STEP 1508 H=1508:00 +CPU= 28.963
19:17:17 STEP 1509 H=1509:00 +CPU= 43.084
19:17:47 STEP 1510 H=1510:00 +CPU= 29.693
19:18:16 STEP 1511 H=1511:00 +CPU= 29.375
19:19:10 STEP 1512 H=1512:00 +CPU= 53.600
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMGGhq0f+001512
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMSHhq0f+001512
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMUAhq0f+001512
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782/ICMGGhq0f+001488
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782/ICMSHhq0f+001488
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782/ICMUAhq0f+001488
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782/ICMGGhq0f+001500
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782/ICMSHhq0f+001500
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782/ICMUAhq0f+001500
Zipping up the intermediate file: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0138_1990050100_123_959_12175782_0_r262242663_62.zip
Uploading the intermediate file: upload_file_62.zip
19:19:40 STEP 1513 H=1513:00 +CPU= 29.233
19:20:09 STEP 1514 H=1514:00 +CPU= 29.380
19:20:54 STEP 1515 H=1515:00 +CPU= 44.907
19:21:24 STEP 1516 H=1516:00 +CPU= 29.456
19:21:53 STEP 1517 H=1517:00 +CPU= 28.583
19:22:39 STEP 1518 H=1518:00 +CPU= 45.881
19:23:06 STEP 1519 H=1519:00 +CPU= 27.407
19:23:35 STEP 1520 H=1520:00 +CPU= 28.015
19:24:19 STEP 1521 H=1521:00 +CPU= 43.845
19:24:48 STEP 1522 H=1522:00 +CPU= 28.712
19:25:15 STEP 1523 H=1523:00 +CPU= 27.149
19:26:03 STEP 1524 H=1524:00 +CPU= 47.894
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMGGhq0f+001524
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMSHhq0f+001524
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMUAhq0f+001524
19:26:30 STEP 1525 H=1525:00 +CPU= 26.697
19:26:58 STEP 1526 H=1526:00 +CPU= 28.043
19:27:41 STEP 1527 H=1527:00 +CPU= 42.838
19:28:10 STEP 1528 H=1528:00 +CPU= 28.505
19:28:38 STEP 1529 H=1529:00 +CPU= 27.872
19:29:24 STEP 1530 H=1530:00 +CPU= 45.825
19:29:52 STEP 1531 H=1531:00 +CPU= 27.646
19:30:21 STEP 1532 H=1532:00 +CPU= 28.851
19:31:05 STEP 1533 H=1533:00 +CPU= 43.649
19:31:34 STEP 1534 H=1534:00 +CPU= 29.068
19:32:02 STEP 1535 H=1535:00 +CPU= 27.621
19:32:53 STEP 1536 H=1536:00 +CPU= 50.342
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMGGhq0f+001536
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMSHhq0f+001536
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMUAhq0f+001536
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782/ICMGGhq0f+001512
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782/ICMSHhq0f+001512
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782/ICMUAhq0f+001512
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782/ICMGGhq0f+001524
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782/ICMSHhq0f+001524
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782/ICMUAhq0f+001524
Zipping up the intermediate file: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0138_1990050100_123_959_12175782_0_r262242663_63.zip
Uploading the intermediate file: upload_file_63.zip
19:33:21 STEP 1537 H=1537:00 +CPU= 28.039
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
19:45:26 STEP 1538 H=1538:00 +CPU= 27.748
19:46:11 STEP 1539 H=1539:00 +CPU= 44.634
19:46:40 STEP 1540 H=1540:00 +CPU= 29.171
19:47:10 STEP 1541 H=1541:00 +CPU= 28.911
19:47:57 STEP 1542 H=1542:00 +CPU= 46.495
19:48:26 STEP 1543 H=1543:00 +CPU= 29.119
Suspend request received from the BOINC client, suspending the child process
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21127:21127] [20221226:202946:1672086586:34779.758] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1538] Received signal#15 (SIGTERM) :: 3996MB (heap), 4415MB (maxrss), 0MB (maxstack), 0 (paging), nsigs = 1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21127:21127] [20221226:202946:1672086586:34779.778] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1542] Also activating Harakiri-alarm (SIGALRM=14) to expire after 500s elapsed to prevent hangs, nsigs = 1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21127:21127] [20221226:202946:1672086586:34779.778] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1544] Harakiri signal handler 'signal_harakiri' for signal#14 (SIGALRM) installed at 0x81f3c0 (old at (nil))
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21127:21127] [20221226:202946:1672086586:34779.778] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1617] Signal#15 was caused by unrecognized si_code [memaddr=0x1], nsigs = 1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21127:21127] [20221226:202946:1672086586:34779.778] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1686] Starting DrHook backtrace for signal#15, nsigs = 1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21127:21127] [20221226:202946:1672086586:34779.778] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3843] 3996 MB (maxheap), 4415 MB (maxrss), 0 MB (maxstack)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21127:21127] [20221226:202946:1672086586:34779.778] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : MASTER
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21127:21127] [20221226:202946:1672086586:34779.778] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : CNT0
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21127:21127] [20221226:202946:1672086586:34779.778] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : CNT1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21127:21127] [20221226:202946:1672086586:34779.778] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : CNT2
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21127:21127] [20221226:202946:1672086586:34779.778] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : CNT3
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21127:21127] [20221226:202946:1672086586:34779.778] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : CNT4
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21127:21127] [20221226:202946:1672086586:34779.778] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : STEPO
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21127:21127] [20221226:202946:1672086586:34779.778] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : SCAN2M
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21127:21127] [20221226:202946:1672086586:34779.778] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : GP_MODEL_HEAP
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21127:21127] [20221226:202946:1672086586:34779.778] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : GP_MODEL
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21127:21127] [20221226:202946:1672086586:34779.778] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : EC_PHYS_DRV
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21127:21127] [20221226:202946:1672086586:34779.778] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : >OMP-PHYSICS (1001)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21127:21127] [20221226:202946:1672086586:34779.778] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : EC_PHYS
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21127:21127] [20221226:202946:1672086586:34779.778] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : CALLPAR
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21127:21127] [20221226:202946:1672086586:34779.778] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : CLOUD_LAYER
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21127:21127] [20221226:202946:1672086586:34779.779] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : CLOUDSC
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21127:21127] [20221226:202946:1672086586:34779.779] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : CUADJTQ
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21127:21127] [20221226:202947:1672086587:34780.779] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1734] DrHook backtrace done for signal#15, nsigs = 1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21127:21127] [20221226:202947:1672086587:34780.779] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1785] Calling previous signal handler at 0x1ce8bb0 for signal#15, nsigs = 1
forrtl: error (78): process killed (SIGTERM)
Image PC Routine Line Source
oifs_43r3_model.e 0000000001CE916B Unknown Unknown Unknown
oifs_43r3_model.e 000000000081FFF1 Unknown Unknown Unknown
oifs_43r3_model.e 0000000001DC9090 Unknown Unknown Unknown
oifs_43r3_model.e 0000000001CCACC1 Unknown Unknown Unknown
oifs_43r3_model.e 0000000000FBCB79 cuadjtq_ 299 cuadjtq.F90
oifs_43r3_model.e 00000000010255EE cloudsc_ 1522 cloudsc.F90
oifs_43r3_model.e 0000000001014D57 cloud_layer_ 131 cloud_layer.F90
oifs_43r3_model.e 0000000000F10C1B callpar_ 1011 callpar.F90
oifs_43r3_model.e 0000000000E4940F ec_phys_ 670 ec_phys.F90
oifs_43r3_model.e 0000000000E3610C ec_phys_drv_ 599 ec_phys_drv.F90
oifs_43r3_model.e 0000000000BFA3D3 gp_model_ 613 gp_model.F90
oifs_43r3_model.e 00000000012E9482 gp_model_heap_ 74 gp_model_heap.F90
oifs_43r3_model.e 0000000000BBC1CE scan2m_ 535 scan2m.F90
oifs_43r3_model.e 000000000057A664 stepo_ 327 stepo.F90
oifs_43r3_model.e 000000000055DEEC cnt4_ 1133 cnt4.F90
oifs_43r3_model.e 00000000005471C9 cnt3_ 267 cnt3.F90
oifs_43r3_model.e 0000000000546412 cnt2_ 88 cnt2.F90
oifs_43r3_model.e 0000000000545E28 cnt1_ 92 cnt1.F90
oifs_43r3_model.e 000000000040708D cnt0_ 146 cnt0.F90
oifs_43r3_model.e 000000000040220F MAIN__ 96 master.F90
oifs_43r3_model.e 00000000004021A2 Unknown Unknown Unknown
oifs_43r3_model.e 0000000001DCA390 Unknown Unknown Unknown
oifs_43r3_model.e 000000000040206E Unknown Unknown Unknown
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1990050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0138
(argv4) batchid: 959
(argv5) wuid: 12175782
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /data/boinc/boinc-client/slots/4
Project directory is: /data/boinc/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782
..mkdir for temp folder for results failed
Copying: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /data/boinc/boinc-client/slots/4/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /data/boinc/boinc-client/slots/4/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_821fdc31beade791a43ccb577b05773d to: /data/boinc/boinc-client/slots/4/oifs_43r3_ps_0138_1990050100_123_959_12175782.zip
Unzipping the namelist zip file: /data/boinc/boinc-client/slots/4/oifs_43r3_ps_0138_1990050100_123_959_12175782.zip
ic_ancil_file: ic_ancil_12175782
ifsdata_file: ifsdata_12175782
climate_data_file: clim_data_12175782
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_02a85f3688ff39aa035908231beb0b9d to: /data/boinc/boinc-client/slots/4/ic_ancil_12175782.zip
Unzipping the IC ancils zip file: /data/boinc/boinc-client/slots/4/ic_ancil_12175782.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_b6492f8f3b8ba179a849a8bedb304dcb to: /data/boinc/boinc-client/slots/4/ifsdata/ifsdata_12175782.zip
Unzipping the ifsdata_zip file: /data/boinc/boinc-client/slots/4/ifsdata/ifsdata_12175782.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /data/boinc/boinc-client/slots/4/159l_2/clim_data_12175782.zip
Unzipping the climate data zip file: /data/boinc/boinc-client/slots/4/159l_2/clim_data_12175782.zip
Checking for progress XML file: /data/boinc/boinc-client/slots/4/progress_file_12175782.xml
Opened progress file ok : /data/boinc/boinc-client/slots/4/progress_file_12175782.xml
-- Model is restarting --
Adjusting last_iter, 1544, to previous model restart step.
Creating progress file: /data/boinc/boinc-client/slots/4/progress_file_12175782.xml
last_cpu_time: 59535
upload_file_number: 64
last_iter: 1535
last_upload: 5529600
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0138_1990050100_123_959_12175782_0_r262242663
The child process has been launched with process id: 23665
Executing the command: /data/boinc/boinc-client/slots/4/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:23665:23665] [20221227:084032:1672130432:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:23665:23665] [20221227:084032:1672130432:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:23665:23665] [20221227:084032:1672130432:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:23665:23665] [20221227:084032:1672130432:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:23665:23665] [20221227:084032:1672130432:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:23665:23665] [20221227:084032:1672130432:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:23665:23665] [20221227:084032:1672130432:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:23665:23665] [20221227:084032:1672130432:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:23665:23665] [20221227:084032:1672130432:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:23665:23665] [20221227:084032:1672130432:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:23665:23665] [20221227:084032:1672130432:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:23665:23665] [20221227:084032:1672130432:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:23665:23665] [20221227:084032:1672130432:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:23665:23665] [20221227:084032:1672130432:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:23665:23665] [20221227:084032:1672130432:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:23665:23665] [20221227:084032:1672130432:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:23665:23665] [20221227:084032:1672130432:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:23665:23665] [20221227:084032:1672130432:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:23665:23665] [20221227:084032:1672130432:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:23665:23665] [20221227:084032:1672130432:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:23665:23665] [20221227:084032:1672130432:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:23665:23665] [20221227:084032:1672130432:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:23665:23665] [20221227:084032:1672130432:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:23665:23665] [20221227:084032:1672130432:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:23665:23665] [20221227:084032:1672130432:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:23665:23665] [20221227:084032:1672130432:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:23665:23665] [20221227:084032:1672130432:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:23665:23665] [20221227:084032:1672130432:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:23665:23665] [20221227:084032:1672130432:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:23665:23665] [20221227:084032:1672130432:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
08:41:52 STEP 1536 H=1536:00 +CPU= 53.163
08:42:22 STEP 1537 H=1537:00 +CPU= 28.781
08:42:52 STEP 1538 H=1538:00 +CPU= 29.712
08:43:39 STEP 1539 H=1539:00 +CPU= 46.050
08:44:10 STEP 1540 H=1540:00 +CPU= 30.407
08:44:39 STEP 1541 H=1541:00 +CPU= 28.409
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
08:48:07 STEP 1542 H=1542:00 +CPU= 47.789
08:48:35 STEP 1543 H=1543:00 +CPU= 27.922
08:49:05 STEP 1544 H=1544:00 +CPU= 29.833
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:03:39 STEP 1545 H=1545:00 +CPU= 45.246
11:04:09 STEP 1546 H=1546:00 +CPU= 30.380
11:04:38 STEP 1547 H=1547:00 +CPU= 28.285
11:05:28 STEP 1548 H=1548:00 +CPU= 49.964
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMGGhq0f+001548
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMSHhq0f+001548
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMUAhq0f+001548
11:05:57 STEP 1549 H=1549:00 +CPU= 28.590
11:06:28 STEP 1550 H=1550:00 +CPU= 30.032
11:07:13 STEP 1551 H=1551:00 +CPU= 45.272
11:07:43 STEP 1552 H=1552:00 +CPU= 28.872
11:08:11 STEP 1553 H=1553:00 +CPU= 28.390
11:08:57 STEP 1554 H=1554:00 +CPU= 45.441
11:09:26 STEP 1555 H=1555:00 +CPU= 28.532
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:11:59 STEP 1556 H=1556:00 +CPU= 29.347
11:12:45 STEP 1557 H=1557:00 +CPU= 45.842
11:13:15 STEP 1558 H=1558:00 +CPU= 29.566
11:13:45 STEP 1559 H=1559:00 +CPU= 29.619
11:14:38 STEP 1560 H=1560:00 +CPU= 53.203
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMGGhq0f+001560
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMSHhq0f+001560
Moving to projects directory: /data/boinc/boinc-client/slots/4/ICMUAhq0f+001560
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782/ICMGGhq0f+001536
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782/ICMSHhq0f+001536
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782/ICMUAhq0f+001536
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782/ICMGGhq0f+001548
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782/ICMSHhq0f+001548
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175782/ICMUAhq0f+001548
Zipping up the intermediate file: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0138_1990050100_123_959_12175782_0_r262242663_64.zip
Uploading the intermediate file: upload_file_64.zip
11:15:05 STEP 1561 H=1561:00 +CPU= 26.042
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:08:19 STEP 1562 H=1562:00 +CPU= 29.017
13:09:05 STEP 1563 H=1563:00 +CPU= 45.389
13:09:34 STEP 1564 H=1564:00 +CPU= 28.889
13:10:03 STEP 1565 H=1565:00 +CPU= 28.556
Abort request received from BOINC client, ending the child process
..Failed, model did not complete successfully
</stderr_txt>
]]>
