<core_client_version>7.16.6</core_client_version>
<![CDATA[
<message>
Disk usage limit exceeded</message>
<stderr_txt>
43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:2220641:2220641] [20230115:094139:1673743299:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:2220641:2220641] [20230115:094139:1673743299:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:2220641:2220641] [20230115:094139:1673743299:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:2220641:2220641] [20230115:094139:1673743299:0.001] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:2220641:2220641] [20230115:094139:1673743299:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:2220641:2220641] [20230115:094139:1673743299:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:2220641:2220641] [20230115:094139:1673743299:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:2220641:2220641] [20230115:094139:1673743299:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:2220641:2220641] [20230115:094139:1673743299:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:2220641:2220641] [20230115:094139:1673743299:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:2220641:2220641] [20230115:094139:1673743299:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:2220641:2220641] [20230115:094139:1673743299:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:2220641:2220641] [20230115:094139:1673743299:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:2220641:2220641] [20230115:094139:1673743299:0.001] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:44:12 STEP 288 H= 288:00 +CPU= 37.010
09:44:33 STEP 289 H= 289:00 +CPU= 20.790
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:47:26 STEP 290 H= 290:00 +CPU= 21.791
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:49:38 STEP 291 H= 291:00 +CPU= 32.437
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:52:10 STEP 292 H= 292:00 +CPU= 20.713
09:52:32 STEP 293 H= 293:00 +CPU= 21.324
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:55:26 STEP 294 H= 294:00 +CPU= 33.193
09:55:48 STEP 295 H= 295:00 +CPU= 21.463
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:58:10 STEP 296 H= 296:00 +CPU= 21.185
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
10:00:56 STEP 297 H= 297:00 +CPU= 33.225
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
10:02:49 STEP 298 H= 298:00 +CPU= 21.782
10:03:10 STEP 299 H= 299:00 +CPU= 20.770
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
10:05:47 STEP 300 H= 300:00 +CPU= 36.003
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+000300
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+000300
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+000300
10:06:07 STEP 301 H= 301:00 +CPU= 20.248
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
10:08:18 STEP 302 H= 302:00 +CPU= 21.016
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
10:10:53 STEP 303 H= 303:00 +CPU= 33.214
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
10:12:44 STEP 304 H= 304:00 +CPU= 20.666
10:13:04 STEP 305 H= 305:00 +CPU= 20.735
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
10:15:19 STEP 306 H= 306:00 +CPU= 33.307
10:15:39 STEP 307 H= 307:00 +CPU= 19.732
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
10:18:30 STEP 308 H= 308:00 +CPU= 20.392
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
10:20:54 STEP 309 H= 309:00 +CPU= 32.354
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
10:22:56 STEP 310 H= 310:00 +CPU= 20.596
10:23:18 STEP 311 H= 311:00 +CPU= 21.685
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
10:25:57 STEP 312 H= 312:00 +CPU= 38.461
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+000312
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+000312
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+000312
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180611/ICMGGhq0f+000288
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180611/ICMSHhq0f+000288
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180611/ICMUAhq0f+000288
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180611/ICMGGhq0f+000300
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180611/ICMSHhq0f+000300
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180611/ICMUAhq0f+000300
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0967_1994050100_123_963_12180611_0_r1078537470_12.zip
Uploading the intermediate file: upload_file_12.zip
10:26:17 STEP 313 H= 313:00 +CPU= 19.329
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
10:28:30 STEP 314 H= 314:00 +CPU= 20.234
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
10:31:04 STEP 315 H= 315:00 +CPU= 33.263
10:31:25 STEP 316 H= 316:00 +CPU= 20.808
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
10:33:36 STEP 317 H= 317:00 +CPU= 20.100
10:34:10 STEP 318 H= 318:00 +CPU= 34.059
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
10:36:42 STEP 319 H= 319:00 +CPU= 20.432
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
10:38:55 STEP 320 H= 320:00 +CPU= 20.777
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
10:40:40 STEP 321 H= 321:00 +CPU= 32.688
10:41:00 STEP 322 H= 322:00 +CPU= 20.743
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
10:43:22 STEP 323 H= 323:00 +CPU= 20.211
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
10:46:00 STEP 324 H= 324:00 +CPU= 36.793
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+000324
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+000324
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+000324
10:46:21 STEP 325 H= 325:00 +CPU= 20.765
10:46:42 STEP 326 H= 326:00 +CPU= 20.863
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
10:49:56 STEP 327 H= 327:00 +CPU= 32.419
10:50:17 STEP 328 H= 328:00 +CPU= 20.874
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
10:52:59 STEP 329 H= 329:00 +CPU= 20.381
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
10:55:23 STEP 330 H= 330:00 +CPU= 32.921
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
10:58:36 STEP 331 H= 331:00 +CPU= 20.801
10:58:58 STEP 332 H= 332:00 +CPU= 21.446
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:02:22 STEP 333 H= 333:00 +CPU= 32.474
11:02:44 STEP 334 H= 334:00 +CPU= 21.226
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:05:07 STEP 335 H= 335:00 +CPU= 21.531
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:08:16 STEP 336 H= 336:00 +CPU= 38.010
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+000336
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+000336
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+000336
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180611/ICMGGhq0f+000312
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180611/ICMSHhq0f+000312
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180611/ICMUAhq0f+000312
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180611/ICMGGhq0f+000324
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180611/ICMSHhq0f+000324
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180611/ICMUAhq0f+000324
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0967_1994050100_123_963_12180611_0_r1078537470_13.zip
Uploading the intermediate file: upload_file_13.zip
11:08:37 STEP 337 H= 337:00 +CPU= 20.534
11:08:58 STEP 338 H= 338:00 +CPU= 21.001
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:12:12 STEP 339 H= 339:00 +CPU= 32.391
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:15:05 STEP 340 H= 340:00 +CPU= 21.287
11:15:26 STEP 341 H= 341:00 +CPU= 20.486
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:18:00 STEP 342 H= 342:00 +CPU= 33.552
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:21:22 STEP 343 H= 343:00 +CPU= 20.372
11:21:43 STEP 344 H= 344:00 +CPU= 21.503
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:25:07 STEP 345 H= 345:00 +CPU= 32.682
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:28:00 STEP 346 H= 346:00 +CPU= 21.110
11:28:21 STEP 347 H= 347:00 +CPU= 20.970
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:31:08 STEP 348 H= 348:00 +CPU= 36.468
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+000348
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+000348
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+000348
11:31:28 STEP 349 H= 349:00 +CPU= 19.216
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:35:11 STEP 350 H= 350:00 +CPU= 21.405
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:38:05 STEP 351 H= 351:00 +CPU= 32.429
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:40:07 STEP 352 H= 352:00 +CPU= 20.629
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:42:29 STEP 353 H= 353:00 +CPU= 20.238
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1994050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0967
(argv4) batchid: 963
(argv5) wuid: 12180611
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/5
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180611
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/5/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/5/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_7cd8752097350b80e38d196ab1efe670 to: /var/lib/boinc-client/slots/5/oifs_43r3_ps_0967_1994050100_123_963_12180611.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/5/oifs_43r3_ps_0967_1994050100_123_963_12180611.zip
ic_ancil_file: ic_ancil_12180611
ifsdata_file: ifsdata_12180611
climate_data_file: clim_data_12180611
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_31ed0a85b8c984eff82e56249722dc89 to: /var/lib/boinc-client/slots/5/ic_ancil_12180611.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/5/ic_ancil_12180611.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_5d19d06e8823d15453a4445b467400d8 to: /var/lib/boinc-client/slots/5/ifsdata/ifsdata_12180611.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/5/ifsdata/ifsdata_12180611.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/5/159l_2/clim_data_12180611.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/5/159l_2/clim_data_12180611.zip
Checking for progress XML file: /var/lib/boinc-client/slots/5/progress_file_12180611.xml
Opened progress file ok : /var/lib/boinc-client/slots/5/progress_file_12180611.xml
-- Model is restarting --
Adjusting last_iter, 354, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/5/progress_file_12180611.xml
last_cpu_time: 10844
upload_file_number: 14
last_iter: 335
last_upload: 1209600
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0967_1994050100_123_963_12180611_0_r1078537470
The child process has been launched with process id: 2239590
Executing the command: /var/lib/boinc-client/slots/5/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:p500:1:1:2239590:2239590] [20230115:114922:1673750962:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:p500:1:1:2239590:2239590] [20230115:114922:1673750962:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:p500:1:1:2239590:2239590] [20230115:114922:1673750962:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:p500:1:1:2239590:2239590] [20230115:114922:1673750962:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:p500:1:1:2239590:2239590] [20230115:114922:1673750962:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:p500:1:1:2239590:2239590] [20230115:114922:1673750962:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:p500:1:1:2239590:2239590] [20230115:114922:1673750962:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:p500:1:1:2239590:2239590] [20230115:114922:1673750962:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:p500:1:1:2239590:2239590] [20230115:114922:1673750962:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:p500:1:1:2239590:2239590] [20230115:114922:1673750962:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:2239590:2239590] [20230115:114922:1673750962:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:p500:1:1:2239590:2239590] [20230115:114922:1673750962:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:p500:1:1:2239590:2239590] [20230115:114922:1673750962:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:p500:1:1:2239590:2239590] [20230115:114922:1673750962:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:2239590:2239590] [20230115:114922:1673750962:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:2239590:2239590] [20230115:114922:1673750962:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:2239590:2239590] [20230115:114922:1673750962:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:2239590:2239590] [20230115:114922:1673750962:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:2239590:2239590] [20230115:114922:1673750962:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:2239590:2239590] [20230115:114922:1673750962:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:2239590:2239590] [20230115:114922:1673750962:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:2239590:2239590] [20230115:114922:1673750962:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:2239590:2239590] [20230115:114922:1673750962:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:2239590:2239590] [20230115:114922:1673750962:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:2239590:2239590] [20230115:114922:1673750962:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:2239590:2239590] [20230115:114922:1673750962:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:2239590:2239590] [20230115:114922:1673750962:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:2239590:2239590] [20230115:114922:1673750962:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:2239590:2239590] [20230115:114922:1673750962:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:2239590:2239590] [20230115:114922:1673750962:0.001] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:52:48 STEP 336 H= 336:00 +CPU= 36.968
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:55:11 STEP 337 H= 337:00 +CPU= 21.103
11:55:32 STEP 338 H= 338:00 +CPU= 20.981
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:57:55 STEP 339 H= 339:00 +CPU= 32.350
11:58:16 STEP 340 H= 340:00 +CPU= 20.595
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:01:08 STEP 341 H= 341:00 +CPU= 20.408
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:05:23 STEP 342 H= 342:00 +CPU= 33.700
12:05:45 STEP 343 H= 343:00 +CPU= 21.668
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:09:16 STEP 344 H= 344:00 +CPU= 21.030
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:13:01 STEP 345 H= 345:00 +CPU= 32.839
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:16:14 STEP 346 H= 346:00 +CPU= 21.714
12:16:36 STEP 347 H= 347:00 +CPU= 21.356
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:19:55 STEP 348 H= 348:00 +CPU= 36.491
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+000348
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+000348
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+000348
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:23:17 STEP 349 H= 349:00 +CPU= 20.651
12:23:38 STEP 350 H= 350:00 +CPU= 20.955
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:27:22 STEP 351 H= 351:00 +CPU= 32.378
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:30:25 STEP 352 H= 352:00 +CPU= 21.054
12:30:45 STEP 353 H= 353:00 +CPU= 20.172
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:34:20 STEP 354 H= 354:00 +CPU= 34.124
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:36:21 STEP 355 H= 355:00 +CPU= 20.224
12:36:42 STEP 356 H= 356:00 +CPU= 20.556
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:22:33 STEP 357 H= 357:00 +CPU= 32.336
22:22:54 STEP 358 H= 358:00 +CPU= 20.866
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:26:35 STEP 359 H= 359:00 +CPU= 20.534
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:29:24 STEP 360 H= 360:00 +CPU= 37.743
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1994050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0967
(argv4) batchid: 963
(argv5) wuid: 12180611
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/5
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180611
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/5/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/5/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_7cd8752097350b80e38d196ab1efe670 to: /var/lib/boinc-client/slots/5/oifs_43r3_ps_0967_1994050100_123_963_12180611.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/5/oifs_43r3_ps_0967_1994050100_123_963_12180611.zip
ic_ancil_file: ic_ancil_12180611
ifsdata_file: ifsdata_12180611
climate_data_file: clim_data_12180611
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_31ed0a85b8c984eff82e56249722dc89 to: /var/lib/boinc-client/slots/5/ic_ancil_12180611.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/5/ic_ancil_12180611.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_5d19d06e8823d15453a4445b467400d8 to: /var/lib/boinc-client/slots/5/ifsdata/ifsdata_12180611.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/5/ifsdata/ifsdata_12180611.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/5/159l_2/clim_data_12180611.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/5/159l_2/clim_data_12180611.zip
Checking for progress XML file: /var/lib/boinc-client/slots/5/progress_file_12180611.xml
Opened progress file ok : /var/lib/boinc-client/slots/5/progress_file_12180611.xml
-- Model is restarting --
Adjusting last_iter, 360, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/5/progress_file_12180611.xml
last_cpu_time: 11486
upload_file_number: 14
last_iter: 359
last_upload: 1209600
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0967_1994050100_123_963_12180611_0_r1078537470
The child process has been launched with process id: 2360634
Executing the command: /var/lib/boinc-client/slots/5/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:p500:1:1:2360634:2360634] [20230115:223157:1673789517:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:p500:1:1:2360634:2360634] [20230115:223157:1673789517:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:p500:1:1:2360634:2360634] [20230115:223157:1673789517:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:p500:1:1:2360634:2360634] [20230115:223157:1673789517:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:p500:1:1:2360634:2360634] [20230115:223157:1673789517:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:p500:1:1:2360634:2360634] [20230115:223157:1673789517:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:p500:1:1:2360634:2360634] [20230115:223157:1673789517:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:p500:1:1:2360634:2360634] [20230115:223157:1673789517:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:p500:1:1:2360634:2360634] [20230115:223157:1673789517:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:p500:1:1:2360634:2360634] [20230115:223157:1673789517:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:2360634:2360634] [20230115:223157:1673789517:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:p500:1:1:2360634:2360634] [20230115:223157:1673789517:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:p500:1:1:2360634:2360634] [20230115:223157:1673789517:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:p500:1:1:2360634:2360634] [20230115:223157:1673789517:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:2360634:2360634] [20230115:223157:1673789517:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:2360634:2360634] [20230115:223157:1673789517:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:2360634:2360634] [20230115:223157:1673789517:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:2360634:2360634] [20230115:223157:1673789517:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:2360634:2360634] [20230115:223157:1673789517:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:2360634:2360634] [20230115:223157:1673789517:0.001] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:2360634:2360634] [20230115:223157:1673789517:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:2360634:2360634] [20230115:223157:1673789517:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:2360634:2360634] [20230115:223157:1673789517:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:2360634:2360634] [20230115:223157:1673789517:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:2360634:2360634] [20230115:223157:1673789517:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:2360634:2360634] [20230115:223157:1673789517:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:2360634:2360634] [20230115:223157:1673789517:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:2360634:2360634] [20230115:223157:1673789517:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:2360634:2360634] [20230115:223157:1673789517:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:2360634:2360634] [20230115:223157:1673789517:0.001] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:34:58 STEP 360 H= 360:00 +CPU= 36.166
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+000360
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+000360
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+000360
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180611/ICMGGhq0f+000336
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180611/ICMSHhq0f+000336
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180611/ICMUAhq0f+000336
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180611/ICMGGhq0f+000348
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180611/ICMSHhq0f+000348
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180611/ICMUAhq0f+000348
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0967_1994050100_123_963_12180611_0_r1078537470_14.zip
Uploading the intermediate file: upload_file_14.zip
22:35:16 STEP 361 H= 361:00 +CPU= 18.007
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:37:21 STEP 362 H= 362:00 +CPU= 20.109
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:39:54 STEP 363 H= 363:00 +CPU= 31.908
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:41:46 STEP 364 H= 364:00 +CPU= 20.408
22:42:05 STEP 365 H= 365:00 +CPU= 19.371
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:44:59 STEP 366 H= 366:00 +CPU= 32.695
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:47:00 STEP 367 H= 367:00 +CPU= 20.017
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:49:02 STEP 368 H= 368:00 +CPU= 21.103
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:51:15 STEP 369 H= 369:00 +CPU= 31.443
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:53:38 STEP 370 H= 370:00 +CPU= 21.244
22:53:59 STEP 371 H= 371:00 +CPU= 20.084
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:56:25 STEP 372 H= 372:00 +CPU= 35.065
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+000372
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+000372
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+000372
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:58:46 STEP 373 H= 373:00 +CPU= 20.553
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:00:48 STEP 374 H= 374:00 +CPU= 21.521
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:03:00 STEP 375 H= 375:00 +CPU= 31.795
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:05:11 STEP 376 H= 376:00 +CPU= 20.340
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:07:04 STEP 377 H= 377:00 +CPU= 20.243
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:09:30 STEP 378 H= 378:00 +CPU= 34.575
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:11:22 STEP 379 H= 379:00 +CPU= 20.279
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:13:27 STEP 380 H= 380:00 +CPU= 22.368
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:15:31 STEP 381 H= 381:00 +CPU= 33.290
23:15:52 STEP 382 H= 382:00 +CPU= 20.568
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:18:24 STEP 383 H= 383:00 +CPU= 21.704
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:20:43 STEP 384 H= 384:00 +CPU= 37.910
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+000384
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+000384
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+000384
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180611/ICMGGhq0f+000360
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180611/ICMSHhq0f+000360
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180611/ICMUAhq0f+000360
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180611/ICMGGhq0f+000372
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180611/ICMSHhq0f+000372
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180611/ICMUAhq0f+000372
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0967_1994050100_123_963_12180611_0_r1078537470_15.zip
Uploading the intermediate file: upload_file_15.zip
23:21:03 STEP 385 H= 385:00 +CPU= 19.935
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:23:23 STEP 386 H= 386:00 +CPU= 19.766
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:25:56 STEP 387 H= 387:00 +CPU= 31.843
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:28:29 STEP 388 H= 388:00 +CPU= 20.976
23:28:50 STEP 389 H= 389:00 +CPU= 20.952
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:31:33 STEP 390 H= 390:00 +CPU= 32.552
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:33:34 STEP 391 H= 391:00 +CPU= 19.945
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:35:57 STEP 392 H= 392:00 +CPU= 21.214
23:36:29 STEP 393 H= 393:00 +CPU= 32.410
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:38:42 STEP 394 H= 394:00 +CPU= 21.501
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:40:55 STEP 395 H= 395:00 +CPU= 21.718
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:43:23 STEP 396 H= 396:00 +CPU= 36.612
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+000396
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+000396
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+000396
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:45:14 STEP 397 H= 397:00 +CPU= 19.839
23:45:34 STEP 398 H= 398:00 +CPU= 20.649
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:48:28 STEP 399 H= 399:00 +CPU= 32.577
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:50:10 STEP 400 H= 400:00 +CPU= 21.164
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:52:13 STEP 401 H= 401:00 +CPU= 20.971
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:54:19 STEP 402 H= 402:00 +CPU= 33.675
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:56:30 STEP 403 H= 403:00 +CPU= 19.773
23:56:51 STEP 404 H= 404:00 +CPU= 21.177
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:59:14 STEP 405 H= 405:00 +CPU= 31.249
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:01:35 STEP 406 H= 406:00 +CPU= 19.939
00:01:55 STEP 407 H= 407:00 +CPU= 20.590
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:05:04 STEP 408 H= 408:00 +CPU= 37.102
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+000408
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+000408
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+000408
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180611/ICMGGhq0f+000384
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180611/ICMSHhq0f+000384
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180611/ICMUAhq0f+000384
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180611/ICMGGhq0f+000396
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180611/ICMSHhq0f+000396
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180611/ICMUAhq0f+000396
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0967_1994050100_123_963_12180611_0_r1078537470_16.zip
Uploading the intermediate file: upload_file_16.zip
00:05:24 STEP 409 H= 409:00 +CPU= 19.514
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:07:56 STEP 410 H= 410:00 +CPU= 20.564
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:10:49 STEP 411 H= 411:00 +CPU= 31.536
00:11:10 STEP 412 H= 412:00 +CPU= 20.575
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:13:42 STEP 413 H= 413:00 +CPU= 19.836
00:14:14 STEP 414 H= 414:00 +CPU= 32.394
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:16:34 STEP 415 H= 415:00 +CPU= 19.490
00:16:54 STEP 416 H= 416:00 +CPU= 20.586
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:19:37 STEP 417 H= 417:00 +CPU= 31.150
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:21:39 STEP 418 H= 418:00 +CPU= 20.391
00:21:59 STEP 419 H= 419:00 +CPU= 20.132
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:24:17 STEP 420 H= 420:00 +CPU= 35.025
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+000420
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+000420
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+000420
00:24:36 STEP 421 H= 421:00 +CPU= 19.438
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:27:07 STEP 422 H= 422:00 +CPU= 20.100
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:29:10 STEP 423 H= 423:00 +CPU= 31.889
00:29:30 STEP 424 H= 424:00 +CPU= 20.014
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:31:31 STEP 425 H= 425:00 +CPU= 19.656
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:33:54 STEP 426 H= 426:00 +CPU= 31.872
00:34:14 STEP 427 H= 427:00 +CPU= 19.582
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:36:05 STEP 428 H= 428:00 +CPU= 20.776
00:36:36 STEP 429 H= 429:00 +CPU= 31.511
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:39:26 STEP 430 H= 430:00 +CPU= 19.613
00:39:47 STEP 431 H= 431:00 +CPU= 20.627
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:43:56 STEP 432 H= 432:00 +CPU= 37.166
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+000432
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+000432
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+000432
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180611/ICMGGhq0f+000408
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180611/ICMSHhq0f+000408
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180611/ICMUAhq0f+000408
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180611/ICMGGhq0f+000420
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180611/ICMSHhq0f+000420
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180611/ICMUAhq0f+000420
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0967_1994050100_123_963_12180611_0_r1078537470_17.zip
Uploading the intermediate file: upload_file_17.zip
00:44:16 STEP 433 H= 433:00 +CPU= 19.558
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:46:25 STEP 434 H= 434:00 +CPU= 19.887
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:48:38 STEP 435 H= 435:00 +CPU= 31.276
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:50:50 STEP 436 H= 436:00 +CPU= 20.783
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1994050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0967
(argv4) batchid: 963
(argv5) wuid: 12180611
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/5
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180611
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/5/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/5/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_7cd8752097350b80e38d196ab1efe670 to: /var/lib/boinc-client/slots/5/oifs_43r3_ps_0967_1994050100_123_963_12180611.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/5/oifs_43r3_ps_0967_1994050100_123_963_12180611.zip
ic_ancil_file: ic_ancil_12180611
ifsdata_file: ifsdata_12180611
climate_data_file: clim_data_12180611
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_31ed0a85b8c984eff82e56249722dc89 to: /var/lib/boinc-client/slots/5/ic_ancil_12180611.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/5/ic_ancil_12180611.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_5d19d06e8823d15453a4445b467400d8 to: /var/lib/boinc-client/slots/5/ifsdata/ifsdata_12180611.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/5/ifsdata/ifsdata_12180611.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/5/159l_2/clim_data_12180611.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/5/159l_2/clim_data_12180611.zip
Checking for progress XML file: /var/lib/boinc-client/slots/5/progress_file_12180611.xml
Opened progress file ok : /var/lib/boinc-client/slots/5/progress_file_12180611.xml
-- Model is restarting --
Adjusting last_iter, 437, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/5/progress_file_12180611.xml
last_cpu_time: 13395
upload_file_number: 18
last_iter: 431
last_upload: 1555200
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0967_1994050100_123_963_12180611_0_r1078537470
The child process has been launched with process id: 2380304
Executing the command: /var/lib/boinc-client/slots/5/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:p500:1:1:2380304:2380304] [20230116:005223:1673797943:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:p500:1:1:2380304:2380304] [20230116:005223:1673797943:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:p500:1:1:2380304:2380304] [20230116:005223:1673797943:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:p500:1:1:2380304:2380304] [20230116:005223:1673797943:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:p500:1:1:2380304:2380304] [20230116:005223:1673797943:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:p500:1:1:2380304:2380304] [20230116:005223:1673797943:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:p500:1:1:2380304:2380304] [20230116:005223:1673797943:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:p500:1:1:2380304:2380304] [20230116:005223:1673797943:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:p500:1:1:2380304:2380304] [20230116:005223:1673797943:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:p500:1:1:2380304:2380304] [20230116:005223:1673797943:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:2380304:2380304] [20230116:005223:1673797943:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:p500:1:1:2380304:2380304] [20230116:005223:1673797943:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:p500:1:1:2380304:2380304] [20230116:005223:1673797943:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:p500:1:1:2380304:2380304] [20230116:005223:1673797943:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:2380304:2380304] [20230116:005223:1673797943:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:2380304:2380304] [20230116:005223:1673797943:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:2380304:2380304] [20230116:005223:1673797943:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:2380304:2380304] [20230116:005223:1673797943:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:2380304:2380304] [20230116:005223:1673797943:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:2380304:2380304] [20230116:005223:1673797943:0.001] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:2380304:2380304] [20230116:005223:1673797943:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:2380304:2380304] [20230116:005223:1673797943:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:2380304:2380304] [20230116:005223:1673797943:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:2380304:2380304] [20230116:005223:1673797943:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:2380304:2380304] [20230116:005223:1673797943:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:2380304:2380304] [20230116:005223:1673797943:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:2380304:2380304] [20230116:005223:1673797943:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:2380304:2380304] [20230116:005223:1673797943:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:2380304:2380304] [20230116:005223:1673797943:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:2380304:2380304] [20230116:005223:1673797943:0.001] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
00:53:01 STEP 432 H= 432:00 +CPU= 35.474
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:55:22 STEP 433 H= 433:00 +CPU= 19.651
00:55:42 STEP 434 H= 434:00 +CPU= 20.234
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:58:25 STEP 435 H= 435:00 +CPU= 31.842
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:00:27 STEP 436 H= 436:00 +CPU= 20.477
01:00:46 STEP 437 H= 437:00 +CPU= 19.652
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:03:41 STEP 438 H= 438:00 +CPU= 32.171
01:04:00 STEP 439 H= 439:00 +CPU= 19.459
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:06:21 STEP 440 H= 440:00 +CPU= 20.059
01:06:53 STEP 441 H= 441:00 +CPU= 31.347
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:09:53 STEP 442 H= 442:00 +CPU= 20.381
01:10:13 STEP 443 H= 443:00 +CPU= 19.566
01:10:48 STEP 444 H= 444:00 +CPU= 34.927
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+000444
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+000444
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+000444
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:13:20 STEP 445 H= 445:00 +CPU= 20.283
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:14:51 STEP 446 H= 446:00 +CPU= 20.847
01:15:24 STEP 447 H= 447:00 +CPU= 31.933
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:18:25 STEP 448 H= 448:00 +CPU= 20.391
01:18:45 STEP 449 H= 449:00 +CPU= 19.883
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:21:30 STEP 450 H= 450:00 +CPU= 32.319
01:21:49 STEP 451 H= 451:00 +CPU= 19.697
01:22:09 STEP 452 H= 452:00 +CPU= 19.958
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:25:01 STEP 453 H= 453:00 +CPU= 31.210
01:25:21 STEP 454 H= 454:00 +CPU= 20.018
01:25:41 STEP 455 H= 455:00 +CPU= 20.313
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:28:18 STEP 456 H= 456:00 +CPU= 36.235
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+000456
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+000456
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+000456
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180611/ICMGGhq0f+000432
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180611/ICMSHhq0f+000432
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180611/ICMUAhq0f+000432
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180611/ICMGGhq0f+000444
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180611/ICMSHhq0f+000444
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180611/ICMUAhq0f+000444
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0967_1994050100_123_963_12180611_0_r1078537470_18.zip
Uploading the intermediate file: upload_file_18.zip
01:28:37 STEP 457 H= 457:00 +CPU= 18.874
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:31:31 STEP 458 H= 458:00 +CPU= 17.991
Abort request received from BOINC client, ending the child process
..Failed, model did not complete successfully
</stderr_txt>
]]>
