<core_client_version>7.16.6</core_client_version>
<![CDATA[
<message>
Disk usage limit exceeded</message>
<stderr_txt>
the child process
13:26:32 STEP 437 H= 437:00 +CPU= 21.011
13:27:05 STEP 438 H= 438:00 +CPU= 32.759
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:28:37 STEP 439 H= 439:00 +CPU= 20.689
13:28:58 STEP 440 H= 440:00 +CPU= 21.002
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:30:53 STEP 441 H= 441:00 +CPU= 33.394
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:32:15 STEP 442 H= 442:00 +CPU= 20.887
13:32:36 STEP 443 H= 443:00 +CPU= 20.842
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:34:23 STEP 444 H= 444:00 +CPU= 35.910
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+000444
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+000444
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+000444
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:35:55 STEP 445 H= 445:00 +CPU= 21.217
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:37:18 STEP 446 H= 446:00 +CPU= 21.198
13:37:50 STEP 447 H= 447:00 +CPU= 32.411
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:39:22 STEP 448 H= 448:00 +CPU= 20.899
13:39:43 STEP 449 H= 449:00 +CPU= 20.072
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:41:27 STEP 450 H= 450:00 +CPU= 33.642
13:41:47 STEP 451 H= 451:00 +CPU= 19.887
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:43:29 STEP 452 H= 452:00 +CPU= 21.208
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:45:53 STEP 453 H= 453:00 +CPU= 32.633
13:46:14 STEP 454 H= 454:00 +CPU= 21.642
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:47:57 STEP 455 H= 455:00 +CPU= 21.248
13:48:35 STEP 456 H= 456:00 +CPU= 38.189
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+000456
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+000456
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+000456
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198518/ICMGGhq0f+000432
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198518/ICMSHhq0f+000432
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198518/ICMUAhq0f+000432
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198518/ICMGGhq0f+000444
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198518/ICMSHhq0f+000444
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198518/ICMUAhq0f+000444
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0874_2012050100_123_981_12198518_0_r1010603732_18.zip
Uploading the intermediate file: upload_file_18.zip
13:50:07 STEP 457 H= 457:00 +CPU= 20.867
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:52:00 STEP 458 H= 458:00 +CPU= 21.326
13:52:34 STEP 459 H= 459:00 +CPU= 33.674
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:54:17 STEP 460 H= 460:00 +CPU= 21.800
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:55:48 STEP 461 H= 461:00 +CPU= 20.031
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:57:32 STEP 462 H= 462:00 +CPU= 33.186
13:57:54 STEP 463 H= 463:00 +CPU= 21.220
13:58:15 STEP 464 H= 464:00 +CPU= 21.327
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:00:08 STEP 465 H= 465:00 +CPU= 32.627
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:01:31 STEP 466 H= 466:00 +CPU= 21.583
14:01:51 STEP 467 H= 467:00 +CPU= 20.180
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:03:37 STEP 468 H= 468:00 +CPU= 36.359
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+000468
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+000468
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+000468
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
[EC_DRHOOK:p500:1:1:3285629:3285629] [20230119:153853:1674110333:8366.431] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1538] Received signal#15 (SIGTERM) :: 2550MB (heap), 4418MB (maxrss), 0MB (maxstack), 0 (paging), nsigs = 1
[EC_DRHOOK:p500:1:1:3285629:3285629] [20230119:153853:1674110333:8366.431] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1542] Also activating Harakiri-alarm (SIGALRM=14) to expire after 500s elapsed to prevent hangs, nsigs = 1
[EC_DRHOOK:p500:1:1:3285629:3285629] [20230119:153853:1674110333:8366.431] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1544] Harakiri signal handler 'signal_harakiri' for signal#14 (SIGALRM) installed at 0x81f3c0 (old at (nil))
[EC_DRHOOK:p500:1:1:3285629:3285629] [20230119:153853:1674110333:8366.431] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1617] Signal#15 was caused by unrecognized si_code [memaddr=0x1], nsigs = 1
[EC_DRHOOK:p500:1:1:3285629:3285629] [20230119:153853:1674110333:8366.431] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1686] Starting DrHook backtrace for signal#15, nsigs = 1
[EC_DRHOOK:p500:1:1:3285629:3285629] [20230119:153853:1674110333:8366.431] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3843] 2598 MB (maxheap), 4418 MB (maxrss), 0 MB (maxstack)
[EC_DRHOOK:p500:1:1:3285629:3285629] [20230119:153853:1674110333:8366.431] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : MASTER
[EC_DRHOOK:p500:1:1:3285629:3285629] [20230119:153853:1674110333:8366.433] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : CNT0
[EC_DRHOOK:p500:1:1:3285629:3285629] [20230119:153853:1674110333:8366.433] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : CNT1
[EC_DRHOOK:p500:1:1:3285629:3285629] [20230119:153853:1674110333:8366.433] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : CNT2
[EC_DRHOOK:p500:1:1:3285629:3285629] [20230119:153853:1674110333:8366.433] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : CNT3
[EC_DRHOOK:p500:1:1:3285629:3285629] [20230119:153853:1674110333:8366.433] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : CNT4
[EC_DRHOOK:p500:1:1:3285629:3285629] [20230119:153853:1674110333:8366.433] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : WVCOUPLE
[EC_DRHOOK:p500:1:1:3285629:3285629] [20230119:153853:1674110333:8366.433] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : WAVEMDL
[EC_DRHOOK:p500:1:1:3285629:3285629] [20230119:153853:1674110333:8366.433] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : WAMODEL
[EC_DRHOOK:p500:1:1:3285629:3285629] [20230119:153853:1674110333:8366.433] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : >OMP-WAMODEL 2 (1431)
[EC_DRHOOK:p500:1:1:3285629:3285629] [20230119:153853:1674110333:8366.433] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : IMPLSCH
[EC_DRHOOK:p500:1:1:3285629:3285629] [20230119:153853:1674110333:8366.433] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : STRESSO
[EC_DRHOOK:p500:1:1:3285629:3285629] [20230119:153854:1674110334:8367.433] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1734] DrHook backtrace done for signal#15, nsigs = 1
[EC_DRHOOK:p500:1:1:3285629:3285629] [20230119:153854:1674110334:8367.433] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1785] Calling previous signal handler at 0x1ce8bb0 for signal#15, nsigs = 1
forrtl: error (78): process killed (SIGTERM)
Image PC Routine Line Source
oifs_43r3_model.e 0000000001CE916B Unknown Unknown Unknown
oifs_43r3_model.e 000000000081FFF1 Unknown Unknown Unknown
oifs_43r3_model.e 0000000001DC9090 Unknown Unknown Unknown
oifs_43r3_model.e 0000000001CBC54D Unknown Unknown Unknown
oifs_43r3_model.e 0000000001A23ADA stresso_ 234 stresso.F
oifs_43r3_model.e 0000000001A31139 implsch_ 268 implsch.F
oifs_43r3_model.e 000000000168CBD7 wamodel_ 1008 wamodel.F
oifs_43r3_model.e 0000000000872295 wavemdl_ 584 wavemdl.F
oifs_43r3_model.e 00000000007E0165 wvcouple_ 260 wvcouple.F90
oifs_43r3_model.e 000000000055E4AD cnt4_ 1283 cnt4.F90
oifs_43r3_model.e 00000000005471C9 cnt3_ 267 cnt3.F90
oifs_43r3_model.e 0000000000546412 cnt2_ 88 cnt2.F90
oifs_43r3_model.e 0000000000545E28 cnt1_ 92 cnt1.F90
oifs_43r3_model.e 000000000040708D cnt0_ 146 cnt0.F90
oifs_43r3_model.e 000000000040220F MAIN__ 96 master.F90
oifs_43r3_model.e 00000000004021A2 Unknown Unknown Unknown
oifs_43r3_model.e 0000000001DCA390 Unknown Unknown Unknown
oifs_43r3_model.e 000000000040206E Unknown Unknown Unknown
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2012050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0874
(argv4) batchid: 981
(argv5) wuid: 12198518
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/8
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198518
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/8/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/8/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_488773654e6c1731700bac56eeecfeba to: /var/lib/boinc-client/slots/8/oifs_43r3_ps_0874_2012050100_123_981_12198518.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/8/oifs_43r3_ps_0874_2012050100_123_981_12198518.zip
ic_ancil_file: ic_ancil_12198518
ifsdata_file: ifsdata_12198518
climate_data_file: clim_data_12198518
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_d65eb557e702e71b22e596e7fd4d7927 to: /var/lib/boinc-client/slots/8/ic_ancil_12198518.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/8/ic_ancil_12198518.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_53f9b6dce0510c93ae2a4dd3268755ab to: /var/lib/boinc-client/slots/8/ifsdata/ifsdata_12198518.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/8/ifsdata/ifsdata_12198518.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/8/159l_2/clim_data_12198518.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/8/159l_2/clim_data_12198518.zip
Checking for progress XML file: /var/lib/boinc-client/slots/8/progress_file_12198518.xml
Opened progress file ok : /var/lib/boinc-client/slots/8/progress_file_12198518.xml
-- Model is restarting --
Adjusting last_iter, 469, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/8/progress_file_12198518.xml
last_cpu_time: 13792
upload_file_number: 19
last_iter: 455
last_upload: 1641600
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0874_2012050100_123_981_12198518_0_r1010603732
The child process has been launched with process id: 52431
Executing the command: /var/lib/boinc-client/slots/8/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:p500:1:1:52431:52431] [20230119:195022:1674125422:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:p500:1:1:52431:52431] [20230119:195022:1674125422:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:p500:1:1:52431:52431] [20230119:195022:1674125422:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:p500:1:1:52431:52431] [20230119:195022:1674125422:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:p500:1:1:52431:52431] [20230119:195022:1674125422:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:p500:1:1:52431:52431] [20230119:195022:1674125422:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:p500:1:1:52431:52431] [20230119:195022:1674125422:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:p500:1:1:52431:52431] [20230119:195022:1674125422:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:p500:1:1:52431:52431] [20230119:195022:1674125422:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:p500:1:1:52431:52431] [20230119:195022:1674125422:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:52431:52431] [20230119:195022:1674125422:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:p500:1:1:52431:52431] [20230119:195022:1674125422:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:p500:1:1:52431:52431] [20230119:195022:1674125422:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:p500:1:1:52431:52431] [20230119:195022:1674125422:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:52431:52431] [20230119:195022:1674125422:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:52431:52431] [20230119:195022:1674125422:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:52431:52431] [20230119:195022:1674125422:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:52431:52431] [20230119:195022:1674125422:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:52431:52431] [20230119:195022:1674125422:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:52431:52431] [20230119:195022:1674125422:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:52431:52431] [20230119:195022:1674125422:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:52431:52431] [20230119:195022:1674125422:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:52431:52431] [20230119:195022:1674125422:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:52431:52431] [20230119:195022:1674125422:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:52431:52431] [20230119:195022:1674125422:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:52431:52431] [20230119:195022:1674125422:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:52431:52431] [20230119:195022:1674125422:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:52431:52431] [20230119:195022:1674125422:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:52431:52431] [20230119:195022:1674125422:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:52431:52431] [20230119:195022:1674125422:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:28:23 STEP 456 H= 456:00 +CPU= 39.333
20:28:46 STEP 457 H= 457:00 +CPU= 22.919
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:31:32 STEP 458 H= 458:00 +CPU= 23.188
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:47:59 STEP 459 H= 459:00 +CPU= 34.619
20:48:21 STEP 460 H= 460:00 +CPU= 21.432
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:50:33 STEP 461 H= 461:00 +CPU= 20.986
20:51:09 STEP 462 H= 462:00 +CPU= 35.718
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:12:25 STEP 463 H= 463:00 +CPU= 21.262
21:12:45 STEP 464 H= 464:00 +CPU= 20.421
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:16:10 STEP 465 H= 465:00 +CPU= 31.055
21:16:32 STEP 466 H= 466:00 +CPU= 21.753
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:18:04 STEP 467 H= 467:00 +CPU= 20.318
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:19:39 STEP 468 H= 468:00 +CPU= 35.228
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+000468
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+000468
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+000468
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:21:01 STEP 469 H= 469:00 +CPU= 20.424
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:22:44 STEP 470 H= 470:00 +CPU= 20.932
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:24:18 STEP 471 H= 471:00 +CPU= 32.841
21:24:39 STEP 472 H= 472:00 +CPU= 20.993
21:24:58 STEP 473 H= 473:00 +CPU= 19.723
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:26:52 STEP 474 H= 474:00 +CPU= 32.308
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:28:44 STEP 475 H= 475:00 +CPU= 20.516
21:29:05 STEP 476 H= 476:00 +CPU= 20.938
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:30:58 STEP 477 H= 477:00 +CPU= 31.578
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:32:29 STEP 478 H= 478:00 +CPU= 20.734
21:32:51 STEP 479 H= 479:00 +CPU= 21.642
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:35:49 STEP 480 H= 480:00 +CPU= 38.094
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+000480
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+000480
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+000480
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198518/ICMGGhq0f+000456
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198518/ICMSHhq0f+000456
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198518/ICMUAhq0f+000456
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198518/ICMGGhq0f+000468
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198518/ICMSHhq0f+000468
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198518/ICMUAhq0f+000468
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0874_2012050100_123_981_12198518_0_r1010603732_19.zip
Uploading the intermediate file: upload_file_19.zip
21:36:10 STEP 481 H= 481:00 +CPU= 20.428
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:37:40 STEP 482 H= 482:00 +CPU= 20.457
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:39:43 STEP 483 H= 483:00 +CPU= 31.056
21:40:04 STEP 484 H= 484:00 +CPU= 21.063
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:41:34 STEP 485 H= 485:00 +CPU= 20.024
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:43:27 STEP 486 H= 486:00 +CPU= 32.383
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:44:48 STEP 487 H= 487:00 +CPU= 20.315
21:45:09 STEP 488 H= 488:00 +CPU= 20.832
21:45:39 STEP 489 H= 489:00 +CPU= 30.624
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:47:31 STEP 490 H= 490:00 +CPU= 20.648
21:47:51 STEP 491 H= 491:00 +CPU= 20.395
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:49:37 STEP 492 H= 492:00 +CPU= 34.440
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+000492
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+000492
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+000492
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:51:08 STEP 493 H= 493:00 +CPU= 19.661
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2012050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0874
(argv4) batchid: 981
(argv5) wuid: 12198518
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/8
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198518
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/8/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/8/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_488773654e6c1731700bac56eeecfeba to: /var/lib/boinc-client/slots/8/oifs_43r3_ps_0874_2012050100_123_981_12198518.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/8/oifs_43r3_ps_0874_2012050100_123_981_12198518.zip
ic_ancil_file: ic_ancil_12198518
ifsdata_file: ifsdata_12198518
climate_data_file: clim_data_12198518
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_d65eb557e702e71b22e596e7fd4d7927 to: /var/lib/boinc-client/slots/8/ic_ancil_12198518.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/8/ic_ancil_12198518.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_53f9b6dce0510c93ae2a4dd3268755ab to: /var/lib/boinc-client/slots/8/ifsdata/ifsdata_12198518.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/8/ifsdata/ifsdata_12198518.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/8/159l_2/clim_data_12198518.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/8/159l_2/clim_data_12198518.zip
Checking for progress XML file: /var/lib/boinc-client/slots/8/progress_file_12198518.xml
Opened progress file ok : /var/lib/boinc-client/slots/8/progress_file_12198518.xml
-- Model is restarting --
Adjusting last_iter, 494, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/8/progress_file_12198518.xml
last_cpu_time: 14765
upload_file_number: 20
last_iter: 479
last_upload: 1728000
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0874_2012050100_123_981_12198518_0_r1010603732
The child process has been launched with process id: 73449
Executing the command: /var/lib/boinc-client/slots/8/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:p500:1:1:73449:73449] [20230119:215237:1674132757:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:p500:1:1:73449:73449] [20230119:215237:1674132757:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:p500:1:1:73449:73449] [20230119:215237:1674132757:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:p500:1:1:73449:73449] [20230119:215237:1674132757:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:p500:1:1:73449:73449] [20230119:215237:1674132757:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:p500:1:1:73449:73449] [20230119:215237:1674132757:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:p500:1:1:73449:73449] [20230119:215237:1674132757:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:p500:1:1:73449:73449] [20230119:215237:1674132757:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:p500:1:1:73449:73449] [20230119:215237:1674132757:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:p500:1:1:73449:73449] [20230119:215237:1674132757:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:73449:73449] [20230119:215237:1674132757:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:p500:1:1:73449:73449] [20230119:215237:1674132757:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:p500:1:1:73449:73449] [20230119:215237:1674132757:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:p500:1:1:73449:73449] [20230119:215237:1674132757:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:73449:73449] [20230119:215237:1674132757:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:73449:73449] [20230119:215237:1674132757:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:73449:73449] [20230119:215237:1674132757:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:73449:73449] [20230119:215237:1674132757:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:73449:73449] [20230119:215237:1674132757:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:73449:73449] [20230119:215237:1674132757:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:73449:73449] [20230119:215237:1674132757:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:73449:73449] [20230119:215237:1674132757:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:73449:73449] [20230119:215237:1674132757:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:73449:73449] [20230119:215237:1674132757:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:73449:73449] [20230119:215237:1674132757:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:73449:73449] [20230119:215237:1674132757:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:73449:73449] [20230119:215237:1674132757:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:73449:73449] [20230119:215237:1674132757:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:73449:73449] [20230119:215237:1674132757:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:73449:73449] [20230119:215237:1674132757:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:54:25 STEP 480 H= 480:00 +CPU= 35.574
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:55:55 STEP 481 H= 481:00 +CPU= 20.366
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:57:07 STEP 482 H= 482:00 +CPU= 20.888
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:58:41 STEP 483 H= 483:00 +CPU= 32.112
21:59:02 STEP 484 H= 484:00 +CPU= 21.066
21:59:22 STEP 485 H= 485:00 +CPU= 19.913
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:01:15 STEP 486 H= 486:00 +CPU= 32.764
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:02:57 STEP 487 H= 487:00 +CPU= 20.169
22:03:18 STEP 488 H= 488:00 +CPU= 21.466
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:04:52 STEP 489 H= 489:00 +CPU= 31.892
22:05:12 STEP 490 H= 490:00 +CPU= 20.134
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:06:44 STEP 491 H= 491:00 +CPU= 20.884
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:08:52 STEP 492 H= 492:00 +CPU= 35.241
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+000492
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+000492
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+000492
22:09:12 STEP 493 H= 493:00 +CPU= 20.469
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:11:05 STEP 494 H= 494:00 +CPU= 21.792
22:11:38 STEP 495 H= 495:00 +CPU= 32.801
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:13:50 STEP 496 H= 496:00 +CPU= 21.256
22:14:11 STEP 497 H= 497:00 +CPU= 20.573
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:15:54 STEP 498 H= 498:00 +CPU= 32.810
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:17:16 STEP 499 H= 499:00 +CPU= 20.882
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:18:49 STEP 500 H= 500:00 +CPU= 20.833
22:19:21 STEP 501 H= 501:00 +CPU= 32.304
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:21:13 STEP 502 H= 502:00 +CPU= 21.284
22:21:34 STEP 503 H= 503:00 +CPU= 21.433
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:23:22 STEP 504 H= 504:00 +CPU= 37.390
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+000504
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+000504
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+000504
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198518/ICMGGhq0f+000480
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198518/ICMSHhq0f+000480
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198518/ICMUAhq0f+000480
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198518/ICMGGhq0f+000492
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198518/ICMSHhq0f+000492
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198518/ICMUAhq0f+000492
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0874_2012050100_123_981_12198518_0_r1010603732_20.zip
Uploading the intermediate file: upload_file_20.zip
22:23:39 STEP 505 H= 505:00 +CPU= 17.402
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:24:53 STEP 506 H= 506:00 +CPU= 19.909
22:25:25 STEP 507 H= 507:00 +CPU= 32.079
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:27:27 STEP 508 H= 508:00 +CPU= 20.694
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:28:49 STEP 509 H= 509:00 +CPU= 20.305
22:29:21 STEP 510 H= 510:00 +CPU= 32.448
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:31:02 STEP 511 H= 511:00 +CPU= 19.975
22:31:23 STEP 512 H= 512:00 +CPU= 20.829
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:33:07 STEP 513 H= 513:00 +CPU= 31.922
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:35:00 STEP 514 H= 514:00 +CPU= 21.424
22:35:20 STEP 515 H= 515:00 +CPU= 20.244
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:37:27 STEP 516 H= 516:00 +CPU= 35.809
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+000516
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+000516
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+000516
22:37:48 STEP 517 H= 517:00 +CPU= 20.608
22:38:09 STEP 518 H= 518:00 +CPU= 20.819
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:40:12 STEP 519 H= 519:00 +CPU= 32.618
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:41:45 STEP 520 H= 520:00 +CPU= 20.896
22:42:05 STEP 521 H= 521:00 +CPU= 19.975
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:43:59 STEP 522 H= 522:00 +CPU= 33.485
22:44:19 STEP 523 H= 523:00 +CPU= 19.672
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:46:21 STEP 524 H= 524:00 +CPU= 20.792
22:46:53 STEP 525 H= 525:00 +CPU= 32.311
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:48:26 STEP 526 H= 526:00 +CPU= 20.809
22:48:46 STEP 527 H= 527:00 +CPU= 20.409
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:51:06 STEP 528 H= 528:00 +CPU= 37.865
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+000528
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+000528
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+000528
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198518/ICMGGhq0f+000504
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198518/ICMSHhq0f+000504
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198518/ICMUAhq0f+000504
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198518/ICMGGhq0f+000516
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198518/ICMSHhq0f+000516
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198518/ICMUAhq0f+000516
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0874_2012050100_123_981_12198518_0_r1010603732_21.zip
Uploading the intermediate file: upload_file_21.zip
22:51:25 STEP 529 H= 529:00 +CPU= 19.449
22:51:45 STEP 530 H= 530:00 +CPU= 20.035
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:53:39 STEP 531 H= 531:00 +CPU= 31.712
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:55:11 STEP 532 H= 532:00 +CPU= 21.237
22:55:32 STEP 533 H= 533:00 +CPU= 20.266
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:57:36 STEP 534 H= 534:00 +CPU= 32.875
22:57:56 STEP 535 H= 535:00 +CPU= 19.938
22:58:16 STEP 536 H= 536:00 +CPU= 20.515
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:00:20 STEP 537 H= 537:00 +CPU= 33.013
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:01:53 STEP 538 H= 538:00 +CPU= 20.773
23:02:14 STEP 539 H= 539:00 +CPU= 20.469
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:04:41 STEP 540 H= 540:00 +CPU= 36.118
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+000540
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+000540
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+000540
23:05:01 STEP 541 H= 541:00 +CPU= 20.161
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:06:34 STEP 542 H= 542:00 +CPU= 21.210
23:07:06 STEP 543 H= 543:00 +CPU= 31.861
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:08:47 STEP 544 H= 544:00 +CPU= 20.647
23:09:07 STEP 545 H= 545:00 +CPU= 19.670
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:11:01 STEP 546 H= 546:00 +CPU= 32.797
23:11:21 STEP 547 H= 547:00 +CPU= 19.986
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:13:03 STEP 548 H= 548:00 +CPU= 20.908
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:14:46 STEP 549 H= 549:00 +CPU= 32.002
23:15:07 STEP 550 H= 550:00 +CPU= 20.852
23:15:27 STEP 551 H= 551:00 +CPU= 20.331
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:17:37 STEP 552 H= 552:00 +CPU= 38.235
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+000552
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+000552
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+000552
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198518/ICMGGhq0f+000528
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198518/ICMSHhq0f+000528
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198518/ICMUAhq0f+000528
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198518/ICMGGhq0f+000540
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198518/ICMSHhq0f+000540
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198518/ICMUAhq0f+000540
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0874_2012050100_123_981_12198518_0_r1010603732_22.zip
Uploading the intermediate file: upload_file_22.zip
23:17:57 STEP 553 H= 553:00 +CPU= 19.724
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:19:29 STEP 554 H= 554:00 +CPU= 20.953
23:20:01 STEP 555 H= 555:00 +CPU= 32.109
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:21:43 STEP 556 H= 556:00 +CPU= 20.972
23:22:03 STEP 557 H= 557:00 +CPU= 20.050
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:23:56 STEP 558 H= 558:00 +CPU= 32.227
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:25:19 STEP 559 H= 559:00 +CPU= 20.027
23:25:40 STEP 560 H= 560:00 +CPU= 20.938
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:27:32 STEP 561 H= 561:00 +CPU= 31.436
23:27:53 STEP 562 H= 562:00 +CPU= 20.472
23:28:13 STEP 563 H= 563:00 +CPU= 19.935
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:30:19 STEP 564 H= 564:00 +CPU= 35.663
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+000564
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+000564
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+000564
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:31:42 STEP 565 H= 565:00 +CPU= 20.496
23:32:03 STEP 566 H= 566:00 +CPU= 21.071
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:34:38 STEP 567 H= 567:00 +CPU= 32.999
23:34:59 STEP 568 H= 568:00 +CPU= 20.825
23:35:19 STEP 569 H= 569:00 +CPU= 19.529
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:37:13 STEP 570 H= 570:00 +CPU= 32.993
23:37:33 STEP 571 H= 571:00 +CPU= 19.729
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:39:05 STEP 572 H= 572:00 +CPU= 20.211
23:39:37 STEP 573 H= 573:00 +CPU= 31.875
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:41:19 STEP 574 H= 574:00 +CPU= 21.018
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:42:41 STEP 575 H= 575:00 +CPU= 20.883
23:43:19 STEP 576 H= 576:00 +CPU= 37.838
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+000576
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+000576
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+000576
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198518/ICMGGhq0f+000552
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198518/ICMSHhq0f+000552
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198518/ICMUAhq0f+000552
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198518/ICMGGhq0f+000564
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198518/ICMSHhq0f+000564
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198518/ICMUAhq0f+000564
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0874_2012050100_123_981_12198518_0_r1010603732_23.zip
Uploading the intermediate file: upload_file_23.zip
23:45:01 STEP 577 H= 577:00 +CPU= 20.589
23:45:21 STEP 578 H= 578:00 +CPU= 20.049
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:46:43 STEP 579 H= 579:00 +CPU= 32.222
23:47:03 STEP 580 H= 580:00 +CPU= 20.029
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:49:15 STEP 581 H= 581:00 +CPU= 20.160
23:49:48 STEP 582 H= 582:00 +CPU= 32.747
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:51:11 STEP 583 H= 583:00 +CPU= 20.880
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:52:12 STEP 584 H= 584:00 +CPU= 20.248
23:52:44 STEP 585 H= 585:00 +CPU= 31.854
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Quit request received from BOINC client, ending the child process
..Failed, model did not complete successfully
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2012050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0874
(argv4) batchid: 981
(argv5) wuid: 12198518
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/8
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198518
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/8/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/8/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_488773654e6c1731700bac56eeecfeba to: /var/lib/boinc-client/slots/8/oifs_43r3_ps_0874_2012050100_123_981_12198518.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/8/oifs_43r3_ps_0874_2012050100_123_981_12198518.zip
ic_ancil_file: ic_ancil_12198518
ifsdata_file: ifsdata_12198518
climate_data_file: clim_data_12198518
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_d65eb557e702e71b22e596e7fd4d7927 to: /var/lib/boinc-client/slots/8/ic_ancil_12198518.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/8/ic_ancil_12198518.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_53f9b6dce0510c93ae2a4dd3268755ab to: /var/lib/boinc-client/slots/8/ifsdata/ifsdata_12198518.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/8/ifsdata/ifsdata_12198518.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/8/159l_2/clim_data_12198518.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/8/159l_2/clim_data_12198518.zip
Checking for progress XML file: /var/lib/boinc-client/slots/8/progress_file_12198518.xml
Opened progress file ok : /var/lib/boinc-client/slots/8/progress_file_12198518.xml
-- Model is restarting --
Adjusting last_iter, 586, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/8/progress_file_12198518.xml
last_cpu_time: 17414
upload_file_number: 24
last_iter: 575
last_upload: 2073600
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0874_2012050100_123_981_12198518_0_r1010603732
The child process has been launched with process id: 91371
Executing the command: /var/lib/boinc-client/slots/8/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:p500:1:1:91371:91371] [20230119:235540:1674140140:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:p500:1:1:91371:91371] [20230119:235540:1674140140:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:p500:1:1:91371:91371] [20230119:235540:1674140140:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:p500:1:1:91371:91371] [20230119:235540:1674140140:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:p500:1:1:91371:91371] [20230119:235540:1674140140:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:p500:1:1:91371:91371] [20230119:235540:1674140140:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:p500:1:1:91371:91371] [20230119:235540:1674140140:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:p500:1:1:91371:91371] [20230119:235540:1674140140:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:p500:1:1:91371:91371] [20230119:235540:1674140140:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:p500:1:1:91371:91371] [20230119:235540:1674140140:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:91371:91371] [20230119:235540:1674140140:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:p500:1:1:91371:91371] [20230119:235540:1674140140:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:p500:1:1:91371:91371] [20230119:235540:1674140140:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:p500:1:1:91371:91371] [20230119:235540:1674140140:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:91371:91371] [20230119:235540:1674140140:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:91371:91371] [20230119:235540:1674140140:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:91371:91371] [20230119:235540:1674140140:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:91371:91371] [20230119:235540:1674140140:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:91371:91371] [20230119:235540:1674140140:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:91371:91371] [20230119:235540:1674140140:0.001] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:91371:91371] [20230119:235540:1674140140:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:91371:91371] [20230119:235540:1674140140:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:91371:91371] [20230119:235540:1674140140:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:91371:91371] [20230119:235540:1674140140:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:91371:91371] [20230119:235540:1674140140:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:91371:91371] [20230119:235540:1674140140:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:91371:91371] [20230119:235540:1674140140:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:91371:91371] [20230119:235540:1674140140:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:91371:91371] [20230119:235540:1674140140:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:91371:91371] [20230119:235540:1674140140:0.001] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:57:20 STEP 576 H= 576:00 +CPU= 35.974
23:57:39 STEP 577 H= 577:00 +CPU= 19.532
23:58:00 STEP 578 H= 578:00 +CPU= 20.282
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:59:53 STEP 579 H= 579:00 +CPU= 32.230
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:01:15 STEP 580 H= 580:00 +CPU= 20.927
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:02:36 STEP 581 H= 581:00 +CPU= 20.603
00:03:08 STEP 582 H= 582:00 +CPU= 31.928
00:03:28 STEP 583 H= 583:00 +CPU= 20.007
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:05:20 STEP 584 H= 584:00 +CPU= 20.992
00:05:51 STEP 585 H= 585:00 +CPU= 31.205
00:06:12 STEP 586 H= 586:00 +CPU= 20.318
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:08:05 STEP 587 H= 587:00 +CPU= 20.845
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:09:50 STEP 588 H= 588:00 +CPU= 34.439
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+000588
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+000588
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+000588
00:10:11 STEP 589 H= 589:00 +CPU= 21.193
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:11:43 STEP 590 H= 590:00 +CPU= 20.467
00:12:15 STEP 591 H= 591:00 +CPU= 31.888
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:13:57 STEP 592 H= 592:00 +CPU= 20.825
00:14:18 STEP 593 H= 593:00 +CPU= 21.121
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:16:13 STEP 594 H= 594:00 +CPU= 32.524
00:16:33 STEP 595 H= 595:00 +CPU= 19.942
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:18:05 STEP 596 H= 596:00 +CPU= 20.801
00:18:37 STEP 597 H= 597:00 +CPU= 31.811
00:18:57 STEP 598 H= 598:00 +CPU= 20.223
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:20:39 STEP 599 H= 599:00 +CPU= 21.260
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Abort request received from BOINC client, ending the child process
</stderr_txt>
]]>
