<core_client_version>7.16.6</core_client_version>
<![CDATA[
<message>
Disk usage limit exceeded</message>
<stderr_txt>
H= 450:00 +CPU= 33.759
13:41:46 STEP 451 H= 451:00 +CPU= 20.201
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:43:28 STEP 452 H= 452:00 +CPU= 20.949
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:45:51 STEP 453 H= 453:00 +CPU= 32.489
13:46:13 STEP 454 H= 454:00 +CPU= 21.351
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:47:55 STEP 455 H= 455:00 +CPU= 21.547
13:48:33 STEP 456 H= 456:00 +CPU= 38.364
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+000456
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+000456
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+000456
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171092/ICMGGhq0f+000432
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171092/ICMSHhq0f+000432
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171092/ICMUAhq0f+000432
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171092/ICMGGhq0f+000444
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171092/ICMSHhq0f+000444
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171092/ICMUAhq0f+000444
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0448_1985050100_123_954_12171092_0_r600999729_18.zip
Uploading the intermediate file: upload_file_18.zip
13:50:05 STEP 457 H= 457:00 +CPU= 20.740
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:51:58 STEP 458 H= 458:00 +CPU= 21.649
13:52:31 STEP 459 H= 459:00 +CPU= 33.027
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:54:14 STEP 460 H= 460:00 +CPU= 21.633
13:54:35 STEP 461 H= 461:00 +CPU= 20.829
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:57:32 STEP 462 H= 462:00 +CPU= 33.666
13:57:53 STEP 463 H= 463:00 +CPU= 21.181
13:58:14 STEP 464 H= 464:00 +CPU= 21.070
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:00:08 STEP 465 H= 465:00 +CPU= 32.778
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:01:31 STEP 466 H= 466:00 +CPU= 21.529
14:01:51 STEP 467 H= 467:00 +CPU= 20.536
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:03:39 STEP 468 H= 468:00 +CPU= 36.111
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+000468
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+000468
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+000468
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
[EC_DRHOOK:p500:1:1:3285628:3285628] [20230119:153853:1674110333:8366.982] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1538] Received signal#15 (SIGTERM) :: 2550MB (heap), 4418MB (maxrss), 0MB (maxstack), 0 (paging), nsigs = 1
[EC_DRHOOK:p500:1:1:3285628:3285628] [20230119:153853:1674110333:8366.984] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1542] Also activating Harakiri-alarm (SIGALRM=14) to expire after 500s elapsed to prevent hangs, nsigs = 1
[EC_DRHOOK:p500:1:1:3285628:3285628] [20230119:153853:1674110333:8366.984] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1544] Harakiri signal handler 'signal_harakiri' for signal#14 (SIGALRM) installed at 0x81f3c0 (old at (nil))
[EC_DRHOOK:p500:1:1:3285628:3285628] [20230119:153853:1674110333:8366.984] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1617] Signal#15 was caused by unrecognized si_code [memaddr=0x1], nsigs = 1
[EC_DRHOOK:p500:1:1:3285628:3285628] [20230119:153853:1674110333:8366.984] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1686] Starting DrHook backtrace for signal#15, nsigs = 1
[EC_DRHOOK:p500:1:1:3285628:3285628] [20230119:153853:1674110333:8366.984] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3843] 2598 MB (maxheap), 4418 MB (maxrss), 0 MB (maxstack)
[EC_DRHOOK:p500:1:1:3285628:3285628] [20230119:153853:1674110333:8366.984] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : MASTER
[EC_DRHOOK:p500:1:1:3285628:3285628] [20230119:153853:1674110333:8366.985] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : CNT0
[EC_DRHOOK:p500:1:1:3285628:3285628] [20230119:153853:1674110333:8366.985] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : CNT1
[EC_DRHOOK:p500:1:1:3285628:3285628] [20230119:153853:1674110333:8366.985] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : CNT2
[EC_DRHOOK:p500:1:1:3285628:3285628] [20230119:153853:1674110333:8366.985] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : CNT3
[EC_DRHOOK:p500:1:1:3285628:3285628] [20230119:153853:1674110333:8366.985] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : CNT4
[EC_DRHOOK:p500:1:1:3285628:3285628] [20230119:153853:1674110333:8366.985] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : WVCOUPLE
[EC_DRHOOK:p500:1:1:3285628:3285628] [20230119:153853:1674110333:8366.985] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : WAVEMDL
[EC_DRHOOK:p500:1:1:3285628:3285628] [20230119:153853:1674110333:8366.985] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : WAMODEL
[EC_DRHOOK:p500:1:1:3285628:3285628] [20230119:153853:1674110333:8366.985] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : >OMP-WAMODEL 2 (1431)
[EC_DRHOOK:p500:1:1:3285628:3285628] [20230119:153853:1674110333:8366.985] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : IMPLSCH
[EC_DRHOOK:p500:1:1:3285628:3285628] [20230119:153853:1674110333:8366.985] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : SNONLIN
[EC_DRHOOK:p500:1:1:3285628:3285628] [20230119:153854:1674110334:8367.985] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1734] DrHook backtrace done for signal#15, nsigs = 1
[EC_DRHOOK:p500:1:1:3285628:3285628] [20230119:153854:1674110334:8367.985] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1785] Calling previous signal handler at 0x1ce8bb0 for signal#15, nsigs = 1
forrtl: error (78): process killed (SIGTERM)
Image PC Routine Line Source
oifs_43r3_model.e 0000000001CE916B Unknown Unknown Unknown
oifs_43r3_model.e 000000000081FFF1 Unknown Unknown Unknown
oifs_43r3_model.e 0000000001DC9090 Unknown Unknown Unknown
oifs_43r3_model.e 0000000001A67007 snonlin_ 191 snonlin.F
oifs_43r3_model.e 0000000001A31273 implsch_ 285 implsch.F
oifs_43r3_model.e 000000000168CBD7 wamodel_ 1008 wamodel.F
oifs_43r3_model.e 0000000000872295 wavemdl_ 584 wavemdl.F
oifs_43r3_model.e 00000000007E0165 wvcouple_ 260 wvcouple.F90
oifs_43r3_model.e 000000000055E4AD cnt4_ 1283 cnt4.F90
oifs_43r3_model.e 00000000005471C9 cnt3_ 267 cnt3.F90
oifs_43r3_model.e 0000000000546412 cnt2_ 88 cnt2.F90
oifs_43r3_model.e 0000000000545E28 cnt1_ 92 cnt1.F90
oifs_43r3_model.e 000000000040708D cnt0_ 146 cnt0.F90
oifs_43r3_model.e 000000000040220F MAIN__ 96 master.F90
oifs_43r3_model.e 00000000004021A2 Unknown Unknown Unknown
oifs_43r3_model.e 0000000001DCA390 Unknown Unknown Unknown
oifs_43r3_model.e 000000000040206E Unknown Unknown Unknown
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1985050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0448
(argv4) batchid: 954
(argv5) wuid: 12171092
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/5
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171092
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/5/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/5/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_3a13b041295d75ee118f3f1cf97549da to: /var/lib/boinc-client/slots/5/oifs_43r3_ps_0448_1985050100_123_954_12171092.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/5/oifs_43r3_ps_0448_1985050100_123_954_12171092.zip
ic_ancil_file: ic_ancil_12171092
ifsdata_file: ifsdata_12171092
climate_data_file: clim_data_12171092
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_f3d993c5ed652fc499b3cdcf5f2c3ca8 to: /var/lib/boinc-client/slots/5/ic_ancil_12171092.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/5/ic_ancil_12171092.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_0f4a432eeac21caa29a66bc8d16d9c5e to: /var/lib/boinc-client/slots/5/ifsdata/ifsdata_12171092.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/5/ifsdata/ifsdata_12171092.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/5/159l_2/clim_data_12171092.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/5/159l_2/clim_data_12171092.zip
Checking for progress XML file: /var/lib/boinc-client/slots/5/progress_file_12171092.xml
Opened progress file ok : /var/lib/boinc-client/slots/5/progress_file_12171092.xml
-- Model is restarting --
Adjusting last_iter, 469, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/5/progress_file_12171092.xml
last_cpu_time: 13863
upload_file_number: 19
last_iter: 455
last_upload: 1641600
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0448_1985050100_123_954_12171092_0_r600999729
The child process has been launched with process id: 52425
Executing the command: /var/lib/boinc-client/slots/5/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:p500:1:1:52425:52425] [20230119:195022:1674125422:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:p500:1:1:52425:52425] [20230119:195022:1674125422:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:p500:1:1:52425:52425] [20230119:195022:1674125422:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:p500:1:1:52425:52425] [20230119:195022:1674125422:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:p500:1:1:52425:52425] [20230119:195022:1674125422:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:p500:1:1:52425:52425] [20230119:195022:1674125422:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:p500:1:1:52425:52425] [20230119:195022:1674125422:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:p500:1:1:52425:52425] [20230119:195022:1674125422:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:p500:1:1:52425:52425] [20230119:195022:1674125422:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:p500:1:1:52425:52425] [20230119:195022:1674125422:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:52425:52425] [20230119:195022:1674125422:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:p500:1:1:52425:52425] [20230119:195022:1674125422:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:p500:1:1:52425:52425] [20230119:195022:1674125422:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:p500:1:1:52425:52425] [20230119:195022:1674125422:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:52425:52425] [20230119:195022:1674125422:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:52425:52425] [20230119:195022:1674125422:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:52425:52425] [20230119:195022:1674125422:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:52425:52425] [20230119:195022:1674125422:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:52425:52425] [20230119:195022:1674125422:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:52425:52425] [20230119:195022:1674125422:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:52425:52425] [20230119:195022:1674125422:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:52425:52425] [20230119:195022:1674125422:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:52425:52425] [20230119:195022:1674125422:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:52425:52425] [20230119:195022:1674125422:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:52425:52425] [20230119:195022:1674125422:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:52425:52425] [20230119:195022:1674125422:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:52425:52425] [20230119:195022:1674125422:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:52425:52425] [20230119:195022:1674125422:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:52425:52425] [20230119:195022:1674125422:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:52425:52425] [20230119:195022:1674125422:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:28:23 STEP 456 H= 456:00 +CPU= 39.635
20:28:46 STEP 457 H= 457:00 +CPU= 23.034
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:31:31 STEP 458 H= 458:00 +CPU= 23.168
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:47:59 STEP 459 H= 459:00 +CPU= 35.245
20:48:21 STEP 460 H= 460:00 +CPU= 21.904
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:50:33 STEP 461 H= 461:00 +CPU= 21.289
20:51:10 STEP 462 H= 462:00 +CPU= 36.076
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:12:25 STEP 463 H= 463:00 +CPU= 20.998
21:12:46 STEP 464 H= 464:00 +CPU= 20.715
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:16:11 STEP 465 H= 465:00 +CPU= 31.764
21:16:32 STEP 466 H= 466:00 +CPU= 21.527
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:18:03 STEP 467 H= 467:00 +CPU= 19.687
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:19:40 STEP 468 H= 468:00 +CPU= 35.154
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+000468
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+000468
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+000468
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:21:02 STEP 469 H= 469:00 +CPU= 20.548
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:22:45 STEP 470 H= 470:00 +CPU= 20.846
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:24:18 STEP 471 H= 471:00 +CPU= 31.701
21:24:40 STEP 472 H= 472:00 +CPU= 21.472
21:25:00 STEP 473 H= 473:00 +CPU= 19.884
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:26:53 STEP 474 H= 474:00 +CPU= 33.081
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:28:45 STEP 475 H= 475:00 +CPU= 20.472
21:29:06 STEP 476 H= 476:00 +CPU= 20.529
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:30:59 STEP 477 H= 477:00 +CPU= 32.120
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:32:31 STEP 478 H= 478:00 +CPU= 20.447
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:33:43 STEP 479 H= 479:00 +CPU= 21.347
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:35:52 STEP 480 H= 480:00 +CPU= 37.298
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+000480
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+000480
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+000480
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171092/ICMGGhq0f+000456
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171092/ICMSHhq0f+000456
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171092/ICMUAhq0f+000456
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171092/ICMGGhq0f+000468
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171092/ICMSHhq0f+000468
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171092/ICMUAhq0f+000468
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0448_1985050100_123_954_12171092_0_r600999729_19.zip
Uploading the intermediate file: upload_file_19.zip
21:36:12 STEP 481 H= 481:00 +CPU= 19.983
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:37:42 STEP 482 H= 482:00 +CPU= 20.631
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:39:44 STEP 483 H= 483:00 +CPU= 31.566
21:40:05 STEP 484 H= 484:00 +CPU= 20.924
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:41:37 STEP 485 H= 485:00 +CPU= 20.564
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:43:31 STEP 486 H= 486:00 +CPU= 33.955
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:44:52 STEP 487 H= 487:00 +CPU= 20.985
21:45:13 STEP 488 H= 488:00 +CPU= 20.939
21:45:44 STEP 489 H= 489:00 +CPU= 30.968
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:47:35 STEP 490 H= 490:00 +CPU= 20.821
21:47:56 STEP 491 H= 491:00 +CPU= 20.326
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:49:42 STEP 492 H= 492:00 +CPU= 34.881
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+000492
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+000492
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+000492
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:51:14 STEP 493 H= 493:00 +CPU= 20.284
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:52:35 STEP 494 H= 494:00 +CPU= 21.010
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1985050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0448
(argv4) batchid: 954
(argv5) wuid: 12171092
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/5
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171092
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/5/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/5/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_3a13b041295d75ee118f3f1cf97549da to: /var/lib/boinc-client/slots/5/oifs_43r3_ps_0448_1985050100_123_954_12171092.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/5/oifs_43r3_ps_0448_1985050100_123_954_12171092.zip
ic_ancil_file: ic_ancil_12171092
ifsdata_file: ifsdata_12171092
climate_data_file: clim_data_12171092
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_f3d993c5ed652fc499b3cdcf5f2c3ca8 to: /var/lib/boinc-client/slots/5/ic_ancil_12171092.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/5/ic_ancil_12171092.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_0f4a432eeac21caa29a66bc8d16d9c5e to: /var/lib/boinc-client/slots/5/ifsdata/ifsdata_12171092.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/5/ifsdata/ifsdata_12171092.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/5/159l_2/clim_data_12171092.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/5/159l_2/clim_data_12171092.zip
Checking for progress XML file: /var/lib/boinc-client/slots/5/progress_file_12171092.xml
Opened progress file ok : /var/lib/boinc-client/slots/5/progress_file_12171092.xml
-- Model is restarting --
Adjusting last_iter, 495, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/5/progress_file_12171092.xml
last_cpu_time: 14865
upload_file_number: 20
last_iter: 479
last_upload: 1728000
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0448_1985050100_123_954_12171092_0_r600999729
The child process has been launched with process id: 74096
Executing the command: /var/lib/boinc-client/slots/5/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:p500:1:1:74096:74096] [20230119:215718:1674133038:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:p500:1:1:74096:74096] [20230119:215718:1674133038:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:p500:1:1:74096:74096] [20230119:215718:1674133038:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:p500:1:1:74096:74096] [20230119:215718:1674133038:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:p500:1:1:74096:74096] [20230119:215718:1674133038:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:p500:1:1:74096:74096] [20230119:215718:1674133038:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:p500:1:1:74096:74096] [20230119:215718:1674133038:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:p500:1:1:74096:74096] [20230119:215718:1674133038:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:p500:1:1:74096:74096] [20230119:215718:1674133038:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:p500:1:1:74096:74096] [20230119:215718:1674133038:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:74096:74096] [20230119:215718:1674133038:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:p500:1:1:74096:74096] [20230119:215718:1674133038:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:p500:1:1:74096:74096] [20230119:215718:1674133038:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:p500:1:1:74096:74096] [20230119:215718:1674133038:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:74096:74096] [20230119:215718:1674133038:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:74096:74096] [20230119:215718:1674133038:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:74096:74096] [20230119:215718:1674133038:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:74096:74096] [20230119:215718:1674133038:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:74096:74096] [20230119:215718:1674133038:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:74096:74096] [20230119:215718:1674133038:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:74096:74096] [20230119:215718:1674133038:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:74096:74096] [20230119:215718:1674133038:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:74096:74096] [20230119:215718:1674133038:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:74096:74096] [20230119:215718:1674133038:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:74096:74096] [20230119:215718:1674133038:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:74096:74096] [20230119:215718:1674133038:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:74096:74096] [20230119:215718:1674133038:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:74096:74096] [20230119:215718:1674133038:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:74096:74096] [20230119:215718:1674133038:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:74096:74096] [20230119:215718:1674133038:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:58:59 STEP 480 H= 480:00 +CPU= 36.431
21:59:19 STEP 481 H= 481:00 +CPU= 19.821
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:01:00 STEP 482 H= 482:00 +CPU= 20.296
22:01:32 STEP 483 H= 483:00 +CPU= 31.964
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:03:15 STEP 484 H= 484:00 +CPU= 21.439
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:04:38 STEP 485 H= 485:00 +CPU= 20.555
22:05:10 STEP 486 H= 486:00 +CPU= 32.277
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:06:42 STEP 487 H= 487:00 +CPU= 20.727
22:07:03 STEP 488 H= 488:00 +CPU= 20.932
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:09:06 STEP 489 H= 489:00 +CPU= 32.361
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:10:59 STEP 490 H= 490:00 +CPU= 21.291
22:11:19 STEP 491 H= 491:00 +CPU= 20.312
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:13:46 STEP 492 H= 492:00 +CPU= 35.693
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+000492
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+000492
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+000492
22:14:07 STEP 493 H= 493:00 +CPU= 20.925
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:15:38 STEP 494 H= 494:00 +CPU= 21.227
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:17:12 STEP 495 H= 495:00 +CPU= 32.643
22:17:33 STEP 496 H= 496:00 +CPU= 20.787
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:19:06 STEP 497 H= 497:00 +CPU= 20.565
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:21:09 STEP 498 H= 498:00 +CPU= 33.417
22:21:30 STEP 499 H= 499:00 +CPU= 20.494
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:23:02 STEP 500 H= 500:00 +CPU= 20.850
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:24:45 STEP 501 H= 501:00 +CPU= 32.107
22:25:06 STEP 502 H= 502:00 +CPU= 20.862
22:25:26 STEP 503 H= 503:00 +CPU= 20.563
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:28:47 STEP 504 H= 504:00 +CPU= 38.557
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+000504
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+000504
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+000504
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171092/ICMGGhq0f+000480
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171092/ICMSHhq0f+000480
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171092/ICMUAhq0f+000480
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171092/ICMGGhq0f+000492
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171092/ICMSHhq0f+000492
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171092/ICMUAhq0f+000492
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0448_1985050100_123_954_12171092_0_r600999729_20.zip
Uploading the intermediate file: upload_file_20.zip
22:29:07 STEP 505 H= 505:00 +CPU= 20.072
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:30:49 STEP 506 H= 506:00 +CPU= 20.685
22:31:21 STEP 507 H= 507:00 +CPU= 32.107
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:32:54 STEP 508 H= 508:00 +CPU= 20.692
22:33:15 STEP 509 H= 509:00 +CPU= 21.249
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:35:20 STEP 510 H= 510:00 +CPU= 33.841
22:35:41 STEP 511 H= 511:00 +CPU= 20.361
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:37:33 STEP 512 H= 512:00 +CPU= 21.041
22:38:05 STEP 513 H= 513:00 +CPU= 31.753
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:39:57 STEP 514 H= 514:00 +CPU= 21.193
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:41:30 STEP 515 H= 515:00 +CPU= 20.556
22:42:05 STEP 516 H= 516:00 +CPU= 34.987
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+000516
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+000516
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+000516
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:43:45 STEP 517 H= 517:00 +CPU= 19.695
22:44:06 STEP 518 H= 518:00 +CPU= 21.578
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:46:19 STEP 519 H= 519:00 +CPU= 31.972
22:46:41 STEP 520 H= 520:00 +CPU= 21.609
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:48:13 STEP 521 H= 521:00 +CPU= 20.004
22:48:47 STEP 522 H= 522:00 +CPU= 33.363
22:49:07 STEP 523 H= 523:00 +CPU= 19.940
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:51:08 STEP 524 H= 524:00 +CPU= 21.070
22:51:40 STEP 525 H= 525:00 +CPU= 31.920
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:53:24 STEP 526 H= 526:00 +CPU= 21.659
22:53:45 STEP 527 H= 527:00 +CPU= 21.102
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:55:34 STEP 528 H= 528:00 +CPU= 38.009
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+000528
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+000528
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+000528
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171092/ICMGGhq0f+000504
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171092/ICMSHhq0f+000504
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171092/ICMUAhq0f+000504
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171092/ICMGGhq0f+000516
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171092/ICMSHhq0f+000516
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171092/ICMUAhq0f+000516
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0448_1985050100_123_954_12171092_0_r600999729_21.zip
Uploading the intermediate file: upload_file_21.zip
22:55:54 STEP 529 H= 529:00 +CPU= 19.724
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:57:28 STEP 530 H= 530:00 +CPU= 18.467
22:58:01 STEP 531 H= 531:00 +CPU= 32.306
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:59:52 STEP 532 H= 532:00 +CPU= 20.101
23:00:12 STEP 533 H= 533:00 +CPU= 20.176
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:01:55 STEP 534 H= 534:00 +CPU= 32.302
23:02:15 STEP 535 H= 535:00 +CPU= 19.512
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:04:27 STEP 536 H= 536:00 +CPU= 20.586
23:05:00 STEP 537 H= 537:00 +CPU= 33.332
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:06:33 STEP 538 H= 538:00 +CPU= 21.877
SMILAG TRAJECTORY UNDERGROUND 1 TIMES.
POINT= 14 MAX ETADOT VERTICAL VEL.= 2.687132005177365E-008
LON = 98.4375000000000 degrees
LAT = -43.1773092288349 degrees
23:06:54 STEP 539 H= 539:00 +CPU= 20.882
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
SMILAG TRAJECTORY UNDERGROUND 1 TIMES.
POINT= 15 MAX ETADOT VERTICAL VEL.= 3.993982611229104E-008
LON = 97.0312500000000 degrees
LAT = -44.2987941306940 degrees
23:08:50 STEP 540 H= 540:00 +CPU= 35.568
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+000540
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+000540
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+000540
23:09:10 STEP 541 H= 541:00 +CPU= 20.001
SMILAG TRAJECTORY UNDERGROUND 1 TIMES.
POINT= 16 MAX ETADOT VERTICAL VEL.= 4.361146782074441E-008
LON = 95.6250000000000 degrees
LAT = -45.4202786265483 degrees
23:09:30 STEP 542 H= 542:00 +CPU= 20.519
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:12:44 STEP 543 H= 543:00 +CPU= 32.405
23:13:05 STEP 544 H= 544:00 +CPU= 21.337
23:13:26 STEP 545 H= 545:00 +CPU= 20.418
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:15:09 STEP 546 H= 546:00 +CPU= 33.021
23:15:29 STEP 547 H= 547:00 +CPU= 19.859
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:17:21 STEP 548 H= 548:00 +CPU= 20.738
23:17:53 STEP 549 H= 549:00 +CPU= 31.771
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:19:25 STEP 550 H= 550:00 +CPU= 20.809
23:19:46 STEP 551 H= 551:00 +CPU= 21.798
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:21:47 STEP 552 H= 552:00 +CPU= 38.764
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+000552
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+000552
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+000552
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171092/ICMGGhq0f+000528
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171092/ICMSHhq0f+000528
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171092/ICMUAhq0f+000528
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171092/ICMGGhq0f+000540
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171092/ICMSHhq0f+000540
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171092/ICMUAhq0f+000540
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0448_1985050100_123_954_12171092_0_r600999729_22.zip
Uploading the intermediate file: upload_file_22.zip
23:22:08 STEP 553 H= 553:00 +CPU= 20.096
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:23:50 STEP 554 H= 554:00 +CPU= 21.067
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:25:25 STEP 555 H= 555:00 +CPU= 32.762
23:25:46 STEP 556 H= 556:00 +CPU= 20.890
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:27:27 STEP 557 H= 557:00 +CPU= 19.856
23:27:59 STEP 558 H= 558:00 +CPU= 32.032
23:28:18 STEP 559 H= 559:00 +CPU= 19.782
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:30:11 STEP 560 H= 560:00 +CPU= 21.026
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:31:45 STEP 561 H= 561:00 +CPU= 31.934
23:32:06 STEP 562 H= 562:00 +CPU= 20.841
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:33:26 STEP 563 H= 563:00 +CPU= 20.609
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:35:03 STEP 564 H= 564:00 +CPU= 35.770
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+000564
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+000564
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+000564
23:35:22 STEP 565 H= 565:00 +CPU= 19.048
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:37:04 STEP 566 H= 566:00 +CPU= 20.383
23:37:36 STEP 567 H= 567:00 +CPU= 32.172
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:39:09 STEP 568 H= 568:00 +CPU= 20.902
23:39:29 STEP 569 H= 569:00 +CPU= 20.068
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:41:23 STEP 570 H= 570:00 +CPU= 32.985
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:42:45 STEP 571 H= 571:00 +CPU= 20.378
23:43:06 STEP 572 H= 572:00 +CPU= 20.776
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:44:59 STEP 573 H= 573:00 +CPU= 32.337
23:45:20 STEP 574 H= 574:00 +CPU= 21.072
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:46:33 STEP 575 H= 575:00 +CPU= 21.552
23:47:10 STEP 576 H= 576:00 +CPU= 37.117
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+000576
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+000576
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+000576
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171092/ICMGGhq0f+000552
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171092/ICMSHhq0f+000552
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171092/ICMUAhq0f+000552
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171092/ICMGGhq0f+000564
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171092/ICMSHhq0f+000564
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171092/ICMUAhq0f+000564
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0448_1985050100_123_954_12171092_0_r600999729_23.zip
Uploading the intermediate file: upload_file_23.zip
23:49:21 STEP 577 H= 577:00 +CPU= 19.714
23:49:41 STEP 578 H= 578:00 +CPU= 19.638
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:51:15 STEP 579 H= 579:00 +CPU= 32.089
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:52:18 STEP 580 H= 580:00 +CPU= 20.940
23:52:38 STEP 581 H= 581:00 +CPU= 19.717
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:54:22 STEP 582 H= 582:00 +CPU= 33.522
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:55:53 STEP 583 H= 583:00 +CPU= 20.305
23:56:14 STEP 584 H= 584:00 +CPU= 20.934
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1985050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0448
(argv4) batchid: 954
(argv5) wuid: 12171092
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/5
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171092
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/5/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/5/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_3a13b041295d75ee118f3f1cf97549da to: /var/lib/boinc-client/slots/5/oifs_43r3_ps_0448_1985050100_123_954_12171092.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/5/oifs_43r3_ps_0448_1985050100_123_954_12171092.zip
ic_ancil_file: ic_ancil_12171092
ifsdata_file: ifsdata_12171092
climate_data_file: clim_data_12171092
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_f3d993c5ed652fc499b3cdcf5f2c3ca8 to: /var/lib/boinc-client/slots/5/ic_ancil_12171092.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/5/ic_ancil_12171092.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_0f4a432eeac21caa29a66bc8d16d9c5e to: /var/lib/boinc-client/slots/5/ifsdata/ifsdata_12171092.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/5/ifsdata/ifsdata_12171092.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/5/159l_2/clim_data_12171092.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/5/159l_2/clim_data_12171092.zip
Checking for progress XML file: /var/lib/boinc-client/slots/5/progress_file_12171092.xml
Opened progress file ok : /var/lib/boinc-client/slots/5/progress_file_12171092.xml
-- Model is restarting --
Adjusting last_iter, 585, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/5/progress_file_12171092.xml
last_cpu_time: 17494
upload_file_number: 24
last_iter: 575
last_upload: 2073600
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0448_1985050100_123_954_12171092_0_r600999729
The child process has been launched with process id: 91898
Executing the command: /var/lib/boinc-client/slots/5/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:p500:1:1:91898:91898] [20230119:235931:1674140371:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:p500:1:1:91898:91898] [20230119:235931:1674140371:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:p500:1:1:91898:91898] [20230119:235931:1674140371:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:p500:1:1:91898:91898] [20230119:235931:1674140371:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:p500:1:1:91898:91898] [20230119:235931:1674140371:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:p500:1:1:91898:91898] [20230119:235931:1674140371:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:p500:1:1:91898:91898] [20230119:235931:1674140371:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:p500:1:1:91898:91898] [20230119:235931:1674140371:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:p500:1:1:91898:91898] [20230119:235931:1674140371:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:p500:1:1:91898:91898] [20230119:235931:1674140371:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:91898:91898] [20230119:235931:1674140371:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:p500:1:1:91898:91898] [20230119:235931:1674140371:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:p500:1:1:91898:91898] [20230119:235931:1674140371:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:p500:1:1:91898:91898] [20230119:235931:1674140371:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:91898:91898] [20230119:235931:1674140371:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:91898:91898] [20230119:235931:1674140371:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:91898:91898] [20230119:235931:1674140371:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:91898:91898] [20230119:235931:1674140371:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:91898:91898] [20230119:235931:1674140371:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:91898:91898] [20230119:235931:1674140371:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:91898:91898] [20230119:235931:1674140371:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:91898:91898] [20230119:235931:1674140371:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:91898:91898] [20230119:235931:1674140371:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:91898:91898] [20230119:235931:1674140371:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:91898:91898] [20230119:235931:1674140371:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:91898:91898] [20230119:235931:1674140371:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:91898:91898] [20230119:235931:1674140371:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:91898:91898] [20230119:235931:1674140371:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:91898:91898] [20230119:235931:1674140371:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:91898:91898] [20230119:235931:1674140371:0.001] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:01:11 STEP 576 H= 576:00 +CPU= 36.570
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:02:32 STEP 577 H= 577:00 +CPU= 21.149
00:02:53 STEP 578 H= 578:00 +CPU= 20.981
00:03:24 STEP 579 H= 579:00 +CPU= 31.463
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:05:16 STEP 580 H= 580:00 +CPU= 20.322
00:05:35 STEP 581 H= 581:00 +CPU= 19.515
00:06:07 STEP 582 H= 582:00 +CPU= 31.774
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:08:00 STEP 583 H= 583:00 +CPU= 20.242
00:08:21 STEP 584 H= 584:00 +CPU= 21.294
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:10:05 STEP 585 H= 585:00 +CPU= 32.469
00:10:26 STEP 586 H= 586:00 +CPU= 20.872
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:11:57 STEP 587 H= 587:00 +CPU= 20.548
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:13:53 STEP 588 H= 588:00 +CPU= 34.878
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+000588
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+000588
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+000588
00:14:14 STEP 589 H= 589:00 +CPU= 20.556
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:15:57 STEP 590 H= 590:00 +CPU= 20.749
00:16:29 STEP 591 H= 591:00 +CPU= 32.405
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:18:01 STEP 592 H= 592:00 +CPU= 20.412
00:18:22 STEP 593 H= 593:00 +CPU= 21.303
00:18:54 STEP 594 H= 594:00 +CPU= 32.305
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:20:36 STEP 595 H= 595:00 +CPU= 20.715
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:22:08 STEP 596 H= 596:00 +CPU= 20.901
00:22:40 STEP 597 H= 597:00 +CPU= 31.695
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:24:21 STEP 598 H= 598:00 +CPU= 20.712
00:24:42 STEP 599 H= 599:00 +CPU= 20.844
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
00:26:50 STEP 600 H= 600:00 +CPU= 37.443
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+000600
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+000600
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+000600
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171092/ICMGGhq0f+000576
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171092/ICMSHhq0f+000576
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171092/ICMUAhq0f+000576
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171092/ICMGGhq0f+000588
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171092/ICMSHhq0f+000588
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171092/ICMUAhq0f+000588
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0448_1985050100_123_954_12171092_0_r600999729_24.zip
Uploading the intermediate file: upload_file_24.zip
00:27:11 STEP 601 H= 601:00 +CPU= 20.445
Abort request received from BOINC client, ending the child process
</stderr_txt>
]]>
