<core_client_version>7.18.1</core_client_version>
<![CDATA[
<message>
Disk usage limit exceeded</message>
<stderr_txt>
ok_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ardbeg:1:1:2109219:2109219] [20230125:052351:1674617031:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:ardbeg:1:1:2109219:2109219] [20230125:052351:1674617031:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ardbeg:1:1:2109219:2109219] [20230125:052351:1674617031:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ardbeg:1:1:2109219:2109219] [20230125:052351:1674617031:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ardbeg:1:1:2109219:2109219] [20230125:052351:1674617031:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:ardbeg:1:1:2109219:2109219] [20230125:052351:1674617031:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:ardbeg:1:1:2109219:2109219] [20230125:052351:1674617031:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:ardbeg:1:1:2109219:2109219] [20230125:052351:1674617031:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:24:10 STEP 408 H= 408:00 +CPU= 12.784
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMGGhq0f+000408
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMSHhq0f+000408
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMUAhq0f+000408
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180127/ICMGGhq0f+000384
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180127/ICMSHhq0f+000384
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180127/ICMUAhq0f+000384
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180127/ICMGGhq0f+000396
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180127/ICMSHhq0f+000396
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180127/ICMUAhq0f+000396
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0483_1994050100_123_963_12180127_2_r737818687_16.zip
Uploading the intermediate file: upload_file_16.zip
05:24:22 STEP 409 H= 409:00 +CPU= 7.612
05:24:29 STEP 410 H= 410:00 +CPU= 7.111
05:24:40 STEP 411 H= 411:00 +CPU= 10.395
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:24:53 STEP 412 H= 412:00 +CPU= 6.963
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Quit request received from BOINC client, ending the child process
..Failed, model did not complete successfully
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1994050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0483
(argv4) batchid: 963
(argv5) wuid: 12180127
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/36
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180127
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/36/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/36/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_269bb7bb5937830bdfea3ce9c4984509 to: /var/lib/boinc-client/slots/36/oifs_43r3_ps_0483_1994050100_123_963_12180127.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/36/oifs_43r3_ps_0483_1994050100_123_963_12180127.zip
ic_ancil_file: ic_ancil_12180127
ifsdata_file: ifsdata_12180127
climate_data_file: clim_data_12180127
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_d3cb5cd7d264232902dc61bc92d6e311 to: /var/lib/boinc-client/slots/36/ic_ancil_12180127.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/36/ic_ancil_12180127.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_d0a9095da84cd379de2364af164f8200 to: /var/lib/boinc-client/slots/36/ifsdata/ifsdata_12180127.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/36/ifsdata/ifsdata_12180127.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/36/159l_2/clim_data_12180127.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/36/159l_2/clim_data_12180127.zip
Checking for progress XML file: /var/lib/boinc-client/slots/36/progress_file_12180127.xml
Opened progress file ok : /var/lib/boinc-client/slots/36/progress_file_12180127.xml
-- Model is restarting --
Adjusting last_iter, 413, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/36/progress_file_12180127.xml
last_cpu_time: 3542
upload_file_number: 17
last_iter: 407
last_upload: 1468800
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0483_1994050100_123_963_12180127_2_r737818687
The child process has been launched with process id: 2113057
Executing the command: /var/lib/boinc-client/slots/36/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:ardbeg:1:1:2113057:2113057] [20230125:052602:1674617162:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:ardbeg:1:1:2113057:2113057] [20230125:052602:1674617162:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:ardbeg:1:1:2113057:2113057] [20230125:052602:1674617162:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:ardbeg:1:1:2113057:2113057] [20230125:052602:1674617162:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:ardbeg:1:1:2113057:2113057] [20230125:052602:1674617162:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:ardbeg:1:1:2113057:2113057] [20230125:052602:1674617162:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:ardbeg:1:1:2113057:2113057] [20230125:052602:1674617162:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:ardbeg:1:1:2113057:2113057] [20230125:052602:1674617162:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:ardbeg:1:1:2113057:2113057] [20230125:052602:1674617162:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:ardbeg:1:1:2113057:2113057] [20230125:052602:1674617162:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:ardbeg:1:1:2113057:2113057] [20230125:052602:1674617162:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:ardbeg:1:1:2113057:2113057] [20230125:052602:1674617162:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:ardbeg:1:1:2113057:2113057] [20230125:052602:1674617162:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:ardbeg:1:1:2113057:2113057] [20230125:052602:1674617162:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:ardbeg:1:1:2113057:2113057] [20230125:052602:1674617162:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:ardbeg:1:1:2113057:2113057] [20230125:052602:1674617162:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ardbeg:1:1:2113057:2113057] [20230125:052602:1674617162:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:ardbeg:1:1:2113057:2113057] [20230125:052602:1674617162:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ardbeg:1:1:2113057:2113057] [20230125:052602:1674617162:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:ardbeg:1:1:2113057:2113057] [20230125:052602:1674617162:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:ardbeg:1:1:2113057:2113057] [20230125:052602:1674617162:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ardbeg:1:1:2113057:2113057] [20230125:052602:1674617162:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ardbeg:1:1:2113057:2113057] [20230125:052602:1674617162:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:ardbeg:1:1:2113057:2113057] [20230125:052602:1674617162:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ardbeg:1:1:2113057:2113057] [20230125:052602:1674617162:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ardbeg:1:1:2113057:2113057] [20230125:052602:1674617162:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ardbeg:1:1:2113057:2113057] [20230125:052602:1674617162:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:ardbeg:1:1:2113057:2113057] [20230125:052602:1674617162:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:ardbeg:1:1:2113057:2113057] [20230125:052602:1674617162:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:ardbeg:1:1:2113057:2113057] [20230125:052602:1674617162:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:26:25 STEP 408 H= 408:00 +CPU= 13.688
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:26:34 STEP 409 H= 409:00 +CPU= 7.122
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:26:43 STEP 410 H= 410:00 +CPU= 6.808
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:26:59 STEP 411 H= 411:00 +CPU= 11.764
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:27:10 STEP 412 H= 412:00 +CPU= 7.009
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:27:21 STEP 413 H= 413:00 +CPU= 8.016
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:27:34 STEP 414 H= 414:00 +CPU= 10.820
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:27:48 STEP 415 H= 415:00 +CPU= 7.629
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:27:59 STEP 416 H= 416:00 +CPU= 6.993
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:28:19 STEP 417 H= 417:00 +CPU= 11.737
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:28:30 STEP 418 H= 418:00 +CPU= 7.067
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:28:43 STEP 419 H= 419:00 +CPU= 6.875
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:29:03 STEP 420 H= 420:00 +CPU= 11.639
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:29:14 STEP 421 H= 421:00 +CPU= 6.559
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMGGhq0f+000420
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMSHhq0f+000420
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMUAhq0f+000420
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:29:28 STEP 422 H= 422:00 +CPU= 8.123
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:29:45 STEP 423 H= 423:00 +CPU= 10.921
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:29:59 STEP 424 H= 424:00 +CPU= 7.723
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:30:10 STEP 425 H= 425:00 +CPU= 6.748
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:30:29 STEP 426 H= 426:00 +CPU= 10.943
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:30:40 STEP 427 H= 427:00 +CPU= 6.823
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:30:53 STEP 428 H= 428:00 +CPU= 6.739
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:31:13 STEP 429 H= 429:00 +CPU= 11.773
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:31:25 STEP 430 H= 430:00 +CPU= 8.114
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:31:38 STEP 431 H= 431:00 +CPU= 7.321
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:32:00 STEP 432 H= 432:00 +CPU= 13.174
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMGGhq0f+000432
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMSHhq0f+000432
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMUAhq0f+000432
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180127/ICMGGhq0f+000408
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180127/ICMSHhq0f+000408
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180127/ICMUAhq0f+000408
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180127/ICMGGhq0f+000420
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180127/ICMSHhq0f+000420
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180127/ICMUAhq0f+000420
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0483_1994050100_123_963_12180127_2_r737818687_17.zip
Uploading the intermediate file: upload_file_17.zip
05:32:09 STEP 433 H= 433:00 +CPU= 6.655
05:32:16 STEP 434 H= 434:00 +CPU= 7.199
05:32:27 STEP 435 H= 435:00 +CPU= 11.238
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:32:39 STEP 436 H= 436:00 +CPU= 7.120
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:32:48 STEP 437 H= 437:00 +CPU= 6.922
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:33:01 STEP 438 H= 438:00 +CPU= 11.140
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:33:14 STEP 439 H= 439:00 +CPU= 6.650
05:33:21 STEP 440 H= 440:00 +CPU= 6.723
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:33:36 STEP 441 H= 441:00 +CPU= 10.616
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:33:47 STEP 442 H= 442:00 +CPU= 6.810
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:33:56 STEP 443 H= 443:00 +CPU= 6.940
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:34:18 STEP 444 H= 444:00 +CPU= 12.489
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMGGhq0f+000444
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMSHhq0f+000444
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMUAhq0f+000444
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:34:30 STEP 445 H= 445:00 +CPU= 6.818
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:34:41 STEP 446 H= 446:00 +CPU= 6.856
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:34:59 STEP 447 H= 447:00 +CPU= 10.758
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:35:13 STEP 448 H= 448:00 +CPU= 7.754
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:35:22 STEP 449 H= 449:00 +CPU= 7.015
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:35:40 STEP 450 H= 450:00 +CPU= 11.277
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:35:51 STEP 451 H= 451:00 +CPU= 6.678
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:36:04 STEP 452 H= 452:00 +CPU= 7.089
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:36:21 STEP 453 H= 453:00 +CPU= 10.433
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:36:34 STEP 454 H= 454:00 +CPU= 6.950
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:36:45 STEP 455 H= 455:00 +CPU= 7.015
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:37:06 STEP 456 H= 456:00 +CPU= 13.019
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:37:19 STEP 457 H= 457:00 +CPU= 6.748
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMGGhq0f+000456
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMSHhq0f+000456
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMUAhq0f+000456
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180127/ICMGGhq0f+000432
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180127/ICMSHhq0f+000432
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180127/ICMUAhq0f+000432
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180127/ICMGGhq0f+000444
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180127/ICMSHhq0f+000444
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180127/ICMUAhq0f+000444
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0483_1994050100_123_963_12180127_2_r737818687_18.zip
Uploading the intermediate file: upload_file_18.zip
05:37:26 STEP 458 H= 458:00 +CPU= 7.303
05:37:38 STEP 459 H= 459:00 +CPU= 11.021
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:37:50 STEP 460 H= 460:00 +CPU= 7.872
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:37:59 STEP 461 H= 461:00 +CPU= 7.410
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:38:18 STEP 462 H= 462:00 +CPU= 11.183
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:38:30 STEP 463 H= 463:00 +CPU= 7.115
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:38:43 STEP 464 H= 464:00 +CPU= 7.074
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:39:00 STEP 465 H= 465:00 +CPU= 10.645
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:39:13 STEP 466 H= 466:00 +CPU= 7.094
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:39:22 STEP 467 H= 467:00 +CPU= 6.481
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:39:40 STEP 468 H= 468:00 +CPU= 12.005
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMGGhq0f+000468
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMSHhq0f+000468
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMUAhq0f+000468
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:39:51 STEP 469 H= 469:00 +CPU= 6.873
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:40:04 STEP 470 H= 470:00 +CPU= 6.852
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:40:23 STEP 471 H= 471:00 +CPU= 11.140
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:40:35 STEP 472 H= 472:00 +CPU= 7.064
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:40:46 STEP 473 H= 473:00 +CPU= 7.007
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:41:05 STEP 474 H= 474:00 +CPU= 11.364
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:41:18 STEP 475 H= 475:00 +CPU= 6.971
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:41:30 STEP 476 H= 476:00 +CPU= 7.463
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:41:50 STEP 477 H= 477:00 +CPU= 11.305
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:42:01 STEP 478 H= 478:00 +CPU= 7.142
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:42:14 STEP 479 H= 479:00 +CPU= 7.023
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:42:36 STEP 480 H= 480:00 +CPU= 13.573
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:42:45 STEP 481 H= 481:00 +CPU= 6.630
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMGGhq0f+000480
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMSHhq0f+000480
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMUAhq0f+000480
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180127/ICMGGhq0f+000456
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180127/ICMSHhq0f+000456
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180127/ICMUAhq0f+000456
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180127/ICMGGhq0f+000468
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180127/ICMSHhq0f+000468
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180127/ICMUAhq0f+000468
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0483_1994050100_123_963_12180127_2_r737818687_19.zip
Uploading the intermediate file: upload_file_19.zip
05:42:52 STEP 482 H= 482:00 +CPU= 7.044
05:43:03 STEP 483 H= 483:00 +CPU= 11.021
05:43:10 STEP 484 H= 484:00 +CPU= 7.007
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:43:23 STEP 485 H= 485:00 +CPU= 7.178
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:43:40 STEP 486 H= 486:00 +CPU= 10.736
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:43:53 STEP 487 H= 487:00 +CPU= 6.912
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:44:05 STEP 488 H= 488:00 +CPU= 7.000
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:44:23 STEP 489 H= 489:00 +CPU= 10.458
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:44:36 STEP 490 H= 490:00 +CPU= 8.023
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:44:48 STEP 491 H= 491:00 +CPU= 6.722
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:45:08 STEP 492 H= 492:00 +CPU= 11.652
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMGGhq0f+000492
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMSHhq0f+000492
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMUAhq0f+000492
05:45:19 STEP 493 H= 493:00 +CPU= 6.953
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:45:33 STEP 494 H= 494:00 +CPU= 7.156
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1994050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0483
(argv4) batchid: 963
(argv5) wuid: 12180127
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/36
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180127
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/36/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/36/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_269bb7bb5937830bdfea3ce9c4984509 to: /var/lib/boinc-client/slots/36/oifs_43r3_ps_0483_1994050100_123_963_12180127.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/36/oifs_43r3_ps_0483_1994050100_123_963_12180127.zip
ic_ancil_file: ic_ancil_12180127
ifsdata_file: ifsdata_12180127
climate_data_file: clim_data_12180127
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_d3cb5cd7d264232902dc61bc92d6e311 to: /var/lib/boinc-client/slots/36/ic_ancil_12180127.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/36/ic_ancil_12180127.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_d0a9095da84cd379de2364af164f8200 to: /var/lib/boinc-client/slots/36/ifsdata/ifsdata_12180127.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/36/ifsdata/ifsdata_12180127.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/36/159l_2/clim_data_12180127.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/36/159l_2/clim_data_12180127.zip
Checking for progress XML file: /var/lib/boinc-client/slots/36/progress_file_12180127.xml
Opened progress file ok : /var/lib/boinc-client/slots/36/progress_file_12180127.xml
-- Model is restarting --
Adjusting last_iter, 495, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/36/progress_file_12180127.xml
last_cpu_time: 4288
upload_file_number: 20
last_iter: 479
last_upload: 1728000
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0483_1994050100_123_963_12180127_2_r737818687
The child process has been launched with process id: 2149823
Executing the command: /var/lib/boinc-client/slots/36/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:ardbeg:1:1:2149823:2149823] [20230125:054646:1674618406:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:ardbeg:1:1:2149823:2149823] [20230125:054646:1674618406:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:ardbeg:1:1:2149823:2149823] [20230125:054646:1674618406:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:ardbeg:1:1:2149823:2149823] [20230125:054646:1674618406:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:ardbeg:1:1:2149823:2149823] [20230125:054646:1674618406:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:ardbeg:1:1:2149823:2149823] [20230125:054646:1674618406:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:ardbeg:1:1:2149823:2149823] [20230125:054646:1674618406:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:ardbeg:1:1:2149823:2149823] [20230125:054646:1674618406:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:ardbeg:1:1:2149823:2149823] [20230125:054646:1674618406:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:ardbeg:1:1:2149823:2149823] [20230125:054646:1674618406:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:ardbeg:1:1:2149823:2149823] [20230125:054646:1674618406:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:ardbeg:1:1:2149823:2149823] [20230125:054646:1674618406:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:ardbeg:1:1:2149823:2149823] [20230125:054646:1674618406:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:ardbeg:1:1:2149823:2149823] [20230125:054646:1674618406:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:ardbeg:1:1:2149823:2149823] [20230125:054646:1674618406:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:ardbeg:1:1:2149823:2149823] [20230125:054646:1674618406:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ardbeg:1:1:2149823:2149823] [20230125:054646:1674618406:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:ardbeg:1:1:2149823:2149823] [20230125:054646:1674618406:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ardbeg:1:1:2149823:2149823] [20230125:054646:1674618406:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:ardbeg:1:1:2149823:2149823] [20230125:054646:1674618406:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:ardbeg:1:1:2149823:2149823] [20230125:054646:1674618406:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ardbeg:1:1:2149823:2149823] [20230125:054646:1674618406:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ardbeg:1:1:2149823:2149823] [20230125:054646:1674618406:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:ardbeg:1:1:2149823:2149823] [20230125:054646:1674618406:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ardbeg:1:1:2149823:2149823] [20230125:054646:1674618406:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ardbeg:1:1:2149823:2149823] [20230125:054646:1674618406:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ardbeg:1:1:2149823:2149823] [20230125:054646:1674618406:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:ardbeg:1:1:2149823:2149823] [20230125:054646:1674618406:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:ardbeg:1:1:2149823:2149823] [20230125:054646:1674618406:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:ardbeg:1:1:2149823:2149823] [20230125:054646:1674618406:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:47:05 STEP 480 H= 480:00 +CPU= 12.110
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:47:19 STEP 481 H= 481:00 +CPU= 7.015
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:47:30 STEP 482 H= 482:00 +CPU= 6.962
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:47:49 STEP 483 H= 483:00 +CPU= 10.650
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:48:00 STEP 484 H= 484:00 +CPU= 6.796
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:48:10 STEP 485 H= 485:00 +CPU= 6.659
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:48:29 STEP 486 H= 486:00 +CPU= 10.719
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:48:40 STEP 487 H= 487:00 +CPU= 7.008
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:48:54 STEP 488 H= 488:00 +CPU= 7.133
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:49:09 STEP 489 H= 489:00 +CPU= 10.968
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:49:20 STEP 490 H= 490:00 +CPU= 6.827
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:49:28 STEP 491 H= 491:00 +CPU= 6.622
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:49:46 STEP 492 H= 492:00 +CPU= 11.790
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMGGhq0f+000492
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMSHhq0f+000492
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMUAhq0f+000492
05:49:55 STEP 493 H= 493:00 +CPU= 6.943
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:50:05 STEP 494 H= 494:00 +CPU= 7.252
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:50:24 STEP 495 H= 495:00 +CPU= 10.501
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:50:35 STEP 496 H= 496:00 +CPU= 6.997
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:50:44 STEP 497 H= 497:00 +CPU= 7.248
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:50:57 STEP 498 H= 498:00 +CPU= 11.048
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:51:08 STEP 499 H= 499:00 +CPU= 7.097
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:51:20 STEP 500 H= 500:00 +CPU= 7.017
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:51:36 STEP 501 H= 501:00 +CPU= 10.551
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:51:49 STEP 502 H= 502:00 +CPU= 6.853
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:52:01 STEP 503 H= 503:00 +CPU= 7.087
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:52:25 STEP 504 H= 504:00 +CPU= 13.418
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMGGhq0f+000504
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMSHhq0f+000504
Moving to projects directory: /var/lib/boinc-client/slots/36/ICMUAhq0f+000504
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180127/ICMGGhq0f+000480
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180127/ICMSHhq0f+000480
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180127/ICMUAhq0f+000480
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180127/ICMGGhq0f+000492
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180127/ICMSHhq0f+000492
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180127/ICMUAhq0f+000492
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0483_1994050100_123_963_12180127_2_r737818687_20.zip
Uploading the intermediate file: upload_file_20.zip
05:52:32 STEP 505 H= 505:00 +CPU= 7.015
05:52:38 STEP 506 H= 506:00 +CPU= 6.629
05:52:49 STEP 507 H= 507:00 +CPU= 10.433
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:53:00 STEP 508 H= 508:00 +CPU= 6.841
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:53:11 STEP 509 H= 509:00 +CPU= 6.774
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:53:30 STEP 510 H= 510:00 +CPU= 10.709
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:53:41 STEP 511 H= 511:00 +CPU= 7.028
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:53:54 STEP 512 H= 512:00 +CPU= 6.957
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:54:10 STEP 513 H= 513:00 +CPU= 10.428
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Abort request received from BOINC client, ending the child process
..Failed, model did not complete successfully
</stderr_txt>
]]>
