climateprediction.net home page
Task 22294000

Task 22294000

Name oifs_43r3_ps_0939_1994050100_123_963_12180583_1
Workunit 12180583
Created 28 Dec 2022, 6:21:51 UTC
Sent 19 Jan 2023, 12:31:36 UTC
Report deadline 20 Mar 2023, 12:31:36 UTC
Received 27 Jan 2023, 15:22:00 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 1 (0x00000001) Unknown error code
Computer ID 1534826
Run time 12 hours 12 min 51 sec
CPU time 25 min 3 sec
Validate state Invalid
Credit 11,854.08
Device peak FLOPS 7.39 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,767.52 MB
Peak swap size 4,978.08 MB
Peak disk usage 6,154.27 MB
Stderr
<core_client_version>7.18.1</core_client_version>
<![CDATA[
<message>
process exited with code 1 (0x1, -255)</message>
<stderr_txt>
127:153916:1674830356:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:50-privat:1:1:9657:9657] [20230127:153916:1674830356:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:50-privat:1:1:9657:9657] [20230127:153916:1674830356:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1994050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0939
(argv4) batchid: 963
(argv5) wuid: 12180583
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /root/slots/3
Project directory is: /root/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /root/projects/climateprediction.net/oifs_43r3_ps_12180583
..mkdir for temp folder for results failed
Copying: /root/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /root/slots/3/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /root/slots/3/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_a1ceb939816cdcc9be58c8fd8fc8e5cf to: /root/slots/3/oifs_43r3_ps_0939_1994050100_123_963_12180583.zip
Unzipping the namelist zip file: /root/slots/3/oifs_43r3_ps_0939_1994050100_123_963_12180583.zip
ic_ancil_file: ic_ancil_12180583
ifsdata_file: ifsdata_12180583
climate_data_file: clim_data_12180583
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_7773fff3d6921f79f40fc2014dc22d8f to: /root/slots/3/ic_ancil_12180583.zip
Unzipping the IC ancils zip file: /root/slots/3/ic_ancil_12180583.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_19c048edb957d87961c2fe802aecf096 to: /root/slots/3/ifsdata/ifsdata_12180583.zip
Unzipping the ifsdata_zip file: /root/slots/3/ifsdata/ifsdata_12180583.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /root/slots/3/159l_2/clim_data_12180583.zip
Unzipping the climate data zip file: /root/slots/3/159l_2/clim_data_12180583.zip
Checking for progress XML file: /root/slots/3/progress_file_12180583.xml
Creating progress file: /root/slots/3/progress_file_12180583.xml
last_cpu_time: 0
upload_file_number: 0
last_iter: 0
last_upload: 0
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0939_1994050100_123_963_12180583_1_r1275551596
The child process has been launched with process id: 9897
Executing the command: /root/slots/3/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:50-privat:1:1:9897:9897] [20230127:154027:1674830427:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:50-privat:1:1:9897:9897] [20230127:154027:1674830427:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:50-privat:1:1:9897:9897] [20230127:154027:1674830427:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:50-privat:1:1:9897:9897] [20230127:154027:1674830427:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:50-privat:1:1:9897:9897] [20230127:154027:1674830427:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:50-privat:1:1:9897:9897] [20230127:154027:1674830427:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:50-privat:1:1:9897:9897] [20230127:154027:1674830427:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:50-privat:1:1:9897:9897] [20230127:154027:1674830427:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:50-privat:1:1:9897:9897] [20230127:154027:1674830427:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:50-privat:1:1:9897:9897] [20230127:154027:1674830427:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:50-privat:1:1:9897:9897] [20230127:154027:1674830427:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:50-privat:1:1:9897:9897] [20230127:154027:1674830427:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:50-privat:1:1:9897:9897] [20230127:154027:1674830427:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:50-privat:1:1:9897:9897] [20230127:154027:1674830427:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:50-privat:1:1:9897:9897] [20230127:154027:1674830427:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:50-privat:1:1:9897:9897] [20230127:154027:1674830427:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:50-privat:1:1:9897:9897] [20230127:154027:1674830427:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:50-privat:1:1:9897:9897] [20230127:154027:1674830427:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:50-privat:1:1:9897:9897] [20230127:154027:1674830427:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:50-privat:1:1:9897:9897] [20230127:154027:1674830427:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:50-privat:1:1:9897:9897] [20230127:154027:1674830427:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:50-privat:1:1:9897:9897] [20230127:154027:1674830427:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:50-privat:1:1:9897:9897] [20230127:154027:1674830427:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:50-privat:1:1:9897:9897] [20230127:154027:1674830427:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:50-privat:1:1:9897:9897] [20230127:154027:1674830427:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:50-privat:1:1:9897:9897] [20230127:154027:1674830427:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:50-privat:1:1:9897:9897] [20230127:154027:1674830427:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:50-privat:1:1:9897:9897] [20230127:154027:1674830427:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:50-privat:1:1:9897:9897] [20230127:154027:1674830427:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:50-privat:1:1:9897:9897] [20230127:154027:1674830427:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1994050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0939
(argv4) batchid: 963
(argv5) wuid: 12180583
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /root/slots/3
Project directory is: /root/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /root/projects/climateprediction.net/oifs_43r3_ps_12180583
..mkdir for temp folder for results failed
Copying: /root/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /root/slots/3/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /root/slots/3/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_a1ceb939816cdcc9be58c8fd8fc8e5cf to: /root/slots/3/oifs_43r3_ps_0939_1994050100_123_963_12180583.zip
Unzipping the namelist zip file: /root/slots/3/oifs_43r3_ps_0939_1994050100_123_963_12180583.zip
ic_ancil_file: ic_ancil_12180583
ifsdata_file: ifsdata_12180583
climate_data_file: clim_data_12180583
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_7773fff3d6921f79f40fc2014dc22d8f to: /root/slots/3/ic_ancil_12180583.zip
Unzipping the IC ancils zip file: /root/slots/3/ic_ancil_12180583.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_19c048edb957d87961c2fe802aecf096 to: /root/slots/3/ifsdata/ifsdata_12180583.zip
Unzipping the ifsdata_zip file: /root/slots/3/ifsdata/ifsdata_12180583.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /root/slots/3/159l_2/clim_data_12180583.zip
Unzipping the climate data zip file: /root/slots/3/159l_2/clim_data_12180583.zip
Checking for progress XML file: /root/slots/3/progress_file_12180583.xml
Creating progress file: /root/slots/3/progress_file_12180583.xml
last_cpu_time: 0
upload_file_number: 0
last_iter: 0
last_upload: 0
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0939_1994050100_123_963_12180583_1_r1275551596
The child process has been launched with process id: 9999
Executing the command: /root/slots/3/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:50-privat:1:1:9999:9999] [20230127:154137:1674830497:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:50-privat:1:1:9999:9999] [20230127:154137:1674830497:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:50-privat:1:1:9999:9999] [20230127:154137:1674830497:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:50-privat:1:1:9999:9999] [20230127:154137:1674830497:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:50-privat:1:1:9999:9999] [20230127:154137:1674830497:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:50-privat:1:1:9999:9999] [20230127:154137:1674830497:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:50-privat:1:1:9999:9999] [20230127:154137:1674830497:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:50-privat:1:1:9999:9999] [20230127:154137:1674830497:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:50-privat:1:1:9999:9999] [20230127:154137:1674830497:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:50-privat:1:1:9999:9999] [20230127:154137:1674830497:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:50-privat:1:1:9999:9999] [20230127:154137:1674830497:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:50-privat:1:1:9999:9999] [20230127:154137:1674830497:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:50-privat:1:1:9999:9999] [20230127:154137:1674830497:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:50-privat:1:1:9999:9999] [20230127:154137:1674830497:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:50-privat:1:1:9999:9999] [20230127:154137:1674830497:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:50-privat:1:1:9999:9999] [20230127:154137:1674830497:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:50-privat:1:1:9999:9999] [20230127:154137:1674830497:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:50-privat:1:1:9999:9999] [20230127:154137:1674830497:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:50-privat:1:1:9999:9999] [20230127:154137:1674830497:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:50-privat:1:1:9999:9999] [20230127:154137:1674830497:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:50-privat:1:1:9999:9999] [20230127:154137:1674830497:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:50-privat:1:1:9999:9999] [20230127:154137:1674830497:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:50-privat:1:1:9999:9999] [20230127:154137:1674830497:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:50-privat:1:1:9999:9999] [20230127:154137:1674830497:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:50-privat:1:1:9999:9999] [20230127:154137:1674830497:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:50-privat:1:1:9999:9999] [20230127:154137:1674830497:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:50-privat:1:1:9999:9999] [20230127:154137:1674830497:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:50-privat:1:1:9999:9999] [20230127:154137:1674830497:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:50-privat:1:1:9999:9999] [20230127:154137:1674830497:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:50-privat:1:1:9999:9999] [20230127:154137:1674830497:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1994050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0939
(argv4) batchid: 963
(argv5) wuid: 12180583
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /root/slots/3
Project directory is: /root/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /root/projects/climateprediction.net/oifs_43r3_ps_12180583
..mkdir for temp folder for results failed
Copying: /root/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /root/slots/3/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /root/slots/3/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_a1ceb939816cdcc9be58c8fd8fc8e5cf to: /root/slots/3/oifs_43r3_ps_0939_1994050100_123_963_12180583.zip
Unzipping the namelist zip file: /root/slots/3/oifs_43r3_ps_0939_1994050100_123_963_12180583.zip
ic_ancil_file: ic_ancil_12180583
ifsdata_file: ifsdata_12180583
climate_data_file: clim_data_12180583
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_7773fff3d6921f79f40fc2014dc22d8f to: /root/slots/3/ic_ancil_12180583.zip
Unzipping the IC ancils zip file: /root/slots/3/ic_ancil_12180583.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_19c048edb957d87961c2fe802aecf096 to: /root/slots/3/ifsdata/ifsdata_12180583.zip
Unzipping the ifsdata_zip file: /root/slots/3/ifsdata/ifsdata_12180583.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /root/slots/3/159l_2/clim_data_12180583.zip
Unzipping the climate data zip file: /root/slots/3/159l_2/clim_data_12180583.zip
Checking for progress XML file: /root/slots/3/progress_file_12180583.xml
Creating progress file: /root/slots/3/progress_file_12180583.xml
last_cpu_time: 0
upload_file_number: 0
last_iter: 0
last_upload: 0
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0939_1994050100_123_963_12180583_1_r1275551596
The child process has been launched with process id: 10054
Executing the command: /root/slots/3/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:50-privat:1:1:10054:10054] [20230127:154247:1674830567:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:50-privat:1:1:10054:10054] [20230127:154247:1674830567:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:50-privat:1:1:10054:10054] [20230127:154247:1674830567:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:50-privat:1:1:10054:10054] [20230127:154247:1674830567:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:50-privat:1:1:10054:10054] [20230127:154247:1674830567:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:50-privat:1:1:10054:10054] [20230127:154247:1674830567:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:50-privat:1:1:10054:10054] [20230127:154247:1674830567:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:50-privat:1:1:10054:10054] [20230127:154247:1674830567:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:50-privat:1:1:10054:10054] [20230127:154247:1674830567:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:50-privat:1:1:10054:10054] [20230127:154247:1674830567:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:50-privat:1:1:10054:10054] [20230127:154247:1674830567:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:50-privat:1:1:10054:10054] [20230127:154247:1674830567:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:50-privat:1:1:10054:10054] [20230127:154247:1674830567:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:50-privat:1:1:10054:10054] [20230127:154247:1674830567:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:50-privat:1:1:10054:10054] [20230127:154247:1674830567:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:50-privat:1:1:10054:10054] [20230127:154247:1674830567:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:50-privat:1:1:10054:10054] [20230127:154247:1674830567:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:50-privat:1:1:10054:10054] [20230127:154247:1674830567:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:50-privat:1:1:10054:10054] [20230127:154247:1674830567:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:50-privat:1:1:10054:10054] [20230127:154247:1674830567:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:50-privat:1:1:10054:10054] [20230127:154247:1674830567:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:50-privat:1:1:10054:10054] [20230127:154247:1674830567:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:50-privat:1:1:10054:10054] [20230127:154247:1674830567:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:50-privat:1:1:10054:10054] [20230127:154247:1674830567:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:50-privat:1:1:10054:10054] [20230127:154247:1674830567:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:50-privat:1:1:10054:10054] [20230127:154247:1674830567:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:50-privat:1:1:10054:10054] [20230127:154247:1674830567:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:50-privat:1:1:10054:10054] [20230127:154247:1674830567:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:50-privat:1:1:10054:10054] [20230127:154247:1674830567:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:50-privat:1:1:10054:10054] [20230127:154247:1674830567:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1994050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0939
(argv4) batchid: 963
(argv5) wuid: 12180583
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /root/slots/3
Project directory is: /root/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /root/projects/climateprediction.net/oifs_43r3_ps_12180583
..mkdir for temp folder for results failed
Copying: /root/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /root/slots/3/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /root/slots/3/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_a1ceb939816cdcc9be58c8fd8fc8e5cf to: /root/slots/3/oifs_43r3_ps_0939_1994050100_123_963_12180583.zip
Unzipping the namelist zip file: /root/slots/3/oifs_43r3_ps_0939_1994050100_123_963_12180583.zip
ic_ancil_file: ic_ancil_12180583
ifsdata_file: ifsdata_12180583
climate_data_file: clim_data_12180583
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_7773fff3d6921f79f40fc2014dc22d8f to: /root/slots/3/ic_ancil_12180583.zip
Unzipping the IC ancils zip file: /root/slots/3/ic_ancil_12180583.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_19c048edb957d87961c2fe802aecf096 to: /root/slots/3/ifsdata/ifsdata_12180583.zip
Unzipping the ifsdata_zip file: /root/slots/3/ifsdata/ifsdata_12180583.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /root/slots/3/159l_2/clim_data_12180583.zip
Unzipping the climate data zip file: /root/slots/3/159l_2/clim_data_12180583.zip
Checking for progress XML file: /root/slots/3/progress_file_12180583.xml
Creating progress file: /root/slots/3/progress_file_12180583.xml
last_cpu_time: 0
upload_file_number: 0
last_iter: 0
last_upload: 0
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0939_1994050100_123_963_12180583_1_r1275551596
The child process has been launched with process id: 10277
Executing the command: /root/slots/3/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:50-privat:1:1:10277:10277] [20230127:154357:1674830637:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:50-privat:1:1:10277:10277] [20230127:154357:1674830637:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:50-privat:1:1:10277:10277] [20230127:154357:1674830637:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:50-privat:1:1:10277:10277] [20230127:154357:1674830637:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:50-privat:1:1:10277:10277] [20230127:154357:1674830637:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:50-privat:1:1:10277:10277] [20230127:154357:1674830637:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:50-privat:1:1:10277:10277] [20230127:154357:1674830637:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:50-privat:1:1:10277:10277] [20230127:154357:1674830637:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:50-privat:1:1:10277:10277] [20230127:154357:1674830637:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:50-privat:1:1:10277:10277] [20230127:154357:1674830637:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:50-privat:1:1:10277:10277] [20230127:154357:1674830637:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:50-privat:1:1:10277:10277] [20230127:154357:1674830637:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:50-privat:1:1:10277:10277] [20230127:154357:1674830637:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:50-privat:1:1:10277:10277] [20230127:154357:1674830637:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:50-privat:1:1:10277:10277] [20230127:154357:1674830637:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:50-privat:1:1:10277:10277] [20230127:154357:1674830637:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:50-privat:1:1:10277:10277] [20230127:154357:1674830637:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:50-privat:1:1:10277:10277] [20230127:154357:1674830637:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:50-privat:1:1:10277:10277] [20230127:154357:1674830637:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:50-privat:1:1:10277:10277] [20230127:154357:1674830637:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:50-privat:1:1:10277:10277] [20230127:154357:1674830637:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:50-privat:1:1:10277:10277] [20230127:154357:1674830637:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:50-privat:1:1:10277:10277] [20230127:154357:1674830637:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:50-privat:1:1:10277:10277] [20230127:154357:1674830637:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:50-privat:1:1:10277:10277] [20230127:154357:1674830637:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:50-privat:1:1:10277:10277] [20230127:154357:1674830637:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:50-privat:1:1:10277:10277] [20230127:154357:1674830637:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:50-privat:1:1:10277:10277] [20230127:154357:1674830637:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:50-privat:1:1:10277:10277] [20230127:154357:1674830637:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:50-privat:1:1:10277:10277] [20230127:154357:1674830637:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:44:31 STEP 2568 H=2568:00 +CPU= 26.442
Moving to projects directory: /root/slots/3/ICMGGhq0f+002568
Moving to projects directory: /root/slots/3/ICMSHhq0f+002568
Moving to projects directory: /root/slots/3/ICMUAhq0f+002568
Adding to the zip: /root/projects/climateprediction.net/oifs_43r3_ps_12180583/ICMGGhq0f+002544
Adding to the zip: /root/projects/climateprediction.net/oifs_43r3_ps_12180583/ICMSHhq0f+002544
Adding to the zip: /root/projects/climateprediction.net/oifs_43r3_ps_12180583/ICMUAhq0f+002544
Adding to the zip: /root/projects/climateprediction.net/oifs_43r3_ps_12180583/ICMGGhq0f+002556
Adding to the zip: /root/projects/climateprediction.net/oifs_43r3_ps_12180583/ICMSHhq0f+002556
Adding to the zip: /root/projects/climateprediction.net/oifs_43r3_ps_12180583/ICMUAhq0f+002556
Zipping up the intermediate file: /root/projects/climateprediction.net/oifs_43r3_ps_0939_1994050100_123_963_12180583_1_r1275551596_0.zip
Uploading the intermediate file: upload_file_0.zip
  15:44:44 STEP 2569 H=2569:00 +CPU= 12.726
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:45:00 STEP 2570 H=2570:00 +CPU= 13.621
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:45:29 STEP 2571 H=2571:00 +CPU= 22.721
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:45:45 STEP 2572 H=2572:00 +CPU= 13.642
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:46:04 STEP 2573 H=2573:00 +CPU= 14.813
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:46:34 STEP 2574 H=2574:00 +CPU= 24.518
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:46:53 STEP 2575 H=2575:00 +CPU= 14.064
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:47:13 STEP 2576 H=2576:00 +CPU= 16.364
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:47:44 STEP 2577 H=2577:00 +CPU= 24.191
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:48:04 STEP 2578 H=2578:00 +CPU= 15.455
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:48:25 STEP 2579 H=2579:00 +CPU= 17.174
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:49:00 STEP 2580 H=2580:00 +CPU= 26.755
Moving to projects directory: /root/slots/3/ICMGGhq0f+002580
Moving to projects directory: /root/slots/3/ICMSHhq0f+002580
Moving to projects directory: /root/slots/3/ICMUAhq0f+002580
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:49:20 STEP 2581 H=2581:00 +CPU= 15.426
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:49:41 STEP 2582 H=2582:00 +CPU= 16.174
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:50:11 STEP 2583 H=2583:00 +CPU= 23.844
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:50:30 STEP 2584 H=2584:00 +CPU= 15.021
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:50:49 STEP 2585 H=2585:00 +CPU= 15.229
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:51:21 STEP 2586 H=2586:00 +CPU= 24.590
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:51:41 STEP 2587 H=2587:00 +CPU= 15.768
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:52:02 STEP 2588 H=2588:00 +CPU= 16.547
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:52:31 STEP 2589 H=2589:00 +CPU= 23.100
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:52:52 STEP 2590 H=2590:00 +CPU= 16.400
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:53:12 STEP 2591 H=2591:00 +CPU= 16.027
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:53:45 STEP 2592 H=2592:00 +CPU= 26.843
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /root/slots/3/ICMGGhq0f+002592
Moving to projects directory: /root/slots/3/ICMSHhq0f+002592
Moving to projects directory: /root/slots/3/ICMUAhq0f+002592
Adding to the zip: /root/projects/climateprediction.net/oifs_43r3_ps_12180583/ICMGGhq0f+002568
Adding to the zip: /root/projects/climateprediction.net/oifs_43r3_ps_12180583/ICMSHhq0f+002568
Adding to the zip: /root/projects/climateprediction.net/oifs_43r3_ps_12180583/ICMUAhq0f+002568
Adding to the zip: /root/projects/climateprediction.net/oifs_43r3_ps_12180583/ICMGGhq0f+002580
Adding to the zip: /root/projects/climateprediction.net/oifs_43r3_ps_12180583/ICMSHhq0f+002580
Adding to the zip: /root/projects/climateprediction.net/oifs_43r3_ps_12180583/ICMUAhq0f+002580
Zipping up the intermediate file: /root/projects/climateprediction.net/oifs_43r3_ps_0939_1994050100_123_963_12180583_1_r1275551596_1.zip
Uploading the intermediate file: upload_file_1.zip
  15:54:03 STEP 2593 H=2593:00 +CPU= 15.439
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:54:21 STEP 2594 H=2594:00 +CPU= 15.541
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:54:51 STEP 2595 H=2595:00 +CPU= 23.479
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:55:12 STEP 2596 H=2596:00 +CPU= 16.695
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:55:32 STEP 2597 H=2597:00 +CPU= 16.034
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:56:02 STEP 2598 H=2598:00 +CPU= 24.071
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:56:23 STEP 2599 H=2599:00 +CPU= 15.876
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:56:42 STEP 2600 H=2600:00 +CPU= 15.589
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:57:13 STEP 2601 H=2601:00 +CPU= 23.833
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:57:33 STEP 2602 H=2602:00 +CPU= 16.211
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:57:53 STEP 2603 H=2603:00 +CPU= 15.164
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:58:25 STEP 2604 H=2604:00 +CPU= 26.487
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /root/slots/3/ICMGGhq0f+002604
Moving to projects directory: /root/slots/3/ICMSHhq0f+002604
Moving to projects directory: /root/slots/3/ICMUAhq0f+002604
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:58:46 STEP 2605 H=2605:00 +CPU= 16.062
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:59:06 STEP 2606 H=2606:00 +CPU= 15.956
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:59:36 STEP 2607 H=2607:00 +CPU= 23.798
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:59:56 STEP 2608 H=2608:00 +CPU= 15.710
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:00:15 STEP 2609 H=2609:00 +CPU= 14.278
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:00:45 STEP 2610 H=2610:00 +CPU= 23.778
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:01:05 STEP 2611 H=2611:00 +CPU= 15.549
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:01:23 STEP 2612 H=2612:00 +CPU= 14.512
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:01:54 STEP 2613 H=2613:00 +CPU= 24.282
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:02:14 STEP 2614 H=2614:00 +CPU= 16.212
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:02:33 STEP 2615 H=2615:00 +CPU= 14.560
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:03:10 STEP 2616 H=2616:00 +CPU= 28.308
Moving to projects directory: /root/slots/3/ICMGGhq0f+002616
Moving to projects directory: /root/slots/3/ICMSHhq0f+002616
Moving to projects directory: /root/slots/3/ICMUAhq0f+002616
Adding to the zip: /root/projects/climateprediction.net/oifs_43r3_ps_12180583/ICMGGhq0f+002592
Adding to the zip: /root/projects/climateprediction.net/oifs_43r3_ps_12180583/ICMSHhq0f+002592
Adding to the zip: /root/projects/climateprediction.net/oifs_43r3_ps_12180583/ICMUAhq0f+002592
Adding to the zip: /root/projects/climateprediction.net/oifs_43r3_ps_12180583/ICMGGhq0f+002604
Adding to the zip: /root/projects/climateprediction.net/oifs_43r3_ps_12180583/ICMSHhq0f+002604
Adding to the zip: /root/projects/climateprediction.net/oifs_43r3_ps_12180583/ICMUAhq0f+002604
Zipping up the intermediate file: /root/projects/climateprediction.net/oifs_43r3_ps_0939_1994050100_123_963_12180583_1_r1275551596_2.zip
Uploading the intermediate file: upload_file_2.zip
  16:03:27 STEP 2617 H=2617:00 +CPU= 16.471
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:03:43 STEP 2618 H=2618:00 +CPU= 14.382
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:04:14 STEP 2619 H=2619:00 +CPU= 24.597
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:04:34 STEP 2620 H=2620:00 +CPU= 15.520
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:04:53 STEP 2621 H=2621:00 +CPU= 14.520
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:05:25 STEP 2622 H=2622:00 +CPU= 25.884
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:05:44 STEP 2623 H=2623:00 +CPU= 14.552
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:06:05 STEP 2624 H=2624:00 +CPU= 16.093
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:06:37 STEP 2625 H=2625:00 +CPU= 25.662
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:06:57 STEP 2626 H=2626:00 +CPU= 15.463
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:07:15 STEP 2627 H=2627:00 +CPU= 14.348
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:07:52 STEP 2628 H=2628:00 +CPU= 27.653
Moving to projects directory: /root/slots/3/ICMGGhq0f+002628
Moving to projects directory: /root/slots/3/ICMSHhq0f+002628
Moving to projects directory: /root/slots/3/ICMUAhq0f+002628
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:08:11 STEP 2629 H=2629:00 +CPU= 14.886
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:08:31 STEP 2630 H=2630:00 +CPU= 15.922
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:09:03 STEP 2631 H=2631:00 +CPU= 25.347
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:09:23 STEP 2632 H=2632:00 +CPU= 15.540
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:09:43 STEP 2633 H=2633:00 +CPU= 15.724
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:10:16 STEP 2634 H=2634:00 +CPU= 26.293
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:10:35 STEP 2635 H=2635:00 +CPU= 14.736
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:10:55 STEP 2636 H=2636:00 +CPU= 16.223
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:11:26 STEP 2637 H=2637:00 +CPU= 24.260
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:11:46 STEP 2638 H=2638:00 +CPU= 15.372
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:12:06 STEP 2639 H=2639:00 +CPU= 15.880
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:12:43 STEP 2640 H=2640:00 +CPU= 28.266
Moving to projects directory: /root/slots/3/ICMGGhq0f+002640
Moving to projects directory: /root/slots/3/ICMSHhq0f+002640
Moving to projects directory: /root/slots/3/ICMUAhq0f+002640
Adding to the zip: /root/projects/climateprediction.net/oifs_43r3_ps_12180583/ICMGGhq0f+002616
Adding to the zip: /root/projects/climateprediction.net/oifs_43r3_ps_12180583/ICMSHhq0f+002616
Adding to the zip: /root/projects/climateprediction.net/oifs_43r3_ps_12180583/ICMUAhq0f+002616
Adding to the zip: /root/projects/climateprediction.net/oifs_43r3_ps_12180583/ICMGGhq0f+002628
Adding to the zip: /root/projects/climateprediction.net/oifs_43r3_ps_12180583/ICMSHhq0f+002628
Adding to the zip: /root/projects/climateprediction.net/oifs_43r3_ps_12180583/ICMUAhq0f+002628
Zipping up the intermediate file: /root/projects/climateprediction.net/oifs_43r3_ps_0939_1994050100_123_963_12180583_1_r1275551596_3.zip
Uploading the intermediate file: upload_file_3.zip
  16:12:58 STEP 2641 H=2641:00 +CPU= 14.813
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:13:17 STEP 2642 H=2642:00 +CPU= 16.445
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:13:49 STEP 2643 H=2643:00 +CPU= 24.284
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:14:09 STEP 2644 H=2644:00 +CPU= 15.612
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:14:30 STEP 2645 H=2645:00 +CPU= 16.583
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:15:02 STEP 2646 H=2646:00 +CPU= 25.446
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:15:22 STEP 2647 H=2647:00 +CPU= 15.690
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
The child process terminated with status: 0
..Failed, model did not complete successfully

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:43:18 1534826 22294000 oifs_43r3_ps_0939_1994050100_123_963_12180583_1 8,467,200 34,058 0.0040
09 May 2023 16:43:14 1534826 22294000 oifs_43r3_ps_0939_1994050100_123_963_12180583_1 7,430,400 29,552 0.0040
09 May 2023 16:42:14 1534826 22294000 oifs_43r3_ps_0939_1994050100_123_963_12180583_1 5,097,600 20,575 0.0040
09 May 2023 16:42:11 1534826 22294000 oifs_43r3_ps_0939_1994050100_123_963_12180583_1 4,233,600 17,480 0.0041
09 May 2023 16:42:08 1534826 22294000 oifs_43r3_ps_0939_1994050100_123_963_12180583_1 3,369,600 14,374 0.0043
09 May 2023 16:42:05 1534826 22294000 oifs_43r3_ps_0939_1994050100_123_963_12180583_1 2,505,600 11,110 0.0044
09 May 2023 16:28:48 1534826 22294000 oifs_43r3_ps_0939_1994050100_123_963_12180583_1 864,000 3,644 0.0042


©2024 climateprediction.net