<core_client_version>7.16.6</core_client_version>
<![CDATA[
<message>
Disk usage limit exceeded</message>
<stderr_txt>
he child process
12:03:00 STEP 1964 H=1964:00 +CPU= 22.389
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:05:14 STEP 1965 H=1965:00 +CPU= 32.911
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:06:47 STEP 1966 H=1966:00 +CPU= 21.553
12:07:09 STEP 1967 H=1967:00 +CPU= 21.391
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:09:29 STEP 1968 H=1968:00 +CPU= 38.427
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+001968
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+001968
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+001968
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185163/ICMGGhq0f+001944
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185163/ICMSHhq0f+001944
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185163/ICMUAhq0f+001944
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185163/ICMGGhq0f+001956
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185163/ICMSHhq0f+001956
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185163/ICMUAhq0f+001956
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0519_1999050100_123_968_12185163_0_r1015713260_81.zip
Uploading the intermediate file: upload_file_81.zip
12:09:50 STEP 1969 H=1969:00 +CPU= 20.479
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:11:32 STEP 1970 H=1970:00 +CPU= 21.330
12:12:05 STEP 1971 H=1971:00 +CPU= 32.845
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:13:48 STEP 1972 H=1972:00 +CPU= 21.248
12:14:09 STEP 1973 H=1973:00 +CPU= 20.802
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:15:53 STEP 1974 H=1974:00 +CPU= 32.949
12:16:14 STEP 1975 H=1975:00 +CPU= 21.047
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:17:46 STEP 1976 H=1976:00 +CPU= 21.304
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:19:20 STEP 1977 H=1977:00 +CPU= 32.056
12:19:42 STEP 1978 H=1978:00 +CPU= 21.999
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:20:54 STEP 1979 H=1979:00 +CPU= 20.965
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:22:41 STEP 1980 H=1980:00 +CPU= 36.078
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+001980
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+001980
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+001980
12:23:02 STEP 1981 H=1981:00 +CPU= 20.382
12:23:22 STEP 1982 H=1982:00 +CPU= 20.521
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:25:16 STEP 1983 H=1983:00 +CPU= 31.772
12:25:37 STEP 1984 H=1984:00 +CPU= 21.245
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:27:08 STEP 1985 H=1985:00 +CPU= 20.517
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:28:31 STEP 1986 H=1986:00 +CPU= 33.146
12:28:52 STEP 1987 H=1987:00 +CPU= 20.079
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:30:05 STEP 1988 H=1988:00 +CPU= 20.882
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:31:30 STEP 1989 H=1989:00 +CPU= 33.272
12:31:51 STEP 1990 H=1990:00 +CPU= 21.169
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:33:24 STEP 1991 H=1991:00 +CPU= 21.163
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:35:24 STEP 1992 H=1992:00 +CPU= 38.792
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+001992
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+001992
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+001992
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185163/ICMGGhq0f+001968
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185163/ICMSHhq0f+001968
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185163/ICMUAhq0f+001968
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185163/ICMGGhq0f+001980
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185163/ICMSHhq0f+001980
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185163/ICMUAhq0f+001980
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0519_1999050100_123_968_12185163_0_r1015713260_82.zip
Uploading the intermediate file: upload_file_82.zip
12:35:44 STEP 1993 H=1993:00 +CPU= 20.399
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:37:07 STEP 1994 H=1994:00 +CPU= 21.276
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:38:31 STEP 1995 H=1995:00 +CPU= 32.885
12:38:53 STEP 1996 H=1996:00 +CPU= 21.698
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:40:25 STEP 1997 H=1997:00 +CPU= 20.367
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:42:09 STEP 1998 H=1998:00 +CPU= 32.859
12:42:30 STEP 1999 H=1999:00 +CPU= 21.080
12:42:51 STEP 2000 H=2000:00 +CPU= 21.079
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:44:26 STEP 2001 H=2001:00 +CPU= 32.602
12:44:47 STEP 2002 H=2002:00 +CPU= 20.759
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:46:18 STEP 2003 H=2003:00 +CPU= 20.872
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:48:06 STEP 2004 H=2004:00 +CPU= 35.666
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002004
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002004
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002004
12:48:27 STEP 2005 H=2005:00 +CPU= 20.743
12:48:48 STEP 2006 H=2006:00 +CPU= 21.007
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:50:33 STEP 2007 H=2007:00 +CPU= 32.824
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:51:36 STEP 2008 H=2008:00 +CPU= 21.258
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:52:57 STEP 2009 H=2009:00 +CPU= 20.767
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:54:22 STEP 2010 H=2010:00 +CPU= 33.759
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:55:44 STEP 2011 H=2011:00 +CPU= 20.381
12:56:05 STEP 2012 H=2012:00 +CPU= 21.507
12:56:37 STEP 2013 H=2013:00 +CPU= 31.951
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:58:20 STEP 2014 H=2014:00 +CPU= 21.259
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:59:32 STEP 2015 H=2015:00 +CPU= 20.951
13:00:10 STEP 2016 H=2016:00 +CPU= 38.103
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002016
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002016
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002016
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185163/ICMGGhq0f+001992
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185163/ICMSHhq0f+001992
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185163/ICMUAhq0f+001992
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185163/ICMGGhq0f+002004
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185163/ICMSHhq0f+002004
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185163/ICMUAhq0f+002004
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0519_1999050100_123_968_12185163_0_r1015713260_83.zip
Uploading the intermediate file: upload_file_83.zip
13:00:29 STEP 2017 H=2017:00 +CPU= 18.755
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:02:23 STEP 2018 H=2018:00 +CPU= 20.068
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:04:08 STEP 2019 H=2019:00 +CPU= 33.177
13:04:29 STEP 2020 H=2020:00 +CPU= 20.995
13:04:49 STEP 2021 H=2021:00 +CPU= 20.584
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:06:35 STEP 2022 H=2022:00 +CPU= 34.187
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:07:57 STEP 2023 H=2023:00 +CPU= 21.243
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:09:19 STEP 2024 H=2024:00 +CPU= 21.493
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:10:44 STEP 2025 H=2025:00 +CPU= 33.084
13:11:06 STEP 2026 H=2026:00 +CPU= 21.782
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:12:27 STEP 2027 H=2027:00 +CPU= 20.429
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:13:44 STEP 2028 H=2028:00 +CPU= 36.001
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002028
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002028
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002028
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:14:56 STEP 2029 H=2029:00 +CPU= 20.559
13:15:17 STEP 2030 H=2030:00 +CPU= 20.950
13:15:49 STEP 2031 H=2031:00 +CPU= 32.264
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:17:41 STEP 2032 H=2032:00 +CPU= 21.257
13:18:02 STEP 2033 H=2033:00 +CPU= 20.048
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:19:48 STEP 2034 H=2034:00 +CPU= 33.872
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:21:30 STEP 2035 H=2035:00 +CPU= 21.586
Quit request received from BOINC client, ending the child process
..Failed, model did not complete successfully
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1999050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0519
(argv4) batchid: 968
(argv5) wuid: 12185163
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/1
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185163
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/1/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/1/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_200a82a7cf9761a9e0842caca25046f8 to: /var/lib/boinc-client/slots/1/oifs_43r3_ps_0519_1999050100_123_968_12185163.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/1/oifs_43r3_ps_0519_1999050100_123_968_12185163.zip
ic_ancil_file: ic_ancil_12185163
ifsdata_file: ifsdata_12185163
climate_data_file: clim_data_12185163
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_e3bf602c8107e121d1bbfacee4793b53 to: /var/lib/boinc-client/slots/1/ic_ancil_12185163.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/1/ic_ancil_12185163.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_10af139ae6830e9a7baf0e9fd4919c53 to: /var/lib/boinc-client/slots/1/ifsdata/ifsdata_12185163.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/1/ifsdata/ifsdata_12185163.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/1/159l_2/clim_data_12185163.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/1/159l_2/clim_data_12185163.zip
Checking for progress XML file: /var/lib/boinc-client/slots/1/progress_file_12185163.xml
Opened progress file ok : /var/lib/boinc-client/slots/1/progress_file_12185163.xml
-- Model is restarting --
Adjusting last_iter, 2036, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/1/progress_file_12185163.xml
last_cpu_time: 50835
upload_file_number: 84
last_iter: 2015
last_upload: 7257600
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0519_1999050100_123_968_12185163_0_r1015713260
The child process has been launched with process id: 3286182
Executing the command: /var/lib/boinc-client/slots/1/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:p500:1:1:3286182:3286182] [20230119:132316:1674102196:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:p500:1:1:3286182:3286182] [20230119:132316:1674102196:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:p500:1:1:3286182:3286182] [20230119:132316:1674102196:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:p500:1:1:3286182:3286182] [20230119:132316:1674102196:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:p500:1:1:3286182:3286182] [20230119:132316:1674102196:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:p500:1:1:3286182:3286182] [20230119:132316:1674102196:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:p500:1:1:3286182:3286182] [20230119:132316:1674102196:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:p500:1:1:3286182:3286182] [20230119:132316:1674102196:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:p500:1:1:3286182:3286182] [20230119:132316:1674102196:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:p500:1:1:3286182:3286182] [20230119:132316:1674102196:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:3286182:3286182] [20230119:132316:1674102196:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:p500:1:1:3286182:3286182] [20230119:132316:1674102196:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:p500:1:1:3286182:3286182] [20230119:132316:1674102196:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:p500:1:1:3286182:3286182] [20230119:132316:1674102196:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:3286182:3286182] [20230119:132316:1674102196:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:3286182:3286182] [20230119:132316:1674102196:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:3286182:3286182] [20230119:132316:1674102196:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:3286182:3286182] [20230119:132316:1674102196:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:3286182:3286182] [20230119:132316:1674102196:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:3286182:3286182] [20230119:132316:1674102196:0.001] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:3286182:3286182] [20230119:132316:1674102196:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:3286182:3286182] [20230119:132316:1674102196:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:3286182:3286182] [20230119:132316:1674102196:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:3286182:3286182] [20230119:132316:1674102196:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:3286182:3286182] [20230119:132316:1674102196:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:3286182:3286182] [20230119:132316:1674102196:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:3286182:3286182] [20230119:132316:1674102196:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:3286182:3286182] [20230119:132316:1674102196:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:3286182:3286182] [20230119:132316:1674102196:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:3286182:3286182] [20230119:132316:1674102196:0.001] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:25:01 STEP 2016 H=2016:00 +CPU= 38.126
13:25:22 STEP 2017 H=2017:00 +CPU= 21.048
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:26:35 STEP 2018 H=2018:00 +CPU= 21.577
13:27:07 STEP 2019 H=2019:00 +CPU= 32.312
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:28:40 STEP 2020 H=2020:00 +CPU= 21.217
13:29:00 STEP 2021 H=2021:00 +CPU= 19.961
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:30:55 STEP 2022 H=2022:00 +CPU= 33.736
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:32:17 STEP 2023 H=2023:00 +CPU= 20.535
13:32:38 STEP 2024 H=2024:00 +CPU= 20.870
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:34:21 STEP 2025 H=2025:00 +CPU= 32.709
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:35:53 STEP 2026 H=2026:00 +CPU= 21.382
13:36:14 STEP 2027 H=2027:00 +CPU= 20.674
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:37:49 STEP 2028 H=2028:00 +CPU= 35.534
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002028
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002028
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002028
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:39:21 STEP 2029 H=2029:00 +CPU= 20.290
13:39:42 STEP 2030 H=2030:00 +CPU= 20.868
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:41:24 STEP 2031 H=2031:00 +CPU= 32.192
13:41:45 STEP 2032 H=2032:00 +CPU= 20.703
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:43:27 STEP 2033 H=2033:00 +CPU= 20.562
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:45:51 STEP 2034 H=2034:00 +CPU= 32.894
13:46:12 STEP 2035 H=2035:00 +CPU= 21.177
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:47:54 STEP 2036 H=2036:00 +CPU= 21.378
13:48:26 STEP 2037 H=2037:00 +CPU= 32.583
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:49:58 STEP 2038 H=2038:00 +CPU= 21.248
13:50:19 STEP 2039 H=2039:00 +CPU= 21.529
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:52:29 STEP 2040 H=2040:00 +CPU= 38.565
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002040
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002040
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002040
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185163/ICMGGhq0f+002016
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185163/ICMSHhq0f+002016
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185163/ICMUAhq0f+002016
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185163/ICMGGhq0f+002028
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185163/ICMSHhq0f+002028
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185163/ICMUAhq0f+002028
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0519_1999050100_123_968_12185163_0_r1015713260_84.zip
Uploading the intermediate file: upload_file_84.zip
13:54:11 STEP 2041 H=2041:00 +CPU= 20.747
13:54:33 STEP 2042 H=2042:00 +CPU= 21.650
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:57:28 STEP 2043 H=2043:00 +CPU= 32.582
13:57:50 STEP 2044 H=2044:00 +CPU= 21.820
13:58:11 STEP 2045 H=2045:00 +CPU= 20.904
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:00:05 STEP 2046 H=2046:00 +CPU= 33.123
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:01:27 STEP 2047 H=2047:00 +CPU= 20.928
14:01:48 STEP 2048 H=2048:00 +CPU= 20.631
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:03:32 STEP 2049 H=2049:00 +CPU= 32.785
14:03:53 STEP 2050 H=2050:00 +CPU= 20.878
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
[EC_DRHOOK:p500:1:1:3286182:3286182] [20230119:153853:1674110333:8136.852] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1538] Received signal#15 (SIGTERM) :: 4749MB (heap), 4419MB (maxrss), 0MB (maxstack), 0 (paging), nsigs = 1
[EC_DRHOOK:p500:1:1:3286182:3286182] [20230119:153853:1674110333:8136.853] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1542] Also activating Harakiri-alarm (SIGALRM=14) to expire after 500s elapsed to prevent hangs, nsigs = 1
[EC_DRHOOK:p500:1:1:3286182:3286182] [20230119:153853:1674110333:8136.853] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1544] Harakiri signal handler 'signal_harakiri' for signal#14 (SIGALRM) installed at 0x81f3c0 (old at (nil))
[EC_DRHOOK:p500:1:1:3286182:3286182] [20230119:153853:1674110333:8136.853] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1617] Signal#15 was caused by unrecognized si_code [memaddr=0x1], nsigs = 1
[EC_DRHOOK:p500:1:1:3286182:3286182] [20230119:153853:1674110333:8136.853] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1686] Starting DrHook backtrace for signal#15, nsigs = 1
[EC_DRHOOK:p500:1:1:3286182:3286182] [20230119:153853:1674110333:8136.853] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3843] 4749 MB (maxheap), 4419 MB (maxrss), 0 MB (maxstack)
[EC_DRHOOK:p500:1:1:3286182:3286182] [20230119:153853:1674110333:8136.853] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : MASTER
[EC_DRHOOK:p500:1:1:3286182:3286182] [20230119:153853:1674110333:8136.853] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : CNT0
[EC_DRHOOK:p500:1:1:3286182:3286182] [20230119:153853:1674110333:8136.853] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : CNT1
[EC_DRHOOK:p500:1:1:3286182:3286182] [20230119:153853:1674110333:8136.853] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : CNT2
[EC_DRHOOK:p500:1:1:3286182:3286182] [20230119:153853:1674110333:8136.853] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : CNT3
[EC_DRHOOK:p500:1:1:3286182:3286182] [20230119:153853:1674110333:8136.853] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : CNT4
[EC_DRHOOK:p500:1:1:3286182:3286182] [20230119:153853:1674110333:8136.853] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : STEPO
[EC_DRHOOK:p500:1:1:3286182:3286182] [20230119:153853:1674110333:8136.853] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : SCAN2M
[EC_DRHOOK:p500:1:1:3286182:3286182] [20230119:153853:1674110333:8136.853] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : GP_MODEL_HEAP
[EC_DRHOOK:p500:1:1:3286182:3286182] [20230119:153853:1674110333:8136.853] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : GP_MODEL
[EC_DRHOOK:p500:1:1:3286182:3286182] [20230119:153853:1674110333:8136.853] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : CALL_SL_HEAP
[EC_DRHOOK:p500:1:1:3286182:3286182] [20230119:153853:1674110333:8136.853] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : CALL_SL
[EC_DRHOOK:p500:1:1:3286182:3286182] [20230119:153853:1674110333:8136.853] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : >OMP-CALL_SL 1 (1004)
[EC_DRHOOK:p500:1:1:3286182:3286182] [20230119:153853:1674110333:8136.853] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : LAPINEA
[EC_DRHOOK:p500:1:1:3286182:3286182] [20230119:153853:1674110333:8136.853] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : LARCINA
[EC_DRHOOK:p500:1:1:3286182:3286182] [20230119:153853:1674110333:8136.853] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : LASCAW
[EC_DRHOOK:p500:1:1:3286182:3286182] [20230119:153853:1674110333:8136.853] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : LASCAW_VINTW
[EC_DRHOOK:p500:1:1:3286182:3286182] [20230119:153854:1674110334:8137.853] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1734] DrHook backtrace done for signal#15, nsigs = 1
[EC_DRHOOK:p500:1:1:3286182:3286182] [20230119:153854:1674110334:8137.853] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1785] Calling previous signal handler at 0x1ce8bb0 for signal#15, nsigs = 1
forrtl: error (78): process killed (SIGTERM)
Image PC Routine Line Source
oifs_43r3_model.e 0000000001CE916B Unknown Unknown Unknown
oifs_43r3_model.e 000000000081FFF1 Unknown Unknown Unknown
oifs_43r3_model.e 0000000001DC9090 Unknown Unknown Unknown
oifs_43r3_model.e 0000000000E0770D lascaw_vintw_ 231 lascaw_vintw.F90
oifs_43r3_model.e 0000000000DFB6BB lascaw_ 888 lascaw.F90
oifs_43r3_model.e 0000000000DED525 larcina_ 319 larcina.F90
oifs_43r3_model.e 0000000000DE60CD lapinea_ 325 lapinea.F90
oifs_43r3_model.e 0000000000D7A4EC call_sl_ 300 call_sl.F90
oifs_43r3_model.e 0000000000D784FD call_sl_heap_ 94 call_sl_heap.F90
oifs_43r3_model.e 0000000000BF9958 gp_model_ 533 gp_model.F90
oifs_43r3_model.e 00000000012E9482 gp_model_heap_ 74 gp_model_heap.F90
oifs_43r3_model.e 0000000000BBC1CE scan2m_ 535 scan2m.F90
oifs_43r3_model.e 000000000057A664 stepo_ 327 stepo.F90
oifs_43r3_model.e 000000000055DEEC cnt4_ 1133 cnt4.F90
oifs_43r3_model.e 00000000005471C9 cnt3_ 267 cnt3.F90
oifs_43r3_model.e 0000000000546412 cnt2_ 88 cnt2.F90
oifs_43r3_model.e 0000000000545E28 cnt1_ 92 cnt1.F90
oifs_43r3_model.e 000000000040708D cnt0_ 146 cnt0.F90
oifs_43r3_model.e 000000000040220F MAIN__ 96 master.F90
oifs_43r3_model.e 00000000004021A2 Unknown Unknown Unknown
oifs_43r3_model.e 0000000001DCA390 Unknown Unknown Unknown
oifs_43r3_model.e 000000000040206E Unknown Unknown Unknown
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1999050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0519
(argv4) batchid: 968
(argv5) wuid: 12185163
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/1
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185163
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/1/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/1/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_200a82a7cf9761a9e0842caca25046f8 to: /var/lib/boinc-client/slots/1/oifs_43r3_ps_0519_1999050100_123_968_12185163.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/1/oifs_43r3_ps_0519_1999050100_123_968_12185163.zip
ic_ancil_file: ic_ancil_12185163
ifsdata_file: ifsdata_12185163
climate_data_file: clim_data_12185163
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_e3bf602c8107e121d1bbfacee4793b53 to: /var/lib/boinc-client/slots/1/ic_ancil_12185163.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/1/ic_ancil_12185163.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_10af139ae6830e9a7baf0e9fd4919c53 to: /var/lib/boinc-client/slots/1/ifsdata/ifsdata_12185163.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/1/ifsdata/ifsdata_12185163.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/1/159l_2/clim_data_12185163.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/1/159l_2/clim_data_12185163.zip
Checking for progress XML file: /var/lib/boinc-client/slots/1/progress_file_12185163.xml
Opened progress file ok : /var/lib/boinc-client/slots/1/progress_file_12185163.xml
-- Model is restarting --
Adjusting last_iter, 2051, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/1/progress_file_12185163.xml
last_cpu_time: 51729
upload_file_number: 85
last_iter: 2039
last_upload: 7344000
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0519_1999050100_123_968_12185163_0_r1015713260
The child process has been launched with process id: 52407
Executing the command: /var/lib/boinc-client/slots/1/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:p500:1:1:52407:52407] [20230119:195018:1674125418:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:p500:1:1:52407:52407] [20230119:195018:1674125418:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:p500:1:1:52407:52407] [20230119:195018:1674125418:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:p500:1:1:52407:52407] [20230119:195018:1674125418:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:p500:1:1:52407:52407] [20230119:195018:1674125418:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:p500:1:1:52407:52407] [20230119:195018:1674125418:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:p500:1:1:52407:52407] [20230119:195018:1674125418:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:p500:1:1:52407:52407] [20230119:195018:1674125418:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:p500:1:1:52407:52407] [20230119:195018:1674125418:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:p500:1:1:52407:52407] [20230119:195018:1674125418:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:52407:52407] [20230119:195018:1674125418:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:p500:1:1:52407:52407] [20230119:195018:1674125418:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:p500:1:1:52407:52407] [20230119:195018:1674125418:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:p500:1:1:52407:52407] [20230119:195018:1674125418:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:52407:52407] [20230119:195018:1674125418:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:52407:52407] [20230119:195018:1674125418:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:52407:52407] [20230119:195018:1674125418:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:52407:52407] [20230119:195018:1674125418:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:52407:52407] [20230119:195018:1674125418:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:52407:52407] [20230119:195018:1674125418:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:52407:52407] [20230119:195018:1674125418:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:52407:52407] [20230119:195018:1674125418:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:52407:52407] [20230119:195018:1674125418:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:52407:52407] [20230119:195018:1674125418:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:52407:52407] [20230119:195018:1674125418:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:52407:52407] [20230119:195018:1674125418:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:52407:52407] [20230119:195018:1674125418:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:52407:52407] [20230119:195018:1674125418:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:52407:52407] [20230119:195018:1674125418:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:52407:52407] [20230119:195018:1674125418:0.001] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:17:10 STEP 2040 H=2040:00 +CPU= 38.546
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:28:36 STEP 2041 H=2041:00 +CPU= 23.013
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:31:21 STEP 2042 H=2042:00 +CPU= 23.419
20:31:58 STEP 2043 H=2043:00 +CPU= 35.717
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:48:13 STEP 2044 H=2044:00 +CPU= 21.806
20:48:34 STEP 2045 H=2045:00 +CPU= 21.028
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:51:00 STEP 2046 H=2046:00 +CPU= 34.957
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:12:16 STEP 2047 H=2047:00 +CPU= 22.236
21:12:37 STEP 2048 H=2048:00 +CPU= 20.835
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:14:41 STEP 2049 H=2049:00 +CPU= 31.671
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:16:24 STEP 2050 H=2050:00 +CPU= 21.078
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:17:57 STEP 2051 H=2051:00 +CPU= 20.647
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:19:32 STEP 2052 H=2052:00 +CPU= 34.497
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002052
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002052
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002052
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:20:55 STEP 2053 H=2053:00 +CPU= 21.037
21:21:17 STEP 2054 H=2054:00 +CPU= 21.277
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:24:11 STEP 2055 H=2055:00 +CPU= 32.116
21:24:33 STEP 2056 H=2056:00 +CPU= 21.538
21:24:52 STEP 2057 H=2057:00 +CPU= 19.547
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:26:46 STEP 2058 H=2058:00 +CPU= 32.707
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:28:38 STEP 2059 H=2059:00 +CPU= 20.200
21:29:00 STEP 2060 H=2060:00 +CPU= 21.209
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:30:51 STEP 2061 H=2061:00 +CPU= 31.481
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:32:24 STEP 2062 H=2062:00 +CPU= 21.422
21:32:46 STEP 2063 H=2063:00 +CPU= 21.789
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:35:45 STEP 2064 H=2064:00 +CPU= 37.365
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002064
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002064
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002064
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185163/ICMGGhq0f+002040
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185163/ICMSHhq0f+002040
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185163/ICMUAhq0f+002040
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185163/ICMGGhq0f+002052
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185163/ICMSHhq0f+002052
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185163/ICMUAhq0f+002052
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0519_1999050100_123_968_12185163_0_r1015713260_85.zip
Uploading the intermediate file: upload_file_85.zip
21:36:07 STEP 2065 H=2065:00 +CPU= 21.282
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:37:36 STEP 2066 H=2066:00 +CPU= 20.568
21:38:08 STEP 2067 H=2067:00 +CPU= 31.503
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:40:01 STEP 2068 H=2068:00 +CPU= 21.479
21:40:22 STEP 2069 H=2069:00 +CPU= 21.138
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:43:26 STEP 2070 H=2070:00 +CPU= 32.744
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:44:48 STEP 2071 H=2071:00 +CPU= 20.649
21:45:09 STEP 2072 H=2072:00 +CPU= 21.447
21:45:40 STEP 2073 H=2073:00 +CPU= 31.310
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:47:33 STEP 2074 H=2074:00 +CPU= 21.034
21:47:53 STEP 2075 H=2075:00 +CPU= 19.928
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:49:38 STEP 2076 H=2076:00 +CPU= 34.452
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002076
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002076
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002076
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:51:09 STEP 2077 H=2077:00 +CPU= 19.741
21:51:30 STEP 2078 H=2078:00 +CPU= 21.277
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:54:15 STEP 2079 H=2079:00 +CPU= 32.810
21:54:37 STEP 2080 H=2080:00 +CPU= 21.487
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Quit request received from BOINC client, ending the child process
..Failed, model did not complete successfully
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1999050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0519
(argv4) batchid: 968
(argv5) wuid: 12185163
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/1
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185163
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/1/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/1/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_200a82a7cf9761a9e0842caca25046f8 to: /var/lib/boinc-client/slots/1/oifs_43r3_ps_0519_1999050100_123_968_12185163.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/1/oifs_43r3_ps_0519_1999050100_123_968_12185163.zip
ic_ancil_file: ic_ancil_12185163
ifsdata_file: ifsdata_12185163
climate_data_file: clim_data_12185163
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_e3bf602c8107e121d1bbfacee4793b53 to: /var/lib/boinc-client/slots/1/ic_ancil_12185163.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/1/ic_ancil_12185163.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_10af139ae6830e9a7baf0e9fd4919c53 to: /var/lib/boinc-client/slots/1/ifsdata/ifsdata_12185163.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/1/ifsdata/ifsdata_12185163.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/1/159l_2/clim_data_12185163.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/1/159l_2/clim_data_12185163.zip
Checking for progress XML file: /var/lib/boinc-client/slots/1/progress_file_12185163.xml
Opened progress file ok : /var/lib/boinc-client/slots/1/progress_file_12185163.xml
-- Model is restarting --
Adjusting last_iter, 2081, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/1/progress_file_12185163.xml
last_cpu_time: 52789
upload_file_number: 86
last_iter: 2063
last_upload: 7430400
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0519_1999050100_123_968_12185163_0_r1015713260
The child process has been launched with process id: 74063
Executing the command: /var/lib/boinc-client/slots/1/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:p500:1:1:74063:74063] [20230119:215707:1674133027:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:p500:1:1:74063:74063] [20230119:215707:1674133027:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:p500:1:1:74063:74063] [20230119:215707:1674133027:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:p500:1:1:74063:74063] [20230119:215707:1674133027:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:p500:1:1:74063:74063] [20230119:215707:1674133027:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:p500:1:1:74063:74063] [20230119:215707:1674133027:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:p500:1:1:74063:74063] [20230119:215707:1674133027:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:p500:1:1:74063:74063] [20230119:215707:1674133027:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:p500:1:1:74063:74063] [20230119:215707:1674133027:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:p500:1:1:74063:74063] [20230119:215707:1674133027:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:74063:74063] [20230119:215707:1674133027:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:p500:1:1:74063:74063] [20230119:215707:1674133027:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:p500:1:1:74063:74063] [20230119:215707:1674133027:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:p500:1:1:74063:74063] [20230119:215707:1674133027:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:74063:74063] [20230119:215707:1674133027:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:p500:1:1:74063:74063] [20230119:215707:1674133027:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:74063:74063] [20230119:215707:1674133027:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:74063:74063] [20230119:215707:1674133027:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:74063:74063] [20230119:215707:1674133027:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:74063:74063] [20230119:215707:1674133027:0.001] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:p500:1:1:74063:74063] [20230119:215707:1674133027:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:74063:74063] [20230119:215707:1674133027:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:74063:74063] [20230119:215707:1674133027:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:74063:74063] [20230119:215707:1674133027:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:74063:74063] [20230119:215707:1674133027:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:74063:74063] [20230119:215707:1674133027:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:p500:1:1:74063:74063] [20230119:215707:1674133027:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:74063:74063] [20230119:215707:1674133027:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:74063:74063] [20230119:215707:1674133027:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:p500:1:1:74063:74063] [20230119:215707:1674133027:0.001] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:58:48 STEP 2064 H=2064:00 +CPU= 36.466
21:59:09 STEP 2065 H=2065:00 +CPU= 20.274
21:59:29 STEP 2066 H=2066:00 +CPU= 20.051
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:01:22 STEP 2067 H=2067:00 +CPU= 31.806
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:03:04 STEP 2068 H=2068:00 +CPU= 21.770
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:04:27 STEP 2069 H=2069:00 +CPU= 21.399
22:04:59 STEP 2070 H=2070:00 +CPU= 32.361
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:06:32 STEP 2071 H=2071:00 +CPU= 20.060
22:06:53 STEP 2072 H=2072:00 +CPU= 21.565
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:08:59 STEP 2073 H=2073:00 +CPU= 33.196
22:09:20 STEP 2074 H=2074:00 +CPU= 21.057
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:11:10 STEP 2075 H=2075:00 +CPU= 19.700
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:13:37 STEP 2076 H=2076:00 +CPU= 35.792
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002076
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002076
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002076
22:13:59 STEP 2077 H=2077:00 +CPU= 21.787
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:15:32 STEP 2078 H=2078:00 +CPU= 22.020
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:17:05 STEP 2079 H=2079:00 +CPU= 32.729
22:17:27 STEP 2080 H=2080:00 +CPU= 21.153
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:18:59 STEP 2081 H=2081:00 +CPU= 20.450
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:21:03 STEP 2082 H=2082:00 +CPU= 32.919
22:21:24 STEP 2083 H=2083:00 +CPU= 20.900
22:21:45 STEP 2084 H=2084:00 +CPU= 20.891
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:24:40 STEP 2085 H=2085:00 +CPU= 33.161
22:25:02 STEP 2086 H=2086:00 +CPU= 21.732
22:25:22 STEP 2087 H=2087:00 +CPU= 19.855
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:28:42 STEP 2088 H=2088:00 +CPU= 37.920
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002088
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002088
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002088
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185163/ICMGGhq0f+002064
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185163/ICMSHhq0f+002064
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185163/ICMUAhq0f+002064
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185163/ICMGGhq0f+002076
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185163/ICMSHhq0f+002076
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185163/ICMUAhq0f+002076
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0519_1999050100_123_968_12185163_0_r1015713260_86.zip
Uploading the intermediate file: upload_file_86.zip
22:29:03 STEP 2089 H=2089:00 +CPU= 21.028
22:29:24 STEP 2090 H=2090:00 +CPU= 20.318
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:31:17 STEP 2091 H=2091:00 +CPU= 32.033
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:32:49 STEP 2092 H=2092:00 +CPU= 20.522
22:33:10 STEP 2093 H=2093:00 +CPU= 21.043
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:35:15 STEP 2094 H=2094:00 +CPU= 33.784
22:35:35 STEP 2095 H=2095:00 +CPU= 20.574
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:37:28 STEP 2096 H=2096:00 +CPU= 21.520
22:38:00 STEP 2097 H=2097:00 +CPU= 32.120
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:39:52 STEP 2098 H=2098:00 +CPU= 20.825
22:40:13 STEP 2099 H=2099:00 +CPU= 20.644
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Abort request received from BOINC client, ending the child process
</stderr_txt>
]]>
