<core_client_version>7.20.2</core_client_version>
<![CDATA[
<message>
Disk usage limit exceeded</message>
<stderr_txt>
146 cnt0.F90
oifs_43r3_model.e 000000000040220F MAIN__ 96 master.F90
oifs_43r3_model.e 00000000004021A2 Unknown Unknown Unknown
oifs_43r3_model.e 0000000001DCA390 Unknown Unknown Unknown
oifs_43r3_model.e 000000000040206E Unknown Unknown Unknown
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1990050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0135
(argv4) batchid: 959
(argv5) wuid: 12175779
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /data/boinc/boinc-client/slots/1
Project directory is: /data/boinc/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779
..mkdir for temp folder for results failed
Copying: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /data/boinc/boinc-client/slots/1/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /data/boinc/boinc-client/slots/1/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_cdbe9a24cbe93add2311c72846577cbd to: /data/boinc/boinc-client/slots/1/oifs_43r3_ps_0135_1990050100_123_959_12175779.zip
Unzipping the namelist zip file: /data/boinc/boinc-client/slots/1/oifs_43r3_ps_0135_1990050100_123_959_12175779.zip
ic_ancil_file: ic_ancil_12175779
ifsdata_file: ifsdata_12175779
climate_data_file: clim_data_12175779
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_c5e1dd845347a7846435bfdf28d3d536 to: /data/boinc/boinc-client/slots/1/ic_ancil_12175779.zip
Unzipping the IC ancils zip file: /data/boinc/boinc-client/slots/1/ic_ancil_12175779.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_32dadcc4d1f6c09909249875340185df to: /data/boinc/boinc-client/slots/1/ifsdata/ifsdata_12175779.zip
Unzipping the ifsdata_zip file: /data/boinc/boinc-client/slots/1/ifsdata/ifsdata_12175779.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /data/boinc/boinc-client/slots/1/159l_2/clim_data_12175779.zip
Unzipping the climate data zip file: /data/boinc/boinc-client/slots/1/159l_2/clim_data_12175779.zip
Checking for progress XML file: /data/boinc/boinc-client/slots/1/progress_file_12175779.xml
Opened progress file ok : /data/boinc/boinc-client/slots/1/progress_file_12175779.xml
-- Model is restarting --
Adjusting last_iter, 1168, to previous model restart step.
Creating progress file: /data/boinc/boinc-client/slots/1/progress_file_12175779.xml
last_cpu_time: 46060
upload_file_number: 48
last_iter: 1151
last_upload: 4147200
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0135_1990050100_123_959_12175779_0_r1972005946
The child process has been launched with process id: 21124
Executing the command: /data/boinc/boinc-client/slots/1/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21124:21124] [20221226:105004:1672051804:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21124:21124] [20221226:105004:1672051804:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21124:21124] [20221226:105004:1672051804:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21124:21124] [20221226:105004:1672051804:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21124:21124] [20221226:105004:1672051804:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21124:21124] [20221226:105004:1672051804:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21124:21124] [20221226:105004:1672051804:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21124:21124] [20221226:105004:1672051804:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21124:21124] [20221226:105004:1672051804:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21124:21124] [20221226:105004:1672051804:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21124:21124] [20221226:105004:1672051804:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21124:21124] [20221226:105004:1672051804:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21124:21124] [20221226:105004:1672051804:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21124:21124] [20221226:105004:1672051804:0.001] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21124:21124] [20221226:105004:1672051804:0.001] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21124:21124] [20221226:105004:1672051804:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21124:21124] [20221226:105004:1672051804:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21124:21124] [20221226:105004:1672051804:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21124:21124] [20221226:105004:1672051804:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21124:21124] [20221226:105004:1672051804:0.001] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21124:21124] [20221226:105004:1672051804:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21124:21124] [20221226:105004:1672051804:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21124:21124] [20221226:105004:1672051804:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21124:21124] [20221226:105004:1672051804:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21124:21124] [20221226:105004:1672051804:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21124:21124] [20221226:105004:1672051804:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21124:21124] [20221226:105004:1672051804:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21124:21124] [20221226:105004:1672051804:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21124:21124] [20221226:105004:1672051804:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21124:21124] [20221226:105004:1672051804:0.001] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:32:56 STEP 1152 H=1152:00 +CPU= 54.235
11:33:26 STEP 1153 H=1153:00 +CPU= 29.736
11:33:57 STEP 1154 H=1154:00 +CPU= 31.262
11:34:45 STEP 1155 H=1155:00 +CPU= 46.838
11:35:16 STEP 1156 H=1156:00 +CPU= 30.272
11:35:46 STEP 1157 H=1157:00 +CPU= 29.930
11:36:34 STEP 1158 H=1158:00 +CPU= 47.924
11:37:04 STEP 1159 H=1159:00 +CPU= 29.717
11:37:36 STEP 1160 H=1160:00 +CPU= 31.174
11:38:23 STEP 1161 H=1161:00 +CPU= 47.077
11:38:55 STEP 1162 H=1162:00 +CPU= 31.192
11:39:25 STEP 1163 H=1163:00 +CPU= 30.241
11:40:17 STEP 1164 H=1164:00 +CPU= 51.451
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMGGhq0f+001164
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMSHhq0f+001164
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMUAhq0f+001164
11:40:46 STEP 1165 H=1165:00 +CPU= 28.799
11:41:17 STEP 1166 H=1166:00 +CPU= 30.449
11:42:05 STEP 1167 H=1167:00 +CPU= 47.266
11:42:35 STEP 1168 H=1168:00 +CPU= 30.297
11:43:05 STEP 1169 H=1169:00 +CPU= 29.019
11:43:54 STEP 1170 H=1170:00 +CPU= 48.080
11:44:24 STEP 1171 H=1171:00 +CPU= 29.640
11:44:55 STEP 1172 H=1172:00 +CPU= 31.283
11:45:43 STEP 1173 H=1173:00 +CPU= 47.498
11:46:15 STEP 1174 H=1174:00 +CPU= 31.105
11:46:45 STEP 1175 H=1175:00 +CPU= 30.469
11:47:37 STEP 1176 H=1176:00 +CPU= 51.210
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMGGhq0f+001176
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMSHhq0f+001176
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMUAhq0f+001176
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMGGhq0f+001152
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMSHhq0f+001152
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMUAhq0f+001152
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMGGhq0f+001164
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMSHhq0f+001164
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMUAhq0f+001164
Zipping up the intermediate file: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0135_1990050100_123_959_12175779_0_r1972005946_48.zip
Uploading the intermediate file: upload_file_48.zip
11:48:05 STEP 1177 H=1177:00 +CPU= 27.642
11:48:36 STEP 1178 H=1178:00 +CPU= 30.381
11:49:22 STEP 1179 H=1179:00 +CPU= 45.952
11:49:52 STEP 1180 H=1180:00 +CPU= 29.430
11:50:21 STEP 1181 H=1181:00 +CPU= 29.134
11:51:10 STEP 1182 H=1182:00 +CPU= 48.414
11:51:39 STEP 1183 H=1183:00 +CPU= 28.563
11:52:10 STEP 1184 H=1184:00 +CPU= 30.363
11:52:58 STEP 1185 H=1185:00 +CPU= 47.268
11:53:28 STEP 1186 H=1186:00 +CPU= 29.935
11:53:58 STEP 1187 H=1187:00 +CPU= 29.648
11:54:48 STEP 1188 H=1188:00 +CPU= 49.869
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMGGhq0f+001188
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMSHhq0f+001188
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMUAhq0f+001188
11:55:17 STEP 1189 H=1189:00 +CPU= 28.722
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:50:16 STEP 1190 H=1190:00 +CPU= 29.606
12:51:02 STEP 1191 H=1191:00 +CPU= 46.099
12:51:32 STEP 1192 H=1192:00 +CPU= 28.949
12:52:01 STEP 1193 H=1193:00 +CPU= 28.810
12:52:47 STEP 1194 H=1194:00 +CPU= 45.863
12:53:15 STEP 1195 H=1195:00 +CPU= 28.137
12:53:46 STEP 1196 H=1196:00 +CPU= 30.238
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:39:34 STEP 1197 H=1197:00 +CPU= 45.209
13:40:05 STEP 1198 H=1198:00 +CPU= 29.839
13:40:34 STEP 1199 H=1199:00 +CPU= 29.327
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:25:23 STEP 1200 H=1200:00 +CPU= 54.871
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMGGhq0f+001200
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMSHhq0f+001200
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMUAhq0f+001200
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMGGhq0f+001176
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMSHhq0f+001176
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMUAhq0f+001176
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMGGhq0f+001188
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMSHhq0f+001188
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMUAhq0f+001188
Zipping up the intermediate file: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0135_1990050100_123_959_12175779_0_r1972005946_49.zip
Uploading the intermediate file: upload_file_49.zip
14:25:54 STEP 1201 H=1201:00 +CPU= 30.148
14:26:24 STEP 1202 H=1202:00 +CPU= 30.251
14:27:12 STEP 1203 H=1203:00 +CPU= 46.857
14:27:44 STEP 1204 H=1204:00 +CPU= 30.656
14:28:14 STEP 1205 H=1205:00 +CPU= 29.653
14:29:02 STEP 1206 H=1206:00 +CPU= 46.985
14:29:32 STEP 1207 H=1207:00 +CPU= 29.568
14:30:03 STEP 1208 H=1208:00 +CPU= 29.966
14:30:50 STEP 1209 H=1209:00 +CPU= 46.191
14:31:21 STEP 1210 H=1210:00 +CPU= 30.341
14:31:51 STEP 1211 H=1211:00 +CPU= 29.620
14:32:43 STEP 1212 H=1212:00 +CPU= 50.908
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMGGhq0f+001212
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMSHhq0f+001212
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMUAhq0f+001212
14:33:13 STEP 1213 H=1213:00 +CPU= 29.767
14:33:45 STEP 1214 H=1214:00 +CPU= 30.702
14:34:32 STEP 1215 H=1215:00 +CPU= 46.638
14:35:03 STEP 1216 H=1216:00 +CPU= 30.152
14:35:32 STEP 1217 H=1217:00 +CPU= 28.913
14:36:20 STEP 1218 H=1218:00 +CPU= 47.269
14:36:50 STEP 1219 H=1219:00 +CPU= 29.158
14:37:20 STEP 1220 H=1220:00 +CPU= 29.534
14:38:06 STEP 1221 H=1221:00 +CPU= 44.734
14:38:36 STEP 1222 H=1222:00 +CPU= 29.747
14:39:06 STEP 1223 H=1223:00 +CPU= 29.699
14:40:00 STEP 1224 H=1224:00 +CPU= 54.481
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMGGhq0f+001224
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMSHhq0f+001224
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMUAhq0f+001224
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMGGhq0f+001200
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMSHhq0f+001200
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMUAhq0f+001200
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMGGhq0f+001212
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMSHhq0f+001212
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMUAhq0f+001212
Zipping up the intermediate file: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0135_1990050100_123_959_12175779_0_r1972005946_50.zip
Uploading the intermediate file: upload_file_50.zip
14:40:29 STEP 1225 H=1225:00 +CPU= 28.687
14:40:59 STEP 1226 H=1226:00 +CPU= 29.857
14:41:45 STEP 1227 H=1227:00 +CPU= 45.351
14:42:16 STEP 1228 H=1228:00 +CPU= 30.133
14:42:44 STEP 1229 H=1229:00 +CPU= 28.508
14:43:31 STEP 1230 H=1230:00 +CPU= 46.317
14:43:59 STEP 1231 H=1231:00 +CPU= 28.028
14:44:29 STEP 1232 H=1232:00 +CPU= 29.617
14:45:14 STEP 1233 H=1233:00 +CPU= 44.485
14:45:43 STEP 1234 H=1234:00 +CPU= 29.187
14:46:12 STEP 1235 H=1235:00 +CPU= 28.519
14:47:03 STEP 1236 H=1236:00 +CPU= 50.558
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMGGhq0f+001236
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMSHhq0f+001236
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMUAhq0f+001236
14:47:31 STEP 1237 H=1237:00 +CPU= 28.198
14:48:01 STEP 1238 H=1238:00 +CPU= 29.325
14:48:47 STEP 1239 H=1239:00 +CPU= 45.196
14:49:16 STEP 1240 H=1240:00 +CPU= 29.524
14:49:45 STEP 1241 H=1241:00 +CPU= 28.485
14:50:31 STEP 1242 H=1242:00 +CPU= 45.797
14:51:00 STEP 1243 H=1243:00 +CPU= 28.189
14:51:30 STEP 1244 H=1244:00 +CPU= 29.625
14:52:15 STEP 1245 H=1245:00 +CPU= 45.292
14:52:44 STEP 1246 H=1246:00 +CPU= 28.994
14:53:14 STEP 1247 H=1247:00 +CPU= 29.250
14:54:08 STEP 1248 H=1248:00 +CPU= 53.229
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMGGhq0f+001248
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMSHhq0f+001248
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMUAhq0f+001248
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMGGhq0f+001224
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMSHhq0f+001224
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMUAhq0f+001224
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMGGhq0f+001236
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMSHhq0f+001236
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMUAhq0f+001236
Zipping up the intermediate file: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0135_1990050100_123_959_12175779_0_r1972005946_51.zip
Uploading the intermediate file: upload_file_51.zip
14:54:36 STEP 1249 H=1249:00 +CPU= 28.534
14:55:05 STEP 1250 H=1250:00 +CPU= 28.246
14:55:51 STEP 1251 H=1251:00 +CPU= 46.048
14:56:21 STEP 1252 H=1252:00 +CPU= 29.641
14:56:50 STEP 1253 H=1253:00 +CPU= 28.595
14:57:36 STEP 1254 H=1254:00 +CPU= 45.747
14:58:05 STEP 1255 H=1255:00 +CPU= 29.192
14:58:35 STEP 1256 H=1256:00 +CPU= 29.143
14:59:21 STEP 1257 H=1257:00 +CPU= 45.754
14:59:51 STEP 1258 H=1258:00 +CPU= 29.892
15:00:20 STEP 1259 H=1259:00 +CPU= 28.802
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
17:25:18 STEP 1260 H=1260:00 +CPU= 49.699
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMGGhq0f+001260
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMSHhq0f+001260
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMUAhq0f+001260
17:25:46 STEP 1261 H=1261:00 +CPU= 28.586
17:26:16 STEP 1262 H=1262:00 +CPU= 28.923
17:27:00 STEP 1263 H=1263:00 +CPU= 43.776
17:27:29 STEP 1264 H=1264:00 +CPU= 29.288
17:27:59 STEP 1265 H=1265:00 +CPU= 29.057
17:28:46 STEP 1266 H=1266:00 +CPU= 47.139
17:29:15 STEP 1267 H=1267:00 +CPU= 28.419
17:29:44 STEP 1268 H=1268:00 +CPU= 29.561
17:30:30 STEP 1269 H=1269:00 +CPU= 44.941
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
17:33:01 STEP 1270 H=1270:00 +CPU= 30.047
17:33:32 STEP 1271 H=1271:00 +CPU= 30.572
17:34:26 STEP 1272 H=1272:00 +CPU= 53.509
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMGGhq0f+001272
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMSHhq0f+001272
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMUAhq0f+001272
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMGGhq0f+001248
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMSHhq0f+001248
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMUAhq0f+001248
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMGGhq0f+001260
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMSHhq0f+001260
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMUAhq0f+001260
Zipping up the intermediate file: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0135_1990050100_123_959_12175779_0_r1972005946_52.zip
Uploading the intermediate file: upload_file_52.zip
17:34:54 STEP 1273 H=1273:00 +CPU= 28.581
17:35:23 STEP 1274 H=1274:00 +CPU= 28.867
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
17:38:10 STEP 1275 H=1275:00 +CPU= 45.593
17:38:39 STEP 1276 H=1276:00 +CPU= 29.416
17:39:09 STEP 1277 H=1277:00 +CPU= 29.506
17:39:55 STEP 1278 H=1278:00 +CPU= 46.054
17:40:24 STEP 1279 H=1279:00 +CPU= 28.200
17:40:53 STEP 1280 H=1280:00 +CPU= 29.480
17:41:40 STEP 1281 H=1281:00 +CPU= 46.603
17:42:10 STEP 1282 H=1282:00 +CPU= 29.591
17:42:40 STEP 1283 H=1283:00 +CPU= 29.302
17:43:30 STEP 1284 H=1284:00 +CPU= 50.386
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMGGhq0f+001284
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMSHhq0f+001284
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMUAhq0f+001284
17:44:00 STEP 1285 H=1285:00 +CPU= 29.527
17:44:30 STEP 1286 H=1286:00 +CPU= 30.242
17:45:15 STEP 1287 H=1287:00 +CPU= 44.480
17:45:46 STEP 1288 H=1288:00 +CPU= 29.964
17:46:14 STEP 1289 H=1289:00 +CPU= 28.351
17:47:02 STEP 1290 H=1290:00 +CPU= 46.991
17:47:31 STEP 1291 H=1291:00 +CPU= 28.906
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
17:50:03 STEP 1292 H=1292:00 +CPU= 29.905
17:50:49 STEP 1293 H=1293:00 +CPU= 46.182
17:51:19 STEP 1294 H=1294:00 +CPU= 29.293
17:51:48 STEP 1295 H=1295:00 +CPU= 28.559
17:52:42 STEP 1296 H=1296:00 +CPU= 53.707
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMGGhq0f+001296
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMSHhq0f+001296
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMUAhq0f+001296
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMGGhq0f+001272
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMSHhq0f+001272
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMUAhq0f+001272
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMGGhq0f+001284
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMSHhq0f+001284
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMUAhq0f+001284
Zipping up the intermediate file: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0135_1990050100_123_959_12175779_0_r1972005946_53.zip
Uploading the intermediate file: upload_file_53.zip
17:53:10 STEP 1297 H=1297:00 +CPU= 28.291
17:53:39 STEP 1298 H=1298:00 +CPU= 28.455
17:54:25 STEP 1299 H=1299:00 +CPU= 45.299
17:54:55 STEP 1300 H=1300:00 +CPU= 29.999
17:55:23 STEP 1301 H=1301:00 +CPU= 27.866
17:56:08 STEP 1302 H=1302:00 +CPU= 44.853
17:56:37 STEP 1303 H=1303:00 +CPU= 29.007
17:57:08 STEP 1304 H=1304:00 +CPU= 30.238
17:57:53 STEP 1305 H=1305:00 +CPU= 45.118
17:58:23 STEP 1306 H=1306:00 +CPU= 29.709
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
18:00:57 STEP 1307 H=1307:00 +CPU= 27.952
18:01:47 STEP 1308 H=1308:00 +CPU= 49.348
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMGGhq0f+001308
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMSHhq0f+001308
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMUAhq0f+001308
18:02:15 STEP 1309 H=1309:00 +CPU= 27.725
18:02:45 STEP 1310 H=1310:00 +CPU= 29.629
18:03:31 STEP 1311 H=1311:00 +CPU= 46.073
18:04:01 STEP 1312 H=1312:00 +CPU= 29.347
18:04:30 STEP 1313 H=1313:00 +CPU= 28.927
18:05:18 STEP 1314 H=1314:00 +CPU= 47.890
18:05:48 STEP 1315 H=1315:00 +CPU= 29.265
18:06:18 STEP 1316 H=1316:00 +CPU= 30.002
18:07:04 STEP 1317 H=1317:00 +CPU= 45.425
18:07:33 STEP 1318 H=1318:00 +CPU= 29.045
18:08:02 STEP 1319 H=1319:00 +CPU= 29.238
18:08:56 STEP 1320 H=1320:00 +CPU= 53.586
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMGGhq0f+001320
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMSHhq0f+001320
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMUAhq0f+001320
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMGGhq0f+001296
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMSHhq0f+001296
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMUAhq0f+001296
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMGGhq0f+001308
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMSHhq0f+001308
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMUAhq0f+001308
Zipping up the intermediate file: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0135_1990050100_123_959_12175779_0_r1972005946_54.zip
Uploading the intermediate file: upload_file_54.zip
18:09:26 STEP 1321 H=1321:00 +CPU= 29.054
18:09:54 STEP 1322 H=1322:00 +CPU= 27.925
18:10:38 STEP 1323 H=1323:00 +CPU= 44.354
18:11:08 STEP 1324 H=1324:00 +CPU= 29.057
18:11:37 STEP 1325 H=1325:00 +CPU= 28.956
18:12:23 STEP 1326 H=1326:00 +CPU= 45.382
18:12:51 STEP 1327 H=1327:00 +CPU= 28.496
18:13:21 STEP 1328 H=1328:00 +CPU= 29.596
18:14:07 STEP 1329 H=1329:00 +CPU= 45.456
18:14:36 STEP 1330 H=1330:00 +CPU= 28.978
18:15:06 STEP 1331 H=1331:00 +CPU= 29.333
18:15:56 STEP 1332 H=1332:00 +CPU= 49.602
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMGGhq0f+001332
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMSHhq0f+001332
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMUAhq0f+001332
18:16:25 STEP 1333 H=1333:00 +CPU= 29.355
18:16:55 STEP 1334 H=1334:00 +CPU= 29.448
18:17:40 STEP 1335 H=1335:00 +CPU= 45.257
18:18:11 STEP 1336 H=1336:00 +CPU= 29.904
18:18:40 STEP 1337 H=1337:00 +CPU= 29.113
18:19:26 STEP 1338 H=1338:00 +CPU= 46.087
18:19:55 STEP 1339 H=1339:00 +CPU= 28.731
18:20:25 STEP 1340 H=1340:00 +CPU= 29.301
18:21:11 STEP 1341 H=1341:00 +CPU= 45.638
18:21:40 STEP 1342 H=1342:00 +CPU= 29.324
18:22:10 STEP 1343 H=1343:00 +CPU= 29.344
18:23:02 STEP 1344 H=1344:00 +CPU= 52.125
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMGGhq0f+001344
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMSHhq0f+001344
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMUAhq0f+001344
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMGGhq0f+001320
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMSHhq0f+001320
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMUAhq0f+001320
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMGGhq0f+001332
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMSHhq0f+001332
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMUAhq0f+001332
Zipping up the intermediate file: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0135_1990050100_123_959_12175779_0_r1972005946_55.zip
Uploading the intermediate file: upload_file_55.zip
18:23:31 STEP 1345 H=1345:00 +CPU= 28.540
18:24:01 STEP 1346 H=1346:00 +CPU= 30.024
18:24:47 STEP 1347 H=1347:00 +CPU= 45.516
18:25:17 STEP 1348 H=1348:00 +CPU= 30.138
18:25:45 STEP 1349 H=1349:00 +CPU= 27.837
18:26:31 STEP 1350 H=1350:00 +CPU= 45.400
18:27:01 STEP 1351 H=1351:00 +CPU= 29.689
18:27:32 STEP 1352 H=1352:00 +CPU= 30.187
18:28:15 STEP 1353 H=1353:00 +CPU= 43.171
18:28:45 STEP 1354 H=1354:00 +CPU= 29.733
18:29:13 STEP 1355 H=1355:00 +CPU= 27.743
18:30:03 STEP 1356 H=1356:00 +CPU= 49.397
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMGGhq0f+001356
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMSHhq0f+001356
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMUAhq0f+001356
18:30:32 STEP 1357 H=1357:00 +CPU= 29.051
18:31:01 STEP 1358 H=1358:00 +CPU= 29.390
18:31:46 STEP 1359 H=1359:00 +CPU= 43.973
18:32:16 STEP 1360 H=1360:00 +CPU= 30.152
18:32:44 STEP 1361 H=1361:00 +CPU= 27.875
18:33:31 STEP 1362 H=1362:00 +CPU= 46.528
18:34:00 STEP 1363 H=1363:00 +CPU= 28.781
18:34:29 STEP 1364 H=1364:00 +CPU= 29.336
18:35:14 STEP 1365 H=1365:00 +CPU= 44.357
18:35:43 STEP 1366 H=1366:00 +CPU= 29.120
18:36:13 STEP 1367 H=1367:00 +CPU= 29.629
18:37:06 STEP 1368 H=1368:00 +CPU= 53.050
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMGGhq0f+001368
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMSHhq0f+001368
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMUAhq0f+001368
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMGGhq0f+001344
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMSHhq0f+001344
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMUAhq0f+001344
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMGGhq0f+001356
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMSHhq0f+001356
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMUAhq0f+001356
Zipping up the intermediate file: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0135_1990050100_123_959_12175779_0_r1972005946_56.zip
Uploading the intermediate file: upload_file_56.zip
18:37:36 STEP 1369 H=1369:00 +CPU= 29.501
18:38:06 STEP 1370 H=1370:00 +CPU= 30.355
18:38:52 STEP 1371 H=1371:00 +CPU= 44.894
18:39:20 STEP 1372 H=1372:00 +CPU= 28.736
18:39:48 STEP 1373 H=1373:00 +CPU= 27.757
18:40:35 STEP 1374 H=1374:00 +CPU= 46.122
18:41:02 STEP 1375 H=1375:00 +CPU= 27.331
18:41:31 STEP 1376 H=1376:00 +CPU= 28.845
18:42:16 STEP 1377 H=1377:00 +CPU= 44.025
18:42:44 STEP 1378 H=1378:00 +CPU= 28.524
18:43:13 STEP 1379 H=1379:00 +CPU= 28.447
18:44:03 STEP 1380 H=1380:00 +CPU= 49.945
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMGGhq0f+001380
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMSHhq0f+001380
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMUAhq0f+001380
18:44:32 STEP 1381 H=1381:00 +CPU= 28.622
18:45:01 STEP 1382 H=1382:00 +CPU= 29.156
18:45:46 STEP 1383 H=1383:00 +CPU= 44.409
18:46:17 STEP 1384 H=1384:00 +CPU= 30.926
18:46:44 STEP 1385 H=1385:00 +CPU= 27.119
18:47:30 STEP 1386 H=1386:00 +CPU= 45.512
18:47:59 STEP 1387 H=1387:00 +CPU= 28.283
18:48:28 STEP 1388 H=1388:00 +CPU= 29.242
18:49:13 STEP 1389 H=1389:00 +CPU= 44.912
18:49:43 STEP 1390 H=1390:00 +CPU= 29.815
18:50:12 STEP 1391 H=1391:00 +CPU= 29.020
18:51:06 STEP 1392 H=1392:00 +CPU= 52.973
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMGGhq0f+001392
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMSHhq0f+001392
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMUAhq0f+001392
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMGGhq0f+001368
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMSHhq0f+001368
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMUAhq0f+001368
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMGGhq0f+001380
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMSHhq0f+001380
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMUAhq0f+001380
Zipping up the intermediate file: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0135_1990050100_123_959_12175779_0_r1972005946_57.zip
Uploading the intermediate file: upload_file_57.zip
18:51:34 STEP 1393 H=1393:00 +CPU= 28.466
Uploading trickle at timestep: 5011200
18:52:03 STEP 1394 H=1394:00 +CPU= 29.058
18:52:47 STEP 1395 H=1395:00 +CPU= 43.858
18:53:17 STEP 1396 H=1396:00 +CPU= 28.828
18:53:45 STEP 1397 H=1397:00 +CPU= 28.504
18:54:30 STEP 1398 H=1398:00 +CPU= 44.991
18:54:59 STEP 1399 H=1399:00 +CPU= 28.013
18:55:29 STEP 1400 H=1400:00 +CPU= 30.420
18:56:15 STEP 1401 H=1401:00 +CPU= 45.601
18:56:44 STEP 1402 H=1402:00 +CPU= 28.564
18:57:12 STEP 1403 H=1403:00 +CPU= 27.790
18:58:04 STEP 1404 H=1404:00 +CPU= 51.675
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMGGhq0f+001404
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMSHhq0f+001404
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMUAhq0f+001404
18:58:32 STEP 1405 H=1405:00 +CPU= 27.830
18:59:02 STEP 1406 H=1406:00 +CPU= 30.217
18:59:48 STEP 1407 H=1407:00 +CPU= 45.394
19:00:17 STEP 1408 H=1408:00 +CPU= 28.804
19:00:46 STEP 1409 H=1409:00 +CPU= 28.458
19:01:30 STEP 1410 H=1410:00 +CPU= 44.313
19:01:58 STEP 1411 H=1411:00 +CPU= 27.949
19:02:27 STEP 1412 H=1412:00 +CPU= 28.995
19:03:13 STEP 1413 H=1413:00 +CPU= 45.222
19:03:42 STEP 1414 H=1414:00 +CPU= 28.500
19:04:11 STEP 1415 H=1415:00 +CPU= 28.897
19:05:04 STEP 1416 H=1416:00 +CPU= 53.276
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMGGhq0f+001416
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMSHhq0f+001416
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMUAhq0f+001416
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMGGhq0f+001392
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMSHhq0f+001392
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMUAhq0f+001392
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMGGhq0f+001404
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMSHhq0f+001404
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMUAhq0f+001404
Zipping up the intermediate file: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0135_1990050100_123_959_12175779_0_r1972005946_58.zip
Uploading the intermediate file: upload_file_58.zip
19:05:33 STEP 1417 H=1417:00 +CPU= 28.634
19:06:04 STEP 1418 H=1418:00 +CPU= 30.468
19:06:50 STEP 1419 H=1419:00 +CPU= 45.976
19:07:20 STEP 1420 H=1420:00 +CPU= 29.607
19:07:48 STEP 1421 H=1421:00 +CPU= 27.995
19:08:33 STEP 1422 H=1422:00 +CPU= 44.938
19:09:01 STEP 1423 H=1423:00 +CPU= 27.781
19:09:31 STEP 1424 H=1424:00 +CPU= 29.719
19:10:15 STEP 1425 H=1425:00 +CPU= 43.973
19:10:45 STEP 1426 H=1426:00 +CPU= 29.846
19:11:15 STEP 1427 H=1427:00 +CPU= 29.439
19:12:06 STEP 1428 H=1428:00 +CPU= 50.805
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMGGhq0f+001428
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMSHhq0f+001428
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMUAhq0f+001428
19:12:35 STEP 1429 H=1429:00 +CPU= 29.318
19:13:06 STEP 1430 H=1430:00 +CPU= 30.035
19:13:51 STEP 1431 H=1431:00 +CPU= 45.114
19:14:21 STEP 1432 H=1432:00 +CPU= 29.460
19:14:49 STEP 1433 H=1433:00 +CPU= 28.250
19:15:36 STEP 1434 H=1434:00 +CPU= 46.179
19:16:03 STEP 1435 H=1435:00 +CPU= 27.360
19:16:32 STEP 1436 H=1436:00 +CPU= 29.002
19:17:17 STEP 1437 H=1437:00 +CPU= 44.621
19:17:47 STEP 1438 H=1438:00 +CPU= 29.325
19:18:16 STEP 1439 H=1439:00 +CPU= 29.581
19:19:11 STEP 1440 H=1440:00 +CPU= 54.164
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMGGhq0f+001440
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMSHhq0f+001440
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMUAhq0f+001440
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMGGhq0f+001416
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMSHhq0f+001416
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMUAhq0f+001416
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMGGhq0f+001428
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMSHhq0f+001428
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMUAhq0f+001428
Zipping up the intermediate file: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0135_1990050100_123_959_12175779_0_r1972005946_59.zip
Uploading the intermediate file: upload_file_59.zip
19:19:40 STEP 1441 H=1441:00 +CPU= 28.463
19:20:08 STEP 1442 H=1442:00 +CPU= 28.312
19:20:53 STEP 1443 H=1443:00 +CPU= 44.154
19:21:22 STEP 1444 H=1444:00 +CPU= 29.367
19:21:50 STEP 1445 H=1445:00 +CPU= 28.199
19:22:37 STEP 1446 H=1446:00 +CPU= 45.895
19:23:05 STEP 1447 H=1447:00 +CPU= 28.413
19:23:34 STEP 1448 H=1448:00 +CPU= 28.545
19:24:16 STEP 1449 H=1449:00 +CPU= 41.885
19:24:44 STEP 1450 H=1450:00 +CPU= 28.103
19:25:13 STEP 1451 H=1451:00 +CPU= 28.099
19:26:01 STEP 1452 H=1452:00 +CPU= 48.523
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMGGhq0f+001452
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMSHhq0f+001452
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMUAhq0f+001452
19:26:30 STEP 1453 H=1453:00 +CPU= 27.920
19:27:00 STEP 1454 H=1454:00 +CPU= 29.743
19:27:43 STEP 1455 H=1455:00 +CPU= 43.315
19:28:11 STEP 1456 H=1456:00 +CPU= 27.739
19:28:39 STEP 1457 H=1457:00 +CPU= 27.515
19:29:25 STEP 1458 H=1458:00 +CPU= 45.174
19:29:53 STEP 1459 H=1459:00 +CPU= 27.943
19:30:22 STEP 1460 H=1460:00 +CPU= 28.702
19:31:05 STEP 1461 H=1461:00 +CPU= 42.768
19:31:32 STEP 1462 H=1462:00 +CPU= 26.897
19:32:00 STEP 1463 H=1463:00 +CPU= 28.397
19:32:53 STEP 1464 H=1464:00 +CPU= 52.269
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMGGhq0f+001464
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMSHhq0f+001464
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMUAhq0f+001464
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMGGhq0f+001440
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMSHhq0f+001440
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMUAhq0f+001440
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMGGhq0f+001452
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMSHhq0f+001452
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMUAhq0f+001452
Zipping up the intermediate file: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0135_1990050100_123_959_12175779_0_r1972005946_60.zip
Uploading the intermediate file: upload_file_60.zip
19:33:21 STEP 1465 H=1465:00 +CPU= 28.084
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
19:45:26 STEP 1466 H=1466:00 +CPU= 28.256
19:46:11 STEP 1467 H=1467:00 +CPU= 44.032
19:46:41 STEP 1468 H=1468:00 +CPU= 29.458
19:47:10 STEP 1469 H=1469:00 +CPU= 28.726
19:47:57 STEP 1470 H=1470:00 +CPU= 46.213
19:48:25 STEP 1471 H=1471:00 +CPU= 28.327
Suspend request received from the BOINC client, suspending the child process
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21124:21124] [20221226:202946:1672086586:34782.519] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1538] Received signal#15 (SIGTERM) :: 3996MB (heap), 4419MB (maxrss), 0MB (maxstack), 0 (paging), nsigs = 1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21124:21124] [20221226:202946:1672086586:34782.532] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1542] Also activating Harakiri-alarm (SIGALRM=14) to expire after 500s elapsed to prevent hangs, nsigs = 1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21124:21124] [20221226:202946:1672086586:34782.532] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1544] Harakiri signal handler 'signal_harakiri' for signal#14 (SIGALRM) installed at 0x81f3c0 (old at (nil))
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21124:21124] [20221226:202946:1672086586:34782.532] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1617] Signal#15 was caused by unrecognized si_code [memaddr=0x1], nsigs = 1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21124:21124] [20221226:202946:1672086586:34782.532] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1686] Starting DrHook backtrace for signal#15, nsigs = 1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21124:21124] [20221226:202946:1672086586:34782.532] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3843] 3996 MB (maxheap), 4419 MB (maxrss), 0 MB (maxstack)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21124:21124] [20221226:202946:1672086586:34782.532] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : MASTER
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21124:21124] [20221226:202946:1672086586:34782.532] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : CNT0
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21124:21124] [20221226:202946:1672086586:34782.532] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : CNT1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21124:21124] [20221226:202946:1672086586:34782.532] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : CNT2
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21124:21124] [20221226:202946:1672086586:34782.532] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : CNT3
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21124:21124] [20221226:202946:1672086586:34782.532] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : CNT4
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21124:21124] [20221226:202946:1672086586:34782.532] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : STEPO
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21124:21124] [20221226:202946:1672086586:34782.532] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : SCAN2M
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21124:21124] [20221226:202946:1672086586:34782.532] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : GP_MODEL_HEAP
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21124:21124] [20221226:202946:1672086586:34782.532] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : GP_MODEL
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21124:21124] [20221226:202946:1672086586:34782.532] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : EC_PHYS_DRV
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21124:21124] [20221226:202946:1672086586:34782.532] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : >OMP-PHYSICS (1001)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21124:21124] [20221226:202946:1672086586:34782.532] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : EC_PHYS
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21124:21124] [20221226:202946:1672086586:34782.532] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : CALLPAR
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21124:21124] [20221226:202946:1672086586:34782.532] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : CLOUD_LAYER
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21124:21124] [20221226:202946:1672086586:34782.532] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : CLOUDSC
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21124:21124] [20221226:202947:1672086587:34783.532] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1734] DrHook backtrace done for signal#15, nsigs = 1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:21124:21124] [20221226:202947:1672086587:34783.532] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1785] Calling previous signal handler at 0x1ce8bb0 for signal#15, nsigs = 1
forrtl: error (78): process killed (SIGTERM)
Image PC Routine Line Source
oifs_43r3_model.e 0000000001CE916B Unknown Unknown Unknown
oifs_43r3_model.e 000000000081FFF1 Unknown Unknown Unknown
oifs_43r3_model.e 0000000001DC9090 Unknown Unknown Unknown
oifs_43r3_model.e 0000000001DB453D Unknown Unknown Unknown
oifs_43r3_model.e 0000000001020C3C cloudsc_ 1028 cloudsc.F90
oifs_43r3_model.e 0000000001014D57 cloud_layer_ 131 cloud_layer.F90
oifs_43r3_model.e 0000000000F10C1B callpar_ 1011 callpar.F90
oifs_43r3_model.e 0000000000E4940F ec_phys_ 670 ec_phys.F90
oifs_43r3_model.e 0000000000E3610C ec_phys_drv_ 599 ec_phys_drv.F90
oifs_43r3_model.e 0000000000BFA3D3 gp_model_ 613 gp_model.F90
oifs_43r3_model.e 00000000012E9482 gp_model_heap_ 74 gp_model_heap.F90
oifs_43r3_model.e 0000000000BBC1CE scan2m_ 535 scan2m.F90
oifs_43r3_model.e 000000000057A664 stepo_ 327 stepo.F90
oifs_43r3_model.e 000000000055DEEC cnt4_ 1133 cnt4.F90
oifs_43r3_model.e 00000000005471C9 cnt3_ 267 cnt3.F90
oifs_43r3_model.e 0000000000546412 cnt2_ 88 cnt2.F90
oifs_43r3_model.e 0000000000545E28 cnt1_ 92 cnt1.F90
oifs_43r3_model.e 000000000040708D cnt0_ 146 cnt0.F90
oifs_43r3_model.e 000000000040220F MAIN__ 96 master.F90
oifs_43r3_model.e 00000000004021A2 Unknown Unknown Unknown
oifs_43r3_model.e 0000000001DCA390 Unknown Unknown Unknown
oifs_43r3_model.e 000000000040206E Unknown Unknown Unknown
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1990050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0135
(argv4) batchid: 959
(argv5) wuid: 12175779
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /data/boinc/boinc-client/slots/1
Project directory is: /data/boinc/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779
..mkdir for temp folder for results failed
Copying: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /data/boinc/boinc-client/slots/1/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /data/boinc/boinc-client/slots/1/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_cdbe9a24cbe93add2311c72846577cbd to: /data/boinc/boinc-client/slots/1/oifs_43r3_ps_0135_1990050100_123_959_12175779.zip
Unzipping the namelist zip file: /data/boinc/boinc-client/slots/1/oifs_43r3_ps_0135_1990050100_123_959_12175779.zip
ic_ancil_file: ic_ancil_12175779
ifsdata_file: ifsdata_12175779
climate_data_file: clim_data_12175779
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_c5e1dd845347a7846435bfdf28d3d536 to: /data/boinc/boinc-client/slots/1/ic_ancil_12175779.zip
Unzipping the IC ancils zip file: /data/boinc/boinc-client/slots/1/ic_ancil_12175779.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_32dadcc4d1f6c09909249875340185df to: /data/boinc/boinc-client/slots/1/ifsdata/ifsdata_12175779.zip
Unzipping the ifsdata_zip file: /data/boinc/boinc-client/slots/1/ifsdata/ifsdata_12175779.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /data/boinc/boinc-client/slots/1/159l_2/clim_data_12175779.zip
Unzipping the climate data zip file: /data/boinc/boinc-client/slots/1/159l_2/clim_data_12175779.zip
Checking for progress XML file: /data/boinc/boinc-client/slots/1/progress_file_12175779.xml
Opened progress file ok : /data/boinc/boinc-client/slots/1/progress_file_12175779.xml
-- Model is restarting --
Adjusting last_iter, 1472, to previous model restart step.
Creating progress file: /data/boinc/boinc-client/slots/1/progress_file_12175779.xml
last_cpu_time: 57320
upload_file_number: 61
last_iter: 1463
last_upload: 5270400
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0135_1990050100_123_959_12175779_0_r1972005946
The child process has been launched with process id: 23666
Executing the command: /data/boinc/boinc-client/slots/1/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:23666:23666] [20221227:084032:1672130432:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:23666:23666] [20221227:084032:1672130432:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:23666:23666] [20221227:084032:1672130432:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:23666:23666] [20221227:084032:1672130432:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:23666:23666] [20221227:084032:1672130432:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:23666:23666] [20221227:084032:1672130432:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:23666:23666] [20221227:084032:1672130432:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:23666:23666] [20221227:084032:1672130432:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:23666:23666] [20221227:084032:1672130432:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:23666:23666] [20221227:084032:1672130432:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:23666:23666] [20221227:084032:1672130432:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:23666:23666] [20221227:084032:1672130432:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:23666:23666] [20221227:084032:1672130432:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:23666:23666] [20221227:084032:1672130432:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:23666:23666] [20221227:084032:1672130432:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:23666:23666] [20221227:084032:1672130432:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:23666:23666] [20221227:084032:1672130432:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:23666:23666] [20221227:084032:1672130432:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:23666:23666] [20221227:084032:1672130432:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:23666:23666] [20221227:084032:1672130432:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:23666:23666] [20221227:084032:1672130432:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:23666:23666] [20221227:084032:1672130432:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:23666:23666] [20221227:084032:1672130432:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:23666:23666] [20221227:084032:1672130432:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:23666:23666] [20221227:084032:1672130432:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:23666:23666] [20221227:084032:1672130432:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:23666:23666] [20221227:084032:1672130432:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:23666:23666] [20221227:084032:1672130432:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:23666:23666] [20221227:084032:1672130432:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:23666:23666] [20221227:084032:1672130432:0.001] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
08:41:52 STEP 1464 H=1464:00 +CPU= 52.668
08:42:21 STEP 1465 H=1465:00 +CPU= 28.947
08:42:51 STEP 1466 H=1466:00 +CPU= 29.255
08:43:38 STEP 1467 H=1467:00 +CPU= 46.131
08:44:09 STEP 1468 H=1468:00 +CPU= 29.851
08:44:38 STEP 1469 H=1469:00 +CPU= 28.719
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
08:48:04 STEP 1470 H=1470:00 +CPU= 46.050
08:48:33 STEP 1471 H=1471:00 +CPU= 28.662
08:49:02 STEP 1472 H=1472:00 +CPU= 29.035
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:03:35 STEP 1473 H=1473:00 +CPU= 44.451
11:04:05 STEP 1474 H=1474:00 +CPU= 29.295
11:04:33 STEP 1475 H=1475:00 +CPU= 28.225
11:05:24 STEP 1476 H=1476:00 +CPU= 50.162
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMGGhq0f+001476
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMSHhq0f+001476
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMUAhq0f+001476
11:05:53 STEP 1477 H=1477:00 +CPU= 28.483
11:06:23 STEP 1478 H=1478:00 +CPU= 29.622
11:07:08 STEP 1479 H=1479:00 +CPU= 45.142
11:07:38 STEP 1480 H=1480:00 +CPU= 29.367
11:08:06 STEP 1481 H=1481:00 +CPU= 28.057
11:08:52 STEP 1482 H=1482:00 +CPU= 45.554
11:09:20 STEP 1483 H=1483:00 +CPU= 27.915
11:09:50 STEP 1484 H=1484:00 +CPU= 29.113
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:12:38 STEP 1485 H=1485:00 +CPU= 44.383
11:13:08 STEP 1486 H=1486:00 +CPU= 29.671
11:13:37 STEP 1487 H=1487:00 +CPU= 29.343
11:14:31 STEP 1488 H=1488:00 +CPU= 53.553
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMGGhq0f+001488
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMSHhq0f+001488
Moving to projects directory: /data/boinc/boinc-client/slots/1/ICMUAhq0f+001488
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMGGhq0f+001464
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMSHhq0f+001464
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMUAhq0f+001464
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMGGhq0f+001476
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMSHhq0f+001476
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175779/ICMUAhq0f+001476
Zipping up the intermediate file: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0135_1990050100_123_959_12175779_0_r1972005946_61.zip
Uploading the intermediate file: upload_file_61.zip
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:36:54 STEP 1489 H=1489:00 +CPU= 28.943
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:08:25 STEP 1490 H=1490:00 +CPU= 29.711
13:09:10 STEP 1491 H=1491:00 +CPU= 44.881
13:09:39 STEP 1492 H=1492:00 +CPU= 29.410
13:10:08 STEP 1493 H=1493:00 +CPU= 28.501
Abort request received from BOINC client, ending the child process
..Failed, model did not complete successfully
</stderr_txt>
]]>
