<core_client_version>7.20.2</core_client_version>
<![CDATA[
<message>
Disk usage limit exceeded</message>
<stderr_txt>
from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:52:38 STEP 2180 H=2180:00 +CPU= 20.220
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:53:10 STEP 2181 H=2181:00 +CPU= 30.302
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:53:33 STEP 2182 H=2182:00 +CPU= 20.702
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:53:58 STEP 2183 H=2183:00 +CPU= 20.985
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:54:41 STEP 2184 H=2184:00 +CPU= 28.260
Moving to projects directory: /home/kari/slots/4/ICMGGhq0f+002184
Moving to projects directory: /home/kari/slots/4/ICMSHhq0f+002184
Moving to projects directory: /home/kari/slots/4/ICMUAhq0f+002184
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12169430/ICMGGhq0f+002160
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12169430/ICMSHhq0f+002160
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12169430/ICMUAhq0f+002160
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12169430/ICMGGhq0f+002172
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12169430/ICMSHhq0f+002172
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12169430/ICMUAhq0f+002172
Zipping up the intermediate file: /home/kari/projects/climateprediction.net/oifs_43r3_ps_0786_1983050100_123_952_12169430_1_r1135878893_90.zip
Uploading the intermediate file: upload_file_90.zip
21:55:05 STEP 2185 H=2185:00 +CPU= 20.229
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:55:30 STEP 2186 H=2186:00 +CPU= 22.319
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:56:06 STEP 2187 H=2187:00 +CPU= 30.806
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:56:29 STEP 2188 H=2188:00 +CPU= 21.152
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:56:53 STEP 2189 H=2189:00 +CPU= 21.534
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:57:30 STEP 2190 H=2190:00 +CPU= 32.671
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:57:52 STEP 2191 H=2191:00 +CPU= 19.824
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:58:16 STEP 2192 H=2192:00 +CPU= 20.287
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:58:48 STEP 2193 H=2193:00 +CPU= 29.680
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:59:11 STEP 2194 H=2194:00 +CPU= 20.789
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:59:36 STEP 2195 H=2195:00 +CPU= 20.504
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:00:17 STEP 2196 H=2196:00 +CPU= 36.676
Moving to projects directory: /home/kari/slots/4/ICMGGhq0f+002196
Moving to projects directory: /home/kari/slots/4/ICMSHhq0f+002196
Moving to projects directory: /home/kari/slots/4/ICMUAhq0f+002196
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:00:40 STEP 2197 H=2197:00 +CPU= 20.071
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:01:02 STEP 2198 H=2198:00 +CPU= 20.017
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:01:38 STEP 2199 H=2199:00 +CPU= 31.400
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:02:00 STEP 2200 H=2200:00 +CPU= 20.464
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:02:23 STEP 2201 H=2201:00 +CPU= 20.781
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:03:00 STEP 2202 H=2202:00 +CPU= 32.194
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:03:22 STEP 2203 H=2203:00 +CPU= 19.735
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:03:45 STEP 2204 H=2204:00 +CPU= 21.162
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:04:22 STEP 2205 H=2205:00 +CPU= 32.609
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:04:45 STEP 2206 H=2206:00 +CPU= 20.917
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:05:10 STEP 2207 H=2207:00 +CPU= 20.627
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:06:05 STEP 2208 H=2208:00 +CPU= 40.401
Moving to projects directory: /home/kari/slots/4/ICMGGhq0f+002208
Moving to projects directory: /home/kari/slots/4/ICMSHhq0f+002208
Moving to projects directory: /home/kari/slots/4/ICMUAhq0f+002208
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12169430/ICMGGhq0f+002184
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12169430/ICMSHhq0f+002184
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12169430/ICMUAhq0f+002184
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12169430/ICMGGhq0f+002196
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12169430/ICMSHhq0f+002196
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12169430/ICMUAhq0f+002196
Zipping up the intermediate file: /home/kari/projects/climateprediction.net/oifs_43r3_ps_0786_1983050100_123_952_12169430_1_r1135878893_91.zip
Uploading the intermediate file: upload_file_91.zip
22:06:25 STEP 2209 H=2209:00 +CPU= 20.046
22:06:48 STEP 2210 H=2210:00 +CPU= 22.604
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:07:26 STEP 2211 H=2211:00 +CPU= 33.217
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:07:51 STEP 2212 H=2212:00 +CPU= 23.358
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:08:18 STEP 2213 H=2213:00 +CPU= 22.411
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:08:53 STEP 2214 H=2214:00 +CPU= 32.890
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:09:21 STEP 2215 H=2215:00 +CPU= 23.298
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:09:45 STEP 2216 H=2216:00 +CPU= 21.613
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:10:23 STEP 2217 H=2217:00 +CPU= 33.322
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:10:48 STEP 2218 H=2218:00 +CPU= 23.524
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:11:14 STEP 2219 H=2219:00 +CPU= 22.964
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:11:59 STEP 2220 H=2220:00 +CPU= 38.892
Moving to projects directory: /home/kari/slots/4/ICMGGhq0f+002220
Moving to projects directory: /home/kari/slots/4/ICMSHhq0f+002220
Moving to projects directory: /home/kari/slots/4/ICMUAhq0f+002220
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:12:24 STEP 2221 H=2221:00 +CPU= 22.844
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:12:50 STEP 2222 H=2222:00 +CPU= 24.019
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:13:29 STEP 2223 H=2223:00 +CPU= 34.665
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:13:52 STEP 2224 H=2224:00 +CPU= 20.779
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:14:18 STEP 2225 H=2225:00 +CPU= 21.168
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:14:52 STEP 2226 H=2226:00 +CPU= 31.643
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:15:20 STEP 2227 H=2227:00 +CPU= 20.242
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:15:47 STEP 2228 H=2228:00 +CPU= 24.144
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:16:28 STEP 2229 H=2229:00 +CPU= 31.510
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:16:51 STEP 2230 H=2230:00 +CPU= 19.703
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:17:19 STEP 2231 H=2231:00 +CPU= 23.237
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:18:08 STEP 2232 H=2232:00 +CPU= 40.794
Moving to projects directory: /home/kari/slots/4/ICMGGhq0f+002232
Moving to projects directory: /home/kari/slots/4/ICMSHhq0f+002232
Moving to projects directory: /home/kari/slots/4/ICMUAhq0f+002232
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12169430/ICMGGhq0f+002208
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12169430/ICMSHhq0f+002208
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12169430/ICMUAhq0f+002208
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12169430/ICMGGhq0f+002220
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12169430/ICMSHhq0f+002220
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12169430/ICMUAhq0f+002220
Zipping up the intermediate file: /home/kari/projects/climateprediction.net/oifs_43r3_ps_0786_1983050100_123_952_12169430_1_r1135878893_92.zip
Uploading the intermediate file: upload_file_92.zip
22:18:32 STEP 2233 H=2233:00 +CPU= 19.362
22:18:53 STEP 2234 H=2234:00 +CPU= 20.932
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:19:31 STEP 2235 H=2235:00 +CPU= 33.383
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:20:00 STEP 2236 H=2236:00 +CPU= 23.105
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:20:25 STEP 2237 H=2237:00 +CPU= 23.173
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:21:06 STEP 2238 H=2238:00 +CPU= 36.084
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:21:30 STEP 2239 H=2239:00 +CPU= 21.620
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:21:55 STEP 2240 H=2240:00 +CPU= 21.175
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:22:29 STEP 2241 H=2241:00 +CPU= 31.189
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:22:51 STEP 2242 H=2242:00 +CPU= 20.244
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:23:16 STEP 2243 H=2243:00 +CPU= 20.529
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:23:53 STEP 2244 H=2244:00 +CPU= 34.242
Moving to projects directory: /home/kari/slots/4/ICMGGhq0f+002244
Moving to projects directory: /home/kari/slots/4/ICMSHhq0f+002244
Moving to projects directory: /home/kari/slots/4/ICMUAhq0f+002244
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:24:16 STEP 2245 H=2245:00 +CPU= 18.924
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:24:39 STEP 2246 H=2246:00 +CPU= 20.334
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:25:13 STEP 2247 H=2247:00 +CPU= 32.000
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:25:39 STEP 2248 H=2248:00 +CPU= 21.905
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:26:04 STEP 2249 H=2249:00 +CPU= 22.045
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:26:40 STEP 2250 H=2250:00 +CPU= 32.005
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:27:02 STEP 2251 H=2251:00 +CPU= 20.070
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:27:26 STEP 2252 H=2252:00 +CPU= 21.484
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:28:02 STEP 2253 H=2253:00 +CPU= 31.774
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:28:27 STEP 2254 H=2254:00 +CPU= 21.812
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:28:51 STEP 2255 H=2255:00 +CPU= 21.620
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:29:31 STEP 2256 H=2256:00 +CPU= 35.241
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /home/kari/slots/4/ICMGGhq0f+002256
Moving to projects directory: /home/kari/slots/4/ICMSHhq0f+002256
Moving to projects directory: /home/kari/slots/4/ICMUAhq0f+002256
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12169430/ICMGGhq0f+002232
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12169430/ICMSHhq0f+002232
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12169430/ICMUAhq0f+002232
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12169430/ICMGGhq0f+002244
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12169430/ICMSHhq0f+002244
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12169430/ICMUAhq0f+002244
Zipping up the intermediate file: /home/kari/projects/climateprediction.net/oifs_43r3_ps_0786_1983050100_123_952_12169430_1_r1135878893_93.zip
Uploading the intermediate file: upload_file_93.zip
22:29:53 STEP 2257 H=2257:00 +CPU= 19.738
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:30:16 STEP 2258 H=2258:00 +CPU= 20.098
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:30:50 STEP 2259 H=2259:00 +CPU= 32.087
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:31:16 STEP 2260 H=2260:00 +CPU= 21.803
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:31:41 STEP 2261 H=2261:00 +CPU= 22.321
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:32:57 STEP 2262 H=2262:00 +CPU= 44.174
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:34:22 STEP 2263 H=2263:00 +CPU= 39.776
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:35:18 STEP 2264 H=2264:00 +CPU= 33.666
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:36:25 STEP 2265 H=2265:00 +CPU= 45.574
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:36:56 STEP 2266 H=2266:00 +CPU= 23.998
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:37:58 STEP 2267 H=2267:00 +CPU= 34.657
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:40:01 STEP 2268 H=2268:00 +CPU= 62.720
Moving to projects directory: /home/kari/slots/4/ICMGGhq0f+002268
Moving to projects directory: /home/kari/slots/4/ICMSHhq0f+002268
Moving to projects directory: /home/kari/slots/4/ICMUAhq0f+002268
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:40:53 STEP 2269 H=2269:00 +CPU= 33.030
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:41:36 STEP 2270 H=2270:00 +CPU= 29.683
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:42:14 STEP 2271 H=2271:00 +CPU= 34.248
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:42:39 STEP 2272 H=2272:00 +CPU= 22.358
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:43:05 STEP 2273 H=2273:00 +CPU= 23.277
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:43:48 STEP 2274 H=2274:00 +CPU= 34.801
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:44:12 STEP 2275 H=2275:00 +CPU= 21.462
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:45:23 STEP 2276 H=2276:00 +CPU= 38.451
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:47:40 STEP 2277 H=2277:00 +CPU= 67.398
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:48:47 STEP 2278 H=2278:00 +CPU= 44.085
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:49:10 STEP 2279 H=2279:00 +CPU= 20.097
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:50:22 STEP 2280 H=2280:00 +CPU= 37.920
Moving to projects directory: /home/kari/slots/4/ICMGGhq0f+002280
Moving to projects directory: /home/kari/slots/4/ICMSHhq0f+002280
Moving to projects directory: /home/kari/slots/4/ICMUAhq0f+002280
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12169430/ICMGGhq0f+002256
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12169430/ICMSHhq0f+002256
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12169430/ICMUAhq0f+002256
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12169430/ICMGGhq0f+002268
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12169430/ICMSHhq0f+002268
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12169430/ICMUAhq0f+002268
Zipping up the intermediate file: /home/kari/projects/climateprediction.net/oifs_43r3_ps_0786_1983050100_123_952_12169430_1_r1135878893_94.zip
Uploading the intermediate file: upload_file_94.zip
22:50:47 STEP 2281 H=2281:00 +CPU= 20.256
22:51:06 STEP 2282 H=2282:00 +CPU= 19.141
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:53:42 STEP 2283 H=2283:00 +CPU= 60.520
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:54:50 STEP 2284 H=2284:00 +CPU= 43.436
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:56:12 STEP 2285 H=2285:00 +CPU= 40.093
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:58:46 STEP 2286 H=2286:00 +CPU= 57.348
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:00:12 STEP 2287 H=2287:00 +CPU= 45.653
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:01:42 STEP 2288 H=2288:00 +CPU= 50.306
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:02:20 STEP 2289 H=2289:00 +CPU= 32.737
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:02:44 STEP 2290 H=2290:00 +CPU= 21.964
23:03:05 STEP 2291 H=2291:00 +CPU= 20.337
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:05:08 STEP 2292 H=2292:00 +CPU= 55.340
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /home/kari/slots/4/ICMGGhq0f+002292
Moving to projects directory: /home/kari/slots/4/ICMSHhq0f+002292
Moving to projects directory: /home/kari/slots/4/ICMUAhq0f+002292
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:06:15 STEP 2293 H=2293:00 +CPU= 30.710
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:06:40 STEP 2294 H=2294:00 +CPU= 20.949
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:07:16 STEP 2295 H=2295:00 +CPU= 32.760
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:08:22 STEP 2296 H=2296:00 +CPU= 30.486
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:08:46 STEP 2297 H=2297:00 +CPU= 21.072
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:09:30 STEP 2298 H=2298:00 +CPU= 38.060
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:09:52 STEP 2299 H=2299:00 +CPU= 20.435
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:10:14 STEP 2300 H=2300:00 +CPU= 19.791
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:10:57 STEP 2301 H=2301:00 +CPU= 36.328
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:11:24 STEP 2302 H=2302:00 +CPU= 19.841
Suspend request received from the BOINC client, suspending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1983050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0786
(argv4) batchid: 952
(argv5) wuid: 12169430
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /home/kari/slots/4
Project directory is: /home/kari/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12169430
..mkdir for temp folder for results failed
Copying: /home/kari/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /home/kari/slots/4/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /home/kari/slots/4/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_d63cd12f076ba25ad1a0e2752b707838 to: /home/kari/slots/4/oifs_43r3_ps_0786_1983050100_123_952_12169430.zip
Unzipping the namelist zip file: /home/kari/slots/4/oifs_43r3_ps_0786_1983050100_123_952_12169430.zip
ic_ancil_file: ic_ancil_12169430
ifsdata_file: ifsdata_12169430
climate_data_file: clim_data_12169430
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_6d3494750b74eb2545b0464961a4c684 to: /home/kari/slots/4/ic_ancil_12169430.zip
Unzipping the IC ancils zip file: /home/kari/slots/4/ic_ancil_12169430.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_590a3b944a2ea423482de576badb3ac5 to: /home/kari/slots/4/ifsdata/ifsdata_12169430.zip
Unzipping the ifsdata_zip file: /home/kari/slots/4/ifsdata/ifsdata_12169430.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /home/kari/slots/4/159l_2/clim_data_12169430.zip
Unzipping the climate data zip file: /home/kari/slots/4/159l_2/clim_data_12169430.zip
Checking for progress XML file: /home/kari/slots/4/progress_file_12169430.xml
Opened progress file ok : /home/kari/slots/4/progress_file_12169430.xml
-- Model is restarting --
Adjusting last_iter, 2303, to previous model restart step.
Creating progress file: /home/kari/slots/4/progress_file_12169430.xml
last_cpu_time: 76057
upload_file_number: 95
last_iter: 2279
last_upload: 8208000
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0786_1983050100_123_952_12169430_1_r1135878893
The child process has been launched with process id: 4450
Executing the command: /home/kari/slots/4/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:G:1:1:4450:4450] [20230116:231318:1673903598:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:G:1:1:4450:4450] [20230116:231318:1673903598:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:G:1:1:4450:4450] [20230116:231318:1673903598:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:G:1:1:4450:4450] [20230116:231318:1673903598:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:G:1:1:4450:4450] [20230116:231318:1673903598:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:G:1:1:4450:4450] [20230116:231318:1673903598:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:G:1:1:4450:4450] [20230116:231318:1673903598:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:G:1:1:4450:4450] [20230116:231318:1673903598:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:G:1:1:4450:4450] [20230116:231318:1673903598:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:G:1:1:4450:4450] [20230116:231318:1673903598:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:G:1:1:4450:4450] [20230116:231318:1673903598:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:G:1:1:4450:4450] [20230116:231318:1673903598:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:G:1:1:4450:4450] [20230116:231318:1673903598:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:G:1:1:4450:4450] [20230116:231318:1673903598:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:G:1:1:4450:4450] [20230116:231318:1673903598:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:G:1:1:4450:4450] [20230116:231318:1673903598:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:G:1:1:4450:4450] [20230116:231318:1673903598:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:G:1:1:4450:4450] [20230116:231318:1673903598:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:G:1:1:4450:4450] [20230116:231318:1673903598:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:G:1:1:4450:4450] [20230116:231318:1673903598:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:G:1:1:4450:4450] [20230116:231318:1673903598:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:G:1:1:4450:4450] [20230116:231318:1673903598:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:G:1:1:4450:4450] [20230116:231318:1673903598:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:G:1:1:4450:4450] [20230116:231318:1673903598:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:G:1:1:4450:4450] [20230116:231318:1673903598:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:G:1:1:4450:4450] [20230116:231318:1673903598:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:G:1:1:4450:4450] [20230116:231318:1673903598:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:G:1:1:4450:4450] [20230116:231318:1673903598:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:G:1:1:4450:4450] [20230116:231318:1673903598:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:G:1:1:4450:4450] [20230116:231318:1673903598:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:14:47 STEP 2280 H=2280:00 +CPU= 36.139
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:15:25 STEP 2281 H=2281:00 +CPU= 20.571
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:15:49 STEP 2282 H=2282:00 +CPU= 21.793
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:16:26 STEP 2283 H=2283:00 +CPU= 31.026
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:16:50 STEP 2284 H=2284:00 +CPU= 21.434
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:17:12 STEP 2285 H=2285:00 +CPU= 19.623
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:17:45 STEP 2286 H=2286:00 +CPU= 29.605
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:18:08 STEP 2287 H=2287:00 +CPU= 20.170
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:18:30 STEP 2288 H=2288:00 +CPU= 19.752
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:19:02 STEP 2289 H=2289:00 +CPU= 28.375
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:19:26 STEP 2290 H=2290:00 +CPU= 20.972
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:19:46 STEP 2291 H=2291:00 +CPU= 17.786
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:20:20 STEP 2292 H=2292:00 +CPU= 29.763
Moving to projects directory: /home/kari/slots/4/ICMGGhq0f+002292
Moving to projects directory: /home/kari/slots/4/ICMSHhq0f+002292
Moving to projects directory: /home/kari/slots/4/ICMUAhq0f+002292
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:20:40 STEP 2293 H=2293:00 +CPU= 18.399
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:21:02 STEP 2294 H=2294:00 +CPU= 19.166
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:21:34 STEP 2295 H=2295:00 +CPU= 28.033
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:22:00 STEP 2296 H=2296:00 +CPU= 23.782
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:22:26 STEP 2297 H=2297:00 +CPU= 23.919
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:23:06 STEP 2298 H=2298:00 +CPU= 35.420
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:23:31 STEP 2299 H=2299:00 +CPU= 22.595
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:23:59 STEP 2300 H=2300:00 +CPU= 23.870
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:24:40 STEP 2301 H=2301:00 +CPU= 36.575
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:25:07 STEP 2302 H=2302:00 +CPU= 24.029
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:25:35 STEP 2303 H=2303:00 +CPU= 23.954
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:26:24 STEP 2304 H=2304:00 +CPU= 42.890
Moving to projects directory: /home/kari/slots/4/ICMGGhq0f+002304
Moving to projects directory: /home/kari/slots/4/ICMSHhq0f+002304
Moving to projects directory: /home/kari/slots/4/ICMUAhq0f+002304
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12169430/ICMGGhq0f+002280
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12169430/ICMSHhq0f+002280
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12169430/ICMUAhq0f+002280
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12169430/ICMGGhq0f+002292
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12169430/ICMSHhq0f+002292
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12169430/ICMUAhq0f+002292
Zipping up the intermediate file: /home/kari/projects/climateprediction.net/oifs_43r3_ps_0786_1983050100_123_952_12169430_1_r1135878893_95.zip
Uploading the intermediate file: upload_file_95.zip
23:26:46 STEP 2305 H=2305:00 +CPU= 22.297
23:27:06 STEP 2306 H=2306:00 +CPU= 19.492
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:27:41 STEP 2307 H=2307:00 +CPU= 30.385
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:28:04 STEP 2308 H=2308:00 +CPU= 20.598
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:28:25 STEP 2309 H=2309:00 +CPU= 18.348
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1983050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0786
(argv4) batchid: 952
(argv5) wuid: 12169430
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /home/kari/slots/4
Project directory is: /home/kari/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12169430
..mkdir for temp folder for results failed
Copying: /home/kari/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /home/kari/slots/4/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /home/kari/slots/4/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_d63cd12f076ba25ad1a0e2752b707838 to: /home/kari/slots/4/oifs_43r3_ps_0786_1983050100_123_952_12169430.zip
Unzipping the namelist zip file: /home/kari/slots/4/oifs_43r3_ps_0786_1983050100_123_952_12169430.zip
ic_ancil_file: ic_ancil_12169430
ifsdata_file: ifsdata_12169430
climate_data_file: clim_data_12169430
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_6d3494750b74eb2545b0464961a4c684 to: /home/kari/slots/4/ic_ancil_12169430.zip
Unzipping the IC ancils zip file: /home/kari/slots/4/ic_ancil_12169430.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_590a3b944a2ea423482de576badb3ac5 to: /home/kari/slots/4/ifsdata/ifsdata_12169430.zip
Unzipping the ifsdata_zip file: /home/kari/slots/4/ifsdata/ifsdata_12169430.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /home/kari/slots/4/159l_2/clim_data_12169430.zip
Unzipping the climate data zip file: /home/kari/slots/4/159l_2/clim_data_12169430.zip
Checking for progress XML file: /home/kari/slots/4/progress_file_12169430.xml
Opened progress file ok : /home/kari/slots/4/progress_file_12169430.xml
-- Model is restarting --
Adjusting last_iter, 2309, to previous model restart step.
Creating progress file: /home/kari/slots/4/progress_file_12169430.xml
last_cpu_time: 76806
upload_file_number: 96
last_iter: 2303
last_upload: 8294400
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0786_1983050100_123_952_12169430_1_r1135878893
The child process has been launched with process id: 4457
Executing the command: /home/kari/slots/4/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:G:1:1:4457:4457] [20230117:163208:1673965928:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:G:1:1:4457:4457] [20230117:163208:1673965928:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:G:1:1:4457:4457] [20230117:163208:1673965928:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:G:1:1:4457:4457] [20230117:163208:1673965928:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:G:1:1:4457:4457] [20230117:163208:1673965928:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:G:1:1:4457:4457] [20230117:163208:1673965928:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:G:1:1:4457:4457] [20230117:163208:1673965928:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:G:1:1:4457:4457] [20230117:163208:1673965928:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:G:1:1:4457:4457] [20230117:163208:1673965928:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:G:1:1:4457:4457] [20230117:163208:1673965928:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:G:1:1:4457:4457] [20230117:163208:1673965928:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:G:1:1:4457:4457] [20230117:163208:1673965928:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:G:1:1:4457:4457] [20230117:163208:1673965928:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:G:1:1:4457:4457] [20230117:163208:1673965928:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:G:1:1:4457:4457] [20230117:163208:1673965928:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:G:1:1:4457:4457] [20230117:163208:1673965928:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:G:1:1:4457:4457] [20230117:163208:1673965928:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:G:1:1:4457:4457] [20230117:163208:1673965928:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:G:1:1:4457:4457] [20230117:163208:1673965928:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:G:1:1:4457:4457] [20230117:163208:1673965928:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:G:1:1:4457:4457] [20230117:163208:1673965928:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:G:1:1:4457:4457] [20230117:163208:1673965928:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:G:1:1:4457:4457] [20230117:163208:1673965928:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:G:1:1:4457:4457] [20230117:163208:1673965928:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:G:1:1:4457:4457] [20230117:163208:1673965928:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:G:1:1:4457:4457] [20230117:163208:1673965928:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:G:1:1:4457:4457] [20230117:163208:1673965928:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:G:1:1:4457:4457] [20230117:163208:1673965928:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:G:1:1:4457:4457] [20230117:163208:1673965928:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:G:1:1:4457:4457] [20230117:163208:1673965928:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
16:33:05 STEP 2304 H=2304:00 +CPU= 35.045
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
16:33:29 STEP 2305 H=2305:00 +CPU= 21.008
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
16:33:51 STEP 2306 H=2306:00 +CPU= 20.341
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
16:34:25 STEP 2307 H=2307:00 +CPU= 29.289
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
16:34:48 STEP 2308 H=2308:00 +CPU= 20.713
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
16:35:12 STEP 2309 H=2309:00 +CPU= 21.276
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
16:35:46 STEP 2310 H=2310:00 +CPU= 30.309
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
16:36:09 STEP 2311 H=2311:00 +CPU= 20.795
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
16:36:32 STEP 2312 H=2312:00 +CPU= 20.867
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
16:37:06 STEP 2313 H=2313:00 +CPU= 29.796
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
16:37:30 STEP 2314 H=2314:00 +CPU= 20.915
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
16:37:52 STEP 2315 H=2315:00 +CPU= 20.576
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
16:38:28 STEP 2316 H=2316:00 +CPU= 31.577
Moving to projects directory: /home/kari/slots/4/ICMGGhq0f+002316
Moving to projects directory: /home/kari/slots/4/ICMSHhq0f+002316
Moving to projects directory: /home/kari/slots/4/ICMUAhq0f+002316
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
16:38:51 STEP 2317 H=2317:00 +CPU= 20.093
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
16:39:13 STEP 2318 H=2318:00 +CPU= 20.605
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
16:39:47 STEP 2319 H=2319:00 +CPU= 29.400
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
16:40:10 STEP 2320 H=2320:00 +CPU= 20.870
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
16:40:34 STEP 2321 H=2321:00 +CPU= 22.002
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
16:41:11 STEP 2322 H=2322:00 +CPU= 31.853
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
16:41:34 STEP 2323 H=2323:00 +CPU= 21.414
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
16:41:58 STEP 2324 H=2324:00 +CPU= 21.918
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Abort request received from BOINC client, ending the child process
</stderr_txt>
]]>
