climateprediction.net home page
Task 22290248

Task 22290248

Name oifs_43r3_ps_0134_2018050100_123_987_12203778_0
Workunit 12203778
Created 24 Dec 2022, 19:51:08 UTC
Sent 22 Jan 2023, 15:25:25 UTC
Report deadline 23 Mar 2023, 15:25:25 UTC
Received 26 Jan 2023, 23:50:53 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1538515
Run time 10 hours 50 min 25 sec
CPU time 10 hours 45 min 38 sec
Validate state Valid
Credit 14,873.04
Device peak FLOPS 9.06 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,392.48 MB
Peak swap size 4,974.27 MB
Peak disk usage 2,953.30 MB
Stderr
<core_client_version>7.20.2</core_client_version>
<![CDATA[
<stderr_txt>
/ICMSHhq0f+002268
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMUAhq0f+002268
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_0134_2018050100_123_987_12203778_0_r750555874_94.zip
Uploading the intermediate file: upload_file_94.zip
  01:36:51 STEP 2281 H=2281:00 +CPU= 10.940
  01:37:02 STEP 2282 H=2282:00 +CPU= 11.031
  01:37:19 STEP 2283 H=2283:00 +CPU= 16.918
  01:37:30 STEP 2284 H=2284:00 +CPU= 11.404
  01:37:41 STEP 2285 H=2285:00 +CPU= 10.813
  01:37:58 STEP 2286 H=2286:00 +CPU= 16.919
  01:38:09 STEP 2287 H=2287:00 +CPU= 11.167
  01:38:20 STEP 2288 H=2288:00 +CPU= 11.058
  01:38:37 STEP 2289 H=2289:00 +CPU= 16.646
  01:38:48 STEP 2290 H=2290:00 +CPU= 11.369
  01:38:59 STEP 2291 H=2291:00 +CPU= 10.893
  01:39:18 STEP 2292 H=2292:00 +CPU= 18.502
Moving to projects directory: /home/fritzb/slots/5/ICMGGhq0f+002292
Moving to projects directory: /home/fritzb/slots/5/ICMSHhq0f+002292
Moving to projects directory: /home/fritzb/slots/5/ICMUAhq0f+002292
  01:39:29 STEP 2293 H=2293:00 +CPU= 11.305
  01:39:41 STEP 2294 H=2294:00 +CPU= 11.513
  01:39:57 STEP 2295 H=2295:00 +CPU= 16.660
  01:40:09 STEP 2296 H=2296:00 +CPU= 11.393
  01:40:20 STEP 2297 H=2297:00 +CPU= 11.059
  01:40:37 STEP 2298 H=2298:00 +CPU= 16.848
  01:40:48 STEP 2299 H=2299:00 +CPU= 11.018
  01:40:59 STEP 2300 H=2300:00 +CPU= 10.883
  01:41:15 STEP 2301 H=2301:00 +CPU= 16.222
  01:41:26 STEP 2302 H=2302:00 +CPU= 10.932
  01:41:37 STEP 2303 H=2303:00 +CPU= 10.976
  01:41:56 STEP 2304 H=2304:00 +CPU= 19.405
Moving to projects directory: /home/fritzb/slots/5/ICMGGhq0f+002304
Moving to projects directory: /home/fritzb/slots/5/ICMSHhq0f+002304
Moving to projects directory: /home/fritzb/slots/5/ICMUAhq0f+002304
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMGGhq0f+002280
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMSHhq0f+002280
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMUAhq0f+002280
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMGGhq0f+002292
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMSHhq0f+002292
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMUAhq0f+002292
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_0134_2018050100_123_987_12203778_0_r750555874_95.zip
Uploading the intermediate file: upload_file_95.zip
  01:42:07 STEP 2305 H=2305:00 +CPU= 10.719
  01:42:18 STEP 2306 H=2306:00 +CPU= 11.117
  01:42:34 STEP 2307 H=2307:00 +CPU= 16.316
  01:42:45 STEP 2308 H=2308:00 +CPU= 10.952
  01:42:56 STEP 2309 H=2309:00 +CPU= 10.781
  01:43:13 STEP 2310 H=2310:00 +CPU= 16.726
  01:43:24 STEP 2311 H=2311:00 +CPU= 10.901
  01:43:35 STEP 2312 H=2312:00 +CPU= 11.090
  01:43:51 STEP 2313 H=2313:00 +CPU= 16.571
  01:44:03 STEP 2314 H=2314:00 +CPU= 11.505
  01:44:14 STEP 2315 H=2315:00 +CPU= 11.149
  01:44:32 STEP 2316 H=2316:00 +CPU= 17.857
Moving to projects directory: /home/fritzb/slots/5/ICMGGhq0f+002316
Moving to projects directory: /home/fritzb/slots/5/ICMSHhq0f+002316
Moving to projects directory: /home/fritzb/slots/5/ICMUAhq0f+002316
  01:44:43 STEP 2317 H=2317:00 +CPU= 10.885
  01:44:54 STEP 2318 H=2318:00 +CPU= 11.314
  01:45:11 STEP 2319 H=2319:00 +CPU= 16.790
  01:45:22 STEP 2320 H=2320:00 +CPU= 11.226
  01:45:33 STEP 2321 H=2321:00 +CPU= 11.104
  01:45:50 STEP 2322 H=2322:00 +CPU= 16.714
  01:46:03 STEP 2323 H=2323:00 +CPU= 11.013
  01:46:15 STEP 2324 H=2324:00 +CPU= 11.315
  01:46:31 STEP 2325 H=2325:00 +CPU= 16.830
  01:46:42 STEP 2326 H=2326:00 +CPU= 10.877
  01:46:54 STEP 2327 H=2327:00 +CPU= 11.304
  01:47:14 STEP 2328 H=2328:00 +CPU= 19.891
Moving to projects directory: /home/fritzb/slots/5/ICMGGhq0f+002328
Moving to projects directory: /home/fritzb/slots/5/ICMSHhq0f+002328
Moving to projects directory: /home/fritzb/slots/5/ICMUAhq0f+002328
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMGGhq0f+002304
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMSHhq0f+002304
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMUAhq0f+002304
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMGGhq0f+002316
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMSHhq0f+002316
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMUAhq0f+002316
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_0134_2018050100_123_987_12203778_0_r750555874_96.zip
Uploading the intermediate file: upload_file_96.zip
  01:47:24 STEP 2329 H=2329:00 +CPU= 10.888
  01:47:36 STEP 2330 H=2330:00 +CPU= 11.159
  01:47:52 STEP 2331 H=2331:00 +CPU= 16.727
  01:48:04 STEP 2332 H=2332:00 +CPU= 11.413
  01:48:15 STEP 2333 H=2333:00 +CPU= 11.019
  01:48:32 STEP 2334 H=2334:00 +CPU= 17.108
  01:48:43 STEP 2335 H=2335:00 +CPU= 11.082
  01:48:55 STEP 2336 H=2336:00 +CPU= 11.598
  01:49:11 STEP 2337 H=2337:00 +CPU= 16.814
  01:49:23 STEP 2338 H=2338:00 +CPU= 11.228
  01:49:34 STEP 2339 H=2339:00 +CPU= 11.109
  01:49:52 STEP 2340 H=2340:00 +CPU= 18.185
Moving to projects directory: /home/fritzb/slots/5/ICMGGhq0f+002340
Moving to projects directory: /home/fritzb/slots/5/ICMSHhq0f+002340
Moving to projects directory: /home/fritzb/slots/5/ICMUAhq0f+002340
  01:50:03 STEP 2341 H=2341:00 +CPU= 10.939
  01:50:14 STEP 2342 H=2342:00 +CPU= 11.473
  01:50:31 STEP 2343 H=2343:00 +CPU= 16.776
  01:50:42 STEP 2344 H=2344:00 +CPU= 11.254
  01:50:54 STEP 2345 H=2345:00 +CPU= 11.040
  01:51:11 STEP 2346 H=2346:00 +CPU= 17.184
  01:51:22 STEP 2347 H=2347:00 +CPU= 10.835
  01:51:33 STEP 2348 H=2348:00 +CPU= 11.543
  01:51:50 STEP 2349 H=2349:00 +CPU= 16.812
  01:52:01 STEP 2350 H=2350:00 +CPU= 10.948
  01:52:12 STEP 2351 H=2351:00 +CPU= 11.429
  01:52:32 STEP 2352 H=2352:00 +CPU= 20.098
Moving to projects directory: /home/fritzb/slots/5/ICMGGhq0f+002352
Moving to projects directory: /home/fritzb/slots/5/ICMSHhq0f+002352
Moving to projects directory: /home/fritzb/slots/5/ICMUAhq0f+002352
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMGGhq0f+002328
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMSHhq0f+002328
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMUAhq0f+002328
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMGGhq0f+002340
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMSHhq0f+002340
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMUAhq0f+002340
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_0134_2018050100_123_987_12203778_0_r750555874_97.zip
Uploading the intermediate file: upload_file_97.zip
  01:52:43 STEP 2353 H=2353:00 +CPU= 10.657
  01:52:54 STEP 2354 H=2354:00 +CPU= 11.254
  01:53:11 STEP 2355 H=2355:00 +CPU= 16.661
  01:53:22 STEP 2356 H=2356:00 +CPU= 11.064
  01:53:33 STEP 2357 H=2357:00 +CPU= 11.271
  01:53:50 STEP 2358 H=2358:00 +CPU= 16.797
  01:54:01 STEP 2359 H=2359:00 +CPU= 10.718
  01:54:13 STEP 2360 H=2360:00 +CPU= 11.543
  01:54:29 STEP 2361 H=2361:00 +CPU= 16.957
  01:54:40 STEP 2362 H=2362:00 +CPU= 10.908
  01:54:52 STEP 2363 H=2363:00 +CPU= 11.233
  01:55:10 STEP 2364 H=2364:00 +CPU= 18.728
Moving to projects directory: /home/fritzb/slots/5/ICMGGhq0f+002364
Moving to projects directory: /home/fritzb/slots/5/ICMSHhq0f+002364
Moving to projects directory: /home/fritzb/slots/5/ICMUAhq0f+002364
  01:55:21 STEP 2365 H=2365:00 +CPU= 10.782
  01:55:33 STEP 2366 H=2366:00 +CPU= 11.454
  01:55:50 STEP 2367 H=2367:00 +CPU= 17.003
  01:56:01 STEP 2368 H=2368:00 +CPU= 11.097
  01:56:12 STEP 2369 H=2369:00 +CPU= 11.228
  01:56:30 STEP 2370 H=2370:00 +CPU= 17.503
  01:56:40 STEP 2371 H=2371:00 +CPU= 10.410
  01:56:51 STEP 2372 H=2372:00 +CPU= 11.341
  01:57:08 STEP 2373 H=2373:00 +CPU= 16.728
  01:57:19 STEP 2374 H=2374:00 +CPU= 10.624
  01:57:30 STEP 2375 H=2375:00 +CPU= 11.040
  01:57:50 STEP 2376 H=2376:00 +CPU= 19.992
Moving to projects directory: /home/fritzb/slots/5/ICMGGhq0f+002376
Moving to projects directory: /home/fritzb/slots/5/ICMSHhq0f+002376
Moving to projects directory: /home/fritzb/slots/5/ICMUAhq0f+002376
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMGGhq0f+002352
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMSHhq0f+002352
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMUAhq0f+002352
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMGGhq0f+002364
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMSHhq0f+002364
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMUAhq0f+002364
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_0134_2018050100_123_987_12203778_0_r750555874_98.zip
Uploading the intermediate file: upload_file_98.zip
  01:58:00 STEP 2377 H=2377:00 +CPU= 10.520
  01:58:12 STEP 2378 H=2378:00 +CPU= 11.318
  01:58:29 STEP 2379 H=2379:00 +CPU= 17.106
  01:58:40 STEP 2380 H=2380:00 +CPU= 10.840
  01:58:50 STEP 2381 H=2381:00 +CPU= 10.887
  01:59:08 STEP 2382 H=2382:00 +CPU= 17.102
  01:59:18 STEP 2383 H=2383:00 +CPU= 10.540
  01:59:29 STEP 2384 H=2384:00 +CPU= 11.009
  01:59:46 STEP 2385 H=2385:00 +CPU= 16.584
  01:59:56 STEP 2386 H=2386:00 +CPU= 10.748
  02:00:07 STEP 2387 H=2387:00 +CPU= 10.885
  02:00:26 STEP 2388 H=2388:00 +CPU= 18.325
Moving to projects directory: /home/fritzb/slots/5/ICMGGhq0f+002388
Moving to projects directory: /home/fritzb/slots/5/ICMSHhq0f+002388
Moving to projects directory: /home/fritzb/slots/5/ICMUAhq0f+002388
  02:00:36 STEP 2389 H=2389:00 +CPU= 10.556
  02:00:47 STEP 2390 H=2390:00 +CPU= 11.123
  02:01:04 STEP 2391 H=2391:00 +CPU= 16.705
  02:01:15 STEP 2392 H=2392:00 +CPU= 10.916
  02:01:26 STEP 2393 H=2393:00 +CPU= 10.968
  02:01:43 STEP 2394 H=2394:00 +CPU= 17.365
  02:01:54 STEP 2395 H=2395:00 +CPU= 10.410
  02:02:05 STEP 2396 H=2396:00 +CPU= 11.005
  02:02:22 STEP 2397 H=2397:00 +CPU= 17.171
  02:02:33 STEP 2398 H=2398:00 +CPU= 10.597
  02:02:44 STEP 2399 H=2399:00 +CPU= 11.254
  02:03:04 STEP 2400 H=2400:00 +CPU= 20.117
Moving to projects directory: /home/fritzb/slots/5/ICMGGhq0f+002400
Moving to projects directory: /home/fritzb/slots/5/ICMSHhq0f+002400
Moving to projects directory: /home/fritzb/slots/5/ICMUAhq0f+002400
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMGGhq0f+002376
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMSHhq0f+002376
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMUAhq0f+002376
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMGGhq0f+002388
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMSHhq0f+002388
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMUAhq0f+002388
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_0134_2018050100_123_987_12203778_0_r750555874_99.zip
Uploading the intermediate file: upload_file_99.zip
  02:03:15 STEP 2401 H=2401:00 +CPU= 10.677
  02:03:26 STEP 2402 H=2402:00 +CPU= 11.058
Uploading trickle at timestep: 8640000
  02:03:43 STEP 2403 H=2403:00 +CPU= 16.881
  02:03:54 STEP 2404 H=2404:00 +CPU= 10.895
  02:04:05 STEP 2405 H=2405:00 +CPU= 11.001
  02:04:22 STEP 2406 H=2406:00 +CPU= 17.294
  02:04:32 STEP 2407 H=2407:00 +CPU= 10.404
  02:04:44 STEP 2408 H=2408:00 +CPU= 11.369
  02:05:01 STEP 2409 H=2409:00 +CPU= 17.285
  02:05:12 STEP 2410 H=2410:00 +CPU= 10.569
  02:05:23 STEP 2411 H=2411:00 +CPU= 10.990
  02:05:42 STEP 2412 H=2412:00 +CPU= 18.898
Moving to projects directory: /home/fritzb/slots/5/ICMGGhq0f+002412
Moving to projects directory: /home/fritzb/slots/5/ICMSHhq0f+002412
Moving to projects directory: /home/fritzb/slots/5/ICMUAhq0f+002412
  02:05:52 STEP 2413 H=2413:00 +CPU= 10.637
  02:06:03 STEP 2414 H=2414:00 +CPU= 11.116
  02:06:21 STEP 2415 H=2415:00 +CPU= 17.069
  02:06:31 STEP 2416 H=2416:00 +CPU= 10.441
  02:06:42 STEP 2417 H=2417:00 +CPU= 11.037
  02:07:00 STEP 2418 H=2418:00 +CPU= 17.515
  02:07:10 STEP 2419 H=2419:00 +CPU= 10.296
  02:07:21 STEP 2420 H=2420:00 +CPU= 10.688
  02:07:38 STEP 2421 H=2421:00 +CPU= 17.395
  02:07:48 STEP 2422 H=2422:00 +CPU= 10.422
  02:07:59 STEP 2423 H=2423:00 +CPU= 10.715
  02:08:20 STEP 2424 H=2424:00 +CPU= 20.654
Moving to projects directory: /home/fritzb/slots/5/ICMGGhq0f+002424
Moving to projects directory: /home/fritzb/slots/5/ICMSHhq0f+002424
Moving to projects directory: /home/fritzb/slots/5/ICMUAhq0f+002424
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMGGhq0f+002400
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMSHhq0f+002400
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMUAhq0f+002400
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMGGhq0f+002412
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMSHhq0f+002412
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMUAhq0f+002412
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_0134_2018050100_123_987_12203778_0_r750555874_100.zip
Uploading the intermediate file: upload_file_100.zip
  02:08:30 STEP 2425 H=2425:00 +CPU=  9.980
  02:08:41 STEP 2426 H=2426:00 +CPU= 10.879
  02:08:58 STEP 2427 H=2427:00 +CPU= 17.679
  02:09:09 STEP 2428 H=2428:00 +CPU= 10.484
  02:09:19 STEP 2429 H=2429:00 +CPU= 10.477
  02:09:37 STEP 2430 H=2430:00 +CPU= 17.374
  02:09:47 STEP 2431 H=2431:00 +CPU= 10.325
  02:09:58 STEP 2432 H=2432:00 +CPU= 10.624
  02:10:15 STEP 2433 H=2433:00 +CPU= 17.217
  02:10:26 STEP 2434 H=2434:00 +CPU= 10.863
  02:10:36 STEP 2435 H=2435:00 +CPU= 10.614
  02:10:56 STEP 2436 H=2436:00 +CPU= 19.044
Moving to projects directory: /home/fritzb/slots/5/ICMGGhq0f+002436
Moving to projects directory: /home/fritzb/slots/5/ICMSHhq0f+002436
Moving to projects directory: /home/fritzb/slots/5/ICMUAhq0f+002436
  02:11:06 STEP 2437 H=2437:00 +CPU= 10.326
  02:11:16 STEP 2438 H=2438:00 +CPU= 10.620
  02:11:33 STEP 2439 H=2439:00 +CPU= 16.938
  02:11:45 STEP 2440 H=2440:00 +CPU= 11.214
  02:11:55 STEP 2441 H=2441:00 +CPU= 10.690
  02:12:13 STEP 2442 H=2442:00 +CPU= 17.232
  02:12:24 STEP 2443 H=2443:00 +CPU= 11.201
  02:12:35 STEP 2444 H=2444:00 +CPU= 11.208
  02:12:52 STEP 2445 H=2445:00 +CPU= 17.223
  02:13:04 STEP 2446 H=2446:00 +CPU= 11.316
  02:13:15 STEP 2447 H=2447:00 +CPU= 11.140
  02:13:35 STEP 2448 H=2448:00 +CPU= 20.400
Moving to projects directory: /home/fritzb/slots/5/ICMGGhq0f+002448
Moving to projects directory: /home/fritzb/slots/5/ICMSHhq0f+002448
Moving to projects directory: /home/fritzb/slots/5/ICMUAhq0f+002448
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMGGhq0f+002424
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMSHhq0f+002424
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMUAhq0f+002424
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMGGhq0f+002436
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMSHhq0f+002436
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMUAhq0f+002436
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_0134_2018050100_123_987_12203778_0_r750555874_101.zip
Uploading the intermediate file: upload_file_101.zip
  02:13:46 STEP 2449 H=2449:00 +CPU= 10.584
  02:13:57 STEP 2450 H=2450:00 +CPU= 10.867
  02:14:14 STEP 2451 H=2451:00 +CPU= 17.215
  02:14:25 STEP 2452 H=2452:00 +CPU= 11.148
  02:14:36 STEP 2453 H=2453:00 +CPU= 10.919
  02:14:53 STEP 2454 H=2454:00 +CPU= 17.334
  02:15:04 STEP 2455 H=2455:00 +CPU= 10.793
  02:15:15 STEP 2456 H=2456:00 +CPU= 11.028
  02:15:32 STEP 2457 H=2457:00 +CPU= 17.139
  02:15:43 STEP 2458 H=2458:00 +CPU= 11.022
  02:15:54 STEP 2459 H=2459:00 +CPU= 10.793
  02:16:13 STEP 2460 H=2460:00 +CPU= 18.709
Moving to projects directory: /home/fritzb/slots/5/ICMGGhq0f+002460
Moving to projects directory: /home/fritzb/slots/5/ICMSHhq0f+002460
Moving to projects directory: /home/fritzb/slots/5/ICMUAhq0f+002460
  02:16:24 STEP 2461 H=2461:00 +CPU= 10.780
  02:16:35 STEP 2462 H=2462:00 +CPU= 10.931
  02:16:52 STEP 2463 H=2463:00 +CPU= 17.112
  02:17:03 STEP 2464 H=2464:00 +CPU= 11.177
  02:17:14 STEP 2465 H=2465:00 +CPU= 10.777
  02:17:31 STEP 2466 H=2466:00 +CPU= 17.464
  02:17:42 STEP 2467 H=2467:00 +CPU= 10.774
  02:17:52 STEP 2468 H=2468:00 +CPU= 10.571
  02:18:10 STEP 2469 H=2469:00 +CPU= 17.078
  02:18:20 STEP 2470 H=2470:00 +CPU= 10.819
  02:18:31 STEP 2471 H=2471:00 +CPU= 10.473
  02:18:51 STEP 2472 H=2472:00 +CPU= 20.459
Moving to projects directory: /home/fritzb/slots/5/ICMGGhq0f+002472
Moving to projects directory: /home/fritzb/slots/5/ICMSHhq0f+002472
Moving to projects directory: /home/fritzb/slots/5/ICMUAhq0f+002472
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMGGhq0f+002448
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMSHhq0f+002448
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMUAhq0f+002448
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMGGhq0f+002460
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMSHhq0f+002460
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMUAhq0f+002460
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_0134_2018050100_123_987_12203778_0_r750555874_102.zip
Uploading the intermediate file: upload_file_102.zip
  02:19:02 STEP 2473 H=2473:00 +CPU= 10.823
  02:19:13 STEP 2474 H=2474:00 +CPU= 10.808
  02:19:30 STEP 2475 H=2475:00 +CPU= 16.837
  02:19:41 STEP 2476 H=2476:00 +CPU= 10.965
  02:19:51 STEP 2477 H=2477:00 +CPU= 10.129
  02:20:08 STEP 2478 H=2478:00 +CPU= 17.437
  02:20:19 STEP 2479 H=2479:00 +CPU= 10.802
  02:20:29 STEP 2480 H=2480:00 +CPU= 10.160
  02:20:47 STEP 2481 H=2481:00 +CPU= 17.239
  02:20:58 STEP 2482 H=2482:00 +CPU= 11.296
  02:21:08 STEP 2483 H=2483:00 +CPU=  9.968
  02:21:27 STEP 2484 H=2484:00 +CPU= 18.939
Moving to projects directory: /home/fritzb/slots/5/ICMGGhq0f+002484
Moving to projects directory: /home/fritzb/slots/5/ICMSHhq0f+002484
Moving to projects directory: /home/fritzb/slots/5/ICMUAhq0f+002484
  02:21:38 STEP 2485 H=2485:00 +CPU= 10.675
  02:21:48 STEP 2486 H=2486:00 +CPU= 10.341
  02:22:05 STEP 2487 H=2487:00 +CPU= 16.972
  02:22:16 STEP 2488 H=2488:00 +CPU= 11.428
  02:22:27 STEP 2489 H=2489:00 +CPU= 10.439
  02:22:44 STEP 2490 H=2490:00 +CPU= 17.193
  02:22:55 STEP 2491 H=2491:00 +CPU= 10.826
  02:23:06 STEP 2492 H=2492:00 +CPU= 11.014
  02:23:23 STEP 2493 H=2493:00 +CPU= 16.893
  02:23:34 STEP 2494 H=2494:00 +CPU= 11.079
  02:23:45 STEP 2495 H=2495:00 +CPU= 10.988
  02:24:05 STEP 2496 H=2496:00 +CPU= 20.245
Moving to projects directory: /home/fritzb/slots/5/ICMGGhq0f+002496
Moving to projects directory: /home/fritzb/slots/5/ICMSHhq0f+002496
Moving to projects directory: /home/fritzb/slots/5/ICMUAhq0f+002496
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMGGhq0f+002472
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMSHhq0f+002472
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMUAhq0f+002472
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMGGhq0f+002484
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMSHhq0f+002484
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMUAhq0f+002484
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_0134_2018050100_123_987_12203778_0_r750555874_103.zip
Uploading the intermediate file: upload_file_103.zip
  02:24:16 STEP 2497 H=2497:00 +CPU= 10.893
  02:24:27 STEP 2498 H=2498:00 +CPU= 10.901
  02:24:44 STEP 2499 H=2499:00 +CPU= 17.054
  02:24:55 STEP 2500 H=2500:00 +CPU= 11.249
  02:25:06 STEP 2501 H=2501:00 +CPU= 10.982
  02:25:23 STEP 2502 H=2502:00 +CPU= 17.244
  02:25:35 STEP 2503 H=2503:00 +CPU= 11.048
  02:25:46 STEP 2504 H=2504:00 +CPU= 11.096
  02:26:02 STEP 2505 H=2505:00 +CPU= 16.693
  02:26:14 STEP 2506 H=2506:00 +CPU= 11.295
  02:26:25 STEP 2507 H=2507:00 +CPU= 11.020
  02:26:43 STEP 2508 H=2508:00 +CPU= 18.487
Moving to projects directory: /home/fritzb/slots/5/ICMGGhq0f+002508
Moving to projects directory: /home/fritzb/slots/5/ICMSHhq0f+002508
Moving to projects directory: /home/fritzb/slots/5/ICMUAhq0f+002508
  02:26:54 STEP 2509 H=2509:00 +CPU= 10.832
  02:27:05 STEP 2510 H=2510:00 +CPU= 10.995
  02:27:22 STEP 2511 H=2511:00 +CPU= 16.567
  02:27:33 STEP 2512 H=2512:00 +CPU= 11.505
  02:27:44 STEP 2513 H=2513:00 +CPU= 11.084
  02:28:01 STEP 2514 H=2514:00 +CPU= 16.907
  02:28:12 STEP 2515 H=2515:00 +CPU= 10.948
  02:28:24 STEP 2516 H=2516:00 +CPU= 11.589
  02:28:40 STEP 2517 H=2517:00 +CPU= 16.556
  02:28:51 STEP 2518 H=2518:00 +CPU= 11.097
  02:29:02 STEP 2519 H=2519:00 +CPU= 10.971
  02:29:22 STEP 2520 H=2520:00 +CPU= 19.909
Moving to projects directory: /home/fritzb/slots/5/ICMGGhq0f+002520
Moving to projects directory: /home/fritzb/slots/5/ICMSHhq0f+002520
Moving to projects directory: /home/fritzb/slots/5/ICMUAhq0f+002520
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMGGhq0f+002496
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMSHhq0f+002496
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMUAhq0f+002496
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMGGhq0f+002508
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMSHhq0f+002508
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMUAhq0f+002508
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_0134_2018050100_123_987_12203778_0_r750555874_104.zip
Uploading the intermediate file: upload_file_104.zip
  02:29:33 STEP 2521 H=2521:00 +CPU= 10.984
  02:29:44 STEP 2522 H=2522:00 +CPU= 11.231
  02:30:01 STEP 2523 H=2523:00 +CPU= 16.537
  02:30:14 STEP 2524 H=2524:00 +CPU= 11.332
  02:30:25 STEP 2525 H=2525:00 +CPU= 11.035
  02:30:41 STEP 2526 H=2526:00 +CPU= 16.707
  02:30:52 STEP 2527 H=2527:00 +CPU= 11.008
  02:31:03 STEP 2528 H=2528:00 +CPU= 10.921
  02:31:20 STEP 2529 H=2529:00 +CPU= 16.331
  02:31:31 STEP 2530 H=2530:00 +CPU= 11.022
  02:31:41 STEP 2531 H=2531:00 +CPU= 10.670
  02:31:59 STEP 2532 H=2532:00 +CPU= 17.804
Moving to projects directory: /home/fritzb/slots/5/ICMGGhq0f+002532
Moving to projects directory: /home/fritzb/slots/5/ICMSHhq0f+002532
Moving to projects directory: /home/fritzb/slots/5/ICMUAhq0f+002532
  02:32:10 STEP 2533 H=2533:00 +CPU= 10.715
  02:32:21 STEP 2534 H=2534:00 +CPU= 10.990
  02:32:37 STEP 2535 H=2535:00 +CPU= 16.155
  02:32:48 STEP 2536 H=2536:00 +CPU= 11.193
  02:32:59 STEP 2537 H=2537:00 +CPU= 11.054
  02:33:16 STEP 2538 H=2538:00 +CPU= 16.516
  02:33:27 STEP 2539 H=2539:00 +CPU= 10.785
  02:33:38 STEP 2540 H=2540:00 +CPU= 11.036
  02:33:54 STEP 2541 H=2541:00 +CPU= 16.650
  02:34:05 STEP 2542 H=2542:00 +CPU= 11.037
  02:34:16 STEP 2543 H=2543:00 +CPU= 11.193
  02:34:37 STEP 2544 H=2544:00 +CPU= 20.139
Moving to projects directory: /home/fritzb/slots/5/ICMGGhq0f+002544
Moving to projects directory: /home/fritzb/slots/5/ICMSHhq0f+002544
Moving to projects directory: /home/fritzb/slots/5/ICMUAhq0f+002544
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMGGhq0f+002520
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMSHhq0f+002520
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMUAhq0f+002520
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMGGhq0f+002532
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMSHhq0f+002532
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMUAhq0f+002532
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_0134_2018050100_123_987_12203778_0_r750555874_105.zip
Uploading the intermediate file: upload_file_105.zip
  02:34:48 STEP 2545 H=2545:00 +CPU= 11.010
  02:34:59 STEP 2546 H=2546:00 +CPU= 11.442
  02:35:16 STEP 2547 H=2547:00 +CPU= 16.575
  02:35:27 STEP 2548 H=2548:00 +CPU= 11.167
  02:35:38 STEP 2549 H=2549:00 +CPU= 11.089
  02:35:55 STEP 2550 H=2550:00 +CPU= 16.841
  02:36:05 STEP 2551 H=2551:00 +CPU= 10.569
  02:36:17 STEP 2552 H=2552:00 +CPU= 11.432
  02:36:34 STEP 2553 H=2553:00 +CPU= 16.769
  02:36:45 STEP 2554 H=2554:00 +CPU= 10.939
  02:36:56 STEP 2555 H=2555:00 +CPU= 10.972
  02:37:14 STEP 2556 H=2556:00 +CPU= 18.610
Moving to projects directory: /home/fritzb/slots/5/ICMGGhq0f+002556
Moving to projects directory: /home/fritzb/slots/5/ICMSHhq0f+002556
Moving to projects directory: /home/fritzb/slots/5/ICMUAhq0f+002556
  02:37:25 STEP 2557 H=2557:00 +CPU= 10.738
  02:37:36 STEP 2558 H=2558:00 +CPU= 11.160
  02:37:53 STEP 2559 H=2559:00 +CPU= 16.572
  02:38:04 STEP 2560 H=2560:00 +CPU= 11.089
  02:38:15 STEP 2561 H=2561:00 +CPU= 11.301
  02:38:32 STEP 2562 H=2562:00 +CPU= 17.077
  02:38:43 STEP 2563 H=2563:00 +CPU= 10.645
  02:38:54 STEP 2564 H=2564:00 +CPU= 11.215
  02:39:11 STEP 2565 H=2565:00 +CPU= 17.260
  02:39:22 STEP 2566 H=2566:00 +CPU= 10.805
  02:39:33 STEP 2567 H=2567:00 +CPU= 11.140
  02:39:53 STEP 2568 H=2568:00 +CPU= 19.998
Moving to projects directory: /home/fritzb/slots/5/ICMGGhq0f+002568
Moving to projects directory: /home/fritzb/slots/5/ICMSHhq0f+002568
Moving to projects directory: /home/fritzb/slots/5/ICMUAhq0f+002568
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMGGhq0f+002544
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMSHhq0f+002544
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMUAhq0f+002544
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMGGhq0f+002556
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMSHhq0f+002556
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMUAhq0f+002556
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_0134_2018050100_123_987_12203778_0_r750555874_106.zip
Uploading the intermediate file: upload_file_106.zip
  02:40:04 STEP 2569 H=2569:00 +CPU= 10.735
  02:40:15 STEP 2570 H=2570:00 +CPU= 11.223
  02:40:32 STEP 2571 H=2571:00 +CPU= 17.016
  02:40:43 STEP 2572 H=2572:00 +CPU= 10.890
  02:40:54 STEP 2573 H=2573:00 +CPU= 11.072
  02:41:12 STEP 2574 H=2574:00 +CPU= 17.350
  02:41:22 STEP 2575 H=2575:00 +CPU= 10.622
  02:41:34 STEP 2576 H=2576:00 +CPU= 11.198
  02:41:50 STEP 2577 H=2577:00 +CPU= 16.940
  02:42:01 STEP 2578 H=2578:00 +CPU= 10.847
  02:42:12 STEP 2579 H=2579:00 +CPU= 10.827
  02:42:30 STEP 2580 H=2580:00 +CPU= 18.292
Moving to projects directory: /home/fritzb/slots/5/ICMGGhq0f+002580
Moving to projects directory: /home/fritzb/slots/5/ICMSHhq0f+002580
Moving to projects directory: /home/fritzb/slots/5/ICMUAhq0f+002580
  02:42:41 STEP 2581 H=2581:00 +CPU= 10.349
  02:42:52 STEP 2582 H=2582:00 +CPU= 10.739
  02:43:08 STEP 2583 H=2583:00 +CPU= 16.730
  02:43:19 STEP 2584 H=2584:00 +CPU= 11.009
  02:43:30 STEP 2585 H=2585:00 +CPU= 10.567
  02:43:47 STEP 2586 H=2586:00 +CPU= 17.240
  02:43:58 STEP 2587 H=2587:00 +CPU= 10.672
  02:44:09 STEP 2588 H=2588:00 +CPU= 11.125
  02:44:26 STEP 2589 H=2589:00 +CPU= 16.958
  02:44:37 STEP 2590 H=2590:00 +CPU= 10.892
  02:44:48 STEP 2591 H=2591:00 +CPU= 11.342
  02:45:08 STEP 2592 H=2592:00 +CPU= 20.027
Moving to projects directory: /home/fritzb/slots/5/ICMGGhq0f+002592
Moving to projects directory: /home/fritzb/slots/5/ICMSHhq0f+002592
Moving to projects directory: /home/fritzb/slots/5/ICMUAhq0f+002592
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMGGhq0f+002568
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMSHhq0f+002568
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMUAhq0f+002568
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMGGhq0f+002580
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMSHhq0f+002580
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMUAhq0f+002580
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_0134_2018050100_123_987_12203778_0_r750555874_107.zip
Uploading the intermediate file: upload_file_107.zip
  02:45:19 STEP 2593 H=2593:00 +CPU= 10.578
  02:45:30 STEP 2594 H=2594:00 +CPU= 11.029
  02:45:47 STEP 2595 H=2595:00 +CPU= 16.985
  02:45:58 STEP 2596 H=2596:00 +CPU= 11.015
  02:46:09 STEP 2597 H=2597:00 +CPU= 11.081
  02:46:26 STEP 2598 H=2598:00 +CPU= 17.206
  02:46:37 STEP 2599 H=2599:00 +CPU= 10.882
  02:46:49 STEP 2600 H=2600:00 +CPU= 11.091
  02:47:06 STEP 2601 H=2601:00 +CPU= 16.961
  02:47:16 STEP 2602 H=2602:00 +CPU= 10.520
  02:47:27 STEP 2603 H=2603:00 +CPU= 10.695
  02:47:46 STEP 2604 H=2604:00 +CPU= 18.547
Moving to projects directory: /home/fritzb/slots/5/ICMGGhq0f+002604
Moving to projects directory: /home/fritzb/slots/5/ICMSHhq0f+002604
Moving to projects directory: /home/fritzb/slots/5/ICMUAhq0f+002604
  02:47:56 STEP 2605 H=2605:00 +CPU= 10.398
  02:48:07 STEP 2606 H=2606:00 +CPU= 11.170
  02:48:24 STEP 2607 H=2607:00 +CPU= 17.060
  02:48:35 STEP 2608 H=2608:00 +CPU= 10.503
  02:48:45 STEP 2609 H=2609:00 +CPU= 10.675
  02:49:03 STEP 2610 H=2610:00 +CPU= 17.624
  02:49:13 STEP 2611 H=2611:00 +CPU=  9.986
  02:49:24 STEP 2612 H=2612:00 +CPU= 10.853
  02:49:42 STEP 2613 H=2613:00 +CPU= 17.368
  02:49:52 STEP 2614 H=2614:00 +CPU= 10.387
  02:50:03 STEP 2615 H=2615:00 +CPU= 10.704
  02:50:23 STEP 2616 H=2616:00 +CPU= 20.456
Moving to projects directory: /home/fritzb/slots/5/ICMGGhq0f+002616
Moving to projects directory: /home/fritzb/slots/5/ICMSHhq0f+002616
Moving to projects directory: /home/fritzb/slots/5/ICMUAhq0f+002616
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMGGhq0f+002592
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMSHhq0f+002592
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMUAhq0f+002592
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMGGhq0f+002604
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMSHhq0f+002604
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMUAhq0f+002604
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_0134_2018050100_123_987_12203778_0_r750555874_108.zip
Uploading the intermediate file: upload_file_108.zip
  02:50:34 STEP 2617 H=2617:00 +CPU= 10.089
  02:50:44 STEP 2618 H=2618:00 +CPU= 10.911
  02:51:02 STEP 2619 H=2619:00 +CPU= 17.428
  02:51:12 STEP 2620 H=2620:00 +CPU= 10.303
  02:51:23 STEP 2621 H=2621:00 +CPU= 10.873
  02:51:41 STEP 2622 H=2622:00 +CPU= 17.756
  02:51:51 STEP 2623 H=2623:00 +CPU= 10.504
  02:52:02 STEP 2624 H=2624:00 +CPU= 10.710
  02:52:19 STEP 2625 H=2625:00 +CPU= 16.841
  02:52:30 STEP 2626 H=2626:00 +CPU= 10.591
  02:52:40 STEP 2627 H=2627:00 +CPU= 10.590
  02:52:59 STEP 2628 H=2628:00 +CPU= 18.451
Moving to projects directory: /home/fritzb/slots/5/ICMGGhq0f+002628
Moving to projects directory: /home/fritzb/slots/5/ICMSHhq0f+002628
Moving to projects directory: /home/fritzb/slots/5/ICMUAhq0f+002628
  02:53:09 STEP 2629 H=2629:00 +CPU= 10.553
  02:53:20 STEP 2630 H=2630:00 +CPU= 10.708
  02:53:37 STEP 2631 H=2631:00 +CPU= 16.821
  02:53:48 STEP 2632 H=2632:00 +CPU= 11.112
  02:53:58 STEP 2633 H=2633:00 +CPU= 10.561
  02:54:16 STEP 2634 H=2634:00 +CPU= 17.194
  02:54:27 STEP 2635 H=2635:00 +CPU= 11.137
  02:54:38 STEP 2636 H=2636:00 +CPU= 11.117
  02:54:55 STEP 2637 H=2637:00 +CPU= 16.965
  02:55:06 STEP 2638 H=2638:00 +CPU= 11.215
  02:55:17 STEP 2639 H=2639:00 +CPU= 10.802
  02:55:38 STEP 2640 H=2640:00 +CPU= 20.360
Moving to projects directory: /home/fritzb/slots/5/ICMGGhq0f+002640
Moving to projects directory: /home/fritzb/slots/5/ICMSHhq0f+002640
Moving to projects directory: /home/fritzb/slots/5/ICMUAhq0f+002640
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMGGhq0f+002616
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMSHhq0f+002616
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMUAhq0f+002616
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMGGhq0f+002628
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMSHhq0f+002628
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMUAhq0f+002628
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_0134_2018050100_123_987_12203778_0_r750555874_109.zip
Uploading the intermediate file: upload_file_109.zip
  02:55:48 STEP 2641 H=2641:00 +CPU= 10.604
  02:55:59 STEP 2642 H=2642:00 +CPU= 10.788
Uploading trickle at timestep: 9504000
  02:56:16 STEP 2643 H=2643:00 +CPU= 16.800
  02:56:27 STEP 2644 H=2644:00 +CPU= 10.930
  02:56:38 STEP 2645 H=2645:00 +CPU= 10.684
  02:56:55 STEP 2646 H=2646:00 +CPU= 17.398
  02:57:06 STEP 2647 H=2647:00 +CPU= 10.684
  02:57:17 STEP 2648 H=2648:00 +CPU= 10.915
  02:57:34 STEP 2649 H=2649:00 +CPU= 17.025
  02:57:45 STEP 2650 H=2650:00 +CPU= 10.973
  02:57:55 STEP 2651 H=2651:00 +CPU= 10.688
  02:58:14 STEP 2652 H=2652:00 +CPU= 18.779
Moving to projects directory: /home/fritzb/slots/5/ICMGGhq0f+002652
Moving to projects directory: /home/fritzb/slots/5/ICMSHhq0f+002652
Moving to projects directory: /home/fritzb/slots/5/ICMUAhq0f+002652
  02:58:25 STEP 2653 H=2653:00 +CPU= 10.797
  02:58:36 STEP 2654 H=2654:00 +CPU= 10.808
  02:58:53 STEP 2655 H=2655:00 +CPU= 16.778
  02:59:04 STEP 2656 H=2656:00 +CPU= 11.035
  02:59:14 STEP 2657 H=2657:00 +CPU= 10.613
  02:59:31 STEP 2658 H=2658:00 +CPU= 17.218
  02:59:42 STEP 2659 H=2659:00 +CPU= 10.794
  02:59:53 STEP 2660 H=2660:00 +CPU= 10.252
  03:00:10 STEP 2661 H=2661:00 +CPU= 16.991
  03:00:21 STEP 2662 H=2662:00 +CPU= 11.186
  03:00:31 STEP 2663 H=2663:00 +CPU= 10.423
  03:00:51 STEP 2664 H=2664:00 +CPU= 20.149
Moving to projects directory: /home/fritzb/slots/5/ICMGGhq0f+002664
Moving to projects directory: /home/fritzb/slots/5/ICMSHhq0f+002664
Moving to projects directory: /home/fritzb/slots/5/ICMUAhq0f+002664
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMGGhq0f+002640
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMSHhq0f+002640
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMUAhq0f+002640
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMGGhq0f+002652
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMSHhq0f+002652
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMUAhq0f+002652
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_0134_2018050100_123_987_12203778_0_r750555874_110.zip
Uploading the intermediate file: upload_file_110.zip
  03:01:02 STEP 2665 H=2665:00 +CPU= 10.809
  03:01:13 STEP 2666 H=2666:00 +CPU= 10.327
  03:01:30 STEP 2667 H=2667:00 +CPU= 17.270
  03:01:41 STEP 2668 H=2668:00 +CPU= 11.069
  03:01:51 STEP 2669 H=2669:00 +CPU= 10.050
  03:02:08 STEP 2670 H=2670:00 +CPU= 17.335
  03:02:19 STEP 2671 H=2671:00 +CPU= 10.556
  03:02:30 STEP 2672 H=2672:00 +CPU= 10.546
  03:02:46 STEP 2673 H=2673:00 +CPU= 16.835
  03:02:58 STEP 2674 H=2674:00 +CPU= 11.296
  03:03:08 STEP 2675 H=2675:00 +CPU= 10.725
  03:03:27 STEP 2676 H=2676:00 +CPU= 19.053
Moving to projects directory: /home/fritzb/slots/5/ICMGGhq0f+002676
Moving to projects directory: /home/fritzb/slots/5/ICMSHhq0f+002676
Moving to projects directory: /home/fritzb/slots/5/ICMUAhq0f+002676
  03:03:39 STEP 2677 H=2677:00 +CPU= 11.084
  03:03:49 STEP 2678 H=2678:00 +CPU= 10.554
  03:04:06 STEP 2679 H=2679:00 +CPU= 17.075
  03:04:17 STEP 2680 H=2680:00 +CPU= 11.172
  03:04:28 STEP 2681 H=2681:00 +CPU= 10.408
  03:04:45 STEP 2682 H=2682:00 +CPU= 17.162
  03:04:56 STEP 2683 H=2683:00 +CPU= 10.936
  03:05:07 STEP 2684 H=2684:00 +CPU= 10.944
  03:05:24 STEP 2685 H=2685:00 +CPU= 16.924
  03:05:35 STEP 2686 H=2686:00 +CPU= 11.182
  03:05:46 STEP 2687 H=2687:00 +CPU= 11.295
  03:06:07 STEP 2688 H=2688:00 +CPU= 20.203
Moving to projects directory: /home/fritzb/slots/5/ICMGGhq0f+002688
Moving to projects directory: /home/fritzb/slots/5/ICMSHhq0f+002688
Moving to projects directory: /home/fritzb/slots/5/ICMUAhq0f+002688
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMGGhq0f+002664
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMSHhq0f+002664
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMUAhq0f+002664
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMGGhq0f+002676
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMSHhq0f+002676
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMUAhq0f+002676
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_0134_2018050100_123_987_12203778_0_r750555874_111.zip
Uploading the intermediate file: upload_file_111.zip
  03:06:18 STEP 2689 H=2689:00 +CPU= 10.918
  03:06:29 STEP 2690 H=2690:00 +CPU= 11.125
  03:06:46 STEP 2691 H=2691:00 +CPU= 16.994
  03:06:57 STEP 2692 H=2692:00 +CPU= 11.301
  03:07:08 STEP 2693 H=2693:00 +CPU= 10.901
  03:07:25 STEP 2694 H=2694:00 +CPU= 17.022
  03:07:36 STEP 2695 H=2695:00 +CPU= 10.834
  03:07:47 STEP 2696 H=2696:00 +CPU= 11.065
  03:08:04 STEP 2697 H=2697:00 +CPU= 16.868
  03:08:15 STEP 2698 H=2698:00 +CPU= 11.156
  03:08:26 STEP 2699 H=2699:00 +CPU= 10.895
  03:08:44 STEP 2700 H=2700:00 +CPU= 18.593
Moving to projects directory: /home/fritzb/slots/5/ICMGGhq0f+002700
Moving to projects directory: /home/fritzb/slots/5/ICMSHhq0f+002700
Moving to projects directory: /home/fritzb/slots/5/ICMUAhq0f+002700
  03:08:56 STEP 2701 H=2701:00 +CPU= 11.212
  03:09:07 STEP 2702 H=2702:00 +CPU= 11.221
  03:09:24 STEP 2703 H=2703:00 +CPU= 16.841
  03:09:35 STEP 2704 H=2704:00 +CPU= 11.374
  03:09:46 STEP 2705 H=2705:00 +CPU= 11.018
  03:10:03 STEP 2706 H=2706:00 +CPU= 16.977
  03:10:14 STEP 2707 H=2707:00 +CPU= 11.170
  03:10:25 STEP 2708 H=2708:00 +CPU= 11.067
  03:10:42 STEP 2709 H=2709:00 +CPU= 16.530
  03:10:53 STEP 2710 H=2710:00 +CPU= 11.488
  03:11:05 STEP 2711 H=2711:00 +CPU= 11.330
  03:11:24 STEP 2712 H=2712:00 +CPU= 19.659
Moving to projects directory: /home/fritzb/slots/5/ICMGGhq0f+002712
Moving to projects directory: /home/fritzb/slots/5/ICMSHhq0f+002712
Moving to projects directory: /home/fritzb/slots/5/ICMUAhq0f+002712
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMGGhq0f+002688
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMSHhq0f+002688
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMUAhq0f+002688
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMGGhq0f+002700
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMSHhq0f+002700
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMUAhq0f+002700
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_0134_2018050100_123_987_12203778_0_r750555874_112.zip
Uploading the intermediate file: upload_file_112.zip
  03:11:35 STEP 2713 H=2713:00 +CPU= 11.020
  03:11:47 STEP 2714 H=2714:00 +CPU= 11.130
  03:12:03 STEP 2715 H=2715:00 +CPU= 16.853
  03:12:15 STEP 2716 H=2716:00 +CPU= 11.221
  03:12:26 STEP 2717 H=2717:00 +CPU= 11.104
  03:12:43 STEP 2718 H=2718:00 +CPU= 17.136
  03:12:54 STEP 2719 H=2719:00 +CPU= 11.061
  03:13:05 STEP 2720 H=2720:00 +CPU= 11.171
  03:13:22 STEP 2721 H=2721:00 +CPU= 16.364
  03:13:32 STEP 2722 H=2722:00 +CPU= 10.915
  03:13:43 STEP 2723 H=2723:00 +CPU= 10.657
  03:14:01 STEP 2724 H=2724:00 +CPU= 17.879
Moving to projects directory: /home/fritzb/slots/5/ICMGGhq0f+002724
Moving to projects directory: /home/fritzb/slots/5/ICMSHhq0f+002724
Moving to projects directory: /home/fritzb/slots/5/ICMUAhq0f+002724
  03:14:12 STEP 2725 H=2725:00 +CPU= 10.689
  03:14:23 STEP 2726 H=2726:00 +CPU= 10.944
  03:14:39 STEP 2727 H=2727:00 +CPU= 16.239
  03:14:50 STEP 2728 H=2728:00 +CPU= 10.797
  03:15:01 STEP 2729 H=2729:00 +CPU= 10.828
  03:15:17 STEP 2730 H=2730:00 +CPU= 16.611
  03:15:28 STEP 2731 H=2731:00 +CPU= 10.376
  03:15:39 STEP 2732 H=2732:00 +CPU= 11.147
  03:15:55 STEP 2733 H=2733:00 +CPU= 16.716
  03:16:06 STEP 2734 H=2734:00 +CPU= 10.826
  03:16:17 STEP 2735 H=2735:00 +CPU= 11.124
  03:16:39 STEP 2736 H=2736:00 +CPU= 20.628
Moving to projects directory: /home/fritzb/slots/5/ICMGGhq0f+002736
Moving to projects directory: /home/fritzb/slots/5/ICMSHhq0f+002736
Moving to projects directory: /home/fritzb/slots/5/ICMUAhq0f+002736
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMGGhq0f+002712
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMSHhq0f+002712
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMUAhq0f+002712
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMGGhq0f+002724
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMSHhq0f+002724
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMUAhq0f+002724
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_0134_2018050100_123_987_12203778_0_r750555874_113.zip
Uploading the intermediate file: upload_file_113.zip
  03:16:49 STEP 2737 H=2737:00 +CPU= 10.958
  03:17:01 STEP 2738 H=2738:00 +CPU= 11.074
  03:17:17 STEP 2739 H=2739:00 +CPU= 16.598
  03:17:28 STEP 2740 H=2740:00 +CPU= 11.169
  03:17:39 STEP 2741 H=2741:00 +CPU= 10.869
  03:17:56 STEP 2742 H=2742:00 +CPU= 17.062
  03:18:07 STEP 2743 H=2743:00 +CPU= 10.718
  03:18:18 STEP 2744 H=2744:00 +CPU= 11.231
  03:18:35 STEP 2745 H=2745:00 +CPU= 16.631
  03:18:46 STEP 2746 H=2746:00 +CPU= 11.026
  03:18:57 STEP 2747 H=2747:00 +CPU= 11.283
  03:19:16 STEP 2748 H=2748:00 +CPU= 18.693
Moving to projects directory: /home/fritzb/slots/5/ICMGGhq0f+002748
Moving to projects directory: /home/fritzb/slots/5/ICMSHhq0f+002748
Moving to projects directory: /home/fritzb/slots/5/ICMUAhq0f+002748
  03:19:27 STEP 2749 H=2749:00 +CPU= 11.114
  03:19:39 STEP 2750 H=2750:00 +CPU= 11.492
  03:19:55 STEP 2751 H=2751:00 +CPU= 16.881
  03:20:06 STEP 2752 H=2752:00 +CPU= 10.981
  03:20:17 STEP 2753 H=2753:00 +CPU= 10.898
  03:20:35 STEP 2754 H=2754:00 +CPU= 17.212
  03:20:45 STEP 2755 H=2755:00 +CPU= 10.641
  03:20:57 STEP 2756 H=2756:00 +CPU= 11.315
  03:21:14 STEP 2757 H=2757:00 +CPU= 17.192
  03:21:25 STEP 2758 H=2758:00 +CPU= 10.732
  03:21:36 STEP 2759 H=2759:00 +CPU= 11.134
  03:21:56 STEP 2760 H=2760:00 +CPU= 20.174
Moving to projects directory: /home/fritzb/slots/5/ICMGGhq0f+002760
Moving to projects directory: /home/fritzb/slots/5/ICMSHhq0f+002760
Moving to projects directory: /home/fritzb/slots/5/ICMUAhq0f+002760
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMGGhq0f+002736
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMSHhq0f+002736
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMUAhq0f+002736
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMGGhq0f+002748
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMSHhq0f+002748
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMUAhq0f+002748
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_0134_2018050100_123_987_12203778_0_r750555874_114.zip
Uploading the intermediate file: upload_file_114.zip
  03:22:06 STEP 2761 H=2761:00 +CPU= 10.385
  03:22:17 STEP 2762 H=2762:00 +CPU= 10.632
  03:22:34 STEP 2763 H=2763:00 +CPU= 16.424
  03:22:44 STEP 2764 H=2764:00 +CPU= 10.488
  03:22:55 STEP 2765 H=2765:00 +CPU= 10.619
  03:23:11 STEP 2766 H=2766:00 +CPU= 16.782
  03:23:22 STEP 2767 H=2767:00 +CPU= 10.101
  03:23:33 STEP 2768 H=2768:00 +CPU= 10.996
  03:23:49 STEP 2769 H=2769:00 +CPU= 16.583
  03:24:00 STEP 2770 H=2770:00 +CPU= 10.461
  03:24:11 STEP 2771 H=2771:00 +CPU= 10.755
  03:24:29 STEP 2772 H=2772:00 +CPU= 18.073
Moving to projects directory: /home/fritzb/slots/5/ICMGGhq0f+002772
Moving to projects directory: /home/fritzb/slots/5/ICMSHhq0f+002772
Moving to projects directory: /home/fritzb/slots/5/ICMUAhq0f+002772
  03:24:39 STEP 2773 H=2773:00 +CPU= 10.324
  03:24:50 STEP 2774 H=2774:00 +CPU= 11.076
  03:25:06 STEP 2775 H=2775:00 +CPU= 16.367
  03:25:17 STEP 2776 H=2776:00 +CPU= 10.383
  03:25:28 STEP 2777 H=2777:00 +CPU= 10.750
  03:25:45 STEP 2778 H=2778:00 +CPU= 17.111
  03:25:55 STEP 2779 H=2779:00 +CPU= 10.492
  03:26:06 STEP 2780 H=2780:00 +CPU= 10.876
  03:26:23 STEP 2781 H=2781:00 +CPU= 16.466
  03:26:33 STEP 2782 H=2782:00 +CPU= 10.836
  03:26:45 STEP 2783 H=2783:00 +CPU= 11.144
  03:27:05 STEP 2784 H=2784:00 +CPU= 20.062
Moving to projects directory: /home/fritzb/slots/5/ICMGGhq0f+002784
Moving to projects directory: /home/fritzb/slots/5/ICMSHhq0f+002784
Moving to projects directory: /home/fritzb/slots/5/ICMUAhq0f+002784
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMGGhq0f+002760
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMSHhq0f+002760
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMUAhq0f+002760
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMGGhq0f+002772
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMSHhq0f+002772
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMUAhq0f+002772
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_0134_2018050100_123_987_12203778_0_r750555874_115.zip
Uploading the intermediate file: upload_file_115.zip
  03:27:15 STEP 2785 H=2785:00 +CPU= 10.377
  03:27:26 STEP 2786 H=2786:00 +CPU= 10.965
  03:27:43 STEP 2787 H=2787:00 +CPU= 16.660
  03:27:53 STEP 2788 H=2788:00 +CPU= 10.728
  03:28:04 STEP 2789 H=2789:00 +CPU= 11.044
  03:28:22 STEP 2790 H=2790:00 +CPU= 17.037
  03:28:32 STEP 2791 H=2791:00 +CPU= 10.727
  03:28:43 STEP 2792 H=2792:00 +CPU= 10.965
  03:29:00 STEP 2793 H=2793:00 +CPU= 16.724
  03:29:11 STEP 2794 H=2794:00 +CPU= 10.914
  03:29:22 STEP 2795 H=2795:00 +CPU= 10.931
  03:29:40 STEP 2796 H=2796:00 +CPU= 18.685
Moving to projects directory: /home/fritzb/slots/5/ICMGGhq0f+002796
Moving to projects directory: /home/fritzb/slots/5/ICMSHhq0f+002796
Moving to projects directory: /home/fritzb/slots/5/ICMUAhq0f+002796
  03:29:51 STEP 2797 H=2797:00 +CPU= 10.653
  03:30:02 STEP 2798 H=2798:00 +CPU= 11.083
  03:30:19 STEP 2799 H=2799:00 +CPU= 16.875
  03:30:30 STEP 2800 H=2800:00 +CPU= 10.946
  03:30:41 STEP 2801 H=2801:00 +CPU= 11.377
  03:30:59 STEP 2802 H=2802:00 +CPU= 17.264
  03:31:09 STEP 2803 H=2803:00 +CPU= 10.562
  03:31:20 STEP 2804 H=2804:00 +CPU= 10.911
  03:31:37 STEP 2805 H=2805:00 +CPU= 16.432
  03:31:49 STEP 2806 H=2806:00 +CPU= 10.512
  03:31:59 STEP 2807 H=2807:00 +CPU= 10.745
  03:32:19 STEP 2808 H=2808:00 +CPU= 19.202
Moving to projects directory: /home/fritzb/slots/5/ICMGGhq0f+002808
Moving to projects directory: /home/fritzb/slots/5/ICMSHhq0f+002808
Moving to projects directory: /home/fritzb/slots/5/ICMUAhq0f+002808
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMGGhq0f+002784
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMSHhq0f+002784
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMUAhq0f+002784
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMGGhq0f+002796
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMSHhq0f+002796
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMUAhq0f+002796
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_0134_2018050100_123_987_12203778_0_r750555874_116.zip
Uploading the intermediate file: upload_file_116.zip
  03:32:29 STEP 2809 H=2809:00 +CPU= 10.210
  03:32:39 STEP 2810 H=2810:00 +CPU= 10.145
  03:32:54 STEP 2811 H=2811:00 +CPU= 15.343
  03:33:04 STEP 2812 H=2812:00 +CPU=  9.983
  03:33:14 STEP 2813 H=2813:00 +CPU= 10.030
  03:33:30 STEP 2814 H=2814:00 +CPU= 16.001
  03:33:40 STEP 2815 H=2815:00 +CPU=  9.627
  03:33:50 STEP 2816 H=2816:00 +CPU= 10.313
  03:34:07 STEP 2817 H=2817:00 +CPU= 16.167
  03:34:16 STEP 2818 H=2818:00 +CPU=  9.659
  03:34:26 STEP 2819 H=2819:00 +CPU=  9.718
  03:34:43 STEP 2820 H=2820:00 +CPU= 17.147
Moving to projects directory: /home/fritzb/slots/5/ICMGGhq0f+002820
Moving to projects directory: /home/fritzb/slots/5/ICMSHhq0f+002820
Moving to projects directory: /home/fritzb/slots/5/ICMUAhq0f+002820
  03:34:52 STEP 2821 H=2821:00 +CPU=  9.317
  03:35:03 STEP 2822 H=2822:00 +CPU= 10.496
  03:35:19 STEP 2823 H=2823:00 +CPU= 16.139
  03:35:29 STEP 2824 H=2824:00 +CPU=  9.727
  03:35:39 STEP 2825 H=2825:00 +CPU=  9.924
  03:35:55 STEP 2826 H=2826:00 +CPU= 16.301
  03:36:05 STEP 2827 H=2827:00 +CPU=  9.588
  03:36:15 STEP 2828 H=2828:00 +CPU= 10.697
  03:36:32 STEP 2829 H=2829:00 +CPU= 16.931
  03:36:42 STEP 2830 H=2830:00 +CPU= 10.141
  03:36:54 STEP 2831 H=2831:00 +CPU= 10.376
  03:37:13 STEP 2832 H=2832:00 +CPU= 18.987
Moving to projects directory: /home/fritzb/slots/5/ICMGGhq0f+002832
Moving to projects directory: /home/fritzb/slots/5/ICMSHhq0f+002832
Moving to projects directory: /home/fritzb/slots/5/ICMUAhq0f+002832
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMGGhq0f+002808
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMSHhq0f+002808
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMUAhq0f+002808
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMGGhq0f+002820
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMSHhq0f+002820
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMUAhq0f+002820
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_0134_2018050100_123_987_12203778_0_r750555874_117.zip
Uploading the intermediate file: upload_file_117.zip
  03:37:23 STEP 2833 H=2833:00 +CPU=  9.792
  03:37:33 STEP 2834 H=2834:00 +CPU= 10.172
  03:37:49 STEP 2835 H=2835:00 +CPU= 16.050
  03:38:00 STEP 2836 H=2836:00 +CPU= 10.193
  03:38:10 STEP 2837 H=2837:00 +CPU= 10.210
  03:38:27 STEP 2838 H=2838:00 +CPU= 16.924
  03:38:37 STEP 2839 H=2839:00 +CPU=  9.878
  03:38:47 STEP 2840 H=2840:00 +CPU= 10.482
  03:39:03 STEP 2841 H=2841:00 +CPU= 16.148
  03:39:13 STEP 2842 H=2842:00 +CPU=  9.775
  03:39:23 STEP 2843 H=2843:00 +CPU=  9.681
  03:39:40 STEP 2844 H=2844:00 +CPU= 17.617
Moving to projects directory: /home/fritzb/slots/5/ICMGGhq0f+002844
Moving to projects directory: /home/fritzb/slots/5/ICMSHhq0f+002844
Moving to projects directory: /home/fritzb/slots/5/ICMUAhq0f+002844
  03:39:50 STEP 2845 H=2845:00 +CPU=  9.524
  03:40:00 STEP 2846 H=2846:00 +CPU= 10.015
  03:40:16 STEP 2847 H=2847:00 +CPU= 15.983
  03:40:26 STEP 2848 H=2848:00 +CPU=  9.899
  03:40:36 STEP 2849 H=2849:00 +CPU= 10.153
  03:40:53 STEP 2850 H=2850:00 +CPU= 16.745
  03:41:03 STEP 2851 H=2851:00 +CPU= 10.066
  03:41:13 STEP 2852 H=2852:00 +CPU= 10.156
  03:41:29 STEP 2853 H=2853:00 +CPU= 16.280
  03:41:40 STEP 2854 H=2854:00 +CPU= 10.700
  03:41:50 STEP 2855 H=2855:00 +CPU= 10.451
  03:42:10 STEP 2856 H=2856:00 +CPU= 19.599
Moving to projects directory: /home/fritzb/slots/5/ICMGGhq0f+002856
Moving to projects directory: /home/fritzb/slots/5/ICMSHhq0f+002856
Moving to projects directory: /home/fritzb/slots/5/ICMUAhq0f+002856
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMGGhq0f+002832
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMSHhq0f+002832
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMUAhq0f+002832
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMGGhq0f+002844
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMSHhq0f+002844
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMUAhq0f+002844
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_0134_2018050100_123_987_12203778_0_r750555874_118.zip
Uploading the intermediate file: upload_file_118.zip
  03:42:20 STEP 2857 H=2857:00 +CPU= 10.316
  03:42:31 STEP 2858 H=2858:00 +CPU= 10.696
  03:42:48 STEP 2859 H=2859:00 +CPU= 16.762
  03:42:59 STEP 2860 H=2860:00 +CPU= 11.172
  03:43:10 STEP 2861 H=2861:00 +CPU= 10.660
  03:43:27 STEP 2862 H=2862:00 +CPU= 17.165
  03:43:38 STEP 2863 H=2863:00 +CPU= 11.141
  03:43:49 STEP 2864 H=2864:00 +CPU= 11.114
  03:44:06 STEP 2865 H=2865:00 +CPU= 17.014
  03:44:17 STEP 2866 H=2866:00 +CPU= 11.036
  03:44:28 STEP 2867 H=2867:00 +CPU= 10.977
  03:44:47 STEP 2868 H=2868:00 +CPU= 18.666
Moving to projects directory: /home/fritzb/slots/5/ICMGGhq0f+002868
Moving to projects directory: /home/fritzb/slots/5/ICMSHhq0f+002868
Moving to projects directory: /home/fritzb/slots/5/ICMUAhq0f+002868
  03:44:58 STEP 2869 H=2869:00 +CPU= 10.731
  03:45:09 STEP 2870 H=2870:00 +CPU= 10.922
  03:45:25 STEP 2871 H=2871:00 +CPU= 16.524
  03:45:37 STEP 2872 H=2872:00 +CPU= 11.230
  03:45:48 STEP 2873 H=2873:00 +CPU= 10.724
  03:46:05 STEP 2874 H=2874:00 +CPU= 17.169
  03:46:16 STEP 2875 H=2875:00 +CPU= 10.860
  03:46:27 STEP 2876 H=2876:00 +CPU= 10.978
  03:46:44 STEP 2877 H=2877:00 +CPU= 16.777
  03:46:55 STEP 2878 H=2878:00 +CPU= 11.229
  03:47:06 STEP 2879 H=2879:00 +CPU= 10.832
  03:47:26 STEP 2880 H=2880:00 +CPU= 20.318
Moving to projects directory: /home/fritzb/slots/5/ICMGGhq0f+002880
Moving to projects directory: /home/fritzb/slots/5/ICMSHhq0f+002880
Moving to projects directory: /home/fritzb/slots/5/ICMUAhq0f+002880
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMGGhq0f+002856
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMSHhq0f+002856
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMUAhq0f+002856
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMGGhq0f+002868
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMSHhq0f+002868
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMUAhq0f+002868
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_0134_2018050100_123_987_12203778_0_r750555874_119.zip
Uploading the intermediate file: upload_file_119.zip
  03:47:37 STEP 2881 H=2881:00 +CPU= 10.916
  03:47:49 STEP 2882 H=2882:00 +CPU= 11.301
Uploading trickle at timestep: 10368000
  03:48:06 STEP 2883 H=2883:00 +CPU= 16.917
  03:48:17 STEP 2884 H=2884:00 +CPU= 11.203
  03:48:28 STEP 2885 H=2885:00 +CPU= 10.994
  03:48:45 STEP 2886 H=2886:00 +CPU= 17.020
  03:48:56 STEP 2887 H=2887:00 +CPU= 11.147
  03:49:07 STEP 2888 H=2888:00 +CPU= 10.855
  03:49:23 STEP 2889 H=2889:00 +CPU= 16.568
  03:49:34 STEP 2890 H=2890:00 +CPU= 10.992
  03:49:45 STEP 2891 H=2891:00 +CPU= 10.417
  03:50:03 STEP 2892 H=2892:00 +CPU= 18.566
Moving to projects directory: /home/fritzb/slots/5/ICMGGhq0f+002892
Moving to projects directory: /home/fritzb/slots/5/ICMSHhq0f+002892
Moving to projects directory: /home/fritzb/slots/5/ICMUAhq0f+002892
  03:50:14 STEP 2893 H=2893:00 +CPU= 10.926
  03:50:25 STEP 2894 H=2894:00 +CPU= 10.756
  03:50:42 STEP 2895 H=2895:00 +CPU= 16.859
  03:50:53 STEP 2896 H=2896:00 +CPU= 10.858
  03:51:03 STEP 2897 H=2897:00 +CPU= 10.245
  03:51:20 STEP 2898 H=2898:00 +CPU= 16.723
  03:51:30 STEP 2899 H=2899:00 +CPU= 10.645
  03:51:41 STEP 2900 H=2900:00 +CPU= 10.425
  03:51:58 STEP 2901 H=2901:00 +CPU= 16.672
  03:52:09 STEP 2902 H=2902:00 +CPU= 10.984
  03:52:20 STEP 2903 H=2903:00 +CPU= 10.941
  03:52:40 STEP 2904 H=2904:00 +CPU= 19.927
Moving to projects directory: /home/fritzb/slots/5/ICMGGhq0f+002904
Moving to projects directory: /home/fritzb/slots/5/ICMSHhq0f+002904
Moving to projects directory: /home/fritzb/slots/5/ICMUAhq0f+002904
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMGGhq0f+002880
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMSHhq0f+002880
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMUAhq0f+002880
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMGGhq0f+002892
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMSHhq0f+002892
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMUAhq0f+002892
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_0134_2018050100_123_987_12203778_0_r750555874_120.zip
Uploading the intermediate file: upload_file_120.zip
  03:52:50 STEP 2905 H=2905:00 +CPU= 10.754
  03:53:01 STEP 2906 H=2906:00 +CPU= 10.661
  03:53:18 STEP 2907 H=2907:00 +CPU= 17.045
  03:53:29 STEP 2908 H=2908:00 +CPU= 11.038
  03:53:40 STEP 2909 H=2909:00 +CPU= 10.304
  03:53:57 STEP 2910 H=2910:00 +CPU= 17.103
  03:54:08 STEP 2911 H=2911:00 +CPU= 11.137
  03:54:19 STEP 2912 H=2912:00 +CPU= 10.758
  03:54:35 STEP 2913 H=2913:00 +CPU= 16.694
  03:54:47 STEP 2914 H=2914:00 +CPU= 11.262
  03:54:57 STEP 2915 H=2915:00 +CPU= 10.589
  03:55:16 STEP 2916 H=2916:00 +CPU= 18.259
Moving to projects directory: /home/fritzb/slots/5/ICMGGhq0f+002916
Moving to projects directory: /home/fritzb/slots/5/ICMSHhq0f+002916
Moving to projects directory: /home/fritzb/slots/5/ICMUAhq0f+002916
  03:55:26 STEP 2917 H=2917:00 +CPU= 10.809
  03:55:37 STEP 2918 H=2918:00 +CPU= 10.916
  03:55:54 STEP 2919 H=2919:00 +CPU= 16.729
  03:56:05 STEP 2920 H=2920:00 +CPU= 11.106
  03:56:16 STEP 2921 H=2921:00 +CPU= 10.759
  03:56:33 STEP 2922 H=2922:00 +CPU= 16.764
  03:56:44 STEP 2923 H=2923:00 +CPU= 11.072
  03:56:55 STEP 2924 H=2924:00 +CPU= 11.148
  03:57:12 STEP 2925 H=2925:00 +CPU= 16.766
  03:57:23 STEP 2926 H=2926:00 +CPU= 11.035
  03:57:34 STEP 2927 H=2927:00 +CPU= 11.175
  03:57:55 STEP 2928 H=2928:00 +CPU= 20.658
Moving to projects directory: /home/fritzb/slots/5/ICMGGhq0f+002928
Moving to projects directory: /home/fritzb/slots/5/ICMSHhq0f+002928
Moving to projects directory: /home/fritzb/slots/5/ICMUAhq0f+002928
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMGGhq0f+002904
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMSHhq0f+002904
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMUAhq0f+002904
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMGGhq0f+002916
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMSHhq0f+002916
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMUAhq0f+002916
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_0134_2018050100_123_987_12203778_0_r750555874_121.zip
Uploading the intermediate file: upload_file_121.zip
  03:58:06 STEP 2929 H=2929:00 +CPU= 11.003
  03:58:17 STEP 2930 H=2930:00 +CPU= 10.963
  03:58:34 STEP 2931 H=2931:00 +CPU= 17.015
  03:58:45 STEP 2932 H=2932:00 +CPU= 10.999
  03:58:55 STEP 2933 H=2933:00 +CPU= 10.744
  03:59:12 STEP 2934 H=2934:00 +CPU= 17.045
  03:59:23 STEP 2935 H=2935:00 +CPU= 10.928
  03:59:35 STEP 2936 H=2936:00 +CPU= 11.255
  03:59:51 STEP 2937 H=2937:00 +CPU= 16.635
  04:00:02 STEP 2938 H=2938:00 +CPU= 11.089
  04:00:13 STEP 2939 H=2939:00 +CPU= 10.929
  04:00:32 STEP 2940 H=2940:00 +CPU= 18.209
Moving to projects directory: /home/fritzb/slots/5/ICMGGhq0f+002940
Moving to projects directory: /home/fritzb/slots/5/ICMSHhq0f+002940
Moving to projects directory: /home/fritzb/slots/5/ICMUAhq0f+002940
  04:00:42 STEP 2941 H=2941:00 +CPU= 10.846
  04:00:54 STEP 2942 H=2942:00 +CPU= 11.130
  04:01:10 STEP 2943 H=2943:00 +CPU= 16.617
  04:01:21 STEP 2944 H=2944:00 +CPU= 10.888
  04:01:32 STEP 2945 H=2945:00 +CPU= 10.998
  04:01:49 STEP 2946 H=2946:00 +CPU= 16.883
  04:02:00 STEP 2947 H=2947:00 +CPU= 10.770
  04:02:11 STEP 2948 H=2948:00 +CPU= 11.021
  04:02:27 STEP 2949 H=2949:00 +CPU= 16.589
  04:02:38 STEP 2950 H=2950:00 +CPU= 10.875
  04:02:49 STEP 2951 H=2951:00 +CPU= 10.989
  04:03:09 STEP 2952 H=2952:00 +CPU= 19.137
The child process terminated with status: 0
Moving to projects directory: /home/fritzb/slots/5/ICMGGhq0f+002952
Moving to projects directory: /home/fritzb/slots/5/ICMSHhq0f+002952
Moving to projects directory: /home/fritzb/slots/5/ICMUAhq0f+002952
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMSHhq0f+002952
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMUAhq0f+002940
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMSHhq0f+002928
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMGGhq0f+002952
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMUAhq0f+002952
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMUAhq0f+002928
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMGGhq0f+002940
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMSHhq0f+002940
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12203778/ICMGGhq0f+002928
Zipping up the final file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_0134_2018050100_123_987_12203778_0_r750555874_122.zip
Uploading the final file: upload_file_122.zip
Uploading trickle at timestep: 10623600
04:06:32 (6361): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:40:12 1537731 22290248 oifs_43r3_ps_0134_2018050100_123_987_12203778_0 10,623,600 38,738 0.0036
09 May 2023 16:40:12 1537731 22290248 oifs_43r3_ps_0134_2018050100_123_987_12203778_0 10,623,600 38,738 0.0036
09 May 2023 16:40:09 1537731 22290248 oifs_43r3_ps_0134_2018050100_123_987_12203778_0 10,368,000 37,802 0.0036
09 May 2023 16:40:09 1537731 22290248 oifs_43r3_ps_0134_2018050100_123_987_12203778_0 10,368,000 37,802 0.0036
09 May 2023 16:40:06 1537731 22290248 oifs_43r3_ps_0134_2018050100_123_987_12203778_0 9,504,000 34,698 0.0037
09 May 2023 16:40:06 1537731 22290248 oifs_43r3_ps_0134_2018050100_123_987_12203778_0 9,504,000 34,698 0.0037
09 May 2023 16:40:06 1537731 22290248 oifs_43r3_ps_0134_2018050100_123_987_12203778_0 8,640,000 31,548 0.0037
09 May 2023 16:40:06 1537731 22290248 oifs_43r3_ps_0134_2018050100_123_987_12203778_0 8,640,000 31,548 0.0037
09 May 2023 16:40:02 1537731 22290248 oifs_43r3_ps_0134_2018050100_123_987_12203778_0 7,776,000 28,399 0.0037
09 May 2023 16:39:59 1537731 22290248 oifs_43r3_ps_0134_2018050100_123_987_12203778_0 6,912,000 25,237 0.0037
09 May 2023 16:39:56 1537731 22290248 oifs_43r3_ps_0134_2018050100_123_987_12203778_0 6,048,000 22,097 0.0037
09 May 2023 16:39:53 1537731 22290248 oifs_43r3_ps_0134_2018050100_123_987_12203778_0 5,184,000 18,946 0.0037
09 May 2023 16:39:52 1537731 22290248 oifs_43r3_ps_0134_2018050100_123_987_12203778_0 5,184,000 18,946 0.0037
09 May 2023 16:39:49 1537731 22290248 oifs_43r3_ps_0134_2018050100_123_987_12203778_0 4,320,000 15,807 0.0037
09 May 2023 16:39:46 1537731 22290248 oifs_43r3_ps_0134_2018050100_123_987_12203778_0 3,456,000 12,656 0.0037
09 May 2023 16:39:46 1537731 22290248 oifs_43r3_ps_0134_2018050100_123_987_12203778_0 2,592,000 9,518 0.0037
09 May 2023 16:39:42 1537731 22290248 oifs_43r3_ps_0134_2018050100_123_987_12203778_0 1,728,000 6,349 0.0037
09 May 2023 16:39:39 1537731 22290248 oifs_43r3_ps_0134_2018050100_123_987_12203778_0 864,000 3,185 0.0037


©2024 cpdn.org