climateprediction.net home page
Task 22300888

Task 22300888

Name oifs_43r3_ps_0206_2005050100_123_974_12190850_1
Workunit 12190850
Created 21 Jan 2023, 5:02:58 UTC
Sent 21 Jan 2023, 5:10:22 UTC
Report deadline 22 Mar 2023, 5:10:22 UTC
Received 22 Feb 2023, 10:15:37 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1537623
Run time 16 hours 58 min 21 sec
CPU time 16 hours 34 min 28 sec
Validate state Valid
Credit 14,873.04
Device peak FLOPS 7.67 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,419.53 MB
Peak swap size 4,978.08 MB
Peak disk usage 5,258.09 MB
Stderr
<core_client_version>7.18.1</core_client_version>
<![CDATA[
<stderr_txt>
3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:galfridian-systemproductname:1:1:2017:2017] [20230222:071232:1677046352:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:galfridian-systemproductname:1:1:2017:2017] [20230222:071232:1677046352:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:galfridian-systemproductname:1:1:2017:2017] [20230222:071232:1677046352:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:galfridian-systemproductname:1:1:2017:2017] [20230222:071232:1677046352:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  07:13:06 STEP 2304 H=2304:00 +CPU= 27.895
  07:13:21 STEP 2305 H=2305:00 +CPU= 15.376
  07:13:38 STEP 2306 H=2306:00 +CPU= 16.353
  07:14:03 STEP 2307 H=2307:00 +CPU= 24.618
  07:14:20 STEP 2308 H=2308:00 +CPU= 16.556
  07:14:36 STEP 2309 H=2309:00 +CPU= 16.370
  07:15:02 STEP 2310 H=2310:00 +CPU= 25.376
  07:15:20 STEP 2311 H=2311:00 +CPU= 17.674
  07:15:37 STEP 2312 H=2312:00 +CPU= 16.822
  07:16:03 STEP 2313 H=2313:00 +CPU= 26.014
  07:16:20 STEP 2314 H=2314:00 +CPU= 16.343
  07:16:36 STEP 2315 H=2315:00 +CPU= 16.410
  07:17:05 STEP 2316 H=2316:00 +CPU= 28.240
Moving to projects directory: /home/galfridian/slots/5/ICMGGhq0f+002316
Moving to projects directory: /home/galfridian/slots/5/ICMSHhq0f+002316
Moving to projects directory: /home/galfridian/slots/5/ICMUAhq0f+002316
  07:17:20 STEP 2317 H=2317:00 +CPU= 15.634
  07:17:37 STEP 2318 H=2318:00 +CPU= 16.531
  07:18:02 STEP 2319 H=2319:00 +CPU= 24.794
  07:18:19 STEP 2320 H=2320:00 +CPU= 16.257
  07:18:35 STEP 2321 H=2321:00 +CPU= 15.497
  07:19:00 STEP 2322 H=2322:00 +CPU= 25.369
  07:19:16 STEP 2323 H=2323:00 +CPU= 15.726
  07:19:34 STEP 2324 H=2324:00 +CPU= 17.458
  07:20:01 STEP 2325 H=2325:00 +CPU= 26.567
  07:20:18 STEP 2326 H=2326:00 +CPU= 17.040
  07:20:35 STEP 2327 H=2327:00 +CPU= 16.706
  07:21:05 STEP 2328 H=2328:00 +CPU= 29.229
Moving to projects directory: /home/galfridian/slots/5/ICMGGhq0f+002328
Moving to projects directory: /home/galfridian/slots/5/ICMSHhq0f+002328
Moving to projects directory: /home/galfridian/slots/5/ICMUAhq0f+002328
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMGGhq0f+002304
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMSHhq0f+002304
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMUAhq0f+002304
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMGGhq0f+002316
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMSHhq0f+002316
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMUAhq0f+002316
Zipping up the intermediate file: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_0206_2005050100_123_974_12190850_1_r1551377807_96.zip
Uploading the intermediate file: upload_file_96.zip
  07:21:21 STEP 2329 H=2329:00 +CPU= 15.947
  07:21:39 STEP 2330 H=2330:00 +CPU= 16.822
  07:22:04 STEP 2331 H=2331:00 +CPU= 25.074
  07:22:21 STEP 2332 H=2332:00 +CPU= 16.676
  07:22:37 STEP 2333 H=2333:00 +CPU= 15.833
  07:23:03 STEP 2334 H=2334:00 +CPU= 25.075
  07:23:19 STEP 2335 H=2335:00 +CPU= 16.550
  07:23:36 STEP 2336 H=2336:00 +CPU= 16.492
  07:24:02 STEP 2337 H=2337:00 +CPU= 25.427
  07:24:20 STEP 2338 H=2338:00 +CPU= 17.501
  07:24:36 STEP 2339 H=2339:00 +CPU= 16.057
  07:25:03 STEP 2340 H=2340:00 +CPU= 26.881
Moving to projects directory: /home/galfridian/slots/5/ICMGGhq0f+002340
Moving to projects directory: /home/galfridian/slots/5/ICMSHhq0f+002340
Moving to projects directory: /home/galfridian/slots/5/ICMUAhq0f+002340
  07:25:19 STEP 2341 H=2341:00 +CPU= 15.671
  07:25:36 STEP 2342 H=2342:00 +CPU= 16.628
  07:26:02 STEP 2343 H=2343:00 +CPU= 25.441
  07:26:19 STEP 2344 H=2344:00 +CPU= 16.855
  07:26:36 STEP 2345 H=2345:00 +CPU= 16.400
  07:27:02 STEP 2346 H=2346:00 +CPU= 25.726
  07:27:18 STEP 2347 H=2347:00 +CPU= 16.556
  07:27:35 STEP 2348 H=2348:00 +CPU= 16.199
  07:28:00 STEP 2349 H=2349:00 +CPU= 25.078
  07:28:17 STEP 2350 H=2350:00 +CPU= 17.047
  07:28:34 STEP 2351 H=2351:00 +CPU= 16.346
  07:29:04 STEP 2352 H=2352:00 +CPU= 29.843
Moving to projects directory: /home/galfridian/slots/5/ICMGGhq0f+002352
Moving to projects directory: /home/galfridian/slots/5/ICMSHhq0f+002352
Moving to projects directory: /home/galfridian/slots/5/ICMUAhq0f+002352
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMGGhq0f+002328
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMSHhq0f+002328
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMUAhq0f+002328
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMGGhq0f+002340
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMSHhq0f+002340
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMUAhq0f+002340
Zipping up the intermediate file: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_0206_2005050100_123_974_12190850_1_r1551377807_97.zip
Uploading the intermediate file: upload_file_97.zip
  07:29:20 STEP 2353 H=2353:00 +CPU= 16.106
  07:29:36 STEP 2354 H=2354:00 +CPU= 16.303
  07:30:01 STEP 2355 H=2355:00 +CPU= 24.436
  07:30:18 STEP 2356 H=2356:00 +CPU= 16.821
  07:30:35 STEP 2357 H=2357:00 +CPU= 16.449
  07:31:01 STEP 2358 H=2358:00 +CPU= 26.033
  07:31:18 STEP 2359 H=2359:00 +CPU= 16.213
  07:31:35 STEP 2360 H=2360:00 +CPU= 16.749
  07:32:01 STEP 2361 H=2361:00 +CPU= 25.201
  07:32:17 STEP 2362 H=2362:00 +CPU= 16.250
  07:32:33 STEP 2363 H=2363:00 +CPU= 16.156
  07:33:01 STEP 2364 H=2364:00 +CPU= 27.782
Moving to projects directory: /home/galfridian/slots/5/ICMGGhq0f+002364
Moving to projects directory: /home/galfridian/slots/5/ICMSHhq0f+002364
Moving to projects directory: /home/galfridian/slots/5/ICMUAhq0f+002364
  07:33:18 STEP 2365 H=2365:00 +CPU= 16.275
  07:33:34 STEP 2366 H=2366:00 +CPU= 16.399
  07:33:59 STEP 2367 H=2367:00 +CPU= 24.587
  07:34:16 STEP 2368 H=2368:00 +CPU= 16.560
  07:34:31 STEP 2369 H=2369:00 +CPU= 15.587
  07:34:56 STEP 2370 H=2370:00 +CPU= 24.976
  07:35:13 STEP 2371 H=2371:00 +CPU= 16.338
  07:35:29 STEP 2372 H=2372:00 +CPU= 16.070
  07:35:56 STEP 2373 H=2373:00 +CPU= 25.981
  07:36:12 STEP 2374 H=2374:00 +CPU= 16.309
  07:36:28 STEP 2375 H=2375:00 +CPU= 16.229
  07:36:59 STEP 2376 H=2376:00 +CPU= 30.035
Moving to projects directory: /home/galfridian/slots/5/ICMGGhq0f+002376
Moving to projects directory: /home/galfridian/slots/5/ICMSHhq0f+002376
Moving to projects directory: /home/galfridian/slots/5/ICMUAhq0f+002376
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMGGhq0f+002352
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMSHhq0f+002352
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMUAhq0f+002352
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMGGhq0f+002364
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMSHhq0f+002364
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMUAhq0f+002364
Zipping up the intermediate file: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_0206_2005050100_123_974_12190850_1_r1551377807_98.zip
Uploading the intermediate file: upload_file_98.zip
  07:37:15 STEP 2377 H=2377:00 +CPU= 16.414
  07:37:32 STEP 2378 H=2378:00 +CPU= 16.619
  07:37:58 STEP 2379 H=2379:00 +CPU= 25.645
  07:38:15 STEP 2380 H=2380:00 +CPU= 16.187
  07:38:32 STEP 2381 H=2381:00 +CPU= 16.607
  07:38:58 STEP 2382 H=2382:00 +CPU= 26.300
  07:39:14 STEP 2383 H=2383:00 +CPU= 16.055
  07:39:31 STEP 2384 H=2384:00 +CPU= 16.122
  07:39:56 STEP 2385 H=2385:00 +CPU= 25.245
  07:40:13 STEP 2386 H=2386:00 +CPU= 16.593
  07:40:29 STEP 2387 H=2387:00 +CPU= 16.113
  07:40:57 STEP 2388 H=2388:00 +CPU= 27.496
Moving to projects directory: /home/galfridian/slots/5/ICMGGhq0f+002388
Moving to projects directory: /home/galfridian/slots/5/ICMSHhq0f+002388
Moving to projects directory: /home/galfridian/slots/5/ICMUAhq0f+002388
  07:41:13 STEP 2389 H=2389:00 +CPU= 15.653
  07:41:29 STEP 2390 H=2390:00 +CPU= 15.925
  07:41:53 STEP 2391 H=2391:00 +CPU= 24.204
  07:42:10 STEP 2392 H=2392:00 +CPU= 16.068
  07:42:26 STEP 2393 H=2393:00 +CPU= 15.859
  07:42:52 STEP 2394 H=2394:00 +CPU= 25.461
  07:43:08 STEP 2395 H=2395:00 +CPU= 15.844
  07:43:24 STEP 2396 H=2396:00 +CPU= 16.259
  07:43:49 STEP 2397 H=2397:00 +CPU= 24.912
  07:44:06 STEP 2398 H=2398:00 +CPU= 16.825
  07:44:24 STEP 2399 H=2399:00 +CPU= 16.998
  07:44:55 STEP 2400 H=2400:00 +CPU= 30.456
Moving to projects directory: /home/galfridian/slots/5/ICMGGhq0f+002400
Moving to projects directory: /home/galfridian/slots/5/ICMSHhq0f+002400
Moving to projects directory: /home/galfridian/slots/5/ICMUAhq0f+002400
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMGGhq0f+002376
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMSHhq0f+002376
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMUAhq0f+002376
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMGGhq0f+002388
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMSHhq0f+002388
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMUAhq0f+002388
Zipping up the intermediate file: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_0206_2005050100_123_974_12190850_1_r1551377807_99.zip
Uploading the intermediate file: upload_file_99.zip
  07:45:11 STEP 2401 H=2401:00 +CPU= 15.801
  07:45:28 STEP 2402 H=2402:00 +CPU= 16.212
  07:45:54 STEP 2403 H=2403:00 +CPU= 24.908
  07:46:10 STEP 2404 H=2404:00 +CPU= 16.039
  07:46:26 STEP 2405 H=2405:00 +CPU= 16.017
  07:46:52 STEP 2406 H=2406:00 +CPU= 25.181
  07:47:09 STEP 2407 H=2407:00 +CPU= 16.355
  07:47:26 STEP 2408 H=2408:00 +CPU= 17.032
  07:47:50 STEP 2409 H=2409:00 +CPU= 24.490
  07:48:07 STEP 2410 H=2410:00 +CPU= 16.347
  07:48:23 STEP 2411 H=2411:00 +CPU= 16.170
  07:48:52 STEP 2412 H=2412:00 +CPU= 28.254
Moving to projects directory: /home/galfridian/slots/5/ICMGGhq0f+002412
Moving to projects directory: /home/galfridian/slots/5/ICMSHhq0f+002412
Moving to projects directory: /home/galfridian/slots/5/ICMUAhq0f+002412
  07:49:10 STEP 2413 H=2413:00 +CPU= 17.642
  07:49:26 STEP 2414 H=2414:00 +CPU= 16.455
  07:49:52 STEP 2415 H=2415:00 +CPU= 24.952
  07:50:10 STEP 2416 H=2416:00 +CPU= 18.146
  07:50:26 STEP 2417 H=2417:00 +CPU= 16.202
  07:50:52 STEP 2418 H=2418:00 +CPU= 25.198
  07:51:09 STEP 2419 H=2419:00 +CPU= 16.386
  07:51:25 STEP 2420 H=2420:00 +CPU= 15.782
  07:51:50 STEP 2421 H=2421:00 +CPU= 25.085
  07:52:07 STEP 2422 H=2422:00 +CPU= 16.669
  07:52:23 STEP 2423 H=2423:00 +CPU= 16.183
  07:52:53 STEP 2424 H=2424:00 +CPU= 29.013
Moving to projects directory: /home/galfridian/slots/5/ICMGGhq0f+002424
Moving to projects directory: /home/galfridian/slots/5/ICMSHhq0f+002424
Moving to projects directory: /home/galfridian/slots/5/ICMUAhq0f+002424
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMGGhq0f+002400
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMSHhq0f+002400
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMUAhq0f+002400
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMGGhq0f+002412
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMSHhq0f+002412
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMUAhq0f+002412
Zipping up the intermediate file: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_0206_2005050100_123_974_12190850_1_r1551377807_100.zip
Uploading the intermediate file: upload_file_100.zip
  07:53:10 STEP 2425 H=2425:00 +CPU= 16.155
  07:53:26 STEP 2426 H=2426:00 +CPU= 16.252
  07:53:52 STEP 2427 H=2427:00 +CPU= 25.546
  07:54:09 STEP 2428 H=2428:00 +CPU= 16.146
  07:54:25 STEP 2429 H=2429:00 +CPU= 15.905
  07:54:52 STEP 2430 H=2430:00 +CPU= 26.090
  07:55:07 STEP 2431 H=2431:00 +CPU= 15.695
  07:55:25 STEP 2432 H=2432:00 +CPU= 17.158
  07:55:50 STEP 2433 H=2433:00 +CPU= 24.786
  07:56:06 STEP 2434 H=2434:00 +CPU= 15.830
  07:56:21 STEP 2435 H=2435:00 +CPU= 15.611
  07:56:50 STEP 2436 H=2436:00 +CPU= 27.711
Moving to projects directory: /home/galfridian/slots/5/ICMGGhq0f+002436
Moving to projects directory: /home/galfridian/slots/5/ICMSHhq0f+002436
Moving to projects directory: /home/galfridian/slots/5/ICMUAhq0f+002436
  07:57:06 STEP 2437 H=2437:00 +CPU= 16.311
  07:57:23 STEP 2438 H=2438:00 +CPU= 16.474
  07:57:49 STEP 2439 H=2439:00 +CPU= 25.779
  07:58:06 STEP 2440 H=2440:00 +CPU= 16.300
  07:58:21 STEP 2441 H=2441:00 +CPU= 15.569
  07:58:46 STEP 2442 H=2442:00 +CPU= 25.009
  07:59:02 STEP 2443 H=2443:00 +CPU= 15.533
  07:59:18 STEP 2444 H=2444:00 +CPU= 16.141
  07:59:43 STEP 2445 H=2445:00 +CPU= 24.383
  07:59:59 STEP 2446 H=2446:00 +CPU= 16.562
  08:00:17 STEP 2447 H=2447:00 +CPU= 17.242
  08:00:46 STEP 2448 H=2448:00 +CPU= 29.288
Moving to projects directory: /home/galfridian/slots/5/ICMGGhq0f+002448
Moving to projects directory: /home/galfridian/slots/5/ICMSHhq0f+002448
Moving to projects directory: /home/galfridian/slots/5/ICMUAhq0f+002448
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMGGhq0f+002424
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMSHhq0f+002424
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMUAhq0f+002424
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMGGhq0f+002436
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMSHhq0f+002436
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMUAhq0f+002436
Zipping up the intermediate file: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_0206_2005050100_123_974_12190850_1_r1551377807_101.zip
Uploading the intermediate file: upload_file_101.zip
  08:01:03 STEP 2449 H=2449:00 +CPU= 15.872
  08:01:20 STEP 2450 H=2450:00 +CPU= 16.817
  08:01:46 STEP 2451 H=2451:00 +CPU= 26.631
  08:02:05 STEP 2452 H=2452:00 +CPU= 17.590
  08:02:21 STEP 2453 H=2453:00 +CPU= 16.551
  08:02:47 STEP 2454 H=2454:00 +CPU= 25.657
  08:03:05 STEP 2455 H=2455:00 +CPU= 17.118
  08:03:22 STEP 2456 H=2456:00 +CPU= 16.458
  08:03:46 STEP 2457 H=2457:00 +CPU= 24.725
  08:04:03 STEP 2458 H=2458:00 +CPU= 16.207
  08:04:20 STEP 2459 H=2459:00 +CPU= 17.132
  08:04:50 STEP 2460 H=2460:00 +CPU= 29.860
Moving to projects directory: /home/galfridian/slots/5/ICMGGhq0f+002460
Moving to projects directory: /home/galfridian/slots/5/ICMSHhq0f+002460
Moving to projects directory: /home/galfridian/slots/5/ICMUAhq0f+002460
  08:05:07 STEP 2461 H=2461:00 +CPU= 16.579
  08:05:24 STEP 2462 H=2462:00 +CPU= 16.507
  08:05:49 STEP 2463 H=2463:00 +CPU= 25.004
  08:06:06 STEP 2464 H=2464:00 +CPU= 16.788
  08:06:22 STEP 2465 H=2465:00 +CPU= 15.611
  08:06:49 STEP 2466 H=2466:00 +CPU= 25.420
  08:07:05 STEP 2467 H=2467:00 +CPU= 15.716
  08:07:21 STEP 2468 H=2468:00 +CPU= 16.034
  08:07:46 STEP 2469 H=2469:00 +CPU= 24.700
  08:08:02 STEP 2470 H=2470:00 +CPU= 16.242
  08:08:19 STEP 2471 H=2471:00 +CPU= 17.035
  08:08:49 STEP 2472 H=2472:00 +CPU= 29.278
Moving to projects directory: /home/galfridian/slots/5/ICMGGhq0f+002472
Moving to projects directory: /home/galfridian/slots/5/ICMSHhq0f+002472
Moving to projects directory: /home/galfridian/slots/5/ICMUAhq0f+002472
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMGGhq0f+002448
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMSHhq0f+002448
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMUAhq0f+002448
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMGGhq0f+002460
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMSHhq0f+002460
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMUAhq0f+002460
Zipping up the intermediate file: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_0206_2005050100_123_974_12190850_1_r1551377807_102.zip
Uploading the intermediate file: upload_file_102.zip
  08:09:05 STEP 2473 H=2473:00 +CPU= 15.334
  08:09:21 STEP 2474 H=2474:00 +CPU= 15.966
  08:09:46 STEP 2475 H=2475:00 +CPU= 24.302
  08:10:02 STEP 2476 H=2476:00 +CPU= 15.885
  08:10:18 STEP 2477 H=2477:00 +CPU= 16.629
  08:10:45 STEP 2478 H=2478:00 +CPU= 26.223
  08:11:01 STEP 2479 H=2479:00 +CPU= 15.782
  08:11:18 STEP 2480 H=2480:00 +CPU= 16.422
  08:11:43 STEP 2481 H=2481:00 +CPU= 24.952
  08:12:00 STEP 2482 H=2482:00 +CPU= 17.213
  08:12:17 STEP 2483 H=2483:00 +CPU= 17.003
  08:12:46 STEP 2484 H=2484:00 +CPU= 27.929
Moving to projects directory: /home/galfridian/slots/5/ICMGGhq0f+002484
Moving to projects directory: /home/galfridian/slots/5/ICMSHhq0f+002484
Moving to projects directory: /home/galfridian/slots/5/ICMUAhq0f+002484
  08:13:02 STEP 2485 H=2485:00 +CPU= 15.641
  08:13:18 STEP 2486 H=2486:00 +CPU= 16.119
  08:13:43 STEP 2487 H=2487:00 +CPU= 24.544
  08:13:59 STEP 2488 H=2488:00 +CPU= 16.363
  08:14:15 STEP 2489 H=2489:00 +CPU= 15.479
  08:14:41 STEP 2490 H=2490:00 +CPU= 25.328
  08:14:56 STEP 2491 H=2491:00 +CPU= 15.246
  08:15:12 STEP 2492 H=2492:00 +CPU= 15.743
  08:15:37 STEP 2493 H=2493:00 +CPU= 24.688
  08:15:54 STEP 2494 H=2494:00 +CPU= 16.362
  08:16:11 STEP 2495 H=2495:00 +CPU= 16.783
  08:16:42 STEP 2496 H=2496:00 +CPU= 30.223
Moving to projects directory: /home/galfridian/slots/5/ICMGGhq0f+002496
Moving to projects directory: /home/galfridian/slots/5/ICMSHhq0f+002496
Moving to projects directory: /home/galfridian/slots/5/ICMUAhq0f+002496
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMGGhq0f+002472
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMSHhq0f+002472
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMUAhq0f+002472
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMGGhq0f+002484
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMSHhq0f+002484
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMUAhq0f+002484
Zipping up the intermediate file: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_0206_2005050100_123_974_12190850_1_r1551377807_103.zip
Uploading the intermediate file: upload_file_103.zip
  08:16:58 STEP 2497 H=2497:00 +CPU= 16.107
  08:17:15 STEP 2498 H=2498:00 +CPU= 16.411
  08:17:40 STEP 2499 H=2499:00 +CPU= 24.489
  08:17:57 STEP 2500 H=2500:00 +CPU= 16.492
  08:18:13 STEP 2501 H=2501:00 +CPU= 15.810
  08:18:39 STEP 2502 H=2502:00 +CPU= 26.434
  08:18:56 STEP 2503 H=2503:00 +CPU= 15.894
  08:19:12 STEP 2504 H=2504:00 +CPU= 15.998
  08:19:38 STEP 2505 H=2505:00 +CPU= 26.134
  08:19:54 STEP 2506 H=2506:00 +CPU= 15.940
  08:20:12 STEP 2507 H=2507:00 +CPU= 16.986
  08:20:41 STEP 2508 H=2508:00 +CPU= 29.178
Moving to projects directory: /home/galfridian/slots/5/ICMGGhq0f+002508
Moving to projects directory: /home/galfridian/slots/5/ICMSHhq0f+002508
Moving to projects directory: /home/galfridian/slots/5/ICMUAhq0f+002508
  08:20:57 STEP 2509 H=2509:00 +CPU= 16.001
  08:21:14 STEP 2510 H=2510:00 +CPU= 16.021
  08:21:40 STEP 2511 H=2511:00 +CPU= 26.138
  08:21:57 STEP 2512 H=2512:00 +CPU= 16.649
  08:22:14 STEP 2513 H=2513:00 +CPU= 16.354
  08:22:41 STEP 2514 H=2514:00 +CPU= 27.191
  08:22:58 STEP 2515 H=2515:00 +CPU= 16.696
  08:23:16 STEP 2516 H=2516:00 +CPU= 17.228
  08:23:42 STEP 2517 H=2517:00 +CPU= 25.713
  08:23:58 STEP 2518 H=2518:00 +CPU= 16.111
  08:24:14 STEP 2519 H=2519:00 +CPU= 16.131
  08:24:46 STEP 2520 H=2520:00 +CPU= 30.707
Moving to projects directory: /home/galfridian/slots/5/ICMGGhq0f+002520
Moving to projects directory: /home/galfridian/slots/5/ICMSHhq0f+002520
Moving to projects directory: /home/galfridian/slots/5/ICMUAhq0f+002520
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMGGhq0f+002496
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMSHhq0f+002496
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMUAhq0f+002496
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMGGhq0f+002508
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMSHhq0f+002508
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMUAhq0f+002508
Zipping up the intermediate file: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_0206_2005050100_123_974_12190850_1_r1551377807_104.zip
Uploading the intermediate file: upload_file_104.zip
  08:25:02 STEP 2521 H=2521:00 +CPU= 15.772
  08:25:18 STEP 2522 H=2522:00 +CPU= 16.259
  08:25:43 STEP 2523 H=2523:00 +CPU= 24.600
  08:25:59 STEP 2524 H=2524:00 +CPU= 16.106
  08:26:16 STEP 2525 H=2525:00 +CPU= 16.259
  08:26:42 STEP 2526 H=2526:00 +CPU= 26.071
  08:26:58 STEP 2527 H=2527:00 +CPU= 15.519
  08:27:14 STEP 2528 H=2528:00 +CPU= 16.356
  08:27:39 STEP 2529 H=2529:00 +CPU= 24.708
  08:27:56 STEP 2530 H=2530:00 +CPU= 16.536
  08:28:12 STEP 2531 H=2531:00 +CPU= 16.017
  08:28:39 STEP 2532 H=2532:00 +CPU= 27.070
Moving to projects directory: /home/galfridian/slots/5/ICMGGhq0f+002532
Moving to projects directory: /home/galfridian/slots/5/ICMSHhq0f+002532
Moving to projects directory: /home/galfridian/slots/5/ICMUAhq0f+002532
  08:28:55 STEP 2533 H=2533:00 +CPU= 15.350
  08:29:12 STEP 2534 H=2534:00 +CPU= 16.663
  08:29:38 STEP 2535 H=2535:00 +CPU= 25.049
  08:29:54 STEP 2536 H=2536:00 +CPU= 16.380
  08:30:11 STEP 2537 H=2537:00 +CPU= 16.504
  08:30:37 STEP 2538 H=2538:00 +CPU= 24.959
  08:30:53 STEP 2539 H=2539:00 +CPU= 15.736
  08:31:09 STEP 2540 H=2540:00 +CPU= 16.429
  08:31:34 STEP 2541 H=2541:00 +CPU= 24.460
  08:31:51 STEP 2542 H=2542:00 +CPU= 16.249
  08:32:07 STEP 2543 H=2543:00 +CPU= 16.228
  08:32:37 STEP 2544 H=2544:00 +CPU= 29.171
Moving to projects directory: /home/galfridian/slots/5/ICMGGhq0f+002544
Moving to projects directory: /home/galfridian/slots/5/ICMSHhq0f+002544
Moving to projects directory: /home/galfridian/slots/5/ICMUAhq0f+002544
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMGGhq0f+002520
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMSHhq0f+002520
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMUAhq0f+002520
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMGGhq0f+002532
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMSHhq0f+002532
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMUAhq0f+002532
Zipping up the intermediate file: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_0206_2005050100_123_974_12190850_1_r1551377807_105.zip
Uploading the intermediate file: upload_file_105.zip
  08:32:52 STEP 2545 H=2545:00 +CPU= 15.532
Uploading trickle at timestep: 9158400
  08:33:09 STEP 2546 H=2546:00 +CPU= 16.376
  08:33:35 STEP 2547 H=2547:00 +CPU= 25.710
  08:33:53 STEP 2548 H=2548:00 +CPU= 16.900
  08:34:09 STEP 2549 H=2549:00 +CPU= 16.036
  08:34:35 STEP 2550 H=2550:00 +CPU= 26.467
  08:34:52 STEP 2551 H=2551:00 +CPU= 16.518
  08:35:09 STEP 2552 H=2552:00 +CPU= 16.830
  08:35:35 STEP 2553 H=2553:00 +CPU= 26.255
  08:35:53 STEP 2554 H=2554:00 +CPU= 17.554
  08:36:11 STEP 2555 H=2555:00 +CPU= 17.073
  08:36:39 STEP 2556 H=2556:00 +CPU= 27.795
Moving to projects directory: /home/galfridian/slots/5/ICMGGhq0f+002556
Moving to projects directory: /home/galfridian/slots/5/ICMSHhq0f+002556
Moving to projects directory: /home/galfridian/slots/5/ICMUAhq0f+002556
  08:36:55 STEP 2557 H=2557:00 +CPU= 16.044
  08:37:12 STEP 2558 H=2558:00 +CPU= 16.394
  08:37:37 STEP 2559 H=2559:00 +CPU= 24.683
  08:37:54 STEP 2560 H=2560:00 +CPU= 16.800
  08:38:11 STEP 2561 H=2561:00 +CPU= 17.395
  08:38:40 STEP 2562 H=2562:00 +CPU= 27.906
  08:38:57 STEP 2563 H=2563:00 +CPU= 17.260
  08:39:14 STEP 2564 H=2564:00 +CPU= 16.816
  08:39:39 STEP 2565 H=2565:00 +CPU= 24.669
  08:39:55 STEP 2566 H=2566:00 +CPU= 15.927
  08:40:11 STEP 2567 H=2567:00 +CPU= 15.848
  08:40:41 STEP 2568 H=2568:00 +CPU= 29.102
Moving to projects directory: /home/galfridian/slots/5/ICMGGhq0f+002568
Moving to projects directory: /home/galfridian/slots/5/ICMSHhq0f+002568
Moving to projects directory: /home/galfridian/slots/5/ICMUAhq0f+002568
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMGGhq0f+002544
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMSHhq0f+002544
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMUAhq0f+002544
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMGGhq0f+002556
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMSHhq0f+002556
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMUAhq0f+002556
Zipping up the intermediate file: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_0206_2005050100_123_974_12190850_1_r1551377807_106.zip
Uploading the intermediate file: upload_file_106.zip
  08:40:58 STEP 2569 H=2569:00 +CPU= 16.218
  08:41:14 STEP 2570 H=2570:00 +CPU= 16.303
  08:41:39 STEP 2571 H=2571:00 +CPU= 24.543
  08:41:57 STEP 2572 H=2572:00 +CPU= 17.564
  08:42:14 STEP 2573 H=2573:00 +CPU= 16.113
  08:42:39 STEP 2574 H=2574:00 +CPU= 24.631
  08:42:56 STEP 2575 H=2575:00 +CPU= 16.650
  08:43:13 STEP 2576 H=2576:00 +CPU= 16.747
  08:43:39 STEP 2577 H=2577:00 +CPU= 26.076
  08:43:55 STEP 2578 H=2578:00 +CPU= 15.943
  08:44:12 STEP 2579 H=2579:00 +CPU= 16.283
  08:44:40 STEP 2580 H=2580:00 +CPU= 27.863
Moving to projects directory: /home/galfridian/slots/5/ICMGGhq0f+002580
Moving to projects directory: /home/galfridian/slots/5/ICMSHhq0f+002580
Moving to projects directory: /home/galfridian/slots/5/ICMUAhq0f+002580
  08:44:58 STEP 2581 H=2581:00 +CPU= 17.022
  08:45:15 STEP 2582 H=2582:00 +CPU= 16.702
  08:45:39 STEP 2583 H=2583:00 +CPU= 24.338
  08:45:56 STEP 2584 H=2584:00 +CPU= 16.503
  08:46:12 STEP 2585 H=2585:00 +CPU= 15.729
  08:46:39 STEP 2586 H=2586:00 +CPU= 26.811
  08:46:56 STEP 2587 H=2587:00 +CPU= 15.964
  08:47:12 STEP 2588 H=2588:00 +CPU= 15.898
  08:47:37 STEP 2589 H=2589:00 +CPU= 25.269
  08:47:53 STEP 2590 H=2590:00 +CPU= 15.988
  08:48:11 STEP 2591 H=2591:00 +CPU= 17.158
  08:48:40 STEP 2592 H=2592:00 +CPU= 29.259
Moving to projects directory: /home/galfridian/slots/5/ICMGGhq0f+002592
Moving to projects directory: /home/galfridian/slots/5/ICMSHhq0f+002592
Moving to projects directory: /home/galfridian/slots/5/ICMUAhq0f+002592
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMGGhq0f+002568
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMSHhq0f+002568
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMUAhq0f+002568
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMGGhq0f+002580
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMSHhq0f+002580
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMUAhq0f+002580
Zipping up the intermediate file: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_0206_2005050100_123_974_12190850_1_r1551377807_107.zip
Uploading the intermediate file: upload_file_107.zip
  08:48:57 STEP 2593 H=2593:00 +CPU= 15.585
  08:49:13 STEP 2594 H=2594:00 +CPU= 16.132
  08:49:39 STEP 2595 H=2595:00 +CPU= 25.310
  08:49:56 STEP 2596 H=2596:00 +CPU= 16.540
  08:50:13 STEP 2597 H=2597:00 +CPU= 16.843
  08:50:39 STEP 2598 H=2598:00 +CPU= 25.917
  08:50:55 STEP 2599 H=2599:00 +CPU= 15.744
  08:51:12 STEP 2600 H=2600:00 +CPU= 16.712
  08:51:37 STEP 2601 H=2601:00 +CPU= 25.039
  08:51:56 STEP 2602 H=2602:00 +CPU= 18.145
  08:52:13 STEP 2603 H=2603:00 +CPU= 17.039
  08:52:42 STEP 2604 H=2604:00 +CPU= 28.541
Moving to projects directory: /home/galfridian/slots/5/ICMGGhq0f+002604
Moving to projects directory: /home/galfridian/slots/5/ICMSHhq0f+002604
Moving to projects directory: /home/galfridian/slots/5/ICMUAhq0f+002604
  08:52:59 STEP 2605 H=2605:00 +CPU= 17.120
  08:53:16 STEP 2606 H=2606:00 +CPU= 16.420
  08:53:41 STEP 2607 H=2607:00 +CPU= 25.475
  08:53:59 STEP 2608 H=2608:00 +CPU= 16.917
  08:54:16 STEP 2609 H=2609:00 +CPU= 17.181
  08:54:42 STEP 2610 H=2610:00 +CPU= 25.566
  08:54:58 STEP 2611 H=2611:00 +CPU= 16.094
  08:55:15 STEP 2612 H=2612:00 +CPU= 16.905
  08:55:41 STEP 2613 H=2613:00 +CPU= 25.196
  08:55:57 STEP 2614 H=2614:00 +CPU= 16.033
  08:56:14 STEP 2615 H=2615:00 +CPU= 16.991
  08:56:45 STEP 2616 H=2616:00 +CPU= 30.237
Moving to projects directory: /home/galfridian/slots/5/ICMGGhq0f+002616
Moving to projects directory: /home/galfridian/slots/5/ICMSHhq0f+002616
Moving to projects directory: /home/galfridian/slots/5/ICMUAhq0f+002616
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMGGhq0f+002592
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMSHhq0f+002592
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMUAhq0f+002592
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMGGhq0f+002604
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMSHhq0f+002604
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMUAhq0f+002604
Zipping up the intermediate file: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_0206_2005050100_123_974_12190850_1_r1551377807_108.zip
Uploading the intermediate file: upload_file_108.zip
  08:57:02 STEP 2617 H=2617:00 +CPU= 17.022
  08:57:20 STEP 2618 H=2618:00 +CPU= 17.039
  08:57:45 STEP 2619 H=2619:00 +CPU= 24.808
  08:58:01 STEP 2620 H=2620:00 +CPU= 16.262
  08:58:17 STEP 2621 H=2621:00 +CPU= 15.733
  08:58:44 STEP 2622 H=2622:00 +CPU= 26.457
  08:59:01 STEP 2623 H=2623:00 +CPU= 16.077
  08:59:17 STEP 2624 H=2624:00 +CPU= 16.420
  08:59:42 STEP 2625 H=2625:00 +CPU= 24.580
  08:59:58 STEP 2626 H=2626:00 +CPU= 16.076
  09:00:14 STEP 2627 H=2627:00 +CPU= 15.688
  09:00:43 STEP 2628 H=2628:00 +CPU= 28.201
Moving to projects directory: /home/galfridian/slots/5/ICMGGhq0f+002628
Moving to projects directory: /home/galfridian/slots/5/ICMSHhq0f+002628
Moving to projects directory: /home/galfridian/slots/5/ICMUAhq0f+002628
  09:00:58 STEP 2629 H=2629:00 +CPU= 15.607
  09:01:14 STEP 2630 H=2630:00 +CPU= 15.987
  09:01:40 STEP 2631 H=2631:00 +CPU= 24.784
  09:01:57 STEP 2632 H=2632:00 +CPU= 17.038
  09:02:14 STEP 2633 H=2633:00 +CPU= 16.871
  09:02:40 STEP 2634 H=2634:00 +CPU= 25.798
  09:02:57 STEP 2635 H=2635:00 +CPU= 16.083
  09:03:13 STEP 2636 H=2636:00 +CPU= 16.672
  09:03:39 STEP 2637 H=2637:00 +CPU= 25.421
  09:03:56 STEP 2638 H=2638:00 +CPU= 16.908
  09:04:12 STEP 2639 H=2639:00 +CPU= 16.000
  09:04:42 STEP 2640 H=2640:00 +CPU= 29.768
Moving to projects directory: /home/galfridian/slots/5/ICMGGhq0f+002640
Moving to projects directory: /home/galfridian/slots/5/ICMSHhq0f+002640
Moving to projects directory: /home/galfridian/slots/5/ICMUAhq0f+002640
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMGGhq0f+002616
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMSHhq0f+002616
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMUAhq0f+002616
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMGGhq0f+002628
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMSHhq0f+002628
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMUAhq0f+002628
Zipping up the intermediate file: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_0206_2005050100_123_974_12190850_1_r1551377807_109.zip
Uploading the intermediate file: upload_file_109.zip
  09:04:59 STEP 2641 H=2641:00 +CPU= 16.027
  09:05:15 STEP 2642 H=2642:00 +CPU= 16.276
  09:05:41 STEP 2643 H=2643:00 +CPU= 26.111
  09:05:59 STEP 2644 H=2644:00 +CPU= 17.598
  09:06:16 STEP 2645 H=2645:00 +CPU= 16.870
  09:06:43 STEP 2646 H=2646:00 +CPU= 26.405
  09:07:00 STEP 2647 H=2647:00 +CPU= 16.230
  09:07:16 STEP 2648 H=2648:00 +CPU= 16.374
  09:07:42 STEP 2649 H=2649:00 +CPU= 24.999
  09:07:58 STEP 2650 H=2650:00 +CPU= 16.412
  09:08:14 STEP 2651 H=2651:00 +CPU= 15.492
  09:08:41 STEP 2652 H=2652:00 +CPU= 27.246
Moving to projects directory: /home/galfridian/slots/5/ICMGGhq0f+002652
Moving to projects directory: /home/galfridian/slots/5/ICMSHhq0f+002652
Moving to projects directory: /home/galfridian/slots/5/ICMUAhq0f+002652
  09:08:57 STEP 2653 H=2653:00 +CPU= 15.519
  09:09:14 STEP 2654 H=2654:00 +CPU= 17.196
  09:09:41 STEP 2655 H=2655:00 +CPU= 26.919
  09:09:59 STEP 2656 H=2656:00 +CPU= 17.020
  09:10:15 STEP 2657 H=2657:00 +CPU= 16.247
  09:10:42 STEP 2658 H=2658:00 +CPU= 26.788
  09:10:58 STEP 2659 H=2659:00 +CPU= 15.710
  09:11:15 STEP 2660 H=2660:00 +CPU= 16.306
  09:11:41 STEP 2661 H=2661:00 +CPU= 25.076
  09:11:58 STEP 2662 H=2662:00 +CPU= 17.052
  09:12:16 STEP 2663 H=2663:00 +CPU= 17.198
  09:12:48 STEP 2664 H=2664:00 +CPU= 31.417
Moving to projects directory: /home/galfridian/slots/5/ICMGGhq0f+002664
Moving to projects directory: /home/galfridian/slots/5/ICMSHhq0f+002664
Moving to projects directory: /home/galfridian/slots/5/ICMUAhq0f+002664
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMGGhq0f+002640
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMSHhq0f+002640
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMUAhq0f+002640
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMGGhq0f+002652
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMSHhq0f+002652
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMUAhq0f+002652
Zipping up the intermediate file: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_0206_2005050100_123_974_12190850_1_r1551377807_110.zip
Uploading the intermediate file: upload_file_110.zip
  09:13:04 STEP 2665 H=2665:00 +CPU= 15.770
  09:13:21 STEP 2666 H=2666:00 +CPU= 16.991
  09:13:48 STEP 2667 H=2667:00 +CPU= 25.819
  09:14:06 STEP 2668 H=2668:00 +CPU= 18.289
  09:14:23 STEP 2669 H=2669:00 +CPU= 16.096
  09:14:48 STEP 2670 H=2670:00 +CPU= 25.151
  09:15:04 STEP 2671 H=2671:00 +CPU= 15.604
  09:15:21 STEP 2672 H=2672:00 +CPU= 16.527
  09:15:47 STEP 2673 H=2673:00 +CPU= 25.455
  09:16:04 STEP 2674 H=2674:00 +CPU= 16.892
  09:16:20 STEP 2675 H=2675:00 +CPU= 16.255
  09:16:49 STEP 2676 H=2676:00 +CPU= 27.877
Moving to projects directory: /home/galfridian/slots/5/ICMGGhq0f+002676
Moving to projects directory: /home/galfridian/slots/5/ICMSHhq0f+002676
Moving to projects directory: /home/galfridian/slots/5/ICMUAhq0f+002676
  09:17:05 STEP 2677 H=2677:00 +CPU= 16.358
  09:17:22 STEP 2678 H=2678:00 +CPU= 16.480
  09:17:48 STEP 2679 H=2679:00 +CPU= 25.856
  09:18:05 STEP 2680 H=2680:00 +CPU= 16.464
  09:18:21 STEP 2681 H=2681:00 +CPU= 15.950
  09:18:47 STEP 2682 H=2682:00 +CPU= 25.853
  09:19:03 STEP 2683 H=2683:00 +CPU= 16.166
  09:19:19 STEP 2684 H=2684:00 +CPU= 16.567
  09:19:44 STEP 2685 H=2685:00 +CPU= 24.606
  09:20:00 STEP 2686 H=2686:00 +CPU= 16.221
  09:20:17 STEP 2687 H=2687:00 +CPU= 16.833
  09:20:48 STEP 2688 H=2688:00 +CPU= 29.938
Moving to projects directory: /home/galfridian/slots/5/ICMGGhq0f+002688
Moving to projects directory: /home/galfridian/slots/5/ICMSHhq0f+002688
Moving to projects directory: /home/galfridian/slots/5/ICMUAhq0f+002688
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMGGhq0f+002664
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMSHhq0f+002664
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMUAhq0f+002664
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMGGhq0f+002676
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMSHhq0f+002676
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMUAhq0f+002676
Zipping up the intermediate file: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_0206_2005050100_123_974_12190850_1_r1551377807_111.zip
Uploading the intermediate file: upload_file_111.zip
  09:21:05 STEP 2689 H=2689:00 +CPU= 16.366
  09:21:22 STEP 2690 H=2690:00 +CPU= 17.018
  09:21:48 STEP 2691 H=2691:00 +CPU= 25.987
  09:22:05 STEP 2692 H=2692:00 +CPU= 16.026
  09:22:20 STEP 2693 H=2693:00 +CPU= 15.653
  09:22:46 STEP 2694 H=2694:00 +CPU= 25.040
  09:23:02 STEP 2695 H=2695:00 +CPU= 15.688
  09:23:18 STEP 2696 H=2696:00 +CPU= 16.219
  09:23:43 STEP 2697 H=2697:00 +CPU= 24.995
  09:23:59 STEP 2698 H=2698:00 +CPU= 16.011
  09:24:15 STEP 2699 H=2699:00 +CPU= 15.845
  09:24:43 STEP 2700 H=2700:00 +CPU= 27.432
Moving to projects directory: /home/galfridian/slots/5/ICMGGhq0f+002700
Moving to projects directory: /home/galfridian/slots/5/ICMSHhq0f+002700
Moving to projects directory: /home/galfridian/slots/5/ICMUAhq0f+002700
  09:25:00 STEP 2701 H=2701:00 +CPU= 16.020
  09:25:16 STEP 2702 H=2702:00 +CPU= 16.317
  09:25:42 STEP 2703 H=2703:00 +CPU= 25.275
  09:25:58 STEP 2704 H=2704:00 +CPU= 16.415
  09:26:15 STEP 2705 H=2705:00 +CPU= 16.674
  09:26:42 STEP 2706 H=2706:00 +CPU= 26.455
  09:26:58 STEP 2707 H=2707:00 +CPU= 15.982
  09:27:15 STEP 2708 H=2708:00 +CPU= 16.763
  09:27:41 STEP 2709 H=2709:00 +CPU= 25.284
  09:27:58 STEP 2710 H=2710:00 +CPU= 16.606
  09:28:15 STEP 2711 H=2711:00 +CPU= 17.414
  09:28:46 STEP 2712 H=2712:00 +CPU= 30.085
Moving to projects directory: /home/galfridian/slots/5/ICMGGhq0f+002712
Moving to projects directory: /home/galfridian/slots/5/ICMSHhq0f+002712
Moving to projects directory: /home/galfridian/slots/5/ICMUAhq0f+002712
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMGGhq0f+002688
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMSHhq0f+002688
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMUAhq0f+002688
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMGGhq0f+002700
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMSHhq0f+002700
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMUAhq0f+002700
Zipping up the intermediate file: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_0206_2005050100_123_974_12190850_1_r1551377807_112.zip
Uploading the intermediate file: upload_file_112.zip
  09:29:02 STEP 2713 H=2713:00 +CPU= 16.038
  09:29:19 STEP 2714 H=2714:00 +CPU= 16.516
  09:29:45 STEP 2715 H=2715:00 +CPU= 25.754
  09:30:03 STEP 2716 H=2716:00 +CPU= 17.912
  09:30:19 STEP 2717 H=2717:00 +CPU= 16.250
  09:30:45 STEP 2718 H=2718:00 +CPU= 25.748
  09:31:01 STEP 2719 H=2719:00 +CPU= 15.760
  09:31:18 STEP 2720 H=2720:00 +CPU= 16.465
  09:31:43 STEP 2721 H=2721:00 +CPU= 25.525
  09:32:00 STEP 2722 H=2722:00 +CPU= 16.617
  09:32:17 STEP 2723 H=2723:00 +CPU= 16.495
  09:32:45 STEP 2724 H=2724:00 +CPU= 27.795
Moving to projects directory: /home/galfridian/slots/5/ICMGGhq0f+002724
Moving to projects directory: /home/galfridian/slots/5/ICMSHhq0f+002724
Moving to projects directory: /home/galfridian/slots/5/ICMUAhq0f+002724
  09:33:02 STEP 2725 H=2725:00 +CPU= 16.411
  09:33:18 STEP 2726 H=2726:00 +CPU= 16.253
  09:33:43 STEP 2727 H=2727:00 +CPU= 24.533
  09:33:59 STEP 2728 H=2728:00 +CPU= 15.993
  09:34:15 STEP 2729 H=2729:00 +CPU= 16.035
  09:34:43 STEP 2730 H=2730:00 +CPU= 27.028
  09:34:59 STEP 2731 H=2731:00 +CPU= 16.013
  09:35:16 STEP 2732 H=2732:00 +CPU= 16.525
  09:35:42 STEP 2733 H=2733:00 +CPU= 25.668
  09:36:00 STEP 2734 H=2734:00 +CPU= 17.617
  09:36:17 STEP 2735 H=2735:00 +CPU= 17.313
  09:36:48 STEP 2736 H=2736:00 +CPU= 29.586
Moving to projects directory: /home/galfridian/slots/5/ICMGGhq0f+002736
Moving to projects directory: /home/galfridian/slots/5/ICMSHhq0f+002736
Moving to projects directory: /home/galfridian/slots/5/ICMUAhq0f+002736
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMGGhq0f+002712
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMSHhq0f+002712
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMUAhq0f+002712
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMGGhq0f+002724
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMSHhq0f+002724
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMUAhq0f+002724
Zipping up the intermediate file: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_0206_2005050100_123_974_12190850_1_r1551377807_113.zip
Uploading the intermediate file: upload_file_113.zip
  09:37:04 STEP 2737 H=2737:00 +CPU= 16.324
  09:37:23 STEP 2738 H=2738:00 +CPU= 18.143
  09:37:48 STEP 2739 H=2739:00 +CPU= 25.562
  09:38:05 STEP 2740 H=2740:00 +CPU= 16.271
  09:38:21 STEP 2741 H=2741:00 +CPU= 15.478
  09:38:47 STEP 2742 H=2742:00 +CPU= 25.572
  09:39:02 STEP 2743 H=2743:00 +CPU= 15.530
  09:39:19 STEP 2744 H=2744:00 +CPU= 16.565
  09:39:44 STEP 2745 H=2745:00 +CPU= 25.050
  09:40:01 STEP 2746 H=2746:00 +CPU= 16.433
  09:40:19 STEP 2747 H=2747:00 +CPU= 17.079
  09:40:47 STEP 2748 H=2748:00 +CPU= 28.128
Moving to projects directory: /home/galfridian/slots/5/ICMGGhq0f+002748
Moving to projects directory: /home/galfridian/slots/5/ICMSHhq0f+002748
Moving to projects directory: /home/galfridian/slots/5/ICMUAhq0f+002748
  09:41:04 STEP 2749 H=2749:00 +CPU= 16.264
  09:41:21 STEP 2750 H=2750:00 +CPU= 17.404
  09:41:47 STEP 2751 H=2751:00 +CPU= 25.144
  09:42:03 STEP 2752 H=2752:00 +CPU= 16.689
  09:42:20 STEP 2753 H=2753:00 +CPU= 16.152
  09:42:45 STEP 2754 H=2754:00 +CPU= 25.277
  09:43:01 STEP 2755 H=2755:00 +CPU= 15.706
  09:43:18 STEP 2756 H=2756:00 +CPU= 16.659
  09:43:44 STEP 2757 H=2757:00 +CPU= 25.695
  09:44:00 STEP 2758 H=2758:00 +CPU= 16.353
  09:44:18 STEP 2759 H=2759:00 +CPU= 17.511
  09:44:48 STEP 2760 H=2760:00 +CPU= 29.933
Moving to projects directory: /home/galfridian/slots/5/ICMGGhq0f+002760
Moving to projects directory: /home/galfridian/slots/5/ICMSHhq0f+002760
Moving to projects directory: /home/galfridian/slots/5/ICMUAhq0f+002760
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMGGhq0f+002736
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMSHhq0f+002736
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMUAhq0f+002736
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMGGhq0f+002748
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMSHhq0f+002748
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMUAhq0f+002748
Zipping up the intermediate file: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_0206_2005050100_123_974_12190850_1_r1551377807_114.zip
Uploading the intermediate file: upload_file_114.zip
  09:45:06 STEP 2761 H=2761:00 +CPU= 16.816
  09:45:23 STEP 2762 H=2762:00 +CPU= 17.146
  09:45:48 STEP 2763 H=2763:00 +CPU= 24.384
  09:46:04 STEP 2764 H=2764:00 +CPU= 16.306
  09:46:21 STEP 2765 H=2765:00 +CPU= 16.443
  09:46:47 STEP 2766 H=2766:00 +CPU= 25.539
  09:47:03 STEP 2767 H=2767:00 +CPU= 15.798
  09:47:20 STEP 2768 H=2768:00 +CPU= 17.117
  09:47:46 STEP 2769 H=2769:00 +CPU= 25.433
  09:48:03 STEP 2770 H=2770:00 +CPU= 16.374
  09:48:19 STEP 2771 H=2771:00 +CPU= 15.705
  09:48:47 STEP 2772 H=2772:00 +CPU= 27.958
Moving to projects directory: /home/galfridian/slots/5/ICMGGhq0f+002772
Moving to projects directory: /home/galfridian/slots/5/ICMSHhq0f+002772
Moving to projects directory: /home/galfridian/slots/5/ICMUAhq0f+002772
  09:49:03 STEP 2773 H=2773:00 +CPU= 16.008
  09:49:21 STEP 2774 H=2774:00 +CPU= 17.655
  09:49:47 STEP 2775 H=2775:00 +CPU= 25.358
  09:50:03 STEP 2776 H=2776:00 +CPU= 16.237
  09:50:19 STEP 2777 H=2777:00 +CPU= 16.138
  09:50:45 STEP 2778 H=2778:00 +CPU= 25.060
  09:51:01 STEP 2779 H=2779:00 +CPU= 16.357
  09:51:18 STEP 2780 H=2780:00 +CPU= 16.756
  09:51:45 STEP 2781 H=2781:00 +CPU= 26.039
  09:52:02 STEP 2782 H=2782:00 +CPU= 16.697
  09:52:18 STEP 2783 H=2783:00 +CPU= 16.576
  09:52:49 STEP 2784 H=2784:00 +CPU= 29.609
Moving to projects directory: /home/galfridian/slots/5/ICMGGhq0f+002784
Moving to projects directory: /home/galfridian/slots/5/ICMSHhq0f+002784
Moving to projects directory: /home/galfridian/slots/5/ICMUAhq0f+002784
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMGGhq0f+002760
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMSHhq0f+002760
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMUAhq0f+002760
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMGGhq0f+002772
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMSHhq0f+002772
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMUAhq0f+002772
Zipping up the intermediate file: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_0206_2005050100_123_974_12190850_1_r1551377807_115.zip
Uploading the intermediate file: upload_file_115.zip
  09:53:04 STEP 2785 H=2785:00 +CPU= 15.723
Uploading trickle at timestep: 10022400
  09:53:21 STEP 2786 H=2786:00 +CPU= 16.507
  09:53:47 STEP 2787 H=2787:00 +CPU= 25.418
  09:54:03 STEP 2788 H=2788:00 +CPU= 16.257
  09:54:20 STEP 2789 H=2789:00 +CPU= 16.227
  09:54:45 STEP 2790 H=2790:00 +CPU= 25.575
  09:55:01 STEP 2791 H=2791:00 +CPU= 15.358
  09:55:17 STEP 2792 H=2792:00 +CPU= 16.185
  09:55:42 STEP 2793 H=2793:00 +CPU= 24.720
  09:55:59 STEP 2794 H=2794:00 +CPU= 16.668
  09:56:15 STEP 2795 H=2795:00 +CPU= 15.689
  09:56:42 STEP 2796 H=2796:00 +CPU= 27.016
Moving to projects directory: /home/galfridian/slots/5/ICMGGhq0f+002796
Moving to projects directory: /home/galfridian/slots/5/ICMSHhq0f+002796
Moving to projects directory: /home/galfridian/slots/5/ICMUAhq0f+002796
  09:57:00 STEP 2797 H=2797:00 +CPU= 16.896
  09:57:16 STEP 2798 H=2798:00 +CPU= 16.253
  09:57:41 STEP 2799 H=2799:00 +CPU= 24.215
  09:57:57 STEP 2800 H=2800:00 +CPU= 16.170
  09:58:14 STEP 2801 H=2801:00 +CPU= 16.463
  09:58:39 STEP 2802 H=2802:00 +CPU= 25.407
  09:58:55 STEP 2803 H=2803:00 +CPU= 15.911
  09:59:13 STEP 2804 H=2804:00 +CPU= 16.807
  09:59:38 STEP 2805 H=2805:00 +CPU= 24.671
  09:59:54 STEP 2806 H=2806:00 +CPU= 16.208
  10:00:10 STEP 2807 H=2807:00 +CPU= 16.117
  10:00:41 STEP 2808 H=2808:00 +CPU= 29.795
Moving to projects directory: /home/galfridian/slots/5/ICMGGhq0f+002808
Moving to projects directory: /home/galfridian/slots/5/ICMSHhq0f+002808
Moving to projects directory: /home/galfridian/slots/5/ICMUAhq0f+002808
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMGGhq0f+002784
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMSHhq0f+002784
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMUAhq0f+002784
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMGGhq0f+002796
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMSHhq0f+002796
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMUAhq0f+002796
Zipping up the intermediate file: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_0206_2005050100_123_974_12190850_1_r1551377807_116.zip
Uploading the intermediate file: upload_file_116.zip
  10:00:56 STEP 2809 H=2809:00 +CPU= 15.463
  10:01:13 STEP 2810 H=2810:00 +CPU= 16.121
  10:01:38 STEP 2811 H=2811:00 +CPU= 24.803
  10:01:55 STEP 2812 H=2812:00 +CPU= 16.570
  10:02:12 STEP 2813 H=2813:00 +CPU= 16.416
  10:02:37 STEP 2814 H=2814:00 +CPU= 25.334
  10:02:54 STEP 2815 H=2815:00 +CPU= 16.398
  10:03:10 STEP 2816 H=2816:00 +CPU= 16.275
  10:03:37 STEP 2817 H=2817:00 +CPU= 25.460
  10:03:54 STEP 2818 H=2818:00 +CPU= 17.086
  10:04:10 STEP 2819 H=2819:00 +CPU= 15.954
  10:04:39 STEP 2820 H=2820:00 +CPU= 28.606
Moving to projects directory: /home/galfridian/slots/5/ICMGGhq0f+002820
Moving to projects directory: /home/galfridian/slots/5/ICMSHhq0f+002820
Moving to projects directory: /home/galfridian/slots/5/ICMUAhq0f+002820
  10:04:56 STEP 2821 H=2821:00 +CPU= 17.159
  10:05:14 STEP 2822 H=2822:00 +CPU= 17.073
  10:05:40 STEP 2823 H=2823:00 +CPU= 26.079
  10:05:57 STEP 2824 H=2824:00 +CPU= 16.694
  10:06:16 STEP 2825 H=2825:00 +CPU= 18.383
  10:06:43 STEP 2826 H=2826:00 +CPU= 27.131
  10:07:00 STEP 2827 H=2827:00 +CPU= 16.325
  10:07:17 STEP 2828 H=2828:00 +CPU= 16.426
  10:07:42 STEP 2829 H=2829:00 +CPU= 25.457
  10:07:59 STEP 2830 H=2830:00 +CPU= 16.841
  10:08:16 STEP 2831 H=2831:00 +CPU= 16.393
  10:08:47 STEP 2832 H=2832:00 +CPU= 30.649
Moving to projects directory: /home/galfridian/slots/5/ICMGGhq0f+002832
Moving to projects directory: /home/galfridian/slots/5/ICMSHhq0f+002832
Moving to projects directory: /home/galfridian/slots/5/ICMUAhq0f+002832
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMGGhq0f+002808
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMSHhq0f+002808
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMUAhq0f+002808
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMGGhq0f+002820
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMSHhq0f+002820
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMUAhq0f+002820
Zipping up the intermediate file: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_0206_2005050100_123_974_12190850_1_r1551377807_117.zip
Uploading the intermediate file: upload_file_117.zip
  10:09:05 STEP 2833 H=2833:00 +CPU= 17.184
  10:09:21 STEP 2834 H=2834:00 +CPU= 16.450
  10:09:48 STEP 2835 H=2835:00 +CPU= 25.801
  10:10:03 STEP 2836 H=2836:00 +CPU= 15.824
  10:10:20 STEP 2837 H=2837:00 +CPU= 16.702
  10:10:47 STEP 2838 H=2838:00 +CPU= 26.240
  10:11:04 STEP 2839 H=2839:00 +CPU= 16.600
  10:11:20 STEP 2840 H=2840:00 +CPU= 16.755
  10:11:46 STEP 2841 H=2841:00 +CPU= 24.955
  10:12:02 STEP 2842 H=2842:00 +CPU= 15.806
  10:12:18 STEP 2843 H=2843:00 +CPU= 16.086
  10:12:46 STEP 2844 H=2844:00 +CPU= 27.385
Moving to projects directory: /home/galfridian/slots/5/ICMGGhq0f+002844
Moving to projects directory: /home/galfridian/slots/5/ICMSHhq0f+002844
Moving to projects directory: /home/galfridian/slots/5/ICMUAhq0f+002844
  10:13:03 STEP 2845 H=2845:00 +CPU= 16.232
  10:13:20 STEP 2846 H=2846:00 +CPU= 16.546
  10:13:45 STEP 2847 H=2847:00 +CPU= 24.892
  10:14:02 STEP 2848 H=2848:00 +CPU= 16.509
  10:14:18 STEP 2849 H=2849:00 +CPU= 16.344
  10:14:44 STEP 2850 H=2850:00 +CPU= 25.561
  10:15:01 STEP 2851 H=2851:00 +CPU= 16.212
  10:15:18 STEP 2852 H=2852:00 +CPU= 17.106
  10:15:43 STEP 2853 H=2853:00 +CPU= 24.905
  10:16:00 STEP 2854 H=2854:00 +CPU= 16.497
  10:16:17 STEP 2855 H=2855:00 +CPU= 16.561
  10:16:47 STEP 2856 H=2856:00 +CPU= 30.198
Moving to projects directory: /home/galfridian/slots/5/ICMGGhq0f+002856
Moving to projects directory: /home/galfridian/slots/5/ICMSHhq0f+002856
Moving to projects directory: /home/galfridian/slots/5/ICMUAhq0f+002856
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMGGhq0f+002832
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMSHhq0f+002832
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMUAhq0f+002832
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMGGhq0f+002844
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMSHhq0f+002844
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMUAhq0f+002844
Zipping up the intermediate file: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_0206_2005050100_123_974_12190850_1_r1551377807_118.zip
Uploading the intermediate file: upload_file_118.zip
  10:17:04 STEP 2857 H=2857:00 +CPU= 16.501
  10:17:21 STEP 2858 H=2858:00 +CPU= 16.371
  10:17:46 STEP 2859 H=2859:00 +CPU= 25.297
  10:18:03 STEP 2860 H=2860:00 +CPU= 16.102
  10:18:18 STEP 2861 H=2861:00 +CPU= 15.594
  10:18:44 STEP 2862 H=2862:00 +CPU= 25.884
  10:19:01 STEP 2863 H=2863:00 +CPU= 16.644
  10:19:18 STEP 2864 H=2864:00 +CPU= 16.856
  10:19:45 STEP 2865 H=2865:00 +CPU= 26.080
  10:20:01 STEP 2866 H=2866:00 +CPU= 16.375
  10:20:18 STEP 2867 H=2867:00 +CPU= 16.213
  10:20:46 STEP 2868 H=2868:00 +CPU= 28.005
Moving to projects directory: /home/galfridian/slots/5/ICMGGhq0f+002868
Moving to projects directory: /home/galfridian/slots/5/ICMSHhq0f+002868
Moving to projects directory: /home/galfridian/slots/5/ICMUAhq0f+002868
  10:21:02 STEP 2869 H=2869:00 +CPU= 16.099
  10:21:19 STEP 2870 H=2870:00 +CPU= 16.369
  10:21:44 STEP 2871 H=2871:00 +CPU= 24.712
  10:22:01 STEP 2872 H=2872:00 +CPU= 16.377
  10:22:17 STEP 2873 H=2873:00 +CPU= 15.966
  10:22:43 STEP 2874 H=2874:00 +CPU= 25.408
  10:22:59 STEP 2875 H=2875:00 +CPU= 15.689
  10:23:15 STEP 2876 H=2876:00 +CPU= 16.707
  10:23:41 STEP 2877 H=2877:00 +CPU= 24.940
  10:23:58 STEP 2878 H=2878:00 +CPU= 16.821
  10:24:14 STEP 2879 H=2879:00 +CPU= 16.366
  10:24:44 STEP 2880 H=2880:00 +CPU= 29.470
Moving to projects directory: /home/galfridian/slots/5/ICMGGhq0f+002880
Moving to projects directory: /home/galfridian/slots/5/ICMSHhq0f+002880
Moving to projects directory: /home/galfridian/slots/5/ICMUAhq0f+002880
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMGGhq0f+002856
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMSHhq0f+002856
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMUAhq0f+002856
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMGGhq0f+002868
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMSHhq0f+002868
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMUAhq0f+002868
Zipping up the intermediate file: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_0206_2005050100_123_974_12190850_1_r1551377807_119.zip
Uploading the intermediate file: upload_file_119.zip
  10:25:01 STEP 2881 H=2881:00 +CPU= 16.574
  10:25:18 STEP 2882 H=2882:00 +CPU= 17.244
  10:25:44 STEP 2883 H=2883:00 +CPU= 25.593
  10:26:02 STEP 2884 H=2884:00 +CPU= 17.059
  10:26:18 STEP 2885 H=2885:00 +CPU= 16.180
  10:26:45 STEP 2886 H=2886:00 +CPU= 26.713
  10:27:02 STEP 2887 H=2887:00 +CPU= 16.429
  10:27:19 STEP 2888 H=2888:00 +CPU= 16.985
  10:27:45 STEP 2889 H=2889:00 +CPU= 25.632
  10:28:02 STEP 2890 H=2890:00 +CPU= 17.361
  10:28:19 STEP 2891 H=2891:00 +CPU= 16.616
  10:28:48 STEP 2892 H=2892:00 +CPU= 27.949
Moving to projects directory: /home/galfridian/slots/5/ICMGGhq0f+002892
Moving to projects directory: /home/galfridian/slots/5/ICMSHhq0f+002892
Moving to projects directory: /home/galfridian/slots/5/ICMUAhq0f+002892
  10:29:04 STEP 2893 H=2893:00 +CPU= 16.142
  10:29:21 STEP 2894 H=2894:00 +CPU= 16.227
  10:29:46 STEP 2895 H=2895:00 +CPU= 25.335
  10:30:04 STEP 2896 H=2896:00 +CPU= 17.247
  10:30:20 STEP 2897 H=2897:00 +CPU= 16.292
  10:30:47 STEP 2898 H=2898:00 +CPU= 25.688
  10:31:03 STEP 2899 H=2899:00 +CPU= 16.136
  10:31:20 STEP 2900 H=2900:00 +CPU= 16.460
  10:31:45 STEP 2901 H=2901:00 +CPU= 24.822
  10:32:02 STEP 2902 H=2902:00 +CPU= 16.572
  10:32:19 STEP 2903 H=2903:00 +CPU= 17.180
  10:32:49 STEP 2904 H=2904:00 +CPU= 29.438
Moving to projects directory: /home/galfridian/slots/5/ICMGGhq0f+002904
Moving to projects directory: /home/galfridian/slots/5/ICMSHhq0f+002904
Moving to projects directory: /home/galfridian/slots/5/ICMUAhq0f+002904
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMGGhq0f+002880
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMSHhq0f+002880
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMUAhq0f+002880
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMGGhq0f+002892
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMSHhq0f+002892
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMUAhq0f+002892
Zipping up the intermediate file: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_0206_2005050100_123_974_12190850_1_r1551377807_120.zip
Uploading the intermediate file: upload_file_120.zip
  10:33:05 STEP 2905 H=2905:00 +CPU= 15.971
  10:33:21 STEP 2906 H=2906:00 +CPU= 15.910
  10:33:46 STEP 2907 H=2907:00 +CPU= 24.859
  10:34:03 STEP 2908 H=2908:00 +CPU= 17.026
  10:34:20 STEP 2909 H=2909:00 +CPU= 16.412
  10:34:47 STEP 2910 H=2910:00 +CPU= 26.109
  10:35:04 STEP 2911 H=2911:00 +CPU= 16.679
  10:35:20 STEP 2912 H=2912:00 +CPU= 16.355
  10:35:47 STEP 2913 H=2913:00 +CPU= 25.442
  10:36:04 STEP 2914 H=2914:00 +CPU= 17.009
  10:36:21 STEP 2915 H=2915:00 +CPU= 16.440
  10:36:49 STEP 2916 H=2916:00 +CPU= 27.933
Moving to projects directory: /home/galfridian/slots/5/ICMGGhq0f+002916
Moving to projects directory: /home/galfridian/slots/5/ICMSHhq0f+002916
Moving to projects directory: /home/galfridian/slots/5/ICMUAhq0f+002916
  10:37:06 STEP 2917 H=2917:00 +CPU= 16.488
  10:37:22 STEP 2918 H=2918:00 +CPU= 16.233
  10:37:47 STEP 2919 H=2919:00 +CPU= 24.516
  10:38:03 STEP 2920 H=2920:00 +CPU= 15.971
  10:38:19 STEP 2921 H=2921:00 +CPU= 15.650
  10:38:46 STEP 2922 H=2922:00 +CPU= 26.858
  10:39:03 STEP 2923 H=2923:00 +CPU= 17.081
  10:39:21 STEP 2924 H=2924:00 +CPU= 16.982
  10:39:47 STEP 2925 H=2925:00 +CPU= 25.851
  10:40:04 STEP 2926 H=2926:00 +CPU= 16.693
  10:40:21 STEP 2927 H=2927:00 +CPU= 16.553
  10:40:51 STEP 2928 H=2928:00 +CPU= 29.681
Moving to projects directory: /home/galfridian/slots/5/ICMGGhq0f+002928
Moving to projects directory: /home/galfridian/slots/5/ICMSHhq0f+002928
Moving to projects directory: /home/galfridian/slots/5/ICMUAhq0f+002928
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMGGhq0f+002904
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMSHhq0f+002904
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMUAhq0f+002904
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMGGhq0f+002916
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMSHhq0f+002916
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMUAhq0f+002916
Zipping up the intermediate file: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_0206_2005050100_123_974_12190850_1_r1551377807_121.zip
Uploading the intermediate file: upload_file_121.zip
  10:41:07 STEP 2929 H=2929:00 +CPU= 15.121
  10:41:23 STEP 2930 H=2930:00 +CPU= 15.772
  10:41:48 STEP 2931 H=2931:00 +CPU= 24.282
  10:42:04 STEP 2932 H=2932:00 +CPU= 16.086
  10:42:20 STEP 2933 H=2933:00 +CPU= 15.733
  10:42:46 STEP 2934 H=2934:00 +CPU= 25.752
  10:43:02 STEP 2935 H=2935:00 +CPU= 15.761
  10:43:18 STEP 2936 H=2936:00 +CPU= 16.220
  10:43:43 STEP 2937 H=2937:00 +CPU= 24.269
  10:43:59 STEP 2938 H=2938:00 +CPU= 16.301
  10:44:15 STEP 2939 H=2939:00 +CPU= 16.182
  10:44:43 STEP 2940 H=2940:00 +CPU= 27.335
Moving to projects directory: /home/galfridian/slots/5/ICMGGhq0f+002940
Moving to projects directory: /home/galfridian/slots/5/ICMSHhq0f+002940
Moving to projects directory: /home/galfridian/slots/5/ICMUAhq0f+002940
  10:44:59 STEP 2941 H=2941:00 +CPU= 15.438
  10:45:15 STEP 2942 H=2942:00 +CPU= 16.326
  10:45:41 STEP 2943 H=2943:00 +CPU= 25.323
  10:45:59 STEP 2944 H=2944:00 +CPU= 17.554
  10:46:15 STEP 2945 H=2945:00 +CPU= 15.807
  10:46:41 STEP 2946 H=2946:00 +CPU= 25.203
  10:46:57 STEP 2947 H=2947:00 +CPU= 16.299
  10:47:15 STEP 2948 H=2948:00 +CPU= 17.670
  10:47:42 STEP 2949 H=2949:00 +CPU= 26.468
  10:47:59 STEP 2950 H=2950:00 +CPU= 16.858
  10:48:17 STEP 2951 H=2951:00 +CPU= 17.028
  10:48:47 STEP 2952 H=2952:00 +CPU= 29.083
The child process terminated with status: 0
Moving to projects directory: /home/galfridian/slots/5/ICMGGhq0f+002952
Moving to projects directory: /home/galfridian/slots/5/ICMSHhq0f+002952
Moving to projects directory: /home/galfridian/slots/5/ICMUAhq0f+002952
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMUAhq0f+002952
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMUAhq0f+002928
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMGGhq0f+002928
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMGGhq0f+002940
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMSHhq0f+002928
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMUAhq0f+002940
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMGGhq0f+002952
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMSHhq0f+002952
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12190850/ICMSHhq0f+002940
Zipping up the final file: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_0206_2005050100_123_974_12190850_1_r1551377807_122.zip
Uploading the final file: upload_file_122.zip
Uploading trickle at timestep: 10623600
10:52:10 (1903): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:52:32 1537623 22300888 oifs_43r3_ps_0206_2005050100_123_974_12190850_1 10,623,600 59,668 0.0056
09 May 2023 16:52:32 1537623 22300888 oifs_43r3_ps_0206_2005050100_123_974_12190850_1 10,022,400 56,361 0.0056
09 May 2023 16:52:32 1537623 22300888 oifs_43r3_ps_0206_2005050100_123_974_12190850_1 9,158,400 51,620 0.0056
09 May 2023 16:52:30 1537623 22300888 oifs_43r3_ps_0206_2005050100_123_974_12190850_1 7,603,200 42,759 0.0056
09 May 2023 16:52:30 1537623 22300888 oifs_43r3_ps_0206_2005050100_123_974_12190850_1 6,739,200 38,018 0.0056
09 May 2023 16:52:30 1537623 22300888 oifs_43r3_ps_0206_2005050100_123_974_12190850_1 5,875,200 33,290 0.0057
09 May 2023 16:52:27 1537623 22300888 oifs_43r3_ps_0206_2005050100_123_974_12190850_1 4,233,600 23,600 0.0056
09 May 2023 16:52:27 1537623 22300888 oifs_43r3_ps_0206_2005050100_123_974_12190850_1 3,369,600 18,810 0.0056
09 May 2023 16:52:27 1537623 22300888 oifs_43r3_ps_0206_2005050100_123_974_12190850_1 2,505,600 14,095 0.0056
09 May 2023 16:52:26 1537623 22300888 oifs_43r3_ps_0206_2005050100_123_974_12190850_1 1,641,600 9,387 0.0057


©2024 climateprediction.net