climateprediction.net home page
Task 22270068

Task 22270068

Name oifs_43r3_ps_0156_1999050100_123_968_12184800_0
Workunit 12184800
Created 22 Dec 2022, 18:05:14 UTC
Sent 31 Dec 2022, 6:29:00 UTC
Report deadline 30 Jan 2023, 6:29:00 UTC
Received 15 Jan 2023, 18:46:29 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1537623
Run time 14 hours 26 min 47 sec
CPU time 14 hours 17 min 49 sec
Validate state Valid
Credit 14,873.04
Device peak FLOPS 7.68 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,406.57 MB
Peak swap size 4,974.33 MB
Peak disk usage 1,428.96 MB
Stderr
<core_client_version>7.18.1</core_client_version>
<![CDATA[
<stderr_txt>
/slots/19/ICMGGhq0f+002304
Moving to projects directory: /home/galfridian/slots/19/ICMSHhq0f+002304
Moving to projects directory: /home/galfridian/slots/19/ICMUAhq0f+002304
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMGGhq0f+002280
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMSHhq0f+002280
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMUAhq0f+002280
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMGGhq0f+002292
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMSHhq0f+002292
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMUAhq0f+002292
Zipping up the intermediate file: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_0156_1999050100_123_968_12184800_0_r742267911_95.zip
Uploading the intermediate file: upload_file_95.zip
  16:27:34 STEP 2305 H=2305:00 +CPU= 15.047
  16:27:49 STEP 2306 H=2306:00 +CPU= 15.255
  16:28:11 STEP 2307 H=2307:00 +CPU= 22.256
  16:28:26 STEP 2308 H=2308:00 +CPU= 14.565
  16:28:40 STEP 2309 H=2309:00 +CPU= 14.190
  16:29:03 STEP 2310 H=2310:00 +CPU= 22.822
  16:29:17 STEP 2311 H=2311:00 +CPU= 13.967
  16:29:32 STEP 2312 H=2312:00 +CPU= 14.491
  16:29:54 STEP 2313 H=2313:00 +CPU= 21.926
  16:30:08 STEP 2314 H=2314:00 +CPU= 14.460
  16:30:23 STEP 2315 H=2315:00 +CPU= 14.031
  16:30:48 STEP 2316 H=2316:00 +CPU= 24.680
Moving to projects directory: /home/galfridian/slots/19/ICMGGhq0f+002316
Moving to projects directory: /home/galfridian/slots/19/ICMSHhq0f+002316
Moving to projects directory: /home/galfridian/slots/19/ICMUAhq0f+002316
  16:31:02 STEP 2317 H=2317:00 +CPU= 14.128
  16:31:17 STEP 2318 H=2318:00 +CPU= 15.054
  16:31:39 STEP 2319 H=2319:00 +CPU= 22.350
  16:31:54 STEP 2320 H=2320:00 +CPU= 14.089
  16:32:08 STEP 2321 H=2321:00 +CPU= 14.042
  16:32:31 STEP 2322 H=2322:00 +CPU= 23.078
  16:32:45 STEP 2323 H=2323:00 +CPU= 14.311
  16:33:00 STEP 2324 H=2324:00 +CPU= 14.635
  16:33:23 STEP 2325 H=2325:00 +CPU= 22.659
  16:33:37 STEP 2326 H=2326:00 +CPU= 14.282
  16:33:51 STEP 2327 H=2327:00 +CPU= 14.153
  16:34:18 STEP 2328 H=2328:00 +CPU= 26.217
Moving to projects directory: /home/galfridian/slots/19/ICMGGhq0f+002328
Moving to projects directory: /home/galfridian/slots/19/ICMSHhq0f+002328
Moving to projects directory: /home/galfridian/slots/19/ICMUAhq0f+002328
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMGGhq0f+002304
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMSHhq0f+002304
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMUAhq0f+002304
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMGGhq0f+002316
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMSHhq0f+002316
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMUAhq0f+002316
Zipping up the intermediate file: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_0156_1999050100_123_968_12184800_0_r742267911_96.zip
Uploading the intermediate file: upload_file_96.zip
  16:34:32 STEP 2329 H=2329:00 +CPU= 14.153
  16:34:47 STEP 2330 H=2330:00 +CPU= 14.659
  16:35:10 STEP 2331 H=2331:00 +CPU= 22.583
  16:35:24 STEP 2332 H=2332:00 +CPU= 14.814
  16:35:39 STEP 2333 H=2333:00 +CPU= 14.092
  16:36:01 STEP 2334 H=2334:00 +CPU= 22.560
  16:36:16 STEP 2335 H=2335:00 +CPU= 14.434
  16:36:31 STEP 2336 H=2336:00 +CPU= 15.319
  16:36:53 STEP 2337 H=2337:00 +CPU= 22.298
  16:37:08 STEP 2338 H=2338:00 +CPU= 14.132
  16:37:22 STEP 2339 H=2339:00 +CPU= 14.465
  16:37:48 STEP 2340 H=2340:00 +CPU= 25.301
Moving to projects directory: /home/galfridian/slots/19/ICMGGhq0f+002340
Moving to projects directory: /home/galfridian/slots/19/ICMSHhq0f+002340
Moving to projects directory: /home/galfridian/slots/19/ICMUAhq0f+002340
  16:38:02 STEP 2341 H=2341:00 +CPU= 14.154
  16:38:17 STEP 2342 H=2342:00 +CPU= 14.472
  16:38:39 STEP 2343 H=2343:00 +CPU= 22.165
  16:38:54 STEP 2344 H=2344:00 +CPU= 14.805
  16:39:08 STEP 2345 H=2345:00 +CPU= 13.896
  16:39:31 STEP 2346 H=2346:00 +CPU= 22.633
  16:39:45 STEP 2347 H=2347:00 +CPU= 14.347
  16:40:00 STEP 2348 H=2348:00 +CPU= 14.649
  16:40:22 STEP 2349 H=2349:00 +CPU= 22.437
  16:40:37 STEP 2350 H=2350:00 +CPU= 14.546
  16:40:52 STEP 2351 H=2351:00 +CPU= 14.964
  16:41:19 STEP 2352 H=2352:00 +CPU= 26.525
Moving to projects directory: /home/galfridian/slots/19/ICMGGhq0f+002352
Moving to projects directory: /home/galfridian/slots/19/ICMSHhq0f+002352
Moving to projects directory: /home/galfridian/slots/19/ICMUAhq0f+002352
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMGGhq0f+002328
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMSHhq0f+002328
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMUAhq0f+002328
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMGGhq0f+002340
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMSHhq0f+002340
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMUAhq0f+002340
Zipping up the intermediate file: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_0156_1999050100_123_968_12184800_0_r742267911_97.zip
Uploading the intermediate file: upload_file_97.zip
  16:41:33 STEP 2353 H=2353:00 +CPU= 13.994
  16:41:48 STEP 2354 H=2354:00 +CPU= 14.685
  16:42:10 STEP 2355 H=2355:00 +CPU= 22.507
  16:42:25 STEP 2356 H=2356:00 +CPU= 14.219
  16:42:38 STEP 2357 H=2357:00 +CPU= 13.698
  16:43:01 STEP 2358 H=2358:00 +CPU= 22.798
  16:43:16 STEP 2359 H=2359:00 +CPU= 14.180
  16:43:30 STEP 2360 H=2360:00 +CPU= 14.619
  16:43:53 STEP 2361 H=2361:00 +CPU= 22.683
  16:44:08 STEP 2362 H=2362:00 +CPU= 14.729
  16:44:23 STEP 2363 H=2363:00 +CPU= 14.345
  16:44:48 STEP 2364 H=2364:00 +CPU= 25.496
Moving to projects directory: /home/galfridian/slots/19/ICMGGhq0f+002364
Moving to projects directory: /home/galfridian/slots/19/ICMSHhq0f+002364
Moving to projects directory: /home/galfridian/slots/19/ICMUAhq0f+002364
  16:45:03 STEP 2365 H=2365:00 +CPU= 14.255
  16:45:17 STEP 2366 H=2366:00 +CPU= 14.572
  16:45:40 STEP 2367 H=2367:00 +CPU= 22.801
  16:45:55 STEP 2368 H=2368:00 +CPU= 15.137
  16:46:10 STEP 2369 H=2369:00 +CPU= 14.782
  16:46:34 STEP 2370 H=2370:00 +CPU= 23.708
  16:46:48 STEP 2371 H=2371:00 +CPU= 14.011
  16:47:03 STEP 2372 H=2372:00 +CPU= 14.904
  16:47:26 STEP 2373 H=2373:00 +CPU= 22.625
  16:47:41 STEP 2374 H=2374:00 +CPU= 14.831
  16:47:56 STEP 2375 H=2375:00 +CPU= 14.647
  16:48:23 STEP 2376 H=2376:00 +CPU= 26.936
Moving to projects directory: /home/galfridian/slots/19/ICMGGhq0f+002376
Moving to projects directory: /home/galfridian/slots/19/ICMSHhq0f+002376
Moving to projects directory: /home/galfridian/slots/19/ICMUAhq0f+002376
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMGGhq0f+002352
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMSHhq0f+002352
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMUAhq0f+002352
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMGGhq0f+002364
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMSHhq0f+002364
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMUAhq0f+002364
Zipping up the intermediate file: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_0156_1999050100_123_968_12184800_0_r742267911_98.zip
Uploading the intermediate file: upload_file_98.zip
  16:48:37 STEP 2377 H=2377:00 +CPU= 13.761
  16:48:51 STEP 2378 H=2378:00 +CPU= 14.652
  16:49:14 STEP 2379 H=2379:00 +CPU= 22.549
  16:49:29 STEP 2380 H=2380:00 +CPU= 14.834
  16:49:44 STEP 2381 H=2381:00 +CPU= 14.409
  16:50:07 STEP 2382 H=2382:00 +CPU= 23.289
  16:50:21 STEP 2383 H=2383:00 +CPU= 14.428
  16:50:36 STEP 2384 H=2384:00 +CPU= 14.620
  16:50:59 STEP 2385 H=2385:00 +CPU= 22.429
  16:51:14 STEP 2386 H=2386:00 +CPU= 14.679
  16:51:28 STEP 2387 H=2387:00 +CPU= 14.422
  16:51:54 STEP 2388 H=2388:00 +CPU= 25.714
Moving to projects directory: /home/galfridian/slots/19/ICMGGhq0f+002388
Moving to projects directory: /home/galfridian/slots/19/ICMSHhq0f+002388
Moving to projects directory: /home/galfridian/slots/19/ICMUAhq0f+002388
  16:52:08 STEP 2389 H=2389:00 +CPU= 14.360
  16:52:23 STEP 2390 H=2390:00 +CPU= 14.994
  16:52:47 STEP 2391 H=2391:00 +CPU= 23.114
  16:53:01 STEP 2392 H=2392:00 +CPU= 14.459
  16:53:16 STEP 2393 H=2393:00 +CPU= 14.447
  16:53:39 STEP 2394 H=2394:00 +CPU= 23.325
  16:53:54 STEP 2395 H=2395:00 +CPU= 14.857
  16:54:09 STEP 2396 H=2396:00 +CPU= 14.512
  16:54:31 STEP 2397 H=2397:00 +CPU= 21.976
  16:54:45 STEP 2398 H=2398:00 +CPU= 14.397
  16:54:59 STEP 2399 H=2399:00 +CPU= 14.297
  16:55:26 STEP 2400 H=2400:00 +CPU= 26.449
Moving to projects directory: /home/galfridian/slots/19/ICMGGhq0f+002400
Moving to projects directory: /home/galfridian/slots/19/ICMSHhq0f+002400
Moving to projects directory: /home/galfridian/slots/19/ICMUAhq0f+002400
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMGGhq0f+002376
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMSHhq0f+002376
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMUAhq0f+002376
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMGGhq0f+002388
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMSHhq0f+002388
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMUAhq0f+002388
Zipping up the intermediate file: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_0156_1999050100_123_968_12184800_0_r742267911_99.zip
Uploading the intermediate file: upload_file_99.zip
  16:55:40 STEP 2401 H=2401:00 +CPU= 13.989
Uploading trickle at timestep: 8640000
  16:55:55 STEP 2402 H=2402:00 +CPU= 14.880
  16:56:17 STEP 2403 H=2403:00 +CPU= 22.224
  16:56:32 STEP 2404 H=2404:00 +CPU= 14.660
  16:56:46 STEP 2405 H=2405:00 +CPU= 14.116
  16:57:09 STEP 2406 H=2406:00 +CPU= 22.883
  16:57:24 STEP 2407 H=2407:00 +CPU= 14.622
  16:57:39 STEP 2408 H=2408:00 +CPU= 14.908
  16:58:01 STEP 2409 H=2409:00 +CPU= 22.381
  16:58:16 STEP 2410 H=2410:00 +CPU= 14.831
  16:58:31 STEP 2411 H=2411:00 +CPU= 14.109
  16:58:57 STEP 2412 H=2412:00 +CPU= 25.659
Moving to projects directory: /home/galfridian/slots/19/ICMGGhq0f+002412
Moving to projects directory: /home/galfridian/slots/19/ICMSHhq0f+002412
Moving to projects directory: /home/galfridian/slots/19/ICMUAhq0f+002412
  16:59:11 STEP 2413 H=2413:00 +CPU= 14.494
  16:59:26 STEP 2414 H=2414:00 +CPU= 14.715
  16:59:48 STEP 2415 H=2415:00 +CPU= 22.307
  17:00:03 STEP 2416 H=2416:00 +CPU= 14.637
  17:00:18 STEP 2417 H=2417:00 +CPU= 14.608
  17:00:40 STEP 2418 H=2418:00 +CPU= 22.611
  17:00:55 STEP 2419 H=2419:00 +CPU= 14.142
  17:01:10 STEP 2420 H=2420:00 +CPU= 14.849
  17:01:33 STEP 2421 H=2421:00 +CPU= 22.375
  17:01:47 STEP 2422 H=2422:00 +CPU= 14.448
  17:02:02 STEP 2423 H=2423:00 +CPU= 14.311
  17:02:28 STEP 2424 H=2424:00 +CPU= 26.404
Moving to projects directory: /home/galfridian/slots/19/ICMGGhq0f+002424
Moving to projects directory: /home/galfridian/slots/19/ICMSHhq0f+002424
Moving to projects directory: /home/galfridian/slots/19/ICMUAhq0f+002424
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMGGhq0f+002400
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMSHhq0f+002400
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMUAhq0f+002400
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMGGhq0f+002412
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMSHhq0f+002412
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMUAhq0f+002412
Zipping up the intermediate file: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_0156_1999050100_123_968_12184800_0_r742267911_100.zip
Uploading the intermediate file: upload_file_100.zip
  17:02:43 STEP 2425 H=2425:00 +CPU= 14.357
  17:02:57 STEP 2426 H=2426:00 +CPU= 14.493
  17:03:20 STEP 2427 H=2427:00 +CPU= 22.198
  17:03:35 STEP 2428 H=2428:00 +CPU= 14.858
  17:03:49 STEP 2429 H=2429:00 +CPU= 14.304
  17:04:12 STEP 2430 H=2430:00 +CPU= 23.100
  17:04:26 STEP 2431 H=2431:00 +CPU= 14.024
  17:04:41 STEP 2432 H=2432:00 +CPU= 14.413
  17:05:03 STEP 2433 H=2433:00 +CPU= 22.423
  17:05:18 STEP 2434 H=2434:00 +CPU= 14.671
  17:05:32 STEP 2435 H=2435:00 +CPU= 14.164
  17:05:57 STEP 2436 H=2436:00 +CPU= 24.762
Moving to projects directory: /home/galfridian/slots/19/ICMGGhq0f+002436
Moving to projects directory: /home/galfridian/slots/19/ICMSHhq0f+002436
Moving to projects directory: /home/galfridian/slots/19/ICMUAhq0f+002436
  17:06:12 STEP 2437 H=2437:00 +CPU= 14.069
  17:06:26 STEP 2438 H=2438:00 +CPU= 14.723
  17:06:49 STEP 2439 H=2439:00 +CPU= 22.282
  17:07:03 STEP 2440 H=2440:00 +CPU= 14.561
  17:07:18 STEP 2441 H=2441:00 +CPU= 14.099
  17:07:41 STEP 2442 H=2442:00 +CPU= 22.871
  17:07:55 STEP 2443 H=2443:00 +CPU= 13.973
  17:08:09 STEP 2444 H=2444:00 +CPU= 14.615
  17:08:32 STEP 2445 H=2445:00 +CPU= 22.389
  17:08:47 STEP 2446 H=2446:00 +CPU= 14.466
  17:09:02 STEP 2447 H=2447:00 +CPU= 15.070
  17:09:29 STEP 2448 H=2448:00 +CPU= 26.662
Moving to projects directory: /home/galfridian/slots/19/ICMGGhq0f+002448
Moving to projects directory: /home/galfridian/slots/19/ICMSHhq0f+002448
Moving to projects directory: /home/galfridian/slots/19/ICMUAhq0f+002448
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMGGhq0f+002424
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMSHhq0f+002424
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMUAhq0f+002424
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMGGhq0f+002436
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMSHhq0f+002436
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMUAhq0f+002436
Zipping up the intermediate file: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_0156_1999050100_123_968_12184800_0_r742267911_101.zip
Uploading the intermediate file: upload_file_101.zip
  17:09:43 STEP 2449 H=2449:00 +CPU= 14.342
  17:09:58 STEP 2450 H=2450:00 +CPU= 14.741
  17:10:21 STEP 2451 H=2451:00 +CPU= 22.801
  17:10:35 STEP 2452 H=2452:00 +CPU= 14.541
  17:10:50 STEP 2453 H=2453:00 +CPU= 14.402
  17:11:13 STEP 2454 H=2454:00 +CPU= 23.220
  17:11:28 STEP 2455 H=2455:00 +CPU= 14.292
  17:11:42 STEP 2456 H=2456:00 +CPU= 14.402
  17:12:05 STEP 2457 H=2457:00 +CPU= 22.467
  17:12:20 STEP 2458 H=2458:00 +CPU= 14.631
  17:12:34 STEP 2459 H=2459:00 +CPU= 14.369
  17:12:59 STEP 2460 H=2460:00 +CPU= 25.486
Moving to projects directory: /home/galfridian/slots/19/ICMGGhq0f+002460
Moving to projects directory: /home/galfridian/slots/19/ICMSHhq0f+002460
Moving to projects directory: /home/galfridian/slots/19/ICMUAhq0f+002460
  17:13:14 STEP 2461 H=2461:00 +CPU= 14.268
  17:13:28 STEP 2462 H=2462:00 +CPU= 14.622
  17:13:51 STEP 2463 H=2463:00 +CPU= 22.337
  17:14:06 STEP 2464 H=2464:00 +CPU= 14.596
  17:14:20 STEP 2465 H=2465:00 +CPU= 14.518
  17:14:43 STEP 2466 H=2466:00 +CPU= 22.853
  17:14:58 STEP 2467 H=2467:00 +CPU= 14.095
  17:15:12 STEP 2468 H=2468:00 +CPU= 14.555
  17:15:35 STEP 2469 H=2469:00 +CPU= 22.323
  17:15:50 STEP 2470 H=2470:00 +CPU= 14.448
  17:16:04 STEP 2471 H=2471:00 +CPU= 14.668
  17:16:32 STEP 2472 H=2472:00 +CPU= 26.996
Moving to projects directory: /home/galfridian/slots/19/ICMGGhq0f+002472
Moving to projects directory: /home/galfridian/slots/19/ICMSHhq0f+002472
Moving to projects directory: /home/galfridian/slots/19/ICMUAhq0f+002472
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMGGhq0f+002448
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMSHhq0f+002448
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMUAhq0f+002448
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMGGhq0f+002460
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMSHhq0f+002460
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMUAhq0f+002460
Zipping up the intermediate file: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_0156_1999050100_123_968_12184800_0_r742267911_102.zip
Uploading the intermediate file: upload_file_102.zip
  17:16:46 STEP 2473 H=2473:00 +CPU= 14.128
  17:17:01 STEP 2474 H=2474:00 +CPU= 14.699
  17:17:24 STEP 2475 H=2475:00 +CPU= 22.703
  17:17:38 STEP 2476 H=2476:00 +CPU= 14.345
  17:17:52 STEP 2477 H=2477:00 +CPU= 13.837
  17:18:15 STEP 2478 H=2478:00 +CPU= 22.689
  17:18:29 STEP 2479 H=2479:00 +CPU= 14.411
  17:18:44 STEP 2480 H=2480:00 +CPU= 14.858
  17:19:07 STEP 2481 H=2481:00 +CPU= 22.255
  17:19:22 STEP 2482 H=2482:00 +CPU= 14.810
  17:19:36 STEP 2483 H=2483:00 +CPU= 14.414
  17:20:02 STEP 2484 H=2484:00 +CPU= 25.383
Moving to projects directory: /home/galfridian/slots/19/ICMGGhq0f+002484
Moving to projects directory: /home/galfridian/slots/19/ICMSHhq0f+002484
Moving to projects directory: /home/galfridian/slots/19/ICMUAhq0f+002484
  17:20:16 STEP 2485 H=2485:00 +CPU= 14.416
  17:20:31 STEP 2486 H=2486:00 +CPU= 14.510
  17:20:53 STEP 2487 H=2487:00 +CPU= 22.319
  17:21:08 STEP 2488 H=2488:00 +CPU= 14.476
  17:21:22 STEP 2489 H=2489:00 +CPU= 13.786
  17:21:44 STEP 2490 H=2490:00 +CPU= 22.692
  17:21:59 STEP 2491 H=2491:00 +CPU= 14.189
  17:22:13 STEP 2492 H=2492:00 +CPU= 14.739
  17:22:36 STEP 2493 H=2493:00 +CPU= 22.463
  17:22:50 STEP 2494 H=2494:00 +CPU= 14.388
  17:23:05 STEP 2495 H=2495:00 +CPU= 14.724
  17:23:32 STEP 2496 H=2496:00 +CPU= 26.294
Moving to projects directory: /home/galfridian/slots/19/ICMGGhq0f+002496
Moving to projects directory: /home/galfridian/slots/19/ICMSHhq0f+002496
Moving to projects directory: /home/galfridian/slots/19/ICMUAhq0f+002496
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMGGhq0f+002472
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMSHhq0f+002472
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMUAhq0f+002472
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMGGhq0f+002484
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMSHhq0f+002484
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMUAhq0f+002484
Zipping up the intermediate file: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_0156_1999050100_123_968_12184800_0_r742267911_103.zip
Uploading the intermediate file: upload_file_103.zip
  17:23:45 STEP 2497 H=2497:00 +CPU= 13.475
  17:23:59 STEP 2498 H=2498:00 +CPU= 14.149
  17:24:21 STEP 2499 H=2499:00 +CPU= 22.020
  17:24:35 STEP 2500 H=2500:00 +CPU= 13.958
  17:24:50 STEP 2501 H=2501:00 +CPU= 14.350
  17:25:12 STEP 2502 H=2502:00 +CPU= 21.961
  17:25:25 STEP 2503 H=2503:00 +CPU= 13.264
  17:25:39 STEP 2504 H=2504:00 +CPU= 13.825
  17:26:00 STEP 2505 H=2505:00 +CPU= 21.467
  17:26:15 STEP 2506 H=2506:00 +CPU= 14.352
  17:26:29 STEP 2507 H=2507:00 +CPU= 13.717
  17:26:53 STEP 2508 H=2508:00 +CPU= 24.421
Moving to projects directory: /home/galfridian/slots/19/ICMGGhq0f+002508
Moving to projects directory: /home/galfridian/slots/19/ICMSHhq0f+002508
Moving to projects directory: /home/galfridian/slots/19/ICMUAhq0f+002508
  17:27:06 STEP 2509 H=2509:00 +CPU= 13.432
  17:27:21 STEP 2510 H=2510:00 +CPU= 14.258
  17:27:42 STEP 2511 H=2511:00 +CPU= 21.497
  17:27:57 STEP 2512 H=2512:00 +CPU= 14.662
  17:28:11 STEP 2513 H=2513:00 +CPU= 13.951
  17:28:34 STEP 2514 H=2514:00 +CPU= 22.521
  17:28:48 STEP 2515 H=2515:00 +CPU= 14.071
  17:29:02 STEP 2516 H=2516:00 +CPU= 14.637
  17:29:25 STEP 2517 H=2517:00 +CPU= 22.527
  17:29:39 STEP 2518 H=2518:00 +CPU= 14.003
  17:29:53 STEP 2519 H=2519:00 +CPU= 14.143
  17:30:20 STEP 2520 H=2520:00 +CPU= 26.561
Moving to projects directory: /home/galfridian/slots/19/ICMGGhq0f+002520
Moving to projects directory: /home/galfridian/slots/19/ICMSHhq0f+002520
Moving to projects directory: /home/galfridian/slots/19/ICMUAhq0f+002520
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMGGhq0f+002496
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMSHhq0f+002496
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMUAhq0f+002496
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMGGhq0f+002508
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMSHhq0f+002508
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMUAhq0f+002508
Zipping up the intermediate file: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_0156_1999050100_123_968_12184800_0_r742267911_104.zip
Uploading the intermediate file: upload_file_104.zip
  17:30:34 STEP 2521 H=2521:00 +CPU= 13.691
  17:30:49 STEP 2522 H=2522:00 +CPU= 14.972
  17:31:11 STEP 2523 H=2523:00 +CPU= 22.112
  17:31:25 STEP 2524 H=2524:00 +CPU= 14.019
  17:31:39 STEP 2525 H=2525:00 +CPU= 13.957
  17:32:01 STEP 2526 H=2526:00 +CPU= 22.256
  17:32:16 STEP 2527 H=2527:00 +CPU= 14.611
  17:32:31 STEP 2528 H=2528:00 +CPU= 14.928
  17:32:53 STEP 2529 H=2529:00 +CPU= 22.443
  17:33:08 STEP 2530 H=2530:00 +CPU= 14.670
  17:33:22 STEP 2531 H=2531:00 +CPU= 14.062
  17:33:47 STEP 2532 H=2532:00 +CPU= 24.923
Moving to projects directory: /home/galfridian/slots/19/ICMGGhq0f+002532
Moving to projects directory: /home/galfridian/slots/19/ICMSHhq0f+002532
Moving to projects directory: /home/galfridian/slots/19/ICMUAhq0f+002532
  17:34:02 STEP 2533 H=2533:00 +CPU= 14.335
  17:34:16 STEP 2534 H=2534:00 +CPU= 14.661
  17:34:38 STEP 2535 H=2535:00 +CPU= 21.988
  17:34:53 STEP 2536 H=2536:00 +CPU= 14.294
  17:35:07 STEP 2537 H=2537:00 +CPU= 13.936
  17:35:29 STEP 2538 H=2538:00 +CPU= 22.331
  17:35:43 STEP 2539 H=2539:00 +CPU= 13.676
  17:35:56 STEP 2540 H=2540:00 +CPU= 13.359
  17:36:18 STEP 2541 H=2541:00 +CPU= 21.977
  17:36:32 STEP 2542 H=2542:00 +CPU= 14.164
  17:36:47 STEP 2543 H=2543:00 +CPU= 14.592
  17:37:14 STEP 2544 H=2544:00 +CPU= 26.749
Moving to projects directory: /home/galfridian/slots/19/ICMGGhq0f+002544
Moving to projects directory: /home/galfridian/slots/19/ICMSHhq0f+002544
Moving to projects directory: /home/galfridian/slots/19/ICMUAhq0f+002544
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMGGhq0f+002520
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMSHhq0f+002520
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMUAhq0f+002520
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMGGhq0f+002532
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMSHhq0f+002532
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMUAhq0f+002532
Zipping up the intermediate file: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_0156_1999050100_123_968_12184800_0_r742267911_105.zip
Uploading the intermediate file: upload_file_105.zip
  17:37:28 STEP 2545 H=2545:00 +CPU= 14.088
  17:37:43 STEP 2546 H=2546:00 +CPU= 14.806
  17:38:05 STEP 2547 H=2547:00 +CPU= 22.325
  17:38:20 STEP 2548 H=2548:00 +CPU= 14.220
  17:38:34 STEP 2549 H=2549:00 +CPU= 14.070
  17:38:57 STEP 2550 H=2550:00 +CPU= 22.667
  17:39:12 STEP 2551 H=2551:00 +CPU= 14.431
  17:39:26 STEP 2552 H=2552:00 +CPU= 14.352
  17:39:49 STEP 2553 H=2553:00 +CPU= 22.522
  17:40:03 STEP 2554 H=2554:00 +CPU= 14.430
  17:40:17 STEP 2555 H=2555:00 +CPU= 13.794
  17:40:43 STEP 2556 H=2556:00 +CPU= 25.170
Moving to projects directory: /home/galfridian/slots/19/ICMGGhq0f+002556
Moving to projects directory: /home/galfridian/slots/19/ICMSHhq0f+002556
Moving to projects directory: /home/galfridian/slots/19/ICMUAhq0f+002556
  17:40:57 STEP 2557 H=2557:00 +CPU= 14.048
  17:41:11 STEP 2558 H=2558:00 +CPU= 14.738
  17:41:34 STEP 2559 H=2559:00 +CPU= 23.017
  17:41:49 STEP 2560 H=2560:00 +CPU= 14.798
  17:42:03 STEP 2561 H=2561:00 +CPU= 14.112
  17:42:26 STEP 2562 H=2562:00 +CPU= 22.894
  17:42:40 STEP 2563 H=2563:00 +CPU= 13.704
  17:42:54 STEP 2564 H=2564:00 +CPU= 14.317
  17:43:17 STEP 2565 H=2565:00 +CPU= 22.370
  17:43:31 STEP 2566 H=2566:00 +CPU= 14.359
  17:43:46 STEP 2567 H=2567:00 +CPU= 14.715
  17:44:13 STEP 2568 H=2568:00 +CPU= 26.528
Moving to projects directory: /home/galfridian/slots/19/ICMGGhq0f+002568
Moving to projects directory: /home/galfridian/slots/19/ICMSHhq0f+002568
Moving to projects directory: /home/galfridian/slots/19/ICMUAhq0f+002568
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMGGhq0f+002544
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMSHhq0f+002544
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMUAhq0f+002544
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMGGhq0f+002556
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMSHhq0f+002556
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMUAhq0f+002556
Zipping up the intermediate file: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_0156_1999050100_123_968_12184800_0_r742267911_106.zip
Uploading the intermediate file: upload_file_106.zip
  17:44:26 STEP 2569 H=2569:00 +CPU= 13.650
  17:44:40 STEP 2570 H=2570:00 +CPU= 14.117
  17:45:03 STEP 2571 H=2571:00 +CPU= 22.472
  17:45:18 STEP 2572 H=2572:00 +CPU= 14.480
  17:45:31 STEP 2573 H=2573:00 +CPU= 13.837
  17:45:54 STEP 2574 H=2574:00 +CPU= 22.804
  17:46:09 STEP 2575 H=2575:00 +CPU= 14.531
  17:46:24 STEP 2576 H=2576:00 +CPU= 14.894
  17:46:46 STEP 2577 H=2577:00 +CPU= 22.432
  17:47:01 STEP 2578 H=2578:00 +CPU= 14.564
  17:47:15 STEP 2579 H=2579:00 +CPU= 14.108
  17:47:40 STEP 2580 H=2580:00 +CPU= 24.836
Moving to projects directory: /home/galfridian/slots/19/ICMGGhq0f+002580
Moving to projects directory: /home/galfridian/slots/19/ICMSHhq0f+002580
Moving to projects directory: /home/galfridian/slots/19/ICMUAhq0f+002580
  17:47:54 STEP 2581 H=2581:00 +CPU= 14.038
  17:48:08 STEP 2582 H=2582:00 +CPU= 14.318
  17:48:31 STEP 2583 H=2583:00 +CPU= 22.437
  17:48:46 STEP 2584 H=2584:00 +CPU= 14.692
  17:49:00 STEP 2585 H=2585:00 +CPU= 14.284
  17:49:23 STEP 2586 H=2586:00 +CPU= 23.049
  17:49:37 STEP 2587 H=2587:00 +CPU= 14.017
  17:49:52 STEP 2588 H=2588:00 +CPU= 14.444
  17:50:14 STEP 2589 H=2589:00 +CPU= 22.227
  17:50:29 STEP 2590 H=2590:00 +CPU= 14.746
  17:50:43 STEP 2591 H=2591:00 +CPU= 14.270
  17:51:10 STEP 2592 H=2592:00 +CPU= 26.842
Moving to projects directory: /home/galfridian/slots/19/ICMGGhq0f+002592
Moving to projects directory: /home/galfridian/slots/19/ICMSHhq0f+002592
Moving to projects directory: /home/galfridian/slots/19/ICMUAhq0f+002592
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMGGhq0f+002568
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMSHhq0f+002568
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMUAhq0f+002568
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMGGhq0f+002580
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMSHhq0f+002580
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMUAhq0f+002580
Zipping up the intermediate file: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_0156_1999050100_123_968_12184800_0_r742267911_107.zip
Uploading the intermediate file: upload_file_107.zip
  17:51:24 STEP 2593 H=2593:00 +CPU= 14.016
  17:51:39 STEP 2594 H=2594:00 +CPU= 14.514
  17:52:01 STEP 2595 H=2595:00 +CPU= 22.586
  17:52:16 STEP 2596 H=2596:00 +CPU= 14.592
  17:52:30 STEP 2597 H=2597:00 +CPU= 14.208
  17:52:53 STEP 2598 H=2598:00 +CPU= 22.667
  17:53:07 STEP 2599 H=2599:00 +CPU= 13.880
  17:53:21 STEP 2600 H=2600:00 +CPU= 14.619
  17:53:44 STEP 2601 H=2601:00 +CPU= 22.168
  17:53:58 STEP 2602 H=2602:00 +CPU= 14.262
  17:54:12 STEP 2603 H=2603:00 +CPU= 14.153
  17:54:37 STEP 2604 H=2604:00 +CPU= 24.989
Moving to projects directory: /home/galfridian/slots/19/ICMGGhq0f+002604
Moving to projects directory: /home/galfridian/slots/19/ICMSHhq0f+002604
Moving to projects directory: /home/galfridian/slots/19/ICMUAhq0f+002604
  17:54:51 STEP 2605 H=2605:00 +CPU= 14.264
  17:55:06 STEP 2606 H=2606:00 +CPU= 14.280
  17:55:28 STEP 2607 H=2607:00 +CPU= 22.248
  17:55:42 STEP 2608 H=2608:00 +CPU= 14.060
  17:55:56 STEP 2609 H=2609:00 +CPU= 14.082
  17:56:19 STEP 2610 H=2610:00 +CPU= 22.709
  17:56:33 STEP 2611 H=2611:00 +CPU= 14.105
  17:56:48 STEP 2612 H=2612:00 +CPU= 14.574
  17:57:10 STEP 2613 H=2613:00 +CPU= 22.469
  17:57:25 STEP 2614 H=2614:00 +CPU= 14.446
  17:57:40 STEP 2615 H=2615:00 +CPU= 14.927
  17:58:06 STEP 2616 H=2616:00 +CPU= 26.599
Moving to projects directory: /home/galfridian/slots/19/ICMGGhq0f+002616
Moving to projects directory: /home/galfridian/slots/19/ICMSHhq0f+002616
Moving to projects directory: /home/galfridian/slots/19/ICMUAhq0f+002616
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMGGhq0f+002592
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMSHhq0f+002592
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMUAhq0f+002592
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMGGhq0f+002604
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMSHhq0f+002604
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMUAhq0f+002604
Zipping up the intermediate file: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_0156_1999050100_123_968_12184800_0_r742267911_108.zip
Uploading the intermediate file: upload_file_108.zip
  17:58:21 STEP 2617 H=2617:00 +CPU= 14.013
  17:58:35 STEP 2618 H=2618:00 +CPU= 14.248
  17:58:57 STEP 2619 H=2619:00 +CPU= 21.830
  17:59:12 STEP 2620 H=2620:00 +CPU= 14.536
  17:59:26 STEP 2621 H=2621:00 +CPU= 14.367
  17:59:49 STEP 2622 H=2622:00 +CPU= 22.768
  18:00:03 STEP 2623 H=2623:00 +CPU= 14.378
  18:00:18 STEP 2624 H=2624:00 +CPU= 14.641
  18:00:41 STEP 2625 H=2625:00 +CPU= 22.268
  18:00:55 STEP 2626 H=2626:00 +CPU= 14.363
  18:01:09 STEP 2627 H=2627:00 +CPU= 14.052
  18:01:34 STEP 2628 H=2628:00 +CPU= 24.885
Moving to projects directory: /home/galfridian/slots/19/ICMGGhq0f+002628
Moving to projects directory: /home/galfridian/slots/19/ICMSHhq0f+002628
Moving to projects directory: /home/galfridian/slots/19/ICMUAhq0f+002628
  18:01:48 STEP 2629 H=2629:00 +CPU= 14.150
  18:02:03 STEP 2630 H=2630:00 +CPU= 14.696
  18:02:25 STEP 2631 H=2631:00 +CPU= 22.451
  18:02:40 STEP 2632 H=2632:00 +CPU= 14.714
  18:02:54 STEP 2633 H=2633:00 +CPU= 14.026
  18:03:17 STEP 2634 H=2634:00 +CPU= 22.696
  18:03:31 STEP 2635 H=2635:00 +CPU= 13.962
  18:03:45 STEP 2636 H=2636:00 +CPU= 14.352
  18:04:08 STEP 2637 H=2637:00 +CPU= 22.429
  18:04:23 STEP 2638 H=2638:00 +CPU= 14.795
  18:04:38 STEP 2639 H=2639:00 +CPU= 14.649
  18:05:05 STEP 2640 H=2640:00 +CPU= 26.711
Moving to projects directory: /home/galfridian/slots/19/ICMGGhq0f+002640
Moving to projects directory: /home/galfridian/slots/19/ICMSHhq0f+002640
Moving to projects directory: /home/galfridian/slots/19/ICMUAhq0f+002640
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMGGhq0f+002616
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMSHhq0f+002616
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMUAhq0f+002616
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMGGhq0f+002628
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMSHhq0f+002628
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMUAhq0f+002628
Zipping up the intermediate file: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_0156_1999050100_123_968_12184800_0_r742267911_109.zip
Uploading the intermediate file: upload_file_109.zip
  18:05:19 STEP 2641 H=2641:00 +CPU= 14.476
  18:05:34 STEP 2642 H=2642:00 +CPU= 14.499
Uploading trickle at timestep: 9504000
  18:05:56 STEP 2643 H=2643:00 +CPU= 22.662
  18:06:11 STEP 2644 H=2644:00 +CPU= 14.192
  18:06:24 STEP 2645 H=2645:00 +CPU= 13.869
  18:06:47 STEP 2646 H=2646:00 +CPU= 22.487
  18:07:01 STEP 2647 H=2647:00 +CPU= 14.472
  18:07:16 STEP 2648 H=2648:00 +CPU= 14.275
  18:07:38 STEP 2649 H=2649:00 +CPU= 21.990
  18:07:52 STEP 2650 H=2650:00 +CPU= 14.436
  18:08:06 STEP 2651 H=2651:00 +CPU= 14.028
  18:08:32 STEP 2652 H=2652:00 +CPU= 25.216
Moving to projects directory: /home/galfridian/slots/19/ICMGGhq0f+002652
Moving to projects directory: /home/galfridian/slots/19/ICMSHhq0f+002652
Moving to projects directory: /home/galfridian/slots/19/ICMUAhq0f+002652
  18:08:46 STEP 2653 H=2653:00 +CPU= 14.131
  18:09:01 STEP 2654 H=2654:00 +CPU= 14.508
  18:09:23 STEP 2655 H=2655:00 +CPU= 22.315
  18:09:38 STEP 2656 H=2656:00 +CPU= 14.520
  18:09:52 STEP 2657 H=2657:00 +CPU= 14.296
  18:10:15 STEP 2658 H=2658:00 +CPU= 22.413
  18:10:29 STEP 2659 H=2659:00 +CPU= 14.196
  18:10:44 STEP 2660 H=2660:00 +CPU= 14.955
  18:11:06 STEP 2661 H=2661:00 +CPU= 22.187
  18:11:21 STEP 2662 H=2662:00 +CPU= 14.473
  18:11:35 STEP 2663 H=2663:00 +CPU= 14.309
  18:12:02 STEP 2664 H=2664:00 +CPU= 26.303
Moving to projects directory: /home/galfridian/slots/19/ICMGGhq0f+002664
Moving to projects directory: /home/galfridian/slots/19/ICMSHhq0f+002664
Moving to projects directory: /home/galfridian/slots/19/ICMUAhq0f+002664
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMGGhq0f+002640
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMSHhq0f+002640
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMUAhq0f+002640
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMGGhq0f+002652
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMSHhq0f+002652
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMUAhq0f+002652
Zipping up the intermediate file: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_0156_1999050100_123_968_12184800_0_r742267911_110.zip
Uploading the intermediate file: upload_file_110.zip
  18:12:16 STEP 2665 H=2665:00 +CPU= 14.003
  18:12:31 STEP 2666 H=2666:00 +CPU= 14.976
  18:12:54 STEP 2667 H=2667:00 +CPU= 22.737
  18:13:08 STEP 2668 H=2668:00 +CPU= 14.373
  18:13:22 STEP 2669 H=2669:00 +CPU= 13.746
  18:13:44 STEP 2670 H=2670:00 +CPU= 22.190
  18:13:58 STEP 2671 H=2671:00 +CPU= 14.165
  18:14:13 STEP 2672 H=2672:00 +CPU= 14.764
  18:14:36 STEP 2673 H=2673:00 +CPU= 22.321
  18:14:50 STEP 2674 H=2674:00 +CPU= 14.564
  18:15:04 STEP 2675 H=2675:00 +CPU= 13.924
  18:15:29 STEP 2676 H=2676:00 +CPU= 24.463
Moving to projects directory: /home/galfridian/slots/19/ICMGGhq0f+002676
Moving to projects directory: /home/galfridian/slots/19/ICMSHhq0f+002676
Moving to projects directory: /home/galfridian/slots/19/ICMUAhq0f+002676
  18:15:43 STEP 2677 H=2677:00 +CPU= 14.048
  18:15:58 STEP 2678 H=2678:00 +CPU= 14.700
  18:16:20 STEP 2679 H=2679:00 +CPU= 22.069
  18:16:34 STEP 2680 H=2680:00 +CPU= 14.632
  18:16:49 STEP 2681 H=2681:00 +CPU= 14.504
  18:17:12 STEP 2682 H=2682:00 +CPU= 22.573
  18:17:26 STEP 2683 H=2683:00 +CPU= 14.148
  18:17:41 STEP 2684 H=2684:00 +CPU= 14.757
  18:18:03 STEP 2685 H=2685:00 +CPU= 22.712
  18:18:18 STEP 2686 H=2686:00 +CPU= 14.598
  18:18:33 STEP 2687 H=2687:00 +CPU= 15.126
  18:19:00 STEP 2688 H=2688:00 +CPU= 26.397
Moving to projects directory: /home/galfridian/slots/19/ICMGGhq0f+002688
Moving to projects directory: /home/galfridian/slots/19/ICMSHhq0f+002688
Moving to projects directory: /home/galfridian/slots/19/ICMUAhq0f+002688
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMGGhq0f+002664
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMSHhq0f+002664
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMUAhq0f+002664
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMGGhq0f+002676
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMSHhq0f+002676
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMUAhq0f+002676
Zipping up the intermediate file: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_0156_1999050100_123_968_12184800_0_r742267911_111.zip
Uploading the intermediate file: upload_file_111.zip
  18:19:14 STEP 2689 H=2689:00 +CPU= 13.885
  18:19:28 STEP 2690 H=2690:00 +CPU= 14.371
  18:19:50 STEP 2691 H=2691:00 +CPU= 21.846
  18:20:05 STEP 2692 H=2692:00 +CPU= 14.730
  18:20:19 STEP 2693 H=2693:00 +CPU= 14.421
  18:20:42 STEP 2694 H=2694:00 +CPU= 22.631
  18:20:56 STEP 2695 H=2695:00 +CPU= 13.749
  18:21:10 STEP 2696 H=2696:00 +CPU= 14.405
  18:21:33 STEP 2697 H=2697:00 +CPU= 22.561
  18:21:48 STEP 2698 H=2698:00 +CPU= 15.033
  18:22:02 STEP 2699 H=2699:00 +CPU= 14.341
  18:22:27 STEP 2700 H=2700:00 +CPU= 24.819
Moving to projects directory: /home/galfridian/slots/19/ICMGGhq0f+002700
Moving to projects directory: /home/galfridian/slots/19/ICMSHhq0f+002700
Moving to projects directory: /home/galfridian/slots/19/ICMUAhq0f+002700
  18:22:42 STEP 2701 H=2701:00 +CPU= 14.219
  18:22:57 STEP 2702 H=2702:00 +CPU= 15.048
  18:23:19 STEP 2703 H=2703:00 +CPU= 22.524
  18:23:34 STEP 2704 H=2704:00 +CPU= 14.780
  18:23:49 STEP 2705 H=2705:00 +CPU= 14.230
  18:24:12 STEP 2706 H=2706:00 +CPU= 23.134
  18:24:26 STEP 2707 H=2707:00 +CPU= 14.415
  18:24:41 STEP 2708 H=2708:00 +CPU= 14.504
  18:25:03 STEP 2709 H=2709:00 +CPU= 21.924
  18:25:18 STEP 2710 H=2710:00 +CPU= 15.211
  18:25:34 STEP 2711 H=2711:00 +CPU= 15.387
  18:26:01 STEP 2712 H=2712:00 +CPU= 26.969
Moving to projects directory: /home/galfridian/slots/19/ICMGGhq0f+002712
Moving to projects directory: /home/galfridian/slots/19/ICMSHhq0f+002712
Moving to projects directory: /home/galfridian/slots/19/ICMUAhq0f+002712
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMGGhq0f+002688
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMSHhq0f+002688
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMUAhq0f+002688
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMGGhq0f+002700
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMSHhq0f+002700
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMUAhq0f+002700
Zipping up the intermediate file: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_0156_1999050100_123_968_12184800_0_r742267911_112.zip
Uploading the intermediate file: upload_file_112.zip
  18:26:15 STEP 2713 H=2713:00 +CPU= 13.696
  18:26:29 STEP 2714 H=2714:00 +CPU= 14.548
  18:26:52 STEP 2715 H=2715:00 +CPU= 22.646
  18:27:07 STEP 2716 H=2716:00 +CPU= 14.547
  18:27:21 STEP 2717 H=2717:00 +CPU= 14.300
  18:27:44 STEP 2718 H=2718:00 +CPU= 22.692
  18:27:59 STEP 2719 H=2719:00 +CPU= 14.343
  18:28:13 STEP 2720 H=2720:00 +CPU= 14.693
  18:28:36 STEP 2721 H=2721:00 +CPU= 22.516
  18:28:51 STEP 2722 H=2722:00 +CPU= 14.916
  18:29:06 STEP 2723 H=2723:00 +CPU= 14.363
  18:29:30 STEP 2724 H=2724:00 +CPU= 24.436
Moving to projects directory: /home/galfridian/slots/19/ICMGGhq0f+002724
Moving to projects directory: /home/galfridian/slots/19/ICMSHhq0f+002724
Moving to projects directory: /home/galfridian/slots/19/ICMUAhq0f+002724
  18:29:45 STEP 2725 H=2725:00 +CPU= 14.481
  18:30:00 STEP 2726 H=2726:00 +CPU= 14.477
  18:30:22 STEP 2727 H=2727:00 +CPU= 22.398
  18:30:37 STEP 2728 H=2728:00 +CPU= 14.795
  18:30:52 STEP 2729 H=2729:00 +CPU= 14.818
  18:31:15 STEP 2730 H=2730:00 +CPU= 22.967
  18:31:29 STEP 2731 H=2731:00 +CPU= 14.208
  18:31:44 STEP 2732 H=2732:00 +CPU= 14.750
  18:32:07 STEP 2733 H=2733:00 +CPU= 22.552
  18:32:21 STEP 2734 H=2734:00 +CPU= 14.587
  18:32:36 STEP 2735 H=2735:00 +CPU= 14.801
  18:33:03 STEP 2736 H=2736:00 +CPU= 26.624
Moving to projects directory: /home/galfridian/slots/19/ICMGGhq0f+002736
Moving to projects directory: /home/galfridian/slots/19/ICMSHhq0f+002736
Moving to projects directory: /home/galfridian/slots/19/ICMUAhq0f+002736
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMGGhq0f+002712
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMSHhq0f+002712
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMUAhq0f+002712
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMGGhq0f+002724
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMSHhq0f+002724
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMUAhq0f+002724
Zipping up the intermediate file: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_0156_1999050100_123_968_12184800_0_r742267911_113.zip
Uploading the intermediate file: upload_file_113.zip
  18:33:17 STEP 2737 H=2737:00 +CPU= 14.002
  18:33:32 STEP 2738 H=2738:00 +CPU= 14.669
  18:33:55 STEP 2739 H=2739:00 +CPU= 23.030
  18:34:10 STEP 2740 H=2740:00 +CPU= 15.018
  18:34:24 STEP 2741 H=2741:00 +CPU= 14.239
  18:34:47 STEP 2742 H=2742:00 +CPU= 22.567
  18:35:02 STEP 2743 H=2743:00 +CPU= 14.366
  18:35:16 STEP 2744 H=2744:00 +CPU= 14.734
  18:35:40 STEP 2745 H=2745:00 +CPU= 22.564
  18:35:54 STEP 2746 H=2746:00 +CPU= 14.661
  18:36:09 STEP 2747 H=2747:00 +CPU= 14.408
  18:36:35 STEP 2748 H=2748:00 +CPU= 24.853
Moving to projects directory: /home/galfridian/slots/19/ICMGGhq0f+002748
Moving to projects directory: /home/galfridian/slots/19/ICMSHhq0f+002748
Moving to projects directory: /home/galfridian/slots/19/ICMUAhq0f+002748
  18:36:49 STEP 2749 H=2749:00 +CPU= 14.216
  18:37:04 STEP 2750 H=2750:00 +CPU= 14.968
  18:37:27 STEP 2751 H=2751:00 +CPU= 22.442
  18:37:42 STEP 2752 H=2752:00 +CPU= 14.929
  18:37:57 STEP 2753 H=2753:00 +CPU= 14.179
  18:38:20 STEP 2754 H=2754:00 +CPU= 23.298
  18:38:35 STEP 2755 H=2755:00 +CPU= 14.168
  18:38:49 STEP 2756 H=2756:00 +CPU= 14.326
  18:39:13 STEP 2757 H=2757:00 +CPU= 23.079
  18:39:28 STEP 2758 H=2758:00 +CPU= 14.532
  18:39:43 STEP 2759 H=2759:00 +CPU= 14.760
  18:40:10 STEP 2760 H=2760:00 +CPU= 27.395
Moving to projects directory: /home/galfridian/slots/19/ICMGGhq0f+002760
Moving to projects directory: /home/galfridian/slots/19/ICMSHhq0f+002760
Moving to projects directory: /home/galfridian/slots/19/ICMUAhq0f+002760
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMGGhq0f+002736
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMSHhq0f+002736
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMUAhq0f+002736
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMGGhq0f+002748
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMSHhq0f+002748
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMUAhq0f+002748
Zipping up the intermediate file: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_0156_1999050100_123_968_12184800_0_r742267911_114.zip
Uploading the intermediate file: upload_file_114.zip
  18:40:25 STEP 2761 H=2761:00 +CPU= 14.628
  18:40:40 STEP 2762 H=2762:00 +CPU= 14.602
  18:41:02 STEP 2763 H=2763:00 +CPU= 22.157
  18:41:17 STEP 2764 H=2764:00 +CPU= 15.164
  18:41:32 STEP 2765 H=2765:00 +CPU= 13.894
  18:41:55 STEP 2766 H=2766:00 +CPU= 22.697
  18:42:09 STEP 2767 H=2767:00 +CPU= 14.148
  18:42:24 STEP 2768 H=2768:00 +CPU= 14.478
  18:42:47 STEP 2769 H=2769:00 +CPU= 22.416
  18:43:02 STEP 2770 H=2770:00 +CPU= 14.935
  18:43:16 STEP 2771 H=2771:00 +CPU= 14.509
  18:43:42 STEP 2772 H=2772:00 +CPU= 25.206
Moving to projects directory: /home/galfridian/slots/19/ICMGGhq0f+002772
Moving to projects directory: /home/galfridian/slots/19/ICMSHhq0f+002772
Moving to projects directory: /home/galfridian/slots/19/ICMUAhq0f+002772
  18:43:57 STEP 2773 H=2773:00 +CPU= 14.541
  18:44:12 STEP 2774 H=2774:00 +CPU= 14.543
  18:44:34 STEP 2775 H=2775:00 +CPU= 22.382
  18:44:49 STEP 2776 H=2776:00 +CPU= 14.851
  18:45:04 STEP 2777 H=2777:00 +CPU= 14.421
  18:45:27 STEP 2778 H=2778:00 +CPU= 23.311
  18:45:42 STEP 2779 H=2779:00 +CPU= 14.481
  18:45:57 STEP 2780 H=2780:00 +CPU= 14.610
  18:46:19 STEP 2781 H=2781:00 +CPU= 22.174
  18:46:34 STEP 2782 H=2782:00 +CPU= 14.603
  18:46:49 STEP 2783 H=2783:00 +CPU= 14.372
  18:47:15 STEP 2784 H=2784:00 +CPU= 26.346
Moving to projects directory: /home/galfridian/slots/19/ICMGGhq0f+002784
Moving to projects directory: /home/galfridian/slots/19/ICMSHhq0f+002784
Moving to projects directory: /home/galfridian/slots/19/ICMUAhq0f+002784
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMGGhq0f+002760
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMSHhq0f+002760
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMUAhq0f+002760
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMGGhq0f+002772
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMSHhq0f+002772
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMUAhq0f+002772
Zipping up the intermediate file: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_0156_1999050100_123_968_12184800_0_r742267911_115.zip
Uploading the intermediate file: upload_file_115.zip
  18:47:29 STEP 2785 H=2785:00 +CPU= 14.039
  18:47:44 STEP 2786 H=2786:00 +CPU= 14.614
  18:48:07 STEP 2787 H=2787:00 +CPU= 22.289
  18:48:22 STEP 2788 H=2788:00 +CPU= 14.914
  18:48:36 STEP 2789 H=2789:00 +CPU= 14.555
  18:49:00 STEP 2790 H=2790:00 +CPU= 22.881
  18:49:14 STEP 2791 H=2791:00 +CPU= 14.127
  18:49:29 STEP 2792 H=2792:00 +CPU= 15.265
  18:49:52 STEP 2793 H=2793:00 +CPU= 22.189
  18:50:07 STEP 2794 H=2794:00 +CPU= 15.456
  18:50:22 STEP 2795 H=2795:00 +CPU= 14.710
  18:50:48 STEP 2796 H=2796:00 +CPU= 25.064
Moving to projects directory: /home/galfridian/slots/19/ICMGGhq0f+002796
Moving to projects directory: /home/galfridian/slots/19/ICMSHhq0f+002796
Moving to projects directory: /home/galfridian/slots/19/ICMUAhq0f+002796
  18:51:02 STEP 2797 H=2797:00 +CPU= 14.255
  18:51:17 STEP 2798 H=2798:00 +CPU= 14.465
  18:51:39 STEP 2799 H=2799:00 +CPU= 22.212
  18:51:54 STEP 2800 H=2800:00 +CPU= 14.532
  18:52:08 STEP 2801 H=2801:00 +CPU= 14.167
  18:52:31 STEP 2802 H=2802:00 +CPU= 23.015
  18:52:45 STEP 2803 H=2803:00 +CPU= 14.095
  18:53:00 STEP 2804 H=2804:00 +CPU= 14.872
  18:53:23 STEP 2805 H=2805:00 +CPU= 22.103
  18:53:37 STEP 2806 H=2806:00 +CPU= 14.473
  18:53:52 STEP 2807 H=2807:00 +CPU= 14.579
  18:54:19 STEP 2808 H=2808:00 +CPU= 27.026
Moving to projects directory: /home/galfridian/slots/19/ICMGGhq0f+002808
Moving to projects directory: /home/galfridian/slots/19/ICMSHhq0f+002808
Moving to projects directory: /home/galfridian/slots/19/ICMUAhq0f+002808
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMGGhq0f+002784
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMSHhq0f+002784
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMUAhq0f+002784
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMGGhq0f+002796
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMSHhq0f+002796
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMUAhq0f+002796
Zipping up the intermediate file: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_0156_1999050100_123_968_12184800_0_r742267911_116.zip
Uploading the intermediate file: upload_file_116.zip
  18:54:33 STEP 2809 H=2809:00 +CPU= 14.214
  18:54:48 STEP 2810 H=2810:00 +CPU= 14.455
  18:55:11 STEP 2811 H=2811:00 +CPU= 22.205
  18:55:26 STEP 2812 H=2812:00 +CPU= 14.813
  18:55:40 STEP 2813 H=2813:00 +CPU= 14.375
  18:56:03 STEP 2814 H=2814:00 +CPU= 23.148
  18:56:18 STEP 2815 H=2815:00 +CPU= 13.994
  18:56:32 STEP 2816 H=2816:00 +CPU= 14.532
  18:56:55 STEP 2817 H=2817:00 +CPU= 22.206
  18:57:10 STEP 2818 H=2818:00 +CPU= 14.498
  18:57:24 STEP 2819 H=2819:00 +CPU= 14.341
  18:57:50 STEP 2820 H=2820:00 +CPU= 25.834
Moving to projects directory: /home/galfridian/slots/19/ICMGGhq0f+002820
Moving to projects directory: /home/galfridian/slots/19/ICMSHhq0f+002820
Moving to projects directory: /home/galfridian/slots/19/ICMUAhq0f+002820
  18:58:05 STEP 2821 H=2821:00 +CPU= 14.825
  18:58:20 STEP 2822 H=2822:00 +CPU= 14.613
  18:58:43 STEP 2823 H=2823:00 +CPU= 22.650
  18:58:58 STEP 2824 H=2824:00 +CPU= 14.839
  18:59:12 STEP 2825 H=2825:00 +CPU= 14.166
  18:59:35 STEP 2826 H=2826:00 +CPU= 22.633
  18:59:49 STEP 2827 H=2827:00 +CPU= 14.195
  19:00:04 STEP 2828 H=2828:00 +CPU= 14.773
  19:00:27 STEP 2829 H=2829:00 +CPU= 22.814
  19:00:42 STEP 2830 H=2830:00 +CPU= 14.805
  19:00:57 STEP 2831 H=2831:00 +CPU= 14.531
  19:01:24 STEP 2832 H=2832:00 +CPU= 26.895
Moving to projects directory: /home/galfridian/slots/19/ICMGGhq0f+002832
Moving to projects directory: /home/galfridian/slots/19/ICMSHhq0f+002832
Moving to projects directory: /home/galfridian/slots/19/ICMUAhq0f+002832
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMGGhq0f+002808
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMSHhq0f+002808
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMUAhq0f+002808
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMGGhq0f+002820
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMSHhq0f+002820
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMUAhq0f+002820
Zipping up the intermediate file: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_0156_1999050100_123_968_12184800_0_r742267911_117.zip
Uploading the intermediate file: upload_file_117.zip
  19:01:39 STEP 2833 H=2833:00 +CPU= 14.268
  19:01:53 STEP 2834 H=2834:00 +CPU= 14.644
  19:02:16 STEP 2835 H=2835:00 +CPU= 22.477
  19:02:31 STEP 2836 H=2836:00 +CPU= 15.009
  19:02:45 STEP 2837 H=2837:00 +CPU= 14.121
  19:03:08 STEP 2838 H=2838:00 +CPU= 22.601
  19:03:23 STEP 2839 H=2839:00 +CPU= 14.327
  19:03:38 STEP 2840 H=2840:00 +CPU= 14.727
  19:04:00 STEP 2841 H=2841:00 +CPU= 22.430
  19:04:15 STEP 2842 H=2842:00 +CPU= 14.791
  19:04:29 STEP 2843 H=2843:00 +CPU= 14.255
  19:04:54 STEP 2844 H=2844:00 +CPU= 24.923
Moving to projects directory: /home/galfridian/slots/19/ICMGGhq0f+002844
Moving to projects directory: /home/galfridian/slots/19/ICMSHhq0f+002844
Moving to projects directory: /home/galfridian/slots/19/ICMUAhq0f+002844
  19:05:09 STEP 2845 H=2845:00 +CPU= 14.173
  19:05:23 STEP 2846 H=2846:00 +CPU= 14.432
  19:05:46 STEP 2847 H=2847:00 +CPU= 22.638
  19:06:01 STEP 2848 H=2848:00 +CPU= 14.713
  19:06:15 STEP 2849 H=2849:00 +CPU= 13.936
  19:06:38 STEP 2850 H=2850:00 +CPU= 22.884
  19:06:53 STEP 2851 H=2851:00 +CPU= 14.488
  19:07:07 STEP 2852 H=2852:00 +CPU= 14.496
  19:07:31 STEP 2853 H=2853:00 +CPU= 23.260
  19:07:45 STEP 2854 H=2854:00 +CPU= 14.664
  19:08:00 STEP 2855 H=2855:00 +CPU= 14.753
  19:08:27 STEP 2856 H=2856:00 +CPU= 26.542
Moving to projects directory: /home/galfridian/slots/19/ICMGGhq0f+002856
Moving to projects directory: /home/galfridian/slots/19/ICMSHhq0f+002856
Moving to projects directory: /home/galfridian/slots/19/ICMUAhq0f+002856
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMGGhq0f+002832
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMSHhq0f+002832
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMUAhq0f+002832
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMGGhq0f+002844
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMSHhq0f+002844
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMUAhq0f+002844
Zipping up the intermediate file: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_0156_1999050100_123_968_12184800_0_r742267911_118.zip
Uploading the intermediate file: upload_file_118.zip
  19:08:42 STEP 2857 H=2857:00 +CPU= 14.308
  19:08:56 STEP 2858 H=2858:00 +CPU= 14.492
  19:09:19 STEP 2859 H=2859:00 +CPU= 22.501
  19:09:34 STEP 2860 H=2860:00 +CPU= 14.435
  19:09:48 STEP 2861 H=2861:00 +CPU= 14.225
  19:10:11 STEP 2862 H=2862:00 +CPU= 22.550
  19:10:26 STEP 2863 H=2863:00 +CPU= 14.368
  19:10:41 STEP 2864 H=2864:00 +CPU= 14.871
  19:11:04 STEP 2865 H=2865:00 +CPU= 22.582
  19:11:19 STEP 2866 H=2866:00 +CPU= 14.931
  19:11:33 STEP 2867 H=2867:00 +CPU= 13.895
  19:11:58 STEP 2868 H=2868:00 +CPU= 25.107
Moving to projects directory: /home/galfridian/slots/19/ICMGGhq0f+002868
Moving to projects directory: /home/galfridian/slots/19/ICMSHhq0f+002868
Moving to projects directory: /home/galfridian/slots/19/ICMUAhq0f+002868
  19:12:12 STEP 2869 H=2869:00 +CPU= 14.289
  19:12:28 STEP 2870 H=2870:00 +CPU= 15.244
  19:12:51 STEP 2871 H=2871:00 +CPU= 23.007
  19:13:06 STEP 2872 H=2872:00 +CPU= 14.701
  19:13:20 STEP 2873 H=2873:00 +CPU= 14.289
  19:13:43 STEP 2874 H=2874:00 +CPU= 23.282
  19:13:58 STEP 2875 H=2875:00 +CPU= 14.175
  19:14:12 STEP 2876 H=2876:00 +CPU= 14.396
  19:14:35 STEP 2877 H=2877:00 +CPU= 22.733
  19:14:50 STEP 2878 H=2878:00 +CPU= 14.671
  19:15:04 STEP 2879 H=2879:00 +CPU= 14.425
  19:15:31 STEP 2880 H=2880:00 +CPU= 26.641
Moving to projects directory: /home/galfridian/slots/19/ICMGGhq0f+002880
Moving to projects directory: /home/galfridian/slots/19/ICMSHhq0f+002880
Moving to projects directory: /home/galfridian/slots/19/ICMUAhq0f+002880
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMGGhq0f+002856
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMSHhq0f+002856
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMUAhq0f+002856
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMGGhq0f+002868
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMSHhq0f+002868
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMUAhq0f+002868
Zipping up the intermediate file: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_0156_1999050100_123_968_12184800_0_r742267911_119.zip
Uploading the intermediate file: upload_file_119.zip
  19:15:46 STEP 2881 H=2881:00 +CPU= 14.252
Uploading trickle at timestep: 10368000
  19:16:00 STEP 2882 H=2882:00 +CPU= 14.303
  19:16:22 STEP 2883 H=2883:00 +CPU= 22.071
  19:16:37 STEP 2884 H=2884:00 +CPU= 14.385
  19:16:51 STEP 2885 H=2885:00 +CPU= 14.137
  19:17:15 STEP 2886 H=2886:00 +CPU= 23.274
  19:17:29 STEP 2887 H=2887:00 +CPU= 14.181
  19:17:44 STEP 2888 H=2888:00 +CPU= 14.801
  19:18:06 STEP 2889 H=2889:00 +CPU= 22.293
  19:18:21 STEP 2890 H=2890:00 +CPU= 14.531
  19:18:35 STEP 2891 H=2891:00 +CPU= 14.278
  19:19:01 STEP 2892 H=2892:00 +CPU= 24.951
Moving to projects directory: /home/galfridian/slots/19/ICMGGhq0f+002892
Moving to projects directory: /home/galfridian/slots/19/ICMSHhq0f+002892
Moving to projects directory: /home/galfridian/slots/19/ICMUAhq0f+002892
  19:19:15 STEP 2893 H=2893:00 +CPU= 14.598
  19:19:30 STEP 2894 H=2894:00 +CPU= 14.592
  19:19:53 STEP 2895 H=2895:00 +CPU= 22.586
  19:20:08 STEP 2896 H=2896:00 +CPU= 14.547
  19:20:22 STEP 2897 H=2897:00 +CPU= 13.975
  19:20:45 STEP 2898 H=2898:00 +CPU= 23.188
  19:21:00 STEP 2899 H=2899:00 +CPU= 14.742
  19:21:15 STEP 2900 H=2900:00 +CPU= 15.133
  19:21:38 STEP 2901 H=2901:00 +CPU= 22.524
  19:21:53 STEP 2902 H=2902:00 +CPU= 14.503
  19:22:07 STEP 2903 H=2903:00 +CPU= 14.512
  19:22:34 STEP 2904 H=2904:00 +CPU= 26.439
Moving to projects directory: /home/galfridian/slots/19/ICMGGhq0f+002904
Moving to projects directory: /home/galfridian/slots/19/ICMSHhq0f+002904
Moving to projects directory: /home/galfridian/slots/19/ICMUAhq0f+002904
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMGGhq0f+002880
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMSHhq0f+002880
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMUAhq0f+002880
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMGGhq0f+002892
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMSHhq0f+002892
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMUAhq0f+002892
Zipping up the intermediate file: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_0156_1999050100_123_968_12184800_0_r742267911_120.zip
Uploading the intermediate file: upload_file_120.zip
  19:22:48 STEP 2905 H=2905:00 +CPU= 14.230
  19:23:03 STEP 2906 H=2906:00 +CPU= 14.385
  19:23:26 STEP 2907 H=2907:00 +CPU= 22.763
  19:23:41 STEP 2908 H=2908:00 +CPU= 14.721
  19:23:55 STEP 2909 H=2909:00 +CPU= 14.260
  19:24:18 STEP 2910 H=2910:00 +CPU= 22.467
  19:24:33 STEP 2911 H=2911:00 +CPU= 14.497
  19:24:47 STEP 2912 H=2912:00 +CPU= 14.645
  19:25:11 STEP 2913 H=2913:00 +CPU= 22.938
  19:25:25 STEP 2914 H=2914:00 +CPU= 14.473
  19:25:39 STEP 2915 H=2915:00 +CPU= 14.036
  19:26:04 STEP 2916 H=2916:00 +CPU= 24.842
Moving to projects directory: /home/galfridian/slots/19/ICMGGhq0f+002916
Moving to projects directory: /home/galfridian/slots/19/ICMSHhq0f+002916
Moving to projects directory: /home/galfridian/slots/19/ICMUAhq0f+002916
  19:26:19 STEP 2917 H=2917:00 +CPU= 14.047
  19:26:34 STEP 2918 H=2918:00 +CPU= 14.737
  19:26:56 STEP 2919 H=2919:00 +CPU= 22.706
  19:27:11 STEP 2920 H=2920:00 +CPU= 14.370
  19:27:25 STEP 2921 H=2921:00 +CPU= 14.274
  19:27:49 STEP 2922 H=2922:00 +CPU= 23.073
  19:28:03 STEP 2923 H=2923:00 +CPU= 14.133
  19:28:18 STEP 2924 H=2924:00 +CPU= 15.004
  19:28:40 STEP 2925 H=2925:00 +CPU= 22.207
  19:28:55 STEP 2926 H=2926:00 +CPU= 14.649
  19:29:10 STEP 2927 H=2927:00 +CPU= 14.965
  19:29:37 STEP 2928 H=2928:00 +CPU= 26.763
Moving to projects directory: /home/galfridian/slots/19/ICMGGhq0f+002928
Moving to projects directory: /home/galfridian/slots/19/ICMSHhq0f+002928
Moving to projects directory: /home/galfridian/slots/19/ICMUAhq0f+002928
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMGGhq0f+002904
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMSHhq0f+002904
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMUAhq0f+002904
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMGGhq0f+002916
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMSHhq0f+002916
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMUAhq0f+002916
Zipping up the intermediate file: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_0156_1999050100_123_968_12184800_0_r742267911_121.zip
Uploading the intermediate file: upload_file_121.zip
  19:29:52 STEP 2929 H=2929:00 +CPU= 14.297
  19:30:07 STEP 2930 H=2930:00 +CPU= 14.767
  19:30:29 STEP 2931 H=2931:00 +CPU= 22.352
  19:30:44 STEP 2932 H=2932:00 +CPU= 14.488
  19:30:58 STEP 2933 H=2933:00 +CPU= 14.157
  19:31:22 STEP 2934 H=2934:00 +CPU= 23.036
  19:31:36 STEP 2935 H=2935:00 +CPU= 13.835
  19:31:50 STEP 2936 H=2936:00 +CPU= 14.205
  19:32:12 STEP 2937 H=2937:00 +CPU= 21.943
  19:32:27 STEP 2938 H=2938:00 +CPU= 14.723
  19:32:41 STEP 2939 H=2939:00 +CPU= 14.188
  19:33:07 STEP 2940 H=2940:00 +CPU= 25.018
Moving to projects directory: /home/galfridian/slots/19/ICMGGhq0f+002940
Moving to projects directory: /home/galfridian/slots/19/ICMSHhq0f+002940
Moving to projects directory: /home/galfridian/slots/19/ICMUAhq0f+002940
  19:33:21 STEP 2941 H=2941:00 +CPU= 14.041
  19:33:36 STEP 2942 H=2942:00 +CPU= 14.786
  19:33:58 STEP 2943 H=2943:00 +CPU= 22.581
  19:34:14 STEP 2944 H=2944:00 +CPU= 15.230
  19:34:29 STEP 2945 H=2945:00 +CPU= 15.031
  19:34:52 STEP 2946 H=2946:00 +CPU= 23.136
  19:35:06 STEP 2947 H=2947:00 +CPU= 14.154
  19:35:22 STEP 2948 H=2948:00 +CPU= 14.912
  19:35:44 STEP 2949 H=2949:00 +CPU= 22.337
  19:35:59 STEP 2950 H=2950:00 +CPU= 14.679
  19:36:14 STEP 2951 H=2951:00 +CPU= 14.967
  19:36:41 STEP 2952 H=2952:00 +CPU= 26.653
The child process terminated with status: 0
Moving to projects directory: /home/galfridian/slots/19/ICMGGhq0f+002952
Moving to projects directory: /home/galfridian/slots/19/ICMSHhq0f+002952
Moving to projects directory: /home/galfridian/slots/19/ICMUAhq0f+002952
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMUAhq0f+002952
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMUAhq0f+002928
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMGGhq0f+002928
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMGGhq0f+002940
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMSHhq0f+002928
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMUAhq0f+002940
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMGGhq0f+002952
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMSHhq0f+002952
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12184800/ICMSHhq0f+002940
Zipping up the final file: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_0156_1999050100_123_968_12184800_0_r742267911_122.zip
Uploading the final file: upload_file_122.zip
Uploading trickle at timestep: 10623600
19:40:04 (73604): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:21:08 1537623 22270068 oifs_43r3_ps_0156_1999050100_123_968_12184800_0 10,623,600 51,469 0.0048
09 May 2023 16:21:08 1537623 22270068 oifs_43r3_ps_0156_1999050100_123_968_12184800_0 10,368,000 50,212 0.0048
09 May 2023 16:21:08 1537623 22270068 oifs_43r3_ps_0156_1999050100_123_968_12184800_0 10,368,000 50,212 0.0048
09 May 2023 16:21:04 1537623 22270068 oifs_43r3_ps_0156_1999050100_123_968_12184800_0 9,504,000 46,029 0.0048
09 May 2023 16:21:04 1537623 22270068 oifs_43r3_ps_0156_1999050100_123_968_12184800_0 9,504,000 46,029 0.0048
09 May 2023 16:21:00 1537623 22270068 oifs_43r3_ps_0156_1999050100_123_968_12184800_0 8,640,000 41,864 0.0048
09 May 2023 16:20:56 1537623 22270068 oifs_43r3_ps_0156_1999050100_123_968_12184800_0 7,776,000 37,670 0.0048
09 May 2023 16:20:56 1537623 22270068 oifs_43r3_ps_0156_1999050100_123_968_12184800_0 7,776,000 37,670 0.0048
09 May 2023 16:20:48 1537623 22270068 oifs_43r3_ps_0156_1999050100_123_968_12184800_0 6,912,000 33,507 0.0048
09 May 2023 16:20:43 1537623 22270068 oifs_43r3_ps_0156_1999050100_123_968_12184800_0 6,048,000 29,308 0.0048
09 May 2023 16:20:39 1537623 22270068 oifs_43r3_ps_0156_1999050100_123_968_12184800_0 5,184,000 25,152 0.0049
09 May 2023 16:20:39 1537623 22270068 oifs_43r3_ps_0156_1999050100_123_968_12184800_0 5,184,000 25,152 0.0049
09 May 2023 16:20:35 1537623 22270068 oifs_43r3_ps_0156_1999050100_123_968_12184800_0 4,320,000 20,963 0.0049
09 May 2023 16:20:35 1537623 22270068 oifs_43r3_ps_0156_1999050100_123_968_12184800_0 4,320,000 20,963 0.0049
09 May 2023 16:20:31 1537623 22270068 oifs_43r3_ps_0156_1999050100_123_968_12184800_0 3,456,000 16,782 0.0049
09 May 2023 16:20:27 1537623 22270068 oifs_43r3_ps_0156_1999050100_123_968_12184800_0 2,592,000 12,601 0.0049
09 May 2023 16:20:19 1537623 22270068 oifs_43r3_ps_0156_1999050100_123_968_12184800_0 1,728,000 8,411 0.0049
09 May 2023 16:20:15 1537623 22270068 oifs_43r3_ps_0156_1999050100_123_968_12184800_0 864,000 4,226 0.0049


©2024 climateprediction.net