climateprediction.net home page
Task 22316454

Task 22316454

Name oifs_43r3_0192_2019110100_123_993_12215060_0
Workunit 12215060
Created 24 Feb 2023, 17:14:35 UTC
Sent 24 Feb 2023, 17:29:19 UTC
Report deadline 25 Apr 2023, 17:29:19 UTC
Received 25 Feb 2023, 17:45:57 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1497236
Run time 13 hours 54 min 50 sec
CPU time 13 hours 50 min 43 sec
Validate state Valid
Credit 14,873.04
Device peak FLOPS 7.27 GFLOPS
Application version OpenIFS 43r3 v1.21
x86_64-pc-linux-gnu
Peak working set size 4,410.62 MB
Peak swap size 4,974.23 MB
Peak disk usage 1,498.98 MB
Stderr
<core_client_version>7.20.5</core_client_version>
<![CDATA[
<stderr_txt>
nw4+002340
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMSHhnw4+002340
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMUAhnw4+002340
Zipping up the intermediate file: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_0192_2019110100_123_993_12215060_0_r518255869_97.zip
Uploading the intermediate file: upload_file_97.zip
  13:56:07 STEP 2353 H=2353:00 +CPU= 14.027
  13:56:21 STEP 2354 H=2354:00 +CPU= 14.428
  13:56:43 STEP 2355 H=2355:00 +CPU= 21.489
  13:56:57 STEP 2356 H=2356:00 +CPU= 14.424
  13:57:11 STEP 2357 H=2357:00 +CPU= 13.837
  13:57:33 STEP 2358 H=2358:00 +CPU= 21.892
  13:57:47 STEP 2359 H=2359:00 +CPU= 14.134
  13:58:02 STEP 2360 H=2360:00 +CPU= 14.479
  13:58:23 STEP 2361 H=2361:00 +CPU= 21.343
  13:58:38 STEP 2362 H=2362:00 +CPU= 14.500
  13:58:52 STEP 2363 H=2363:00 +CPU= 14.000
  13:59:15 STEP 2364 H=2364:00 +CPU= 23.371
Moving to projects directory: /hdd/boinc-client/slots/1/ICMGGhnw4+002364
Moving to projects directory: /hdd/boinc-client/slots/1/ICMSHhnw4+002364
Moving to projects directory: /hdd/boinc-client/slots/1/ICMUAhnw4+002364
  13:59:29 STEP 2365 H=2365:00 +CPU= 14.156
  13:59:43 STEP 2366 H=2366:00 +CPU= 14.263
  14:00:05 STEP 2367 H=2367:00 +CPU= 21.364
  14:00:19 STEP 2368 H=2368:00 +CPU= 14.526
  14:00:33 STEP 2369 H=2369:00 +CPU= 13.839
  14:00:55 STEP 2370 H=2370:00 +CPU= 21.663
  14:01:09 STEP 2371 H=2371:00 +CPU= 13.961
  14:01:23 STEP 2372 H=2372:00 +CPU= 14.418
  14:01:45 STEP 2373 H=2373:00 +CPU= 21.379
  14:01:59 STEP 2374 H=2374:00 +CPU= 14.493
  14:02:14 STEP 2375 H=2375:00 +CPU= 14.480
  14:02:39 STEP 2376 H=2376:00 +CPU= 25.069
Moving to projects directory: /hdd/boinc-client/slots/1/ICMGGhnw4+002376
Moving to projects directory: /hdd/boinc-client/slots/1/ICMSHhnw4+002376
Moving to projects directory: /hdd/boinc-client/slots/1/ICMUAhnw4+002376
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMGGhnw4+002352
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMSHhnw4+002352
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMUAhnw4+002352
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMGGhnw4+002364
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMSHhnw4+002364
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMUAhnw4+002364
Zipping up the intermediate file: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_0192_2019110100_123_993_12215060_0_r518255869_98.zip
Uploading the intermediate file: upload_file_98.zip
  14:02:53 STEP 2377 H=2377:00 +CPU= 14.048
  14:03:07 STEP 2378 H=2378:00 +CPU= 14.525
  14:03:29 STEP 2379 H=2379:00 +CPU= 21.400
  14:03:44 STEP 2380 H=2380:00 +CPU= 14.709
  14:03:58 STEP 2381 H=2381:00 +CPU= 13.965
  14:04:20 STEP 2382 H=2382:00 +CPU= 22.124
  14:04:34 STEP 2383 H=2383:00 +CPU= 14.131
  14:04:48 STEP 2384 H=2384:00 +CPU= 14.531
  14:05:10 STEP 2385 H=2385:00 +CPU= 21.421
  14:05:24 STEP 2386 H=2386:00 +CPU= 14.438
  14:05:38 STEP 2387 H=2387:00 +CPU= 13.970
  14:06:02 STEP 2388 H=2388:00 +CPU= 23.365
Moving to projects directory: /hdd/boinc-client/slots/1/ICMGGhnw4+002388
Moving to projects directory: /hdd/boinc-client/slots/1/ICMSHhnw4+002388
Moving to projects directory: /hdd/boinc-client/slots/1/ICMUAhnw4+002388
  14:06:16 STEP 2389 H=2389:00 +CPU= 14.172
  14:06:30 STEP 2390 H=2390:00 +CPU= 14.507
  14:06:52 STEP 2391 H=2391:00 +CPU= 21.331
  14:07:06 STEP 2392 H=2392:00 +CPU= 14.628
  14:07:20 STEP 2393 H=2393:00 +CPU= 13.958
  14:07:42 STEP 2394 H=2394:00 +CPU= 21.693
  14:07:56 STEP 2395 H=2395:00 +CPU= 14.151
  14:08:11 STEP 2396 H=2396:00 +CPU= 14.489
  14:08:32 STEP 2397 H=2397:00 +CPU= 21.322
  14:08:47 STEP 2398 H=2398:00 +CPU= 14.569
  14:09:01 STEP 2399 H=2399:00 +CPU= 14.489
  14:09:26 STEP 2400 H=2400:00 +CPU= 25.266
Moving to projects directory: /hdd/boinc-client/slots/1/ICMGGhnw4+002400
Moving to projects directory: /hdd/boinc-client/slots/1/ICMSHhnw4+002400
Moving to projects directory: /hdd/boinc-client/slots/1/ICMUAhnw4+002400
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMGGhnw4+002376
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMSHhnw4+002376
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMUAhnw4+002376
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMGGhnw4+002388
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMSHhnw4+002388
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMUAhnw4+002388
Zipping up the intermediate file: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_0192_2019110100_123_993_12215060_0_r518255869_99.zip
Uploading the intermediate file: upload_file_99.zip
  14:09:40 STEP 2401 H=2401:00 +CPU= 14.042
  14:09:55 STEP 2402 H=2402:00 +CPU= 14.579
Uploading trickle at timestep: 8640000
  14:10:16 STEP 2403 H=2403:00 +CPU= 21.352
  14:10:31 STEP 2404 H=2404:00 +CPU= 14.839
  14:10:45 STEP 2405 H=2405:00 +CPU= 14.077
  14:11:07 STEP 2406 H=2406:00 +CPU= 21.740
  14:11:21 STEP 2407 H=2407:00 +CPU= 14.114
  14:11:36 STEP 2408 H=2408:00 +CPU= 14.471
  14:11:57 STEP 2409 H=2409:00 +CPU= 21.239
  14:12:11 STEP 2410 H=2410:00 +CPU= 14.456
  14:12:25 STEP 2411 H=2411:00 +CPU= 13.930
  14:12:49 STEP 2412 H=2412:00 +CPU= 23.321
Moving to projects directory: /hdd/boinc-client/slots/1/ICMGGhnw4+002412
Moving to projects directory: /hdd/boinc-client/slots/1/ICMSHhnw4+002412
Moving to projects directory: /hdd/boinc-client/slots/1/ICMUAhnw4+002412
  14:13:03 STEP 2413 H=2413:00 +CPU= 14.191
  14:13:17 STEP 2414 H=2414:00 +CPU= 14.453
  14:13:39 STEP 2415 H=2415:00 +CPU= 21.322
  14:13:53 STEP 2416 H=2416:00 +CPU= 14.747
  14:14:07 STEP 2417 H=2417:00 +CPU= 14.018
  14:14:29 STEP 2418 H=2418:00 +CPU= 21.577
  14:14:43 STEP 2419 H=2419:00 +CPU= 14.195
  14:14:58 STEP 2420 H=2420:00 +CPU= 14.361
  14:15:19 STEP 2421 H=2421:00 +CPU= 21.440
  14:15:34 STEP 2422 H=2422:00 +CPU= 14.587
  14:15:48 STEP 2423 H=2423:00 +CPU= 14.490
  14:16:13 STEP 2424 H=2424:00 +CPU= 25.236
Moving to projects directory: /hdd/boinc-client/slots/1/ICMGGhnw4+002424
Moving to projects directory: /hdd/boinc-client/slots/1/ICMSHhnw4+002424
Moving to projects directory: /hdd/boinc-client/slots/1/ICMUAhnw4+002424
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMGGhnw4+002400
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMSHhnw4+002400
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMUAhnw4+002400
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMGGhnw4+002412
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMSHhnw4+002412
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMUAhnw4+002412
Zipping up the intermediate file: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_0192_2019110100_123_993_12215060_0_r518255869_100.zip
Uploading the intermediate file: upload_file_100.zip
  14:16:27 STEP 2425 H=2425:00 +CPU= 14.068
  14:16:42 STEP 2426 H=2426:00 +CPU= 14.497
  14:17:04 STEP 2427 H=2427:00 +CPU= 21.562
  14:17:18 STEP 2428 H=2428:00 +CPU= 14.564
  14:17:32 STEP 2429 H=2429:00 +CPU= 13.897
  14:17:54 STEP 2430 H=2430:00 +CPU= 21.725
  14:18:08 STEP 2431 H=2431:00 +CPU= 14.120
  14:18:22 STEP 2432 H=2432:00 +CPU= 14.480
  14:18:44 STEP 2433 H=2433:00 +CPU= 21.286
  14:18:58 STEP 2434 H=2434:00 +CPU= 14.554
  14:19:12 STEP 2435 H=2435:00 +CPU= 14.025
  14:19:36 STEP 2436 H=2436:00 +CPU= 23.308
Moving to projects directory: /hdd/boinc-client/slots/1/ICMGGhnw4+002436
Moving to projects directory: /hdd/boinc-client/slots/1/ICMSHhnw4+002436
Moving to projects directory: /hdd/boinc-client/slots/1/ICMUAhnw4+002436
  14:19:50 STEP 2437 H=2437:00 +CPU= 14.092
  14:20:04 STEP 2438 H=2438:00 +CPU= 14.340
  14:20:25 STEP 2439 H=2439:00 +CPU= 21.245
  14:20:40 STEP 2440 H=2440:00 +CPU= 14.528
  14:20:54 STEP 2441 H=2441:00 +CPU= 13.925
  14:21:15 STEP 2442 H=2442:00 +CPU= 21.544
  14:21:29 STEP 2443 H=2443:00 +CPU= 13.988
  14:21:44 STEP 2444 H=2444:00 +CPU= 14.417
  14:22:05 STEP 2445 H=2445:00 +CPU= 21.272
  14:22:19 STEP 2446 H=2446:00 +CPU= 14.342
  14:22:34 STEP 2447 H=2447:00 +CPU= 14.455
  14:22:59 STEP 2448 H=2448:00 +CPU= 24.955
Moving to projects directory: /hdd/boinc-client/slots/1/ICMGGhnw4+002448
Moving to projects directory: /hdd/boinc-client/slots/1/ICMSHhnw4+002448
Moving to projects directory: /hdd/boinc-client/slots/1/ICMUAhnw4+002448
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMGGhnw4+002424
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMSHhnw4+002424
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMUAhnw4+002424
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMGGhnw4+002436
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMSHhnw4+002436
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMUAhnw4+002436
Zipping up the intermediate file: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_0192_2019110100_123_993_12215060_0_r518255869_101.zip
Uploading the intermediate file: upload_file_101.zip
  14:23:13 STEP 2449 H=2449:00 +CPU= 14.182
  14:23:28 STEP 2450 H=2450:00 +CPU= 14.542
  14:23:49 STEP 2451 H=2451:00 +CPU= 21.267
  14:24:04 STEP 2452 H=2452:00 +CPU= 14.711
  14:24:18 STEP 2453 H=2453:00 +CPU= 14.187
  14:24:40 STEP 2454 H=2454:00 +CPU= 21.715
  14:24:54 STEP 2455 H=2455:00 +CPU= 13.972
  14:25:08 STEP 2456 H=2456:00 +CPU= 14.629
  14:25:30 STEP 2457 H=2457:00 +CPU= 21.292
  14:25:44 STEP 2458 H=2458:00 +CPU= 14.401
  14:25:58 STEP 2459 H=2459:00 +CPU= 14.056
  14:26:21 STEP 2460 H=2460:00 +CPU= 23.427
Moving to projects directory: /hdd/boinc-client/slots/1/ICMGGhnw4+002460
Moving to projects directory: /hdd/boinc-client/slots/1/ICMSHhnw4+002460
Moving to projects directory: /hdd/boinc-client/slots/1/ICMUAhnw4+002460
  14:26:36 STEP 2461 H=2461:00 +CPU= 14.113
  14:26:50 STEP 2462 H=2462:00 +CPU= 14.422
  14:27:11 STEP 2463 H=2463:00 +CPU= 21.343
  14:27:26 STEP 2464 H=2464:00 +CPU= 14.404
  14:27:40 STEP 2465 H=2465:00 +CPU= 14.085
  14:28:01 STEP 2466 H=2466:00 +CPU= 21.595
  14:28:16 STEP 2467 H=2467:00 +CPU= 14.089
  14:28:30 STEP 2468 H=2468:00 +CPU= 14.500
  14:28:51 STEP 2469 H=2469:00 +CPU= 21.239
  14:29:06 STEP 2470 H=2470:00 +CPU= 14.466
  14:29:20 STEP 2471 H=2471:00 +CPU= 14.528
  14:29:45 STEP 2472 H=2472:00 +CPU= 25.027
Moving to projects directory: /hdd/boinc-client/slots/1/ICMGGhnw4+002472
Moving to projects directory: /hdd/boinc-client/slots/1/ICMSHhnw4+002472
Moving to projects directory: /hdd/boinc-client/slots/1/ICMUAhnw4+002472
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMGGhnw4+002448
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMSHhnw4+002448
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMUAhnw4+002448
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMGGhnw4+002460
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMSHhnw4+002460
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMUAhnw4+002460
Zipping up the intermediate file: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_0192_2019110100_123_993_12215060_0_r518255869_102.zip
Uploading the intermediate file: upload_file_102.zip
  14:29:59 STEP 2473 H=2473:00 +CPU= 14.144
  14:30:14 STEP 2474 H=2474:00 +CPU= 14.356
  14:30:35 STEP 2475 H=2475:00 +CPU= 21.453
  14:30:50 STEP 2476 H=2476:00 +CPU= 14.363
  14:31:04 STEP 2477 H=2477:00 +CPU= 14.051
  14:31:25 STEP 2478 H=2478:00 +CPU= 21.721
  14:31:40 STEP 2479 H=2479:00 +CPU= 14.103
  14:31:54 STEP 2480 H=2480:00 +CPU= 14.628
  14:32:16 STEP 2481 H=2481:00 +CPU= 21.369
  14:32:30 STEP 2482 H=2482:00 +CPU= 14.545
  14:32:45 STEP 2483 H=2483:00 +CPU= 14.563
  14:33:08 STEP 2484 H=2484:00 +CPU= 23.375
Moving to projects directory: /hdd/boinc-client/slots/1/ICMGGhnw4+002484
Moving to projects directory: /hdd/boinc-client/slots/1/ICMSHhnw4+002484
Moving to projects directory: /hdd/boinc-client/slots/1/ICMUAhnw4+002484
  14:33:22 STEP 2485 H=2485:00 +CPU= 13.895
  14:33:37 STEP 2486 H=2486:00 +CPU= 14.455
  14:33:58 STEP 2487 H=2487:00 +CPU= 21.294
  14:34:12 STEP 2488 H=2488:00 +CPU= 14.288
  14:34:26 STEP 2489 H=2489:00 +CPU= 14.159
  14:34:48 STEP 2490 H=2490:00 +CPU= 21.768
  14:35:02 STEP 2491 H=2491:00 +CPU= 14.162
  14:35:17 STEP 2492 H=2492:00 +CPU= 14.585
  14:35:38 STEP 2493 H=2493:00 +CPU= 21.232
  14:35:53 STEP 2494 H=2494:00 +CPU= 14.447
  14:36:07 STEP 2495 H=2495:00 +CPU= 14.572
  14:36:32 STEP 2496 H=2496:00 +CPU= 25.271
Moving to projects directory: /hdd/boinc-client/slots/1/ICMGGhnw4+002496
Moving to projects directory: /hdd/boinc-client/slots/1/ICMSHhnw4+002496
Moving to projects directory: /hdd/boinc-client/slots/1/ICMUAhnw4+002496
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMGGhnw4+002472
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMSHhnw4+002472
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMUAhnw4+002472
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMGGhnw4+002484
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMSHhnw4+002484
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMUAhnw4+002484
Zipping up the intermediate file: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_0192_2019110100_123_993_12215060_0_r518255869_103.zip
Uploading the intermediate file: upload_file_103.zip
  14:36:47 STEP 2497 H=2497:00 +CPU= 14.147
  14:37:01 STEP 2498 H=2498:00 +CPU= 14.367
  14:37:23 STEP 2499 H=2499:00 +CPU= 21.504
  14:37:37 STEP 2500 H=2500:00 +CPU= 14.437
  14:37:51 STEP 2501 H=2501:00 +CPU= 14.070
  14:38:13 STEP 2502 H=2502:00 +CPU= 21.739
  14:38:27 STEP 2503 H=2503:00 +CPU= 14.173
  14:38:42 STEP 2504 H=2504:00 +CPU= 14.557
  14:39:03 STEP 2505 H=2505:00 +CPU= 21.254
  14:39:17 STEP 2506 H=2506:00 +CPU= 14.437
  14:39:31 STEP 2507 H=2507:00 +CPU= 14.100
  14:39:55 STEP 2508 H=2508:00 +CPU= 23.272
Moving to projects directory: /hdd/boinc-client/slots/1/ICMGGhnw4+002508
Moving to projects directory: /hdd/boinc-client/slots/1/ICMSHhnw4+002508
Moving to projects directory: /hdd/boinc-client/slots/1/ICMUAhnw4+002508
  14:40:09 STEP 2509 H=2509:00 +CPU= 14.007
  14:40:23 STEP 2510 H=2510:00 +CPU= 14.527
  14:40:45 STEP 2511 H=2511:00 +CPU= 21.241
  14:40:59 STEP 2512 H=2512:00 +CPU= 14.402
  14:41:13 STEP 2513 H=2513:00 +CPU= 14.112
  14:41:35 STEP 2514 H=2514:00 +CPU= 21.595
  14:41:49 STEP 2515 H=2515:00 +CPU= 14.076
  14:42:03 STEP 2516 H=2516:00 +CPU= 14.525
  14:42:25 STEP 2517 H=2517:00 +CPU= 21.288
  14:42:39 STEP 2518 H=2518:00 +CPU= 14.348
  14:42:53 STEP 2519 H=2519:00 +CPU= 14.527
  14:43:19 STEP 2520 H=2520:00 +CPU= 25.237
Moving to projects directory: /hdd/boinc-client/slots/1/ICMGGhnw4+002520
Moving to projects directory: /hdd/boinc-client/slots/1/ICMSHhnw4+002520
Moving to projects directory: /hdd/boinc-client/slots/1/ICMUAhnw4+002520
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMGGhnw4+002496
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMSHhnw4+002496
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMUAhnw4+002496
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMGGhnw4+002508
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMSHhnw4+002508
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMUAhnw4+002508
Zipping up the intermediate file: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_0192_2019110100_123_993_12215060_0_r518255869_104.zip
Uploading the intermediate file: upload_file_104.zip
  14:43:33 STEP 2521 H=2521:00 +CPU= 14.056
  14:43:47 STEP 2522 H=2522:00 +CPU= 14.408
  14:44:09 STEP 2523 H=2523:00 +CPU= 21.566
  14:44:23 STEP 2524 H=2524:00 +CPU= 14.327
  14:44:37 STEP 2525 H=2525:00 +CPU= 14.104
  14:44:59 STEP 2526 H=2526:00 +CPU= 21.664
  14:45:13 STEP 2527 H=2527:00 +CPU= 14.002
  14:45:28 STEP 2528 H=2528:00 +CPU= 14.649
  14:45:49 STEP 2529 H=2529:00 +CPU= 21.250
  14:46:03 STEP 2530 H=2530:00 +CPU= 14.326
  14:46:17 STEP 2531 H=2531:00 +CPU= 14.081
  14:46:41 STEP 2532 H=2532:00 +CPU= 23.226
Moving to projects directory: /hdd/boinc-client/slots/1/ICMGGhnw4+002532
Moving to projects directory: /hdd/boinc-client/slots/1/ICMSHhnw4+002532
Moving to projects directory: /hdd/boinc-client/slots/1/ICMUAhnw4+002532
  14:46:55 STEP 2533 H=2533:00 +CPU= 14.083
  14:47:09 STEP 2534 H=2534:00 +CPU= 14.697
  14:47:31 STEP 2535 H=2535:00 +CPU= 21.382
  14:47:45 STEP 2536 H=2536:00 +CPU= 14.455
  14:47:59 STEP 2537 H=2537:00 +CPU= 14.194
  14:48:21 STEP 2538 H=2538:00 +CPU= 21.588
  14:48:35 STEP 2539 H=2539:00 +CPU= 14.063
  14:48:50 STEP 2540 H=2540:00 +CPU= 14.438
  14:49:11 STEP 2541 H=2541:00 +CPU= 21.333
  14:49:25 STEP 2542 H=2542:00 +CPU= 14.307
  14:49:40 STEP 2543 H=2543:00 +CPU= 14.547
  14:50:05 STEP 2544 H=2544:00 +CPU= 25.314
Moving to projects directory: /hdd/boinc-client/slots/1/ICMGGhnw4+002544
Moving to projects directory: /hdd/boinc-client/slots/1/ICMSHhnw4+002544
Moving to projects directory: /hdd/boinc-client/slots/1/ICMUAhnw4+002544
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMGGhnw4+002520
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMSHhnw4+002520
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMUAhnw4+002520
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMGGhnw4+002532
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMSHhnw4+002532
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMUAhnw4+002532
Zipping up the intermediate file: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_0192_2019110100_123_993_12215060_0_r518255869_105.zip
Uploading the intermediate file: upload_file_105.zip
  14:50:19 STEP 2545 H=2545:00 +CPU= 14.131
  14:50:34 STEP 2546 H=2546:00 +CPU= 14.436
  14:50:55 STEP 2547 H=2547:00 +CPU= 21.578
  14:51:10 STEP 2548 H=2548:00 +CPU= 14.282
  14:51:24 STEP 2549 H=2549:00 +CPU= 14.152
  14:51:46 STEP 2550 H=2550:00 +CPU= 21.791
  14:52:00 STEP 2551 H=2551:00 +CPU= 13.998
  14:52:14 STEP 2552 H=2552:00 +CPU= 14.452
  14:52:35 STEP 2553 H=2553:00 +CPU= 21.263
  14:52:50 STEP 2554 H=2554:00 +CPU= 14.348
  14:53:04 STEP 2555 H=2555:00 +CPU= 14.085
  14:53:27 STEP 2556 H=2556:00 +CPU= 23.281
Moving to projects directory: /hdd/boinc-client/slots/1/ICMGGhnw4+002556
Moving to projects directory: /hdd/boinc-client/slots/1/ICMSHhnw4+002556
Moving to projects directory: /hdd/boinc-client/slots/1/ICMUAhnw4+002556
  14:53:41 STEP 2557 H=2557:00 +CPU= 14.059
  14:53:56 STEP 2558 H=2558:00 +CPU= 14.580
  14:54:17 STEP 2559 H=2559:00 +CPU= 21.420
  14:54:32 STEP 2560 H=2560:00 +CPU= 14.460
  14:54:46 STEP 2561 H=2561:00 +CPU= 14.147
  14:55:07 STEP 2562 H=2562:00 +CPU= 21.653
  14:55:21 STEP 2563 H=2563:00 +CPU= 13.995
  14:55:36 STEP 2564 H=2564:00 +CPU= 14.462
  14:55:57 STEP 2565 H=2565:00 +CPU= 21.262
  14:56:12 STEP 2566 H=2566:00 +CPU= 14.360
  14:56:26 STEP 2567 H=2567:00 +CPU= 14.570
  14:56:51 STEP 2568 H=2568:00 +CPU= 25.225
Moving to projects directory: /hdd/boinc-client/slots/1/ICMGGhnw4+002568
Moving to projects directory: /hdd/boinc-client/slots/1/ICMSHhnw4+002568
Moving to projects directory: /hdd/boinc-client/slots/1/ICMUAhnw4+002568
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMGGhnw4+002544
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMSHhnw4+002544
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMUAhnw4+002544
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMGGhnw4+002556
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMSHhnw4+002556
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMUAhnw4+002556
Zipping up the intermediate file: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_0192_2019110100_123_993_12215060_0_r518255869_106.zip
Uploading the intermediate file: upload_file_106.zip
  14:57:06 STEP 2569 H=2569:00 +CPU= 14.129
  14:57:20 STEP 2570 H=2570:00 +CPU= 14.406
  14:57:42 STEP 2571 H=2571:00 +CPU= 21.559
  14:57:56 STEP 2572 H=2572:00 +CPU= 14.294
  14:58:10 STEP 2573 H=2573:00 +CPU= 14.068
  14:58:32 STEP 2574 H=2574:00 +CPU= 21.680
  14:58:46 STEP 2575 H=2575:00 +CPU= 13.963
  14:59:00 STEP 2576 H=2576:00 +CPU= 14.676
  14:59:22 STEP 2577 H=2577:00 +CPU= 21.293
  14:59:36 STEP 2578 H=2578:00 +CPU= 14.346
  14:59:50 STEP 2579 H=2579:00 +CPU= 14.164
  15:00:13 STEP 2580 H=2580:00 +CPU= 23.327
Moving to projects directory: /hdd/boinc-client/slots/1/ICMGGhnw4+002580
Moving to projects directory: /hdd/boinc-client/slots/1/ICMSHhnw4+002580
Moving to projects directory: /hdd/boinc-client/slots/1/ICMUAhnw4+002580
  15:00:28 STEP 2581 H=2581:00 +CPU= 14.153
  15:00:42 STEP 2582 H=2582:00 +CPU= 14.582
  15:01:04 STEP 2583 H=2583:00 +CPU= 21.474
  15:01:18 STEP 2584 H=2584:00 +CPU= 14.529
  15:01:32 STEP 2585 H=2585:00 +CPU= 14.122
  15:01:54 STEP 2586 H=2586:00 +CPU= 21.684
  15:02:08 STEP 2587 H=2587:00 +CPU= 13.961
  15:02:22 STEP 2588 H=2588:00 +CPU= 14.439
  15:02:44 STEP 2589 H=2589:00 +CPU= 21.293
  15:02:58 STEP 2590 H=2590:00 +CPU= 14.300
  15:03:13 STEP 2591 H=2591:00 +CPU= 14.492
  15:03:38 STEP 2592 H=2592:00 +CPU= 25.242
Moving to projects directory: /hdd/boinc-client/slots/1/ICMGGhnw4+002592
Moving to projects directory: /hdd/boinc-client/slots/1/ICMSHhnw4+002592
Moving to projects directory: /hdd/boinc-client/slots/1/ICMUAhnw4+002592
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMGGhnw4+002568
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMSHhnw4+002568
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMUAhnw4+002568
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMGGhnw4+002580
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMSHhnw4+002580
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMUAhnw4+002580
Zipping up the intermediate file: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_0192_2019110100_123_993_12215060_0_r518255869_107.zip
Uploading the intermediate file: upload_file_107.zip
  15:03:52 STEP 2593 H=2593:00 +CPU= 13.963
  15:04:06 STEP 2594 H=2594:00 +CPU= 14.435
  15:04:28 STEP 2595 H=2595:00 +CPU= 21.542
  15:04:42 STEP 2596 H=2596:00 +CPU= 14.336
  15:04:56 STEP 2597 H=2597:00 +CPU= 14.085
  15:05:18 STEP 2598 H=2598:00 +CPU= 21.808
  15:05:32 STEP 2599 H=2599:00 +CPU= 13.985
  15:05:47 STEP 2600 H=2600:00 +CPU= 14.701
  15:06:08 STEP 2601 H=2601:00 +CPU= 21.219
  15:06:22 STEP 2602 H=2602:00 +CPU= 14.262
  15:06:36 STEP 2603 H=2603:00 +CPU= 14.082
  15:07:00 STEP 2604 H=2604:00 +CPU= 23.218
Moving to projects directory: /hdd/boinc-client/slots/1/ICMGGhnw4+002604
Moving to projects directory: /hdd/boinc-client/slots/1/ICMSHhnw4+002604
Moving to projects directory: /hdd/boinc-client/slots/1/ICMUAhnw4+002604
  15:07:14 STEP 2605 H=2605:00 +CPU= 14.009
  15:07:28 STEP 2606 H=2606:00 +CPU= 14.517
  15:07:49 STEP 2607 H=2607:00 +CPU= 21.241
  15:08:04 STEP 2608 H=2608:00 +CPU= 14.446
  15:08:18 STEP 2609 H=2609:00 +CPU= 14.067
  15:08:40 STEP 2610 H=2610:00 +CPU= 21.640
  15:08:53 STEP 2611 H=2611:00 +CPU= 13.798
  15:09:08 STEP 2612 H=2612:00 +CPU= 14.369
  15:09:29 STEP 2613 H=2613:00 +CPU= 21.332
  15:09:43 STEP 2614 H=2614:00 +CPU= 14.310
  15:09:58 STEP 2615 H=2615:00 +CPU= 14.495
  15:10:23 STEP 2616 H=2616:00 +CPU= 25.159
Moving to projects directory: /hdd/boinc-client/slots/1/ICMGGhnw4+002616
Moving to projects directory: /hdd/boinc-client/slots/1/ICMSHhnw4+002616
Moving to projects directory: /hdd/boinc-client/slots/1/ICMUAhnw4+002616
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMGGhnw4+002592
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMSHhnw4+002592
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMUAhnw4+002592
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMGGhnw4+002604
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMSHhnw4+002604
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMUAhnw4+002604
Zipping up the intermediate file: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_0192_2019110100_123_993_12215060_0_r518255869_108.zip
Uploading the intermediate file: upload_file_108.zip
  15:10:37 STEP 2617 H=2617:00 +CPU= 13.898
  15:10:51 STEP 2618 H=2618:00 +CPU= 14.380
  15:11:13 STEP 2619 H=2619:00 +CPU= 21.386
  15:11:27 STEP 2620 H=2620:00 +CPU= 14.346
  15:11:41 STEP 2621 H=2621:00 +CPU= 14.067
  15:12:03 STEP 2622 H=2622:00 +CPU= 21.697
  15:12:17 STEP 2623 H=2623:00 +CPU= 13.883
  15:12:32 STEP 2624 H=2624:00 +CPU= 14.550
  15:12:53 STEP 2625 H=2625:00 +CPU= 21.104
  15:13:07 STEP 2626 H=2626:00 +CPU= 14.369
  15:13:21 STEP 2627 H=2627:00 +CPU= 14.054
  15:13:44 STEP 2628 H=2628:00 +CPU= 23.197
Moving to projects directory: /hdd/boinc-client/slots/1/ICMGGhnw4+002628
Moving to projects directory: /hdd/boinc-client/slots/1/ICMSHhnw4+002628
Moving to projects directory: /hdd/boinc-client/slots/1/ICMUAhnw4+002628
  15:13:58 STEP 2629 H=2629:00 +CPU= 14.014
  15:14:13 STEP 2630 H=2630:00 +CPU= 14.436
  15:14:34 STEP 2631 H=2631:00 +CPU= 21.017
  15:14:48 STEP 2632 H=2632:00 +CPU= 14.394
  15:15:02 STEP 2633 H=2633:00 +CPU= 14.064
  15:15:24 STEP 2634 H=2634:00 +CPU= 21.499
  15:15:38 STEP 2635 H=2635:00 +CPU= 14.127
  15:15:52 STEP 2636 H=2636:00 +CPU= 14.450
  15:16:14 STEP 2637 H=2637:00 +CPU= 21.281
  15:16:28 STEP 2638 H=2638:00 +CPU= 14.429
  15:16:43 STEP 2639 H=2639:00 +CPU= 14.560
  15:17:08 STEP 2640 H=2640:00 +CPU= 24.875
Moving to projects directory: /hdd/boinc-client/slots/1/ICMGGhnw4+002640
Moving to projects directory: /hdd/boinc-client/slots/1/ICMSHhnw4+002640
Moving to projects directory: /hdd/boinc-client/slots/1/ICMUAhnw4+002640
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMGGhnw4+002616
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMSHhnw4+002616
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMUAhnw4+002616
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMGGhnw4+002628
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMSHhnw4+002628
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMUAhnw4+002628
Zipping up the intermediate file: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_0192_2019110100_123_993_12215060_0_r518255869_109.zip
Uploading the intermediate file: upload_file_109.zip
  15:17:22 STEP 2641 H=2641:00 +CPU= 14.074
Uploading trickle at timestep: 9504000
  15:17:36 STEP 2642 H=2642:00 +CPU= 14.439
  15:17:57 STEP 2643 H=2643:00 +CPU= 21.178
  15:18:12 STEP 2644 H=2644:00 +CPU= 14.536
  15:18:26 STEP 2645 H=2645:00 +CPU= 14.086
  15:18:48 STEP 2646 H=2646:00 +CPU= 21.583
  15:19:02 STEP 2647 H=2647:00 +CPU= 14.080
  15:19:16 STEP 2648 H=2648:00 +CPU= 14.581
  15:19:37 STEP 2649 H=2649:00 +CPU= 21.203
  15:19:52 STEP 2650 H=2650:00 +CPU= 14.569
  15:20:06 STEP 2651 H=2651:00 +CPU= 14.124
  15:20:29 STEP 2652 H=2652:00 +CPU= 23.019
Moving to projects directory: /hdd/boinc-client/slots/1/ICMGGhnw4+002652
Moving to projects directory: /hdd/boinc-client/slots/1/ICMSHhnw4+002652
Moving to projects directory: /hdd/boinc-client/slots/1/ICMUAhnw4+002652
  15:20:43 STEP 2653 H=2653:00 +CPU= 14.042
  15:20:58 STEP 2654 H=2654:00 +CPU= 14.385
  15:21:19 STEP 2655 H=2655:00 +CPU= 21.078
  15:21:33 STEP 2656 H=2656:00 +CPU= 14.466
  15:21:47 STEP 2657 H=2657:00 +CPU= 14.087
  15:22:09 STEP 2658 H=2658:00 +CPU= 21.566
  15:22:23 STEP 2659 H=2659:00 +CPU= 14.067
  15:22:37 STEP 2660 H=2660:00 +CPU= 14.491
  15:22:59 STEP 2661 H=2661:00 +CPU= 21.180
  15:23:13 STEP 2662 H=2662:00 +CPU= 14.333
  15:23:28 STEP 2663 H=2663:00 +CPU= 14.743
  15:23:53 STEP 2664 H=2664:00 +CPU= 24.887
Moving to projects directory: /hdd/boinc-client/slots/1/ICMGGhnw4+002664
Moving to projects directory: /hdd/boinc-client/slots/1/ICMSHhnw4+002664
Moving to projects directory: /hdd/boinc-client/slots/1/ICMUAhnw4+002664
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMGGhnw4+002640
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMSHhnw4+002640
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMUAhnw4+002640
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMGGhnw4+002652
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMSHhnw4+002652
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMUAhnw4+002652
Zipping up the intermediate file: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_0192_2019110100_123_993_12215060_0_r518255869_110.zip
Uploading the intermediate file: upload_file_110.zip
  15:24:07 STEP 2665 H=2665:00 +CPU= 14.208
  15:24:21 STEP 2666 H=2666:00 +CPU= 14.404
  15:24:43 STEP 2667 H=2667:00 +CPU= 21.350
  15:24:57 STEP 2668 H=2668:00 +CPU= 14.653
  15:25:11 STEP 2669 H=2669:00 +CPU= 14.038
  15:25:33 STEP 2670 H=2670:00 +CPU= 21.731
  15:25:47 STEP 2671 H=2671:00 +CPU= 14.187
  15:26:02 STEP 2672 H=2672:00 +CPU= 14.616
  15:26:23 STEP 2673 H=2673:00 +CPU= 21.329
  15:26:38 STEP 2674 H=2674:00 +CPU= 14.569
  15:26:52 STEP 2675 H=2675:00 +CPU= 14.200
  15:27:15 STEP 2676 H=2676:00 +CPU= 23.002
Moving to projects directory: /hdd/boinc-client/slots/1/ICMGGhnw4+002676
Moving to projects directory: /hdd/boinc-client/slots/1/ICMSHhnw4+002676
Moving to projects directory: /hdd/boinc-client/slots/1/ICMUAhnw4+002676
  15:27:29 STEP 2677 H=2677:00 +CPU= 14.054
  15:27:44 STEP 2678 H=2678:00 +CPU= 14.420
  15:28:05 STEP 2679 H=2679:00 +CPU= 21.244
  15:28:19 STEP 2680 H=2680:00 +CPU= 14.507
  15:28:34 STEP 2681 H=2681:00 +CPU= 14.162
  15:28:55 STEP 2682 H=2682:00 +CPU= 21.621
  15:29:09 STEP 2683 H=2683:00 +CPU= 14.070
  15:29:24 STEP 2684 H=2684:00 +CPU= 14.473
  15:29:45 STEP 2685 H=2685:00 +CPU= 21.216
  15:29:59 STEP 2686 H=2686:00 +CPU= 14.164
  15:30:14 STEP 2687 H=2687:00 +CPU= 14.722
  15:30:39 STEP 2688 H=2688:00 +CPU= 24.819
Moving to projects directory: /hdd/boinc-client/slots/1/ICMGGhnw4+002688
Moving to projects directory: /hdd/boinc-client/slots/1/ICMSHhnw4+002688
Moving to projects directory: /hdd/boinc-client/slots/1/ICMUAhnw4+002688
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMGGhnw4+002664
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMSHhnw4+002664
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMUAhnw4+002664
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMGGhnw4+002676
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMSHhnw4+002676
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMUAhnw4+002676
Zipping up the intermediate file: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_0192_2019110100_123_993_12215060_0_r518255869_111.zip
Uploading the intermediate file: upload_file_111.zip
  15:30:53 STEP 2689 H=2689:00 +CPU= 14.279
  15:31:08 STEP 2690 H=2690:00 +CPU= 14.369
  15:31:29 STEP 2691 H=2691:00 +CPU= 21.183
  15:31:43 STEP 2692 H=2692:00 +CPU= 14.396
  15:31:57 STEP 2693 H=2693:00 +CPU= 13.987
  15:32:19 STEP 2694 H=2694:00 +CPU= 21.545
  15:32:33 STEP 2695 H=2695:00 +CPU= 14.058
  15:32:47 STEP 2696 H=2696:00 +CPU= 14.565
  15:33:08 STEP 2697 H=2697:00 +CPU= 21.082
  15:33:23 STEP 2698 H=2698:00 +CPU= 14.308
  15:33:37 STEP 2699 H=2699:00 +CPU= 14.230
  15:34:00 STEP 2700 H=2700:00 +CPU= 22.972
Moving to projects directory: /hdd/boinc-client/slots/1/ICMGGhnw4+002700
Moving to projects directory: /hdd/boinc-client/slots/1/ICMSHhnw4+002700
Moving to projects directory: /hdd/boinc-client/slots/1/ICMUAhnw4+002700
  15:34:14 STEP 2701 H=2701:00 +CPU= 14.034
  15:34:29 STEP 2702 H=2702:00 +CPU= 14.453
  15:34:50 STEP 2703 H=2703:00 +CPU= 21.110
  15:35:04 STEP 2704 H=2704:00 +CPU= 14.382
  15:35:18 STEP 2705 H=2705:00 +CPU= 14.183
  15:35:40 STEP 2706 H=2706:00 +CPU= 21.485
  15:35:54 STEP 2707 H=2707:00 +CPU= 13.816
  15:36:08 STEP 2708 H=2708:00 +CPU= 14.608
  15:36:29 STEP 2709 H=2709:00 +CPU= 21.246
  15:36:44 STEP 2710 H=2710:00 +CPU= 14.275
  15:36:59 STEP 2711 H=2711:00 +CPU= 14.755
  15:37:24 STEP 2712 H=2712:00 +CPU= 25.008
Moving to projects directory: /hdd/boinc-client/slots/1/ICMGGhnw4+002712
Moving to projects directory: /hdd/boinc-client/slots/1/ICMSHhnw4+002712
Moving to projects directory: /hdd/boinc-client/slots/1/ICMUAhnw4+002712
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMGGhnw4+002688
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMSHhnw4+002688
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMUAhnw4+002688
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMGGhnw4+002700
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMSHhnw4+002700
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMUAhnw4+002700
Zipping up the intermediate file: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_0192_2019110100_123_993_12215060_0_r518255869_112.zip
Uploading the intermediate file: upload_file_112.zip
  15:37:38 STEP 2713 H=2713:00 +CPU= 14.037
  15:37:52 STEP 2714 H=2714:00 +CPU= 14.409
  15:38:13 STEP 2715 H=2715:00 +CPU= 21.249
  15:38:28 STEP 2716 H=2716:00 +CPU= 14.520
  15:38:42 STEP 2717 H=2717:00 +CPU= 14.122
  15:39:04 STEP 2718 H=2718:00 +CPU= 21.572
  15:39:18 STEP 2719 H=2719:00 +CPU= 13.972
  15:39:32 STEP 2720 H=2720:00 +CPU= 14.686
  15:39:53 STEP 2721 H=2721:00 +CPU= 21.161
  15:40:08 STEP 2722 H=2722:00 +CPU= 14.335
  15:40:22 STEP 2723 H=2723:00 +CPU= 14.162
  15:40:45 STEP 2724 H=2724:00 +CPU= 23.138
Moving to projects directory: /hdd/boinc-client/slots/1/ICMGGhnw4+002724
Moving to projects directory: /hdd/boinc-client/slots/1/ICMSHhnw4+002724
Moving to projects directory: /hdd/boinc-client/slots/1/ICMUAhnw4+002724
  15:40:59 STEP 2725 H=2725:00 +CPU= 14.081
  15:41:14 STEP 2726 H=2726:00 +CPU= 14.647
  15:41:35 STEP 2727 H=2727:00 +CPU= 21.357
  15:41:50 STEP 2728 H=2728:00 +CPU= 14.440
  15:42:04 STEP 2729 H=2729:00 +CPU= 14.369
  15:42:26 STEP 2730 H=2730:00 +CPU= 21.562
  15:42:39 STEP 2731 H=2731:00 +CPU= 13.802
  15:42:54 STEP 2732 H=2732:00 +CPU= 14.646
  15:43:16 STEP 2733 H=2733:00 +CPU= 21.542
  15:43:30 STEP 2734 H=2734:00 +CPU= 14.108
  15:43:44 STEP 2735 H=2735:00 +CPU= 14.744
  15:44:10 STEP 2736 H=2736:00 +CPU= 25.195
Moving to projects directory: /hdd/boinc-client/slots/1/ICMGGhnw4+002736
Moving to projects directory: /hdd/boinc-client/slots/1/ICMSHhnw4+002736
Moving to projects directory: /hdd/boinc-client/slots/1/ICMUAhnw4+002736
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMGGhnw4+002712
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMSHhnw4+002712
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMUAhnw4+002712
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMGGhnw4+002724
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMSHhnw4+002724
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMUAhnw4+002724
Zipping up the intermediate file: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_0192_2019110100_123_993_12215060_0_r518255869_113.zip
Uploading the intermediate file: upload_file_113.zip
  15:44:24 STEP 2737 H=2737:00 +CPU= 14.171
  15:44:38 STEP 2738 H=2738:00 +CPU= 14.486
  15:45:00 STEP 2739 H=2739:00 +CPU= 21.450
  15:45:14 STEP 2740 H=2740:00 +CPU= 14.379
  15:45:28 STEP 2741 H=2741:00 +CPU= 14.203
  15:45:50 STEP 2742 H=2742:00 +CPU= 21.708
  15:46:04 STEP 2743 H=2743:00 +CPU= 13.922
  15:46:19 STEP 2744 H=2744:00 +CPU= 14.653
  15:46:40 STEP 2745 H=2745:00 +CPU= 21.359
  15:46:54 STEP 2746 H=2746:00 +CPU= 14.176
  15:47:09 STEP 2747 H=2747:00 +CPU= 14.161
  15:47:32 STEP 2748 H=2748:00 +CPU= 23.222
Moving to projects directory: /hdd/boinc-client/slots/1/ICMGGhnw4+002748
Moving to projects directory: /hdd/boinc-client/slots/1/ICMSHhnw4+002748
Moving to projects directory: /hdd/boinc-client/slots/1/ICMUAhnw4+002748
  15:47:46 STEP 2749 H=2749:00 +CPU= 13.933
  15:48:00 STEP 2750 H=2750:00 +CPU= 14.456
  15:48:22 STEP 2751 H=2751:00 +CPU= 21.414
  15:48:36 STEP 2752 H=2752:00 +CPU= 14.378
  15:48:50 STEP 2753 H=2753:00 +CPU= 14.169
  15:49:12 STEP 2754 H=2754:00 +CPU= 21.666
  15:49:26 STEP 2755 H=2755:00 +CPU= 13.838
  15:49:40 STEP 2756 H=2756:00 +CPU= 14.485
  15:50:02 STEP 2757 H=2757:00 +CPU= 21.396
  15:50:16 STEP 2758 H=2758:00 +CPU= 14.192
  15:50:30 STEP 2759 H=2759:00 +CPU= 14.605
  15:50:56 STEP 2760 H=2760:00 +CPU= 25.030
Moving to projects directory: /hdd/boinc-client/slots/1/ICMGGhnw4+002760
Moving to projects directory: /hdd/boinc-client/slots/1/ICMSHhnw4+002760
Moving to projects directory: /hdd/boinc-client/slots/1/ICMUAhnw4+002760
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMGGhnw4+002736
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMSHhnw4+002736
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMUAhnw4+002736
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMGGhnw4+002748
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMSHhnw4+002748
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMUAhnw4+002748
Zipping up the intermediate file: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_0192_2019110100_123_993_12215060_0_r518255869_114.zip
Uploading the intermediate file: upload_file_114.zip
  15:51:09 STEP 2761 H=2761:00 +CPU= 13.771
  15:51:24 STEP 2762 H=2762:00 +CPU= 14.342
  15:51:45 STEP 2763 H=2763:00 +CPU= 21.429
  15:51:59 STEP 2764 H=2764:00 +CPU= 14.330
  15:52:14 STEP 2765 H=2765:00 +CPU= 14.112
  15:52:35 STEP 2766 H=2766:00 +CPU= 21.771
  15:52:49 STEP 2767 H=2767:00 +CPU= 13.830
  15:53:04 STEP 2768 H=2768:00 +CPU= 14.679
  15:53:25 STEP 2769 H=2769:00 +CPU= 21.384
  15:53:39 STEP 2770 H=2770:00 +CPU= 14.170
  15:53:54 STEP 2771 H=2771:00 +CPU= 14.240
  15:54:17 STEP 2772 H=2772:00 +CPU= 23.295
Moving to projects directory: /hdd/boinc-client/slots/1/ICMGGhnw4+002772
Moving to projects directory: /hdd/boinc-client/slots/1/ICMSHhnw4+002772
Moving to projects directory: /hdd/boinc-client/slots/1/ICMUAhnw4+002772
  15:54:31 STEP 2773 H=2773:00 +CPU= 13.907
  15:54:45 STEP 2774 H=2774:00 +CPU= 14.514
  15:55:07 STEP 2775 H=2775:00 +CPU= 21.304
  15:55:21 STEP 2776 H=2776:00 +CPU= 14.177
  15:55:35 STEP 2777 H=2777:00 +CPU= 14.202
  15:55:57 STEP 2778 H=2778:00 +CPU= 21.770
  15:56:11 STEP 2779 H=2779:00 +CPU= 13.643
  15:56:25 STEP 2780 H=2780:00 +CPU= 14.544
  15:56:47 STEP 2781 H=2781:00 +CPU= 21.428
  15:57:01 STEP 2782 H=2782:00 +CPU= 14.189
  15:57:15 STEP 2783 H=2783:00 +CPU= 14.648
  15:57:41 STEP 2784 H=2784:00 +CPU= 25.395
Moving to projects directory: /hdd/boinc-client/slots/1/ICMGGhnw4+002784
Moving to projects directory: /hdd/boinc-client/slots/1/ICMSHhnw4+002784
Moving to projects directory: /hdd/boinc-client/slots/1/ICMUAhnw4+002784
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMGGhnw4+002760
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMSHhnw4+002760
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMUAhnw4+002760
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMGGhnw4+002772
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMSHhnw4+002772
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMUAhnw4+002772
Zipping up the intermediate file: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_0192_2019110100_123_993_12215060_0_r518255869_115.zip
Uploading the intermediate file: upload_file_115.zip
  15:57:55 STEP 2785 H=2785:00 +CPU= 13.856
  15:58:09 STEP 2786 H=2786:00 +CPU= 14.495
  15:58:31 STEP 2787 H=2787:00 +CPU= 21.635
  15:58:45 STEP 2788 H=2788:00 +CPU= 14.185
  15:58:59 STEP 2789 H=2789:00 +CPU= 14.225
  15:59:21 STEP 2790 H=2790:00 +CPU= 21.933
  15:59:35 STEP 2791 H=2791:00 +CPU= 13.727
  15:59:50 STEP 2792 H=2792:00 +CPU= 14.523
  16:00:11 STEP 2793 H=2793:00 +CPU= 21.377
  16:00:25 STEP 2794 H=2794:00 +CPU= 14.200
  16:00:39 STEP 2795 H=2795:00 +CPU= 14.068
  16:01:03 STEP 2796 H=2796:00 +CPU= 23.416
Moving to projects directory: /hdd/boinc-client/slots/1/ICMGGhnw4+002796
Moving to projects directory: /hdd/boinc-client/slots/1/ICMSHhnw4+002796
Moving to projects directory: /hdd/boinc-client/slots/1/ICMUAhnw4+002796
  16:01:16 STEP 2797 H=2797:00 +CPU= 13.813
  16:01:31 STEP 2798 H=2798:00 +CPU= 14.432
  16:01:52 STEP 2799 H=2799:00 +CPU= 21.478
  16:02:07 STEP 2800 H=2800:00 +CPU= 14.158
  16:02:21 STEP 2801 H=2801:00 +CPU= 14.144
  16:02:43 STEP 2802 H=2802:00 +CPU= 21.976
  16:02:56 STEP 2803 H=2803:00 +CPU= 13.688
  16:03:11 STEP 2804 H=2804:00 +CPU= 14.524
  16:03:32 STEP 2805 H=2805:00 +CPU= 21.495
  16:03:47 STEP 2806 H=2806:00 +CPU= 14.265
  16:04:01 STEP 2807 H=2807:00 +CPU= 14.561
  16:04:27 STEP 2808 H=2808:00 +CPU= 25.445
Moving to projects directory: /hdd/boinc-client/slots/1/ICMGGhnw4+002808
Moving to projects directory: /hdd/boinc-client/slots/1/ICMSHhnw4+002808
Moving to projects directory: /hdd/boinc-client/slots/1/ICMUAhnw4+002808
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMGGhnw4+002784
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMSHhnw4+002784
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMUAhnw4+002784
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMGGhnw4+002796
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMSHhnw4+002796
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMUAhnw4+002796
Zipping up the intermediate file: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_0192_2019110100_123_993_12215060_0_r518255869_116.zip
Uploading the intermediate file: upload_file_116.zip
  16:04:40 STEP 2809 H=2809:00 +CPU= 13.701
  16:04:55 STEP 2810 H=2810:00 +CPU= 14.314
  16:05:17 STEP 2811 H=2811:00 +CPU= 21.785
  16:05:31 STEP 2812 H=2812:00 +CPU= 14.317
  16:05:45 STEP 2813 H=2813:00 +CPU= 14.056
  16:06:07 STEP 2814 H=2814:00 +CPU= 21.959
  16:06:21 STEP 2815 H=2815:00 +CPU= 13.660
  16:06:35 STEP 2816 H=2816:00 +CPU= 14.592
  16:06:57 STEP 2817 H=2817:00 +CPU= 21.522
  16:07:11 STEP 2818 H=2818:00 +CPU= 14.154
  16:07:25 STEP 2819 H=2819:00 +CPU= 14.152
  16:07:49 STEP 2820 H=2820:00 +CPU= 23.458
Moving to projects directory: /hdd/boinc-client/slots/1/ICMGGhnw4+002820
Moving to projects directory: /hdd/boinc-client/slots/1/ICMSHhnw4+002820
Moving to projects directory: /hdd/boinc-client/slots/1/ICMUAhnw4+002820
  16:08:02 STEP 2821 H=2821:00 +CPU= 13.732
  16:08:17 STEP 2822 H=2822:00 +CPU= 14.432
  16:08:38 STEP 2823 H=2823:00 +CPU= 21.522
  16:08:52 STEP 2824 H=2824:00 +CPU= 14.170
  16:09:06 STEP 2825 H=2825:00 +CPU= 14.036
  16:09:28 STEP 2826 H=2826:00 +CPU= 21.925
  16:09:42 STEP 2827 H=2827:00 +CPU= 13.700
  16:09:57 STEP 2828 H=2828:00 +CPU= 14.488
  16:10:18 STEP 2829 H=2829:00 +CPU= 21.459
  16:10:33 STEP 2830 H=2830:00 +CPU= 14.425
  16:10:47 STEP 2831 H=2831:00 +CPU= 14.553
  16:11:12 STEP 2832 H=2832:00 +CPU= 25.330
Moving to projects directory: /hdd/boinc-client/slots/1/ICMGGhnw4+002832
Moving to projects directory: /hdd/boinc-client/slots/1/ICMSHhnw4+002832
Moving to projects directory: /hdd/boinc-client/slots/1/ICMUAhnw4+002832
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMGGhnw4+002808
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMSHhnw4+002808
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMUAhnw4+002808
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMGGhnw4+002820
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMSHhnw4+002820
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMUAhnw4+002820
Zipping up the intermediate file: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_0192_2019110100_123_993_12215060_0_r518255869_117.zip
Uploading the intermediate file: upload_file_117.zip
  16:11:26 STEP 2833 H=2833:00 +CPU= 13.812
  16:11:41 STEP 2834 H=2834:00 +CPU= 14.402
  16:12:02 STEP 2835 H=2835:00 +CPU= 21.711
  16:12:17 STEP 2836 H=2836:00 +CPU= 14.243
  16:12:31 STEP 2837 H=2837:00 +CPU= 14.067
  16:12:53 STEP 2838 H=2838:00 +CPU= 21.983
  16:13:07 STEP 2839 H=2839:00 +CPU= 13.704
  16:13:21 STEP 2840 H=2840:00 +CPU= 14.606
  16:13:43 STEP 2841 H=2841:00 +CPU= 21.709
  16:13:57 STEP 2842 H=2842:00 +CPU= 14.156
  16:14:11 STEP 2843 H=2843:00 +CPU= 14.142
  16:14:35 STEP 2844 H=2844:00 +CPU= 23.431
Moving to projects directory: /hdd/boinc-client/slots/1/ICMGGhnw4+002844
Moving to projects directory: /hdd/boinc-client/slots/1/ICMSHhnw4+002844
Moving to projects directory: /hdd/boinc-client/slots/1/ICMUAhnw4+002844
  16:14:48 STEP 2845 H=2845:00 +CPU= 13.723
  16:15:03 STEP 2846 H=2846:00 +CPU= 14.424
  16:15:24 STEP 2847 H=2847:00 +CPU= 21.530
  16:15:38 STEP 2848 H=2848:00 +CPU= 14.075
  16:15:53 STEP 2849 H=2849:00 +CPU= 14.107
  16:16:15 STEP 2850 H=2850:00 +CPU= 22.029
  16:16:28 STEP 2851 H=2851:00 +CPU= 13.695
  16:16:43 STEP 2852 H=2852:00 +CPU= 14.505
  16:17:04 STEP 2853 H=2853:00 +CPU= 21.539
  16:17:19 STEP 2854 H=2854:00 +CPU= 14.262
  16:17:33 STEP 2855 H=2855:00 +CPU= 14.562
  16:17:59 STEP 2856 H=2856:00 +CPU= 25.383
Moving to projects directory: /hdd/boinc-client/slots/1/ICMGGhnw4+002856
Moving to projects directory: /hdd/boinc-client/slots/1/ICMSHhnw4+002856
Moving to projects directory: /hdd/boinc-client/slots/1/ICMUAhnw4+002856
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMGGhnw4+002832
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMSHhnw4+002832
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMUAhnw4+002832
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMGGhnw4+002844
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMSHhnw4+002844
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMUAhnw4+002844
Zipping up the intermediate file: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_0192_2019110100_123_993_12215060_0_r518255869_118.zip
Uploading the intermediate file: upload_file_118.zip
  16:18:13 STEP 2857 H=2857:00 +CPU= 13.925
  16:18:27 STEP 2858 H=2858:00 +CPU= 14.416
  16:18:49 STEP 2859 H=2859:00 +CPU= 21.912
  16:19:03 STEP 2860 H=2860:00 +CPU= 14.301
  16:19:17 STEP 2861 H=2861:00 +CPU= 14.248
  16:19:40 STEP 2862 H=2862:00 +CPU= 22.048
  16:19:53 STEP 2863 H=2863:00 +CPU= 13.771
  16:20:08 STEP 2864 H=2864:00 +CPU= 14.607
  16:20:29 STEP 2865 H=2865:00 +CPU= 21.522
  16:20:44 STEP 2866 H=2866:00 +CPU= 14.166
  16:20:58 STEP 2867 H=2867:00 +CPU= 14.131
  16:21:21 STEP 2868 H=2868:00 +CPU= 23.524
Moving to projects directory: /hdd/boinc-client/slots/1/ICMGGhnw4+002868
Moving to projects directory: /hdd/boinc-client/slots/1/ICMSHhnw4+002868
Moving to projects directory: /hdd/boinc-client/slots/1/ICMUAhnw4+002868
  16:21:35 STEP 2869 H=2869:00 +CPU= 13.960
  16:21:50 STEP 2870 H=2870:00 +CPU= 14.573
  16:22:12 STEP 2871 H=2871:00 +CPU= 21.640
  16:22:26 STEP 2872 H=2872:00 +CPU= 14.168
  16:22:40 STEP 2873 H=2873:00 +CPU= 14.329
  16:23:02 STEP 2874 H=2874:00 +CPU= 22.117
  16:23:16 STEP 2875 H=2875:00 +CPU= 13.759
  16:23:31 STEP 2876 H=2876:00 +CPU= 14.599
  16:23:52 STEP 2877 H=2877:00 +CPU= 21.561
  16:24:06 STEP 2878 H=2878:00 +CPU= 14.228
  16:24:21 STEP 2879 H=2879:00 +CPU= 14.621
  16:24:47 STEP 2880 H=2880:00 +CPU= 25.564
Moving to projects directory: /hdd/boinc-client/slots/1/ICMGGhnw4+002880
Moving to projects directory: /hdd/boinc-client/slots/1/ICMSHhnw4+002880
Moving to projects directory: /hdd/boinc-client/slots/1/ICMUAhnw4+002880
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMGGhnw4+002856
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMSHhnw4+002856
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMUAhnw4+002856
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMGGhnw4+002868
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMSHhnw4+002868
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMUAhnw4+002868
Zipping up the intermediate file: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_0192_2019110100_123_993_12215060_0_r518255869_119.zip
Uploading the intermediate file: upload_file_119.zip
  16:25:00 STEP 2881 H=2881:00 +CPU= 13.858
  16:25:15 STEP 2882 H=2882:00 +CPU= 14.453
Uploading trickle at timestep: 10368000
  16:25:37 STEP 2883 H=2883:00 +CPU= 21.790
  16:25:51 STEP 2884 H=2884:00 +CPU= 14.217
  16:26:05 STEP 2885 H=2885:00 +CPU= 14.209
  16:26:27 STEP 2886 H=2886:00 +CPU= 22.032
  16:26:41 STEP 2887 H=2887:00 +CPU= 13.748
  16:26:55 STEP 2888 H=2888:00 +CPU= 14.441
  16:27:17 STEP 2889 H=2889:00 +CPU= 21.489
  16:27:31 STEP 2890 H=2890:00 +CPU= 14.175
  16:27:45 STEP 2891 H=2891:00 +CPU= 14.006
  16:28:09 STEP 2892 H=2892:00 +CPU= 23.663
Moving to projects directory: /hdd/boinc-client/slots/1/ICMGGhnw4+002892
Moving to projects directory: /hdd/boinc-client/slots/1/ICMSHhnw4+002892
Moving to projects directory: /hdd/boinc-client/slots/1/ICMUAhnw4+002892
  16:28:23 STEP 2893 H=2893:00 +CPU= 13.863
  16:28:37 STEP 2894 H=2894:00 +CPU= 14.577
  16:28:59 STEP 2895 H=2895:00 +CPU= 21.592
  16:29:13 STEP 2896 H=2896:00 +CPU= 14.133
  16:29:27 STEP 2897 H=2897:00 +CPU= 14.216
  16:29:49 STEP 2898 H=2898:00 +CPU= 22.058
  16:30:03 STEP 2899 H=2899:00 +CPU= 13.707
  16:30:18 STEP 2900 H=2900:00 +CPU= 14.593
  16:30:39 STEP 2901 H=2901:00 +CPU= 21.515
  16:30:53 STEP 2902 H=2902:00 +CPU= 14.249
  16:31:08 STEP 2903 H=2903:00 +CPU= 14.605
  16:31:34 STEP 2904 H=2904:00 +CPU= 25.573
Moving to projects directory: /hdd/boinc-client/slots/1/ICMGGhnw4+002904
Moving to projects directory: /hdd/boinc-client/slots/1/ICMSHhnw4+002904
Moving to projects directory: /hdd/boinc-client/slots/1/ICMUAhnw4+002904
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMGGhnw4+002880
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMSHhnw4+002880
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMUAhnw4+002880
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMGGhnw4+002892
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMSHhnw4+002892
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMUAhnw4+002892
Zipping up the intermediate file: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_0192_2019110100_123_993_12215060_0_r518255869_120.zip
Uploading the intermediate file: upload_file_120.zip
  16:31:47 STEP 2905 H=2905:00 +CPU= 13.794
  16:32:02 STEP 2906 H=2906:00 +CPU= 14.388
  16:32:24 STEP 2907 H=2907:00 +CPU= 21.609
  16:32:38 STEP 2908 H=2908:00 +CPU= 14.197
  16:32:52 STEP 2909 H=2909:00 +CPU= 14.461
  16:33:14 STEP 2910 H=2910:00 +CPU= 21.832
  16:33:28 STEP 2911 H=2911:00 +CPU= 13.682
  16:33:42 STEP 2912 H=2912:00 +CPU= 14.444
  16:34:04 STEP 2913 H=2913:00 +CPU= 21.408
  16:34:18 STEP 2914 H=2914:00 +CPU= 14.169
  16:34:32 STEP 2915 H=2915:00 +CPU= 14.079
  16:34:55 STEP 2916 H=2916:00 +CPU= 23.431
Moving to projects directory: /hdd/boinc-client/slots/1/ICMGGhnw4+002916
Moving to projects directory: /hdd/boinc-client/slots/1/ICMSHhnw4+002916
Moving to projects directory: /hdd/boinc-client/slots/1/ICMUAhnw4+002916
  16:35:09 STEP 2917 H=2917:00 +CPU= 13.784
  16:35:24 STEP 2918 H=2918:00 +CPU= 14.343
  16:35:45 STEP 2919 H=2919:00 +CPU= 21.507
  16:35:59 STEP 2920 H=2920:00 +CPU= 14.102
  16:36:13 STEP 2921 H=2921:00 +CPU= 14.002
  16:36:35 STEP 2922 H=2922:00 +CPU= 21.827
  16:36:49 STEP 2923 H=2923:00 +CPU= 13.670
  16:37:03 STEP 2924 H=2924:00 +CPU= 14.441
  16:37:25 STEP 2925 H=2925:00 +CPU= 21.515
  16:37:39 STEP 2926 H=2926:00 +CPU= 14.234
  16:37:54 STEP 2927 H=2927:00 +CPU= 14.538
  16:38:19 STEP 2928 H=2928:00 +CPU= 25.358
Moving to projects directory: /hdd/boinc-client/slots/1/ICMGGhnw4+002928
Moving to projects directory: /hdd/boinc-client/slots/1/ICMSHhnw4+002928
Moving to projects directory: /hdd/boinc-client/slots/1/ICMUAhnw4+002928
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMGGhnw4+002904
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMSHhnw4+002904
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMUAhnw4+002904
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMGGhnw4+002916
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMSHhnw4+002916
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMUAhnw4+002916
Zipping up the intermediate file: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_0192_2019110100_123_993_12215060_0_r518255869_121.zip
Uploading the intermediate file: upload_file_121.zip
  16:38:33 STEP 2929 H=2929:00 +CPU= 13.872
  16:38:47 STEP 2930 H=2930:00 +CPU= 14.368
  16:39:09 STEP 2931 H=2931:00 +CPU= 21.844
  16:39:23 STEP 2932 H=2932:00 +CPU= 14.253
  16:39:38 STEP 2933 H=2933:00 +CPU= 14.199
  16:40:00 STEP 2934 H=2934:00 +CPU= 22.012
  16:40:13 STEP 2935 H=2935:00 +CPU= 13.727
  16:40:28 STEP 2936 H=2936:00 +CPU= 14.537
  16:40:49 STEP 2937 H=2937:00 +CPU= 21.622
  16:41:04 STEP 2938 H=2938:00 +CPU= 14.198
  16:41:18 STEP 2939 H=2939:00 +CPU= 14.107
  16:41:41 STEP 2940 H=2940:00 +CPU= 23.451
Moving to projects directory: /hdd/boinc-client/slots/1/ICMGGhnw4+002940
Moving to projects directory: /hdd/boinc-client/slots/1/ICMSHhnw4+002940
Moving to projects directory: /hdd/boinc-client/slots/1/ICMUAhnw4+002940
  16:41:55 STEP 2941 H=2941:00 +CPU= 13.831
  16:42:10 STEP 2942 H=2942:00 +CPU= 14.477
  16:42:31 STEP 2943 H=2943:00 +CPU= 21.521
  16:42:45 STEP 2944 H=2944:00 +CPU= 14.135
  16:42:59 STEP 2945 H=2945:00 +CPU= 14.116
  16:43:21 STEP 2946 H=2946:00 +CPU= 21.950
  16:43:35 STEP 2947 H=2947:00 +CPU= 13.679
  16:43:49 STEP 2948 H=2948:00 +CPU= 14.447
  16:44:11 STEP 2949 H=2949:00 +CPU= 21.606
  16:44:25 STEP 2950 H=2950:00 +CPU= 14.193
  16:44:40 STEP 2951 H=2951:00 +CPU= 14.504
  16:45:04 STEP 2952 H=2952:00 +CPU= 24.231
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

  FIELD LEV        AVERAGE               MINIMUM               MAXIMUM       
    101  60  3.19925486346338E-02 -1.00000000000000E+00  1.00000000000000E+00
  MAXGPFV : MAX. VALUE =    1.18310829420388     
  MAXGPFV : MAX. VALUE =   0.766000000000000     
 NSTEP =  2952 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGhnw4+002952 MODE=a
 IO-STREAM CLOSED - ICMGGhnw4+002952
 MPI-TASK:   1 -    322847402 BYTES IN      8 RECORDS TRANSFERRED IN    0.0004 SECONDS807118.5 Mbytes/s, TOTAL TIME=    0.0067( 6.0%)
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200302231500  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200302233000  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200302234500  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200303000000  !!!!!!!!!!!! 
 16:45:04 STEP 2952 H=2952:00 +CPU= 24.231
 END CNT3
 NSTEP =  2952 CNT0   000000000  20.993  20.993  21.017   0.999               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ          654/    28953814 WRITTEN        46048/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1   1116    0      654        28275    46048 ************   137.8     0.0   137.8     0.8   222.4
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 ********* *********    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 ********* *********    100.00      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                 3200    1719.3    1719.3     11.03      0.00
   9 SPCM     - SPECTRAL COMP.                    2952     283.1     283.1      1.68      0.00
  10 SCAN2M - PHYSICS                             2953    6884.9    6884.9     40.76      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                247     865.7     865.7      0.43      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                126      11.8      11.8      0.00      0.00
  13 SCAN2M - RADIATION CALC.                      985    7160.7    7160.7     14.14      0.00
  14 SUINIF                                          1    1370.9    1370.9      0.00      0.00
  17 GRIDFPOS IN CNT4                              247      27.8      27.8      0.01      0.00
  18 SUSPECG                                         1     249.2     249.2      0.00      0.00
  19 SUSPEC                                          1     256.0     256.0      0.00      0.00
  24 SUGRIDU                                         1     864.0     864.0      0.00      0.00
  25 SPECRT                                          1     120.8     120.8      0.00      0.00
  26 SUGRIDF                                         1     130.0     130.0      0.00      0.00
  27 RESTART FILES - WRITING                       123    1738.4    1738.4      0.43      0.00
  28 RESTART FILES - READING                         1       0.0       0.0      0.00      0.00
  29 SU4FPOS IN CNT4                               247       0.0       0.0      0.00      0.00
  30 DYNFPOS IN CNT4                               247    1377.9    1377.9      0.68      0.00
  31 POSDDH IN STEPO                                13       0.8       0.8      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                   2953    2394.3    2394.3     14.17      0.00
  38 WAM      - TOTAL COST OF WAVE MODEL          2952    1708.9    1708.9     10.11      0.00
  39 SU0YOMB                                         1     176.7     176.7      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                   2953      16.3      16.3      0.10      0.00
  54 SPCM     - M TO S/S TO M TRANSP.             2952     260.6     260.6      1.54      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.             2952      43.3      43.3      0.26      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                126       0.1       0.1      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM    10094      93.1      93.1      1.88      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM      6152      88.9      88.9      1.10      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM       6152      35.8      35.8      0.44      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM     10094      32.6      32.6      0.66      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            2      15.1      15.1      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION          10094      15.6      15.6      0.32      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION           6152      14.0      14.0      0.17      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION          10094      15.8      15.8      0.32      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION           6152      10.9      10.9      0.13      0.00
 400 GSTATS                                     589499       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                564603       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME    49883.4 CPU TIME   49843.1 VECTOR TIME    49843.1


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY      213.0
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /hdd/boinc-client/slots/1/ICMGGhnw4+002952
Moving to projects directory: /hdd/boinc-client/slots/1/ICMSHhnw4+002952
Moving to projects directory: /hdd/boinc-client/slots/1/ICMUAhnw4+002952
Adding to the zip: /hdd/boinc-client/slots/1/NODE.001_01
Adding to the zip: /hdd/boinc-client/slots/1/ifs.stat
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMSHhnw4+002952
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMUAhnw4+002952
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMSHhnw4+002940
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMUAhnw4+002940
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMGGhnw4+002928
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMGGhnw4+002952
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMGGhnw4+002940
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMSHhnw4+002928
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12215060/ICMUAhnw4+002928
Zipping up the final file: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_0192_2019110100_123_993_12215060_0_r518255869_122.zip
Uploading the final file: upload_file_122.zip
Uploading trickle at timestep: 10623600
16:48:27 (62891): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:53:52 1497236 22316454 oifs_43r3_0192_2019110100_123_993_12215060_0 10,623,600 49,843 0.0047
09 May 2023 16:53:49 1497236 22316454 oifs_43r3_0192_2019110100_123_993_12215060_0 10,368,000 48,634 0.0047
09 May 2023 16:53:46 1497236 22316454 oifs_43r3_0192_2019110100_123_993_12215060_0 9,504,000 44,572 0.0047
09 May 2023 16:53:43 1497236 22316454 oifs_43r3_0192_2019110100_123_993_12215060_0 8,640,000 40,521 0.0047
09 May 2023 16:53:40 1497236 22316454 oifs_43r3_0192_2019110100_123_993_12215060_0 7,776,000 36,450 0.0047
09 May 2023 16:53:37 1497236 22316454 oifs_43r3_0192_2019110100_123_993_12215060_0 6,912,000 32,391 0.0047
09 May 2023 16:53:34 1497236 22316454 oifs_43r3_0192_2019110100_123_993_12215060_0 6,048,000 28,360 0.0047
09 May 2023 16:53:31 1497236 22316454 oifs_43r3_0192_2019110100_123_993_12215060_0 5,184,000 24,368 0.0047
09 May 2023 16:53:25 1497236 22316454 oifs_43r3_0192_2019110100_123_993_12215060_0 4,320,000 20,326 0.0047
09 May 2023 16:53:22 1497236 22316454 oifs_43r3_0192_2019110100_123_993_12215060_0 3,456,000 16,274 0.0047
09 May 2023 16:53:18 1497236 22316454 oifs_43r3_0192_2019110100_123_993_12215060_0 2,592,000 12,213 0.0047
09 May 2023 16:53:15 1497236 22316454 oifs_43r3_0192_2019110100_123_993_12215060_0 1,728,000 8,161 0.0047
09 May 2023 16:53:12 1497236 22316454 oifs_43r3_0192_2019110100_123_993_12215060_0 864,000 4,100 0.0047


©2024 climateprediction.net