climateprediction.net home page
Task 22315181

Task 22315181

Name oifs_43r3_00ay_2019110100_123_993_12213832_0
Workunit 12213832
Created 24 Feb 2023, 12:52:07 UTC
Sent 24 Feb 2023, 13:00:24 UTC
Report deadline 25 Apr 2023, 13:00:24 UTC
Received 25 Feb 2023, 19:21:17 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1535805
Run time 10 hours 18 min 31 sec
CPU time 10 hours 14 min 45 sec
Validate state Valid
Credit 14,873.04
Device peak FLOPS 8.83 GFLOPS
Application version OpenIFS 43r3 v1.21
x86_64-pc-linux-gnu
Peak working set size 4,368.76 MB
Peak swap size 4,983.16 MB
Peak disk usage 1,267.57 MB
Stderr
<core_client_version>7.18.1</core_client_version>
<![CDATA[
<stderr_txt>
nc-client-cpdn/slots/1/ICMUAhnw4+002460
  12:08:41 STEP 2461 H=2461:00 +CPU=  9.950
  12:08:52 STEP 2462 H=2462:00 +CPU= 10.758
  12:09:08 STEP 2463 H=2463:00 +CPU= 16.031
  12:09:18 STEP 2464 H=2464:00 +CPU= 10.323
  12:09:29 STEP 2465 H=2465:00 +CPU= 10.093
  12:09:45 STEP 2466 H=2466:00 +CPU= 16.009
  12:09:55 STEP 2467 H=2467:00 +CPU= 10.017
  12:10:05 STEP 2468 H=2468:00 +CPU= 10.399
  12:10:21 STEP 2469 H=2469:00 +CPU= 15.837
  12:10:31 STEP 2470 H=2470:00 +CPU= 10.053
  12:10:42 STEP 2471 H=2471:00 +CPU= 10.787
  12:11:01 STEP 2472 H=2472:00 +CPU= 18.924
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMGGhnw4+002472
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMSHhnw4+002472
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMUAhnw4+002472
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMGGhnw4+002448
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMSHhnw4+002448
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMUAhnw4+002448
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMGGhnw4+002460
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMSHhnw4+002460
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMUAhnw4+002460
Zipping up the intermediate file: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_00ay_2019110100_123_993_12213832_0_r463720082_102.zip
Uploading the intermediate file: upload_file_102.zip
  12:11:11 STEP 2473 H=2473:00 +CPU= 10.197
  12:11:21 STEP 2474 H=2474:00 +CPU= 10.502
  12:11:38 STEP 2475 H=2475:00 +CPU= 16.402
  12:11:48 STEP 2476 H=2476:00 +CPU= 10.630
  12:11:59 STEP 2477 H=2477:00 +CPU= 10.177
  12:12:15 STEP 2478 H=2478:00 +CPU= 16.106
  12:12:25 STEP 2479 H=2479:00 +CPU= 10.183
  12:12:35 STEP 2480 H=2480:00 +CPU= 10.539
  12:12:51 STEP 2481 H=2481:00 +CPU= 15.635
  12:13:02 STEP 2482 H=2482:00 +CPU= 10.572
  12:13:12 STEP 2483 H=2483:00 +CPU= 10.007
  12:13:29 STEP 2484 H=2484:00 +CPU= 17.720
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMGGhnw4+002484
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMSHhnw4+002484
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMUAhnw4+002484
  12:13:40 STEP 2485 H=2485:00 +CPU= 10.164
  12:13:50 STEP 2486 H=2486:00 +CPU= 10.351
  12:14:06 STEP 2487 H=2487:00 +CPU= 15.762
  12:14:16 STEP 2488 H=2488:00 +CPU= 10.111
  12:14:26 STEP 2489 H=2489:00 +CPU=  9.791
  12:14:42 STEP 2490 H=2490:00 +CPU= 16.045
  12:14:52 STEP 2491 H=2491:00 +CPU= 10.019
  12:15:02 STEP 2492 H=2492:00 +CPU= 10.348
  12:15:18 STEP 2493 H=2493:00 +CPU= 16.154
  12:15:29 STEP 2494 H=2494:00 +CPU= 10.929
  12:15:40 STEP 2495 H=2495:00 +CPU= 11.097
  12:15:58 STEP 2496 H=2496:00 +CPU= 18.300
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMGGhnw4+002496
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMSHhnw4+002496
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMUAhnw4+002496
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMGGhnw4+002472
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMSHhnw4+002472
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMUAhnw4+002472
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMGGhnw4+002484
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMSHhnw4+002484
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMUAhnw4+002484
Zipping up the intermediate file: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_00ay_2019110100_123_993_12213832_0_r463720082_103.zip
Uploading the intermediate file: upload_file_103.zip
  12:16:08 STEP 2497 H=2497:00 +CPU=  9.671
  12:16:18 STEP 2498 H=2498:00 +CPU=  9.978
  12:16:34 STEP 2499 H=2499:00 +CPU= 16.032
  12:16:44 STEP 2500 H=2500:00 +CPU= 10.155
  12:16:54 STEP 2501 H=2501:00 +CPU=  9.770
  12:17:10 STEP 2502 H=2502:00 +CPU= 16.408
  12:17:20 STEP 2503 H=2503:00 +CPU=  9.961
  12:17:31 STEP 2504 H=2504:00 +CPU= 10.194
  12:17:46 STEP 2505 H=2505:00 +CPU= 15.618
  12:17:56 STEP 2506 H=2506:00 +CPU= 10.183
  12:18:06 STEP 2507 H=2507:00 +CPU= 10.025
  12:18:24 STEP 2508 H=2508:00 +CPU= 17.222
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMGGhnw4+002508
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMSHhnw4+002508
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMUAhnw4+002508
  12:18:33 STEP 2509 H=2509:00 +CPU=  9.779
  12:18:44 STEP 2510 H=2510:00 +CPU= 10.070
  12:18:59 STEP 2511 H=2511:00 +CPU= 15.846
  12:19:10 STEP 2512 H=2512:00 +CPU= 10.370
  12:19:20 STEP 2513 H=2513:00 +CPU= 10.317
  12:19:36 STEP 2514 H=2514:00 +CPU= 16.312
  12:19:46 STEP 2515 H=2515:00 +CPU= 10.020
  12:19:57 STEP 2516 H=2516:00 +CPU= 10.538
  12:20:13 STEP 2517 H=2517:00 +CPU= 15.854
  12:20:23 STEP 2518 H=2518:00 +CPU= 10.047
  12:20:33 STEP 2519 H=2519:00 +CPU= 10.073
  12:20:52 STEP 2520 H=2520:00 +CPU= 18.542
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMGGhnw4+002520
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMSHhnw4+002520
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMUAhnw4+002520
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMGGhnw4+002496
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMSHhnw4+002496
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMUAhnw4+002496
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMGGhnw4+002508
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMSHhnw4+002508
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMUAhnw4+002508
Zipping up the intermediate file: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_00ay_2019110100_123_993_12213832_0_r463720082_104.zip
Uploading the intermediate file: upload_file_104.zip
  12:21:02 STEP 2521 H=2521:00 +CPU=  9.975
  12:21:12 STEP 2522 H=2522:00 +CPU= 10.325
  12:21:28 STEP 2523 H=2523:00 +CPU= 15.752
  12:21:38 STEP 2524 H=2524:00 +CPU= 10.111
  12:21:47 STEP 2525 H=2525:00 +CPU=  9.773
  12:22:03 STEP 2526 H=2526:00 +CPU= 15.990
  12:22:14 STEP 2527 H=2527:00 +CPU= 10.374
  12:22:24 STEP 2528 H=2528:00 +CPU= 10.342
  12:22:40 STEP 2529 H=2529:00 +CPU= 15.956
  12:22:50 STEP 2530 H=2530:00 +CPU= 10.249
  12:23:01 STEP 2531 H=2531:00 +CPU= 10.169
  12:23:18 STEP 2532 H=2532:00 +CPU= 17.362
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMGGhnw4+002532
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMSHhnw4+002532
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMUAhnw4+002532
  12:23:28 STEP 2533 H=2533:00 +CPU= 10.083
  12:23:38 STEP 2534 H=2534:00 +CPU= 10.251
  12:23:54 STEP 2535 H=2535:00 +CPU= 16.023
  12:24:05 STEP 2536 H=2536:00 +CPU= 10.430
  12:24:15 STEP 2537 H=2537:00 +CPU= 10.006
  12:24:31 STEP 2538 H=2538:00 +CPU= 15.899
  12:24:41 STEP 2539 H=2539:00 +CPU= 10.056
  12:24:51 STEP 2540 H=2540:00 +CPU= 10.250
  12:25:07 STEP 2541 H=2541:00 +CPU= 15.981
  12:25:17 STEP 2542 H=2542:00 +CPU= 10.425
  12:25:28 STEP 2543 H=2543:00 +CPU= 10.365
  12:25:47 STEP 2544 H=2544:00 +CPU= 18.647
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMGGhnw4+002544
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMSHhnw4+002544
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMUAhnw4+002544
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMGGhnw4+002520
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMSHhnw4+002520
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMUAhnw4+002520
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMGGhnw4+002532
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMSHhnw4+002532
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMUAhnw4+002532
Zipping up the intermediate file: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_00ay_2019110100_123_993_12213832_0_r463720082_105.zip
Uploading the intermediate file: upload_file_105.zip
  12:25:57 STEP 2545 H=2545:00 +CPU= 10.503
  12:26:08 STEP 2546 H=2546:00 +CPU= 10.507
  12:26:24 STEP 2547 H=2547:00 +CPU= 15.954
  12:26:34 STEP 2548 H=2548:00 +CPU= 10.266
  12:26:44 STEP 2549 H=2549:00 +CPU= 10.043
  12:27:00 STEP 2550 H=2550:00 +CPU= 16.370
  12:27:10 STEP 2551 H=2551:00 +CPU= 10.040
  12:27:21 STEP 2552 H=2552:00 +CPU= 10.179
  12:27:36 STEP 2553 H=2553:00 +CPU= 15.789
  12:27:47 STEP 2554 H=2554:00 +CPU= 10.460
  12:27:57 STEP 2555 H=2555:00 +CPU= 10.209
  12:28:15 STEP 2556 H=2556:00 +CPU= 17.542
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMGGhnw4+002556
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMSHhnw4+002556
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMUAhnw4+002556
  12:28:25 STEP 2557 H=2557:00 +CPU= 10.287
  12:28:36 STEP 2558 H=2558:00 +CPU= 10.634
  12:28:52 STEP 2559 H=2559:00 +CPU= 16.583
  12:29:03 STEP 2560 H=2560:00 +CPU= 10.599
  12:29:13 STEP 2561 H=2561:00 +CPU= 10.358
  12:29:30 STEP 2562 H=2562:00 +CPU= 17.137
  12:29:41 STEP 2563 H=2563:00 +CPU= 10.523
  12:29:52 STEP 2564 H=2564:00 +CPU= 11.173
  12:30:08 STEP 2565 H=2565:00 +CPU= 15.927
  12:30:18 STEP 2566 H=2566:00 +CPU=  9.999
  12:30:28 STEP 2567 H=2567:00 +CPU= 10.353
  12:30:47 STEP 2568 H=2568:00 +CPU= 18.387
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMGGhnw4+002568
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMSHhnw4+002568
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMUAhnw4+002568
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMGGhnw4+002544
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMSHhnw4+002544
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMUAhnw4+002544
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMGGhnw4+002556
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMSHhnw4+002556
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMUAhnw4+002556
Zipping up the intermediate file: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_00ay_2019110100_123_993_12213832_0_r463720082_106.zip
Uploading the intermediate file: upload_file_106.zip
  12:30:57 STEP 2569 H=2569:00 +CPU= 10.057
  12:31:07 STEP 2570 H=2570:00 +CPU= 10.525
  12:31:23 STEP 2571 H=2571:00 +CPU= 15.585
  12:31:33 STEP 2572 H=2572:00 +CPU= 10.182
  12:31:43 STEP 2573 H=2573:00 +CPU=  9.918
  12:32:00 STEP 2574 H=2574:00 +CPU= 16.588
  12:32:10 STEP 2575 H=2575:00 +CPU=  9.916
  12:32:20 STEP 2576 H=2576:00 +CPU= 10.108
  12:32:35 STEP 2577 H=2577:00 +CPU= 15.755
  12:32:46 STEP 2578 H=2578:00 +CPU= 10.226
  12:32:56 STEP 2579 H=2579:00 +CPU=  9.922
  12:33:13 STEP 2580 H=2580:00 +CPU= 17.159
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMGGhnw4+002580
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMSHhnw4+002580
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMUAhnw4+002580
  12:33:23 STEP 2581 H=2581:00 +CPU= 10.484
  12:33:34 STEP 2582 H=2582:00 +CPU= 10.561
  12:33:50 STEP 2583 H=2583:00 +CPU= 16.197
  12:34:00 STEP 2584 H=2584:00 +CPU= 10.042
  12:34:10 STEP 2585 H=2585:00 +CPU=  9.964
  12:34:26 STEP 2586 H=2586:00 +CPU= 16.264
  12:34:36 STEP 2587 H=2587:00 +CPU=  9.910
  12:34:46 STEP 2588 H=2588:00 +CPU= 10.261
  12:35:02 STEP 2589 H=2589:00 +CPU= 15.975
  12:35:13 STEP 2590 H=2590:00 +CPU= 10.348
  12:35:23 STEP 2591 H=2591:00 +CPU= 10.712
  12:35:42 STEP 2592 H=2592:00 +CPU= 18.947
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMGGhnw4+002592
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMSHhnw4+002592
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMUAhnw4+002592
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMGGhnw4+002568
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMSHhnw4+002568
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMUAhnw4+002568
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMGGhnw4+002580
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMSHhnw4+002580
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMUAhnw4+002580
Zipping up the intermediate file: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_00ay_2019110100_123_993_12213832_0_r463720082_107.zip
Uploading the intermediate file: upload_file_107.zip
  12:35:52 STEP 2593 H=2593:00 +CPU=  9.976
  12:36:03 STEP 2594 H=2594:00 +CPU= 10.349
  12:36:19 STEP 2595 H=2595:00 +CPU= 15.706
  12:36:29 STEP 2596 H=2596:00 +CPU= 10.197
  12:36:39 STEP 2597 H=2597:00 +CPU= 10.293
  12:36:56 STEP 2598 H=2598:00 +CPU= 16.807
  12:37:06 STEP 2599 H=2599:00 +CPU= 10.082
  12:37:17 STEP 2600 H=2600:00 +CPU= 10.689
  12:37:33 STEP 2601 H=2601:00 +CPU= 16.021
  12:37:43 STEP 2602 H=2602:00 +CPU= 10.429
  12:37:53 STEP 2603 H=2603:00 +CPU= 10.327
  12:38:11 STEP 2604 H=2604:00 +CPU= 17.389
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMGGhnw4+002604
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMSHhnw4+002604
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMUAhnw4+002604
  12:38:21 STEP 2605 H=2605:00 +CPU= 10.052
  12:38:31 STEP 2606 H=2606:00 +CPU= 10.423
  12:38:47 STEP 2607 H=2607:00 +CPU= 15.652
  12:38:57 STEP 2608 H=2608:00 +CPU= 10.018
  12:39:07 STEP 2609 H=2609:00 +CPU= 10.124
  12:39:23 STEP 2610 H=2610:00 +CPU= 16.330
  12:39:34 STEP 2611 H=2611:00 +CPU= 10.475
  12:39:44 STEP 2612 H=2612:00 +CPU= 10.559
  12:40:01 STEP 2613 H=2613:00 +CPU= 16.146
  12:40:11 STEP 2614 H=2614:00 +CPU= 10.445
  12:40:21 STEP 2615 H=2615:00 +CPU= 10.386
  12:40:40 STEP 2616 H=2616:00 +CPU= 18.238
  12:40:50 STEP 2617 H=2617:00 +CPU=  9.995
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMGGhnw4+002616
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMSHhnw4+002616
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMUAhnw4+002616
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMGGhnw4+002592
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMSHhnw4+002592
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMUAhnw4+002592
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMGGhnw4+002604
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMSHhnw4+002604
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMUAhnw4+002604
Zipping up the intermediate file: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_00ay_2019110100_123_993_12213832_0_r463720082_108.zip
Uploading the intermediate file: upload_file_108.zip
  12:41:00 STEP 2618 H=2618:00 +CPU= 10.011
  12:41:15 STEP 2619 H=2619:00 +CPU= 15.559
  12:41:25 STEP 2620 H=2620:00 +CPU= 10.065
  12:41:35 STEP 2621 H=2621:00 +CPU=  9.701
  12:41:51 STEP 2622 H=2622:00 +CPU= 15.962
  12:42:01 STEP 2623 H=2623:00 +CPU=  9.764
  12:42:11 STEP 2624 H=2624:00 +CPU=  9.983
  12:42:26 STEP 2625 H=2625:00 +CPU= 15.802
  12:42:37 STEP 2626 H=2626:00 +CPU= 10.244
  12:42:46 STEP 2627 H=2627:00 +CPU=  9.732
  12:43:03 STEP 2628 H=2628:00 +CPU= 16.861
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMGGhnw4+002628
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMSHhnw4+002628
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMUAhnw4+002628
  12:43:13 STEP 2629 H=2629:00 +CPU=  9.783
  12:43:23 STEP 2630 H=2630:00 +CPU= 10.300
  12:43:40 STEP 2631 H=2631:00 +CPU= 16.354
  12:43:50 STEP 2632 H=2632:00 +CPU= 10.177
  12:44:00 STEP 2633 H=2633:00 +CPU=  9.793
  12:44:16 STEP 2634 H=2634:00 +CPU= 15.835
  12:44:25 STEP 2635 H=2635:00 +CPU=  9.598
  12:44:35 STEP 2636 H=2636:00 +CPU= 10.042
  12:44:51 STEP 2637 H=2637:00 +CPU= 15.822
  12:45:01 STEP 2638 H=2638:00 +CPU=  9.888
  12:45:11 STEP 2639 H=2639:00 +CPU= 10.093
  12:45:29 STEP 2640 H=2640:00 +CPU= 18.238
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMGGhnw4+002640
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMSHhnw4+002640
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMUAhnw4+002640
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMGGhnw4+002616
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMSHhnw4+002616
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMUAhnw4+002616
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMGGhnw4+002628
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMSHhnw4+002628
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMUAhnw4+002628
Zipping up the intermediate file: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_00ay_2019110100_123_993_12213832_0_r463720082_109.zip
Uploading the intermediate file: upload_file_109.zip
  12:45:39 STEP 2641 H=2641:00 +CPU=  9.756
  12:45:49 STEP 2642 H=2642:00 +CPU= 10.272
Uploading trickle at timestep: 9504000
  12:46:05 STEP 2643 H=2643:00 +CPU= 15.584
  12:46:15 STEP 2644 H=2644:00 +CPU= 10.259
  12:46:25 STEP 2645 H=2645:00 +CPU=  9.906
  12:46:41 STEP 2646 H=2646:00 +CPU= 15.876
  12:46:51 STEP 2647 H=2647:00 +CPU=  9.690
  12:47:01 STEP 2648 H=2648:00 +CPU= 10.189
  12:47:17 STEP 2649 H=2649:00 +CPU= 15.845
  12:47:27 STEP 2650 H=2650:00 +CPU= 10.586
  12:47:38 STEP 2651 H=2651:00 +CPU= 10.285
  12:47:54 STEP 2652 H=2652:00 +CPU= 16.712
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMGGhnw4+002652
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMSHhnw4+002652
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMUAhnw4+002652
  12:48:04 STEP 2653 H=2653:00 +CPU=  9.700
  12:48:14 STEP 2654 H=2654:00 +CPU= 10.045
  12:48:30 STEP 2655 H=2655:00 +CPU= 15.550
  12:48:40 STEP 2656 H=2656:00 +CPU= 10.244
  12:48:50 STEP 2657 H=2657:00 +CPU= 10.112
  12:49:07 STEP 2658 H=2658:00 +CPU= 16.484
  12:49:16 STEP 2659 H=2659:00 +CPU=  9.891
  12:49:27 STEP 2660 H=2660:00 +CPU= 10.298
  12:49:43 STEP 2661 H=2661:00 +CPU= 15.763
  12:49:53 STEP 2662 H=2662:00 +CPU= 10.232
  12:50:03 STEP 2663 H=2663:00 +CPU= 10.048
  12:50:21 STEP 2664 H=2664:00 +CPU= 18.343
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMGGhnw4+002664
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMSHhnw4+002664
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMUAhnw4+002664
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMGGhnw4+002640
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMSHhnw4+002640
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMUAhnw4+002640
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMGGhnw4+002652
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMSHhnw4+002652
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMUAhnw4+002652
Zipping up the intermediate file: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_00ay_2019110100_123_993_12213832_0_r463720082_110.zip
Uploading the intermediate file: upload_file_110.zip
  12:50:31 STEP 2665 H=2665:00 +CPU=  9.933
  12:50:41 STEP 2666 H=2666:00 +CPU=  9.841
  12:50:57 STEP 2667 H=2667:00 +CPU= 15.533
  12:51:07 STEP 2668 H=2668:00 +CPU= 10.375
  12:51:17 STEP 2669 H=2669:00 +CPU=  9.866
  12:51:33 STEP 2670 H=2670:00 +CPU= 16.099
  12:51:43 STEP 2671 H=2671:00 +CPU=  9.831
  12:51:53 STEP 2672 H=2672:00 +CPU= 10.222
  12:52:09 STEP 2673 H=2673:00 +CPU= 15.776
  12:52:19 STEP 2674 H=2674:00 +CPU= 10.398
  12:52:29 STEP 2675 H=2675:00 +CPU= 10.030
  12:52:46 STEP 2676 H=2676:00 +CPU= 17.016
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMGGhnw4+002676
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMSHhnw4+002676
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMUAhnw4+002676
  12:52:56 STEP 2677 H=2677:00 +CPU=  9.654
  12:53:06 STEP 2678 H=2678:00 +CPU= 10.178
  12:53:22 STEP 2679 H=2679:00 +CPU= 16.035
  12:53:32 STEP 2680 H=2680:00 +CPU= 10.346
  12:53:42 STEP 2681 H=2681:00 +CPU=  9.730
  12:53:58 STEP 2682 H=2682:00 +CPU= 15.906
  12:54:08 STEP 2683 H=2683:00 +CPU=  9.599
  12:54:18 STEP 2684 H=2684:00 +CPU= 10.031
  12:54:33 STEP 2685 H=2685:00 +CPU= 15.531
  12:54:43 STEP 2686 H=2686:00 +CPU=  9.981
  12:54:53 STEP 2687 H=2687:00 +CPU= 10.184
  12:55:12 STEP 2688 H=2688:00 +CPU= 18.279
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMGGhnw4+002688
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMSHhnw4+002688
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMUAhnw4+002688
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMGGhnw4+002664
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMSHhnw4+002664
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMUAhnw4+002664
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMGGhnw4+002676
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMSHhnw4+002676
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMUAhnw4+002676
Zipping up the intermediate file: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_00ay_2019110100_123_993_12213832_0_r463720082_111.zip
Uploading the intermediate file: upload_file_111.zip
  12:55:22 STEP 2689 H=2689:00 +CPU= 10.088
  12:55:32 STEP 2690 H=2690:00 +CPU= 10.354
  12:55:48 STEP 2691 H=2691:00 +CPU= 15.874
  12:55:58 STEP 2692 H=2692:00 +CPU= 10.168
  12:56:08 STEP 2693 H=2693:00 +CPU= 10.079
  12:56:25 STEP 2694 H=2694:00 +CPU= 16.335
  12:56:35 STEP 2695 H=2695:00 +CPU= 10.097
  12:56:45 STEP 2696 H=2696:00 +CPU= 10.447
  12:57:01 STEP 2697 H=2697:00 +CPU= 16.059
  12:57:12 STEP 2698 H=2698:00 +CPU= 10.566
  12:57:22 STEP 2699 H=2699:00 +CPU= 10.235
  12:57:39 STEP 2700 H=2700:00 +CPU= 17.327
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMGGhnw4+002700
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMSHhnw4+002700
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMUAhnw4+002700
  12:57:49 STEP 2701 H=2701:00 +CPU=  9.819
  12:58:00 STEP 2702 H=2702:00 +CPU= 10.292
  12:58:15 STEP 2703 H=2703:00 +CPU= 15.323
  12:58:25 STEP 2704 H=2704:00 +CPU=  9.946
  12:58:34 STEP 2705 H=2705:00 +CPU=  9.610
  12:58:50 STEP 2706 H=2706:00 +CPU= 15.574
  12:59:00 STEP 2707 H=2707:00 +CPU= 10.029
  12:59:10 STEP 2708 H=2708:00 +CPU= 10.282
  12:59:26 STEP 2709 H=2709:00 +CPU= 15.483
  12:59:36 STEP 2710 H=2710:00 +CPU=  9.915
  12:59:46 STEP 2711 H=2711:00 +CPU= 10.218
  13:00:04 STEP 2712 H=2712:00 +CPU= 18.127
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMGGhnw4+002712
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMSHhnw4+002712
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMUAhnw4+002712
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMGGhnw4+002688
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMSHhnw4+002688
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMUAhnw4+002688
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMGGhnw4+002700
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMSHhnw4+002700
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMUAhnw4+002700
Zipping up the intermediate file: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_00ay_2019110100_123_993_12213832_0_r463720082_112.zip
Uploading the intermediate file: upload_file_112.zip
  13:00:14 STEP 2713 H=2713:00 +CPU=  9.907
  13:00:24 STEP 2714 H=2714:00 +CPU= 10.166
  13:00:40 STEP 2715 H=2715:00 +CPU= 15.457
  13:00:50 STEP 2716 H=2716:00 +CPU= 10.071
  13:00:59 STEP 2717 H=2717:00 +CPU=  9.705
  13:01:16 STEP 2718 H=2718:00 +CPU= 16.385
  13:01:26 STEP 2719 H=2719:00 +CPU= 10.371
  13:01:37 STEP 2720 H=2720:00 +CPU= 10.417
  13:01:53 STEP 2721 H=2721:00 +CPU= 16.166
  13:02:03 STEP 2722 H=2722:00 +CPU= 10.093
  13:02:13 STEP 2723 H=2723:00 +CPU=  9.743
  13:02:29 STEP 2724 H=2724:00 +CPU= 16.730
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMGGhnw4+002724
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMSHhnw4+002724
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMUAhnw4+002724
  13:02:39 STEP 2725 H=2725:00 +CPU=  9.604
  13:02:49 STEP 2726 H=2726:00 +CPU= 10.033
  13:03:05 STEP 2727 H=2727:00 +CPU= 15.466
  13:03:15 STEP 2728 H=2728:00 +CPU= 10.335
  13:03:24 STEP 2729 H=2729:00 +CPU=  9.634
  13:03:40 STEP 2730 H=2730:00 +CPU= 16.013
  13:03:50 STEP 2731 H=2731:00 +CPU=  9.772
  13:04:00 STEP 2732 H=2732:00 +CPU= 10.225
  13:04:16 STEP 2733 H=2733:00 +CPU= 15.971
  13:04:27 STEP 2734 H=2734:00 +CPU= 10.207
  13:04:37 STEP 2735 H=2735:00 +CPU= 10.097
  13:04:55 STEP 2736 H=2736:00 +CPU= 18.090
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMGGhnw4+002736
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMSHhnw4+002736
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMUAhnw4+002736
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMGGhnw4+002712
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMSHhnw4+002712
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMUAhnw4+002712
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMGGhnw4+002724
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMSHhnw4+002724
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMUAhnw4+002724
Zipping up the intermediate file: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_00ay_2019110100_123_993_12213832_0_r463720082_113.zip
Uploading the intermediate file: upload_file_113.zip
  13:05:05 STEP 2737 H=2737:00 +CPU= 10.011
  13:05:15 STEP 2738 H=2738:00 +CPU= 10.186
  13:05:31 STEP 2739 H=2739:00 +CPU= 15.238
  13:05:41 STEP 2740 H=2740:00 +CPU=  9.988
  13:05:51 STEP 2741 H=2741:00 +CPU=  9.875
  13:06:06 STEP 2742 H=2742:00 +CPU= 15.871
  13:06:16 STEP 2743 H=2743:00 +CPU=  9.734
  13:06:26 STEP 2744 H=2744:00 +CPU= 10.225
  13:06:42 STEP 2745 H=2745:00 +CPU= 15.501
  13:06:52 STEP 2746 H=2746:00 +CPU= 10.237
  13:07:02 STEP 2747 H=2747:00 +CPU= 10.155
  13:07:20 STEP 2748 H=2748:00 +CPU= 17.599
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMGGhnw4+002748
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMSHhnw4+002748
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMUAhnw4+002748
  13:07:30 STEP 2749 H=2749:00 +CPU= 10.038
  13:07:40 STEP 2750 H=2750:00 +CPU= 10.204
  13:07:56 STEP 2751 H=2751:00 +CPU= 16.338
  13:08:07 STEP 2752 H=2752:00 +CPU= 10.285
  13:08:17 STEP 2753 H=2753:00 +CPU= 10.110
  13:08:33 STEP 2754 H=2754:00 +CPU= 16.102
  13:08:43 STEP 2755 H=2755:00 +CPU=  9.876
  13:08:53 STEP 2756 H=2756:00 +CPU= 10.365
  13:09:09 STEP 2757 H=2757:00 +CPU= 15.844
  13:09:19 STEP 2758 H=2758:00 +CPU= 10.295
  13:09:30 STEP 2759 H=2759:00 +CPU= 10.560
  13:09:48 STEP 2760 H=2760:00 +CPU= 17.965
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMGGhnw4+002760
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMSHhnw4+002760
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMUAhnw4+002760
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMGGhnw4+002736
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMSHhnw4+002736
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMUAhnw4+002736
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMGGhnw4+002748
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMSHhnw4+002748
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMUAhnw4+002748
Zipping up the intermediate file: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_00ay_2019110100_123_993_12213832_0_r463720082_114.zip
Uploading the intermediate file: upload_file_114.zip
  13:09:58 STEP 2761 H=2761:00 +CPU=  9.915
  13:10:08 STEP 2762 H=2762:00 +CPU=  9.986
  13:10:24 STEP 2763 H=2763:00 +CPU= 15.552
 SMILAG TRAJECTORY UNDERGROUND      1 TIMES.
  POINT=           13  MAX ETADOT VERTICAL VEL.=   2.590301551764812E-007
  LON  =    48.7500000000000       degrees
  LAT  =    39.8128523737712       degrees
  13:10:34 STEP 2764 H=2764:00 +CPU= 10.207
  13:10:44 STEP 2765 H=2765:00 +CPU=  9.798
 SMILAG TRAJECTORY UNDERGROUND      1 TIMES.
  POINT=           14  MAX ETADOT VERTICAL VEL.=   2.596772499702227E-007
  LON  =    47.5000000000000       degrees
  LAT  =    40.9343383242788       degrees
  13:10:59 STEP 2766 H=2766:00 +CPU= 15.889
 SMILAG TRAJECTORY UNDERGROUND      1 TIMES.
  POINT=           15  MAX ETADOT VERTICAL VEL.=   2.602363574476596E-007
  LON  =    46.2500000000000       degrees
  LAT  =    40.9343383242788       degrees
  13:11:10 STEP 2767 H=2767:00 +CPU= 10.115
 SMILAG TRAJECTORY UNDERGROUND      1 TIMES.
  POINT=           19  MAX ETADOT VERTICAL VEL.=   3.426770838194975E-007
  LON  =    46.4062500000000       degrees
  LAT  =    42.0558239509352       degrees
  13:11:20 STEP 2768 H=2768:00 +CPU= 10.134
 SMILAG TRAJECTORY UNDERGROUND      1 TIMES.
  POINT=           20  MAX ETADOT VERTICAL VEL.=   1.371221933014668E-007
  LON  =    45.0000000000000       degrees
  LAT  =    43.1773092288349       degrees
  13:11:36 STEP 2769 H=2769:00 +CPU= 16.036
 SMILAG TRAJECTORY UNDERGROUND      2 TIMES.
  POINT=           20  MAX ETADOT VERTICAL VEL.=   2.930289048029138E-007
  LON  =    45.0000000000000       degrees
  LAT  =    43.1773092288349       degrees
  13:11:46 STEP 2770 H=2770:00 +CPU= 10.503
  13:11:56 STEP 2771 H=2771:00 +CPU= 10.012
 SMILAG TRAJECTORY UNDERGROUND      2 TIMES.
  POINT=           21  MAX ETADOT VERTICAL VEL.=   3.508382368385412E-007
  LON  =    43.5937500000000       degrees
  LAT  =    44.2987941306940       degrees
  13:12:13 STEP 2772 H=2772:00 +CPU= 16.968
 SMILAG TRAJECTORY UNDERGROUND      1 TIMES.
  POINT=           21  MAX ETADOT VERTICAL VEL.=   1.193912892849427E-006
  LON  =    43.5937500000000       degrees
  LAT  =    45.4202786265483       degrees
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMGGhnw4+002772
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMSHhnw4+002772
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMUAhnw4+002772
  13:12:23 STEP 2773 H=2773:00 +CPU=  9.838
 SMILAG TRAJECTORY UNDERGROUND      3 TIMES.
  POINT=           21  MAX ETADOT VERTICAL VEL.=   1.935948283499726E-007
  LON  =    43.5937500000000       degrees
  LAT  =    45.4202786265483       degrees
  13:12:33 STEP 2774 H=2774:00 +CPU= 10.347
  13:12:49 STEP 2775 H=2775:00 +CPU= 16.002
 SMILAG TRAJECTORY UNDERGROUND      1 TIMES.
  POINT=           23  MAX ETADOT VERTICAL VEL.=   1.007944050887648E-007
  LON  =    43.5000000000000       degrees
  LAT  =    46.5417626834057       degrees
  13:13:00 STEP 2776 H=2776:00 +CPU= 10.262
  13:13:10 STEP 2777 H=2777:00 +CPU=  9.971
 SMILAG TRAJECTORY UNDERGROUND      1 TIMES.
  POINT=            7  MAX ETADOT VERTICAL VEL.=   2.258033469556073E-007
  LON  =    43.5000000000000       degrees
  LAT  =    47.6632462648426       degrees
  13:13:26 STEP 2778 H=2778:00 +CPU= 16.107
  13:13:36 STEP 2779 H=2779:00 +CPU= 10.008
  13:13:46 STEP 2780 H=2780:00 +CPU= 10.169
  13:14:02 STEP 2781 H=2781:00 +CPU= 15.846
  13:14:12 STEP 2782 H=2782:00 +CPU= 10.180
  13:14:22 STEP 2783 H=2783:00 +CPU= 10.287
  13:14:41 STEP 2784 H=2784:00 +CPU= 18.165
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMGGhnw4+002784
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMSHhnw4+002784
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMUAhnw4+002784
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMGGhnw4+002760
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMSHhnw4+002760
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMUAhnw4+002760
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMGGhnw4+002772
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMSHhnw4+002772
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMUAhnw4+002772
Zipping up the intermediate file: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_00ay_2019110100_123_993_12213832_0_r463720082_115.zip
Uploading the intermediate file: upload_file_115.zip
  13:14:51 STEP 2785 H=2785:00 +CPU=  9.944
  13:15:00 STEP 2786 H=2786:00 +CPU=  9.859
  13:15:16 STEP 2787 H=2787:00 +CPU= 15.655
  13:15:27 STEP 2788 H=2788:00 +CPU= 10.599
  13:15:36 STEP 2789 H=2789:00 +CPU=  9.782
  13:15:53 STEP 2790 H=2790:00 +CPU= 16.574
  13:16:03 STEP 2791 H=2791:00 +CPU=  9.989
  13:16:13 STEP 2792 H=2792:00 +CPU= 10.380
  13:16:29 STEP 2793 H=2793:00 +CPU= 16.033
  13:16:40 STEP 2794 H=2794:00 +CPU= 10.129
  13:16:49 STEP 2795 H=2795:00 +CPU=  9.840
  13:17:07 STEP 2796 H=2796:00 +CPU= 17.561
  13:17:17 STEP 2797 H=2797:00 +CPU=  9.696
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMGGhnw4+002796
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMSHhnw4+002796
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMUAhnw4+002796
  13:17:27 STEP 2798 H=2798:00 +CPU= 10.015
  13:17:42 STEP 2799 H=2799:00 +CPU= 15.768
  13:17:53 STEP 2800 H=2800:00 +CPU= 10.218
  13:18:03 STEP 2801 H=2801:00 +CPU=  9.984
  13:18:19 STEP 2802 H=2802:00 +CPU= 15.939
  13:18:29 STEP 2803 H=2803:00 +CPU= 10.193
  13:18:39 STEP 2804 H=2804:00 +CPU= 10.494
  13:18:55 STEP 2805 H=2805:00 +CPU= 16.229
  13:19:06 STEP 2806 H=2806:00 +CPU= 10.473
  13:19:16 STEP 2807 H=2807:00 +CPU= 10.369
  13:19:35 STEP 2808 H=2808:00 +CPU= 18.753
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMGGhnw4+002808
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMSHhnw4+002808
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMUAhnw4+002808
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMGGhnw4+002784
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMSHhnw4+002784
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMUAhnw4+002784
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMGGhnw4+002796
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMSHhnw4+002796
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMUAhnw4+002796
Zipping up the intermediate file: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_00ay_2019110100_123_993_12213832_0_r463720082_116.zip
Uploading the intermediate file: upload_file_116.zip
  13:19:45 STEP 2809 H=2809:00 +CPU= 10.183
  13:19:56 STEP 2810 H=2810:00 +CPU= 10.717
  13:20:12 STEP 2811 H=2811:00 +CPU= 15.763
  13:20:22 STEP 2812 H=2812:00 +CPU= 10.554
  13:20:32 STEP 2813 H=2813:00 +CPU= 10.071
  13:20:49 STEP 2814 H=2814:00 +CPU= 16.284
  13:20:59 STEP 2815 H=2815:00 +CPU=  9.962
  13:21:09 STEP 2816 H=2816:00 +CPU= 10.408
  13:21:25 STEP 2817 H=2817:00 +CPU= 15.702
  13:21:35 STEP 2818 H=2818:00 +CPU= 10.593
  13:21:45 STEP 2819 H=2819:00 +CPU= 10.035
  13:22:03 STEP 2820 H=2820:00 +CPU= 17.138
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMGGhnw4+002820
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMSHhnw4+002820
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMUAhnw4+002820
  13:22:13 STEP 2821 H=2821:00 +CPU= 10.319
  13:22:23 STEP 2822 H=2822:00 +CPU= 10.094
  13:22:39 STEP 2823 H=2823:00 +CPU= 15.712
  13:22:49 STEP 2824 H=2824:00 +CPU= 10.274
  13:22:59 STEP 2825 H=2825:00 +CPU=  9.963
  13:23:15 STEP 2826 H=2826:00 +CPU= 16.498
  13:23:26 STEP 2827 H=2827:00 +CPU= 10.338
  13:23:36 STEP 2828 H=2828:00 +CPU= 10.528
  13:23:52 STEP 2829 H=2829:00 +CPU= 15.917
  13:24:03 STEP 2830 H=2830:00 +CPU= 10.363
  13:24:13 STEP 2831 H=2831:00 +CPU= 10.164
  13:24:31 STEP 2832 H=2832:00 +CPU= 18.705
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMGGhnw4+002832
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMSHhnw4+002832
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMUAhnw4+002832
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMGGhnw4+002808
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMSHhnw4+002808
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMUAhnw4+002808
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMGGhnw4+002820
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMSHhnw4+002820
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMUAhnw4+002820
Zipping up the intermediate file: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_00ay_2019110100_123_993_12213832_0_r463720082_117.zip
Uploading the intermediate file: upload_file_117.zip
  13:24:41 STEP 2833 H=2833:00 +CPU=  9.775
  13:24:51 STEP 2834 H=2834:00 +CPU= 10.196
  13:25:07 STEP 2835 H=2835:00 +CPU= 15.786
  13:25:18 STEP 2836 H=2836:00 +CPU= 10.372
  13:25:28 STEP 2837 H=2837:00 +CPU= 10.615
  13:25:45 STEP 2838 H=2838:00 +CPU= 16.321
  13:25:55 STEP 2839 H=2839:00 +CPU= 10.423
  13:26:05 STEP 2840 H=2840:00 +CPU= 10.133
  13:26:21 STEP 2841 H=2841:00 +CPU= 15.827
  13:26:31 STEP 2842 H=2842:00 +CPU= 10.510
  13:26:42 STEP 2843 H=2843:00 +CPU= 10.337
  13:26:59 STEP 2844 H=2844:00 +CPU= 17.517
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMGGhnw4+002844
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMSHhnw4+002844
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMUAhnw4+002844
  13:27:10 STEP 2845 H=2845:00 +CPU= 10.455
  13:27:20 STEP 2846 H=2846:00 +CPU= 10.576
  13:27:36 STEP 2847 H=2847:00 +CPU= 15.265
  13:27:46 STEP 2848 H=2848:00 +CPU=  9.915
  13:27:55 STEP 2849 H=2849:00 +CPU=  9.771
  13:28:12 STEP 2850 H=2850:00 +CPU= 16.180
  13:28:21 STEP 2851 H=2851:00 +CPU=  9.723
  13:28:31 STEP 2852 H=2852:00 +CPU= 10.162
  13:28:47 STEP 2853 H=2853:00 +CPU= 16.067
  13:28:58 STEP 2854 H=2854:00 +CPU= 10.265
  13:29:08 STEP 2855 H=2855:00 +CPU= 10.360
  13:29:27 STEP 2856 H=2856:00 +CPU= 19.325
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMGGhnw4+002856
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMSHhnw4+002856
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMUAhnw4+002856
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMGGhnw4+002832
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMSHhnw4+002832
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMUAhnw4+002832
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMGGhnw4+002844
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMSHhnw4+002844
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMUAhnw4+002844
Zipping up the intermediate file: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_00ay_2019110100_123_993_12213832_0_r463720082_118.zip
Uploading the intermediate file: upload_file_118.zip
  13:29:37 STEP 2857 H=2857:00 +CPU=  9.798
  13:29:48 STEP 2858 H=2858:00 +CPU= 10.598
  13:30:04 STEP 2859 H=2859:00 +CPU= 15.994
  13:30:14 STEP 2860 H=2860:00 +CPU=  9.966
  13:30:24 STEP 2861 H=2861:00 +CPU=  9.782
  13:30:39 STEP 2862 H=2862:00 +CPU= 15.860
  13:30:49 STEP 2863 H=2863:00 +CPU=  9.781
  13:31:00 STEP 2864 H=2864:00 +CPU= 10.294
  13:31:15 STEP 2865 H=2865:00 +CPU= 15.406
  13:31:25 STEP 2866 H=2866:00 +CPU= 10.344
  13:31:35 STEP 2867 H=2867:00 +CPU= 10.089
  13:31:53 STEP 2868 H=2868:00 +CPU= 17.354
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMGGhnw4+002868
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMSHhnw4+002868
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMUAhnw4+002868
  13:32:03 STEP 2869 H=2869:00 +CPU=  9.953
  13:32:13 STEP 2870 H=2870:00 +CPU= 10.134
  13:32:29 STEP 2871 H=2871:00 +CPU= 15.786
  13:32:39 STEP 2872 H=2872:00 +CPU= 10.352
  13:32:49 STEP 2873 H=2873:00 +CPU= 10.184
  13:33:05 STEP 2874 H=2874:00 +CPU= 15.980
  13:33:15 STEP 2875 H=2875:00 +CPU= 10.164
  13:33:26 STEP 2876 H=2876:00 +CPU= 10.526
  13:33:42 STEP 2877 H=2877:00 +CPU= 15.893
  13:33:52 STEP 2878 H=2878:00 +CPU= 10.064
  13:34:02 STEP 2879 H=2879:00 +CPU=  9.992
  13:34:20 STEP 2880 H=2880:00 +CPU= 18.156
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMGGhnw4+002880
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMSHhnw4+002880
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMUAhnw4+002880
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMGGhnw4+002856
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMSHhnw4+002856
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMUAhnw4+002856
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMGGhnw4+002868
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMSHhnw4+002868
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMUAhnw4+002868
Zipping up the intermediate file: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_00ay_2019110100_123_993_12213832_0_r463720082_119.zip
Uploading the intermediate file: upload_file_119.zip
  13:34:30 STEP 2881 H=2881:00 +CPU=  9.716
  13:34:40 STEP 2882 H=2882:00 +CPU=  9.853
Uploading trickle at timestep: 10368000
  13:34:55 STEP 2883 H=2883:00 +CPU= 15.371
  13:35:05 STEP 2884 H=2884:00 +CPU=  9.827
  13:35:15 STEP 2885 H=2885:00 +CPU= 10.497
  13:35:31 STEP 2886 H=2886:00 +CPU= 16.068
  13:35:41 STEP 2887 H=2887:00 +CPU=  9.977
  13:35:51 STEP 2888 H=2888:00 +CPU= 10.069
  13:36:07 STEP 2889 H=2889:00 +CPU= 15.526
  13:36:17 STEP 2890 H=2890:00 +CPU= 10.167
  13:36:27 STEP 2891 H=2891:00 +CPU=  9.795
  13:36:44 STEP 2892 H=2892:00 +CPU= 17.012
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMGGhnw4+002892
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMSHhnw4+002892
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMUAhnw4+002892
  13:36:54 STEP 2893 H=2893:00 +CPU=  9.773
  13:37:04 STEP 2894 H=2894:00 +CPU= 10.401
  13:37:20 STEP 2895 H=2895:00 +CPU= 16.079
  13:37:30 STEP 2896 H=2896:00 +CPU= 10.347
  13:37:40 STEP 2897 H=2897:00 +CPU=  9.761
  13:37:56 STEP 2898 H=2898:00 +CPU= 15.519
  13:38:06 STEP 2899 H=2899:00 +CPU=  9.928
  13:38:16 STEP 2900 H=2900:00 +CPU= 10.125
  13:38:31 STEP 2901 H=2901:00 +CPU= 15.514
  13:38:41 STEP 2902 H=2902:00 +CPU=  9.862
  13:38:51 STEP 2903 H=2903:00 +CPU= 10.298
  13:39:10 STEP 2904 H=2904:00 +CPU= 18.302
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMGGhnw4+002904
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMSHhnw4+002904
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMUAhnw4+002904
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMGGhnw4+002880
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMSHhnw4+002880
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMUAhnw4+002880
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMGGhnw4+002892
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMSHhnw4+002892
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMUAhnw4+002892
Zipping up the intermediate file: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_00ay_2019110100_123_993_12213832_0_r463720082_120.zip
Uploading the intermediate file: upload_file_120.zip
  13:39:20 STEP 2905 H=2905:00 +CPU= 10.148
  13:39:30 STEP 2906 H=2906:00 +CPU= 10.499
  13:39:46 STEP 2907 H=2907:00 +CPU= 15.929
  13:39:57 STEP 2908 H=2908:00 +CPU= 10.547
  13:40:07 STEP 2909 H=2909:00 +CPU= 10.226
  13:40:23 STEP 2910 H=2910:00 +CPU= 15.844
  13:40:33 STEP 2911 H=2911:00 +CPU=  9.961
  13:40:43 STEP 2912 H=2912:00 +CPU= 10.229
  13:40:59 STEP 2913 H=2913:00 +CPU= 15.408
  13:41:09 STEP 2914 H=2914:00 +CPU= 10.308
  13:41:19 STEP 2915 H=2915:00 +CPU= 10.157
  13:41:36 STEP 2916 H=2916:00 +CPU= 16.933
 SMILAG TRAJECTORY UNDERGROUND      1 TIMES.
  POINT=           25  MAX ETADOT VERTICAL VEL.=   3.059736001327264E-007
  LON  =    73.7500000000000       degrees
  LAT  =    37.5698795904715       degrees
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMGGhnw4+002916
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMSHhnw4+002916
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMUAhnw4+002916
  13:41:46 STEP 2917 H=2917:00 +CPU=  9.680
  13:41:56 STEP 2918 H=2918:00 +CPU=  9.934
  13:42:12 STEP 2919 H=2919:00 +CPU= 15.954
  13:42:22 STEP 2920 H=2920:00 +CPU= 10.143
  13:42:31 STEP 2921 H=2921:00 +CPU=  9.726
  13:42:47 STEP 2922 H=2922:00 +CPU= 15.853
 SMILAG TRAJECTORY UNDERGROUND      1 TIMES.
  POINT=           30  MAX ETADOT VERTICAL VEL.=   1.074223110501037E-007
  LON  =    67.5000000000000       degrees
  LAT  =    38.6913661222016       degrees
  13:42:57 STEP 2923 H=2923:00 +CPU=  9.718
 SMILAG TRAJECTORY UNDERGROUND      1 TIMES.
  POINT=           31  MAX ETADOT VERTICAL VEL.=   1.387690318875567E-008
  LON  =    66.2500000000000       degrees
  LAT  =    38.6913661222016       degrees
  13:43:07 STEP 2924 H=2924:00 +CPU=  9.889
  13:43:23 STEP 2925 H=2925:00 +CPU= 16.114
  13:43:33 STEP 2926 H=2926:00 +CPU= 10.360
  13:43:44 STEP 2927 H=2927:00 +CPU= 10.136
  13:44:03 STEP 2928 H=2928:00 +CPU= 18.814
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMGGhnw4+002928
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMSHhnw4+002928
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMUAhnw4+002928
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMGGhnw4+002904
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMSHhnw4+002904
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMUAhnw4+002904
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMGGhnw4+002916
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMSHhnw4+002916
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMUAhnw4+002916
Zipping up the intermediate file: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_00ay_2019110100_123_993_12213832_0_r463720082_121.zip
Uploading the intermediate file: upload_file_121.zip
  13:44:13 STEP 2929 H=2929:00 +CPU= 10.005
 SMILAG TRAJECTORY UNDERGROUND      1 TIMES.
  POINT=            4  MAX ETADOT VERTICAL VEL.=   3.709481786319040E-007
  LON  =    60.0000000000000       degrees
  LAT  =    39.8128523737712       degrees
  13:44:23 STEP 2930 H=2930:00 +CPU= 10.113
  13:44:38 STEP 2931 H=2931:00 +CPU= 15.416
  13:44:48 STEP 2932 H=2932:00 +CPU= 10.074
  13:44:58 STEP 2933 H=2933:00 +CPU=  9.751
  13:45:14 STEP 2934 H=2934:00 +CPU= 16.277
 SMILAG TRAJECTORY UNDERGROUND      1 TIMES.
  POINT=            7  MAX ETADOT VERTICAL VEL.=   3.545710190737422E-007
  LON  =    56.2500000000000       degrees
  LAT  =    40.9343383242788       degrees
  13:45:24 STEP 2935 H=2935:00 +CPU=  9.822
  13:45:34 STEP 2936 H=2936:00 +CPU= 10.021
  13:45:50 STEP 2937 H=2937:00 +CPU= 15.571
  13:46:00 STEP 2938 H=2938:00 +CPU= 10.627
  13:46:11 STEP 2939 H=2939:00 +CPU= 10.293
  13:46:28 STEP 2940 H=2940:00 +CPU= 17.325
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMGGhnw4+002940
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMSHhnw4+002940
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMUAhnw4+002940
  13:46:38 STEP 2941 H=2941:00 +CPU=  9.917
  13:46:48 STEP 2942 H=2942:00 +CPU= 10.134
  13:47:04 STEP 2943 H=2943:00 +CPU= 15.645
  13:47:14 STEP 2944 H=2944:00 +CPU= 10.362
  13:47:24 STEP 2945 H=2945:00 +CPU= 10.244
  13:47:40 STEP 2946 H=2946:00 +CPU= 16.271
  13:47:51 STEP 2947 H=2947:00 +CPU= 10.178
  13:48:01 STEP 2948 H=2948:00 +CPU= 10.374
  13:48:17 STEP 2949 H=2949:00 +CPU= 15.831
  13:48:27 STEP 2950 H=2950:00 +CPU= 10.233
  13:48:37 STEP 2951 H=2951:00 +CPU= 10.051
  13:48:55 STEP 2952 H=2952:00 +CPU= 17.435
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

  FIELD LEV        AVERAGE               MINIMUM               MAXIMUM       
    101  60  3.19925486346338E-02 -1.00000000000000E+00  1.00000000000000E+00
  MAXGPFV : MAX. VALUE =    1.09621219865815     
  MAXGPFV : MAX. VALUE =   0.721607775882989     
 NSTEP =  2952 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGhnw4+002952 MODE=a
 IO-STREAM CLOSED - ICMGGhnw4+002952
 MPI-TASK:   1 -    320304458 BYTES IN      8 RECORDS TRANSFERRED IN    0.0003 SECONDS******** Mbytes/s, TOTAL TIME=    0.0059( 5.1%)
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200302231500  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200302233000  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200302234500  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200303000000  !!!!!!!!!!!! 
 13:48:55 STEP 2952 H=2952:00 +CPU= 17.435
 END CNT3
 NSTEP =  2952 CNT0   000000000  15.291  15.291  15.300   0.999               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ          654/    28953814 WRITTEN        46048/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1   1116    0      654        28275    46048 ************    85.7     0.0    85.7     0.5   147.8
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 ********* *********    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 ********* *********    100.00      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                 3200    1012.6    1012.6      8.78      0.00
   9 SPCM     - SPECTRAL COMP.                    2952     131.5     131.5      1.05      0.00
  10 SCAN2M - PHYSICS                             2953    5612.7    5612.7     44.91      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                247     540.0     540.0      0.36      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                126       9.2       9.2      0.00      0.00
  13 SCAN2M - RADIATION CALC.                      985    5867.6    5867.6     15.66      0.00
  14 SUINIF                                          1     815.8     815.8      0.00      0.00
  17 GRIDFPOS IN CNT4                              247      23.9      23.9      0.02      0.00
  18 SUSPECG                                         1     143.8     143.8      0.00      0.00
  19 SUSPEC                                          1     147.5     147.5      0.00      0.00
  24 SUGRIDU                                         1     503.6     503.6      0.00      0.00
  25 SPECRT                                          1      75.8      75.8      0.00      0.00
  26 SUGRIDF                                         1      88.8      88.8      0.00      0.00
  27 RESTART FILES - WRITING                       123    1084.4    1084.4      0.36      0.00
  28 RESTART FILES - READING                         1       0.0       0.0      0.00      0.00
  29 SU4FPOS IN CNT4                               247       0.1       0.1      0.00      0.00
  30 DYNFPOS IN CNT4                               247    1119.1    1119.1      0.75      0.00
  31 POSDDH IN STEPO                                13       3.0       3.0      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                   2953    1542.0    1542.0     12.34      0.00
  38 WAM      - TOTAL COST OF WAVE MODEL          2952    1301.8    1301.8     10.41      0.00
  39 SU0YOMB                                         1     169.2     169.2      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                   2953       7.0       7.0      0.06      0.00
  54 SPCM     - M TO S/S TO M TRANSP.             2952      53.1      53.1      0.42      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.             2952      14.8      14.8      0.12      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                126       0.2       0.2      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM    10094      69.5      69.5      1.90      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM      6152      67.4      67.4      1.12      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM       6152      27.0      27.0      0.45      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM     10094      22.3      22.3      0.61      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            2       8.9       8.9      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION          10094      11.5      11.5      0.32      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION           6152       9.7       9.7      0.16      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION          10094      11.9      11.9      0.33      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION           6152       9.0       9.0      0.15      0.00
 400 GSTATS                                     589499       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                564603       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME    36902.4 CPU TIME   36885.8 VECTOR TIME    36885.8


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY      288.0
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMGGhnw4+002952
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMSHhnw4+002952
Moving to projects directory: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ICMUAhnw4+002952
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/NODE.001_01
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/slots/1/ifs.stat
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMUAhnw4+002940
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMGGhnw4+002940
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMSHhnw4+002940
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMUAhnw4+002928
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMGGhnw4+002952
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMSHhnw4+002952
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMSHhnw4+002928
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMGGhnw4+002928
Adding to the zip: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_12213832/ICMUAhnw4+002952
Zipping up the final file: /srv/datapool/nobak/boinc/boinc-client-cpdn/projects/climateprediction.net/oifs_43r3_00ay_2019110100_123_993_12213832_0_r463720082_122.zip
Uploading the final file: upload_file_122.zip
Uploading trickle at timestep: 10623600
13:52:17 (381015): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:53:56 1535805 22315181 oifs_43r3_00ay_2019110100_123_993_12213832_0 10,623,600 36,885 0.0035
09 May 2023 16:53:56 1535805 22315181 oifs_43r3_00ay_2019110100_123_993_12213832_0 10,368,000 36,010 0.0035
09 May 2023 16:53:53 1535805 22315181 oifs_43r3_00ay_2019110100_123_993_12213832_0 9,504,000 33,082 0.0035
09 May 2023 16:53:51 1535805 22315181 oifs_43r3_00ay_2019110100_123_993_12213832_0 8,640,000 30,134 0.0035
09 May 2023 16:53:47 1535805 22315181 oifs_43r3_00ay_2019110100_123_993_12213832_0 7,776,000 27,186 0.0035
09 May 2023 16:53:47 1535805 22315181 oifs_43r3_00ay_2019110100_123_993_12213832_0 6,912,000 24,277 0.0035
09 May 2023 16:53:44 1535805 22315181 oifs_43r3_00ay_2019110100_123_993_12213832_0 6,048,000 21,350 0.0035
09 May 2023 16:53:41 1535805 22315181 oifs_43r3_00ay_2019110100_123_993_12213832_0 5,184,000 18,290 0.0035
09 May 2023 16:53:39 1535805 22315181 oifs_43r3_00ay_2019110100_123_993_12213832_0 4,320,000 15,142 0.0035
09 May 2023 16:53:36 1535805 22315181 oifs_43r3_00ay_2019110100_123_993_12213832_0 3,456,000 11,962 0.0035
09 May 2023 16:53:33 1535805 22315181 oifs_43r3_00ay_2019110100_123_993_12213832_0 2,592,000 8,783 0.0034
09 May 2023 16:53:30 1535805 22315181 oifs_43r3_00ay_2019110100_123_993_12213832_0 1,728,000 5,804 0.0034
09 May 2023 16:53:30 1535805 22315181 oifs_43r3_00ay_2019110100_123_993_12213832_0 864,000 2,925 0.0034


©2024 climateprediction.net