climateprediction.net home page
Task 22266380

Task 22266380

Name oifs_43r3_ps_0707_1995050100_123_964_12181351_0
Workunit 12181351
Created 22 Dec 2022, 9:03:22 UTC
Sent 22 Dec 2022, 9:08:48 UTC
Report deadline 21 Jan 2023, 9:08:48 UTC
Received 4 Jan 2023, 16:58:56 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1521081
Run time 1 days 7 hours 21 min 16 sec
CPU time 1 days 5 hours 22 min 40 sec
Validate state Valid
Credit 14,873.04
Device peak FLOPS 5.44 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,415.23 MB
Peak swap size 4,978.08 MB
Peak disk usage 4,885.57 MB
Stderr
<core_client_version>7.18.1</core_client_version>
<![CDATA[
<stderr_txt>
EP 2614 H=2614:00 +CPU= 28.371
  16:10:35 STEP 2615 H=2615:00 +CPU= 27.973
  16:11:29 STEP 2616 H=2616:00 +CPU= 50.606
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002616
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002616
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMGGhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMSHhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMUAhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMGGhq0f+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMSHhq0f+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMUAhq0f+002604
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0707_1995050100_123_964_12181351_0_r500507084_108.zip
Uploading the intermediate file: upload_file_108.zip
  16:11:59 STEP 2617 H=2617:00 +CPU= 27.344
  16:12:28 STEP 2618 H=2618:00 +CPU= 27.630
  16:13:13 STEP 2619 H=2619:00 +CPU= 42.374
  16:13:43 STEP 2620 H=2620:00 +CPU= 28.526
  16:14:12 STEP 2621 H=2621:00 +CPU= 27.179
  16:14:58 STEP 2622 H=2622:00 +CPU= 42.773
  16:15:27 STEP 2623 H=2623:00 +CPU= 27.218
  16:15:58 STEP 2624 H=2624:00 +CPU= 28.354
  16:16:43 STEP 2625 H=2625:00 +CPU= 41.785
  16:17:13 STEP 2626 H=2626:00 +CPU= 28.865
  16:17:42 STEP 2627 H=2627:00 +CPU= 27.465
  16:18:32 STEP 2628 H=2628:00 +CPU= 46.473
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002628
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002628
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002628
  16:19:01 STEP 2629 H=2629:00 +CPU= 27.478
  16:19:31 STEP 2630 H=2630:00 +CPU= 28.123
  16:20:16 STEP 2631 H=2631:00 +CPU= 42.027
  16:20:46 STEP 2632 H=2632:00 +CPU= 28.267
  16:21:15 STEP 2633 H=2633:00 +CPU= 26.712
  16:22:00 STEP 2634 H=2634:00 +CPU= 42.951
  16:22:30 STEP 2635 H=2635:00 +CPU= 27.690
  16:22:59 STEP 2636 H=2636:00 +CPU= 27.541
  16:23:44 STEP 2637 H=2637:00 +CPU= 42.365
  16:24:14 STEP 2638 H=2638:00 +CPU= 28.547
  16:24:44 STEP 2639 H=2639:00 +CPU= 28.202
  16:25:37 STEP 2640 H=2640:00 +CPU= 50.179
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002640
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002640
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMGGhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMSHhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMUAhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMGGhq0f+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMSHhq0f+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMUAhq0f+002628
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0707_1995050100_123_964_12181351_0_r500507084_109.zip
Uploading the intermediate file: upload_file_109.zip
  16:26:07 STEP 2641 H=2641:00 +CPU= 27.448
  16:26:36 STEP 2642 H=2642:00 +CPU= 27.561
  16:27:21 STEP 2643 H=2643:00 +CPU= 41.944
  16:27:51 STEP 2644 H=2644:00 +CPU= 27.981
  16:28:20 STEP 2645 H=2645:00 +CPU= 27.108
  16:29:06 STEP 2646 H=2646:00 +CPU= 42.785
  16:29:35 STEP 2647 H=2647:00 +CPU= 27.395
  16:30:05 STEP 2648 H=2648:00 +CPU= 28.136
  16:30:49 STEP 2649 H=2649:00 +CPU= 41.972
  16:31:20 STEP 2650 H=2650:00 +CPU= 28.480
  16:31:49 STEP 2651 H=2651:00 +CPU= 27.495
  16:32:39 STEP 2652 H=2652:00 +CPU= 46.845
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002652
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002652
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002652
  16:33:08 STEP 2653 H=2653:00 +CPU= 27.186
  16:33:38 STEP 2654 H=2654:00 +CPU= 28.138
  16:34:22 STEP 2655 H=2655:00 +CPU= 42.184
  16:34:52 STEP 2656 H=2656:00 +CPU= 28.797
  16:35:21 STEP 2657 H=2657:00 +CPU= 27.143
  16:36:07 STEP 2658 H=2658:00 +CPU= 42.953
  16:36:36 STEP 2659 H=2659:00 +CPU= 27.580
  16:37:06 STEP 2660 H=2660:00 +CPU= 27.848
  16:37:51 STEP 2661 H=2661:00 +CPU= 42.329
  16:38:21 STEP 2662 H=2662:00 +CPU= 28.215
  16:38:51 STEP 2663 H=2663:00 +CPU= 28.489
  16:39:44 STEP 2664 H=2664:00 +CPU= 49.515
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002664
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002664
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMGGhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMSHhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMUAhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMGGhq0f+002652
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMSHhq0f+002652
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMUAhq0f+002652
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0707_1995050100_123_964_12181351_0_r500507084_110.zip
Uploading the intermediate file: upload_file_110.zip
  16:40:13 STEP 2665 H=2665:00 +CPU= 27.175
  16:40:43 STEP 2666 H=2666:00 +CPU= 27.880
  16:41:28 STEP 2667 H=2667:00 +CPU= 42.817
  16:41:57 STEP 2668 H=2668:00 +CPU= 28.159
  16:42:26 STEP 2669 H=2669:00 +CPU= 27.185
  16:43:12 STEP 2670 H=2670:00 +CPU= 43.200
  16:43:42 STEP 2671 H=2671:00 +CPU= 27.758
  16:44:13 STEP 2672 H=2672:00 +CPU= 28.769
  16:44:57 STEP 2673 H=2673:00 +CPU= 41.721
  16:45:28 STEP 2674 H=2674:00 +CPU= 28.984
  16:45:57 STEP 2675 H=2675:00 +CPU= 27.655
  16:46:47 STEP 2676 H=2676:00 +CPU= 46.530
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002676
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002676
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002676
  16:47:16 STEP 2677 H=2677:00 +CPU= 27.388
  16:47:46 STEP 2678 H=2678:00 +CPU= 27.926
  16:48:30 STEP 2679 H=2679:00 +CPU= 42.346
  16:49:01 STEP 2680 H=2680:00 +CPU= 28.912
  16:49:30 STEP 2681 H=2681:00 +CPU= 27.285
  16:50:16 STEP 2682 H=2682:00 +CPU= 43.226
  16:50:45 STEP 2683 H=2683:00 +CPU= 27.600
  16:51:16 STEP 2684 H=2684:00 +CPU= 28.211
  16:52:00 STEP 2685 H=2685:00 +CPU= 41.798
  16:52:31 STEP 2686 H=2686:00 +CPU= 28.649
  16:53:02 STEP 2687 H=2687:00 +CPU= 28.602
  16:53:54 STEP 2688 H=2688:00 +CPU= 49.801
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002688
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002688
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMGGhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMSHhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMUAhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMGGhq0f+002676
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMSHhq0f+002676
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMUAhq0f+002676
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0707_1995050100_123_964_12181351_0_r500507084_111.zip
Uploading the intermediate file: upload_file_111.zip
  16:54:24 STEP 2689 H=2689:00 +CPU= 27.855
  16:54:53 STEP 2690 H=2690:00 +CPU= 27.900
  16:55:39 STEP 2691 H=2691:00 +CPU= 42.561
  16:56:09 STEP 2692 H=2692:00 +CPU= 28.440
  16:56:38 STEP 2693 H=2693:00 +CPU= 27.396
  16:57:24 STEP 2694 H=2694:00 +CPU= 43.076
  16:57:54 STEP 2695 H=2695:00 +CPU= 27.938
  16:58:24 STEP 2696 H=2696:00 +CPU= 28.576
  16:59:09 STEP 2697 H=2697:00 +CPU= 41.453
  16:59:39 STEP 2698 H=2698:00 +CPU= 28.473
  17:00:08 STEP 2699 H=2699:00 +CPU= 27.885
  17:00:58 STEP 2700 H=2700:00 +CPU= 46.747
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002700
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002700
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002700
  17:01:28 STEP 2701 H=2701:00 +CPU= 27.729
  17:01:58 STEP 2702 H=2702:00 +CPU= 28.597
  17:02:43 STEP 2703 H=2703:00 +CPU= 41.835
  17:03:13 STEP 2704 H=2704:00 +CPU= 28.638
  17:03:42 STEP 2705 H=2705:00 +CPU= 27.171
  17:04:28 STEP 2706 H=2706:00 +CPU= 43.040
  17:04:57 STEP 2707 H=2707:00 +CPU= 27.360
  17:05:27 STEP 2708 H=2708:00 +CPU= 28.401
  17:06:12 STEP 2709 H=2709:00 +CPU= 41.831
  17:06:42 STEP 2710 H=2710:00 +CPU= 28.173
  17:07:13 STEP 2711 H=2711:00 +CPU= 28.241
  17:08:06 STEP 2712 H=2712:00 +CPU= 49.982
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002712
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002712
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMGGhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMSHhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMUAhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMGGhq0f+002700
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMSHhq0f+002700
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMUAhq0f+002700
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0707_1995050100_123_964_12181351_0_r500507084_112.zip
Uploading the intermediate file: upload_file_112.zip
  17:08:35 STEP 2713 H=2713:00 +CPU= 27.396
  17:09:05 STEP 2714 H=2714:00 +CPU= 28.003
  17:09:49 STEP 2715 H=2715:00 +CPU= 41.747
  17:10:20 STEP 2716 H=2716:00 +CPU= 28.198
  17:10:49 STEP 2717 H=2717:00 +CPU= 27.606
  17:11:35 STEP 2718 H=2718:00 +CPU= 43.064
  17:12:04 STEP 2719 H=2719:00 +CPU= 27.521
  17:12:34 STEP 2720 H=2720:00 +CPU= 28.077
  17:13:19 STEP 2721 H=2721:00 +CPU= 42.350
  17:13:49 STEP 2722 H=2722:00 +CPU= 28.378
  17:14:18 STEP 2723 H=2723:00 +CPU= 27.863
  17:15:08 STEP 2724 H=2724:00 +CPU= 46.500
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002724
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002724
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002724
  17:15:38 STEP 2725 H=2725:00 +CPU= 27.782
  17:16:07 STEP 2726 H=2726:00 +CPU= 28.334
  17:16:53 STEP 2727 H=2727:00 +CPU= 42.374
  17:17:24 STEP 2728 H=2728:00 +CPU= 28.325
  17:17:53 STEP 2729 H=2729:00 +CPU= 27.525
  17:18:39 STEP 2730 H=2730:00 +CPU= 42.990
  17:19:09 STEP 2731 H=2731:00 +CPU= 27.545
  17:19:39 STEP 2732 H=2732:00 +CPU= 28.488
  17:20:23 STEP 2733 H=2733:00 +CPU= 41.833
  17:20:54 STEP 2734 H=2734:00 +CPU= 28.691
  17:21:24 STEP 2735 H=2735:00 +CPU= 28.567
  17:22:17 STEP 2736 H=2736:00 +CPU= 49.630
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002736
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002736
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMGGhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMSHhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMUAhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMGGhq0f+002724
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMSHhq0f+002724
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMUAhq0f+002724
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0707_1995050100_123_964_12181351_0_r500507084_113.zip
Uploading the intermediate file: upload_file_113.zip
  17:22:47 STEP 2737 H=2737:00 +CPU= 28.160
  17:23:18 STEP 2738 H=2738:00 +CPU= 28.488
  17:24:03 STEP 2739 H=2739:00 +CPU= 41.856
  17:24:33 STEP 2740 H=2740:00 +CPU= 28.461
  17:25:03 STEP 2741 H=2741:00 +CPU= 27.943
  17:25:48 STEP 2742 H=2742:00 +CPU= 43.012
  17:26:23 STEP 2743 H=2743:00 +CPU= 31.552
  17:26:59 STEP 2744 H=2744:00 +CPU= 33.661
  17:27:51 STEP 2745 H=2745:00 +CPU= 48.792
  17:28:27 STEP 2746 H=2746:00 +CPU= 33.687
  17:29:02 STEP 2747 H=2747:00 +CPU= 31.909
  17:29:52 STEP 2748 H=2748:00 +CPU= 46.833
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002748
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002748
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002748
  17:30:22 STEP 2749 H=2749:00 +CPU= 28.044
  17:30:53 STEP 2750 H=2750:00 +CPU= 28.709
  17:31:37 STEP 2751 H=2751:00 +CPU= 41.709
  17:32:07 STEP 2752 H=2752:00 +CPU= 28.367
  17:32:37 STEP 2753 H=2753:00 +CPU= 27.719
  17:33:23 STEP 2754 H=2754:00 +CPU= 42.485
  17:33:53 STEP 2755 H=2755:00 +CPU= 27.759
  17:34:23 STEP 2756 H=2756:00 +CPU= 28.667
  17:35:14 STEP 2757 H=2757:00 +CPU= 47.853
  17:35:51 STEP 2758 H=2758:00 +CPU= 33.199
  17:36:26 STEP 2759 H=2759:00 +CPU= 33.642
  17:37:27 STEP 2760 H=2760:00 +CPU= 56.200
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002760
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002760
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMGGhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMSHhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMUAhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMGGhq0f+002748
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMSHhq0f+002748
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMUAhq0f+002748
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0707_1995050100_123_964_12181351_0_r500507084_114.zip
Uploading the intermediate file: upload_file_114.zip
Uploading trickle at timestep: 9936000
  17:37:58 STEP 2761 H=2761:00 +CPU= 28.685
  17:38:28 STEP 2762 H=2762:00 +CPU= 28.844
  17:39:13 STEP 2763 H=2763:00 +CPU= 41.908
  17:39:43 STEP 2764 H=2764:00 +CPU= 28.667
  17:40:13 STEP 2765 H=2765:00 +CPU= 27.700
  17:41:00 STEP 2766 H=2766:00 +CPU= 43.332
  17:41:30 STEP 2767 H=2767:00 +CPU= 27.429
  17:42:01 STEP 2768 H=2768:00 +CPU= 28.963
  17:42:45 STEP 2769 H=2769:00 +CPU= 41.820
  17:43:17 STEP 2770 H=2770:00 +CPU= 29.986
  17:43:51 STEP 2771 H=2771:00 +CPU= 31.496
  17:44:48 STEP 2772 H=2772:00 +CPU= 53.005
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002772
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002772
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002772
  17:45:23 STEP 2773 H=2773:00 +CPU= 32.086
  17:45:57 STEP 2774 H=2774:00 +CPU= 32.599
  17:46:45 STEP 2775 H=2775:00 +CPU= 44.317
  17:47:15 STEP 2776 H=2776:00 +CPU= 28.632
  17:47:44 STEP 2777 H=2777:00 +CPU= 27.384
  17:48:30 STEP 2778 H=2778:00 +CPU= 42.982
  17:49:00 STEP 2779 H=2779:00 +CPU= 27.908
  17:49:30 STEP 2780 H=2780:00 +CPU= 28.582
  17:50:15 STEP 2781 H=2781:00 +CPU= 41.986
  17:50:46 STEP 2782 H=2782:00 +CPU= 28.007
  17:51:16 STEP 2783 H=2783:00 +CPU= 28.879
  17:52:13 STEP 2784 H=2784:00 +CPU= 53.348
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002784
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002784
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMGGhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMSHhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMUAhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMGGhq0f+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMSHhq0f+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMUAhq0f+002772
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0707_1995050100_123_964_12181351_0_r500507084_115.zip
Uploading the intermediate file: upload_file_115.zip
  17:52:48 STEP 2785 H=2785:00 +CPU= 31.989
  17:53:23 STEP 2786 H=2786:00 +CPU= 33.021
[EC_DRHOOK:WAW22:1:1:1983:1983] [20221231:175405:1672505645:452164.247] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1538] Received signal#15 (SIGTERM) :: 2550MB (heap), 4419MB (maxrss), 0MB (maxstack), 0 (paging), nsigs = 1
[EC_DRHOOK:WAW22:1:1:1983:1983] [20221231:175405:1672505645:452164.258] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1542] Also activating Harakiri-alarm (SIGALRM=14) to expire after 500s elapsed to prevent hangs, nsigs = 1
[EC_DRHOOK:WAW22:1:1:1983:1983] [20221231:175405:1672505645:452164.258] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1544] Harakiri signal handler 'signal_harakiri' for signal#14 (SIGALRM) installed at 0x81f3c0 (old at (nil))
[EC_DRHOOK:WAW22:1:1:1983:1983] [20221231:175405:1672505645:452164.258] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1617] Signal#15 was caused by unrecognized si_code [memaddr=0x1], nsigs = 1
[EC_DRHOOK:WAW22:1:1:1983:1983] [20221231:175405:1672505645:452164.258] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1686] Starting DrHook backtrace for signal#15, nsigs = 1
[EC_DRHOOK:WAW22:1:1:1983:1983] [20221231:175405:1672505645:452164.258] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3843] 2598 MB (maxheap), 4419 MB (maxrss), 0 MB (maxstack)
[EC_DRHOOK:WAW22:1:1:1983:1983] [20221231:175405:1672505645:452164.258] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :  MASTER 
[EC_DRHOOK:WAW22:1:1:1983:1983] [20221231:175405:1672505645:452164.261] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :   CNT0 
[EC_DRHOOK:WAW22:1:1:1983:1983] [20221231:175405:1672505645:452164.264] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :    CNT1 
[EC_DRHOOK:WAW22:1:1:1983:1983] [20221231:175405:1672505645:452164.264] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :     CNT2 
[EC_DRHOOK:WAW22:1:1:1983:1983] [20221231:175405:1672505645:452164.267] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :      CNT3 
[EC_DRHOOK:WAW22:1:1:1983:1983] [20221231:175405:1672505645:452164.267] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :       CNT4 
[EC_DRHOOK:WAW22:1:1:1983:1983] [20221231:175405:1672505645:452164.267] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :        WVCOUPLE 
[EC_DRHOOK:WAW22:1:1:1983:1983] [20221231:175405:1672505645:452164.267] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :         WAVEMDL 
[EC_DRHOOK:WAW22:1:1:1983:1983] [20221231:175405:1672505645:452164.267] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :          WAMODEL 
[EC_DRHOOK:WAW22:1:1:1983:1983] [20221231:175405:1672505645:452164.267] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :           >OMP-WAMODEL 2            (1431) 
[EC_DRHOOK:WAW22:1:1:1983:1983] [20221231:175405:1672505645:452164.267] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :            IMPLSCH 
[EC_DRHOOK:WAW22:1:1:1983:1983] [20221231:175405:1672505645:452164.267] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :             SDISSIP 
[EC_DRHOOK:WAW22:1:1:1983:1983] [20221231:175405:1672505645:452164.267] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :              SDISSIP_JAN 
[EC_DRHOOK:WAW22:1:1:1983:1983] [20221231:175406:1672505646:452165.271] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1734] DrHook backtrace done for signal#15, nsigs = 1
[EC_DRHOOK:WAW22:1:1:1983:1983] [20221231:175406:1672505646:452165.271] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1785] Calling previous signal handler at 0x1ce8bb0 for signal#15, nsigs = 1
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source             
oifs_43r3_model.e  0000000001CE916B  Unknown               Unknown  Unknown
oifs_43r3_model.e  000000000081FFF1  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DC9090  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001A9DA61  sdissip_jan_              163  sdissip_jan.F
oifs_43r3_model.e  0000000001A85F63  sdissip_                   93  sdissip.F90
oifs_43r3_model.e  0000000001A3136A  implsch_                  291  implsch.F
oifs_43r3_model.e  000000000168CBD7  wamodel_                 1008  wamodel.F
oifs_43r3_model.e  0000000000872295  wavemdl_                  584  wavemdl.F
oifs_43r3_model.e  00000000007E0165  wvcouple_                 260  wvcouple.F90
oifs_43r3_model.e  000000000055E4AD  cnt4_                    1283  cnt4.F90
oifs_43r3_model.e  00000000005471C9  cnt3_                     267  cnt3.F90
oifs_43r3_model.e  0000000000546412  cnt2_                      88  cnt2.F90
oifs_43r3_model.e  0000000000545E28  cnt1_                      92  cnt1.F90
oifs_43r3_model.e  000000000040708D  cnt0_                     146  cnt0.F90
oifs_43r3_model.e  000000000040220F  MAIN__                     96  master.F90
oifs_43r3_model.e  00000000004021A2  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DCA390  Unknown               Unknown  Unknown
oifs_43r3_model.e  000000000040206E  Unknown               Unknown  Unknown
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1995050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0707
(argv4) batchid: 964
(argv5) wuid: 12181351
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/8
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/8/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/8/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_ea3f8210b8c50e567d26675d19fa7d52 to: /var/lib/boinc-client/slots/8/oifs_43r3_ps_0707_1995050100_123_964_12181351.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/8/oifs_43r3_ps_0707_1995050100_123_964_12181351.zip
ic_ancil_file: ic_ancil_12181351
ifsdata_file: ifsdata_12181351
climate_data_file: clim_data_12181351
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_cd6523865c1d1fbe43f8e5320b50eec3 to: /var/lib/boinc-client/slots/8/ic_ancil_12181351.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/8/ic_ancil_12181351.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_ef2958591c31e87de13ad064e1a21b25 to: /var/lib/boinc-client/slots/8/ifsdata/ifsdata_12181351.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/8/ifsdata/ifsdata_12181351.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/8/159l_2/clim_data_12181351.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/8/159l_2/clim_data_12181351.zip
Checking for progress XML file: /var/lib/boinc-client/slots/8/progress_file_12181351.xml
Opened progress file ok : /var/lib/boinc-client/slots/8/progress_file_12181351.xml
-- Model is restarting --
Adjusting last_iter, 2787, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/8/progress_file_12181351.xml
last_cpu_time: 98804
upload_file_number: 116
last_iter: 2783
last_upload: 10022400
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0707_1995050100_123_964_12181351_0_r500507084
The child process has been launched with process id: 2049
Executing the command: /var/lib/boinc-client/slots/8/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:WAW22:1:1:2049:2049] [20230101:125108:1672573868:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:WAW22:1:1:2049:2049] [20230101:125108:1672573868:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:WAW22:1:1:2049:2049] [20230101:125108:1672573868:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:WAW22:1:1:2049:2049] [20230101:125108:1672573868:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:WAW22:1:1:2049:2049] [20230101:125108:1672573868:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:WAW22:1:1:2049:2049] [20230101:125108:1672573868:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:WAW22:1:1:2049:2049] [20230101:125108:1672573868:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:WAW22:1:1:2049:2049] [20230101:125108:1672573868:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:WAW22:1:1:2049:2049] [20230101:125108:1672573868:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:WAW22:1:1:2049:2049] [20230101:125108:1672573868:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:WAW22:1:1:2049:2049] [20230101:125108:1672573868:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:WAW22:1:1:2049:2049] [20230101:125108:1672573868:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:WAW22:1:1:2049:2049] [20230101:125108:1672573868:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:WAW22:1:1:2049:2049] [20230101:125108:1672573868:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:WAW22:1:1:2049:2049] [20230101:125108:1672573868:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:WAW22:1:1:2049:2049] [20230101:125108:1672573868:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:WAW22:1:1:2049:2049] [20230101:125108:1672573868:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:WAW22:1:1:2049:2049] [20230101:125108:1672573868:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:WAW22:1:1:2049:2049] [20230101:125108:1672573868:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:WAW22:1:1:2049:2049] [20230101:125108:1672573868:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:WAW22:1:1:2049:2049] [20230101:125108:1672573868:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:WAW22:1:1:2049:2049] [20230101:125108:1672573868:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:WAW22:1:1:2049:2049] [20230101:125108:1672573868:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:WAW22:1:1:2049:2049] [20230101:125108:1672573868:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:WAW22:1:1:2049:2049] [20230101:125108:1672573868:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:WAW22:1:1:2049:2049] [20230101:125108:1672573868:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:WAW22:1:1:2049:2049] [20230101:125108:1672573868:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:WAW22:1:1:2049:2049] [20230101:125108:1672573868:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:WAW22:1:1:2049:2049] [20230101:125108:1672573868:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:WAW22:1:1:2049:2049] [20230101:125108:1672573868:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  12:52:35 STEP 2784 H=2784:00 +CPU= 81.397
  12:53:22 STEP 2785 H=2785:00 +CPU= 47.148
  12:54:00 STEP 2786 H=2786:00 +CPU= 37.295
  12:54:57 STEP 2787 H=2787:00 +CPU= 57.416
  12:55:41 STEP 2788 H=2788:00 +CPU= 43.465
  12:56:29 STEP 2789 H=2789:00 +CPU= 41.300
  12:57:27 STEP 2790 H=2790:00 +CPU= 54.147
  12:58:02 STEP 2791 H=2791:00 +CPU= 34.081
  12:58:48 STEP 2792 H=2792:00 +CPU= 40.282
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  13:11:27 STEP 2793 H=2793:00 +CPU= 56.813
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  13:22:31 STEP 2794 H=2794:00 +CPU= 43.131
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  13:28:44 STEP 2795 H=2795:00 +CPU= 47.635
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  13:43:07 STEP 2796 H=2796:00 +CPU= 53.782
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002796
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002796
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002796
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  13:44:02 STEP 2797 H=2797:00 +CPU= 27.975
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  13:52:00 STEP 2798 H=2798:00 +CPU= 32.781
  13:53:03 STEP 2799 H=2799:00 +CPU= 58.043
  13:53:47 STEP 2800 H=2800:00 +CPU= 42.997
  13:54:35 STEP 2801 H=2801:00 +CPU= 46.641
  13:55:44 STEP 2802 H=2802:00 +CPU= 67.713
  13:56:31 STEP 2803 H=2803:00 +CPU= 45.524
  13:57:17 STEP 2804 H=2804:00 +CPU= 44.181
  13:58:31 STEP 2805 H=2805:00 +CPU= 72.512
  13:59:28 STEP 2806 H=2806:00 +CPU= 55.408
  14:00:21 STEP 2807 H=2807:00 +CPU= 51.213
  14:01:38 STEP 2808 H=2808:00 +CPU= 75.223
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002808
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002808
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMGGhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMSHhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMUAhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMGGhq0f+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMSHhq0f+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMUAhq0f+002796
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0707_1995050100_123_964_12181351_0_r500507084_116.zip
Uploading the intermediate file: upload_file_116.zip
  14:02:21 STEP 2809 H=2809:00 +CPU= 41.441
  14:03:01 STEP 2810 H=2810:00 +CPU= 38.920
  14:04:14 STEP 2811 H=2811:00 +CPU= 70.242
  14:05:08 STEP 2812 H=2812:00 +CPU= 52.975
  14:05:58 STEP 2813 H=2813:00 +CPU= 48.403
  14:07:12 STEP 2814 H=2814:00 +CPU= 72.067
  14:07:54 STEP 2815 H=2815:00 +CPU= 40.609
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:13:54 STEP 2816 H=2816:00 +CPU= 36.215
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:16:08 STEP 2817 H=2817:00 +CPU= 53.129
  14:16:44 STEP 2818 H=2818:00 +CPU= 34.750
  14:17:20 STEP 2819 H=2819:00 +CPU= 36.179
  14:18:30 STEP 2820 H=2820:00 +CPU= 69.177
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002820
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002820
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002820
  14:19:04 STEP 2821 H=2821:00 +CPU= 33.515
  14:19:37 STEP 2822 H=2822:00 +CPU= 32.408
  14:20:34 STEP 2823 H=2823:00 +CPU= 56.307
  14:21:25 STEP 2824 H=2824:00 +CPU= 50.050
  14:22:10 STEP 2825 H=2825:00 +CPU= 43.917
  14:23:22 STEP 2826 H=2826:00 +CPU= 70.609
  14:24:14 STEP 2827 H=2827:00 +CPU= 51.608
  14:24:59 STEP 2828 H=2828:00 +CPU= 44.057
  14:26:10 STEP 2829 H=2829:00 +CPU= 70.062
  14:27:01 STEP 2830 H=2830:00 +CPU= 50.500
  14:27:51 STEP 2831 H=2831:00 +CPU= 48.940
  14:29:24 STEP 2832 H=2832:00 +CPU= 91.245
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002832
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002832
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMGGhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMSHhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMUAhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMGGhq0f+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMSHhq0f+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMUAhq0f+002820
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0707_1995050100_123_964_12181351_0_r500507084_117.zip
Uploading the intermediate file: upload_file_117.zip
  14:30:14 STEP 2833 H=2833:00 +CPU= 48.790
  14:31:00 STEP 2834 H=2834:00 +CPU= 45.164
  14:32:00 STEP 2835 H=2835:00 +CPU= 58.646
  14:32:38 STEP 2836 H=2836:00 +CPU= 37.285
  14:33:16 STEP 2837 H=2837:00 +CPU= 38.024
  14:34:14 STEP 2838 H=2838:00 +CPU= 57.196
  14:34:54 STEP 2839 H=2839:00 +CPU= 34.948
  14:35:35 STEP 2840 H=2840:00 +CPU= 34.094
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:42:31 STEP 2841 H=2841:00 +CPU= 46.842
  14:43:13 STEP 2842 H=2842:00 +CPU= 31.861
  14:43:54 STEP 2843 H=2843:00 +CPU= 31.115
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:45:19 STEP 2844 H=2844:00 +CPU= 56.404
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002844
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002844
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002844
  14:45:58 STEP 2845 H=2845:00 +CPU= 36.442
  14:46:37 STEP 2846 H=2846:00 +CPU= 36.460
  14:47:33 STEP 2847 H=2847:00 +CPU= 54.353
  14:48:14 STEP 2848 H=2848:00 +CPU= 38.942
  14:48:55 STEP 2849 H=2849:00 +CPU= 38.619
  14:49:53 STEP 2850 H=2850:00 +CPU= 55.104
  14:50:26 STEP 2851 H=2851:00 +CPU= 31.358
  14:50:58 STEP 2852 H=2852:00 +CPU= 31.476
  14:51:41 STEP 2853 H=2853:00 +CPU= 41.042
  14:52:09 STEP 2854 H=2854:00 +CPU= 26.905
  14:52:37 STEP 2855 H=2855:00 +CPU= 26.835
  14:53:26 STEP 2856 H=2856:00 +CPU= 47.515
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002856
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002856
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMGGhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMSHhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMUAhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMGGhq0f+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMSHhq0f+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMUAhq0f+002844
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0707_1995050100_123_964_12181351_0_r500507084_118.zip
Uploading the intermediate file: upload_file_118.zip
  14:53:54 STEP 2857 H=2857:00 +CPU= 26.269
  14:54:24 STEP 2858 H=2858:00 +CPU= 27.207
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1995050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0707
(argv4) batchid: 964
(argv5) wuid: 12181351
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/8
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/8/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/8/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_ea3f8210b8c50e567d26675d19fa7d52 to: /var/lib/boinc-client/slots/8/oifs_43r3_ps_0707_1995050100_123_964_12181351.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/8/oifs_43r3_ps_0707_1995050100_123_964_12181351.zip
ic_ancil_file: ic_ancil_12181351
ifsdata_file: ifsdata_12181351
climate_data_file: clim_data_12181351
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_cd6523865c1d1fbe43f8e5320b50eec3 to: /var/lib/boinc-client/slots/8/ic_ancil_12181351.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/8/ic_ancil_12181351.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_ef2958591c31e87de13ad064e1a21b25 to: /var/lib/boinc-client/slots/8/ifsdata/ifsdata_12181351.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/8/ifsdata/ifsdata_12181351.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/8/159l_2/clim_data_12181351.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/8/159l_2/clim_data_12181351.zip
Checking for progress XML file: /var/lib/boinc-client/slots/8/progress_file_12181351.xml
Opened progress file ok : /var/lib/boinc-client/slots/8/progress_file_12181351.xml
-- Model is restarting --
Adjusting last_iter, 2859, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/8/progress_file_12181351.xml
last_cpu_time: 102347
upload_file_number: 119
last_iter: 2855
last_upload: 10281600
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0707_1995050100_123_964_12181351_0_r500507084
The child process has been launched with process id: 63796
Executing the command: /var/lib/boinc-client/slots/8/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:WAW22:1:1:63796:63796] [20230101:153002:1672583402:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:WAW22:1:1:63796:63796] [20230101:153002:1672583402:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:WAW22:1:1:63796:63796] [20230101:153002:1672583402:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:WAW22:1:1:63796:63796] [20230101:153002:1672583402:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:WAW22:1:1:63796:63796] [20230101:153002:1672583402:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:WAW22:1:1:63796:63796] [20230101:153002:1672583402:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:WAW22:1:1:63796:63796] [20230101:153002:1672583402:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:WAW22:1:1:63796:63796] [20230101:153002:1672583402:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:WAW22:1:1:63796:63796] [20230101:153002:1672583402:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:WAW22:1:1:63796:63796] [20230101:153002:1672583402:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:WAW22:1:1:63796:63796] [20230101:153002:1672583402:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:WAW22:1:1:63796:63796] [20230101:153002:1672583402:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:WAW22:1:1:63796:63796] [20230101:153002:1672583402:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:WAW22:1:1:63796:63796] [20230101:153002:1672583402:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:WAW22:1:1:63796:63796] [20230101:153002:1672583402:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:WAW22:1:1:63796:63796] [20230101:153002:1672583402:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:WAW22:1:1:63796:63796] [20230101:153002:1672583402:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:WAW22:1:1:63796:63796] [20230101:153002:1672583402:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:WAW22:1:1:63796:63796] [20230101:153002:1672583402:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:WAW22:1:1:63796:63796] [20230101:153002:1672583402:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:WAW22:1:1:63796:63796] [20230101:153002:1672583402:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:WAW22:1:1:63796:63796] [20230101:153002:1672583402:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:WAW22:1:1:63796:63796] [20230101:153002:1672583402:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:WAW22:1:1:63796:63796] [20230101:153002:1672583402:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:WAW22:1:1:63796:63796] [20230101:153002:1672583402:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:WAW22:1:1:63796:63796] [20230101:153002:1672583402:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:WAW22:1:1:63796:63796] [20230101:153002:1672583402:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:WAW22:1:1:63796:63796] [20230101:153002:1672583402:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:WAW22:1:1:63796:63796] [20230101:153002:1672583402:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:WAW22:1:1:63796:63796] [20230101:153002:1672583402:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  15:31:07 STEP 2856 H=2856:00 +CPU= 51.875
  15:31:39 STEP 2857 H=2857:00 +CPU= 27.939
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:32:43 STEP 2858 H=2858:00 +CPU= 31.351
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:00:39 STEP 2859 H=2859:00 +CPU= 50.966
  16:01:14 STEP 2860 H=2860:00 +CPU= 30.976
  16:01:50 STEP 2861 H=2861:00 +CPU= 32.452
  16:02:49 STEP 2862 H=2862:00 +CPU= 51.716
  16:03:28 STEP 2863 H=2863:00 +CPU= 33.678
  16:04:04 STEP 2864 H=2864:00 +CPU= 32.326
  16:04:57 STEP 2865 H=2865:00 +CPU= 49.517
  16:05:34 STEP 2866 H=2866:00 +CPU= 33.493
  16:06:07 STEP 2867 H=2867:00 +CPU= 30.142
  16:07:03 STEP 2868 H=2868:00 +CPU= 52.442
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002868
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002868
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002868
  16:07:35 STEP 2869 H=2869:00 +CPU= 29.099
  16:08:11 STEP 2870 H=2870:00 +CPU= 33.571
  16:09:05 STEP 2871 H=2871:00 +CPU= 49.185
  16:09:41 STEP 2872 H=2872:00 +CPU= 33.299
  16:10:16 STEP 2873 H=2873:00 +CPU= 32.138
  16:11:07 STEP 2874 H=2874:00 +CPU= 47.456
  16:11:40 STEP 2875 H=2875:00 +CPU= 30.735
  16:12:12 STEP 2876 H=2876:00 +CPU= 29.336
  16:12:58 STEP 2877 H=2877:00 +CPU= 43.485
  16:13:31 STEP 2878 H=2878:00 +CPU= 29.915
  16:14:04 STEP 2879 H=2879:00 +CPU= 30.924
  16:15:01 STEP 2880 H=2880:00 +CPU= 52.487
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002880
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002880
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMGGhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMSHhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMUAhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMGGhq0f+002868
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMSHhq0f+002868
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMUAhq0f+002868
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0707_1995050100_123_964_12181351_0_r500507084_119.zip
Uploading the intermediate file: upload_file_119.zip
  16:15:32 STEP 2881 H=2881:00 +CPU= 28.902
  16:16:04 STEP 2882 H=2882:00 +CPU= 28.664
  16:16:51 STEP 2883 H=2883:00 +CPU= 43.928
  16:17:27 STEP 2884 H=2884:00 +CPU= 33.589
  16:18:00 STEP 2885 H=2885:00 +CPU= 30.926
  16:18:55 STEP 2886 H=2886:00 +CPU= 51.001
  16:19:30 STEP 2887 H=2887:00 +CPU= 32.754
  16:20:05 STEP 2888 H=2888:00 +CPU= 32.795
  16:20:57 STEP 2889 H=2889:00 +CPU= 48.018
  16:21:30 STEP 2890 H=2890:00 +CPU= 31.449
  16:22:06 STEP 2891 H=2891:00 +CPU= 32.840
  16:23:03 STEP 2892 H=2892:00 +CPU= 53.851
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002892
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002892
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002892
  16:23:38 STEP 2893 H=2893:00 +CPU= 32.401
  16:24:13 STEP 2894 H=2894:00 +CPU= 32.842
  16:25:02 STEP 2895 H=2895:00 +CPU= 46.101
  16:25:33 STEP 2896 H=2896:00 +CPU= 29.014
  16:26:04 STEP 2897 H=2897:00 +CPU= 29.008
  16:26:54 STEP 2898 H=2898:00 +CPU= 46.686
  16:27:26 STEP 2899 H=2899:00 +CPU= 30.445
  16:27:58 STEP 2900 H=2900:00 +CPU= 29.225
  16:28:44 STEP 2901 H=2901:00 +CPU= 43.153
  16:29:14 STEP 2902 H=2902:00 +CPU= 28.375
  16:29:45 STEP 2903 H=2903:00 +CPU= 29.128
  16:30:37 STEP 2904 H=2904:00 +CPU= 49.383
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002904
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002904
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMGGhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMSHhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMUAhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMGGhq0f+002892
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMSHhq0f+002892
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMUAhq0f+002892
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0707_1995050100_123_964_12181351_0_r500507084_120.zip
Uploading the intermediate file: upload_file_120.zip
  16:31:07 STEP 2905 H=2905:00 +CPU= 28.001
  16:31:37 STEP 2906 H=2906:00 +CPU= 28.191
  16:32:23 STEP 2907 H=2907:00 +CPU= 42.821
  16:32:53 STEP 2908 H=2908:00 +CPU= 28.517
  16:33:23 STEP 2909 H=2909:00 +CPU= 27.890
  16:34:09 STEP 2910 H=2910:00 +CPU= 43.434
  16:34:40 STEP 2911 H=2911:00 +CPU= 29.275
  16:35:11 STEP 2912 H=2912:00 +CPU= 28.977
  16:35:56 STEP 2913 H=2913:00 +CPU= 41.869
  16:36:26 STEP 2914 H=2914:00 +CPU= 28.573
  16:36:56 STEP 2915 H=2915:00 +CPU= 27.535
  16:37:44 STEP 2916 H=2916:00 +CPU= 45.502
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002916
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002916
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002916
  16:38:12 STEP 2917 H=2917:00 +CPU= 26.181
  16:38:40 STEP 2918 H=2918:00 +CPU= 26.984
  16:39:23 STEP 2919 H=2919:00 +CPU= 40.054
  16:39:51 STEP 2920 H=2920:00 +CPU= 26.842
  16:40:19 STEP 2921 H=2921:00 +CPU= 25.935
  16:41:02 STEP 2922 H=2922:00 +CPU= 40.541
  16:41:30 STEP 2923 H=2923:00 +CPU= 26.422
  16:41:59 STEP 2924 H=2924:00 +CPU= 27.717
  16:42:42 STEP 2925 H=2925:00 +CPU= 40.115
  16:43:11 STEP 2926 H=2926:00 +CPU= 27.008
  16:43:42 STEP 2927 H=2927:00 +CPU= 27.466
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:45:43 STEP 2928 H=2928:00 +CPU= 48.802
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002928
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002928
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMGGhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMSHhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMUAhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMGGhq0f+002916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMSHhq0f+002916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMUAhq0f+002916
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0707_1995050100_123_964_12181351_0_r500507084_121.zip
Uploading the intermediate file: upload_file_121.zip
  16:46:20 STEP 2929 H=2929:00 +CPU= 21.528
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:00:37 STEP 2930 H=2930:00 +CPU= 27.275
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:07:27 STEP 2931 H=2931:00 +CPU= 43.166
  17:07:57 STEP 2932 H=2932:00 +CPU= 28.189
  17:08:25 STEP 2933 H=2933:00 +CPU= 26.202
  17:09:11 STEP 2934 H=2934:00 +CPU= 42.804
  17:09:41 STEP 2935 H=2935:00 +CPU= 27.811
  17:10:12 STEP 2936 H=2936:00 +CPU= 28.648
  17:10:59 STEP 2937 H=2937:00 +CPU= 42.839
  17:11:30 STEP 2938 H=2938:00 +CPU= 28.569
  17:12:00 STEP 2939 H=2939:00 +CPU= 28.119
  17:12:52 STEP 2940 H=2940:00 +CPU= 47.681
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002940
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002940
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002940
  17:13:23 STEP 2941 H=2941:00 +CPU= 27.845
  17:13:54 STEP 2942 H=2942:00 +CPU= 29.018
  17:14:41 STEP 2943 H=2943:00 +CPU= 43.524
  17:15:12 STEP 2944 H=2944:00 +CPU= 28.201
  17:15:43 STEP 2945 H=2945:00 +CPU= 28.348
  17:16:31 STEP 2946 H=2946:00 +CPU= 44.259
  17:17:01 STEP 2947 H=2947:00 +CPU= 27.258
  17:17:33 STEP 2948 H=2948:00 +CPU= 29.174
  17:18:20 STEP 2949 H=2949:00 +CPU= 43.991
  17:18:50 STEP 2950 H=2950:00 +CPU= 28.302
  17:19:22 STEP 2951 H=2951:00 +CPU= 29.098
  17:20:15 STEP 2952 H=2952:00 +CPU= 48.447
The child process terminated with status: 0
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002952
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002952
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMGGhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMUAhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMSHhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMUAhq0f+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMUAhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMSHhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMSHhq0f+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMGGhq0f+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181351/ICMGGhq0f+002928
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0707_1995050100_123_964_12181351_0_r500507084_122.zip
Uploading the final file: upload_file_122.zip
Uploading trickle at timestep: 10623600
17:23:38 (63789): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:05:12 1521081 22266380 oifs_43r3_ps_0707_1995050100_123_964_12181351_0 10,623,600 105,760 0.0100
09 May 2023 16:05:02 1521081 22266380 oifs_43r3_ps_0707_1995050100_123_964_12181351_0 9,936,000 97,881 0.0099
09 May 2023 16:04:08 1521081 22266380 oifs_43r3_ps_0707_1995050100_123_964_12181351_0 9,072,000 89,610 0.0099
09 May 2023 16:04:02 1521081 22266380 oifs_43r3_ps_0707_1995050100_123_964_12181351_0 8,208,000 81,403 0.0099
09 May 2023 16:03:54 1521081 22266380 oifs_43r3_ps_0707_1995050100_123_964_12181351_0 7,344,000 73,401 0.0100
09 May 2023 16:03:46 1521081 22266380 oifs_43r3_ps_0707_1995050100_123_964_12181351_0 6,480,000 65,044 0.0100
09 May 2023 16:03:40 1521081 22266380 oifs_43r3_ps_0707_1995050100_123_964_12181351_0 5,616,000 56,194 0.0100
09 May 2023 16:03:31 1521081 22266380 oifs_43r3_ps_0707_1995050100_123_964_12181351_0 4,752,000 47,146 0.0099
09 May 2023 16:03:21 1521081 22266380 oifs_43r3_ps_0707_1995050100_123_964_12181351_0 3,888,000 38,250 0.0098
09 May 2023 15:48:22 1521081 22266380 oifs_43r3_ps_0707_1995050100_123_964_12181351_0 2,592,000 24,749 0.0095
09 May 2023 15:48:09 1521081 22266380 oifs_43r3_ps_0707_1995050100_123_964_12181351_0 1,728,000 16,154 0.0093
09 May 2023 15:47:58 1521081 22266380 oifs_43r3_ps_0707_1995050100_123_964_12181351_0 864,000 8,288 0.0096


©2024 cpdn.org