climateprediction.net home page
Task 22263073

Task 22263073

Name oifs_43r3_ps_0579_1992050100_123_961_12178223_0
Workunit 12178223
Created 22 Dec 2022, 0:51:15 UTC
Sent 22 Dec 2022, 1:01:46 UTC
Report deadline 21 Jan 2023, 1:01:46 UTC
Received 22 Dec 2022, 19:42:49 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 194 (0x000000C2) EXIT_ABORTED_BY_CLIENT
Computer ID 1534978
Run time 16 hours 4 min 51 sec
CPU time 15 hours 25 min 57 sec
Validate state Invalid
Credit 14,873.04
Device peak FLOPS 5.10 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,796.51 MB
Peak swap size 4,974.39 MB
Peak disk usage 1,226.43 MB
Stderr
<core_client_version>7.16.16</core_client_version>
<![CDATA[
<message>
Process still present 5 min after writing finish file; aborting</message>
<stderr_txt>
3/ICMUAhq0f+002640
Adding to the zip: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178223/ICMGGhq0f+002652
Adding to the zip: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178223/ICMSHhq0f+002652
Adding to the zip: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178223/ICMUAhq0f+002652
Zipping up the intermediate file: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0579_1992050100_123_961_12178223_0_r383645923_110.zip
Uploading the intermediate file: upload_file_110.zip
  18:28:42 STEP 2665 H=2665:00 +CPU= 15.437
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:29:00 STEP 2666 H=2666:00 +CPU= 15.771
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:29:26 STEP 2667 H=2667:00 +CPU= 24.005
  18:29:42 STEP 2668 H=2668:00 +CPU= 15.783
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:29:59 STEP 2669 H=2669:00 +CPU= 15.300
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:30:26 STEP 2670 H=2670:00 +CPU= 24.449
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:30:43 STEP 2671 H=2671:00 +CPU= 15.378
  18:30:59 STEP 2672 H=2672:00 +CPU= 15.791
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:31:27 STEP 2673 H=2673:00 +CPU= 23.924
  18:31:43 STEP 2674 H=2674:00 +CPU= 15.773
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:32:00 STEP 2675 H=2675:00 +CPU= 15.380
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:32:29 STEP 2676 H=2676:00 +CPU= 26.669
Moving to projects directory: /mnt/xvol/xvar/lib/boinc-client/slots/0/ICMGGhq0f+002676
Moving to projects directory: /mnt/xvol/xvar/lib/boinc-client/slots/0/ICMSHhq0f+002676
Moving to projects directory: /mnt/xvol/xvar/lib/boinc-client/slots/0/ICMUAhq0f+002676
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:32:46 STEP 2677 H=2677:00 +CPU= 15.321
  18:33:02 STEP 2678 H=2678:00 +CPU= 15.770
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:33:28 STEP 2679 H=2679:00 +CPU= 23.857
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:33:45 STEP 2680 H=2680:00 +CPU= 15.725
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:34:03 STEP 2681 H=2681:00 +CPU= 15.374
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:34:29 STEP 2682 H=2682:00 +CPU= 24.367
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:34:47 STEP 2683 H=2683:00 +CPU= 15.341
  18:35:02 STEP 2684 H=2684:00 +CPU= 15.739
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:35:28 STEP 2685 H=2685:00 +CPU= 23.906
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:35:46 STEP 2686 H=2686:00 +CPU= 15.742
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:36:04 STEP 2687 H=2687:00 +CPU= 15.759
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:36:34 STEP 2688 H=2688:00 +CPU= 28.037
Moving to projects directory: /mnt/xvol/xvar/lib/boinc-client/slots/0/ICMGGhq0f+002688
Moving to projects directory: /mnt/xvol/xvar/lib/boinc-client/slots/0/ICMSHhq0f+002688
Moving to projects directory: /mnt/xvol/xvar/lib/boinc-client/slots/0/ICMUAhq0f+002688
Adding to the zip: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178223/ICMGGhq0f+002664
Adding to the zip: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178223/ICMSHhq0f+002664
Adding to the zip: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178223/ICMUAhq0f+002664
Adding to the zip: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178223/ICMGGhq0f+002676
Adding to the zip: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178223/ICMSHhq0f+002676
Adding to the zip: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178223/ICMUAhq0f+002676
Zipping up the intermediate file: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0579_1992050100_123_961_12178223_0_r383645923_111.zip
Uploading the intermediate file: upload_file_111.zip
  18:36:49 STEP 2689 H=2689:00 +CPU= 15.435
  18:37:05 STEP 2690 H=2690:00 +CPU= 15.767
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:37:31 STEP 2691 H=2691:00 +CPU= 24.018
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:37:49 STEP 2692 H=2692:00 +CPU= 15.754
  18:38:04 STEP 2693 H=2693:00 +CPU= 15.358
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:38:33 STEP 2694 H=2694:00 +CPU= 24.444
  18:38:48 STEP 2695 H=2695:00 +CPU= 15.315
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:39:06 STEP 2696 H=2696:00 +CPU= 15.763
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:39:32 STEP 2697 H=2697:00 +CPU= 23.903
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:39:50 STEP 2698 H=2698:00 +CPU= 15.814
  18:40:05 STEP 2699 H=2699:00 +CPU= 15.352
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:40:34 STEP 2700 H=2700:00 +CPU= 26.627
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /mnt/xvol/xvar/lib/boinc-client/slots/0/ICMGGhq0f+002700
Moving to projects directory: /mnt/xvol/xvar/lib/boinc-client/slots/0/ICMSHhq0f+002700
Moving to projects directory: /mnt/xvol/xvar/lib/boinc-client/slots/0/ICMUAhq0f+002700
  18:40:51 STEP 2701 H=2701:00 +CPU= 15.369
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:41:09 STEP 2702 H=2702:00 +CPU= 15.786
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:41:35 STEP 2703 H=2703:00 +CPU= 23.846
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:41:53 STEP 2704 H=2704:00 +CPU= 15.729
  18:42:08 STEP 2705 H=2705:00 +CPU= 15.345
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:42:34 STEP 2706 H=2706:00 +CPU= 24.390
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:42:52 STEP 2707 H=2707:00 +CPU= 15.327
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:43:10 STEP 2708 H=2708:00 +CPU= 15.757
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:43:35 STEP 2709 H=2709:00 +CPU= 23.885
  18:43:51 STEP 2710 H=2710:00 +CPU= 15.776
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:44:09 STEP 2711 H=2711:00 +CPU= 15.741
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:44:39 STEP 2712 H=2712:00 +CPU= 28.060
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /mnt/xvol/xvar/lib/boinc-client/slots/0/ICMGGhq0f+002712
Moving to projects directory: /mnt/xvol/xvar/lib/boinc-client/slots/0/ICMSHhq0f+002712
Moving to projects directory: /mnt/xvol/xvar/lib/boinc-client/slots/0/ICMUAhq0f+002712
Adding to the zip: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178223/ICMGGhq0f+002688
Adding to the zip: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178223/ICMSHhq0f+002688
Adding to the zip: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178223/ICMUAhq0f+002688
Adding to the zip: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178223/ICMGGhq0f+002700
Adding to the zip: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178223/ICMSHhq0f+002700
Adding to the zip: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178223/ICMUAhq0f+002700
Zipping up the intermediate file: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0579_1992050100_123_961_12178223_0_r383645923_112.zip
Uploading the intermediate file: upload_file_112.zip
  18:44:57 STEP 2713 H=2713:00 +CPU= 15.408
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:45:14 STEP 2714 H=2714:00 +CPU= 15.749
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:45:40 STEP 2715 H=2715:00 +CPU= 24.081
  18:45:56 STEP 2716 H=2716:00 +CPU= 15.793
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:46:14 STEP 2717 H=2717:00 +CPU= 15.344
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:46:40 STEP 2718 H=2718:00 +CPU= 24.447
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:46:57 STEP 2719 H=2719:00 +CPU= 15.382
  18:47:13 STEP 2720 H=2720:00 +CPU= 15.804
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:47:41 STEP 2721 H=2721:00 +CPU= 23.977
  18:47:57 STEP 2722 H=2722:00 +CPU= 15.857
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:48:15 STEP 2723 H=2723:00 +CPU= 15.363
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:48:43 STEP 2724 H=2724:00 +CPU= 26.582
Moving to projects directory: /mnt/xvol/xvar/lib/boinc-client/slots/0/ICMGGhq0f+002724
Moving to projects directory: /mnt/xvol/xvar/lib/boinc-client/slots/0/ICMSHhq0f+002724
Moving to projects directory: /mnt/xvol/xvar/lib/boinc-client/slots/0/ICMUAhq0f+002724
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:49:01 STEP 2725 H=2725:00 +CPU= 15.374
  18:49:16 STEP 2726 H=2726:00 +CPU= 15.785
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:49:42 STEP 2727 H=2727:00 +CPU= 23.891
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:50:00 STEP 2728 H=2728:00 +CPU= 15.694
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:50:17 STEP 2729 H=2729:00 +CPU= 15.341
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:50:44 STEP 2730 H=2730:00 +CPU= 24.421
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:51:01 STEP 2731 H=2731:00 +CPU= 15.343
  18:51:17 STEP 2732 H=2732:00 +CPU= 15.753
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:51:43 STEP 2733 H=2733:00 +CPU= 23.945
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:52:01 STEP 2734 H=2734:00 +CPU= 15.746
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:52:19 STEP 2735 H=2735:00 +CPU= 15.856
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:52:49 STEP 2736 H=2736:00 +CPU= 28.161
Moving to projects directory: /mnt/xvol/xvar/lib/boinc-client/slots/0/ICMGGhq0f+002736
Moving to projects directory: /mnt/xvol/xvar/lib/boinc-client/slots/0/ICMSHhq0f+002736
Moving to projects directory: /mnt/xvol/xvar/lib/boinc-client/slots/0/ICMUAhq0f+002736
Adding to the zip: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178223/ICMGGhq0f+002712
Adding to the zip: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178223/ICMSHhq0f+002712
Adding to the zip: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178223/ICMUAhq0f+002712
Adding to the zip: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178223/ICMGGhq0f+002724
Adding to the zip: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178223/ICMSHhq0f+002724
Adding to the zip: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178223/ICMUAhq0f+002724
Zipping up the intermediate file: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0579_1992050100_123_961_12178223_0_r383645923_113.zip
Uploading the intermediate file: upload_file_113.zip
  18:53:04 STEP 2737 H=2737:00 +CPU= 15.497
  18:53:20 STEP 2738 H=2738:00 +CPU= 15.814
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:53:46 STEP 2739 H=2739:00 +CPU= 24.141
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:54:04 STEP 2740 H=2740:00 +CPU= 15.805
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:54:21 STEP 2741 H=2741:00 +CPU= 15.344
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:54:48 STEP 2742 H=2742:00 +CPU= 24.450
  18:55:03 STEP 2743 H=2743:00 +CPU= 15.396
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:55:21 STEP 2744 H=2744:00 +CPU= 15.838
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:55:47 STEP 2745 H=2745:00 +CPU= 24.022
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:56:05 STEP 2746 H=2746:00 +CPU= 15.825
  18:56:21 STEP 2747 H=2747:00 +CPU= 15.389
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:56:51 STEP 2748 H=2748:00 +CPU= 26.713
Moving to projects directory: /mnt/xvol/xvar/lib/boinc-client/slots/0/ICMGGhq0f+002748
Moving to projects directory: /mnt/xvol/xvar/lib/boinc-client/slots/0/ICMSHhq0f+002748
Moving to projects directory: /mnt/xvol/xvar/lib/boinc-client/slots/0/ICMUAhq0f+002748
  18:57:07 STEP 2749 H=2749:00 +CPU= 15.442
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:57:25 STEP 2750 H=2750:00 +CPU= 15.839
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:57:51 STEP 2751 H=2751:00 +CPU= 23.901
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:58:08 STEP 2752 H=2752:00 +CPU= 15.765
  18:58:24 STEP 2753 H=2753:00 +CPU= 15.456
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:58:50 STEP 2754 H=2754:00 +CPU= 24.392
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:59:08 STEP 2755 H=2755:00 +CPU= 15.325
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:59:25 STEP 2756 H=2756:00 +CPU= 15.770
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:59:51 STEP 2757 H=2757:00 +CPU= 23.895
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:00:11 STEP 2758 H=2758:00 +CPU= 17.857
  19:00:30 STEP 2759 H=2759:00 +CPU= 18.500
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:01:02 STEP 2760 H=2760:00 +CPU= 28.225
Moving to projects directory: /mnt/xvol/xvar/lib/boinc-client/slots/0/ICMGGhq0f+002760
Moving to projects directory: /mnt/xvol/xvar/lib/boinc-client/slots/0/ICMSHhq0f+002760
Moving to projects directory: /mnt/xvol/xvar/lib/boinc-client/slots/0/ICMUAhq0f+002760
Adding to the zip: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178223/ICMGGhq0f+002736
Adding to the zip: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178223/ICMSHhq0f+002736
Adding to the zip: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178223/ICMUAhq0f+002736
Adding to the zip: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178223/ICMGGhq0f+002748
Adding to the zip: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178223/ICMSHhq0f+002748
Adding to the zip: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178223/ICMUAhq0f+002748
Zipping up the intermediate file: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0579_1992050100_123_961_12178223_0_r383645923_114.zip
Uploading the intermediate file: upload_file_114.zip
  19:01:18 STEP 2761 H=2761:00 +CPU= 15.445
  19:01:34 STEP 2762 H=2762:00 +CPU= 15.809
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:02:00 STEP 2763 H=2763:00 +CPU= 24.002
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:02:18 STEP 2764 H=2764:00 +CPU= 15.788
  19:02:33 STEP 2765 H=2765:00 +CPU= 15.457
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:03:00 STEP 2766 H=2766:00 +CPU= 24.486
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:03:17 STEP 2767 H=2767:00 +CPU= 15.378
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:03:35 STEP 2768 H=2768:00 +CPU= 15.856
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:04:01 STEP 2769 H=2769:00 +CPU= 24.005
  19:04:17 STEP 2770 H=2770:00 +CPU= 15.775
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:04:34 STEP 2771 H=2771:00 +CPU= 15.396
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:05:03 STEP 2772 H=2772:00 +CPU= 26.713
Moving to projects directory: /mnt/xvol/xvar/lib/boinc-client/slots/0/ICMGGhq0f+002772
Moving to projects directory: /mnt/xvol/xvar/lib/boinc-client/slots/0/ICMSHhq0f+002772
Moving to projects directory: /mnt/xvol/xvar/lib/boinc-client/slots/0/ICMUAhq0f+002772
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:05:20 STEP 2773 H=2773:00 +CPU= 15.428
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:05:38 STEP 2774 H=2774:00 +CPU= 15.808
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:06:04 STEP 2775 H=2775:00 +CPU= 23.920
  19:06:20 STEP 2776 H=2776:00 +CPU= 15.799
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:06:37 STEP 2777 H=2777:00 +CPU= 15.323
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:07:04 STEP 2778 H=2778:00 +CPU= 24.388
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:07:21 STEP 2779 H=2779:00 +CPU= 15.363
  19:07:37 STEP 2780 H=2780:00 +CPU= 15.720
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:08:03 STEP 2781 H=2781:00 +CPU= 23.957
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:08:20 STEP 2782 H=2782:00 +CPU= 15.748
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:08:38 STEP 2783 H=2783:00 +CPU= 15.787
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:09:08 STEP 2784 H=2784:00 +CPU= 28.113
Moving to projects directory: /mnt/xvol/xvar/lib/boinc-client/slots/0/ICMGGhq0f+002784
Moving to projects directory: /mnt/xvol/xvar/lib/boinc-client/slots/0/ICMSHhq0f+002784
Moving to projects directory: /mnt/xvol/xvar/lib/boinc-client/slots/0/ICMUAhq0f+002784
Adding to the zip: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178223/ICMGGhq0f+002760
Adding to the zip: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178223/ICMSHhq0f+002760
Adding to the zip: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178223/ICMUAhq0f+002760
Adding to the zip: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178223/ICMGGhq0f+002772
Adding to the zip: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178223/ICMSHhq0f+002772
Adding to the zip: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178223/ICMUAhq0f+002772
Zipping up the intermediate file: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0579_1992050100_123_961_12178223_0_r383645923_115.zip
Uploading the intermediate file: upload_file_115.zip
  19:09:24 STEP 2785 H=2785:00 +CPU= 15.502
  19:09:40 STEP 2786 H=2786:00 +CPU= 15.779
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:10:06 STEP 2787 H=2787:00 +CPU= 23.993
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:10:24 STEP 2788 H=2788:00 +CPU= 15.843
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:10:41 STEP 2789 H=2789:00 +CPU= 15.315
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:11:08 STEP 2790 H=2790:00 +CPU= 24.489
  19:11:23 STEP 2791 H=2791:00 +CPU= 15.406
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:11:41 STEP 2792 H=2792:00 +CPU= 15.780
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:12:07 STEP 2793 H=2793:00 +CPU= 23.986
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:12:25 STEP 2794 H=2794:00 +CPU= 15.879
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:12:42 STEP 2795 H=2795:00 +CPU= 15.392
  19:13:09 STEP 2796 H=2796:00 +CPU= 26.653
Moving to projects directory: /mnt/xvol/xvar/lib/boinc-client/slots/0/ICMGGhq0f+002796
Moving to projects directory: /mnt/xvol/xvar/lib/boinc-client/slots/0/ICMSHhq0f+002796
Moving to projects directory: /mnt/xvol/xvar/lib/boinc-client/slots/0/ICMUAhq0f+002796
  19:13:24 STEP 2797 H=2797:00 +CPU= 15.397
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:13:42 STEP 2798 H=2798:00 +CPU= 15.830
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:14:08 STEP 2799 H=2799:00 +CPU= 23.983
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:14:26 STEP 2800 H=2800:00 +CPU= 15.745
  19:14:41 STEP 2801 H=2801:00 +CPU= 15.414
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:15:08 STEP 2802 H=2802:00 +CPU= 24.341
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:15:25 STEP 2803 H=2803:00 +CPU= 15.316
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:15:43 STEP 2804 H=2804:00 +CPU= 15.774
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:16:09 STEP 2805 H=2805:00 +CPU= 23.895
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:16:26 STEP 2806 H=2806:00 +CPU= 15.772
  19:16:42 STEP 2807 H=2807:00 +CPU= 15.780
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:17:12 STEP 2808 H=2808:00 +CPU= 28.008
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /mnt/xvol/xvar/lib/boinc-client/slots/0/ICMGGhq0f+002808
Moving to projects directory: /mnt/xvol/xvar/lib/boinc-client/slots/0/ICMSHhq0f+002808
Moving to projects directory: /mnt/xvol/xvar/lib/boinc-client/slots/0/ICMUAhq0f+002808
Adding to the zip: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178223/ICMGGhq0f+002784
Adding to the zip: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178223/ICMSHhq0f+002784
Adding to the zip: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178223/ICMUAhq0f+002784
Adding to the zip: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178223/ICMGGhq0f+002796
Adding to the zip: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178223/ICMSHhq0f+002796
Adding to the zip: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178223/ICMUAhq0f+002796
Zipping up the intermediate file: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0579_1992050100_123_961_12178223_0_r383645923_116.zip
Uploading the intermediate file: upload_file_116.zip
  19:17:30 STEP 2809 H=2809:00 +CPU= 15.472
  19:17:46 STEP 2810 H=2810:00 +CPU= 15.786
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:18:12 STEP 2811 H=2811:00 +CPU= 24.019
  19:18:28 STEP 2812 H=2812:00 +CPU= 15.907
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:18:45 STEP 2813 H=2813:00 +CPU= 15.436
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:19:12 STEP 2814 H=2814:00 +CPU= 24.573
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:19:29 STEP 2815 H=2815:00 +CPU= 15.395
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:19:47 STEP 2816 H=2816:00 +CPU= 15.843
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:20:13 STEP 2817 H=2817:00 +CPU= 23.977
  19:20:29 STEP 2818 H=2818:00 +CPU= 15.813
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:20:46 STEP 2819 H=2819:00 +CPU= 15.455
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:21:15 STEP 2820 H=2820:00 +CPU= 26.704
Moving to projects directory: /mnt/xvol/xvar/lib/boinc-client/slots/0/ICMGGhq0f+002820
Moving to projects directory: /mnt/xvol/xvar/lib/boinc-client/slots/0/ICMSHhq0f+002820
Moving to projects directory: /mnt/xvol/xvar/lib/boinc-client/slots/0/ICMUAhq0f+002820
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:21:32 STEP 2821 H=2821:00 +CPU= 15.395
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:21:50 STEP 2822 H=2822:00 +CPU= 15.878
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:22:16 STEP 2823 H=2823:00 +CPU= 24.008
  19:22:32 STEP 2824 H=2824:00 +CPU= 15.815
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:22:49 STEP 2825 H=2825:00 +CPU= 15.357
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:23:16 STEP 2826 H=2826:00 +CPU= 24.430
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:23:33 STEP 2827 H=2827:00 +CPU= 15.408
  19:23:49 STEP 2828 H=2828:00 +CPU= 15.807
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:24:15 STEP 2829 H=2829:00 +CPU= 24.011
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:24:33 STEP 2830 H=2830:00 +CPU= 15.836
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:24:51 STEP 2831 H=2831:00 +CPU= 15.778
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:25:21 STEP 2832 H=2832:00 +CPU= 28.263
Moving to projects directory: /mnt/xvol/xvar/lib/boinc-client/slots/0/ICMGGhq0f+002832
Moving to projects directory: /mnt/xvol/xvar/lib/boinc-client/slots/0/ICMSHhq0f+002832
Moving to projects directory: /mnt/xvol/xvar/lib/boinc-client/slots/0/ICMUAhq0f+002832
Adding to the zip: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178223/ICMGGhq0f+002808
Adding to the zip: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178223/ICMSHhq0f+002808
Adding to the zip: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178223/ICMUAhq0f+002808
Adding to the zip: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178223/ICMGGhq0f+002820
Adding to the zip: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178223/ICMSHhq0f+002820
Adding to the zip: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178223/ICMUAhq0f+002820
Zipping up the intermediate file: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0579_1992050100_123_961_12178223_0_r383645923_117.zip
Uploading the intermediate file: upload_file_117.zip
  19:25:37 STEP 2833 H=2833:00 +CPU= 15.444
  19:25:52 STEP 2834 H=2834:00 +CPU= 15.798
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:26:18 STEP 2835 H=2835:00 +CPU= 23.981
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:26:36 STEP 2836 H=2836:00 +CPU= 15.856
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:26:54 STEP 2837 H=2837:00 +CPU= 15.545
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:27:20 STEP 2838 H=2838:00 +CPU= 24.486
  19:27:36 STEP 2839 H=2839:00 +CPU= 15.482
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:27:54 STEP 2840 H=2840:00 +CPU= 15.856
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:28:20 STEP 2841 H=2841:00 +CPU= 24.015
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:28:38 STEP 2842 H=2842:00 +CPU= 15.851
  19:28:53 STEP 2843 H=2843:00 +CPU= 15.469
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:29:24 STEP 2844 H=2844:00 +CPU= 26.788
Moving to projects directory: /mnt/xvol/xvar/lib/boinc-client/slots/0/ICMGGhq0f+002844
Moving to projects directory: /mnt/xvol/xvar/lib/boinc-client/slots/0/ICMSHhq0f+002844
Moving to projects directory: /mnt/xvol/xvar/lib/boinc-client/slots/0/ICMUAhq0f+002844
  19:29:39 STEP 2845 H=2845:00 +CPU= 15.468
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:29:57 STEP 2846 H=2846:00 +CPU= 15.839
  19:30:21 STEP 2847 H=2847:00 +CPU= 24.033
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:30:39 STEP 2848 H=2848:00 +CPU= 15.860
  19:30:55 STEP 2849 H=2849:00 +CPU= 15.398
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:31:21 STEP 2850 H=2850:00 +CPU= 24.523
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:31:39 STEP 2851 H=2851:00 +CPU= 15.413
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:31:57 STEP 2852 H=2852:00 +CPU= 15.822
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:32:23 STEP 2853 H=2853:00 +CPU= 24.004
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:32:40 STEP 2854 H=2854:00 +CPU= 15.804
  19:32:56 STEP 2855 H=2855:00 +CPU= 15.859
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:33:27 STEP 2856 H=2856:00 +CPU= 28.204
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /mnt/xvol/xvar/lib/boinc-client/slots/0/ICMGGhq0f+002856
Moving to projects directory: /mnt/xvol/xvar/lib/boinc-client/slots/0/ICMSHhq0f+002856
Moving to projects directory: /mnt/xvol/xvar/lib/boinc-client/slots/0/ICMUAhq0f+002856
Adding to the zip: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178223/ICMGGhq0f+002832
Adding to the zip: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178223/ICMSHhq0f+002832
Adding to the zip: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178223/ICMUAhq0f+002832
Adding to the zip: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178223/ICMGGhq0f+002844
Adding to the zip: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178223/ICMSHhq0f+002844
Adding to the zip: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178223/ICMUAhq0f+002844
Zipping up the intermediate file: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0579_1992050100_123_961_12178223_0_r383645923_118.zip
Uploading the intermediate file: upload_file_118.zip
  19:33:44 STEP 2857 H=2857:00 +CPU= 15.505
  19:34:00 STEP 2858 H=2858:00 +CPU= 15.911
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:34:26 STEP 2859 H=2859:00 +CPU= 24.151
  19:34:42 STEP 2860 H=2860:00 +CPU= 15.948
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:35:00 STEP 2861 H=2861:00 +CPU= 15.429
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:35:26 STEP 2862 H=2862:00 +CPU= 24.509
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:35:44 STEP 2863 H=2863:00 +CPU= 15.421
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:36:01 STEP 2864 H=2864:00 +CPU= 15.822
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:36:27 STEP 2865 H=2865:00 +CPU= 24.066
  19:36:43 STEP 2866 H=2866:00 +CPU= 15.926
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:37:01 STEP 2867 H=2867:00 +CPU= 15.391
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:37:30 STEP 2868 H=2868:00 +CPU= 26.796
Moving to projects directory: /mnt/xvol/xvar/lib/boinc-client/slots/0/ICMGGhq0f+002868
Moving to projects directory: /mnt/xvol/xvar/lib/boinc-client/slots/0/ICMSHhq0f+002868
Moving to projects directory: /mnt/xvol/xvar/lib/boinc-client/slots/0/ICMUAhq0f+002868
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:37:47 STEP 2869 H=2869:00 +CPU= 15.457
  19:38:03 STEP 2870 H=2870:00 +CPU= 15.907
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:38:31 STEP 2871 H=2871:00 +CPU= 23.980
  19:38:47 STEP 2872 H=2872:00 +CPU= 15.829
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:39:04 STEP 2873 H=2873:00 +CPU= 15.387
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:39:31 STEP 2874 H=2874:00 +CPU= 24.471
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:39:48 STEP 2875 H=2875:00 +CPU= 15.431
  19:40:04 STEP 2876 H=2876:00 +CPU= 15.853
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:40:30 STEP 2877 H=2877:00 +CPU= 23.963
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:40:48 STEP 2878 H=2878:00 +CPU= 15.814
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:41:06 STEP 2879 H=2879:00 +CPU= 15.847
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:41:36 STEP 2880 H=2880:00 +CPU= 28.177
Moving to projects directory: /mnt/xvol/xvar/lib/boinc-client/slots/0/ICMGGhq0f+002880
Moving to projects directory: /mnt/xvol/xvar/lib/boinc-client/slots/0/ICMSHhq0f+002880
Moving to projects directory: /mnt/xvol/xvar/lib/boinc-client/slots/0/ICMUAhq0f+002880
Adding to the zip: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178223/ICMGGhq0f+002856
Adding to the zip: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178223/ICMSHhq0f+002856
Adding to the zip: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178223/ICMUAhq0f+002856
Adding to the zip: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178223/ICMGGhq0f+002868
Adding to the zip: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178223/ICMSHhq0f+002868
Adding to the zip: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178223/ICMUAhq0f+002868
Zipping up the intermediate file: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0579_1992050100_123_961_12178223_0_r383645923_119.zip
Uploading the intermediate file: upload_file_119.zip
  19:41:52 STEP 2881 H=2881:00 +CPU= 15.587
Uploading trickle at timestep: 10368000
  19:42:08 STEP 2882 H=2882:00 +CPU= 15.895
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:42:34 STEP 2883 H=2883:00 +CPU= 24.059
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:42:52 STEP 2884 H=2884:00 +CPU= 15.927
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:43:09 STEP 2885 H=2885:00 +CPU= 15.527
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:43:36 STEP 2886 H=2886:00 +CPU= 24.508
  19:43:51 STEP 2887 H=2887:00 +CPU= 15.466
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:44:09 STEP 2888 H=2888:00 +CPU= 15.908
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:44:35 STEP 2889 H=2889:00 +CPU= 24.089
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:44:53 STEP 2890 H=2890:00 +CPU= 15.853
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:45:11 STEP 2891 H=2891:00 +CPU= 15.420
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:45:39 STEP 2892 H=2892:00 +CPU= 26.772
Moving to projects directory: /mnt/xvol/xvar/lib/boinc-client/slots/0/ICMGGhq0f+002892
Moving to projects directory: /mnt/xvol/xvar/lib/boinc-client/slots/0/ICMSHhq0f+002892
Moving to projects directory: /mnt/xvol/xvar/lib/boinc-client/slots/0/ICMUAhq0f+002892
  19:45:55 STEP 2893 H=2893:00 +CPU= 15.464
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:46:13 STEP 2894 H=2894:00 +CPU= 15.884
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:46:39 STEP 2895 H=2895:00 +CPU= 24.051
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:46:57 STEP 2896 H=2896:00 +CPU= 15.862
  19:47:12 STEP 2897 H=2897:00 +CPU= 15.436
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:47:41 STEP 2898 H=2898:00 +CPU= 24.483
  19:47:56 STEP 2899 H=2899:00 +CPU= 15.411
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:48:14 STEP 2900 H=2900:00 +CPU= 15.824
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:48:40 STEP 2901 H=2901:00 +CPU= 23.975
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:48:58 STEP 2902 H=2902:00 +CPU= 15.833
  19:49:14 STEP 2903 H=2903:00 +CPU= 15.815
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:49:46 STEP 2904 H=2904:00 +CPU= 28.311
Moving to projects directory: /mnt/xvol/xvar/lib/boinc-client/slots/0/ICMGGhq0f+002904
Moving to projects directory: /mnt/xvol/xvar/lib/boinc-client/slots/0/ICMSHhq0f+002904
Moving to projects directory: /mnt/xvol/xvar/lib/boinc-client/slots/0/ICMUAhq0f+002904
Adding to the zip: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178223/ICMGGhq0f+002880
Adding to the zip: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178223/ICMSHhq0f+002880
Adding to the zip: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178223/ICMUAhq0f+002880
Adding to the zip: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178223/ICMGGhq0f+002892
Adding to the zip: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178223/ICMSHhq0f+002892
Adding to the zip: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178223/ICMUAhq0f+002892
Zipping up the intermediate file: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0579_1992050100_123_961_12178223_0_r383645923_120.zip
Uploading the intermediate file: upload_file_120.zip
  19:50:02 STEP 2905 H=2905:00 +CPU= 15.533
  19:50:17 STEP 2906 H=2906:00 +CPU= 15.853
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:50:44 STEP 2907 H=2907:00 +CPU= 24.085
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:51:02 STEP 2908 H=2908:00 +CPU= 16.029
  19:51:17 STEP 2909 H=2909:00 +CPU= 15.423
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:51:44 STEP 2910 H=2910:00 +CPU= 24.531
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:52:01 STEP 2911 H=2911:00 +CPU= 15.458
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:52:19 STEP 2912 H=2912:00 +CPU= 15.889
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:52:45 STEP 2913 H=2913:00 +CPU= 24.087
  19:53:01 STEP 2914 H=2914:00 +CPU= 15.900
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:53:19 STEP 2915 H=2915:00 +CPU= 15.474
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:53:47 STEP 2916 H=2916:00 +CPU= 26.802
Moving to projects directory: /mnt/xvol/xvar/lib/boinc-client/slots/0/ICMGGhq0f+002916
Moving to projects directory: /mnt/xvol/xvar/lib/boinc-client/slots/0/ICMSHhq0f+002916
Moving to projects directory: /mnt/xvol/xvar/lib/boinc-client/slots/0/ICMUAhq0f+002916
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:54:05 STEP 2917 H=2917:00 +CPU= 15.517
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:54:23 STEP 2918 H=2918:00 +CPU= 15.908
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:54:49 STEP 2919 H=2919:00 +CPU= 24.014
  19:55:05 STEP 2920 H=2920:00 +CPU= 15.932
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:55:22 STEP 2921 H=2921:00 +CPU= 15.411
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:55:49 STEP 2922 H=2922:00 +CPU= 24.622
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:56:06 STEP 2923 H=2923:00 +CPU= 15.430
  19:56:22 STEP 2924 H=2924:00 +CPU= 15.881
  19:56:46 STEP 2925 H=2925:00 +CPU= 24.119
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:57:04 STEP 2926 H=2926:00 +CPU= 15.852
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:57:22 STEP 2927 H=2927:00 +CPU= 15.835
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:57:52 STEP 2928 H=2928:00 +CPU= 28.259
Moving to projects directory: /mnt/xvol/xvar/lib/boinc-client/slots/0/ICMGGhq0f+002928
Moving to projects directory: /mnt/xvol/xvar/lib/boinc-client/slots/0/ICMSHhq0f+002928
Moving to projects directory: /mnt/xvol/xvar/lib/boinc-client/slots/0/ICMUAhq0f+002928
Adding to the zip: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178223/ICMGGhq0f+002904
Adding to the zip: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178223/ICMSHhq0f+002904
Adding to the zip: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178223/ICMUAhq0f+002904
Adding to the zip: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178223/ICMGGhq0f+002916
Adding to the zip: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178223/ICMSHhq0f+002916
Adding to the zip: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178223/ICMUAhq0f+002916
Zipping up the intermediate file: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0579_1992050100_123_961_12178223_0_r383645923_121.zip
Uploading the intermediate file: upload_file_121.zip
  19:58:08 STEP 2929 H=2929:00 +CPU= 15.628
  19:58:24 STEP 2930 H=2930:00 +CPU= 15.942
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:58:50 STEP 2931 H=2931:00 +CPU= 24.013
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:59:08 STEP 2932 H=2932:00 +CPU= 15.916
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:59:26 STEP 2933 H=2933:00 +CPU= 15.450
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:59:52 STEP 2934 H=2934:00 +CPU= 24.538
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:00:12 STEP 2935 H=2935:00 +CPU= 17.761
  20:00:31 STEP 2936 H=2936:00 +CPU= 18.260
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:00:57 STEP 2937 H=2937:00 +CPU= 24.187
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:01:15 STEP 2938 H=2938:00 +CPU= 15.962
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:01:32 STEP 2939 H=2939:00 +CPU= 15.510
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:02:01 STEP 2940 H=2940:00 +CPU= 26.922
Moving to projects directory: /mnt/xvol/xvar/lib/boinc-client/slots/0/ICMGGhq0f+002940
Moving to projects directory: /mnt/xvol/xvar/lib/boinc-client/slots/0/ICMSHhq0f+002940
Moving to projects directory: /mnt/xvol/xvar/lib/boinc-client/slots/0/ICMUAhq0f+002940
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:02:19 STEP 2941 H=2941:00 +CPU= 15.519
  20:02:35 STEP 2942 H=2942:00 +CPU= 15.880
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:03:01 STEP 2943 H=2943:00 +CPU= 24.128
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:03:19 STEP 2944 H=2944:00 +CPU= 15.935
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:03:36 STEP 2945 H=2945:00 +CPU= 15.453
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:04:03 STEP 2946 H=2946:00 +CPU= 24.575
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:04:20 STEP 2947 H=2947:00 +CPU= 15.450
  20:04:36 STEP 2948 H=2948:00 +CPU= 15.889
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:05:02 STEP 2949 H=2949:00 +CPU= 24.028
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:05:20 STEP 2950 H=2950:00 +CPU= 15.827
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:05:38 STEP 2951 H=2951:00 +CPU= 15.889
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:06:08 STEP 2952 H=2952:00 +CPU= 27.410
The child process terminated with status: 0
Moving to projects directory: /mnt/xvol/xvar/lib/boinc-client/slots/0/ICMGGhq0f+002952
Moving to projects directory: /mnt/xvol/xvar/lib/boinc-client/slots/0/ICMSHhq0f+002952
Moving to projects directory: /mnt/xvol/xvar/lib/boinc-client/slots/0/ICMUAhq0f+002952
Adding to the zip: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178223/ICMGGhq0f+002928
Adding to the zip: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178223/ICMSHhq0f+002928
Adding to the zip: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178223/ICMUAhq0f+002928
Adding to the zip: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178223/ICMGGhq0f+002940
Adding to the zip: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178223/ICMSHhq0f+002940
Adding to the zip: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178223/ICMUAhq0f+002940
Adding to the zip: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178223/ICMGGhq0f+002952
Adding to the zip: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178223/ICMSHhq0f+002952
Adding to the zip: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178223/ICMUAhq0f+002952
Zipping up the final file: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0579_1992050100_123_961_12178223_0_r383645923_122.zip
Uploading the final file: upload_file_122.zip
Uploading trickle at timestep: 10623600
double free or corruption (!prev)
20:09:31 (9364): called boinc_finish(0)
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1992050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0579
(argv4) batchid: 961
(argv5) wuid: 12178223
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /mnt/xvol/xvar/lib/boinc-client/slots/0
Project directory is: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178223
Copying: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /mnt/xvol/xvar/lib/boinc-client/slots/0/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /mnt/xvol/xvar/lib/boinc-client/slots/0/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_04af327b3d1c33277d72453b0a83852f to: /mnt/xvol/xvar/lib/boinc-client/slots/0/oifs_43r3_ps_0579_1992050100_123_961_12178223.zip
Unzipping the namelist zip file: /mnt/xvol/xvar/lib/boinc-client/slots/0/oifs_43r3_ps_0579_1992050100_123_961_12178223.zip
ic_ancil_file: ic_ancil_12178223
ifsdata_file: ifsdata_12178223
climate_data_file: clim_data_12178223
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_778f82ef700d9745c80842dcdab1694f to: /mnt/xvol/xvar/lib/boinc-client/slots/0/ic_ancil_12178223.zip
Unzipping the IC ancils zip file: /mnt/xvol/xvar/lib/boinc-client/slots/0/ic_ancil_12178223.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_33e9e0537b336165945df54674f04da6 to: /mnt/xvol/xvar/lib/boinc-client/slots/0/ifsdata/ifsdata_12178223.zip
Unzipping the ifsdata_zip file: /mnt/xvol/xvar/lib/boinc-client/slots/0/ifsdata/ifsdata_12178223.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /mnt/xvol/xvar/lib/boinc-client/slots/0/159l_2/clim_data_12178223.zip
Unzipping the climate data zip file: /mnt/xvol/xvar/lib/boinc-client/slots/0/159l_2/clim_data_12178223.zip
Checking for progress XML file: /mnt/xvol/xvar/lib/boinc-client/slots/0/progress_file_12178223.xml
Opened progress file ok : /mnt/xvol/xvar/lib/boinc-client/slots/0/progress_file_12178223.xml
-- Model is restarting --
Adjusting last_iter, 2952, to previous model restart step.
Creating progress file: /mnt/xvol/xvar/lib/boinc-client/slots/0/progress_file_12178223.xml
last_cpu_time: 55531
upload_file_number: 122
last_iter: 2951
last_upload: 10540800
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0579_1992050100_123_961_12178223_0_r383645923
The child process has been launched with process id: 22533
Executing the command: /mnt/xvol/xvar/lib/boinc-client/slots/0/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:ztc-as:1:1:22533:22533] [20221222:201246:1671736366:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:ztc-as:1:1:22533:22533] [20221222:201246:1671736366:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:ztc-as:1:1:22533:22533] [20221222:201246:1671736366:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:ztc-as:1:1:22533:22533] [20221222:201246:1671736366:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:ztc-as:1:1:22533:22533] [20221222:201246:1671736366:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:ztc-as:1:1:22533:22533] [20221222:201246:1671736366:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:ztc-as:1:1:22533:22533] [20221222:201246:1671736366:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:ztc-as:1:1:22533:22533] [20221222:201246:1671736366:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:ztc-as:1:1:22533:22533] [20221222:201246:1671736366:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:ztc-as:1:1:22533:22533] [20221222:201246:1671736366:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:ztc-as:1:1:22533:22533] [20221222:201246:1671736366:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:ztc-as:1:1:22533:22533] [20221222:201246:1671736366:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:ztc-as:1:1:22533:22533] [20221222:201246:1671736366:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:ztc-as:1:1:22533:22533] [20221222:201246:1671736366:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:ztc-as:1:1:22533:22533] [20221222:201246:1671736366:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:ztc-as:1:1:22533:22533] [20221222:201246:1671736366:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ztc-as:1:1:22533:22533] [20221222:201246:1671736366:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:ztc-as:1:1:22533:22533] [20221222:201246:1671736366:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ztc-as:1:1:22533:22533] [20221222:201246:1671736366:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:ztc-as:1:1:22533:22533] [20221222:201246:1671736366:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:ztc-as:1:1:22533:22533] [20221222:201246:1671736366:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ztc-as:1:1:22533:22533] [20221222:201246:1671736366:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ztc-as:1:1:22533:22533] [20221222:201246:1671736366:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:ztc-as:1:1:22533:22533] [20221222:201246:1671736366:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ztc-as:1:1:22533:22533] [20221222:201246:1671736366:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ztc-as:1:1:22533:22533] [20221222:201246:1671736366:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ztc-as:1:1:22533:22533] [20221222:201246:1671736366:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:ztc-as:1:1:22533:22533] [20221222:201246:1671736366:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:ztc-as:1:1:22533:22533] [20221222:201246:1671736366:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:ztc-as:1:1:22533:22533] [20221222:201246:1671736366:0.001] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:13:15 STEP 2952 H=2952:00 +CPU= 25.108
The child process terminated with status: 0
Zipping up the final file: /mnt/xvol/xvar/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0579_1992050100_123_961_12178223_0_r383645923_122.zip
Uploading the final file: upload_file_122.zip
Uploading trickle at timestep: 10623600

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 15:48:36 1534978 22263073 oifs_43r3_ps_0579_1992050100_123_961_12178223_0 10,623,600 55,557 0.0052
09 May 2023 15:48:36 1534978 22263073 oifs_43r3_ps_0579_1992050100_123_961_12178223_0 10,623,600 55,539 0.0052
09 May 2023 15:48:30 1534978 22263073 oifs_43r3_ps_0579_1992050100_123_961_12178223_0 10,368,000 54,188 0.0052
09 May 2023 15:48:23 1534978 22263073 oifs_43r3_ps_0579_1992050100_123_961_12178223_0 9,504,000 49,687 0.0052
09 May 2023 15:48:16 1534978 22263073 oifs_43r3_ps_0579_1992050100_123_961_12178223_0 8,640,000 45,177 0.0052
09 May 2023 15:48:09 1534978 22263073 oifs_43r3_ps_0579_1992050100_123_961_12178223_0 7,776,000 40,676 0.0052
09 May 2023 15:48:02 1534978 22263073 oifs_43r3_ps_0579_1992050100_123_961_12178223_0 6,912,000 36,166 0.0052
09 May 2023 15:47:54 1534978 22263073 oifs_43r3_ps_0579_1992050100_123_961_12178223_0 6,048,000 31,656 0.0052
09 May 2023 15:47:47 1534978 22263073 oifs_43r3_ps_0579_1992050100_123_961_12178223_0 5,184,000 27,147 0.0052
09 May 2023 15:47:40 1534978 22263073 oifs_43r3_ps_0579_1992050100_123_961_12178223_0 4,320,000 22,638 0.0052
09 May 2023 15:47:35 1534978 22263073 oifs_43r3_ps_0579_1992050100_123_961_12178223_0 3,456,000 18,119 0.0052
09 May 2023 15:47:25 1534978 22263073 oifs_43r3_ps_0579_1992050100_123_961_12178223_0 2,592,000 13,541 0.0052
09 May 2023 15:47:17 1534978 22263073 oifs_43r3_ps_0579_1992050100_123_961_12178223_0 1,728,000 9,033 0.0052
09 May 2023 15:47:12 1534978 22263073 oifs_43r3_ps_0579_1992050100_123_961_12178223_0 864,000 4,526 0.0052


©2024 climateprediction.net