climateprediction.net home page
Task 22253401

Task 22253401

Name oifs_43r3_ps_0477_1983050100_123_952_12169121_0
Workunit 12169121
Created 21 Dec 2022, 0:52:59 UTC
Sent 6 Jan 2023, 19:56:23 UTC
Report deadline 5 Feb 2023, 19:56:23 UTC
Received 7 Jan 2023, 22:47:35 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 196 (0x000000C4) EXIT_DISK_LIMIT_EXCEEDED
Computer ID 1494567
Run time 16 hours 59 min 24 sec
CPU time 16 hours 43 min 55 sec
Validate state Invalid
Credit 9,072.00
Device peak FLOPS 4.53 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,418.27 MB
Peak swap size 4,978.07 MB
Peak disk usage 7,293.12 MB
Stderr 
<core_client_version>7.16.6</core_client_version>
<![CDATA[
<message>
Disk usage limit exceeded</message>
<stderr_txt>
inc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMSHhq0f+001620
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMUAhq0f+001620
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0477_1983050100_123_952_12169121_0_r136147106_67.zip
Uploading the intermediate file: upload_file_67.zip
  09:57:46 STEP 1633 H=1633:00 +CPU= 21.889
  09:58:09 STEP 1634 H=1634:00 +CPU= 22.725
  09:58:44 STEP 1635 H=1635:00 +CPU= 35.168
  09:59:06 STEP 1636 H=1636:00 +CPU= 22.500
  09:59:28 STEP 1637 H=1637:00 +CPU= 22.044
  10:00:04 STEP 1638 H=1638:00 +CPU= 35.892
  10:00:26 STEP 1639 H=1639:00 +CPU= 21.906
  10:00:49 STEP 1640 H=1640:00 +CPU= 22.753
  10:01:24 STEP 1641 H=1641:00 +CPU= 35.349
  10:01:47 STEP 1642 H=1642:00 +CPU= 22.409
  10:02:09 STEP 1643 H=1643:00 +CPU= 22.076
  10:02:48 STEP 1644 H=1644:00 +CPU= 38.804
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001644
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001644
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001644
  10:03:09 STEP 1645 H=1645:00 +CPU= 21.779
  10:03:32 STEP 1646 H=1646:00 +CPU= 22.799
  10:04:07 STEP 1647 H=1647:00 +CPU= 35.140
  10:04:30 STEP 1648 H=1648:00 +CPU= 22.343
  10:04:52 STEP 1649 H=1649:00 +CPU= 22.129
  10:05:28 STEP 1650 H=1650:00 +CPU= 35.869
  10:05:49 STEP 1651 H=1651:00 +CPU= 21.693
  10:06:12 STEP 1652 H=1652:00 +CPU= 22.742
  10:06:47 STEP 1653 H=1653:00 +CPU= 35.185
  10:07:10 STEP 1654 H=1654:00 +CPU= 22.299
  10:07:32 STEP 1655 H=1655:00 +CPU= 22.614
  10:08:14 STEP 1656 H=1656:00 +CPU= 40.905
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001656
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001656
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMGGhq0f+001632
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMSHhq0f+001632
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMUAhq0f+001632
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMGGhq0f+001644
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMSHhq0f+001644
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMUAhq0f+001644
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0477_1983050100_123_952_12169121_0_r136147106_68.zip
Uploading the intermediate file: upload_file_68.zip
  10:08:35 STEP 1657 H=1657:00 +CPU= 21.845
  10:08:58 STEP 1658 H=1658:00 +CPU= 22.659
  10:09:33 STEP 1659 H=1659:00 +CPU= 35.110
  10:09:56 STEP 1660 H=1660:00 +CPU= 22.475
  10:10:18 STEP 1661 H=1661:00 +CPU= 22.002
  10:10:54 STEP 1662 H=1662:00 +CPU= 35.866
  10:11:15 STEP 1663 H=1663:00 +CPU= 21.839
  10:11:38 STEP 1664 H=1664:00 +CPU= 22.683
  10:12:13 STEP 1665 H=1665:00 +CPU= 35.279
  10:12:36 STEP 1666 H=1666:00 +CPU= 22.372
  10:12:58 STEP 1667 H=1667:00 +CPU= 22.056
  10:13:37 STEP 1668 H=1668:00 +CPU= 38.803
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001668
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001668
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001668
  10:13:58 STEP 1669 H=1669:00 +CPU= 21.769
  10:14:21 STEP 1670 H=1670:00 +CPU= 22.841
  10:14:57 STEP 1671 H=1671:00 +CPU= 35.234
  10:15:19 STEP 1672 H=1672:00 +CPU= 22.397
  10:15:41 STEP 1673 H=1673:00 +CPU= 22.146
  10:16:17 STEP 1674 H=1674:00 +CPU= 35.942
  10:16:39 STEP 1675 H=1675:00 +CPU= 21.697
  10:17:02 STEP 1676 H=1676:00 +CPU= 22.767
  10:17:37 STEP 1677 H=1677:00 +CPU= 35.242
  10:17:59 STEP 1678 H=1678:00 +CPU= 22.286
  10:18:22 STEP 1679 H=1679:00 +CPU= 22.615
  10:19:03 STEP 1680 H=1680:00 +CPU= 40.848
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001680
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001680
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001680
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMGGhq0f+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMSHhq0f+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMUAhq0f+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMGGhq0f+001668
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMSHhq0f+001668
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMUAhq0f+001668
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0477_1983050100_123_952_12169121_0_r136147106_69.zip
Uploading the intermediate file: upload_file_69.zip
  10:19:25 STEP 1681 H=1681:00 +CPU= 21.840
  10:19:47 STEP 1682 H=1682:00 +CPU= 22.636
  10:20:23 STEP 1683 H=1683:00 +CPU= 35.079
  10:20:45 STEP 1684 H=1684:00 +CPU= 22.502
  10:21:07 STEP 1685 H=1685:00 +CPU= 21.985
  10:21:43 STEP 1686 H=1686:00 +CPU= 35.840
  10:22:05 STEP 1687 H=1687:00 +CPU= 21.873
  10:22:27 STEP 1688 H=1688:00 +CPU= 22.698
  10:23:03 STEP 1689 H=1689:00 +CPU= 35.269
  10:23:25 STEP 1690 H=1690:00 +CPU= 22.398
  10:23:47 STEP 1691 H=1691:00 +CPU= 22.055
  10:24:26 STEP 1692 H=1692:00 +CPU= 38.850
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001692
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001692
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001692
  10:24:48 STEP 1693 H=1693:00 +CPU= 21.767
  10:25:11 STEP 1694 H=1694:00 +CPU= 22.856
  10:25:46 STEP 1695 H=1695:00 +CPU= 35.271
  10:26:08 STEP 1696 H=1696:00 +CPU= 22.399
  10:26:31 STEP 1697 H=1697:00 +CPU= 22.158
  10:27:07 STEP 1698 H=1698:00 +CPU= 35.967
  10:27:28 STEP 1699 H=1699:00 +CPU= 21.720
  10:27:51 STEP 1700 H=1700:00 +CPU= 22.795
  10:28:27 STEP 1701 H=1701:00 +CPU= 35.300
  10:28:49 STEP 1702 H=1702:00 +CPU= 22.303
  10:29:11 STEP 1703 H=1703:00 +CPU= 22.630
  10:29:53 STEP 1704 H=1704:00 +CPU= 40.899
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001704
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001704
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMGGhq0f+001680
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMSHhq0f+001680
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMUAhq0f+001680
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMGGhq0f+001692
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMSHhq0f+001692
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMUAhq0f+001692
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0477_1983050100_123_952_12169121_0_r136147106_70.zip
Uploading the intermediate file: upload_file_70.zip
  10:30:14 STEP 1705 H=1705:00 +CPU= 21.866
  10:30:37 STEP 1706 H=1706:00 +CPU= 22.657
  10:31:12 STEP 1707 H=1707:00 +CPU= 35.115
  10:31:35 STEP 1708 H=1708:00 +CPU= 22.482
  10:31:57 STEP 1709 H=1709:00 +CPU= 22.017
  10:32:33 STEP 1710 H=1710:00 +CPU= 35.913
  10:32:55 STEP 1711 H=1711:00 +CPU= 21.880
  10:33:17 STEP 1712 H=1712:00 +CPU= 22.706
  10:33:53 STEP 1713 H=1713:00 +CPU= 35.322
  10:34:15 STEP 1714 H=1714:00 +CPU= 22.379
  10:34:37 STEP 1715 H=1715:00 +CPU= 22.063
  10:35:16 STEP 1716 H=1716:00 +CPU= 38.895
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001716
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001716
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001716
  10:35:38 STEP 1717 H=1717:00 +CPU= 21.797
  10:36:01 STEP 1718 H=1718:00 +CPU= 22.863
  10:36:36 STEP 1719 H=1719:00 +CPU= 35.309
  10:36:59 STEP 1720 H=1720:00 +CPU= 22.427
  10:37:21 STEP 1721 H=1721:00 +CPU= 22.180
  10:37:57 STEP 1722 H=1722:00 +CPU= 36.007
  10:38:19 STEP 1723 H=1723:00 +CPU= 21.758
  10:38:41 STEP 1724 H=1724:00 +CPU= 22.812
  10:39:17 STEP 1725 H=1725:00 +CPU= 35.305
  10:39:39 STEP 1726 H=1726:00 +CPU= 22.342
  10:40:02 STEP 1727 H=1727:00 +CPU= 22.672
  10:40:43 STEP 1728 H=1728:00 +CPU= 40.954
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001728
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001728
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMGGhq0f+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMSHhq0f+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMUAhq0f+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMGGhq0f+001716
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMSHhq0f+001716
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMUAhq0f+001716
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0477_1983050100_123_952_12169121_0_r136147106_71.zip
Uploading the intermediate file: upload_file_71.zip
  10:41:05 STEP 1729 H=1729:00 +CPU= 21.837
  10:41:27 STEP 1730 H=1730:00 +CPU= 22.662
  10:42:03 STEP 1731 H=1731:00 +CPU= 35.153
  10:42:25 STEP 1732 H=1732:00 +CPU= 22.483
  10:42:47 STEP 1733 H=1733:00 +CPU= 22.034
  10:43:23 STEP 1734 H=1734:00 +CPU= 35.928
  10:43:45 STEP 1735 H=1735:00 +CPU= 21.863
  10:44:08 STEP 1736 H=1736:00 +CPU= 22.706
  10:44:43 STEP 1737 H=1737:00 +CPU= 35.343
  10:45:05 STEP 1738 H=1738:00 +CPU= 22.387
  10:45:28 STEP 1739 H=1739:00 +CPU= 22.085
  10:46:06 STEP 1740 H=1740:00 +CPU= 38.857
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001740
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001740
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001740
  10:46:28 STEP 1741 H=1741:00 +CPU= 21.765
  10:46:51 STEP 1742 H=1742:00 +CPU= 22.835
  10:47:26 STEP 1743 H=1743:00 +CPU= 35.290
  10:47:49 STEP 1744 H=1744:00 +CPU= 22.404
  10:48:11 STEP 1745 H=1745:00 +CPU= 22.151
  10:48:47 STEP 1746 H=1746:00 +CPU= 36.009
  10:49:09 STEP 1747 H=1747:00 +CPU= 21.728
  10:49:31 STEP 1748 H=1748:00 +CPU= 22.764
  10:50:07 STEP 1749 H=1749:00 +CPU= 35.279
  10:50:29 STEP 1750 H=1750:00 +CPU= 22.318
  10:50:52 STEP 1751 H=1751:00 +CPU= 22.649
  10:51:33 STEP 1752 H=1752:00 +CPU= 40.989
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001752
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001752
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMGGhq0f+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMSHhq0f+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMUAhq0f+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMGGhq0f+001740
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMSHhq0f+001740
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMUAhq0f+001740
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0477_1983050100_123_952_12169121_0_r136147106_72.zip
Uploading the intermediate file: upload_file_72.zip
  10:51:55 STEP 1753 H=1753:00 +CPU= 21.846
  10:52:17 STEP 1754 H=1754:00 +CPU= 22.660
  10:52:53 STEP 1755 H=1755:00 +CPU= 35.178
  10:53:15 STEP 1756 H=1756:00 +CPU= 22.471
  10:53:37 STEP 1757 H=1757:00 +CPU= 22.017
  10:54:13 STEP 1758 H=1758:00 +CPU= 35.913
  10:54:35 STEP 1759 H=1759:00 +CPU= 21.862
  10:54:58 STEP 1760 H=1760:00 +CPU= 22.688
  10:55:33 STEP 1761 H=1761:00 +CPU= 35.300
  10:55:55 STEP 1762 H=1762:00 +CPU= 22.369
  10:56:17 STEP 1763 H=1763:00 +CPU= 22.046
  10:56:56 STEP 1764 H=1764:00 +CPU= 38.855
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001764
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001764
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001764
  10:57:18 STEP 1765 H=1765:00 +CPU= 21.775
  10:57:41 STEP 1766 H=1766:00 +CPU= 22.820
  10:58:16 STEP 1767 H=1767:00 +CPU= 35.254
  10:58:39 STEP 1768 H=1768:00 +CPU= 22.410
  10:59:01 STEP 1769 H=1769:00 +CPU= 22.156
  10:59:37 STEP 1770 H=1770:00 +CPU= 35.966
  10:59:59 STEP 1771 H=1771:00 +CPU= 21.751
  11:00:21 STEP 1772 H=1772:00 +CPU= 22.781
  11:00:57 STEP 1773 H=1773:00 +CPU= 35.250
  11:01:19 STEP 1774 H=1774:00 +CPU= 22.307
  11:01:42 STEP 1775 H=1775:00 +CPU= 22.639
  11:02:23 STEP 1776 H=1776:00 +CPU= 40.950
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001776
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001776
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMGGhq0f+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMSHhq0f+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMUAhq0f+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMGGhq0f+001764
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMSHhq0f+001764
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMUAhq0f+001764
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0477_1983050100_123_952_12169121_0_r136147106_73.zip
Uploading the intermediate file: upload_file_73.zip
  11:02:45 STEP 1777 H=1777:00 +CPU= 21.833
  11:03:07 STEP 1778 H=1778:00 +CPU= 22.688
  11:03:43 STEP 1779 H=1779:00 +CPU= 35.170
  11:04:05 STEP 1780 H=1780:00 +CPU= 22.486
  11:04:27 STEP 1781 H=1781:00 +CPU= 22.030
  11:05:03 STEP 1782 H=1782:00 +CPU= 35.919
  11:05:25 STEP 1783 H=1783:00 +CPU= 21.854
  11:05:48 STEP 1784 H=1784:00 +CPU= 22.757
  11:06:23 STEP 1785 H=1785:00 +CPU= 35.334
  11:06:45 STEP 1786 H=1786:00 +CPU= 22.386
  11:07:07 STEP 1787 H=1787:00 +CPU= 22.082
  11:07:46 STEP 1788 H=1788:00 +CPU= 38.839
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001788
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001788
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001788
  11:08:08 STEP 1789 H=1789:00 +CPU= 21.789
  11:08:31 STEP 1790 H=1790:00 +CPU= 22.846
  11:09:06 STEP 1791 H=1791:00 +CPU= 35.224
  11:09:29 STEP 1792 H=1792:00 +CPU= 22.424
  11:09:51 STEP 1793 H=1793:00 +CPU= 22.180
  11:10:27 STEP 1794 H=1794:00 +CPU= 35.953
  11:10:49 STEP 1795 H=1795:00 +CPU= 21.771
  11:11:11 STEP 1796 H=1796:00 +CPU= 22.787
  11:11:47 STEP 1797 H=1797:00 +CPU= 35.338
  11:12:09 STEP 1798 H=1798:00 +CPU= 22.389
  11:12:32 STEP 1799 H=1799:00 +CPU= 22.645
  11:13:13 STEP 1800 H=1800:00 +CPU= 40.940
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001800
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001800
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMGGhq0f+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMSHhq0f+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMUAhq0f+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMGGhq0f+001788
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMSHhq0f+001788
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMUAhq0f+001788
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0477_1983050100_123_952_12169121_0_r136147106_74.zip
Uploading the intermediate file: upload_file_74.zip
  11:13:35 STEP 1801 H=1801:00 +CPU= 21.860
Uploading trickle at timestep: 6480000
  11:13:58 STEP 1802 H=1802:00 +CPU= 22.684
  11:14:33 STEP 1803 H=1803:00 +CPU= 35.207
  11:14:55 STEP 1804 H=1804:00 +CPU= 22.521
  11:15:17 STEP 1805 H=1805:00 +CPU= 22.039
  11:15:53 STEP 1806 H=1806:00 +CPU= 35.938
  11:16:15 STEP 1807 H=1807:00 +CPU= 21.909
  11:16:38 STEP 1808 H=1808:00 +CPU= 22.763
  11:17:13 STEP 1809 H=1809:00 +CPU= 35.398
  11:17:36 STEP 1810 H=1810:00 +CPU= 22.372
  11:17:58 STEP 1811 H=1811:00 +CPU= 22.106
  11:18:37 STEP 1812 H=1812:00 +CPU= 38.825
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001812
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001812
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001812
  11:18:59 STEP 1813 H=1813:00 +CPU= 21.807
  11:19:22 STEP 1814 H=1814:00 +CPU= 22.852
  11:19:57 STEP 1815 H=1815:00 +CPU= 35.241
  11:20:19 STEP 1816 H=1816:00 +CPU= 22.475
  11:20:41 STEP 1817 H=1817:00 +CPU= 22.153
  11:21:17 STEP 1818 H=1818:00 +CPU= 35.938
  11:21:39 STEP 1819 H=1819:00 +CPU= 21.797
  11:22:02 STEP 1820 H=1820:00 +CPU= 22.744
  11:22:37 STEP 1821 H=1821:00 +CPU= 35.215
  11:23:00 STEP 1822 H=1822:00 +CPU= 22.373
  11:23:22 STEP 1823 H=1823:00 +CPU= 22.710
  11:24:03 STEP 1824 H=1824:00 +CPU= 40.999
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001824
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001824
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMGGhq0f+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMSHhq0f+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMUAhq0f+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMGGhq0f+001812
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMSHhq0f+001812
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMUAhq0f+001812
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0477_1983050100_123_952_12169121_0_r136147106_75.zip
Uploading the intermediate file: upload_file_75.zip
  11:24:25 STEP 1825 H=1825:00 +CPU= 21.964
  11:24:48 STEP 1826 H=1826:00 +CPU= 22.791
  11:25:23 STEP 1827 H=1827:00 +CPU= 35.267
  11:25:46 STEP 1828 H=1828:00 +CPU= 22.574
  11:26:08 STEP 1829 H=1829:00 +CPU= 22.166
  11:26:44 STEP 1830 H=1830:00 +CPU= 36.000
  11:27:06 STEP 1831 H=1831:00 +CPU= 22.012
  11:27:29 STEP 1832 H=1832:00 +CPU= 22.893
  11:28:05 STEP 1833 H=1833:00 +CPU= 35.484
  11:28:27 STEP 1834 H=1834:00 +CPU= 22.452
  11:28:49 STEP 1835 H=1835:00 +CPU= 22.170
  11:29:28 STEP 1836 H=1836:00 +CPU= 38.821
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001836
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001836
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001836
  11:29:50 STEP 1837 H=1837:00 +CPU= 21.897
  11:30:13 STEP 1838 H=1838:00 +CPU= 22.756
  11:30:48 STEP 1839 H=1839:00 +CPU= 35.179
  11:31:11 STEP 1840 H=1840:00 +CPU= 22.560
  11:31:33 STEP 1841 H=1841:00 +CPU= 22.044
  11:32:08 STEP 1842 H=1842:00 +CPU= 35.868
  11:32:30 STEP 1843 H=1843:00 +CPU= 21.923
  11:32:53 STEP 1844 H=1844:00 +CPU= 22.702
  11:33:28 STEP 1845 H=1845:00 +CPU= 35.153
  11:33:51 STEP 1846 H=1846:00 +CPU= 22.382
  11:34:13 STEP 1847 H=1847:00 +CPU= 22.804
  11:34:55 STEP 1848 H=1848:00 +CPU= 41.099
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001848
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001848
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMGGhq0f+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMSHhq0f+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMUAhq0f+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMGGhq0f+001836
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMSHhq0f+001836
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMUAhq0f+001836
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0477_1983050100_123_952_12169121_0_r136147106_76.zip
Uploading the intermediate file: upload_file_76.zip
  11:35:17 STEP 1849 H=1849:00 +CPU= 22.027
  11:35:40 STEP 1850 H=1850:00 +CPU= 22.953
  11:36:15 STEP 1851 H=1851:00 +CPU= 35.281
  11:36:38 STEP 1852 H=1852:00 +CPU= 22.678
  11:37:00 STEP 1853 H=1853:00 +CPU= 22.282
  11:37:36 STEP 1854 H=1854:00 +CPU= 36.075
  11:37:58 STEP 1855 H=1855:00 +CPU= 22.028
  11:38:21 STEP 1856 H=1856:00 +CPU= 22.913
  11:38:56 STEP 1857 H=1857:00 +CPU= 35.428
  11:39:19 STEP 1858 H=1858:00 +CPU= 22.430
  11:39:41 STEP 1859 H=1859:00 +CPU= 22.232
  11:40:20 STEP 1860 H=1860:00 +CPU= 38.896
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001860
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001860
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001860
  11:40:42 STEP 1861 H=1861:00 +CPU= 21.944
  11:41:05 STEP 1862 H=1862:00 +CPU= 22.687
  11:41:40 STEP 1863 H=1863:00 +CPU= 35.136
  11:42:02 STEP 1864 H=1864:00 +CPU= 22.534
  11:42:24 STEP 1865 H=1865:00 +CPU= 22.010
  11:43:00 STEP 1866 H=1866:00 +CPU= 35.854
  11:43:22 STEP 1867 H=1867:00 +CPU= 21.832
  11:43:45 STEP 1868 H=1868:00 +CPU= 22.631
  11:44:20 STEP 1869 H=1869:00 +CPU= 35.136
  11:44:42 STEP 1870 H=1870:00 +CPU= 22.358
  11:45:05 STEP 1871 H=1871:00 +CPU= 22.802
  11:45:46 STEP 1872 H=1872:00 +CPU= 41.014
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001872
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001872
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMGGhq0f+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMSHhq0f+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMUAhq0f+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMGGhq0f+001860
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMSHhq0f+001860
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMUAhq0f+001860
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0477_1983050100_123_952_12169121_0_r136147106_77.zip
Uploading the intermediate file: upload_file_77.zip
  11:46:08 STEP 1873 H=1873:00 +CPU= 21.924
  11:46:31 STEP 1874 H=1874:00 +CPU= 22.841
  11:47:06 STEP 1875 H=1875:00 +CPU= 35.205
  11:47:29 STEP 1876 H=1876:00 +CPU= 22.603
  11:47:51 STEP 1877 H=1877:00 +CPU= 22.239
  11:48:27 STEP 1878 H=1878:00 +CPU= 36.023
  11:48:49 STEP 1879 H=1879:00 +CPU= 21.981
  11:49:12 STEP 1880 H=1880:00 +CPU= 22.895
  11:49:47 STEP 1881 H=1881:00 +CPU= 35.365
  11:50:10 STEP 1882 H=1882:00 +CPU= 22.410
  11:50:32 STEP 1883 H=1883:00 +CPU= 22.207
  11:51:11 STEP 1884 H=1884:00 +CPU= 38.829
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001884
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001884
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001884
  11:51:33 STEP 1885 H=1885:00 +CPU= 21.880
  11:51:55 STEP 1886 H=1886:00 +CPU= 22.688
  11:52:31 STEP 1887 H=1887:00 +CPU= 35.135
  11:52:53 STEP 1888 H=1888:00 +CPU= 22.524
  11:53:15 STEP 1889 H=1889:00 +CPU= 22.025
  11:53:51 STEP 1890 H=1890:00 +CPU= 35.857
  11:54:13 STEP 1891 H=1891:00 +CPU= 21.858
  11:54:36 STEP 1892 H=1892:00 +CPU= 22.661
  11:55:11 STEP 1893 H=1893:00 +CPU= 35.116
  11:55:33 STEP 1894 H=1894:00 +CPU= 22.342
  11:55:56 STEP 1895 H=1895:00 +CPU= 22.752
  11:56:37 STEP 1896 H=1896:00 +CPU= 41.047
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001896
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001896
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMGGhq0f+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMSHhq0f+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMUAhq0f+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMGGhq0f+001884
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMSHhq0f+001884
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMUAhq0f+001884
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0477_1983050100_123_952_12169121_0_r136147106_78.zip
Uploading the intermediate file: upload_file_78.zip
  11:56:59 STEP 1897 H=1897:00 +CPU= 22.070
  11:57:22 STEP 1898 H=1898:00 +CPU= 22.920
  11:57:57 STEP 1899 H=1899:00 +CPU= 35.309
  11:58:20 STEP 1900 H=1900:00 +CPU= 22.659
  11:58:42 STEP 1901 H=1901:00 +CPU= 22.265
  11:59:18 STEP 1902 H=1902:00 +CPU= 36.097
  11:59:40 STEP 1903 H=1903:00 +CPU= 22.134
  12:00:03 STEP 1904 H=1904:00 +CPU= 23.057
  12:00:39 STEP 1905 H=1905:00 +CPU= 35.451
  12:01:01 STEP 1906 H=1906:00 +CPU= 22.434
  12:01:24 STEP 1907 H=1907:00 +CPU= 22.233
  12:02:02 STEP 1908 H=1908:00 +CPU= 38.812
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001908
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001908
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001908
  12:02:24 STEP 1909 H=1909:00 +CPU= 21.932
  12:02:47 STEP 1910 H=1910:00 +CPU= 22.724
  12:03:22 STEP 1911 H=1911:00 +CPU= 35.175
  12:03:45 STEP 1912 H=1912:00 +CPU= 22.561
  12:04:07 STEP 1913 H=1913:00 +CPU= 22.043
  12:04:43 STEP 1914 H=1914:00 +CPU= 35.882
  12:05:05 STEP 1915 H=1915:00 +CPU= 21.886
  12:05:27 STEP 1916 H=1916:00 +CPU= 22.684
  12:06:03 STEP 1917 H=1917:00 +CPU= 35.195
  12:06:25 STEP 1918 H=1918:00 +CPU= 22.401
  12:06:48 STEP 1919 H=1919:00 +CPU= 22.848
  12:07:29 STEP 1920 H=1920:00 +CPU= 41.040
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001920
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001920
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMGGhq0f+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMSHhq0f+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMUAhq0f+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMGGhq0f+001908
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMSHhq0f+001908
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMUAhq0f+001908
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0477_1983050100_123_952_12169121_0_r136147106_79.zip
Uploading the intermediate file: upload_file_79.zip
  12:07:51 STEP 1921 H=1921:00 +CPU= 21.973
  12:08:14 STEP 1922 H=1922:00 +CPU= 22.850
  12:08:49 STEP 1923 H=1923:00 +CPU= 35.306
  12:09:12 STEP 1924 H=1924:00 +CPU= 22.644
  12:09:34 STEP 1925 H=1925:00 +CPU= 22.274
  12:10:10 STEP 1926 H=1926:00 +CPU= 36.078
  12:10:32 STEP 1927 H=1927:00 +CPU= 21.984
  12:10:55 STEP 1928 H=1928:00 +CPU= 22.865
  12:11:31 STEP 1929 H=1929:00 +CPU= 35.421
  12:11:53 STEP 1930 H=1930:00 +CPU= 22.434
  12:12:15 STEP 1931 H=1931:00 +CPU= 22.252
  12:12:54 STEP 1932 H=1932:00 +CPU= 38.908
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001932
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001932
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001932
  12:13:16 STEP 1933 H=1933:00 +CPU= 21.916
  12:13:39 STEP 1934 H=1934:00 +CPU= 22.709
  12:14:14 STEP 1935 H=1935:00 +CPU= 35.167
  12:14:37 STEP 1936 H=1936:00 +CPU= 22.542
  12:14:59 STEP 1937 H=1937:00 +CPU= 22.056
  12:15:35 STEP 1938 H=1938:00 +CPU= 35.905
  12:15:56 STEP 1939 H=1939:00 +CPU= 21.884
  12:16:19 STEP 1940 H=1940:00 +CPU= 22.706
  12:16:54 STEP 1941 H=1941:00 +CPU= 35.218
  12:17:17 STEP 1942 H=1942:00 +CPU= 22.390
  12:17:40 STEP 1943 H=1943:00 +CPU= 22.843
  12:18:21 STEP 1944 H=1944:00 +CPU= 40.945
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001944
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001944
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001944
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMGGhq0f+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMSHhq0f+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMUAhq0f+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMGGhq0f+001932
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMSHhq0f+001932
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMUAhq0f+001932
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0477_1983050100_123_952_12169121_0_r136147106_80.zip
Uploading the intermediate file: upload_file_80.zip
  12:18:43 STEP 1945 H=1945:00 +CPU= 21.915
  12:19:05 STEP 1946 H=1946:00 +CPU= 22.764
  12:19:41 STEP 1947 H=1947:00 +CPU= 35.185
  12:20:03 STEP 1948 H=1948:00 +CPU= 22.593
  12:20:25 STEP 1949 H=1949:00 +CPU= 22.160
  12:21:01 STEP 1950 H=1950:00 +CPU= 35.996
  12:21:23 STEP 1951 H=1951:00 +CPU= 21.986
  12:21:46 STEP 1952 H=1952:00 +CPU= 22.861
  12:22:22 STEP 1953 H=1953:00 +CPU= 35.334
  12:22:44 STEP 1954 H=1954:00 +CPU= 22.421
  12:23:06 STEP 1955 H=1955:00 +CPU= 22.258
  12:23:45 STEP 1956 H=1956:00 +CPU= 38.891
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001956
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001956
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001956
  12:24:07 STEP 1957 H=1957:00 +CPU= 21.927
  12:24:30 STEP 1958 H=1958:00 +CPU= 22.717
  12:25:05 STEP 1959 H=1959:00 +CPU= 35.193
  12:25:28 STEP 1960 H=1960:00 +CPU= 22.546
  12:25:50 STEP 1961 H=1961:00 +CPU= 22.079
  12:26:26 STEP 1962 H=1962:00 +CPU= 35.895
  12:26:48 STEP 1963 H=1963:00 +CPU= 21.912
  12:27:10 STEP 1964 H=1964:00 +CPU= 22.680
  12:27:45 STEP 1965 H=1965:00 +CPU= 35.194
  12:28:08 STEP 1966 H=1966:00 +CPU= 22.357
  12:28:31 STEP 1967 H=1967:00 +CPU= 22.819
  12:29:12 STEP 1968 H=1968:00 +CPU= 40.923
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001968
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001968
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001968
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMGGhq0f+001944
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMSHhq0f+001944
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMUAhq0f+001944
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMGGhq0f+001956
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMSHhq0f+001956
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMUAhq0f+001956
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0477_1983050100_123_952_12169121_0_r136147106_81.zip
Uploading the intermediate file: upload_file_81.zip
  12:29:34 STEP 1969 H=1969:00 +CPU= 21.889
  12:29:57 STEP 1970 H=1970:00 +CPU= 22.760
  12:30:32 STEP 1971 H=1971:00 +CPU= 35.108
  12:30:54 STEP 1972 H=1972:00 +CPU= 22.573
  12:31:16 STEP 1973 H=1973:00 +CPU= 22.213
  12:31:53 STEP 1974 H=1974:00 +CPU= 36.019
  12:32:14 STEP 1975 H=1975:00 +CPU= 21.964
  12:32:37 STEP 1976 H=1976:00 +CPU= 22.837
  12:33:13 STEP 1977 H=1977:00 +CPU= 35.356
  12:33:35 STEP 1978 H=1978:00 +CPU= 22.430
  12:33:57 STEP 1979 H=1979:00 +CPU= 22.227
  12:34:36 STEP 1980 H=1980:00 +CPU= 38.822
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001980
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001980
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001980
  12:34:58 STEP 1981 H=1981:00 +CPU= 21.895
  12:35:21 STEP 1982 H=1982:00 +CPU= 22.674
  12:35:56 STEP 1983 H=1983:00 +CPU= 35.113
  12:36:18 STEP 1984 H=1984:00 +CPU= 22.510
  12:36:40 STEP 1985 H=1985:00 +CPU= 22.027
  12:37:16 STEP 1986 H=1986:00 +CPU= 35.872
  12:37:38 STEP 1987 H=1987:00 +CPU= 21.865
  12:38:01 STEP 1988 H=1988:00 +CPU= 22.659
  12:38:36 STEP 1989 H=1989:00 +CPU= 35.118
  12:38:58 STEP 1990 H=1990:00 +CPU= 22.350
  12:39:21 STEP 1991 H=1991:00 +CPU= 22.749
  12:40:02 STEP 1992 H=1992:00 +CPU= 40.984
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001992
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001992
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001992
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMGGhq0f+001968
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMSHhq0f+001968
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMUAhq0f+001968
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMGGhq0f+001980
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMSHhq0f+001980
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMUAhq0f+001980
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0477_1983050100_123_952_12169121_0_r136147106_82.zip
Uploading the intermediate file: upload_file_82.zip
  12:40:24 STEP 1993 H=1993:00 +CPU= 21.995
  12:40:47 STEP 1994 H=1994:00 +CPU= 22.860
  12:41:22 STEP 1995 H=1995:00 +CPU= 35.284
  12:41:45 STEP 1996 H=1996:00 +CPU= 22.596
  12:42:07 STEP 1997 H=1997:00 +CPU= 22.197
  12:42:43 STEP 1998 H=1998:00 +CPU= 35.996
  12:43:05 STEP 1999 H=1999:00 +CPU= 22.004
  12:43:28 STEP 2000 H=2000:00 +CPU= 22.894
  12:44:04 STEP 2001 H=2001:00 +CPU= 35.443
  12:44:26 STEP 2002 H=2002:00 +CPU= 22.420
  12:44:48 STEP 2003 H=2003:00 +CPU= 22.195
  12:45:27 STEP 2004 H=2004:00 +CPU= 38.811
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002004
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002004
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002004
  12:45:49 STEP 2005 H=2005:00 +CPU= 21.884
  12:46:12 STEP 2006 H=2006:00 +CPU= 22.721
  12:46:47 STEP 2007 H=2007:00 +CPU= 35.102
  12:47:09 STEP 2008 H=2008:00 +CPU= 22.473
  12:47:31 STEP 2009 H=2009:00 +CPU= 22.029
  12:48:07 STEP 2010 H=2010:00 +CPU= 35.857
  12:48:29 STEP 2011 H=2011:00 +CPU= 21.828
  12:48:52 STEP 2012 H=2012:00 +CPU= 22.661
  12:49:27 STEP 2013 H=2013:00 +CPU= 35.148
  12:49:49 STEP 2014 H=2014:00 +CPU= 22.360
  12:50:12 STEP 2015 H=2015:00 +CPU= 22.710
  12:50:53 STEP 2016 H=2016:00 +CPU= 40.988
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002016
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002016
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002016
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMGGhq0f+001992
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMSHhq0f+001992
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMUAhq0f+001992
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMGGhq0f+002004
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMSHhq0f+002004
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMUAhq0f+002004
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0477_1983050100_123_952_12169121_0_r136147106_83.zip
Uploading the intermediate file: upload_file_83.zip
  12:51:15 STEP 2017 H=2017:00 +CPU= 21.979
  12:51:38 STEP 2018 H=2018:00 +CPU= 22.791
  12:52:13 STEP 2019 H=2019:00 +CPU= 35.294
  12:52:36 STEP 2020 H=2020:00 +CPU= 22.584
  12:52:58 STEP 2021 H=2021:00 +CPU= 22.264
  12:53:34 STEP 2022 H=2022:00 +CPU= 36.057
  12:53:56 STEP 2023 H=2023:00 +CPU= 22.006
  12:54:19 STEP 2024 H=2024:00 +CPU= 22.893
  12:54:57 STEP 2025 H=2025:00 +CPU= 37.577
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1983050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0477
(argv4) batchid: 952
(argv5) wuid: 12169121
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/4
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/4/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/4/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_3ff6f9d0f58b8aaea3f957c01d678a83 to: /var/lib/boinc-client/slots/4/oifs_43r3_ps_0477_1983050100_123_952_12169121.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/4/oifs_43r3_ps_0477_1983050100_123_952_12169121.zip
ic_ancil_file: ic_ancil_12169121
ifsdata_file: ifsdata_12169121
climate_data_file: clim_data_12169121
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_908f77d9f38bc693a71fa9600d861079 to: /var/lib/boinc-client/slots/4/ic_ancil_12169121.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/4/ic_ancil_12169121.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_c17259df7dbac822b3a9ca0689913336 to: /var/lib/boinc-client/slots/4/ifsdata/ifsdata_12169121.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/4/ifsdata/ifsdata_12169121.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/4/159l_2/clim_data_12169121.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/4/159l_2/clim_data_12169121.zip
Checking for progress XML file: /var/lib/boinc-client/slots/4/progress_file_12169121.xml
Opened progress file ok : /var/lib/boinc-client/slots/4/progress_file_12169121.xml
-- Model is restarting --
Adjusting last_iter, 2026, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/4/progress_file_12169121.xml
last_cpu_time: 58328
upload_file_number: 84
last_iter: 2015
last_upload: 7257600
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0477_1983050100_123_952_12169121_0_r136147106
The child process has been launched with process id: 62541
Executing the command: /var/lib/boinc-client/slots/4/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:CB-Boinc-01:1:1:62541:62541] [20230107:133057:1673127057:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:CB-Boinc-01:1:1:62541:62541] [20230107:133057:1673127057:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:CB-Boinc-01:1:1:62541:62541] [20230107:133057:1673127057:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:CB-Boinc-01:1:1:62541:62541] [20230107:133057:1673127057:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:CB-Boinc-01:1:1:62541:62541] [20230107:133057:1673127057:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:CB-Boinc-01:1:1:62541:62541] [20230107:133057:1673127057:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:CB-Boinc-01:1:1:62541:62541] [20230107:133057:1673127057:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:CB-Boinc-01:1:1:62541:62541] [20230107:133057:1673127057:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:CB-Boinc-01:1:1:62541:62541] [20230107:133057:1673127057:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:CB-Boinc-01:1:1:62541:62541] [20230107:133057:1673127057:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:CB-Boinc-01:1:1:62541:62541] [20230107:133057:1673127057:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:CB-Boinc-01:1:1:62541:62541] [20230107:133057:1673127057:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:CB-Boinc-01:1:1:62541:62541] [20230107:133057:1673127057:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:CB-Boinc-01:1:1:62541:62541] [20230107:133057:1673127057:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:CB-Boinc-01:1:1:62541:62541] [20230107:133057:1673127057:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:CB-Boinc-01:1:1:62541:62541] [20230107:133057:1673127057:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:CB-Boinc-01:1:1:62541:62541] [20230107:133057:1673127057:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:CB-Boinc-01:1:1:62541:62541] [20230107:133057:1673127057:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:CB-Boinc-01:1:1:62541:62541] [20230107:133057:1673127057:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:CB-Boinc-01:1:1:62541:62541] [20230107:133057:1673127057:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:CB-Boinc-01:1:1:62541:62541] [20230107:133057:1673127057:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:CB-Boinc-01:1:1:62541:62541] [20230107:133057:1673127057:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:CB-Boinc-01:1:1:62541:62541] [20230107:133057:1673127057:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:CB-Boinc-01:1:1:62541:62541] [20230107:133057:1673127057:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:CB-Boinc-01:1:1:62541:62541] [20230107:133057:1673127057:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:CB-Boinc-01:1:1:62541:62541] [20230107:133057:1673127057:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:CB-Boinc-01:1:1:62541:62541] [20230107:133057:1673127057:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:CB-Boinc-01:1:1:62541:62541] [20230107:133057:1673127057:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:CB-Boinc-01:1:1:62541:62541] [20230107:133057:1673127057:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:CB-Boinc-01:1:1:62541:62541] [20230107:133057:1673127057:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  13:31:53 STEP 2016 H=2016:00 +CPU= 40.081
  13:32:15 STEP 2017 H=2017:00 +CPU= 22.073
  13:32:39 STEP 2018 H=2018:00 +CPU= 23.237
  13:33:15 STEP 2019 H=2019:00 +CPU= 35.977
  13:33:37 STEP 2020 H=2020:00 +CPU= 22.585
  13:34:00 STEP 2021 H=2021:00 +CPU= 22.366
  13:34:37 STEP 2022 H=2022:00 +CPU= 36.925
  13:35:00 STEP 2023 H=2023:00 +CPU= 22.171
  13:35:22 STEP 2024 H=2024:00 +CPU= 22.829
  13:35:59 STEP 2025 H=2025:00 +CPU= 36.053
  13:36:22 STEP 2026 H=2026:00 +CPU= 23.537
  13:36:45 STEP 2027 H=2027:00 +CPU= 22.805
  13:37:25 STEP 2028 H=2028:00 +CPU= 39.964
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002028
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002028
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002028
  13:37:48 STEP 2029 H=2029:00 +CPU= 22.833
  13:38:12 STEP 2030 H=2030:00 +CPU= 23.455
  13:38:48 STEP 2031 H=2031:00 +CPU= 36.044
  13:39:11 STEP 2032 H=2032:00 +CPU= 23.574
  13:39:34 STEP 2033 H=2033:00 +CPU= 22.706
  13:40:11 STEP 2034 H=2034:00 +CPU= 36.928
  13:40:34 STEP 2035 H=2035:00 +CPU= 22.703
  13:40:57 STEP 2036 H=2036:00 +CPU= 23.496
  13:41:33 STEP 2037 H=2037:00 +CPU= 35.995
  13:41:57 STEP 2038 H=2038:00 +CPU= 23.506
  13:42:21 STEP 2039 H=2039:00 +CPU= 23.361
  13:43:04 STEP 2040 H=2040:00 +CPU= 41.956
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002040
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002040
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002040
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMGGhq0f+002016
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMSHhq0f+002016
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMUAhq0f+002016
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMGGhq0f+002028
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMSHhq0f+002028
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMUAhq0f+002028
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0477_1983050100_123_952_12169121_0_r136147106_84.zip
Uploading the intermediate file: upload_file_84.zip
  13:43:27 STEP 2041 H=2041:00 +CPU= 22.669
  13:43:50 STEP 2042 H=2042:00 +CPU= 23.293
  13:44:26 STEP 2043 H=2043:00 +CPU= 36.169
  13:44:50 STEP 2044 H=2044:00 +CPU= 23.314
  13:45:13 STEP 2045 H=2045:00 +CPU= 22.724
  13:45:50 STEP 2046 H=2046:00 +CPU= 36.884
  13:46:12 STEP 2047 H=2047:00 +CPU= 22.731
  13:46:36 STEP 2048 H=2048:00 +CPU= 23.384
  13:47:10 STEP 2049 H=2049:00 +CPU= 34.531
  13:47:32 STEP 2050 H=2050:00 +CPU= 21.568
  13:47:56 STEP 2051 H=2051:00 +CPU= 21.941
  13:48:38 STEP 2052 H=2052:00 +CPU= 39.893
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002052
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002052
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002052
  13:49:01 STEP 2053 H=2053:00 +CPU= 22.773
  13:49:24 STEP 2054 H=2054:00 +CPU= 23.147
  13:50:00 STEP 2055 H=2055:00 +CPU= 35.905
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1983050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0477
(argv4) batchid: 952
(argv5) wuid: 12169121
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/4
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/4/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/4/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_3ff6f9d0f58b8aaea3f957c01d678a83 to: /var/lib/boinc-client/slots/4/oifs_43r3_ps_0477_1983050100_123_952_12169121.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/4/oifs_43r3_ps_0477_1983050100_123_952_12169121.zip
ic_ancil_file: ic_ancil_12169121
ifsdata_file: ifsdata_12169121
climate_data_file: clim_data_12169121
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_908f77d9f38bc693a71fa9600d861079 to: /var/lib/boinc-client/slots/4/ic_ancil_12169121.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/4/ic_ancil_12169121.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_c17259df7dbac822b3a9ca0689913336 to: /var/lib/boinc-client/slots/4/ifsdata/ifsdata_12169121.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/4/ifsdata/ifsdata_12169121.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/4/159l_2/clim_data_12169121.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/4/159l_2/clim_data_12169121.zip
Checking for progress XML file: /var/lib/boinc-client/slots/4/progress_file_12169121.xml
Opened progress file ok : /var/lib/boinc-client/slots/4/progress_file_12169121.xml
-- Model is restarting --
Adjusting last_iter, 2056, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/4/progress_file_12169121.xml
last_cpu_time: 59459
upload_file_number: 85
last_iter: 2039
last_upload: 7344000
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0477_1983050100_123_952_12169121_0_r136147106
The child process has been launched with process id: 62710
Executing the command: /var/lib/boinc-client/slots/4/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:CB-Boinc-01:1:1:62710:62710] [20230107:140829:1673129309:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:CB-Boinc-01:1:1:62710:62710] [20230107:140829:1673129309:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:CB-Boinc-01:1:1:62710:62710] [20230107:140829:1673129309:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:CB-Boinc-01:1:1:62710:62710] [20230107:140829:1673129309:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:CB-Boinc-01:1:1:62710:62710] [20230107:140829:1673129309:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:CB-Boinc-01:1:1:62710:62710] [20230107:140829:1673129309:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:CB-Boinc-01:1:1:62710:62710] [20230107:140829:1673129309:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:CB-Boinc-01:1:1:62710:62710] [20230107:140829:1673129309:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:CB-Boinc-01:1:1:62710:62710] [20230107:140829:1673129309:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:CB-Boinc-01:1:1:62710:62710] [20230107:140829:1673129309:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:CB-Boinc-01:1:1:62710:62710] [20230107:140829:1673129309:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:CB-Boinc-01:1:1:62710:62710] [20230107:140829:1673129309:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:CB-Boinc-01:1:1:62710:62710] [20230107:140829:1673129309:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:CB-Boinc-01:1:1:62710:62710] [20230107:140829:1673129309:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:CB-Boinc-01:1:1:62710:62710] [20230107:140829:1673129309:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:CB-Boinc-01:1:1:62710:62710] [20230107:140829:1673129309:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:CB-Boinc-01:1:1:62710:62710] [20230107:140829:1673129309:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:CB-Boinc-01:1:1:62710:62710] [20230107:140829:1673129309:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:CB-Boinc-01:1:1:62710:62710] [20230107:140829:1673129309:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:CB-Boinc-01:1:1:62710:62710] [20230107:140829:1673129309:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:CB-Boinc-01:1:1:62710:62710] [20230107:140829:1673129309:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:CB-Boinc-01:1:1:62710:62710] [20230107:140829:1673129309:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:CB-Boinc-01:1:1:62710:62710] [20230107:140829:1673129309:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:CB-Boinc-01:1:1:62710:62710] [20230107:140829:1673129309:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:CB-Boinc-01:1:1:62710:62710] [20230107:140829:1673129309:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:CB-Boinc-01:1:1:62710:62710] [20230107:140829:1673129309:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:CB-Boinc-01:1:1:62710:62710] [20230107:140829:1673129309:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:CB-Boinc-01:1:1:62710:62710] [20230107:140829:1673129309:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:CB-Boinc-01:1:1:62710:62710] [20230107:140829:1673129309:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:CB-Boinc-01:1:1:62710:62710] [20230107:140829:1673129309:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  14:09:30 STEP 2040 H=2040:00 +CPU= 40.463
  14:09:53 STEP 2041 H=2041:00 +CPU= 22.777
  14:10:16 STEP 2042 H=2042:00 +CPU= 23.460
  14:10:53 STEP 2043 H=2043:00 +CPU= 36.294
  14:11:16 STEP 2044 H=2044:00 +CPU= 23.492
  14:11:39 STEP 2045 H=2045:00 +CPU= 22.833
  14:12:16 STEP 2046 H=2046:00 +CPU= 37.062
  14:12:39 STEP 2047 H=2047:00 +CPU= 22.901
  14:13:03 STEP 2048 H=2048:00 +CPU= 23.558
  14:13:39 STEP 2049 H=2049:00 +CPU= 36.325
  14:14:03 STEP 2050 H=2050:00 +CPU= 23.612
  14:14:26 STEP 2051 H=2051:00 +CPU= 22.934
  14:15:06 STEP 2052 H=2052:00 +CPU= 40.085
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002052
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002052
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002052
  14:15:29 STEP 2053 H=2053:00 +CPU= 23.042
  14:15:53 STEP 2054 H=2054:00 +CPU= 23.673
  14:16:29 STEP 2055 H=2055:00 +CPU= 36.335
  14:16:53 STEP 2056 H=2056:00 +CPU= 23.609
  14:17:16 STEP 2057 H=2057:00 +CPU= 22.943
  14:17:53 STEP 2058 H=2058:00 +CPU= 37.055
  14:18:16 STEP 2059 H=2059:00 +CPU= 22.925
  14:18:39 STEP 2060 H=2060:00 +CPU= 23.614
  14:19:16 STEP 2061 H=2061:00 +CPU= 36.346
  14:19:39 STEP 2062 H=2062:00 +CPU= 23.526
  14:20:03 STEP 2063 H=2063:00 +CPU= 23.527
  14:20:49 STEP 2064 H=2064:00 +CPU= 41.996
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002064
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002064
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002064
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMGGhq0f+002040
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMSHhq0f+002040
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMUAhq0f+002040
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMGGhq0f+002052
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMSHhq0f+002052
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169121/ICMUAhq0f+002052
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0477_1983050100_123_952_12169121_0_r136147106_85.zip
Uploading the intermediate file: upload_file_85.zip
  14:21:12 STEP 2065 H=2065:00 +CPU= 22.650
  14:21:36 STEP 2066 H=2066:00 +CPU= 23.308
Abort request received from BOINC client, ending the child process

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:12:01 1494567 22253401 oifs_43r3_ps_0477_1983050100_123_952_12169121_0 6,480,000 52,232 0.0081
09 May 2023 16:11:58 1494567 22253401 oifs_43r3_ps_0477_1983050100_123_952_12169121_0 5,616,000 45,736 0.0081
09 May 2023 16:11:50 1494567 22253401 oifs_43r3_ps_0477_1983050100_123_952_12169121_0 4,752,000 39,158 0.0082
09 May 2023 16:11:47 1494567 22253401 oifs_43r3_ps_0477_1983050100_123_952_12169121_0 3,888,000 32,459 0.0083
09 May 2023 16:11:40 1494567 22253401 oifs_43r3_ps_0477_1983050100_123_952_12169121_0 3,024,000 25,757 0.0085
09 May 2023 16:11:37 1494567 22253401 oifs_43r3_ps_0477_1983050100_123_952_12169121_0 2,160,000 19,063 0.0088
09 May 2023 16:11:30 1494567 22253401 oifs_43r3_ps_0477_1983050100_123_952_12169121_0 1,296,000 12,360 0.0095


©2024 cpdn.org