climateprediction.net home page
Task 22297206

Task 22297206

Name oifs_43r3_ps_0280_2020050100_123_989_12205924_1
Workunit 12205924
Created 12 Jan 2023, 15:41:53 UTC
Sent 12 Jan 2023, 16:04:55 UTC
Report deadline 11 Feb 2023, 16:04:55 UTC
Received 14 Jan 2023, 10:53:56 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 1 (0x00000001) Unknown error code
Computer ID 1532184
Run time 12 hours 49 min 18 sec
CPU time 12 hours 46 min 43 sec
Validate state Invalid
Credit 8,709.12
Device peak FLOPS 6.86 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,418.89 MB
Peak swap size 4,978.07 MB
Peak disk usage 3,243.62 MB
Stderr
<core_client_version>7.16.6</core_client_version>
<![CDATA[
<message>
process exited with code 1 (0x1, -255)</message>
<stderr_txt>
o the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMGGhq0f+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMSHhq0f+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMUAhq0f+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMGGhq0f+001860
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMSHhq0f+001860
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMUAhq0f+001860
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0280_2020050100_123_989_12205924_1_r512416711_77.zip
Uploading the intermediate file: upload_file_77.zip
  00:33:49 STEP 1873 H=1873:00 +CPU= 15.366
  00:34:05 STEP 1874 H=1874:00 +CPU= 15.701
  00:34:29 STEP 1875 H=1875:00 +CPU= 24.117
  00:34:44 STEP 1876 H=1876:00 +CPU= 15.585
  00:35:00 STEP 1877 H=1877:00 +CPU= 15.215
  00:35:24 STEP 1878 H=1878:00 +CPU= 24.681
  00:35:40 STEP 1879 H=1879:00 +CPU= 15.200
  00:35:55 STEP 1880 H=1880:00 +CPU= 15.738
  00:36:19 STEP 1881 H=1881:00 +CPU= 24.088
  00:36:35 STEP 1882 H=1882:00 +CPU= 15.613
  00:36:50 STEP 1883 H=1883:00 +CPU= 15.276
  00:37:17 STEP 1884 H=1884:00 +CPU= 26.367
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+001884
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+001884
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+001884
  00:37:32 STEP 1885 H=1885:00 +CPU= 15.189
  00:37:47 STEP 1886 H=1886:00 +CPU= 15.526
  00:38:11 STEP 1887 H=1887:00 +CPU= 24.106
  00:38:27 STEP 1888 H=1888:00 +CPU= 15.504
  00:38:42 STEP 1889 H=1889:00 +CPU= 15.138
  00:39:06 STEP 1890 H=1890:00 +CPU= 24.378
  00:39:22 STEP 1891 H=1891:00 +CPU= 15.179
  00:39:37 STEP 1892 H=1892:00 +CPU= 15.536
  00:40:01 STEP 1893 H=1893:00 +CPU= 24.095
  00:40:17 STEP 1894 H=1894:00 +CPU= 15.521
  00:40:33 STEP 1895 H=1895:00 +CPU= 15.744
  00:41:01 STEP 1896 H=1896:00 +CPU= 28.609
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+001896
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+001896
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMGGhq0f+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMSHhq0f+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMUAhq0f+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMGGhq0f+001884
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMSHhq0f+001884
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMUAhq0f+001884
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0280_2020050100_123_989_12205924_1_r512416711_78.zip
Uploading the intermediate file: upload_file_78.zip
  00:41:16 STEP 1897 H=1897:00 +CPU= 15.206
  00:41:32 STEP 1898 H=1898:00 +CPU= 15.586
  00:41:57 STEP 1899 H=1899:00 +CPU= 24.727
  00:42:12 STEP 1900 H=1900:00 +CPU= 15.614
  00:42:27 STEP 1901 H=1901:00 +CPU= 15.176
  00:42:52 STEP 1902 H=1902:00 +CPU= 24.570
  00:43:07 STEP 1903 H=1903:00 +CPU= 15.296
  00:43:23 STEP 1904 H=1904:00 +CPU= 15.578
  00:43:47 STEP 1905 H=1905:00 +CPU= 24.156
  00:44:03 STEP 1906 H=1906:00 +CPU= 15.664
  00:44:18 STEP 1907 H=1907:00 +CPU= 15.209
  00:44:45 STEP 1908 H=1908:00 +CPU= 26.520
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+001908
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+001908
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+001908
  00:45:00 STEP 1909 H=1909:00 +CPU= 15.257
  00:45:15 STEP 1910 H=1910:00 +CPU= 15.551
  00:45:40 STEP 1911 H=1911:00 +CPU= 24.248
  00:45:55 STEP 1912 H=1912:00 +CPU= 15.780
  00:46:11 STEP 1913 H=1913:00 +CPU= 15.247
  00:46:35 STEP 1914 H=1914:00 +CPU= 24.800
  00:46:51 STEP 1915 H=1915:00 +CPU= 15.309
  00:47:06 STEP 1916 H=1916:00 +CPU= 15.536
  00:47:31 STEP 1917 H=1917:00 +CPU= 24.341
  00:47:46 STEP 1918 H=1918:00 +CPU= 15.655
  00:48:02 STEP 1919 H=1919:00 +CPU= 15.716
  00:48:30 STEP 1920 H=1920:00 +CPU= 28.416
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+001920
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+001920
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMGGhq0f+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMSHhq0f+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMUAhq0f+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMGGhq0f+001908
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMSHhq0f+001908
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMUAhq0f+001908
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0280_2020050100_123_989_12205924_1_r512416711_79.zip
Uploading the intermediate file: upload_file_79.zip
  00:48:46 STEP 1921 H=1921:00 +CPU= 15.342
  00:49:01 STEP 1922 H=1922:00 +CPU= 15.561
  00:49:25 STEP 1923 H=1923:00 +CPU= 24.144
  00:49:41 STEP 1924 H=1924:00 +CPU= 15.624
  00:49:56 STEP 1925 H=1925:00 +CPU= 15.157
  00:50:21 STEP 1926 H=1926:00 +CPU= 24.622
  00:50:36 STEP 1927 H=1927:00 +CPU= 15.317
  00:50:52 STEP 1928 H=1928:00 +CPU= 15.519
  00:51:16 STEP 1929 H=1929:00 +CPU= 24.105
  00:51:32 STEP 1930 H=1930:00 +CPU= 15.683
  00:51:47 STEP 1931 H=1931:00 +CPU= 15.075
  00:52:13 STEP 1932 H=1932:00 +CPU= 26.563
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+001932
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+001932
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+001932
  00:52:28 STEP 1933 H=1933:00 +CPU= 15.230
  00:52:44 STEP 1934 H=1934:00 +CPU= 15.512
  00:53:08 STEP 1935 H=1935:00 +CPU= 24.090
  00:53:24 STEP 1936 H=1936:00 +CPU= 15.624
  00:53:39 STEP 1937 H=1937:00 +CPU= 15.077
  00:54:03 STEP 1938 H=1938:00 +CPU= 24.581
  00:54:19 STEP 1939 H=1939:00 +CPU= 15.228
  00:54:34 STEP 1940 H=1940:00 +CPU= 15.541
  00:54:58 STEP 1941 H=1941:00 +CPU= 24.179
  00:55:14 STEP 1942 H=1942:00 +CPU= 15.606
  00:55:30 STEP 1943 H=1943:00 +CPU= 15.717
  00:55:58 STEP 1944 H=1944:00 +CPU= 28.468
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+001944
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+001944
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+001944
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMGGhq0f+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMSHhq0f+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMUAhq0f+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMGGhq0f+001932
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMSHhq0f+001932
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMUAhq0f+001932
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0280_2020050100_123_989_12205924_1_r512416711_80.zip
Uploading the intermediate file: upload_file_80.zip
  00:56:13 STEP 1945 H=1945:00 +CPU= 15.272
  00:56:29 STEP 1946 H=1946:00 +CPU= 15.692
  00:56:53 STEP 1947 H=1947:00 +CPU= 24.190
  00:57:09 STEP 1948 H=1948:00 +CPU= 15.643
  00:57:24 STEP 1949 H=1949:00 +CPU= 15.135
  00:57:49 STEP 1950 H=1950:00 +CPU= 24.547
  00:58:04 STEP 1951 H=1951:00 +CPU= 15.247
  00:58:19 STEP 1952 H=1952:00 +CPU= 15.600
  00:58:44 STEP 1953 H=1953:00 +CPU= 24.135
  00:58:59 STEP 1954 H=1954:00 +CPU= 15.642
  00:59:15 STEP 1955 H=1955:00 +CPU= 15.292
  00:59:41 STEP 1956 H=1956:00 +CPU= 26.499
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+001956
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+001956
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+001956
  00:59:56 STEP 1957 H=1957:00 +CPU= 15.308
  01:00:12 STEP 1958 H=1958:00 +CPU= 15.795
  01:00:36 STEP 1959 H=1959:00 +CPU= 24.046
  01:00:52 STEP 1960 H=1960:00 +CPU= 15.702
  01:01:07 STEP 1961 H=1961:00 +CPU= 15.263
  01:01:32 STEP 1962 H=1962:00 +CPU= 24.744
  01:01:47 STEP 1963 H=1963:00 +CPU= 15.340
  01:02:03 STEP 1964 H=1964:00 +CPU= 15.578
  01:02:27 STEP 1965 H=1965:00 +CPU= 24.185
  01:02:43 STEP 1966 H=1966:00 +CPU= 15.609
  01:02:58 STEP 1967 H=1967:00 +CPU= 15.679
  01:03:27 STEP 1968 H=1968:00 +CPU= 28.637
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+001968
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+001968
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+001968
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMGGhq0f+001944
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMSHhq0f+001944
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMUAhq0f+001944
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMGGhq0f+001956
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMSHhq0f+001956
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMUAhq0f+001956
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0280_2020050100_123_989_12205924_1_r512416711_81.zip
Uploading the intermediate file: upload_file_81.zip
  01:03:42 STEP 1969 H=1969:00 +CPU= 15.323
Uploading trickle at timestep: 7084800
  01:03:58 STEP 1970 H=1970:00 +CPU= 15.641
  01:04:22 STEP 1971 H=1971:00 +CPU= 24.167
  01:04:38 STEP 1972 H=1972:00 +CPU= 15.777
  01:04:53 STEP 1973 H=1973:00 +CPU= 15.171
  01:05:18 STEP 1974 H=1974:00 +CPU= 24.777
  01:05:33 STEP 1975 H=1975:00 +CPU= 15.392
  01:05:49 STEP 1976 H=1976:00 +CPU= 15.640
  01:06:13 STEP 1977 H=1977:00 +CPU= 24.191
  01:06:29 STEP 1978 H=1978:00 +CPU= 15.698
  01:06:44 STEP 1979 H=1979:00 +CPU= 15.423
  01:07:11 STEP 1980 H=1980:00 +CPU= 26.650
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+001980
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+001980
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+001980
  01:07:26 STEP 1981 H=1981:00 +CPU= 15.236
  01:07:42 STEP 1982 H=1982:00 +CPU= 15.617
  01:08:06 STEP 1983 H=1983:00 +CPU= 24.244
  01:08:22 STEP 1984 H=1984:00 +CPU= 15.722
  01:08:37 STEP 1985 H=1985:00 +CPU= 15.398
  01:09:02 STEP 1986 H=1986:00 +CPU= 24.843
  01:09:17 STEP 1987 H=1987:00 +CPU= 15.307
  01:09:33 STEP 1988 H=1988:00 +CPU= 15.653
  01:09:57 STEP 1989 H=1989:00 +CPU= 24.202
  01:10:13 STEP 1990 H=1990:00 +CPU= 15.767
  01:10:29 STEP 1991 H=1991:00 +CPU= 15.677
  01:10:57 STEP 1992 H=1992:00 +CPU= 28.526
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+001992
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+001992
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+001992
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMGGhq0f+001968
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMSHhq0f+001968
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMUAhq0f+001968
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMGGhq0f+001980
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMSHhq0f+001980
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMUAhq0f+001980
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0280_2020050100_123_989_12205924_1_r512416711_82.zip
Uploading the intermediate file: upload_file_82.zip
  01:11:12 STEP 1993 H=1993:00 +CPU= 15.228
  01:11:28 STEP 1994 H=1994:00 +CPU= 15.580
  01:11:52 STEP 1995 H=1995:00 +CPU= 24.285
  01:12:08 STEP 1996 H=1996:00 +CPU= 15.674
  01:12:23 STEP 1997 H=1997:00 +CPU= 15.140
  01:12:48 STEP 1998 H=1998:00 +CPU= 24.549
  01:13:03 STEP 1999 H=1999:00 +CPU= 15.264
  01:13:18 STEP 2000 H=2000:00 +CPU= 15.638
  01:13:42 STEP 2001 H=2001:00 +CPU= 24.031
  01:13:58 STEP 2002 H=2002:00 +CPU= 15.718
  01:14:14 STEP 2003 H=2003:00 +CPU= 15.346
  01:14:40 STEP 2004 H=2004:00 +CPU= 26.511
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+002004
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+002004
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+002004
  01:14:55 STEP 2005 H=2005:00 +CPU= 15.453
  01:15:11 STEP 2006 H=2006:00 +CPU= 15.667
  01:15:35 STEP 2007 H=2007:00 +CPU= 24.102
  01:15:51 STEP 2008 H=2008:00 +CPU= 15.735
  01:16:06 STEP 2009 H=2009:00 +CPU= 15.189
  01:16:31 STEP 2010 H=2010:00 +CPU= 24.593
  01:16:46 STEP 2011 H=2011:00 +CPU= 15.274
  01:17:02 STEP 2012 H=2012:00 +CPU= 15.533
  01:17:26 STEP 2013 H=2013:00 +CPU= 24.054
  01:17:41 STEP 2014 H=2014:00 +CPU= 15.743
  01:17:57 STEP 2015 H=2015:00 +CPU= 15.718
  01:18:26 STEP 2016 H=2016:00 +CPU= 28.407
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+002016
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+002016
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+002016
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMGGhq0f+001992
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMSHhq0f+001992
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMUAhq0f+001992
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMGGhq0f+002004
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMSHhq0f+002004
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMUAhq0f+002004
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0280_2020050100_123_989_12205924_1_r512416711_83.zip
Uploading the intermediate file: upload_file_83.zip
  01:18:41 STEP 2017 H=2017:00 +CPU= 15.221
  01:18:56 STEP 2018 H=2018:00 +CPU= 15.585
  01:19:21 STEP 2019 H=2019:00 +CPU= 24.282
  01:19:36 STEP 2020 H=2020:00 +CPU= 15.653
  01:19:51 STEP 2021 H=2021:00 +CPU= 15.176
  01:20:16 STEP 2022 H=2022:00 +CPU= 24.549
  01:20:31 STEP 2023 H=2023:00 +CPU= 15.243
  01:20:47 STEP 2024 H=2024:00 +CPU= 15.528
  01:21:11 STEP 2025 H=2025:00 +CPU= 24.183
  01:21:27 STEP 2026 H=2026:00 +CPU= 15.767
  01:21:42 STEP 2027 H=2027:00 +CPU= 15.232
  01:22:09 STEP 2028 H=2028:00 +CPU= 26.481
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+002028
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+002028
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+002028
  01:22:24 STEP 2029 H=2029:00 +CPU= 15.427
  01:22:40 STEP 2030 H=2030:00 +CPU= 15.583
  01:23:04 STEP 2031 H=2031:00 +CPU= 24.123
  01:23:19 STEP 2032 H=2032:00 +CPU= 15.674
  01:23:35 STEP 2033 H=2033:00 +CPU= 15.216
  01:23:59 STEP 2034 H=2034:00 +CPU= 24.364
  01:24:14 STEP 2035 H=2035:00 +CPU= 15.139
  01:24:30 STEP 2036 H=2036:00 +CPU= 15.511
  01:24:54 STEP 2037 H=2037:00 +CPU= 24.000
  01:25:09 STEP 2038 H=2038:00 +CPU= 15.675
  01:25:25 STEP 2039 H=2039:00 +CPU= 15.600
  01:25:53 STEP 2040 H=2040:00 +CPU= 28.493
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+002040
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+002040
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+002040
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMGGhq0f+002016
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMSHhq0f+002016
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMUAhq0f+002016
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMGGhq0f+002028
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMSHhq0f+002028
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMUAhq0f+002028
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0280_2020050100_123_989_12205924_1_r512416711_84.zip
Uploading the intermediate file: upload_file_84.zip
  01:26:09 STEP 2041 H=2041:00 +CPU= 15.378
  01:26:24 STEP 2042 H=2042:00 +CPU= 15.624
  01:26:49 STEP 2043 H=2043:00 +CPU= 24.151
  01:27:04 STEP 2044 H=2044:00 +CPU= 15.616
  01:27:19 STEP 2045 H=2045:00 +CPU= 15.124
  01:27:44 STEP 2046 H=2046:00 +CPU= 24.517
  01:27:59 STEP 2047 H=2047:00 +CPU= 15.277
  01:28:15 STEP 2048 H=2048:00 +CPU= 15.566
  01:28:39 STEP 2049 H=2049:00 +CPU= 24.272
  01:28:55 STEP 2050 H=2050:00 +CPU= 15.680
  01:29:10 STEP 2051 H=2051:00 +CPU= 15.285
  01:29:37 STEP 2052 H=2052:00 +CPU= 26.757
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+002052
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+002052
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+002052
  01:29:52 STEP 2053 H=2053:00 +CPU= 15.281
  01:30:08 STEP 2054 H=2054:00 +CPU= 15.612
  01:30:32 STEP 2055 H=2055:00 +CPU= 24.238
  01:30:47 STEP 2056 H=2056:00 +CPU= 15.661
  01:31:02 STEP 2057 H=2057:00 +CPU= 15.018
  01:31:27 STEP 2058 H=2058:00 +CPU= 24.520
  01:31:42 STEP 2059 H=2059:00 +CPU= 15.237
  01:31:58 STEP 2060 H=2060:00 +CPU= 15.413
  01:32:22 STEP 2061 H=2061:00 +CPU= 24.104
  01:32:38 STEP 2062 H=2062:00 +CPU= 15.727
  01:32:53 STEP 2063 H=2063:00 +CPU= 15.712
  01:33:21 STEP 2064 H=2064:00 +CPU= 28.227
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+002064
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+002064
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+002064
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMGGhq0f+002040
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMSHhq0f+002040
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMUAhq0f+002040
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMGGhq0f+002052
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMSHhq0f+002052
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMUAhq0f+002052
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0280_2020050100_123_989_12205924_1_r512416711_85.zip
Uploading the intermediate file: upload_file_85.zip
  01:33:37 STEP 2065 H=2065:00 +CPU= 15.211
  01:33:52 STEP 2066 H=2066:00 +CPU= 15.496
  01:34:16 STEP 2067 H=2067:00 +CPU= 24.055
  01:34:32 STEP 2068 H=2068:00 +CPU= 15.657
  01:34:47 STEP 2069 H=2069:00 +CPU= 15.128
  01:35:12 STEP 2070 H=2070:00 +CPU= 24.506
  01:35:27 STEP 2071 H=2071:00 +CPU= 15.161
  01:35:42 STEP 2072 H=2072:00 +CPU= 15.539
  01:36:06 STEP 2073 H=2073:00 +CPU= 24.140
  01:36:22 STEP 2074 H=2074:00 +CPU= 15.675
  01:36:37 STEP 2075 H=2075:00 +CPU= 15.285
  01:37:04 STEP 2076 H=2076:00 +CPU= 26.521
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+002076
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+002076
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+002076
  01:37:19 STEP 2077 H=2077:00 +CPU= 15.193
  01:37:35 STEP 2078 H=2078:00 +CPU= 15.596
  01:37:59 STEP 2079 H=2079:00 +CPU= 24.133
  01:38:14 STEP 2080 H=2080:00 +CPU= 15.634
  01:38:30 STEP 2081 H=2081:00 +CPU= 15.187
  01:38:54 STEP 2082 H=2082:00 +CPU= 24.667
  01:39:10 STEP 2083 H=2083:00 +CPU= 15.220
  01:39:25 STEP 2084 H=2084:00 +CPU= 15.500
  01:39:49 STEP 2085 H=2085:00 +CPU= 24.060
  01:40:05 STEP 2086 H=2086:00 +CPU= 15.645
  01:40:20 STEP 2087 H=2087:00 +CPU= 15.631
  01:40:49 STEP 2088 H=2088:00 +CPU= 28.315
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+002088
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+002088
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+002088
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMGGhq0f+002064
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMSHhq0f+002064
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMUAhq0f+002064
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMGGhq0f+002076
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMSHhq0f+002076
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMUAhq0f+002076
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0280_2020050100_123_989_12205924_1_r512416711_86.zip
Uploading the intermediate file: upload_file_86.zip
  01:41:04 STEP 2089 H=2089:00 +CPU= 15.108
  01:41:19 STEP 2090 H=2090:00 +CPU= 15.562
  01:41:44 STEP 2091 H=2091:00 +CPU= 24.354
  01:42:00 STEP 2092 H=2092:00 +CPU= 15.796
  01:42:15 STEP 2093 H=2093:00 +CPU= 15.103
  01:42:39 STEP 2094 H=2094:00 +CPU= 24.701
  01:42:55 STEP 2095 H=2095:00 +CPU= 15.291
  01:43:10 STEP 2096 H=2096:00 +CPU= 15.726
  01:43:35 STEP 2097 H=2097:00 +CPU= 24.406
  01:43:50 STEP 2098 H=2098:00 +CPU= 15.683
  01:44:06 STEP 2099 H=2099:00 +CPU= 15.185
  01:44:32 STEP 2100 H=2100:00 +CPU= 26.598
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+002100
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+002100
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+002100
  01:44:48 STEP 2101 H=2101:00 +CPU= 15.293
  01:45:03 STEP 2102 H=2102:00 +CPU= 15.534
  01:45:27 STEP 2103 H=2103:00 +CPU= 24.102
  01:45:43 STEP 2104 H=2104:00 +CPU= 15.690
  01:45:58 STEP 2105 H=2105:00 +CPU= 15.195
  01:46:23 STEP 2106 H=2106:00 +CPU= 24.724
  01:46:38 STEP 2107 H=2107:00 +CPU= 15.174
  01:46:53 STEP 2108 H=2108:00 +CPU= 15.426
  01:47:17 STEP 2109 H=2109:00 +CPU= 24.077
  01:47:33 STEP 2110 H=2110:00 +CPU= 15.644
  01:47:49 STEP 2111 H=2111:00 +CPU= 15.733
  01:48:17 STEP 2112 H=2112:00 +CPU= 28.484
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+002112
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+002112
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+002112
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMGGhq0f+002088
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMSHhq0f+002088
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMUAhq0f+002088
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMGGhq0f+002100
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMSHhq0f+002100
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMUAhq0f+002100
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0280_2020050100_123_989_12205924_1_r512416711_87.zip
Uploading the intermediate file: upload_file_87.zip
  01:48:33 STEP 2113 H=2113:00 +CPU= 15.287
  01:48:48 STEP 2114 H=2114:00 +CPU= 15.592
  01:49:13 STEP 2115 H=2115:00 +CPU= 24.249
  01:49:28 STEP 2116 H=2116:00 +CPU= 15.721
  01:49:43 STEP 2117 H=2117:00 +CPU= 15.129
  01:50:08 STEP 2118 H=2118:00 +CPU= 24.521
  01:50:23 STEP 2119 H=2119:00 +CPU= 15.237
  01:50:39 STEP 2120 H=2120:00 +CPU= 15.526
  01:51:03 STEP 2121 H=2121:00 +CPU= 24.026
  01:51:18 STEP 2122 H=2122:00 +CPU= 15.717
  01:51:33 STEP 2123 H=2123:00 +CPU= 15.010
  01:52:00 STEP 2124 H=2124:00 +CPU= 26.368
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+002124
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+002124
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+002124
  01:52:15 STEP 2125 H=2125:00 +CPU= 15.204
  01:52:31 STEP 2126 H=2126:00 +CPU= 15.582
  01:52:55 STEP 2127 H=2127:00 +CPU= 24.201
  01:53:11 STEP 2128 H=2128:00 +CPU= 15.771
  01:53:26 STEP 2129 H=2129:00 +CPU= 15.167
  01:53:50 STEP 2130 H=2130:00 +CPU= 24.653
  01:54:06 STEP 2131 H=2131:00 +CPU= 15.170
  01:54:21 STEP 2132 H=2132:00 +CPU= 15.482
  01:54:45 STEP 2133 H=2133:00 +CPU= 24.016
  01:55:01 STEP 2134 H=2134:00 +CPU= 15.606
  01:55:16 STEP 2135 H=2135:00 +CPU= 15.673
  01:55:45 STEP 2136 H=2136:00 +CPU= 28.572
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+002136
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+002136
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+002136
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMGGhq0f+002112
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMSHhq0f+002112
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMUAhq0f+002112
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMGGhq0f+002124
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMSHhq0f+002124
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMUAhq0f+002124
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0280_2020050100_123_989_12205924_1_r512416711_88.zip
Uploading the intermediate file: upload_file_88.zip
  01:56:00 STEP 2137 H=2137:00 +CPU= 15.269
  01:56:16 STEP 2138 H=2138:00 +CPU= 15.508
  01:56:40 STEP 2139 H=2139:00 +CPU= 24.378
  01:56:56 STEP 2140 H=2140:00 +CPU= 15.699
  01:57:11 STEP 2141 H=2141:00 +CPU= 15.161
  01:57:36 STEP 2142 H=2142:00 +CPU= 24.584
  01:57:51 STEP 2143 H=2143:00 +CPU= 15.264
  01:58:06 STEP 2144 H=2144:00 +CPU= 15.502
  01:58:31 STEP 2145 H=2145:00 +CPU= 24.184
  01:58:46 STEP 2146 H=2146:00 +CPU= 15.734
  01:59:02 STEP 2147 H=2147:00 +CPU= 15.378
  01:59:28 STEP 2148 H=2148:00 +CPU= 26.788
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+002148
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+002148
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+002148
  01:59:44 STEP 2149 H=2149:00 +CPU= 15.186
  01:59:59 STEP 2150 H=2150:00 +CPU= 15.554
  02:00:23 STEP 2151 H=2151:00 +CPU= 24.062
  02:00:39 STEP 2152 H=2152:00 +CPU= 15.656
  02:00:54 STEP 2153 H=2153:00 +CPU= 15.110
  02:01:19 STEP 2154 H=2154:00 +CPU= 24.558
  02:01:34 STEP 2155 H=2155:00 +CPU= 15.245
  02:01:49 STEP 2156 H=2156:00 +CPU= 15.503
  02:02:14 STEP 2157 H=2157:00 +CPU= 24.206
  02:02:29 STEP 2158 H=2158:00 +CPU= 15.696
  02:02:45 STEP 2159 H=2159:00 +CPU= 15.673
  02:03:13 STEP 2160 H=2160:00 +CPU= 28.421
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+002160
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+002160
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+002160
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMGGhq0f+002136
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMSHhq0f+002136
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMUAhq0f+002136
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMGGhq0f+002148
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMSHhq0f+002148
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMUAhq0f+002148
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0280_2020050100_123_989_12205924_1_r512416711_89.zip
Uploading the intermediate file: upload_file_89.zip
  02:03:29 STEP 2161 H=2161:00 +CPU= 15.275
  02:03:44 STEP 2162 H=2162:00 +CPU= 15.510
  02:04:08 STEP 2163 H=2163:00 +CPU= 24.191
  02:04:24 STEP 2164 H=2164:00 +CPU= 15.686
  02:04:39 STEP 2165 H=2165:00 +CPU= 15.130
  02:05:04 STEP 2166 H=2166:00 +CPU= 24.567
  02:05:19 STEP 2167 H=2167:00 +CPU= 15.288
  02:05:35 STEP 2168 H=2168:00 +CPU= 15.580
  02:05:59 STEP 2169 H=2169:00 +CPU= 24.184
  02:06:14 STEP 2170 H=2170:00 +CPU= 15.618
  02:06:30 STEP 2171 H=2171:00 +CPU= 15.271
  02:06:56 STEP 2172 H=2172:00 +CPU= 26.458
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+002172
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+002172
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+002172
  02:07:12 STEP 2173 H=2173:00 +CPU= 15.358
  02:07:27 STEP 2174 H=2174:00 +CPU= 15.476
  02:07:51 STEP 2175 H=2175:00 +CPU= 24.373
  02:08:07 STEP 2176 H=2176:00 +CPU= 15.580
  02:08:22 STEP 2177 H=2177:00 +CPU= 15.118
  02:08:47 STEP 2178 H=2178:00 +CPU= 24.577
  02:09:02 STEP 2179 H=2179:00 +CPU= 15.230
  02:09:17 STEP 2180 H=2180:00 +CPU= 15.583
  02:09:42 STEP 2181 H=2181:00 +CPU= 24.092
  02:09:57 STEP 2182 H=2182:00 +CPU= 15.589
  02:10:13 STEP 2183 H=2183:00 +CPU= 15.741
  02:10:42 STEP 2184 H=2184:00 +CPU= 28.800
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+002184
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+002184
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+002184
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMGGhq0f+002160
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMSHhq0f+002160
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMUAhq0f+002160
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMGGhq0f+002172
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMSHhq0f+002172
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMUAhq0f+002172
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0280_2020050100_123_989_12205924_1_r512416711_90.zip
Uploading the intermediate file: upload_file_90.zip
  02:10:57 STEP 2185 H=2185:00 +CPU= 15.211
  02:11:12 STEP 2186 H=2186:00 +CPU= 15.546
  02:11:37 STEP 2187 H=2187:00 +CPU= 24.167
  02:11:52 STEP 2188 H=2188:00 +CPU= 15.655
  02:12:07 STEP 2189 H=2189:00 +CPU= 15.108
  02:12:32 STEP 2190 H=2190:00 +CPU= 24.628
  02:12:47 STEP 2191 H=2191:00 +CPU= 15.407
  02:13:03 STEP 2192 H=2192:00 +CPU= 15.609
  02:13:27 STEP 2193 H=2193:00 +CPU= 24.169
  02:13:43 STEP 2194 H=2194:00 +CPU= 15.672
  02:13:58 STEP 2195 H=2195:00 +CPU= 15.251
  02:14:25 STEP 2196 H=2196:00 +CPU= 26.547
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+002196
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+002196
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+002196
  02:14:40 STEP 2197 H=2197:00 +CPU= 15.343
  02:14:56 STEP 2198 H=2198:00 +CPU= 15.527
  02:15:20 STEP 2199 H=2199:00 +CPU= 24.130
  02:15:35 STEP 2200 H=2200:00 +CPU= 15.652
  02:15:51 STEP 2201 H=2201:00 +CPU= 15.203
  02:16:15 STEP 2202 H=2202:00 +CPU= 24.588
  02:16:31 STEP 2203 H=2203:00 +CPU= 15.338
  02:16:46 STEP 2204 H=2204:00 +CPU= 15.540
  02:17:10 STEP 2205 H=2205:00 +CPU= 24.050
  02:17:26 STEP 2206 H=2206:00 +CPU= 15.743
  02:17:42 STEP 2207 H=2207:00 +CPU= 15.683
  02:18:10 STEP 2208 H=2208:00 +CPU= 28.305
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+002208
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+002208
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+002208
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMGGhq0f+002184
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMSHhq0f+002184
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMUAhq0f+002184
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMGGhq0f+002196
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMSHhq0f+002196
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMUAhq0f+002196
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0280_2020050100_123_989_12205924_1_r512416711_91.zip
Uploading the intermediate file: upload_file_91.zip
  02:18:25 STEP 2209 H=2209:00 +CPU= 15.223
Uploading trickle at timestep: 7948800
  02:18:41 STEP 2210 H=2210:00 +CPU= 15.523
  02:19:05 STEP 2211 H=2211:00 +CPU= 24.183
  02:19:20 STEP 2212 H=2212:00 +CPU= 15.532
  02:19:35 STEP 2213 H=2213:00 +CPU= 15.075
  02:20:00 STEP 2214 H=2214:00 +CPU= 24.502
  02:20:15 STEP 2215 H=2215:00 +CPU= 15.231
  02:20:31 STEP 2216 H=2216:00 +CPU= 15.595
  02:20:55 STEP 2217 H=2217:00 +CPU= 24.365
  02:21:11 STEP 2218 H=2218:00 +CPU= 15.752
  02:21:26 STEP 2219 H=2219:00 +CPU= 15.255
  02:21:53 STEP 2220 H=2220:00 +CPU= 26.443
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+002220
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+002220
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+002220
  02:22:08 STEP 2221 H=2221:00 +CPU= 15.311
  02:22:24 STEP 2222 H=2222:00 +CPU= 15.558
  02:22:48 STEP 2223 H=2223:00 +CPU= 24.198
  02:23:03 STEP 2224 H=2224:00 +CPU= 15.569
  02:23:18 STEP 2225 H=2225:00 +CPU= 15.126
  02:23:43 STEP 2226 H=2226:00 +CPU= 24.556
  02:23:58 STEP 2227 H=2227:00 +CPU= 15.379
  02:24:14 STEP 2228 H=2228:00 +CPU= 15.526
  02:24:38 STEP 2229 H=2229:00 +CPU= 24.071
  02:24:54 STEP 2230 H=2230:00 +CPU= 15.619
  02:25:09 STEP 2231 H=2231:00 +CPU= 15.742
  02:25:38 STEP 2232 H=2232:00 +CPU= 28.588
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+002232
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+002232
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+002232
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMGGhq0f+002208
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMSHhq0f+002208
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMUAhq0f+002208
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMGGhq0f+002220
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMSHhq0f+002220
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMUAhq0f+002220
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0280_2020050100_123_989_12205924_1_r512416711_92.zip
Uploading the intermediate file: upload_file_92.zip
  02:25:53 STEP 2233 H=2233:00 +CPU= 15.197
  02:26:09 STEP 2234 H=2234:00 +CPU= 15.545
  02:26:33 STEP 2235 H=2235:00 +CPU= 24.190
  02:26:49 STEP 2236 H=2236:00 +CPU= 15.698
  02:27:04 STEP 2237 H=2237:00 +CPU= 15.133
  02:27:28 STEP 2238 H=2238:00 +CPU= 24.707
  02:27:44 STEP 2239 H=2239:00 +CPU= 15.171
  02:27:59 STEP 2240 H=2240:00 +CPU= 15.512
  02:28:23 STEP 2241 H=2241:00 +CPU= 23.967
  02:28:39 STEP 2242 H=2242:00 +CPU= 15.676
  02:28:54 STEP 2243 H=2243:00 +CPU= 15.312
  02:29:21 STEP 2244 H=2244:00 +CPU= 26.475
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+002244
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+002244
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+002244
  02:29:36 STEP 2245 H=2245:00 +CPU= 15.216
  02:29:51 STEP 2246 H=2246:00 +CPU= 15.612
  02:30:15 STEP 2247 H=2247:00 +CPU= 23.959
  02:30:31 STEP 2248 H=2248:00 +CPU= 15.649
  02:30:46 STEP 2249 H=2249:00 +CPU= 15.226
  02:31:11 STEP 2250 H=2250:00 +CPU= 24.532
  02:31:26 STEP 2251 H=2251:00 +CPU= 15.299
  02:31:42 STEP 2252 H=2252:00 +CPU= 15.652
  02:32:06 STEP 2253 H=2253:00 +CPU= 24.128
  02:32:21 STEP 2254 H=2254:00 +CPU= 15.601
  02:32:37 STEP 2255 H=2255:00 +CPU= 15.893
  02:33:05 STEP 2256 H=2256:00 +CPU= 27.992
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+002256
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+002256
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+002256
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMGGhq0f+002232
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMSHhq0f+002232
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMUAhq0f+002232
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMGGhq0f+002244
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMSHhq0f+002244
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMUAhq0f+002244
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0280_2020050100_123_989_12205924_1_r512416711_93.zip
Uploading the intermediate file: upload_file_93.zip
  02:33:20 STEP 2257 H=2257:00 +CPU= 14.792
  02:33:35 STEP 2258 H=2258:00 +CPU= 15.211
  02:33:59 STEP 2259 H=2259:00 +CPU= 23.866
  02:34:15 STEP 2260 H=2260:00 +CPU= 15.306
  02:34:29 STEP 2261 H=2261:00 +CPU= 14.801
  02:34:53 STEP 2262 H=2262:00 +CPU= 23.923
  02:35:08 STEP 2263 H=2263:00 +CPU= 14.796
  02:35:23 STEP 2264 H=2264:00 +CPU= 15.081
  02:35:47 STEP 2265 H=2265:00 +CPU= 23.654
  02:36:02 STEP 2266 H=2266:00 +CPU= 15.176
  02:36:17 STEP 2267 H=2267:00 +CPU= 14.810
  02:36:43 STEP 2268 H=2268:00 +CPU= 25.968
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+002268
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+002268
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+002268
  02:36:58 STEP 2269 H=2269:00 +CPU= 14.908
  02:37:13 STEP 2270 H=2270:00 +CPU= 15.192
  02:37:36 STEP 2271 H=2271:00 +CPU= 23.522
  02:37:52 STEP 2272 H=2272:00 +CPU= 15.051
  02:38:06 STEP 2273 H=2273:00 +CPU= 14.760
  02:38:30 STEP 2274 H=2274:00 +CPU= 23.985
  02:38:45 STEP 2275 H=2275:00 +CPU= 14.581
  02:39:00 STEP 2276 H=2276:00 +CPU= 15.130
  02:39:23 STEP 2277 H=2277:00 +CPU= 23.407
  02:39:38 STEP 2278 H=2278:00 +CPU= 15.058
  02:39:54 STEP 2279 H=2279:00 +CPU= 15.193
  02:40:21 STEP 2280 H=2280:00 +CPU= 27.685
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+002280
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+002280
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+002280
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMGGhq0f+002256
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMSHhq0f+002256
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMUAhq0f+002256
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMGGhq0f+002268
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMSHhq0f+002268
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMUAhq0f+002268
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0280_2020050100_123_989_12205924_1_r512416711_94.zip
Uploading the intermediate file: upload_file_94.zip
  02:40:36 STEP 2281 H=2281:00 +CPU= 14.745
  02:40:51 STEP 2282 H=2282:00 +CPU= 15.077
  02:41:15 STEP 2283 H=2283:00 +CPU= 23.509
  02:41:30 STEP 2284 H=2284:00 +CPU= 15.163
  02:41:44 STEP 2285 H=2285:00 +CPU= 14.537
  02:42:08 STEP 2286 H=2286:00 +CPU= 23.943
  02:42:23 STEP 2287 H=2287:00 +CPU= 14.909
  02:42:38 STEP 2288 H=2288:00 +CPU= 15.142
  02:43:02 STEP 2289 H=2289:00 +CPU= 23.634
  02:43:17 STEP 2290 H=2290:00 +CPU= 15.198
  02:43:32 STEP 2291 H=2291:00 +CPU= 14.711
  02:43:58 STEP 2292 H=2292:00 +CPU= 25.765
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+002292
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+002292
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+002292
  02:44:13 STEP 2293 H=2293:00 +CPU= 14.806
  02:44:28 STEP 2294 H=2294:00 +CPU= 15.142
  02:44:51 STEP 2295 H=2295:00 +CPU= 23.358
  02:45:06 STEP 2296 H=2296:00 +CPU= 15.330
  02:45:21 STEP 2297 H=2297:00 +CPU= 14.652
  02:45:45 STEP 2298 H=2298:00 +CPU= 23.945
  02:46:00 STEP 2299 H=2299:00 +CPU= 14.746
  02:46:15 STEP 2300 H=2300:00 +CPU= 15.104
  02:46:38 STEP 2301 H=2301:00 +CPU= 23.515
  02:46:53 STEP 2302 H=2302:00 +CPU= 15.105
  02:47:09 STEP 2303 H=2303:00 +CPU= 15.163
  02:47:36 STEP 2304 H=2304:00 +CPU= 27.518
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+002304
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+002304
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+002304
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMGGhq0f+002280
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMSHhq0f+002280
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMUAhq0f+002280
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMGGhq0f+002292
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMSHhq0f+002292
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMUAhq0f+002292
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0280_2020050100_123_989_12205924_1_r512416711_95.zip
Uploading the intermediate file: upload_file_95.zip
  02:47:52 STEP 2305 H=2305:00 +CPU= 16.216
  02:48:07 STEP 2306 H=2306:00 +CPU= 14.907
  02:48:31 STEP 2307 H=2307:00 +CPU= 23.412
  02:48:46 STEP 2308 H=2308:00 +CPU= 14.963
  02:49:00 STEP 2309 H=2309:00 +CPU= 14.631
  02:49:24 STEP 2310 H=2310:00 +CPU= 23.806
  02:49:39 STEP 2311 H=2311:00 +CPU= 14.630
  02:49:54 STEP 2312 H=2312:00 +CPU= 15.042
  02:50:17 STEP 2313 H=2313:00 +CPU= 23.692
  02:50:33 STEP 2314 H=2314:00 +CPU= 15.175
  02:50:47 STEP 2315 H=2315:00 +CPU= 14.622
  02:51:13 STEP 2316 H=2316:00 +CPU= 25.459
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+002316
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+002316
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+002316
  02:51:27 STEP 2317 H=2317:00 +CPU= 14.696
  02:51:42 STEP 2318 H=2318:00 +CPU= 14.973
  02:52:06 STEP 2319 H=2319:00 +CPU= 23.410
  02:52:21 STEP 2320 H=2320:00 +CPU= 15.031
  02:52:35 STEP 2321 H=2321:00 +CPU= 14.573
  02:52:59 STEP 2322 H=2322:00 +CPU= 23.831
  02:53:14 STEP 2323 H=2323:00 +CPU= 14.758
  02:53:29 STEP 2324 H=2324:00 +CPU= 15.023
  02:53:53 STEP 2325 H=2325:00 +CPU= 23.504
  02:54:08 STEP 2326 H=2326:00 +CPU= 15.048
  02:54:23 STEP 2327 H=2327:00 +CPU= 15.122
  02:54:50 STEP 2328 H=2328:00 +CPU= 27.489
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+002328
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+002328
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+002328
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMGGhq0f+002304
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMSHhq0f+002304
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMUAhq0f+002304
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMGGhq0f+002316
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMSHhq0f+002316
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMUAhq0f+002316
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0280_2020050100_123_989_12205924_1_r512416711_96.zip
Uploading the intermediate file: upload_file_96.zip
  02:55:05 STEP 2329 H=2329:00 +CPU= 14.791
  02:55:20 STEP 2330 H=2330:00 +CPU= 15.165
  02:55:44 STEP 2331 H=2331:00 +CPU= 23.381
  02:55:59 STEP 2332 H=2332:00 +CPU= 15.197
  02:56:13 STEP 2333 H=2333:00 +CPU= 14.674
  02:56:37 STEP 2334 H=2334:00 +CPU= 23.787
  02:56:52 STEP 2335 H=2335:00 +CPU= 14.762
  02:57:07 STEP 2336 H=2336:00 +CPU= 14.964
  02:57:30 STEP 2337 H=2337:00 +CPU= 23.297
  02:57:45 STEP 2338 H=2338:00 +CPU= 15.097
  02:58:00 STEP 2339 H=2339:00 +CPU= 14.774
  02:58:26 STEP 2340 H=2340:00 +CPU= 25.838
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+002340
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+002340
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+002340
  02:58:41 STEP 2341 H=2341:00 +CPU= 14.703
  02:58:56 STEP 2342 H=2342:00 +CPU= 15.061
  02:59:19 STEP 2343 H=2343:00 +CPU= 23.323
  02:59:34 STEP 2344 H=2344:00 +CPU= 15.138
  02:59:49 STEP 2345 H=2345:00 +CPU= 14.612
  03:00:13 STEP 2346 H=2346:00 +CPU= 23.778
  03:00:28 STEP 2347 H=2347:00 +CPU= 14.884
  03:00:43 STEP 2348 H=2348:00 +CPU= 15.094
  03:01:06 STEP 2349 H=2349:00 +CPU= 23.473
  03:01:21 STEP 2350 H=2350:00 +CPU= 15.187
  03:01:36 STEP 2351 H=2351:00 +CPU= 15.148
  03:02:04 STEP 2352 H=2352:00 +CPU= 27.507
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+002352
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+002352
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+002352
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMGGhq0f+002328
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMSHhq0f+002328
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMUAhq0f+002328
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMGGhq0f+002340
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMSHhq0f+002340
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924/ICMUAhq0f+002340
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0280_2020050100_123_989_12205924_1_r512416711_97.zip
Uploading the intermediate file: upload_file_97.zip
  03:02:19 STEP 2353 H=2353:00 +CPU= 14.748
  03:02:34 STEP 2354 H=2354:00 +CPU= 15.060
  03:02:57 STEP 2355 H=2355:00 +CPU= 23.495
  03:03:12 STEP 2356 H=2356:00 +CPU= 15.168
  03:03:27 STEP 2357 H=2357:00 +CPU= 14.692
  03:03:51 STEP 2358 H=2358:00 +CPU= 23.744
  03:04:06 STEP 2359 H=2359:00 +CPU= 14.960
  03:04:21 STEP 2360 H=2360:00 +CPU= 15.039
  03:04:44 STEP 2361 H=2361:00 +CPU= 23.454
  03:05:00 STEP 2362 H=2362:00 +CPU= 15.204
  03:05:14 STEP 2363 H=2363:00 +CPU= 14.655
  03:05:40 STEP 2364 H=2364:00 +CPU= 25.696
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+002364
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+002364
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+002364
  03:05:55 STEP 2365 H=2365:00 +CPU= 14.783
  03:06:10 STEP 2366 H=2366:00 +CPU= 15.099
  03:06:33 STEP 2367 H=2367:00 +CPU= 23.361
  03:06:48 STEP 2368 H=2368:00 +CPU= 15.270
  03:07:03 STEP 2369 H=2369:00 +CPU= 14.713
  03:07:27 STEP 2370 H=2370:00 +CPU= 23.850
  03:07:42 STEP 2371 H=2371:00 +CPU= 14.650
  03:07:57 STEP 2372 H=2372:00 +CPU= 14.962
  03:08:20 STEP 2373 H=2373:00 +CPU= 23.461
  03:08:35 STEP 2374 H=2374:00 +CPU= 15.150
  03:08:50 STEP 2375 H=2375:00 +CPU= 15.118
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2020050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0280
(argv4) batchid: 989
(argv5) wuid: 12205924
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/7
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12205924
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/7/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/7/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_d2474c9f31ba6698cc4588027b200b2a to: /var/lib/boinc-client/slots/7/oifs_43r3_ps_0280_2020050100_123_989_12205924.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/7/oifs_43r3_ps_0280_2020050100_123_989_12205924.zip
ic_ancil_file: ic_ancil_12205924
ifsdata_file: ifsdata_12205924
climate_data_file: clim_data_12205924
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_517fd04b1f155054a971849706955cdc to: /var/lib/boinc-client/slots/7/ic_ancil_12205924.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/7/ic_ancil_12205924.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_54d06e79c6edf170392304f793ea3c10 to: /var/lib/boinc-client/slots/7/ifsdata/ifsdata_12205924.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/7/ifsdata/ifsdata_12205924.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/7/159l_2/clim_data_12205924.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/7/159l_2/clim_data_12205924.zip
Checking for progress XML file: /var/lib/boinc-client/slots/7/progress_file_12205924.xml
Opened progress file ok : /var/lib/boinc-client/slots/7/progress_file_12205924.xml
-- Model is restarting --
Adjusting last_iter, 2376, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/7/progress_file_12205924.xml
last_cpu_time: 46003
upload_file_number: 98
last_iter: 2375
last_upload: 8467200
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0280_2020050100_123_989_12205924_1_r512416711
The child process has been launched with process id: 1438
Executing the command: /var/lib/boinc-client/slots/7/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:W31Ub20:1:1:1438:1438] [20230114:114824:1673693304:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:W31Ub20:1:1:1438:1438] [20230114:114824:1673693304:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:W31Ub20:1:1:1438:1438] [20230114:114824:1673693304:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:W31Ub20:1:1:1438:1438] [20230114:114824:1673693304:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:W31Ub20:1:1:1438:1438] [20230114:114824:1673693304:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:W31Ub20:1:1:1438:1438] [20230114:114824:1673693304:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:W31Ub20:1:1:1438:1438] [20230114:114824:1673693304:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:W31Ub20:1:1:1438:1438] [20230114:114824:1673693304:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:W31Ub20:1:1:1438:1438] [20230114:114824:1673693304:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:W31Ub20:1:1:1438:1438] [20230114:114824:1673693304:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:W31Ub20:1:1:1438:1438] [20230114:114824:1673693304:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:W31Ub20:1:1:1438:1438] [20230114:114824:1673693304:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:W31Ub20:1:1:1438:1438] [20230114:114824:1673693304:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:W31Ub20:1:1:1438:1438] [20230114:114824:1673693304:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:W31Ub20:1:1:1438:1438] [20230114:114824:1673693304:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:W31Ub20:1:1:1438:1438] [20230114:114824:1673693304:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:W31Ub20:1:1:1438:1438] [20230114:114824:1673693304:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:W31Ub20:1:1:1438:1438] [20230114:114824:1673693304:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:W31Ub20:1:1:1438:1438] [20230114:114824:1673693304:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:W31Ub20:1:1:1438:1438] [20230114:114824:1673693304:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:W31Ub20:1:1:1438:1438] [20230114:114824:1673693304:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:W31Ub20:1:1:1438:1438] [20230114:114824:1673693304:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:W31Ub20:1:1:1438:1438] [20230114:114824:1673693304:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:W31Ub20:1:1:1438:1438] [20230114:114824:1673693304:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:W31Ub20:1:1:1438:1438] [20230114:114824:1673693304:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:W31Ub20:1:1:1438:1438] [20230114:114824:1673693304:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:W31Ub20:1:1:1438:1438] [20230114:114824:1673693304:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:W31Ub20:1:1:1438:1438] [20230114:114824:1673693304:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:W31Ub20:1:1:1438:1438] [20230114:114824:1673693304:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:W31Ub20:1:1:1438:1438] [20230114:114824:1673693304:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
ECCODES ERROR   :  IO ERROR: Inappropriate ioctl for device (Inappropriate ioctl for device)
 GRIB_READ_BYTES_INT        50000                       4  FAILED         -11
 GRIB_API ERROR MSG: Input output problem
MPL_ABORT: CALLED FROM PROCESSOR      1 THRD     1
 MPL_ABORT: THRD           1   GRIB_READ_BYTES_INT FAILED
[EC_DRHOOK:W31Ub20:1:1:1438:1438] [20230114:114825:1673693305:1.621] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3843] 1135 MB (maxheap), 361 MB (maxrss), 0 MB (maxstack)
[EC_DRHOOK:W31Ub20:1:1:1438:1438] [20230114:114825:1673693305:1.621] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :  MASTER 
[EC_DRHOOK:W31Ub20:1:1:1438:1438] [20230114:114825:1673693305:1.621] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :   CNT0 
[EC_DRHOOK:W31Ub20:1:1:1438:1438] [20230114:114825:1673693305:1.621] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :    CNT1 
[EC_DRHOOK:W31Ub20:1:1:1438:1438] [20230114:114825:1673693305:1.621] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :     CNT2 
[EC_DRHOOK:W31Ub20:1:1:1438:1438] [20230114:114825:1673693305:1.621] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :      CNT3 
[EC_DRHOOK:W31Ub20:1:1:1438:1438] [20230114:114825:1673693305:1.621] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :       RERESF 
[EC_DRHOOK:W31Ub20:1:1:1438:1438] [20230114:114825:1673693305:1.621] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :        IOSTREAM_MIX:IO_GET 
[EC_DRHOOK:W31Ub20:1:1:1438:1438] [20230114:114825:1673693305:1.621] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :         IOSTREAM_MIX:READ_RECORD 
[EC_DRHOOK:W31Ub20:1:1:1438:1438] [20230114:114825:1673693305:1.621] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :          >MPL-IOSTREAM READ_RECORD ( 650) 
[EC_DRHOOK:W31Ub20:1:1:1438:1438] [20230114:114825:1673693305:1.624] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :           GRIB_API:IGRIB_READ_BYTES_INT 
 SDL_TRACEBACK: Calling INTEL_TRBK, THRD =            1
 Process            1  thread            1  calling linux_trbk from intel_trbk()
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:240] Backtrace(s) for program '/var/lib/boinc-client/slots/7/oifs_43r3_model.exe' : sigcontextptr=0x7ffcea0cff60
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:277] Backtrace (size = 16) with plain hex-dump
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:340] [0]: [0x839273] : 0x839273
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:340] [1]: [0x839879] : 0x839879
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:340] [2]: [0x8c2957] : 0x8c2957
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:340] [3]: [0x8c3229] : 0x8c3229
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:340] [4]: [0xa044bc] : 0xa044bc
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:340] [5]: [0x9e49b1] : 0x9e49b1
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:340] [6]: [0x9d8ba9] : 0x9d8ba9
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:340] [7]: [0x54b4a0] : 0x54b4a0
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:340] [8]: [0x546a18] : 0x546a18
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:340] [9]: [0x546412] : 0x546412
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:340] [10]: [0x545e28] : 0x545e28
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:340] [11]: [0x40708d] : 0x40708d
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:340] [12]: [0x40220f] : 0x40220f
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:340] [13]: [0x4021a2] : 0x4021a2
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:340] [14]: [0x1dca390] : 0x1dca390
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:340] [15]: [0x40206e] : 0x40206e
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:370] End of backtrace(s)
 SDL_TRACEBACK: Done INTEL_TRBK, THRD =            1
abort: 
The child process terminated with status: 0
..Failed, model did not complete successfully

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:19:07 1532184 22297206 oifs_43r3_ps_0280_2020050100_123_989_12205924_1 7,948,800 42,972 0.0054
09 May 2023 16:19:07 1532184 22297206 oifs_43r3_ps_0280_2020050100_123_989_12205924_1 7,084,800 38,485 0.0054
09 May 2023 16:19:07 1532184 22297206 oifs_43r3_ps_0280_2020050100_123_989_12205924_1 7,084,800 38,485 0.0054
09 May 2023 16:19:07 1532184 22297206 oifs_43r3_ps_0280_2020050100_123_989_12205924_1 6,220,800 34,009 0.0055
09 May 2023 16:18:27 1532184 22297206 oifs_43r3_ps_0280_2020050100_123_989_12205924_1 5,356,800 29,523 0.0055
09 May 2023 16:18:27 1532184 22297206 oifs_43r3_ps_0280_2020050100_123_989_12205924_1 5,356,800 29,523 0.0055
09 May 2023 16:18:24 1532184 22297206 oifs_43r3_ps_0280_2020050100_123_989_12205924_1 4,492,800 25,028 0.0056
09 May 2023 16:18:21 1532184 22297206 oifs_43r3_ps_0280_2020050100_123_989_12205924_1 3,628,800 20,523 0.0057
09 May 2023 16:18:21 1532184 22297206 oifs_43r3_ps_0280_2020050100_123_989_12205924_1 3,628,800 20,523 0.0057
09 May 2023 16:18:15 1532184 22297206 oifs_43r3_ps_0280_2020050100_123_989_12205924_1 2,764,800 15,732 0.0057
09 May 2023 16:18:15 1532184 22297206 oifs_43r3_ps_0280_2020050100_123_989_12205924_1 2,764,800 15,732 0.0057
09 May 2023 16:18:15 1532184 22297206 oifs_43r3_ps_0280_2020050100_123_989_12205924_1 1,900,800 10,867 0.0057
09 May 2023 16:18:15 1532184 22297206 oifs_43r3_ps_0280_2020050100_123_989_12205924_1 1,900,800 10,867 0.0057
09 May 2023 16:18:07 1532184 22297206 oifs_43r3_ps_0280_2020050100_123_989_12205924_1 864,000 4,952 0.0057
09 May 2023 16:18:06 1532184 22297206 oifs_43r3_ps_0280_2020050100_123_989_12205924_1 864,000 4,952 0.0057


©2024 cpdn.org