climateprediction.net home page
Task 22269626

Task 22269626

Name oifs_43r3_ps_0738_1998050100_123_967_12184382_0
Workunit 12184382
Created 22 Dec 2022, 16:59:15 UTC
Sent 12 Jan 2023, 16:04:55 UTC
Report deadline 11 Feb 2023, 16:04:55 UTC
Received 14 Jan 2023, 10:53:56 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 1 (0x00000001) Unknown error code
Computer ID 1532184
Run time 12 hours 49 min 52 sec
CPU time 12 hours 47 min 25 sec
Validate state Invalid
Credit 9,918.72
Device peak FLOPS 6.86 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,419.17 MB
Peak swap size 4,978.07 MB
Peak disk usage 3,245.79 MB
Stderr
<core_client_version>7.16.6</core_client_version>
<![CDATA[
<message>
process exited with code 1 (0x1, -255)</message>
<stderr_txt>
o the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMGGhq0f+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMSHhq0f+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMUAhq0f+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMGGhq0f+001860
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMSHhq0f+001860
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMUAhq0f+001860
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0738_1998050100_123_967_12184382_0_r697574241_77.zip
Uploading the intermediate file: upload_file_77.zip
  00:33:49 STEP 1873 H=1873:00 +CPU= 15.280
  00:34:05 STEP 1874 H=1874:00 +CPU= 15.776
  00:34:29 STEP 1875 H=1875:00 +CPU= 24.165
  00:34:45 STEP 1876 H=1876:00 +CPU= 15.642
  00:35:00 STEP 1877 H=1877:00 +CPU= 15.211
  00:35:25 STEP 1878 H=1878:00 +CPU= 24.723
  00:35:40 STEP 1879 H=1879:00 +CPU= 15.284
  00:35:56 STEP 1880 H=1880:00 +CPU= 15.664
  00:36:20 STEP 1881 H=1881:00 +CPU= 24.158
  00:36:36 STEP 1882 H=1882:00 +CPU= 15.740
  00:36:51 STEP 1883 H=1883:00 +CPU= 15.250
  00:37:18 STEP 1884 H=1884:00 +CPU= 26.774
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001884
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001884
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001884
  00:37:33 STEP 1885 H=1885:00 +CPU= 15.356
  00:37:48 STEP 1886 H=1886:00 +CPU= 15.422
  00:38:12 STEP 1887 H=1887:00 +CPU= 24.052
  00:38:28 STEP 1888 H=1888:00 +CPU= 15.681
  00:38:43 STEP 1889 H=1889:00 +CPU= 15.123
  00:39:08 STEP 1890 H=1890:00 +CPU= 24.404
  00:39:23 STEP 1891 H=1891:00 +CPU= 15.089
  00:39:38 STEP 1892 H=1892:00 +CPU= 15.430
  00:40:02 STEP 1893 H=1893:00 +CPU= 24.107
  00:40:18 STEP 1894 H=1894:00 +CPU= 15.673
  00:40:34 STEP 1895 H=1895:00 +CPU= 15.802
  00:41:02 STEP 1896 H=1896:00 +CPU= 28.292
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001896
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001896
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMGGhq0f+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMSHhq0f+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMUAhq0f+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMGGhq0f+001884
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMSHhq0f+001884
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMUAhq0f+001884
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0738_1998050100_123_967_12184382_0_r697574241_78.zip
Uploading the intermediate file: upload_file_78.zip
  00:41:17 STEP 1897 H=1897:00 +CPU= 15.210
  00:41:33 STEP 1898 H=1898:00 +CPU= 15.445
  00:41:57 STEP 1899 H=1899:00 +CPU= 24.013
  00:42:13 STEP 1900 H=1900:00 +CPU= 15.731
  00:42:28 STEP 1901 H=1901:00 +CPU= 15.222
  00:42:52 STEP 1902 H=1902:00 +CPU= 24.542
  00:43:08 STEP 1903 H=1903:00 +CPU= 15.409
  00:43:23 STEP 1904 H=1904:00 +CPU= 15.603
  00:43:47 STEP 1905 H=1905:00 +CPU= 24.017
  00:44:03 STEP 1906 H=1906:00 +CPU= 15.675
  00:44:18 STEP 1907 H=1907:00 +CPU= 15.114
  00:44:45 STEP 1908 H=1908:00 +CPU= 26.499
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001908
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001908
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001908
  00:45:00 STEP 1909 H=1909:00 +CPU= 15.363
  00:45:16 STEP 1910 H=1910:00 +CPU= 15.586
  00:45:40 STEP 1911 H=1911:00 +CPU= 24.244
  00:45:56 STEP 1912 H=1912:00 +CPU= 15.843
  00:46:11 STEP 1913 H=1913:00 +CPU= 15.167
  00:46:36 STEP 1914 H=1914:00 +CPU= 24.629
  00:46:51 STEP 1915 H=1915:00 +CPU= 15.263
  00:47:06 STEP 1916 H=1916:00 +CPU= 15.555
  00:47:30 STEP 1917 H=1917:00 +CPU= 24.081
  00:47:46 STEP 1918 H=1918:00 +CPU= 15.697
  00:48:02 STEP 1919 H=1919:00 +CPU= 15.722
  00:48:30 STEP 1920 H=1920:00 +CPU= 28.319
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001920
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001920
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMGGhq0f+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMSHhq0f+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMUAhq0f+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMGGhq0f+001908
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMSHhq0f+001908
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMUAhq0f+001908
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0738_1998050100_123_967_12184382_0_r697574241_79.zip
Uploading the intermediate file: upload_file_79.zip
  00:48:45 STEP 1921 H=1921:00 +CPU= 15.283
  00:49:01 STEP 1922 H=1922:00 +CPU= 15.578
  00:49:25 STEP 1923 H=1923:00 +CPU= 24.129
  00:49:41 STEP 1924 H=1924:00 +CPU= 15.660
  00:49:56 STEP 1925 H=1925:00 +CPU= 15.134
  00:50:21 STEP 1926 H=1926:00 +CPU= 24.528
  00:50:36 STEP 1927 H=1927:00 +CPU= 15.229
  00:50:51 STEP 1928 H=1928:00 +CPU= 15.658
  00:51:15 STEP 1929 H=1929:00 +CPU= 24.079
  00:51:31 STEP 1930 H=1930:00 +CPU= 15.778
  00:51:46 STEP 1931 H=1931:00 +CPU= 15.166
  00:52:13 STEP 1932 H=1932:00 +CPU= 26.476
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001932
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001932
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001932
  00:52:28 STEP 1933 H=1933:00 +CPU= 15.271
  00:52:44 STEP 1934 H=1934:00 +CPU= 15.510
  00:53:08 STEP 1935 H=1935:00 +CPU= 24.088
  00:53:23 STEP 1936 H=1936:00 +CPU= 15.693
  00:53:39 STEP 1937 H=1937:00 +CPU= 15.200
  00:54:03 STEP 1938 H=1938:00 +CPU= 24.323
  00:54:18 STEP 1939 H=1939:00 +CPU= 15.300
  00:54:34 STEP 1940 H=1940:00 +CPU= 15.629
  00:54:58 STEP 1941 H=1941:00 +CPU= 24.066
  00:55:14 STEP 1942 H=1942:00 +CPU= 15.536
  00:55:29 STEP 1943 H=1943:00 +CPU= 15.698
  00:55:58 STEP 1944 H=1944:00 +CPU= 28.505
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001944
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001944
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001944
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMGGhq0f+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMSHhq0f+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMUAhq0f+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMGGhq0f+001932
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMSHhq0f+001932
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMUAhq0f+001932
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0738_1998050100_123_967_12184382_0_r697574241_80.zip
Uploading the intermediate file: upload_file_80.zip
  00:56:13 STEP 1945 H=1945:00 +CPU= 15.281
  00:56:29 STEP 1946 H=1946:00 +CPU= 15.702
  00:56:53 STEP 1947 H=1947:00 +CPU= 24.446
  00:57:09 STEP 1948 H=1948:00 +CPU= 15.714
  00:57:24 STEP 1949 H=1949:00 +CPU= 15.241
  00:57:49 STEP 1950 H=1950:00 +CPU= 24.542
  00:58:04 STEP 1951 H=1951:00 +CPU= 15.354
  00:58:20 STEP 1952 H=1952:00 +CPU= 15.607
  00:58:44 STEP 1953 H=1953:00 +CPU= 24.127
  00:59:00 STEP 1954 H=1954:00 +CPU= 15.715
  00:59:15 STEP 1955 H=1955:00 +CPU= 15.333
  00:59:41 STEP 1956 H=1956:00 +CPU= 26.532
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001956
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001956
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001956
  00:59:57 STEP 1957 H=1957:00 +CPU= 15.248
  01:00:12 STEP 1958 H=1958:00 +CPU= 15.598
  01:00:37 STEP 1959 H=1959:00 +CPU= 24.206
  01:00:52 STEP 1960 H=1960:00 +CPU= 15.779
  01:01:08 STEP 1961 H=1961:00 +CPU= 15.284
  01:01:32 STEP 1962 H=1962:00 +CPU= 24.691
  01:01:48 STEP 1963 H=1963:00 +CPU= 15.377
  01:02:03 STEP 1964 H=1964:00 +CPU= 15.643
  01:02:27 STEP 1965 H=1965:00 +CPU= 24.122
  01:02:43 STEP 1966 H=1966:00 +CPU= 15.833
  01:02:59 STEP 1967 H=1967:00 +CPU= 15.743
  01:03:28 STEP 1968 H=1968:00 +CPU= 28.630
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001968
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001968
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001968
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMGGhq0f+001944
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMSHhq0f+001944
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMUAhq0f+001944
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMGGhq0f+001956
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMSHhq0f+001956
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMUAhq0f+001956
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0738_1998050100_123_967_12184382_0_r697574241_81.zip
Uploading the intermediate file: upload_file_81.zip
  01:03:43 STEP 1969 H=1969:00 +CPU= 15.339
Uploading trickle at timestep: 7084800
  01:03:59 STEP 1970 H=1970:00 +CPU= 15.694
  01:04:23 STEP 1971 H=1971:00 +CPU= 24.046
  01:04:38 STEP 1972 H=1972:00 +CPU= 15.702
  01:04:54 STEP 1973 H=1973:00 +CPU= 15.364
  01:05:19 STEP 1974 H=1974:00 +CPU= 24.713
  01:05:34 STEP 1975 H=1975:00 +CPU= 15.323
  01:05:49 STEP 1976 H=1976:00 +CPU= 15.610
  01:06:13 STEP 1977 H=1977:00 +CPU= 23.975
  01:06:29 STEP 1978 H=1978:00 +CPU= 15.728
  01:06:45 STEP 1979 H=1979:00 +CPU= 15.389
  01:07:11 STEP 1980 H=1980:00 +CPU= 26.617
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001980
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001980
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001980
  01:07:26 STEP 1981 H=1981:00 +CPU= 15.235
  01:07:42 STEP 1982 H=1982:00 +CPU= 15.586
  01:08:06 STEP 1983 H=1983:00 +CPU= 24.314
  01:08:22 STEP 1984 H=1984:00 +CPU= 15.706
  01:08:37 STEP 1985 H=1985:00 +CPU= 15.146
  01:09:02 STEP 1986 H=1986:00 +CPU= 24.679
  01:09:17 STEP 1987 H=1987:00 +CPU= 15.208
  01:09:33 STEP 1988 H=1988:00 +CPU= 15.556
  01:09:57 STEP 1989 H=1989:00 +CPU= 24.108
  01:10:12 STEP 1990 H=1990:00 +CPU= 15.743
  01:10:28 STEP 1991 H=1991:00 +CPU= 15.690
  01:10:57 STEP 1992 H=1992:00 +CPU= 28.429
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001992
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001992
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001992
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMGGhq0f+001968
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMSHhq0f+001968
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMUAhq0f+001968
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMGGhq0f+001980
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMSHhq0f+001980
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMUAhq0f+001980
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0738_1998050100_123_967_12184382_0_r697574241_82.zip
Uploading the intermediate file: upload_file_82.zip
  01:11:12 STEP 1993 H=1993:00 +CPU= 15.344
  01:11:27 STEP 1994 H=1994:00 +CPU= 15.534
  01:11:52 STEP 1995 H=1995:00 +CPU= 24.237
  01:12:07 STEP 1996 H=1996:00 +CPU= 15.762
  01:12:23 STEP 1997 H=1997:00 +CPU= 15.205
  01:12:47 STEP 1998 H=1998:00 +CPU= 24.651
  01:13:03 STEP 1999 H=1999:00 +CPU= 15.327
  01:13:18 STEP 2000 H=2000:00 +CPU= 15.523
  01:13:42 STEP 2001 H=2001:00 +CPU= 24.095
  01:13:58 STEP 2002 H=2002:00 +CPU= 15.794
  01:14:14 STEP 2003 H=2003:00 +CPU= 15.425
  01:14:40 STEP 2004 H=2004:00 +CPU= 26.684
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+002004
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+002004
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+002004
  01:14:56 STEP 2005 H=2005:00 +CPU= 15.306
  01:15:11 STEP 2006 H=2006:00 +CPU= 15.618
  01:15:35 STEP 2007 H=2007:00 +CPU= 24.083
  01:15:51 STEP 2008 H=2008:00 +CPU= 15.723
  01:16:06 STEP 2009 H=2009:00 +CPU= 15.081
  01:16:31 STEP 2010 H=2010:00 +CPU= 24.585
  01:16:46 STEP 2011 H=2011:00 +CPU= 15.419
  01:17:02 STEP 2012 H=2012:00 +CPU= 15.495
  01:17:26 STEP 2013 H=2013:00 +CPU= 24.053
  01:17:41 STEP 2014 H=2014:00 +CPU= 15.777
  01:17:57 STEP 2015 H=2015:00 +CPU= 15.695
  01:18:26 STEP 2016 H=2016:00 +CPU= 28.436
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+002016
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+002016
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+002016
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMGGhq0f+001992
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMSHhq0f+001992
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMUAhq0f+001992
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMGGhq0f+002004
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMSHhq0f+002004
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMUAhq0f+002004
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0738_1998050100_123_967_12184382_0_r697574241_83.zip
Uploading the intermediate file: upload_file_83.zip
  01:18:41 STEP 2017 H=2017:00 +CPU= 15.220
  01:18:56 STEP 2018 H=2018:00 +CPU= 15.595
  01:19:21 STEP 2019 H=2019:00 +CPU= 24.280
  01:19:37 STEP 2020 H=2020:00 +CPU= 15.846
  01:19:52 STEP 2021 H=2021:00 +CPU= 15.099
  01:20:16 STEP 2022 H=2022:00 +CPU= 24.684
  01:20:32 STEP 2023 H=2023:00 +CPU= 15.301
  01:20:47 STEP 2024 H=2024:00 +CPU= 15.538
  01:21:11 STEP 2025 H=2025:00 +CPU= 24.107
  01:21:27 STEP 2026 H=2026:00 +CPU= 15.721
  01:21:42 STEP 2027 H=2027:00 +CPU= 15.247
  01:22:09 STEP 2028 H=2028:00 +CPU= 26.455
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+002028
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+002028
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+002028
  01:22:24 STEP 2029 H=2029:00 +CPU= 15.287
  01:22:40 STEP 2030 H=2030:00 +CPU= 15.568
  01:23:04 STEP 2031 H=2031:00 +CPU= 24.152
  01:23:20 STEP 2032 H=2032:00 +CPU= 15.834
  01:23:35 STEP 2033 H=2033:00 +CPU= 15.158
  01:23:59 STEP 2034 H=2034:00 +CPU= 24.525
  01:24:14 STEP 2035 H=2035:00 +CPU= 15.218
  01:24:30 STEP 2036 H=2036:00 +CPU= 15.458
  01:24:54 STEP 2037 H=2037:00 +CPU= 23.977
  01:25:10 STEP 2038 H=2038:00 +CPU= 15.722
  01:25:25 STEP 2039 H=2039:00 +CPU= 15.679
  01:25:54 STEP 2040 H=2040:00 +CPU= 28.256
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+002040
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+002040
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+002040
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMGGhq0f+002016
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMSHhq0f+002016
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMUAhq0f+002016
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMGGhq0f+002028
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMSHhq0f+002028
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMUAhq0f+002028
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0738_1998050100_123_967_12184382_0_r697574241_84.zip
Uploading the intermediate file: upload_file_84.zip
  01:26:09 STEP 2041 H=2041:00 +CPU= 15.122
  01:26:24 STEP 2042 H=2042:00 +CPU= 15.551
  01:26:48 STEP 2043 H=2043:00 +CPU= 23.942
  01:27:04 STEP 2044 H=2044:00 +CPU= 15.619
  01:27:19 STEP 2045 H=2045:00 +CPU= 15.086
  01:27:44 STEP 2046 H=2046:00 +CPU= 24.564
  01:27:59 STEP 2047 H=2047:00 +CPU= 15.253
  01:28:14 STEP 2048 H=2048:00 +CPU= 15.495
  01:28:38 STEP 2049 H=2049:00 +CPU= 24.120
  01:28:54 STEP 2050 H=2050:00 +CPU= 15.797
  01:29:10 STEP 2051 H=2051:00 +CPU= 15.378
  01:29:36 STEP 2052 H=2052:00 +CPU= 26.420
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+002052
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+002052
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+002052
  01:29:51 STEP 2053 H=2053:00 +CPU= 15.335
  01:30:07 STEP 2054 H=2054:00 +CPU= 15.601
  01:30:31 STEP 2055 H=2055:00 +CPU= 24.125
  01:30:47 STEP 2056 H=2056:00 +CPU= 15.728
  01:31:02 STEP 2057 H=2057:00 +CPU= 15.111
  01:31:26 STEP 2058 H=2058:00 +CPU= 24.530
  01:31:42 STEP 2059 H=2059:00 +CPU= 15.219
  01:31:57 STEP 2060 H=2060:00 +CPU= 15.490
  01:32:21 STEP 2061 H=2061:00 +CPU= 24.126
  01:32:37 STEP 2062 H=2062:00 +CPU= 15.574
  01:32:53 STEP 2063 H=2063:00 +CPU= 15.745
  01:33:21 STEP 2064 H=2064:00 +CPU= 28.433
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+002064
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+002064
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+002064
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMGGhq0f+002040
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMSHhq0f+002040
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMUAhq0f+002040
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMGGhq0f+002052
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMSHhq0f+002052
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMUAhq0f+002052
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0738_1998050100_123_967_12184382_0_r697574241_85.zip
Uploading the intermediate file: upload_file_85.zip
  01:33:36 STEP 2065 H=2065:00 +CPU= 15.200
  01:33:52 STEP 2066 H=2066:00 +CPU= 15.666
  01:34:16 STEP 2067 H=2067:00 +CPU= 24.233
  01:34:32 STEP 2068 H=2068:00 +CPU= 15.792
  01:34:47 STEP 2069 H=2069:00 +CPU= 15.277
  01:35:12 STEP 2070 H=2070:00 +CPU= 24.543
  01:35:27 STEP 2071 H=2071:00 +CPU= 15.226
  01:35:43 STEP 2072 H=2072:00 +CPU= 15.577
  01:36:07 STEP 2073 H=2073:00 +CPU= 24.081
  01:36:22 STEP 2074 H=2074:00 +CPU= 15.723
  01:36:38 STEP 2075 H=2075:00 +CPU= 15.310
  01:37:04 STEP 2076 H=2076:00 +CPU= 26.402
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+002076
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+002076
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+002076
  01:37:19 STEP 2077 H=2077:00 +CPU= 15.309
  01:37:35 STEP 2078 H=2078:00 +CPU= 15.667
  01:37:59 STEP 2079 H=2079:00 +CPU= 24.159
  01:38:15 STEP 2080 H=2080:00 +CPU= 15.787
  01:38:30 STEP 2081 H=2081:00 +CPU= 15.098
  01:38:54 STEP 2082 H=2082:00 +CPU= 24.283
  01:39:10 STEP 2083 H=2083:00 +CPU= 15.224
  01:39:25 STEP 2084 H=2084:00 +CPU= 15.527
  01:39:49 STEP 2085 H=2085:00 +CPU= 24.082
  01:40:05 STEP 2086 H=2086:00 +CPU= 15.665
  01:40:21 STEP 2087 H=2087:00 +CPU= 15.744
  01:40:49 STEP 2088 H=2088:00 +CPU= 28.375
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+002088
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+002088
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+002088
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMGGhq0f+002064
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMSHhq0f+002064
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMUAhq0f+002064
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMGGhq0f+002076
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMSHhq0f+002076
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMUAhq0f+002076
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0738_1998050100_123_967_12184382_0_r697574241_86.zip
Uploading the intermediate file: upload_file_86.zip
  01:41:04 STEP 2089 H=2089:00 +CPU= 15.346
  01:41:20 STEP 2090 H=2090:00 +CPU= 15.424
  01:41:44 STEP 2091 H=2091:00 +CPU= 24.050
  01:42:00 STEP 2092 H=2092:00 +CPU= 15.649
  01:42:15 STEP 2093 H=2093:00 +CPU= 15.134
  01:42:39 STEP 2094 H=2094:00 +CPU= 24.670
  01:42:55 STEP 2095 H=2095:00 +CPU= 15.282
  01:43:10 STEP 2096 H=2096:00 +CPU= 15.705
  01:43:35 STEP 2097 H=2097:00 +CPU= 24.228
  01:43:50 STEP 2098 H=2098:00 +CPU= 15.648
  01:44:06 STEP 2099 H=2099:00 +CPU= 15.311
  01:44:32 STEP 2100 H=2100:00 +CPU= 26.310
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+002100
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+002100
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+002100
  01:44:47 STEP 2101 H=2101:00 +CPU= 15.264
  01:45:03 STEP 2102 H=2102:00 +CPU= 15.599
  01:45:27 STEP 2103 H=2103:00 +CPU= 24.211
  01:45:43 STEP 2104 H=2104:00 +CPU= 15.839
  01:45:58 STEP 2105 H=2105:00 +CPU= 15.226
  01:46:23 STEP 2106 H=2106:00 +CPU= 24.567
  01:46:38 STEP 2107 H=2107:00 +CPU= 15.173
  01:46:53 STEP 2108 H=2108:00 +CPU= 15.531
  01:47:17 STEP 2109 H=2109:00 +CPU= 24.130
  01:47:33 STEP 2110 H=2110:00 +CPU= 15.709
  01:47:49 STEP 2111 H=2111:00 +CPU= 15.773
  01:48:17 STEP 2112 H=2112:00 +CPU= 28.493
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+002112
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+002112
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+002112
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMGGhq0f+002088
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMSHhq0f+002088
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMUAhq0f+002088
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMGGhq0f+002100
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMSHhq0f+002100
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMUAhq0f+002100
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0738_1998050100_123_967_12184382_0_r697574241_87.zip
Uploading the intermediate file: upload_file_87.zip
  01:48:33 STEP 2113 H=2113:00 +CPU= 15.252
  01:48:48 STEP 2114 H=2114:00 +CPU= 15.541
  01:49:12 STEP 2115 H=2115:00 +CPU= 24.078
  01:49:28 STEP 2116 H=2116:00 +CPU= 15.867
  01:49:43 STEP 2117 H=2117:00 +CPU= 15.222
  01:50:08 STEP 2118 H=2118:00 +CPU= 24.331
  01:50:23 STEP 2119 H=2119:00 +CPU= 15.314
  01:50:39 STEP 2120 H=2120:00 +CPU= 15.540
  01:51:03 STEP 2121 H=2121:00 +CPU= 23.993
  01:51:18 STEP 2122 H=2122:00 +CPU= 15.628
  01:51:33 STEP 2123 H=2123:00 +CPU= 15.050
  01:52:00 STEP 2124 H=2124:00 +CPU= 26.380
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+002124
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+002124
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+002124
  01:52:15 STEP 2125 H=2125:00 +CPU= 15.181
  01:52:30 STEP 2126 H=2126:00 +CPU= 15.457
  01:52:55 STEP 2127 H=2127:00 +CPU= 24.171
  01:53:10 STEP 2128 H=2128:00 +CPU= 15.676
  01:53:25 STEP 2129 H=2129:00 +CPU= 15.015
  01:53:50 STEP 2130 H=2130:00 +CPU= 24.571
  01:54:05 STEP 2131 H=2131:00 +CPU= 15.261
  01:54:21 STEP 2132 H=2132:00 +CPU= 15.579
  01:54:45 STEP 2133 H=2133:00 +CPU= 24.046
  01:55:00 STEP 2134 H=2134:00 +CPU= 15.754
  01:55:16 STEP 2135 H=2135:00 +CPU= 15.727
  01:55:45 STEP 2136 H=2136:00 +CPU= 28.548
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+002136
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+002136
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+002136
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMGGhq0f+002112
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMSHhq0f+002112
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMUAhq0f+002112
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMGGhq0f+002124
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMSHhq0f+002124
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMUAhq0f+002124
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0738_1998050100_123_967_12184382_0_r697574241_88.zip
Uploading the intermediate file: upload_file_88.zip
  01:56:00 STEP 2137 H=2137:00 +CPU= 15.269
  01:56:16 STEP 2138 H=2138:00 +CPU= 15.556
  01:56:40 STEP 2139 H=2139:00 +CPU= 24.137
  01:56:55 STEP 2140 H=2140:00 +CPU= 15.631
  01:57:11 STEP 2141 H=2141:00 +CPU= 15.236
  01:57:35 STEP 2142 H=2142:00 +CPU= 24.711
  01:57:51 STEP 2143 H=2143:00 +CPU= 15.366
  01:58:06 STEP 2144 H=2144:00 +CPU= 15.611
  01:58:30 STEP 2145 H=2145:00 +CPU= 24.061
  01:58:46 STEP 2146 H=2146:00 +CPU= 15.751
  01:59:01 STEP 2147 H=2147:00 +CPU= 15.318
  01:59:28 STEP 2148 H=2148:00 +CPU= 26.477
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+002148
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+002148
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+002148
  01:59:43 STEP 2149 H=2149:00 +CPU= 15.195
  01:59:59 STEP 2150 H=2150:00 +CPU= 15.620
  02:00:23 STEP 2151 H=2151:00 +CPU= 24.010
  02:00:38 STEP 2152 H=2152:00 +CPU= 15.716
  02:00:54 STEP 2153 H=2153:00 +CPU= 15.214
  02:01:18 STEP 2154 H=2154:00 +CPU= 24.601
  02:01:34 STEP 2155 H=2155:00 +CPU= 15.264
  02:01:49 STEP 2156 H=2156:00 +CPU= 15.596
  02:02:13 STEP 2157 H=2157:00 +CPU= 23.988
  02:02:29 STEP 2158 H=2158:00 +CPU= 15.667
  02:02:44 STEP 2159 H=2159:00 +CPU= 15.668
  02:03:13 STEP 2160 H=2160:00 +CPU= 28.409
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+002160
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+002160
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+002160
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMGGhq0f+002136
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMSHhq0f+002136
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMUAhq0f+002136
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMGGhq0f+002148
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMSHhq0f+002148
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMUAhq0f+002148
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0738_1998050100_123_967_12184382_0_r697574241_89.zip
Uploading the intermediate file: upload_file_89.zip
  02:03:28 STEP 2161 H=2161:00 +CPU= 15.254
  02:03:44 STEP 2162 H=2162:00 +CPU= 15.518
  02:04:08 STEP 2163 H=2163:00 +CPU= 24.019
  02:04:23 STEP 2164 H=2164:00 +CPU= 15.578
  02:04:38 STEP 2165 H=2165:00 +CPU= 15.204
  02:05:03 STEP 2166 H=2166:00 +CPU= 24.636
  02:05:18 STEP 2167 H=2167:00 +CPU= 15.294
  02:05:34 STEP 2168 H=2168:00 +CPU= 15.825
  02:05:59 STEP 2169 H=2169:00 +CPU= 24.312
  02:06:14 STEP 2170 H=2170:00 +CPU= 15.754
  02:06:30 STEP 2171 H=2171:00 +CPU= 15.296
  02:06:56 STEP 2172 H=2172:00 +CPU= 26.352
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+002172
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+002172
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+002172
  02:07:11 STEP 2173 H=2173:00 +CPU= 15.397
  02:07:27 STEP 2174 H=2174:00 +CPU= 15.508
  02:07:51 STEP 2175 H=2175:00 +CPU= 24.108
  02:08:07 STEP 2176 H=2176:00 +CPU= 15.643
  02:08:22 STEP 2177 H=2177:00 +CPU= 15.083
  02:08:46 STEP 2178 H=2178:00 +CPU= 24.575
  02:09:01 STEP 2179 H=2179:00 +CPU= 15.203
  02:09:17 STEP 2180 H=2180:00 +CPU= 15.590
  02:09:41 STEP 2181 H=2181:00 +CPU= 24.093
  02:09:57 STEP 2182 H=2182:00 +CPU= 15.676
  02:10:13 STEP 2183 H=2183:00 +CPU= 15.661
  02:10:41 STEP 2184 H=2184:00 +CPU= 28.522
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+002184
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+002184
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+002184
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMGGhq0f+002160
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMSHhq0f+002160
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMUAhq0f+002160
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMGGhq0f+002172
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMSHhq0f+002172
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMUAhq0f+002172
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0738_1998050100_123_967_12184382_0_r697574241_90.zip
Uploading the intermediate file: upload_file_90.zip
  02:10:56 STEP 2185 H=2185:00 +CPU= 15.231
  02:11:12 STEP 2186 H=2186:00 +CPU= 15.568
  02:11:36 STEP 2187 H=2187:00 +CPU= 24.106
  02:11:52 STEP 2188 H=2188:00 +CPU= 15.691
  02:12:07 STEP 2189 H=2189:00 +CPU= 15.183
  02:12:32 STEP 2190 H=2190:00 +CPU= 24.769
  02:12:47 STEP 2191 H=2191:00 +CPU= 15.348
  02:13:03 STEP 2192 H=2192:00 +CPU= 15.672
  02:13:27 STEP 2193 H=2193:00 +CPU= 24.025
  02:13:42 STEP 2194 H=2194:00 +CPU= 15.768
  02:13:58 STEP 2195 H=2195:00 +CPU= 15.357
  02:14:24 STEP 2196 H=2196:00 +CPU= 26.675
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+002196
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+002196
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+002196
  02:14:40 STEP 2197 H=2197:00 +CPU= 15.342
  02:14:55 STEP 2198 H=2198:00 +CPU= 15.595
  02:15:19 STEP 2199 H=2199:00 +CPU= 23.966
  02:15:35 STEP 2200 H=2200:00 +CPU= 15.769
  02:15:50 STEP 2201 H=2201:00 +CPU= 15.230
  02:16:15 STEP 2202 H=2202:00 +CPU= 24.560
  02:16:30 STEP 2203 H=2203:00 +CPU= 15.237
  02:16:46 STEP 2204 H=2204:00 +CPU= 15.622
  02:17:10 STEP 2205 H=2205:00 +CPU= 24.070
  02:17:26 STEP 2206 H=2206:00 +CPU= 15.630
  02:17:41 STEP 2207 H=2207:00 +CPU= 15.710
  02:18:10 STEP 2208 H=2208:00 +CPU= 28.586
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+002208
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+002208
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+002208
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMGGhq0f+002184
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMSHhq0f+002184
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMUAhq0f+002184
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMGGhq0f+002196
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMSHhq0f+002196
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMUAhq0f+002196
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0738_1998050100_123_967_12184382_0_r697574241_91.zip
Uploading the intermediate file: upload_file_91.zip
  02:18:25 STEP 2209 H=2209:00 +CPU= 15.132
Uploading trickle at timestep: 7948800
  02:18:41 STEP 2210 H=2210:00 +CPU= 15.534
  02:19:05 STEP 2211 H=2211:00 +CPU= 24.132
  02:19:20 STEP 2212 H=2212:00 +CPU= 15.649
  02:19:35 STEP 2213 H=2213:00 +CPU= 15.066
  02:20:00 STEP 2214 H=2214:00 +CPU= 24.422
  02:20:15 STEP 2215 H=2215:00 +CPU= 15.124
  02:20:31 STEP 2216 H=2216:00 +CPU= 15.603
  02:20:55 STEP 2217 H=2217:00 +CPU= 24.057
  02:21:10 STEP 2218 H=2218:00 +CPU= 15.792
  02:21:26 STEP 2219 H=2219:00 +CPU= 15.343
  02:21:52 STEP 2220 H=2220:00 +CPU= 26.568
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+002220
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+002220
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+002220
  02:22:08 STEP 2221 H=2221:00 +CPU= 15.322
  02:22:23 STEP 2222 H=2222:00 +CPU= 15.628
  02:22:47 STEP 2223 H=2223:00 +CPU= 24.114
  02:23:03 STEP 2224 H=2224:00 +CPU= 15.627
  02:23:18 STEP 2225 H=2225:00 +CPU= 15.093
  02:23:43 STEP 2226 H=2226:00 +CPU= 24.443
  02:23:58 STEP 2227 H=2227:00 +CPU= 15.266
  02:24:13 STEP 2228 H=2228:00 +CPU= 15.647
  02:24:38 STEP 2229 H=2229:00 +CPU= 24.042
  02:24:53 STEP 2230 H=2230:00 +CPU= 15.594
  02:25:09 STEP 2231 H=2231:00 +CPU= 15.761
  02:25:37 STEP 2232 H=2232:00 +CPU= 28.473
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+002232
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+002232
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+002232
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMGGhq0f+002208
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMSHhq0f+002208
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMUAhq0f+002208
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMGGhq0f+002220
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMSHhq0f+002220
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMUAhq0f+002220
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0738_1998050100_123_967_12184382_0_r697574241_92.zip
Uploading the intermediate file: upload_file_92.zip
  02:25:53 STEP 2233 H=2233:00 +CPU= 15.322
  02:26:08 STEP 2234 H=2234:00 +CPU= 15.577
  02:26:32 STEP 2235 H=2235:00 +CPU= 24.151
  02:26:48 STEP 2236 H=2236:00 +CPU= 15.728
  02:27:03 STEP 2237 H=2237:00 +CPU= 15.180
  02:27:28 STEP 2238 H=2238:00 +CPU= 24.527
  02:27:43 STEP 2239 H=2239:00 +CPU= 15.305
  02:27:59 STEP 2240 H=2240:00 +CPU= 15.626
  02:28:23 STEP 2241 H=2241:00 +CPU= 23.994
  02:28:39 STEP 2242 H=2242:00 +CPU= 15.717
  02:28:54 STEP 2243 H=2243:00 +CPU= 15.362
  02:29:20 STEP 2244 H=2244:00 +CPU= 26.348
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+002244
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+002244
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+002244
  02:29:36 STEP 2245 H=2245:00 +CPU= 15.300
  02:29:51 STEP 2246 H=2246:00 +CPU= 15.662
  02:30:15 STEP 2247 H=2247:00 +CPU= 23.986
  02:30:31 STEP 2248 H=2248:00 +CPU= 15.688
  02:30:46 STEP 2249 H=2249:00 +CPU= 15.234
  02:31:11 STEP 2250 H=2250:00 +CPU= 24.671
  02:31:26 STEP 2251 H=2251:00 +CPU= 15.382
  02:31:42 STEP 2252 H=2252:00 +CPU= 15.539
  02:32:06 STEP 2253 H=2253:00 +CPU= 23.995
  02:32:21 STEP 2254 H=2254:00 +CPU= 15.696
  02:32:37 STEP 2255 H=2255:00 +CPU= 15.815
  02:33:05 STEP 2256 H=2256:00 +CPU= 27.924
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+002256
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+002256
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+002256
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMGGhq0f+002232
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMSHhq0f+002232
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMUAhq0f+002232
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMGGhq0f+002244
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMSHhq0f+002244
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMUAhq0f+002244
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0738_1998050100_123_967_12184382_0_r697574241_93.zip
Uploading the intermediate file: upload_file_93.zip
  02:33:20 STEP 2257 H=2257:00 +CPU= 14.937
  02:33:35 STEP 2258 H=2258:00 +CPU= 15.229
  02:34:00 STEP 2259 H=2259:00 +CPU= 24.157
  02:34:15 STEP 2260 H=2260:00 +CPU= 15.317
  02:34:30 STEP 2261 H=2261:00 +CPU= 14.859
  02:34:54 STEP 2262 H=2262:00 +CPU= 23.858
  02:35:08 STEP 2263 H=2263:00 +CPU= 14.696
  02:35:23 STEP 2264 H=2264:00 +CPU= 15.123
  02:35:47 STEP 2265 H=2265:00 +CPU= 23.557
  02:36:02 STEP 2266 H=2266:00 +CPU= 15.157
  02:36:17 STEP 2267 H=2267:00 +CPU= 14.766
  02:36:43 STEP 2268 H=2268:00 +CPU= 25.942
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+002268
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+002268
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+002268
  02:36:58 STEP 2269 H=2269:00 +CPU= 14.863
  02:37:13 STEP 2270 H=2270:00 +CPU= 15.314
  02:37:36 STEP 2271 H=2271:00 +CPU= 23.402
  02:37:52 STEP 2272 H=2272:00 +CPU= 15.125
  02:38:06 STEP 2273 H=2273:00 +CPU= 14.575
  02:38:30 STEP 2274 H=2274:00 +CPU= 23.896
  02:38:45 STEP 2275 H=2275:00 +CPU= 14.725
  02:39:00 STEP 2276 H=2276:00 +CPU= 15.191
  02:39:23 STEP 2277 H=2277:00 +CPU= 23.291
  02:39:38 STEP 2278 H=2278:00 +CPU= 15.015
  02:39:53 STEP 2279 H=2279:00 +CPU= 15.246
  02:40:21 STEP 2280 H=2280:00 +CPU= 27.614
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+002280
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+002280
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+002280
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMGGhq0f+002256
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMSHhq0f+002256
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMUAhq0f+002256
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMGGhq0f+002268
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMSHhq0f+002268
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMUAhq0f+002268
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0738_1998050100_123_967_12184382_0_r697574241_94.zip
Uploading the intermediate file: upload_file_94.zip
  02:40:36 STEP 2281 H=2281:00 +CPU= 14.994
  02:40:51 STEP 2282 H=2282:00 +CPU= 15.078
  02:41:15 STEP 2283 H=2283:00 +CPU= 23.503
  02:41:30 STEP 2284 H=2284:00 +CPU= 15.033
  02:41:44 STEP 2285 H=2285:00 +CPU= 14.669
  02:42:08 STEP 2286 H=2286:00 +CPU= 23.795
  02:42:23 STEP 2287 H=2287:00 +CPU= 14.829
  02:42:38 STEP 2288 H=2288:00 +CPU= 15.115
  02:43:02 STEP 2289 H=2289:00 +CPU= 23.498
  02:43:17 STEP 2290 H=2290:00 +CPU= 15.233
  02:43:32 STEP 2291 H=2291:00 +CPU= 14.778
  02:43:58 STEP 2292 H=2292:00 +CPU= 25.819
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+002292
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+002292
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+002292
  02:44:12 STEP 2293 H=2293:00 +CPU= 14.843
  02:44:27 STEP 2294 H=2294:00 +CPU= 15.112
  02:44:51 STEP 2295 H=2295:00 +CPU= 23.381
  02:45:06 STEP 2296 H=2296:00 +CPU= 15.266
  02:45:21 STEP 2297 H=2297:00 +CPU= 14.708
  02:45:45 STEP 2298 H=2298:00 +CPU= 23.878
  02:45:59 STEP 2299 H=2299:00 +CPU= 14.785
  02:46:14 STEP 2300 H=2300:00 +CPU= 14.974
  02:46:38 STEP 2301 H=2301:00 +CPU= 23.716
  02:46:53 STEP 2302 H=2302:00 +CPU= 15.278
  02:47:09 STEP 2303 H=2303:00 +CPU= 15.298
  02:47:36 STEP 2304 H=2304:00 +CPU= 27.513
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+002304
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+002304
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+002304
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMGGhq0f+002280
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMSHhq0f+002280
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMUAhq0f+002280
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMGGhq0f+002292
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMSHhq0f+002292
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMUAhq0f+002292
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0738_1998050100_123_967_12184382_0_r697574241_95.zip
Uploading the intermediate file: upload_file_95.zip
  02:47:51 STEP 2305 H=2305:00 +CPU= 14.760
  02:48:06 STEP 2306 H=2306:00 +CPU= 15.005
  02:48:29 STEP 2307 H=2307:00 +CPU= 23.391
  02:48:45 STEP 2308 H=2308:00 +CPU= 15.090
  02:48:59 STEP 2309 H=2309:00 +CPU= 14.668
  02:49:23 STEP 2310 H=2310:00 +CPU= 23.780
  02:49:38 STEP 2311 H=2311:00 +CPU= 14.767
  02:49:53 STEP 2312 H=2312:00 +CPU= 15.090
  02:50:16 STEP 2313 H=2313:00 +CPU= 23.381
  02:50:31 STEP 2314 H=2314:00 +CPU= 15.226
  02:50:46 STEP 2315 H=2315:00 +CPU= 14.699
  02:51:12 STEP 2316 H=2316:00 +CPU= 25.693
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+002316
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+002316
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+002316
  02:51:27 STEP 2317 H=2317:00 +CPU= 14.799
  02:51:42 STEP 2318 H=2318:00 +CPU= 15.025
  02:52:05 STEP 2319 H=2319:00 +CPU= 23.471
  02:52:20 STEP 2320 H=2320:00 +CPU= 15.197
  02:52:35 STEP 2321 H=2321:00 +CPU= 14.646
  02:52:59 STEP 2322 H=2322:00 +CPU= 23.955
  02:53:14 STEP 2323 H=2323:00 +CPU= 14.617
  02:53:29 STEP 2324 H=2324:00 +CPU= 14.991
  02:53:52 STEP 2325 H=2325:00 +CPU= 23.482
  02:54:07 STEP 2326 H=2326:00 +CPU= 15.066
  02:54:22 STEP 2327 H=2327:00 +CPU= 15.254
  02:54:50 STEP 2328 H=2328:00 +CPU= 27.573
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+002328
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+002328
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+002328
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMGGhq0f+002304
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMSHhq0f+002304
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMUAhq0f+002304
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMGGhq0f+002316
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMSHhq0f+002316
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMUAhq0f+002316
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0738_1998050100_123_967_12184382_0_r697574241_96.zip
Uploading the intermediate file: upload_file_96.zip
  02:55:05 STEP 2329 H=2329:00 +CPU= 14.862
  02:55:20 STEP 2330 H=2330:00 +CPU= 15.101
  02:55:43 STEP 2331 H=2331:00 +CPU= 23.269
  02:55:58 STEP 2332 H=2332:00 +CPU= 15.126
  02:56:13 STEP 2333 H=2333:00 +CPU= 14.738
  02:56:37 STEP 2334 H=2334:00 +CPU= 23.960
  02:56:52 STEP 2335 H=2335:00 +CPU= 14.713
  02:57:07 STEP 2336 H=2336:00 +CPU= 14.846
  02:57:30 STEP 2337 H=2337:00 +CPU= 23.371
  02:57:45 STEP 2338 H=2338:00 +CPU= 15.138
  02:58:00 STEP 2339 H=2339:00 +CPU= 14.707
  02:58:26 STEP 2340 H=2340:00 +CPU= 25.640
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+002340
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+002340
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+002340
  02:58:40 STEP 2341 H=2341:00 +CPU= 14.858
  02:58:55 STEP 2342 H=2342:00 +CPU= 15.101
  02:59:19 STEP 2343 H=2343:00 +CPU= 23.414
  02:59:34 STEP 2344 H=2344:00 +CPU= 15.254
  02:59:49 STEP 2345 H=2345:00 +CPU= 14.644
  03:00:12 STEP 2346 H=2346:00 +CPU= 23.687
  03:00:27 STEP 2347 H=2347:00 +CPU= 14.933
  03:00:42 STEP 2348 H=2348:00 +CPU= 15.042
  03:01:06 STEP 2349 H=2349:00 +CPU= 23.426
  03:01:21 STEP 2350 H=2350:00 +CPU= 15.310
  03:01:36 STEP 2351 H=2351:00 +CPU= 15.185
  03:02:05 STEP 2352 H=2352:00 +CPU= 28.362
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+002352
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+002352
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+002352
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMGGhq0f+002328
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMSHhq0f+002328
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMUAhq0f+002328
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMGGhq0f+002340
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMSHhq0f+002340
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382/ICMUAhq0f+002340
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0738_1998050100_123_967_12184382_0_r697574241_97.zip
Uploading the intermediate file: upload_file_97.zip
  03:02:20 STEP 2353 H=2353:00 +CPU= 14.715
  03:02:35 STEP 2354 H=2354:00 +CPU= 15.010
  03:02:58 STEP 2355 H=2355:00 +CPU= 23.241
  03:03:13 STEP 2356 H=2356:00 +CPU= 15.078
  03:03:28 STEP 2357 H=2357:00 +CPU= 14.642
  03:03:51 STEP 2358 H=2358:00 +CPU= 23.621
  03:04:06 STEP 2359 H=2359:00 +CPU= 14.799
  03:04:21 STEP 2360 H=2360:00 +CPU= 15.095
  03:04:44 STEP 2361 H=2361:00 +CPU= 23.262
  03:05:00 STEP 2362 H=2362:00 +CPU= 15.274
  03:05:14 STEP 2363 H=2363:00 +CPU= 14.710
  03:05:40 STEP 2364 H=2364:00 +CPU= 25.690
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+002364
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+002364
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+002364
  03:05:55 STEP 2365 H=2365:00 +CPU= 14.811
  03:06:10 STEP 2366 H=2366:00 +CPU= 15.229
  03:06:34 STEP 2367 H=2367:00 +CPU= 23.496
  03:06:49 STEP 2368 H=2368:00 +CPU= 15.157
  03:07:03 STEP 2369 H=2369:00 +CPU= 14.651
  03:07:27 STEP 2370 H=2370:00 +CPU= 23.810
  03:07:42 STEP 2371 H=2371:00 +CPU= 14.652
  03:07:57 STEP 2372 H=2372:00 +CPU= 14.973
  03:08:20 STEP 2373 H=2373:00 +CPU= 23.486
  03:08:36 STEP 2374 H=2374:00 +CPU= 15.223
  03:08:51 STEP 2375 H=2375:00 +CPU= 15.230
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1998050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0738
(argv4) batchid: 967
(argv5) wuid: 12184382
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/6
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184382
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/6/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/6/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_3c4bbdac5791c59faf9ba89fc86576c3 to: /var/lib/boinc-client/slots/6/oifs_43r3_ps_0738_1998050100_123_967_12184382.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/6/oifs_43r3_ps_0738_1998050100_123_967_12184382.zip
ic_ancil_file: ic_ancil_12184382
ifsdata_file: ifsdata_12184382
climate_data_file: clim_data_12184382
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_424bc8276be3dc5c88faf2904279a7d2 to: /var/lib/boinc-client/slots/6/ic_ancil_12184382.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/6/ic_ancil_12184382.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_031106aac20e7aca3ac0de3c9d0f44a2 to: /var/lib/boinc-client/slots/6/ifsdata/ifsdata_12184382.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/6/ifsdata/ifsdata_12184382.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/6/159l_2/clim_data_12184382.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/6/159l_2/clim_data_12184382.zip
Checking for progress XML file: /var/lib/boinc-client/slots/6/progress_file_12184382.xml
Opened progress file ok : /var/lib/boinc-client/slots/6/progress_file_12184382.xml
-- Model is restarting --
Adjusting last_iter, 2376, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/6/progress_file_12184382.xml
last_cpu_time: 46045
upload_file_number: 98
last_iter: 2375
last_upload: 8467200
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0738_1998050100_123_967_12184382_0_r697574241
The child process has been launched with process id: 1428
Executing the command: /var/lib/boinc-client/slots/6/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:W31Ub20:1:1:1428:1428] [20230114:114824:1673693304:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:W31Ub20:1:1:1428:1428] [20230114:114824:1673693304:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:W31Ub20:1:1:1428:1428] [20230114:114824:1673693304:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:W31Ub20:1:1:1428:1428] [20230114:114824:1673693304:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:W31Ub20:1:1:1428:1428] [20230114:114824:1673693304:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:W31Ub20:1:1:1428:1428] [20230114:114824:1673693304:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:W31Ub20:1:1:1428:1428] [20230114:114824:1673693304:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:W31Ub20:1:1:1428:1428] [20230114:114824:1673693304:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:W31Ub20:1:1:1428:1428] [20230114:114824:1673693304:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:W31Ub20:1:1:1428:1428] [20230114:114824:1673693304:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:W31Ub20:1:1:1428:1428] [20230114:114824:1673693304:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:W31Ub20:1:1:1428:1428] [20230114:114824:1673693304:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:W31Ub20:1:1:1428:1428] [20230114:114824:1673693304:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:W31Ub20:1:1:1428:1428] [20230114:114824:1673693304:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:W31Ub20:1:1:1428:1428] [20230114:114824:1673693304:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:W31Ub20:1:1:1428:1428] [20230114:114824:1673693304:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:W31Ub20:1:1:1428:1428] [20230114:114824:1673693304:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:W31Ub20:1:1:1428:1428] [20230114:114824:1673693304:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:W31Ub20:1:1:1428:1428] [20230114:114824:1673693304:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:W31Ub20:1:1:1428:1428] [20230114:114824:1673693304:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:W31Ub20:1:1:1428:1428] [20230114:114824:1673693304:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:W31Ub20:1:1:1428:1428] [20230114:114824:1673693304:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:W31Ub20:1:1:1428:1428] [20230114:114824:1673693304:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:W31Ub20:1:1:1428:1428] [20230114:114824:1673693304:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:W31Ub20:1:1:1428:1428] [20230114:114824:1673693304:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:W31Ub20:1:1:1428:1428] [20230114:114824:1673693304:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:W31Ub20:1:1:1428:1428] [20230114:114824:1673693304:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:W31Ub20:1:1:1428:1428] [20230114:114824:1673693304:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:W31Ub20:1:1:1428:1428] [20230114:114824:1673693304:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:W31Ub20:1:1:1428:1428] [20230114:114824:1673693304:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
ECCODES ERROR   :  IO ERROR: Inappropriate ioctl for device (Inappropriate ioctl for device)
 GRIB_READ_BYTES_INT        50000                       4  FAILED         -11
 GRIB_API ERROR MSG: Input output problem
MPL_ABORT: CALLED FROM PROCESSOR      1 THRD     1
 MPL_ABORT: THRD           1   GRIB_READ_BYTES_INT FAILED
[EC_DRHOOK:W31Ub20:1:1:1428:1428] [20230114:114825:1673693305:1.590] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3843] 1135 MB (maxheap), 361 MB (maxrss), 0 MB (maxstack)
[EC_DRHOOK:W31Ub20:1:1:1428:1428] [20230114:114825:1673693305:1.590] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :  MASTER 
[EC_DRHOOK:W31Ub20:1:1:1428:1428] [20230114:114825:1673693305:1.590] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :   CNT0 
[EC_DRHOOK:W31Ub20:1:1:1428:1428] [20230114:114825:1673693305:1.590] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :    CNT1 
[EC_DRHOOK:W31Ub20:1:1:1428:1428] [20230114:114825:1673693305:1.590] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :     CNT2 
[EC_DRHOOK:W31Ub20:1:1:1428:1428] [20230114:114825:1673693305:1.590] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :      CNT3 
[EC_DRHOOK:W31Ub20:1:1:1428:1428] [20230114:114825:1673693305:1.590] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :       RERESF 
[EC_DRHOOK:W31Ub20:1:1:1428:1428] [20230114:114825:1673693305:1.590] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :        IOSTREAM_MIX:IO_GET 
[EC_DRHOOK:W31Ub20:1:1:1428:1428] [20230114:114825:1673693305:1.590] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :         IOSTREAM_MIX:READ_RECORD 
[EC_DRHOOK:W31Ub20:1:1:1428:1428] [20230114:114825:1673693305:1.590] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :          >MPL-IOSTREAM READ_RECORD ( 650) 
[EC_DRHOOK:W31Ub20:1:1:1428:1428] [20230114:114825:1673693305:1.590] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :           GRIB_API:IGRIB_READ_BYTES_INT 
 SDL_TRACEBACK: Calling INTEL_TRBK, THRD =            1
 Process            1  thread            1  calling linux_trbk from intel_trbk()
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:240] Backtrace(s) for program '/var/lib/boinc-client/slots/6/oifs_43r3_model.exe' : sigcontextptr=0x7ffc5123efe0
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:277] Backtrace (size = 16) with plain hex-dump
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:340] [0]: [0x839273] : 0x839273
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:340] [1]: [0x839879] : 0x839879
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:340] [2]: [0x8c2957] : 0x8c2957
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:340] [3]: [0x8c3229] : 0x8c3229
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:340] [4]: [0xa044bc] : 0xa044bc
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:340] [5]: [0x9e49b1] : 0x9e49b1
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:340] [6]: [0x9d8ba9] : 0x9d8ba9
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:340] [7]: [0x54b4a0] : 0x54b4a0
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:340] [8]: [0x546a18] : 0x546a18
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:340] [9]: [0x546412] : 0x546412
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:340] [10]: [0x545e28] : 0x545e28
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:340] [11]: [0x40708d] : 0x40708d
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:340] [12]: [0x40220f] : 0x40220f
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:340] [13]: [0x4021a2] : 0x4021a2
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:340] [14]: [0x1dca390] : 0x1dca390
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:340] [15]: [0x40206e] : 0x40206e
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:370] End of backtrace(s)
 SDL_TRACEBACK: Done INTEL_TRBK, THRD =            1
abort: 
The child process terminated with status: 0
..Failed, model did not complete successfully

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:19:07 1532184 22269626 oifs_43r3_ps_0738_1998050100_123_967_12184382_0 7,948,800 43,004 0.0054
09 May 2023 16:19:07 1532184 22269626 oifs_43r3_ps_0738_1998050100_123_967_12184382_0 7,084,800 38,528 0.0054
09 May 2023 16:19:07 1532184 22269626 oifs_43r3_ps_0738_1998050100_123_967_12184382_0 6,220,800 34,051 0.0055
09 May 2023 16:18:27 1532184 22269626 oifs_43r3_ps_0738_1998050100_123_967_12184382_0 5,356,800 29,566 0.0055
09 May 2023 16:18:24 1532184 22269626 oifs_43r3_ps_0738_1998050100_123_967_12184382_0 4,492,800 25,070 0.0056
09 May 2023 16:18:24 1532184 22269626 oifs_43r3_ps_0738_1998050100_123_967_12184382_0 4,492,800 25,070 0.0056
09 May 2023 16:18:21 1532184 22269626 oifs_43r3_ps_0738_1998050100_123_967_12184382_0 3,628,800 20,566 0.0057
09 May 2023 16:18:15 1532184 22269626 oifs_43r3_ps_0738_1998050100_123_967_12184382_0 2,764,800 15,773 0.0057
09 May 2023 16:18:15 1532184 22269626 oifs_43r3_ps_0738_1998050100_123_967_12184382_0 1,900,800 10,909 0.0057
09 May 2023 16:18:15 1532184 22269626 oifs_43r3_ps_0738_1998050100_123_967_12184382_0 1,900,800 10,909 0.0057
09 May 2023 16:18:06 1532184 22269626 oifs_43r3_ps_0738_1998050100_123_967_12184382_0 864,000 4,942 0.0057
09 May 2023 16:18:06 1532184 22269626 oifs_43r3_ps_0738_1998050100_123_967_12184382_0 864,000 4,942 0.0057


©2024 climateprediction.net