climateprediction.net home page
Task 22298458

Task 22298458

Name oifs_43r3_ps_0273_2014050100_123_983_12199917_1
Workunit 12199917
Created 16 Jan 2023, 8:50:57 UTC
Sent 16 Jan 2023, 9:11:48 UTC
Report deadline 15 Feb 2023, 9:11:48 UTC
Received 17 Jan 2023, 9:39:35 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 1 (0x00000001) Unknown error code
Computer ID 1463556
Run time 22 hours 57 min 41 sec
CPU time 22 hours 41 min 23 sec
Validate state Invalid
Credit 13,305.60
Device peak FLOPS 4.15 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,407.52 MB
Peak swap size 4,974.13 MB
Peak disk usage 1,500.11 MB
Stderr 
<core_client_version>7.16.11</core_client_version>
<![CDATA[
<message>
process exited with code 1 (0x1, -255)</message>
<stderr_txt>
 1987 H=1987:00 +CPU= 30.427
  18:51:35 STEP 1988 H=1988:00 +CPU= 31.107
  18:52:21 STEP 1989 H=1989:00 +CPU= 46.354
  18:52:53 STEP 1990 H=1990:00 +CPU= 31.567
  18:53:25 STEP 1991 H=1991:00 +CPU= 31.612
  18:54:10 STEP 1992 H=1992:00 +CPU= 43.240
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+001992
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+001992
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+001992
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMGGhq0f+001968
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMSHhq0f+001968
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMUAhq0f+001968
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMGGhq0f+001980
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMSHhq0f+001980
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMUAhq0f+001980
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0273_2014050100_123_983_12199917_1_r754585437_82.zip
Uploading the intermediate file: upload_file_82.zip
  18:54:39 STEP 1993 H=1993:00 +CPU= 28.089
  18:55:04 STEP 1994 H=1994:00 +CPU= 24.788
  18:55:40 STEP 1995 H=1995:00 +CPU= 36.072
  18:56:05 STEP 1996 H=1996:00 +CPU= 25.461
  18:56:36 STEP 1997 H=1997:00 +CPU= 30.884
  18:57:14 STEP 1998 H=1998:00 +CPU= 37.972
  18:57:38 STEP 1999 H=1999:00 +CPU= 23.682
  18:58:03 STEP 2000 H=2000:00 +CPU= 24.826
  18:58:40 STEP 2001 H=2001:00 +CPU= 37.066
  18:59:05 STEP 2002 H=2002:00 +CPU= 24.679
  18:59:30 STEP 2003 H=2003:00 +CPU= 24.535
  19:00:11 STEP 2004 H=2004:00 +CPU= 40.733
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002004
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002004
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002004
  19:00:36 STEP 2005 H=2005:00 +CPU= 24.426
  19:01:01 STEP 2006 H=2006:00 +CPU= 25.360
  19:01:41 STEP 2007 H=2007:00 +CPU= 39.656
  19:02:10 STEP 2008 H=2008:00 +CPU= 28.597
  19:02:35 STEP 2009 H=2009:00 +CPU= 24.617
  19:03:12 STEP 2010 H=2010:00 +CPU= 36.989
  19:03:36 STEP 2011 H=2011:00 +CPU= 24.413
  19:04:04 STEP 2012 H=2012:00 +CPU= 27.354
  19:04:49 STEP 2013 H=2013:00 +CPU= 43.560
  19:05:18 STEP 2014 H=2014:00 +CPU= 28.564
  19:05:47 STEP 2015 H=2015:00 +CPU= 27.981
  19:06:34 STEP 2016 H=2016:00 +CPU= 44.941
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002016
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002016
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002016
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMGGhq0f+001992
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMSHhq0f+001992
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMUAhq0f+001992
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMGGhq0f+002004
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMSHhq0f+002004
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMUAhq0f+002004
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0273_2014050100_123_983_12199917_1_r754585437_83.zip
Uploading the intermediate file: upload_file_83.zip
  19:06:58 STEP 2017 H=2017:00 +CPU= 23.973
  19:07:23 STEP 2018 H=2018:00 +CPU= 24.705
  19:07:59 STEP 2019 H=2019:00 +CPU= 36.010
  19:08:24 STEP 2020 H=2020:00 +CPU= 25.029
  19:08:48 STEP 2021 H=2021:00 +CPU= 24.198
  19:09:25 STEP 2022 H=2022:00 +CPU= 36.893
  19:09:50 STEP 2023 H=2023:00 +CPU= 24.183
  19:10:17 STEP 2024 H=2024:00 +CPU= 27.354
  19:10:57 STEP 2025 H=2025:00 +CPU= 39.085
  19:11:27 STEP 2026 H=2026:00 +CPU= 30.254
  19:11:58 STEP 2027 H=2027:00 +CPU= 30.723
  19:12:42 STEP 2028 H=2028:00 +CPU= 43.871
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002028
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002028
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002028
  19:13:06 STEP 2029 H=2029:00 +CPU= 23.879
  19:13:32 STEP 2030 H=2030:00 +CPU= 25.671
  19:14:08 STEP 2031 H=2031:00 +CPU= 36.133
  19:14:34 STEP 2032 H=2032:00 +CPU= 25.324
  19:15:00 STEP 2033 H=2033:00 +CPU= 25.797
  19:15:37 STEP 2034 H=2034:00 +CPU= 36.939
  19:16:01 STEP 2035 H=2035:00 +CPU= 23.889
  19:16:27 STEP 2036 H=2036:00 +CPU= 25.014
  19:17:03 STEP 2037 H=2037:00 +CPU= 36.374
  19:17:28 STEP 2038 H=2038:00 +CPU= 24.427
  19:17:52 STEP 2039 H=2039:00 +CPU= 24.745
  19:18:43 STEP 2040 H=2040:00 +CPU= 49.383
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002040
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002040
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002040
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMGGhq0f+002016
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMSHhq0f+002016
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMUAhq0f+002016
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMGGhq0f+002028
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMSHhq0f+002028
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMUAhq0f+002028
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0273_2014050100_123_983_12199917_1_r754585437_84.zip
Uploading the intermediate file: upload_file_84.zip
  19:19:06 STEP 2041 H=2041:00 +CPU= 23.205
  19:19:31 STEP 2042 H=2042:00 +CPU= 25.025
  19:20:10 STEP 2043 H=2043:00 +CPU= 37.443
  19:20:35 STEP 2044 H=2044:00 +CPU= 24.552
  19:20:59 STEP 2045 H=2045:00 +CPU= 23.618
  19:21:36 STEP 2046 H=2046:00 +CPU= 36.612
  19:22:04 STEP 2047 H=2047:00 +CPU= 27.844
  19:22:30 STEP 2048 H=2048:00 +CPU= 25.857
  19:23:12 STEP 2049 H=2049:00 +CPU= 42.302
  19:23:41 STEP 2050 H=2050:00 +CPU= 27.875
  19:24:05 STEP 2051 H=2051:00 +CPU= 23.796
  19:24:45 STEP 2052 H=2052:00 +CPU= 40.212
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002052
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002052
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002052
  19:25:12 STEP 2053 H=2053:00 +CPU= 26.161
  19:25:37 STEP 2054 H=2054:00 +CPU= 24.668
  19:26:14 STEP 2055 H=2055:00 +CPU= 37.190
  19:26:39 STEP 2056 H=2056:00 +CPU= 24.816
  19:27:04 STEP 2057 H=2057:00 +CPU= 24.530
  19:27:41 STEP 2058 H=2058:00 +CPU= 37.038
  19:28:06 STEP 2059 H=2059:00 +CPU= 24.640
  19:28:37 STEP 2060 H=2060:00 +CPU= 30.582
  19:29:18 STEP 2061 H=2061:00 +CPU= 41.071
  19:29:43 STEP 2062 H=2062:00 +CPU= 24.725
  19:30:09 STEP 2063 H=2063:00 +CPU= 25.105
  19:31:02 STEP 2064 H=2064:00 +CPU= 53.427
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002064
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002064
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002064
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMGGhq0f+002040
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMSHhq0f+002040
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMUAhq0f+002040
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMGGhq0f+002052
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMSHhq0f+002052
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMUAhq0f+002052
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0273_2014050100_123_983_12199917_1_r754585437_85.zip
Uploading the intermediate file: upload_file_85.zip
  19:31:28 STEP 2065 H=2065:00 +CPU= 25.195
  19:31:53 STEP 2066 H=2066:00 +CPU= 25.134
  19:32:31 STEP 2067 H=2067:00 +CPU= 38.109
  19:32:56 STEP 2068 H=2068:00 +CPU= 24.824
  19:33:22 STEP 2069 H=2069:00 +CPU= 25.284
  19:34:00 STEP 2070 H=2070:00 +CPU= 37.946
  19:34:26 STEP 2071 H=2071:00 +CPU= 26.457
  19:34:52 STEP 2072 H=2072:00 +CPU= 25.642
  19:35:32 STEP 2073 H=2073:00 +CPU= 37.062
  19:35:59 STEP 2074 H=2074:00 +CPU= 25.331
  19:36:28 STEP 2075 H=2075:00 +CPU= 28.339
  19:37:18 STEP 2076 H=2076:00 +CPU= 50.260
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002076
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002076
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002076
  19:37:49 STEP 2077 H=2077:00 +CPU= 31.089
  19:38:16 STEP 2078 H=2078:00 +CPU= 26.746
  19:38:53 STEP 2079 H=2079:00 +CPU= 36.112
  19:39:18 STEP 2080 H=2080:00 +CPU= 24.809
  19:39:42 STEP 2081 H=2081:00 +CPU= 24.517
  19:40:20 STEP 2082 H=2082:00 +CPU= 37.533
  19:40:44 STEP 2083 H=2083:00 +CPU= 23.621
  19:41:09 STEP 2084 H=2084:00 +CPU= 24.738
  19:41:45 STEP 2085 H=2085:00 +CPU= 35.810
  19:42:13 STEP 2086 H=2086:00 +CPU= 27.316
  19:42:45 STEP 2087 H=2087:00 +CPU= 32.049
  19:43:28 STEP 2088 H=2088:00 +CPU= 42.641
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002088
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002088
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002088
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMGGhq0f+002064
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMSHhq0f+002064
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMUAhq0f+002064
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMGGhq0f+002076
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMSHhq0f+002076
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMUAhq0f+002076
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0273_2014050100_123_983_12199917_1_r754585437_86.zip
Uploading the intermediate file: upload_file_86.zip
  19:43:52 STEP 2089 H=2089:00 +CPU= 23.571
  19:44:17 STEP 2090 H=2090:00 +CPU= 24.857
  19:44:53 STEP 2091 H=2091:00 +CPU= 35.648
  19:45:19 STEP 2092 H=2092:00 +CPU= 25.286
  19:45:47 STEP 2093 H=2093:00 +CPU= 27.480
  19:46:30 STEP 2094 H=2094:00 +CPU= 42.235
  19:46:58 STEP 2095 H=2095:00 +CPU= 27.684
  19:47:23 STEP 2096 H=2096:00 +CPU= 24.751
  19:47:59 STEP 2097 H=2097:00 +CPU= 35.813
  19:48:24 STEP 2098 H=2098:00 +CPU= 25.093
  19:48:48 STEP 2099 H=2099:00 +CPU= 23.942
  19:49:35 STEP 2100 H=2100:00 +CPU= 47.079
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002100
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002100
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002100
  19:50:02 STEP 2101 H=2101:00 +CPU= 26.608
  19:50:28 STEP 2102 H=2102:00 +CPU= 25.508
  19:51:05 STEP 2103 H=2103:00 +CPU= 36.470
  19:51:29 STEP 2104 H=2104:00 +CPU= 24.225
  19:51:54 STEP 2105 H=2105:00 +CPU= 24.447
  19:52:31 STEP 2106 H=2106:00 +CPU= 37.393
  19:52:56 STEP 2107 H=2107:00 +CPU= 24.407
  19:53:21 STEP 2108 H=2108:00 +CPU= 24.965
  19:53:58 STEP 2109 H=2109:00 +CPU= 36.789
  19:54:23 STEP 2110 H=2110:00 +CPU= 24.847
  19:54:51 STEP 2111 H=2111:00 +CPU= 28.255
  19:55:37 STEP 2112 H=2112:00 +CPU= 45.544
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002112
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002112
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002112
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMGGhq0f+002088
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMSHhq0f+002088
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMUAhq0f+002088
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMGGhq0f+002100
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMSHhq0f+002100
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMUAhq0f+002100
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0273_2014050100_123_983_12199917_1_r754585437_87.zip
Uploading the intermediate file: upload_file_87.zip
  19:56:01 STEP 2113 H=2113:00 +CPU= 24.130
  19:56:27 STEP 2114 H=2114:00 +CPU= 24.963
  19:57:05 STEP 2115 H=2115:00 +CPU= 37.781
  19:57:31 STEP 2116 H=2116:00 +CPU= 26.424
  19:57:56 STEP 2117 H=2117:00 +CPU= 24.411
  19:58:33 STEP 2118 H=2118:00 +CPU= 36.967
  19:58:59 STEP 2119 H=2119:00 +CPU= 25.718
  19:59:30 STEP 2120 H=2120:00 +CPU= 31.678
  20:00:08 STEP 2121 H=2121:00 +CPU= 38.086
  20:00:34 STEP 2122 H=2122:00 +CPU= 25.495
  20:01:00 STEP 2123 H=2123:00 +CPU= 25.101
  20:01:41 STEP 2124 H=2124:00 +CPU= 40.062
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002124
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002124
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002124
  20:02:05 STEP 2125 H=2125:00 +CPU= 24.168
  20:02:30 STEP 2126 H=2126:00 +CPU= 24.889
  20:03:06 STEP 2127 H=2127:00 +CPU= 35.948
  20:03:31 STEP 2128 H=2128:00 +CPU= 24.723
  20:03:55 STEP 2129 H=2129:00 +CPU= 24.480
  20:04:32 STEP 2130 H=2130:00 +CPU= 36.646
  20:04:56 STEP 2131 H=2131:00 +CPU= 24.005
  20:05:21 STEP 2132 H=2132:00 +CPU= 24.661
  20:06:03 STEP 2133 H=2133:00 +CPU= 37.663
  20:06:33 STEP 2134 H=2134:00 +CPU= 30.711
  20:07:06 STEP 2135 H=2135:00 +CPU= 32.196
  20:07:51 STEP 2136 H=2136:00 +CPU= 44.724
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002136
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002136
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002136
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMGGhq0f+002112
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMSHhq0f+002112
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMUAhq0f+002112
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMGGhq0f+002124
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMSHhq0f+002124
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMUAhq0f+002124
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0273_2014050100_123_983_12199917_1_r754585437_88.zip
Uploading the intermediate file: upload_file_88.zip
  20:08:14 STEP 2137 H=2137:00 +CPU= 23.311
  20:08:40 STEP 2138 H=2138:00 +CPU= 25.533
  20:09:20 STEP 2139 H=2139:00 +CPU= 39.850
  20:09:47 STEP 2140 H=2140:00 +CPU= 26.490
  20:10:12 STEP 2141 H=2141:00 +CPU= 24.724
  20:10:57 STEP 2142 H=2142:00 +CPU= 44.174
  20:11:28 STEP 2143 H=2143:00 +CPU= 31.566
  20:11:55 STEP 2144 H=2144:00 +CPU= 26.283
  20:12:33 STEP 2145 H=2145:00 +CPU= 37.873
  20:13:03 STEP 2146 H=2146:00 +CPU= 30.377
  20:13:27 STEP 2147 H=2147:00 +CPU= 23.188
  20:14:16 STEP 2148 H=2148:00 +CPU= 49.409
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002148
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002148
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002148
  20:14:47 STEP 2149 H=2149:00 +CPU= 30.955
  20:15:16 STEP 2150 H=2150:00 +CPU= 28.454
  20:15:53 STEP 2151 H=2151:00 +CPU= 36.435
  20:16:19 STEP 2152 H=2152:00 +CPU= 25.924
  20:16:50 STEP 2153 H=2153:00 +CPU= 30.550
  20:17:32 STEP 2154 H=2154:00 +CPU= 41.067
  20:17:55 STEP 2155 H=2155:00 +CPU= 23.788
  20:18:20 STEP 2156 H=2156:00 +CPU= 24.618
  20:18:56 STEP 2157 H=2157:00 +CPU= 35.981
  20:19:21 STEP 2158 H=2158:00 +CPU= 24.633
  20:19:46 STEP 2159 H=2159:00 +CPU= 25.097
  20:20:31 STEP 2160 H=2160:00 +CPU= 44.479
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002160
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002160
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002160
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMGGhq0f+002136
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMSHhq0f+002136
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMUAhq0f+002136
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMGGhq0f+002148
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMSHhq0f+002148
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMUAhq0f+002148
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0273_2014050100_123_983_12199917_1_r754585437_89.zip
Uploading the intermediate file: upload_file_89.zip
Uploading trickle at timestep: 7776000
  20:20:56 STEP 2161 H=2161:00 +CPU= 24.298
  20:21:22 STEP 2162 H=2162:00 +CPU= 24.899
  20:22:07 STEP 2163 H=2163:00 +CPU= 43.991
  20:22:37 STEP 2164 H=2164:00 +CPU= 29.992
  20:23:08 STEP 2165 H=2165:00 +CPU= 30.269
  20:23:55 STEP 2166 H=2166:00 +CPU= 47.147
  20:24:21 STEP 2167 H=2167:00 +CPU= 25.350
  20:24:45 STEP 2168 H=2168:00 +CPU= 24.739
  20:25:23 STEP 2169 H=2169:00 +CPU= 37.874
  20:25:49 STEP 2170 H=2170:00 +CPU= 25.551
  20:26:15 STEP 2171 H=2171:00 +CPU= 25.363
  20:26:59 STEP 2172 H=2172:00 +CPU= 43.860
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002172
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002172
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002172
  20:27:30 STEP 2173 H=2173:00 +CPU= 30.689
  20:28:02 STEP 2174 H=2174:00 +CPU= 31.370
  20:28:40 STEP 2175 H=2175:00 +CPU= 38.257
  20:29:08 STEP 2176 H=2176:00 +CPU= 27.548
  20:29:39 STEP 2177 H=2177:00 +CPU= 30.433
  20:30:26 STEP 2178 H=2178:00 +CPU= 46.690
  20:30:52 STEP 2179 H=2179:00 +CPU= 26.623
  20:31:17 STEP 2180 H=2180:00 +CPU= 24.510
  20:31:56 STEP 2181 H=2181:00 +CPU= 38.299
  20:32:21 STEP 2182 H=2182:00 +CPU= 24.878
  20:32:46 STEP 2183 H=2183:00 +CPU= 24.846
  20:33:29 STEP 2184 H=2184:00 +CPU= 43.052
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002184
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002184
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002184
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMGGhq0f+002160
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMSHhq0f+002160
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMUAhq0f+002160
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMGGhq0f+002172
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMSHhq0f+002172
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMUAhq0f+002172
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0273_2014050100_123_983_12199917_1_r754585437_90.zip
Uploading the intermediate file: upload_file_90.zip
  20:33:55 STEP 2185 H=2185:00 +CPU= 25.582
  20:34:22 STEP 2186 H=2186:00 +CPU= 26.769
  20:34:59 STEP 2187 H=2187:00 +CPU= 36.853
  20:35:25 STEP 2188 H=2188:00 +CPU= 25.247
  20:35:54 STEP 2189 H=2189:00 +CPU= 26.030
  20:36:35 STEP 2190 H=2190:00 +CPU= 39.173
  20:36:59 STEP 2191 H=2191:00 +CPU= 23.680
  20:37:23 STEP 2192 H=2192:00 +CPU= 24.319
  20:38:00 STEP 2193 H=2193:00 +CPU= 36.881
  20:38:25 STEP 2194 H=2194:00 +CPU= 24.732
  20:38:49 STEP 2195 H=2195:00 +CPU= 23.649
  20:39:30 STEP 2196 H=2196:00 +CPU= 40.536
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002196
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002196
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002196
  20:39:54 STEP 2197 H=2197:00 +CPU= 23.900
  20:40:19 STEP 2198 H=2198:00 +CPU= 24.963
  20:40:56 STEP 2199 H=2199:00 +CPU= 36.984
  20:41:21 STEP 2200 H=2200:00 +CPU= 25.313
  20:41:49 STEP 2201 H=2201:00 +CPU= 26.648
  20:42:37 STEP 2202 H=2202:00 +CPU= 47.631
  20:43:06 STEP 2203 H=2203:00 +CPU= 29.438
  20:43:31 STEP 2204 H=2204:00 +CPU= 24.273
  20:44:08 STEP 2205 H=2205:00 +CPU= 37.263
  20:44:33 STEP 2206 H=2206:00 +CPU= 24.387
  20:44:59 STEP 2207 H=2207:00 +CPU= 26.290
  20:45:52 STEP 2208 H=2208:00 +CPU= 52.877
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002208
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002208
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002208
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMGGhq0f+002184
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMSHhq0f+002184
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMUAhq0f+002184
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMGGhq0f+002196
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMSHhq0f+002196
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMUAhq0f+002196
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0273_2014050100_123_983_12199917_1_r754585437_91.zip
Uploading the intermediate file: upload_file_91.zip
  20:46:19 STEP 2209 H=2209:00 +CPU= 25.904
  20:46:45 STEP 2210 H=2210:00 +CPU= 25.382
  20:47:22 STEP 2211 H=2211:00 +CPU= 36.237
  20:47:47 STEP 2212 H=2212:00 +CPU= 24.800
  20:48:11 STEP 2213 H=2213:00 +CPU= 24.165
  20:48:49 STEP 2214 H=2214:00 +CPU= 37.219
  20:49:16 STEP 2215 H=2215:00 +CPU= 26.661
  20:49:42 STEP 2216 H=2216:00 +CPU= 26.301
  20:50:20 STEP 2217 H=2217:00 +CPU= 37.324
  20:50:45 STEP 2218 H=2218:00 +CPU= 24.745
  20:51:10 STEP 2219 H=2219:00 +CPU= 25.195
  20:51:51 STEP 2220 H=2220:00 +CPU= 40.412
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002220
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002220
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002220
  20:52:18 STEP 2221 H=2221:00 +CPU= 25.590
  20:52:43 STEP 2222 H=2222:00 +CPU= 25.337
  20:53:20 STEP 2223 H=2223:00 +CPU= 36.813
  20:53:45 STEP 2224 H=2224:00 +CPU= 25.018
  20:54:09 STEP 2225 H=2225:00 +CPU= 23.780
  20:54:47 STEP 2226 H=2226:00 +CPU= 37.511
  20:55:12 STEP 2227 H=2227:00 +CPU= 24.514
  20:55:37 STEP 2228 H=2228:00 +CPU= 24.809
  20:56:13 STEP 2229 H=2229:00 +CPU= 36.520
  20:56:38 STEP 2230 H=2230:00 +CPU= 24.626
  20:57:04 STEP 2231 H=2231:00 +CPU= 24.648
  20:57:53 STEP 2232 H=2232:00 +CPU= 48.665
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002232
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002232
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002232
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMGGhq0f+002208
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMSHhq0f+002208
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMUAhq0f+002208
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMGGhq0f+002220
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMSHhq0f+002220
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMUAhq0f+002220
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0273_2014050100_123_983_12199917_1_r754585437_92.zip
Uploading the intermediate file: upload_file_92.zip
  20:58:17 STEP 2233 H=2233:00 +CPU= 24.050
  20:58:41 STEP 2234 H=2234:00 +CPU= 24.436
  20:59:18 STEP 2235 H=2235:00 +CPU= 36.895
  20:59:43 STEP 2236 H=2236:00 +CPU= 24.630
  21:00:13 STEP 2237 H=2237:00 +CPU= 29.960
  21:01:01 STEP 2238 H=2238:00 +CPU= 47.638
  21:01:31 STEP 2239 H=2239:00 +CPU= 30.118
  21:02:03 STEP 2240 H=2240:00 +CPU= 30.809
  21:02:41 STEP 2241 H=2241:00 +CPU= 36.563
  21:03:05 STEP 2242 H=2242:00 +CPU= 24.561
  21:03:30 STEP 2243 H=2243:00 +CPU= 24.409
  21:04:13 STEP 2244 H=2244:00 +CPU= 43.078
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002244
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002244
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002244
  21:04:44 STEP 2245 H=2245:00 +CPU= 30.704
  21:05:16 STEP 2246 H=2246:00 +CPU= 31.864
  21:05:58 STEP 2247 H=2247:00 +CPU= 39.581
  21:06:23 STEP 2248 H=2248:00 +CPU= 25.227
  21:06:48 STEP 2249 H=2249:00 +CPU= 25.035
  21:07:29 STEP 2250 H=2250:00 +CPU= 39.572
  21:07:53 STEP 2251 H=2251:00 +CPU= 23.958
  21:08:24 STEP 2252 H=2252:00 +CPU= 29.895
  21:09:10 STEP 2253 H=2253:00 +CPU= 46.098
  21:09:41 STEP 2254 H=2254:00 +CPU= 31.341
  21:10:12 STEP 2255 H=2255:00 +CPU= 30.726
  21:11:00 STEP 2256 H=2256:00 +CPU= 47.430
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002256
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002256
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002256
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMGGhq0f+002232
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMSHhq0f+002232
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMUAhq0f+002232
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMGGhq0f+002244
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMSHhq0f+002244
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMUAhq0f+002244
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0273_2014050100_123_983_12199917_1_r754585437_93.zip
Uploading the intermediate file: upload_file_93.zip
  21:11:26 STEP 2257 H=2257:00 +CPU= 25.462
  21:11:50 STEP 2258 H=2258:00 +CPU= 24.746
  21:12:36 STEP 2259 H=2259:00 +CPU= 43.703
  21:13:06 STEP 2260 H=2260:00 +CPU= 30.544
  21:13:33 STEP 2261 H=2261:00 +CPU= 26.627
  21:14:21 STEP 2262 H=2262:00 +CPU= 47.642
  21:14:50 STEP 2263 H=2263:00 +CPU= 28.979
  21:15:22 STEP 2264 H=2264:00 +CPU= 31.690
  21:16:08 STEP 2265 H=2265:00 +CPU= 46.207
  21:16:40 STEP 2266 H=2266:00 +CPU= 31.561
  21:17:11 STEP 2267 H=2267:00 +CPU= 30.950
  21:17:55 STEP 2268 H=2268:00 +CPU= 42.862
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002268
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002268
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002268
  21:18:24 STEP 2269 H=2269:00 +CPU= 29.365
  21:18:52 STEP 2270 H=2270:00 +CPU= 27.413
  21:19:29 STEP 2271 H=2271:00 +CPU= 36.647
  21:19:56 STEP 2272 H=2272:00 +CPU= 27.189
  21:20:27 STEP 2273 H=2273:00 +CPU= 30.106
  21:21:11 STEP 2274 H=2274:00 +CPU= 44.543
  21:21:35 STEP 2275 H=2275:00 +CPU= 24.013
  21:22:01 STEP 2276 H=2276:00 +CPU= 24.949
  21:22:38 STEP 2277 H=2277:00 +CPU= 37.289
  21:23:04 STEP 2278 H=2278:00 +CPU= 25.150
  21:23:29 STEP 2279 H=2279:00 +CPU= 25.362
  21:24:16 STEP 2280 H=2280:00 +CPU= 44.236
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002280
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002280
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002280
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMGGhq0f+002256
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMSHhq0f+002256
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMUAhq0f+002256
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMGGhq0f+002268
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMSHhq0f+002268
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMUAhq0f+002268
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0273_2014050100_123_983_12199917_1_r754585437_94.zip
Uploading the intermediate file: upload_file_94.zip
  21:24:47 STEP 2281 H=2281:00 +CPU= 30.476
  21:25:16 STEP 2282 H=2282:00 +CPU= 28.423
  21:25:58 STEP 2283 H=2283:00 +CPU= 41.455
  21:26:29 STEP 2284 H=2284:00 +CPU= 31.161
  21:26:58 STEP 2285 H=2285:00 +CPU= 28.309
  21:27:37 STEP 2286 H=2286:00 +CPU= 38.281
  21:28:02 STEP 2287 H=2287:00 +CPU= 24.575
  21:28:26 STEP 2288 H=2288:00 +CPU= 24.477
  21:29:03 STEP 2289 H=2289:00 +CPU= 36.468
  21:29:28 STEP 2290 H=2290:00 +CPU= 24.928
  21:29:52 STEP 2291 H=2291:00 +CPU= 24.032
  21:30:40 STEP 2292 H=2292:00 +CPU= 47.451
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002292
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002292
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002292
  21:31:04 STEP 2293 H=2293:00 +CPU= 24.370
  21:31:34 STEP 2294 H=2294:00 +CPU= 29.570
  21:32:20 STEP 2295 H=2295:00 +CPU= 45.585
  21:32:46 STEP 2296 H=2296:00 +CPU= 25.413
  21:33:15 STEP 2297 H=2297:00 +CPU= 28.614
  21:34:00 STEP 2298 H=2298:00 +CPU= 44.830
  21:34:24 STEP 2299 H=2299:00 +CPU= 24.247
  21:34:50 STEP 2300 H=2300:00 +CPU= 25.128
  21:35:30 STEP 2301 H=2301:00 +CPU= 39.155
  21:35:57 STEP 2302 H=2302:00 +CPU= 25.389
  21:36:28 STEP 2303 H=2303:00 +CPU= 28.694
  21:37:12 STEP 2304 H=2304:00 +CPU= 43.991
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002304
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002304
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002304
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMGGhq0f+002280
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMSHhq0f+002280
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMUAhq0f+002280
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMGGhq0f+002292
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMSHhq0f+002292
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMUAhq0f+002292
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0273_2014050100_123_983_12199917_1_r754585437_95.zip
Uploading the intermediate file: upload_file_95.zip
  21:37:36 STEP 2305 H=2305:00 +CPU= 23.699
  21:38:03 STEP 2306 H=2306:00 +CPU= 25.134
  21:38:41 STEP 2307 H=2307:00 +CPU= 37.675
  21:39:06 STEP 2308 H=2308:00 +CPU= 25.296
  21:39:31 STEP 2309 H=2309:00 +CPU= 24.984
  21:40:09 STEP 2310 H=2310:00 +CPU= 37.778
  21:40:33 STEP 2311 H=2311:00 +CPU= 23.588
  21:40:57 STEP 2312 H=2312:00 +CPU= 24.665
  21:41:34 STEP 2313 H=2313:00 +CPU= 36.353
  21:41:59 STEP 2314 H=2314:00 +CPU= 24.740
  21:42:23 STEP 2315 H=2315:00 +CPU= 23.780
  21:43:05 STEP 2316 H=2316:00 +CPU= 41.985
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002316
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002316
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002316
  21:43:36 STEP 2317 H=2317:00 +CPU= 31.058
  21:44:03 STEP 2318 H=2318:00 +CPU= 26.440
  21:44:40 STEP 2319 H=2319:00 +CPU= 37.122
  21:45:05 STEP 2320 H=2320:00 +CPU= 24.725
  21:45:29 STEP 2321 H=2321:00 +CPU= 23.571
  21:46:08 STEP 2322 H=2322:00 +CPU= 39.313
  21:46:34 STEP 2323 H=2323:00 +CPU= 25.135
  21:46:58 STEP 2324 H=2324:00 +CPU= 24.635
  21:47:35 STEP 2325 H=2325:00 +CPU= 36.517
  21:48:05 STEP 2326 H=2326:00 +CPU= 29.601
  21:48:31 STEP 2327 H=2327:00 +CPU= 24.832
  21:49:21 STEP 2328 H=2328:00 +CPU= 49.589
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002328
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002328
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002328
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMGGhq0f+002304
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMSHhq0f+002304
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMUAhq0f+002304
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMGGhq0f+002316
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMSHhq0f+002316
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMUAhq0f+002316
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0273_2014050100_123_983_12199917_1_r754585437_96.zip
Uploading the intermediate file: upload_file_96.zip
  21:49:48 STEP 2329 H=2329:00 +CPU= 27.244
  21:50:13 STEP 2330 H=2330:00 +CPU= 24.405
  21:50:51 STEP 2331 H=2331:00 +CPU= 38.098
  21:51:23 STEP 2332 H=2332:00 +CPU= 31.820
  21:51:54 STEP 2333 H=2333:00 +CPU= 30.790
  21:52:43 STEP 2334 H=2334:00 +CPU= 47.759
  21:53:08 STEP 2335 H=2335:00 +CPU= 25.412
  21:53:34 STEP 2336 H=2336:00 +CPU= 24.844
  21:54:11 STEP 2337 H=2337:00 +CPU= 36.518
  21:54:36 STEP 2338 H=2338:00 +CPU= 24.617
  21:55:00 STEP 2339 H=2339:00 +CPU= 24.402
  21:55:41 STEP 2340 H=2340:00 +CPU= 40.286
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002340
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002340
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002340
  21:56:05 STEP 2341 H=2341:00 +CPU= 24.070
  21:56:32 STEP 2342 H=2342:00 +CPU= 26.822
  21:57:19 STEP 2343 H=2343:00 +CPU= 46.564
  21:57:44 STEP 2344 H=2344:00 +CPU= 24.872
  21:58:10 STEP 2345 H=2345:00 +CPU= 26.376
  21:58:57 STEP 2346 H=2346:00 +CPU= 45.886
  21:59:21 STEP 2347 H=2347:00 +CPU= 24.089
  21:59:47 STEP 2348 H=2348:00 +CPU= 25.233
  22:00:23 STEP 2349 H=2349:00 +CPU= 35.931
  22:00:47 STEP 2350 H=2350:00 +CPU= 24.186
  22:01:13 STEP 2351 H=2351:00 +CPU= 25.330
  22:01:57 STEP 2352 H=2352:00 +CPU= 43.689
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002352
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002352
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002352
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMGGhq0f+002328
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMSHhq0f+002328
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMUAhq0f+002328
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMGGhq0f+002340
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMSHhq0f+002340
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMUAhq0f+002340
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0273_2014050100_123_983_12199917_1_r754585437_97.zip
Uploading the intermediate file: upload_file_97.zip
  22:02:21 STEP 2353 H=2353:00 +CPU= 24.122
  22:02:50 STEP 2354 H=2354:00 +CPU= 28.208
  22:03:27 STEP 2355 H=2355:00 +CPU= 36.571
  22:03:52 STEP 2356 H=2356:00 +CPU= 24.527
  22:04:15 STEP 2357 H=2357:00 +CPU= 23.733
  22:05:00 STEP 2358 H=2358:00 +CPU= 44.227
  22:05:29 STEP 2359 H=2359:00 +CPU= 28.026
  22:05:56 STEP 2360 H=2360:00 +CPU= 25.520
  22:06:34 STEP 2361 H=2361:00 +CPU= 37.688
  22:06:59 STEP 2362 H=2362:00 +CPU= 24.770
  22:07:23 STEP 2363 H=2363:00 +CPU= 23.829
  22:08:04 STEP 2364 H=2364:00 +CPU= 40.881
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002364
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002364
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002364
  22:08:27 STEP 2365 H=2365:00 +CPU= 23.703
  22:08:55 STEP 2366 H=2366:00 +CPU= 25.731
  22:09:40 STEP 2367 H=2367:00 +CPU= 44.905
  22:10:04 STEP 2368 H=2368:00 +CPU= 23.969
  22:10:28 STEP 2369 H=2369:00 +CPU= 24.115
  22:11:06 STEP 2370 H=2370:00 +CPU= 37.525
  22:11:30 STEP 2371 H=2371:00 +CPU= 24.151
  22:11:55 STEP 2372 H=2372:00 +CPU= 24.614
  22:12:35 STEP 2373 H=2373:00 +CPU= 39.991
  22:13:06 STEP 2374 H=2374:00 +CPU= 31.460
  22:13:35 STEP 2375 H=2375:00 +CPU= 28.119
  22:14:26 STEP 2376 H=2376:00 +CPU= 49.556
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002376
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002376
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002376
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMGGhq0f+002352
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMSHhq0f+002352
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMUAhq0f+002352
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMGGhq0f+002364
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMSHhq0f+002364
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMUAhq0f+002364
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0273_2014050100_123_983_12199917_1_r754585437_98.zip
Uploading the intermediate file: upload_file_98.zip
  22:14:50 STEP 2377 H=2377:00 +CPU= 23.435
  22:15:15 STEP 2378 H=2378:00 +CPU= 24.699
  22:15:52 STEP 2379 H=2379:00 +CPU= 37.443
  22:16:17 STEP 2380 H=2380:00 +CPU= 24.894
  22:16:41 STEP 2381 H=2381:00 +CPU= 23.412
  22:17:19 STEP 2382 H=2382:00 +CPU= 37.767
  22:17:44 STEP 2383 H=2383:00 +CPU= 24.889
  22:18:08 STEP 2384 H=2384:00 +CPU= 24.164
  22:18:45 STEP 2385 H=2385:00 +CPU= 36.564
  22:19:16 STEP 2386 H=2386:00 +CPU= 30.026
  22:19:46 STEP 2387 H=2387:00 +CPU= 30.237
  22:20:39 STEP 2388 H=2388:00 +CPU= 52.423
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002388
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002388
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002388
  22:21:09 STEP 2389 H=2389:00 +CPU= 29.989
  22:21:40 STEP 2390 H=2390:00 +CPU= 31.304
  22:22:28 STEP 2391 H=2391:00 +CPU= 47.255
  22:22:53 STEP 2392 H=2392:00 +CPU= 25.467
  22:23:18 STEP 2393 H=2393:00 +CPU= 24.748
  22:24:03 STEP 2394 H=2394:00 +CPU= 43.254
  22:24:27 STEP 2395 H=2395:00 +CPU= 24.120
  22:24:52 STEP 2396 H=2396:00 +CPU= 24.802
  22:25:29 STEP 2397 H=2397:00 +CPU= 36.922
  22:25:54 STEP 2398 H=2398:00 +CPU= 24.884
  22:26:23 STEP 2399 H=2399:00 +CPU= 29.154
  22:27:09 STEP 2400 H=2400:00 +CPU= 45.299
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002400
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002400
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002400
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMGGhq0f+002376
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMSHhq0f+002376
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMUAhq0f+002376
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMGGhq0f+002388
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMSHhq0f+002388
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMUAhq0f+002388
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0273_2014050100_123_983_12199917_1_r754585437_99.zip
Uploading the intermediate file: upload_file_99.zip
  22:27:33 STEP 2401 H=2401:00 +CPU= 24.107
Uploading trickle at timestep: 8640000
  22:27:58 STEP 2402 H=2402:00 +CPU= 24.570
  22:28:35 STEP 2403 H=2403:00 +CPU= 36.686
  22:29:00 STEP 2404 H=2404:00 +CPU= 24.926
  22:29:25 STEP 2405 H=2405:00 +CPU= 24.690
  22:30:08 STEP 2406 H=2406:00 +CPU= 43.313
  22:30:39 STEP 2407 H=2407:00 +CPU= 30.806
  22:31:08 STEP 2408 H=2408:00 +CPU= 28.745
  22:31:45 STEP 2409 H=2409:00 +CPU= 36.368
  22:32:10 STEP 2410 H=2410:00 +CPU= 25.397
  22:32:38 STEP 2411 H=2411:00 +CPU= 27.422
  22:33:20 STEP 2412 H=2412:00 +CPU= 42.220
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002412
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002412
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002412
  22:33:44 STEP 2413 H=2413:00 +CPU= 23.996
  22:34:10 STEP 2414 H=2414:00 +CPU= 25.075
  22:34:52 STEP 2415 H=2415:00 +CPU= 41.858
  22:35:17 STEP 2416 H=2416:00 +CPU= 24.619
  22:35:45 STEP 2417 H=2417:00 +CPU= 25.319
  22:36:24 STEP 2418 H=2418:00 +CPU= 38.570
  22:36:48 STEP 2419 H=2419:00 +CPU= 23.486
  22:37:14 STEP 2420 H=2420:00 +CPU= 24.824
  22:37:53 STEP 2421 H=2421:00 +CPU= 39.166
  22:38:25 STEP 2422 H=2422:00 +CPU= 31.236
  22:38:49 STEP 2423 H=2423:00 +CPU= 24.679
  22:39:40 STEP 2424 H=2424:00 +CPU= 49.629
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002424
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002424
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002424
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMGGhq0f+002400
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMSHhq0f+002400
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMUAhq0f+002400
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMGGhq0f+002412
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMSHhq0f+002412
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMUAhq0f+002412
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0273_2014050100_123_983_12199917_1_r754585437_100.zip
Uploading the intermediate file: upload_file_100.zip
  22:40:05 STEP 2425 H=2425:00 +CPU= 24.955
  22:40:31 STEP 2426 H=2426:00 +CPU= 25.981
  22:41:08 STEP 2427 H=2427:00 +CPU= 36.985
  22:41:33 STEP 2428 H=2428:00 +CPU= 24.693
  22:41:57 STEP 2429 H=2429:00 +CPU= 24.115
  22:42:35 STEP 2430 H=2430:00 +CPU= 37.767
  22:43:01 STEP 2431 H=2431:00 +CPU= 25.883
  22:43:26 STEP 2432 H=2432:00 +CPU= 24.771
  22:44:09 STEP 2433 H=2433:00 +CPU= 42.035
  22:44:39 STEP 2434 H=2434:00 +CPU= 29.348
  22:45:03 STEP 2435 H=2435:00 +CPU= 23.957
  22:45:55 STEP 2436 H=2436:00 +CPU= 51.434
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002436
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002436
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002436
  22:46:24 STEP 2437 H=2437:00 +CPU= 28.709
  22:46:48 STEP 2438 H=2438:00 +CPU= 24.389
  22:47:26 STEP 2439 H=2439:00 +CPU= 37.176
  22:47:53 STEP 2440 H=2440:00 +CPU= 27.051
  22:48:19 STEP 2441 H=2441:00 +CPU= 25.569
  22:48:57 STEP 2442 H=2442:00 +CPU= 38.519
  22:49:28 STEP 2443 H=2443:00 +CPU= 30.696
  22:49:56 STEP 2444 H=2444:00 +CPU= 26.440
  22:50:32 STEP 2445 H=2445:00 +CPU= 36.413
  22:50:57 STEP 2446 H=2446:00 +CPU= 24.907
  22:51:23 STEP 2447 H=2447:00 +CPU= 25.256
  22:52:10 STEP 2448 H=2448:00 +CPU= 46.824
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002448
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002448
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002448
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMGGhq0f+002424
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMSHhq0f+002424
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMUAhq0f+002424
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMGGhq0f+002436
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMSHhq0f+002436
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMUAhq0f+002436
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0273_2014050100_123_983_12199917_1_r754585437_101.zip
Uploading the intermediate file: upload_file_101.zip
  22:52:35 STEP 2449 H=2449:00 +CPU= 24.478
  22:53:00 STEP 2450 H=2450:00 +CPU= 24.860
  22:53:42 STEP 2451 H=2451:00 +CPU= 41.772
  22:54:07 STEP 2452 H=2452:00 +CPU= 25.073
  22:54:31 STEP 2453 H=2453:00 +CPU= 23.813
  22:55:09 STEP 2454 H=2454:00 +CPU= 37.513
  22:55:34 STEP 2455 H=2455:00 +CPU= 24.324
  22:55:59 STEP 2456 H=2456:00 +CPU= 24.901
  22:56:36 STEP 2457 H=2457:00 +CPU= 36.437
  22:57:01 STEP 2458 H=2458:00 +CPU= 24.890
  22:57:25 STEP 2459 H=2459:00 +CPU= 23.855
  22:58:06 STEP 2460 H=2460:00 +CPU= 40.888
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002460
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002460
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002460
  22:58:30 STEP 2461 H=2461:00 +CPU= 23.953
  22:58:54 STEP 2462 H=2462:00 +CPU= 24.397
  22:59:31 STEP 2463 H=2463:00 +CPU= 36.726
  22:59:56 STEP 2464 H=2464:00 +CPU= 24.912
  23:00:21 STEP 2465 H=2465:00 +CPU= 24.144
  23:01:02 STEP 2466 H=2466:00 +CPU= 40.368
  23:01:32 STEP 2467 H=2467:00 +CPU= 30.387
  23:02:00 STEP 2468 H=2468:00 +CPU= 27.161
  23:02:38 STEP 2469 H=2469:00 +CPU= 38.674
  23:03:05 STEP 2470 H=2470:00 +CPU= 25.383
  23:03:29 STEP 2471 H=2471:00 +CPU= 24.709
  23:04:20 STEP 2472 H=2472:00 +CPU= 50.669
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002472
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002472
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002472
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMGGhq0f+002448
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMSHhq0f+002448
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMUAhq0f+002448
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMGGhq0f+002460
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMSHhq0f+002460
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMUAhq0f+002460
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0273_2014050100_123_983_12199917_1_r754585437_102.zip
Uploading the intermediate file: upload_file_102.zip
  23:04:48 STEP 2473 H=2473:00 +CPU= 27.906
  23:05:19 STEP 2474 H=2474:00 +CPU= 29.542
  23:06:01 STEP 2475 H=2475:00 +CPU= 39.248
  23:06:28 STEP 2476 H=2476:00 +CPU= 26.476
  23:06:52 STEP 2477 H=2477:00 +CPU= 23.968
  23:07:29 STEP 2478 H=2478:00 +CPU= 36.921
  23:07:53 STEP 2479 H=2479:00 +CPU= 24.443
  23:08:19 STEP 2480 H=2480:00 +CPU= 25.341
  23:09:02 STEP 2481 H=2481:00 +CPU= 43.361
  23:09:27 STEP 2482 H=2482:00 +CPU= 25.007
  23:09:56 STEP 2483 H=2483:00 +CPU= 28.831
  23:10:49 STEP 2484 H=2484:00 +CPU= 51.407
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002484
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002484
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002484
  23:11:20 STEP 2485 H=2485:00 +CPU= 30.744
  23:11:52 STEP 2486 H=2486:00 +CPU= 31.775
  23:12:32 STEP 2487 H=2487:00 +CPU= 39.577
  23:12:56 STEP 2488 H=2488:00 +CPU= 24.579
  23:13:21 STEP 2489 H=2489:00 +CPU= 24.156
  23:13:59 STEP 2490 H=2490:00 +CPU= 37.551
  23:14:23 STEP 2491 H=2491:00 +CPU= 23.915
  23:14:47 STEP 2492 H=2492:00 +CPU= 24.525
  23:15:28 STEP 2493 H=2493:00 +CPU= 39.710
  23:15:58 STEP 2494 H=2494:00 +CPU= 30.320
  23:16:25 STEP 2495 H=2495:00 +CPU= 26.892
  23:17:21 STEP 2496 H=2496:00 +CPU= 55.182
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002496
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002496
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002496
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMGGhq0f+002472
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMSHhq0f+002472
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMUAhq0f+002472
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMGGhq0f+002484
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMSHhq0f+002484
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMUAhq0f+002484
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0273_2014050100_123_983_12199917_1_r754585437_103.zip
Uploading the intermediate file: upload_file_103.zip
  23:17:52 STEP 2497 H=2497:00 +CPU= 31.304
  23:18:19 STEP 2498 H=2498:00 +CPU= 26.570
  23:18:57 STEP 2499 H=2499:00 +CPU= 37.519
  23:19:28 STEP 2500 H=2500:00 +CPU= 31.076
  23:19:55 STEP 2501 H=2501:00 +CPU= 26.572
  23:20:35 STEP 2502 H=2502:00 +CPU= 38.543
  23:20:59 STEP 2503 H=2503:00 +CPU= 24.045
  23:21:24 STEP 2504 H=2504:00 +CPU= 24.924
  23:22:00 STEP 2505 H=2505:00 +CPU= 36.220
  23:22:30 STEP 2506 H=2506:00 +CPU= 29.943
  23:23:00 STEP 2507 H=2507:00 +CPU= 30.155
  23:23:52 STEP 2508 H=2508:00 +CPU= 51.252
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002508
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002508
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002508
  23:24:21 STEP 2509 H=2509:00 +CPU= 28.675
  23:24:45 STEP 2510 H=2510:00 +CPU= 24.609
  23:25:26 STEP 2511 H=2511:00 +CPU= 39.652
  23:25:57 STEP 2512 H=2512:00 +CPU= 30.980
  23:26:28 STEP 2513 H=2513:00 +CPU= 30.476
  23:27:06 STEP 2514 H=2514:00 +CPU= 38.205
  23:27:30 STEP 2515 H=2515:00 +CPU= 23.875
  23:27:59 STEP 2516 H=2516:00 +CPU= 28.743
  23:28:35 STEP 2517 H=2517:00 +CPU= 36.017
  23:29:00 STEP 2518 H=2518:00 +CPU= 24.790
  23:29:25 STEP 2519 H=2519:00 +CPU= 24.871
  23:30:09 STEP 2520 H=2520:00 +CPU= 43.633
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002520
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002520
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002520
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMGGhq0f+002496
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMSHhq0f+002496
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMUAhq0f+002496
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMGGhq0f+002508
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMSHhq0f+002508
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMUAhq0f+002508
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0273_2014050100_123_983_12199917_1_r754585437_104.zip
Uploading the intermediate file: upload_file_104.zip
  23:30:33 STEP 2521 H=2521:00 +CPU= 23.939
  23:30:59 STEP 2522 H=2522:00 +CPU= 25.227
  23:31:36 STEP 2523 H=2523:00 +CPU= 36.351
  23:32:02 STEP 2524 H=2524:00 +CPU= 25.386
  23:32:25 STEP 2525 H=2525:00 +CPU= 23.637
  23:33:03 STEP 2526 H=2526:00 +CPU= 37.566
  23:33:27 STEP 2527 H=2527:00 +CPU= 24.173
  23:33:52 STEP 2528 H=2528:00 +CPU= 24.988
  23:34:29 STEP 2529 H=2529:00 +CPU= 36.563
  23:34:54 STEP 2530 H=2530:00 +CPU= 24.471
  23:35:18 STEP 2531 H=2531:00 +CPU= 23.986
  23:36:04 STEP 2532 H=2532:00 +CPU= 42.587
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002532
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002532
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002532
  23:36:29 STEP 2533 H=2533:00 +CPU= 24.281
  23:36:54 STEP 2534 H=2534:00 +CPU= 24.334
  23:37:30 STEP 2535 H=2535:00 +CPU= 36.490
  23:37:55 STEP 2536 H=2536:00 +CPU= 24.735
  23:38:21 STEP 2537 H=2537:00 +CPU= 25.742
  23:39:08 STEP 2538 H=2538:00 +CPU= 46.791
  23:39:39 STEP 2539 H=2539:00 +CPU= 30.968
  23:40:08 STEP 2540 H=2540:00 +CPU= 29.012
  23:40:47 STEP 2541 H=2541:00 +CPU= 38.526
  23:41:16 STEP 2542 H=2542:00 +CPU= 25.453
  23:41:42 STEP 2543 H=2543:00 +CPU= 25.507
  23:42:26 STEP 2544 H=2544:00 +CPU= 43.170
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002544
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002544
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002544
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMGGhq0f+002520
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMSHhq0f+002520
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMUAhq0f+002520
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMGGhq0f+002532
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMSHhq0f+002532
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMUAhq0f+002532
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0273_2014050100_123_983_12199917_1_r754585437_105.zip
Uploading the intermediate file: upload_file_105.zip
  23:42:51 STEP 2545 H=2545:00 +CPU= 25.431
  23:43:16 STEP 2546 H=2546:00 +CPU= 24.767
  23:43:53 STEP 2547 H=2547:00 +CPU= 36.978
  23:44:18 STEP 2548 H=2548:00 +CPU= 24.520
  23:44:43 STEP 2549 H=2549:00 +CPU= 24.541
  23:45:24 STEP 2550 H=2550:00 +CPU= 40.821
  23:45:49 STEP 2551 H=2551:00 +CPU= 25.385
  23:46:17 STEP 2552 H=2552:00 +CPU= 26.988
  23:46:55 STEP 2553 H=2553:00 +CPU= 37.871
  23:47:20 STEP 2554 H=2554:00 +CPU= 25.523
  23:47:44 STEP 2555 H=2555:00 +CPU= 23.842
  23:48:27 STEP 2556 H=2556:00 +CPU= 41.941
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002556
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002556
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002556
  23:48:51 STEP 2557 H=2557:00 +CPU= 24.716
  23:49:16 STEP 2558 H=2558:00 +CPU= 24.246
  23:49:53 STEP 2559 H=2559:00 +CPU= 37.634
  23:50:18 STEP 2560 H=2560:00 +CPU= 24.574
  23:50:42 STEP 2561 H=2561:00 +CPU= 23.385
  23:51:20 STEP 2562 H=2562:00 +CPU= 37.949
  23:51:45 STEP 2563 H=2563:00 +CPU= 24.417
  23:52:09 STEP 2564 H=2564:00 +CPU= 24.034
  23:52:45 STEP 2565 H=2565:00 +CPU= 36.486
  23:53:11 STEP 2566 H=2566:00 +CPU= 25.200
  23:53:36 STEP 2567 H=2567:00 +CPU= 24.709
  23:54:25 STEP 2568 H=2568:00 +CPU= 48.391
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002568
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002568
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002568
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMGGhq0f+002544
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMSHhq0f+002544
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMUAhq0f+002544
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMGGhq0f+002556
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMSHhq0f+002556
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMUAhq0f+002556
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0273_2014050100_123_983_12199917_1_r754585437_106.zip
Uploading the intermediate file: upload_file_106.zip
  23:54:55 STEP 2569 H=2569:00 +CPU= 30.420
  23:55:24 STEP 2570 H=2570:00 +CPU= 28.795
  23:56:05 STEP 2571 H=2571:00 +CPU= 40.890
  23:56:34 STEP 2572 H=2572:00 +CPU= 27.818
  23:56:59 STEP 2573 H=2573:00 +CPU= 24.856
  23:57:36 STEP 2574 H=2574:00 +CPU= 37.304
  23:58:04 STEP 2575 H=2575:00 +CPU= 27.064
  23:58:29 STEP 2576 H=2576:00 +CPU= 25.475
  23:59:05 STEP 2577 H=2577:00 +CPU= 35.973
  23:59:30 STEP 2578 H=2578:00 +CPU= 24.809
  23:59:54 STEP 2579 H=2579:00 +CPU= 23.973
  00:00:35 STEP 2580 H=2580:00 +CPU= 40.692
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002580
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002580
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002580
  00:00:59 STEP 2581 H=2581:00 +CPU= 24.106
  00:01:25 STEP 2582 H=2582:00 +CPU= 25.043
  00:02:02 STEP 2583 H=2583:00 +CPU= 36.131
  00:02:34 STEP 2584 H=2584:00 +CPU= 31.825
  00:03:04 STEP 2585 H=2585:00 +CPU= 29.849
  00:03:42 STEP 2586 H=2586:00 +CPU= 37.855
  00:04:12 STEP 2587 H=2587:00 +CPU= 29.987
  00:04:37 STEP 2588 H=2588:00 +CPU= 25.292
  00:05:15 STEP 2589 H=2589:00 +CPU= 36.884
  00:05:43 STEP 2590 H=2590:00 +CPU= 26.660
  00:06:10 STEP 2591 H=2591:00 +CPU= 25.238
  00:06:55 STEP 2592 H=2592:00 +CPU= 42.891
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002592
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002592
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002592
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMGGhq0f+002568
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMSHhq0f+002568
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMUAhq0f+002568
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMGGhq0f+002580
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMSHhq0f+002580
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMUAhq0f+002580
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0273_2014050100_123_983_12199917_1_r754585437_107.zip
Uploading the intermediate file: upload_file_107.zip
  00:07:19 STEP 2593 H=2593:00 +CPU= 23.622
  00:07:44 STEP 2594 H=2594:00 +CPU= 24.987
  00:08:24 STEP 2595 H=2595:00 +CPU= 39.776
  00:08:51 STEP 2596 H=2596:00 +CPU= 26.947
  00:09:16 STEP 2597 H=2597:00 +CPU= 24.932
  00:09:54 STEP 2598 H=2598:00 +CPU= 37.747
  00:10:19 STEP 2599 H=2599:00 +CPU= 24.469
  00:10:45 STEP 2600 H=2600:00 +CPU= 26.120
  00:11:27 STEP 2601 H=2601:00 +CPU= 41.733
  00:11:54 STEP 2602 H=2602:00 +CPU= 25.250
  00:12:18 STEP 2603 H=2603:00 +CPU= 24.270
  00:12:59 STEP 2604 H=2604:00 +CPU= 40.834
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002604
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002604
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002604
  00:13:23 STEP 2605 H=2605:00 +CPU= 23.889
  00:13:48 STEP 2606 H=2606:00 +CPU= 24.940
  00:14:25 STEP 2607 H=2607:00 +CPU= 36.626
  00:14:52 STEP 2608 H=2608:00 +CPU= 26.444
  00:15:16 STEP 2609 H=2609:00 +CPU= 24.231
  00:15:53 STEP 2610 H=2610:00 +CPU= 37.254
  00:16:23 STEP 2611 H=2611:00 +CPU= 29.190
  00:16:54 STEP 2612 H=2612:00 +CPU= 30.022
  00:17:39 STEP 2613 H=2613:00 +CPU= 44.483
  00:18:05 STEP 2614 H=2614:00 +CPU= 26.162
  00:18:30 STEP 2615 H=2615:00 +CPU= 24.647
  00:19:26 STEP 2616 H=2616:00 +CPU= 54.843
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002616
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002616
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002616
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMGGhq0f+002592
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMSHhq0f+002592
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMUAhq0f+002592
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMGGhq0f+002604
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMSHhq0f+002604
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMUAhq0f+002604
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0273_2014050100_123_983_12199917_1_r754585437_108.zip
Uploading the intermediate file: upload_file_108.zip
  00:19:56 STEP 2617 H=2617:00 +CPU= 29.556
  00:20:24 STEP 2618 H=2618:00 +CPU= 27.970
  00:21:01 STEP 2619 H=2619:00 +CPU= 37.062
  00:21:31 STEP 2620 H=2620:00 +CPU= 29.853
  00:21:59 STEP 2621 H=2621:00 +CPU= 25.960
  00:22:47 STEP 2622 H=2622:00 +CPU= 48.273
  00:23:14 STEP 2623 H=2623:00 +CPU= 26.518
  00:23:39 STEP 2624 H=2624:00 +CPU= 24.710
  00:24:16 STEP 2625 H=2625:00 +CPU= 36.841
  00:24:41 STEP 2626 H=2626:00 +CPU= 24.776
  00:25:05 STEP 2627 H=2627:00 +CPU= 23.935
  00:25:46 STEP 2628 H=2628:00 +CPU= 40.799
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002628
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002628
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002628
  00:26:10 STEP 2629 H=2629:00 +CPU= 23.695
  00:26:34 STEP 2630 H=2630:00 +CPU= 24.566
  00:27:12 STEP 2631 H=2631:00 +CPU= 36.721
  00:27:37 STEP 2632 H=2632:00 +CPU= 24.549
  00:28:03 STEP 2633 H=2633:00 +CPU= 26.252
  00:28:41 STEP 2634 H=2634:00 +CPU= 37.492
  00:29:05 STEP 2635 H=2635:00 +CPU= 23.278
  00:29:31 STEP 2636 H=2636:00 +CPU= 25.819
  00:30:18 STEP 2637 H=2637:00 +CPU= 46.956
  00:30:45 STEP 2638 H=2638:00 +CPU= 26.952
  00:31:13 STEP 2639 H=2639:00 +CPU= 27.160
  00:32:08 STEP 2640 H=2640:00 +CPU= 52.241
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002640
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002640
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002640
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMGGhq0f+002616
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMSHhq0f+002616
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMUAhq0f+002616
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMGGhq0f+002628
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMSHhq0f+002628
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12199917/ICMUAhq0f+002628
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0273_2014050100_123_983_12199917_1_r754585437_109.zip
Uploading the intermediate file: upload_file_109.zip
  00:32:33 STEP 2641 H=2641:00 +CPU= 23.679
Uploading trickle at timestep: 9504000
  00:32:57 STEP 2642 H=2642:00 +CPU= 24.573
  00:33:36 STEP 2643 H=2643:00 +CPU= 38.760
  00:34:06 STEP 2644 H=2644:00 +CPU= 29.797
  00:34:31 STEP 2645 H=2645:00 +CPU= 24.262
  00:35:10 STEP 2646 H=2646:00 +CPU= 38.900
  00:35:36 STEP 2647 H=2647:00 +CPU= 23.767
  00:36:04 STEP 2648 H=2648:00 +CPU= 26.341
  00:36:47 STEP 2649 H=2649:00 +CPU= 42.526
  00:37:12 STEP 2650 H=2650:00 +CPU= 24.254
  00:37:36 STEP 2651 H=2651:00 +CPU= 23.921
  00:38:22 STEP 2652 H=2652:00 +CPU= 45.731
Moving to projects directory: /var/lib/boinc/slots/4/ICMGGhq0f+002652
Moving to projects directory: /var/lib/boinc/slots/4/ICMSHhq0f+002652
Moving to projects directory: /var/lib/boinc/slots/4/ICMUAhq0f+002652
  00:38:50 STEP 2653 H=2653:00 +CPU= 27.243
  00:39:18 STEP 2654 H=2654:00 +CPU= 26.822
  00:39:58 STEP 2655 H=2655:00 +CPU= 39.693
  00:40:26 STEP 2656 H=2656:00 +CPU= 28.209
  00:40:55 STEP 2657 H=2657:00 +CPU= 28.623
The child process terminated with status: 0
..Failed, model did not complete successfully

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:23:51 1463556 22298458 oifs_43r3_ps_0273_2014050100_123_983_12199917_1 9,504,000 81,145 0.0085
09 May 2023 16:23:42 1463556 22298458 oifs_43r3_ps_0273_2014050100_123_983_12199917_1 8,640,000 73,734 0.0085
09 May 2023 16:23:33 1463556 22298458 oifs_43r3_ps_0273_2014050100_123_983_12199917_1 7,776,000 66,211 0.0085
09 May 2023 16:23:23 1463556 22298458 oifs_43r3_ps_0273_2014050100_123_983_12199917_1 6,912,000 58,820 0.0085
09 May 2023 16:23:14 1463556 22298458 oifs_43r3_ps_0273_2014050100_123_983_12199917_1 6,048,000 51,408 0.0085
09 May 2023 16:23:04 1463556 22298458 oifs_43r3_ps_0273_2014050100_123_983_12199917_1 5,184,000 43,953 0.0085
09 May 2023 16:22:54 1463556 22298458 oifs_43r3_ps_0273_2014050100_123_983_12199917_1 4,320,000 36,539 0.0085
09 May 2023 16:22:45 1463556 22298458 oifs_43r3_ps_0273_2014050100_123_983_12199917_1 3,456,000 29,004 0.0084
09 May 2023 16:22:36 1463556 22298458 oifs_43r3_ps_0273_2014050100_123_983_12199917_1 2,592,000 21,671 0.0084
09 May 2023 16:22:27 1463556 22298458 oifs_43r3_ps_0273_2014050100_123_983_12199917_1 1,728,000 14,258 0.0083
09 May 2023 16:22:19 1463556 22298458 oifs_43r3_ps_0273_2014050100_123_983_12199917_1 864,000 7,158 0.0083


©2024 climateprediction.net