climateprediction.net home page
Task 22262925

Task 22262925

Name oifs_43r3_ps_0441_1992050100_123_961_12178085_0
Workunit 12178085
Created 22 Dec 2022, 0:27:54 UTC
Sent 22 Dec 2022, 0:31:32 UTC
Report deadline 21 Jan 2023, 0:31:32 UTC
Received 9 Jan 2023, 11:24:02 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 1 (0x00000001) Unknown error code
Computer ID 1512045
Run time 17 hours 26 min 40 sec
CPU time 16 hours 57 min 29 sec
Validate state Invalid
Credit 12,942.72
Device peak FLOPS 4.92 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,419.23 MB
Peak swap size 4,978.07 MB
Peak disk usage 3,726.73 MB
Stderr
<core_client_version>7.16.6</core_client_version>
<![CDATA[
<message>
process exited with code 1 (0x1, -255)</message>
<stderr_txt>
ICMUAhq0f+002088
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMGGhq0f+002100
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMSHhq0f+002100
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMUAhq0f+002100
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0441_1992050100_123_961_12178085_0_r1492906834_87.zip
Uploading the intermediate file: upload_file_87.zip
  17:22:18 STEP 2113 H=2113:00 +CPU= 21.281
  17:22:41 STEP 2114 H=2114:00 +CPU= 22.325
  17:23:14 STEP 2115 H=2115:00 +CPU= 32.190
  17:23:34 STEP 2116 H=2116:00 +CPU= 19.386
  17:23:53 STEP 2117 H=2117:00 +CPU= 19.055
  17:24:24 STEP 2118 H=2118:00 +CPU= 30.093
  17:24:44 STEP 2119 H=2119:00 +CPU= 19.750
  17:25:04 STEP 2120 H=2120:00 +CPU= 19.321
  17:25:34 STEP 2121 H=2121:00 +CPU= 29.433
  17:25:54 STEP 2122 H=2122:00 +CPU= 19.268
  17:26:13 STEP 2123 H=2123:00 +CPU= 18.972
  17:26:51 STEP 2124 H=2124:00 +CPU= 32.402
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002124
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002124
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002124
  17:27:11 STEP 2125 H=2125:00 +CPU= 19.036
  17:27:31 STEP 2126 H=2126:00 +CPU= 19.381
  17:28:06 STEP 2127 H=2127:00 +CPU= 34.072
  17:28:29 STEP 2128 H=2128:00 +CPU= 22.440
  17:28:52 STEP 2129 H=2129:00 +CPU= 22.987
  17:29:30 STEP 2130 H=2130:00 +CPU= 36.858
  17:29:51 STEP 2131 H=2131:00 +CPU= 20.543
  17:30:11 STEP 2132 H=2132:00 +CPU= 19.299
  17:30:41 STEP 2133 H=2133:00 +CPU= 29.711
  17:31:01 STEP 2134 H=2134:00 +CPU= 19.270
  17:31:20 STEP 2135 H=2135:00 +CPU= 19.337
  17:31:56 STEP 2136 H=2136:00 +CPU= 34.154
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002136
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002136
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002136
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMGGhq0f+002112
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMSHhq0f+002112
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMUAhq0f+002112
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMGGhq0f+002124
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMSHhq0f+002124
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMUAhq0f+002124
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0441_1992050100_123_961_12178085_0_r1492906834_88.zip
Uploading the intermediate file: upload_file_88.zip
  17:32:17 STEP 2137 H=2137:00 +CPU= 18.759
  17:32:36 STEP 2138 H=2138:00 +CPU= 18.711
  17:33:06 STEP 2139 H=2139:00 +CPU= 29.747
  17:33:26 STEP 2140 H=2140:00 +CPU= 19.435
  17:33:45 STEP 2141 H=2141:00 +CPU= 19.102
  17:34:16 STEP 2142 H=2142:00 +CPU= 30.174
  17:34:36 STEP 2143 H=2143:00 +CPU= 18.825
  17:34:55 STEP 2144 H=2144:00 +CPU= 18.985
  17:35:26 STEP 2145 H=2145:00 +CPU= 29.643
  17:35:45 STEP 2146 H=2146:00 +CPU= 19.228
  17:36:05 STEP 2147 H=2147:00 +CPU= 18.973
  17:36:38 STEP 2148 H=2148:00 +CPU= 32.086
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002148
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002148
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002148
  17:36:57 STEP 2149 H=2149:00 +CPU= 18.834
  17:37:17 STEP 2150 H=2150:00 +CPU= 18.737
  17:37:47 STEP 2151 H=2151:00 +CPU= 29.017
  17:38:07 STEP 2152 H=2152:00 +CPU= 19.881
  17:38:27 STEP 2153 H=2153:00 +CPU= 18.417
  17:38:57 STEP 2154 H=2154:00 +CPU= 29.414
  17:39:16 STEP 2155 H=2155:00 +CPU= 18.649
  17:39:36 STEP 2156 H=2156:00 +CPU= 18.777
  17:40:05 STEP 2157 H=2157:00 +CPU= 29.058
  17:40:25 STEP 2158 H=2158:00 +CPU= 18.959
  17:40:45 STEP 2159 H=2159:00 +CPU= 19.243
  17:41:21 STEP 2160 H=2160:00 +CPU= 33.906
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002160
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002160
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002160
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMGGhq0f+002136
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMSHhq0f+002136
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMUAhq0f+002136
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMGGhq0f+002148
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMSHhq0f+002148
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMUAhq0f+002148
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0441_1992050100_123_961_12178085_0_r1492906834_89.zip
Uploading the intermediate file: upload_file_89.zip
  17:41:40 STEP 2161 H=2161:00 +CPU= 18.544
  17:42:00 STEP 2162 H=2162:00 +CPU= 18.788
  17:42:30 STEP 2163 H=2163:00 +CPU= 29.314
  17:42:50 STEP 2164 H=2164:00 +CPU= 19.154
  17:43:09 STEP 2165 H=2165:00 +CPU= 18.717
  17:43:39 STEP 2166 H=2166:00 +CPU= 29.754
  17:43:58 STEP 2167 H=2167:00 +CPU= 18.654
  17:44:18 STEP 2168 H=2168:00 +CPU= 19.395
  17:44:49 STEP 2169 H=2169:00 +CPU= 29.289
  17:45:08 STEP 2170 H=2170:00 +CPU= 19.062
  17:45:27 STEP 2171 H=2171:00 +CPU= 18.581
  17:46:00 STEP 2172 H=2172:00 +CPU= 32.029
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002172
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002172
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002172
  17:46:19 STEP 2173 H=2173:00 +CPU= 18.649
  17:46:39 STEP 2174 H=2174:00 +CPU= 19.035
  17:47:09 STEP 2175 H=2175:00 +CPU= 29.272
  17:47:28 STEP 2176 H=2176:00 +CPU= 18.956
  17:47:47 STEP 2177 H=2177:00 +CPU= 18.494
  17:48:17 STEP 2178 H=2178:00 +CPU= 29.433
  17:48:36 STEP 2179 H=2179:00 +CPU= 18.810
  17:48:55 STEP 2180 H=2180:00 +CPU= 19.035
  17:49:24 STEP 2181 H=2181:00 +CPU= 28.900
  17:49:44 STEP 2182 H=2182:00 +CPU= 19.210
  17:50:04 STEP 2183 H=2183:00 +CPU= 19.754
  17:50:40 STEP 2184 H=2184:00 +CPU= 34.136
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002184
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002184
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002184
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMGGhq0f+002160
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMSHhq0f+002160
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMUAhq0f+002160
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMGGhq0f+002172
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMSHhq0f+002172
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMUAhq0f+002172
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0441_1992050100_123_961_12178085_0_r1492906834_90.zip
Uploading the intermediate file: upload_file_90.zip
  17:50:59 STEP 2185 H=2185:00 +CPU= 18.289
  17:51:19 STEP 2186 H=2186:00 +CPU= 19.007
  17:51:48 STEP 2187 H=2187:00 +CPU= 28.644
  17:52:07 STEP 2188 H=2188:00 +CPU= 18.798
  17:52:26 STEP 2189 H=2189:00 +CPU= 18.850
  17:52:57 STEP 2190 H=2190:00 +CPU= 29.831
  17:53:16 STEP 2191 H=2191:00 +CPU= 18.397
  17:53:36 STEP 2192 H=2192:00 +CPU= 18.957
  17:54:05 STEP 2193 H=2193:00 +CPU= 28.956
  17:54:25 STEP 2194 H=2194:00 +CPU= 19.162
  17:54:44 STEP 2195 H=2195:00 +CPU= 18.833
  17:55:17 STEP 2196 H=2196:00 +CPU= 31.906
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002196
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002196
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002196
  17:55:36 STEP 2197 H=2197:00 +CPU= 18.339
  17:55:55 STEP 2198 H=2198:00 +CPU= 19.002
  17:56:25 STEP 2199 H=2199:00 +CPU= 28.919
  17:56:44 STEP 2200 H=2200:00 +CPU= 18.886
  17:57:03 STEP 2201 H=2201:00 +CPU= 18.418
  17:57:33 STEP 2202 H=2202:00 +CPU= 29.445
  17:57:52 STEP 2203 H=2203:00 +CPU= 18.458
  17:58:12 STEP 2204 H=2204:00 +CPU= 18.949
  17:58:42 STEP 2205 H=2205:00 +CPU= 29.395
  17:59:02 STEP 2206 H=2206:00 +CPU= 18.704
  17:59:22 STEP 2207 H=2207:00 +CPU= 18.990
  17:59:57 STEP 2208 H=2208:00 +CPU= 34.382
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002208
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002208
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002208
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMGGhq0f+002184
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMSHhq0f+002184
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMUAhq0f+002184
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMGGhq0f+002196
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMSHhq0f+002196
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMUAhq0f+002196
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0441_1992050100_123_961_12178085_0_r1492906834_91.zip
Uploading the intermediate file: upload_file_91.zip
  18:00:16 STEP 2209 H=2209:00 +CPU= 18.604
  18:00:36 STEP 2210 H=2210:00 +CPU= 18.887
  18:01:06 STEP 2211 H=2211:00 +CPU= 29.388
  18:01:25 STEP 2212 H=2212:00 +CPU= 18.916
  18:01:44 STEP 2213 H=2213:00 +CPU= 18.651
  18:02:15 STEP 2214 H=2214:00 +CPU= 30.183
  18:02:33 STEP 2215 H=2215:00 +CPU= 18.362
  18:02:53 STEP 2216 H=2216:00 +CPU= 18.826
  18:03:23 STEP 2217 H=2217:00 +CPU= 29.330
  18:03:42 STEP 2218 H=2218:00 +CPU= 18.982
  18:04:01 STEP 2219 H=2219:00 +CPU= 18.918
  18:04:34 STEP 2220 H=2220:00 +CPU= 32.205
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002220
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002220
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002220
  18:04:53 STEP 2221 H=2221:00 +CPU= 18.582
  18:05:12 STEP 2222 H=2222:00 +CPU= 19.079
  18:05:42 STEP 2223 H=2223:00 +CPU= 29.171
  18:06:01 STEP 2224 H=2224:00 +CPU= 18.963
  18:06:19 STEP 2225 H=2225:00 +CPU= 18.314
  18:06:50 STEP 2226 H=2226:00 +CPU= 29.675
  18:07:08 STEP 2227 H=2227:00 +CPU= 18.490
  18:07:28 STEP 2228 H=2228:00 +CPU= 18.874
  18:07:57 STEP 2229 H=2229:00 +CPU= 29.058
  18:08:16 STEP 2230 H=2230:00 +CPU= 18.921
  18:08:36 STEP 2231 H=2231:00 +CPU= 19.236
  18:09:12 STEP 2232 H=2232:00 +CPU= 34.338
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002232
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002232
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002232
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMGGhq0f+002208
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMSHhq0f+002208
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMUAhq0f+002208
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMGGhq0f+002220
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMSHhq0f+002220
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMUAhq0f+002220
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0441_1992050100_123_961_12178085_0_r1492906834_92.zip
Uploading the intermediate file: upload_file_92.zip
  18:09:30 STEP 2233 H=2233:00 +CPU= 18.352
  18:09:51 STEP 2234 H=2234:00 +CPU= 19.388
  18:10:20 STEP 2235 H=2235:00 +CPU= 29.153
  18:10:39 STEP 2236 H=2236:00 +CPU= 18.778
  18:10:59 STEP 2237 H=2237:00 +CPU= 18.771
  18:11:29 STEP 2238 H=2238:00 +CPU= 29.274
  18:11:48 STEP 2239 H=2239:00 +CPU= 18.494
  18:12:07 STEP 2240 H=2240:00 +CPU= 18.418
  18:12:37 STEP 2241 H=2241:00 +CPU= 29.001
  18:12:56 STEP 2242 H=2242:00 +CPU= 18.557
  18:13:15 STEP 2243 H=2243:00 +CPU= 18.450
  18:13:48 STEP 2244 H=2244:00 +CPU= 31.524
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002244
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002244
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002244
  18:14:07 STEP 2245 H=2245:00 +CPU= 18.153
  18:14:27 STEP 2246 H=2246:00 +CPU= 19.121
  18:14:57 STEP 2247 H=2247:00 +CPU= 29.365
  18:15:16 STEP 2248 H=2248:00 +CPU= 18.505
  18:15:35 STEP 2249 H=2249:00 +CPU= 18.385
  18:16:05 STEP 2250 H=2250:00 +CPU= 29.725
  18:16:24 STEP 2251 H=2251:00 +CPU= 18.249
  18:16:43 STEP 2252 H=2252:00 +CPU= 18.671
  18:17:14 STEP 2253 H=2253:00 +CPU= 29.163
  18:17:33 STEP 2254 H=2254:00 +CPU= 18.381
  18:17:53 STEP 2255 H=2255:00 +CPU= 19.179
  18:18:29 STEP 2256 H=2256:00 +CPU= 34.465
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002256
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002256
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002256
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMGGhq0f+002232
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMSHhq0f+002232
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMUAhq0f+002232
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMGGhq0f+002244
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMSHhq0f+002244
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMUAhq0f+002244
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0441_1992050100_123_961_12178085_0_r1492906834_93.zip
Uploading the intermediate file: upload_file_93.zip
  18:18:48 STEP 2257 H=2257:00 +CPU= 18.282
  18:19:07 STEP 2258 H=2258:00 +CPU= 19.039
  18:19:38 STEP 2259 H=2259:00 +CPU= 29.595
  18:19:57 STEP 2260 H=2260:00 +CPU= 18.492
  18:20:16 STEP 2261 H=2261:00 +CPU= 18.765
  18:20:46 STEP 2262 H=2262:00 +CPU= 29.734
  18:21:04 STEP 2263 H=2263:00 +CPU= 18.090
  18:21:24 STEP 2264 H=2264:00 +CPU= 19.182
  18:21:54 STEP 2265 H=2265:00 +CPU= 29.367
  18:22:13 STEP 2266 H=2266:00 +CPU= 18.674
  18:22:33 STEP 2267 H=2267:00 +CPU= 18.748
  18:23:05 STEP 2268 H=2268:00 +CPU= 32.178
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002268
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002268
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002268
  18:23:24 STEP 2269 H=2269:00 +CPU= 18.134
  18:23:43 STEP 2270 H=2270:00 +CPU= 19.105
  18:24:13 STEP 2271 H=2271:00 +CPU= 29.302
  18:24:32 STEP 2272 H=2272:00 +CPU= 18.704
  18:24:51 STEP 2273 H=2273:00 +CPU= 18.496
  18:25:22 STEP 2274 H=2274:00 +CPU= 29.711
  18:25:40 STEP 2275 H=2275:00 +CPU= 18.019
  18:25:59 STEP 2276 H=2276:00 +CPU= 18.803
  18:26:29 STEP 2277 H=2277:00 +CPU= 29.296
  18:26:48 STEP 2278 H=2278:00 +CPU= 18.578
  18:27:08 STEP 2279 H=2279:00 +CPU= 18.865
  18:27:44 STEP 2280 H=2280:00 +CPU= 34.194
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002280
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002280
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002280
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMGGhq0f+002256
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMSHhq0f+002256
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMUAhq0f+002256
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMGGhq0f+002268
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMSHhq0f+002268
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMUAhq0f+002268
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0441_1992050100_123_961_12178085_0_r1492906834_94.zip
Uploading the intermediate file: upload_file_94.zip
  18:28:03 STEP 2281 H=2281:00 +CPU= 18.379
  18:28:23 STEP 2282 H=2282:00 +CPU= 19.131
  18:28:52 STEP 2283 H=2283:00 +CPU= 29.026
  18:29:12 STEP 2284 H=2284:00 +CPU= 18.828
  18:29:30 STEP 2285 H=2285:00 +CPU= 18.476
  18:30:00 STEP 2286 H=2286:00 +CPU= 29.701
  18:30:20 STEP 2287 H=2287:00 +CPU= 18.740
  18:30:39 STEP 2288 H=2288:00 +CPU= 19.067
  18:31:09 STEP 2289 H=2289:00 +CPU= 29.269
  18:31:28 STEP 2290 H=2290:00 +CPU= 19.106
  18:31:47 STEP 2291 H=2291:00 +CPU= 18.619
  18:32:20 STEP 2292 H=2292:00 +CPU= 32.334
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002292
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002292
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002292
  18:32:39 STEP 2293 H=2293:00 +CPU= 18.760
  18:32:58 STEP 2294 H=2294:00 +CPU= 19.077
  18:33:28 STEP 2295 H=2295:00 +CPU= 29.288
  18:33:48 STEP 2296 H=2296:00 +CPU= 19.275
  18:34:07 STEP 2297 H=2297:00 +CPU= 18.415
  18:34:38 STEP 2298 H=2298:00 +CPU= 29.727
  18:34:57 STEP 2299 H=2299:00 +CPU= 18.333
  18:35:16 STEP 2300 H=2300:00 +CPU= 18.695
  18:35:46 STEP 2301 H=2301:00 +CPU= 29.041
  18:36:05 STEP 2302 H=2302:00 +CPU= 18.429
  18:36:27 STEP 2303 H=2303:00 +CPU= 18.426
  18:37:02 STEP 2304 H=2304:00 +CPU= 34.366
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002304
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002304
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002304
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMGGhq0f+002280
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMSHhq0f+002280
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMUAhq0f+002280
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMGGhq0f+002292
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMSHhq0f+002292
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMUAhq0f+002292
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0441_1992050100_123_961_12178085_0_r1492906834_95.zip
Uploading the intermediate file: upload_file_95.zip
  18:37:21 STEP 2305 H=2305:00 +CPU= 18.143
  18:37:41 STEP 2306 H=2306:00 +CPU= 18.610
  18:38:11 STEP 2307 H=2307:00 +CPU= 29.381
  18:38:30 STEP 2308 H=2308:00 +CPU= 18.703
  18:38:49 STEP 2309 H=2309:00 +CPU= 18.382
  18:39:19 STEP 2310 H=2310:00 +CPU= 29.714
  18:39:38 STEP 2311 H=2311:00 +CPU= 18.201
  18:39:57 STEP 2312 H=2312:00 +CPU= 18.741
  18:40:27 STEP 2313 H=2313:00 +CPU= 29.434
  18:40:46 STEP 2314 H=2314:00 +CPU= 18.452
  18:41:05 STEP 2315 H=2315:00 +CPU= 18.201
  18:41:37 STEP 2316 H=2316:00 +CPU= 32.208
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002316
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002316
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002316
  18:41:56 STEP 2317 H=2317:00 +CPU= 18.127
  18:42:15 STEP 2318 H=2318:00 +CPU= 19.041
  18:42:45 STEP 2319 H=2319:00 +CPU= 29.441
  18:43:04 STEP 2320 H=2320:00 +CPU= 18.678
  18:43:24 STEP 2321 H=2321:00 +CPU= 18.703
  18:43:54 STEP 2322 H=2322:00 +CPU= 30.068
  18:44:13 STEP 2323 H=2323:00 +CPU= 18.210
  18:44:32 STEP 2324 H=2324:00 +CPU= 18.892
  18:45:02 STEP 2325 H=2325:00 +CPU= 29.640
  18:45:21 STEP 2326 H=2326:00 +CPU= 18.785
  18:45:41 STEP 2327 H=2327:00 +CPU= 18.950
  18:46:17 STEP 2328 H=2328:00 +CPU= 34.776
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002328
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002328
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002328
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMGGhq0f+002304
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMSHhq0f+002304
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMUAhq0f+002304
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMGGhq0f+002316
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMSHhq0f+002316
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMUAhq0f+002316
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0441_1992050100_123_961_12178085_0_r1492906834_96.zip
Uploading the intermediate file: upload_file_96.zip
  18:46:36 STEP 2329 H=2329:00 +CPU= 18.347
Uploading trickle at timestep: 8380800
  18:46:55 STEP 2330 H=2330:00 +CPU= 18.624
  18:47:25 STEP 2331 H=2331:00 +CPU= 29.167
  18:47:44 STEP 2332 H=2332:00 +CPU= 18.692
  18:48:03 STEP 2333 H=2333:00 +CPU= 18.475
  18:48:33 STEP 2334 H=2334:00 +CPU= 29.761
  18:48:52 STEP 2335 H=2335:00 +CPU= 18.633
  18:49:11 STEP 2336 H=2336:00 +CPU= 18.974
  18:49:41 STEP 2337 H=2337:00 +CPU= 29.253
  18:50:00 STEP 2338 H=2338:00 +CPU= 18.797
  18:50:19 STEP 2339 H=2339:00 +CPU= 18.620
  18:50:52 STEP 2340 H=2340:00 +CPU= 32.370
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002340
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002340
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002340
  18:51:11 STEP 2341 H=2341:00 +CPU= 18.272
  18:51:31 STEP 2342 H=2342:00 +CPU= 19.051
  18:52:01 STEP 2343 H=2343:00 +CPU= 29.348
  18:52:20 STEP 2344 H=2344:00 +CPU= 18.757
  18:52:39 STEP 2345 H=2345:00 +CPU= 18.270
  18:53:10 STEP 2346 H=2346:00 +CPU= 29.950
  18:53:29 STEP 2347 H=2347:00 +CPU= 18.460
  18:53:48 STEP 2348 H=2348:00 +CPU= 18.753
  18:54:18 STEP 2349 H=2349:00 +CPU= 29.348
  18:54:37 STEP 2350 H=2350:00 +CPU= 18.611
  18:54:56 STEP 2351 H=2351:00 +CPU= 18.796
  18:55:32 STEP 2352 H=2352:00 +CPU= 34.125
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002352
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002352
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002352
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMGGhq0f+002328
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMSHhq0f+002328
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMUAhq0f+002328
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMGGhq0f+002340
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMSHhq0f+002340
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMUAhq0f+002340
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0441_1992050100_123_961_12178085_0_r1492906834_97.zip
Uploading the intermediate file: upload_file_97.zip
  18:55:51 STEP 2353 H=2353:00 +CPU= 18.270
  18:56:11 STEP 2354 H=2354:00 +CPU= 18.994
  18:56:41 STEP 2355 H=2355:00 +CPU= 29.503
  18:57:00 STEP 2356 H=2356:00 +CPU= 18.816
  18:57:19 STEP 2357 H=2357:00 +CPU= 18.668
  18:57:50 STEP 2358 H=2358:00 +CPU= 29.646
  18:58:08 STEP 2359 H=2359:00 +CPU= 18.287
  18:58:28 STEP 2360 H=2360:00 +CPU= 19.267
  18:58:58 STEP 2361 H=2361:00 +CPU= 29.255
  18:59:17 STEP 2362 H=2362:00 +CPU= 18.856
  18:59:36 STEP 2363 H=2363:00 +CPU= 18.554
  19:00:09 STEP 2364 H=2364:00 +CPU= 32.370
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002364
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002364
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002364
  19:00:27 STEP 2365 H=2365:00 +CPU= 17.896
  19:00:47 STEP 2366 H=2366:00 +CPU= 19.082
  19:01:17 STEP 2367 H=2367:00 +CPU= 29.363
  19:01:36 STEP 2368 H=2368:00 +CPU= 18.664
  19:01:55 STEP 2369 H=2369:00 +CPU= 18.268
  19:02:25 STEP 2370 H=2370:00 +CPU= 30.093
  19:02:44 STEP 2371 H=2371:00 +CPU= 18.193
  19:03:03 STEP 2372 H=2372:00 +CPU= 19.073
  19:03:33 STEP 2373 H=2373:00 +CPU= 29.539
  19:03:52 STEP 2374 H=2374:00 +CPU= 18.707
  19:04:11 STEP 2375 H=2375:00 +CPU= 18.692
  19:04:47 STEP 2376 H=2376:00 +CPU= 34.301
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002376
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002376
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMGGhq0f+002352
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMSHhq0f+002352
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMUAhq0f+002352
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMGGhq0f+002364
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMSHhq0f+002364
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMUAhq0f+002364
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0441_1992050100_123_961_12178085_0_r1492906834_98.zip
Uploading the intermediate file: upload_file_98.zip
  19:05:06 STEP 2377 H=2377:00 +CPU= 17.979
  19:05:25 STEP 2378 H=2378:00 +CPU= 18.763
  19:05:54 STEP 2379 H=2379:00 +CPU= 29.201
  19:06:14 STEP 2380 H=2380:00 +CPU= 18.898
  19:06:32 STEP 2381 H=2381:00 +CPU= 18.212
  19:07:02 STEP 2382 H=2382:00 +CPU= 29.691
  19:07:21 STEP 2383 H=2383:00 +CPU= 18.241
  19:07:40 STEP 2384 H=2384:00 +CPU= 19.070
  19:08:10 STEP 2385 H=2385:00 +CPU= 29.489
  19:08:29 STEP 2386 H=2386:00 +CPU= 18.601
  19:08:48 STEP 2387 H=2387:00 +CPU= 18.636
  19:09:21 STEP 2388 H=2388:00 +CPU= 32.816
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002388
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002388
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002388
  19:09:40 STEP 2389 H=2389:00 +CPU= 18.287
  19:10:00 STEP 2390 H=2390:00 +CPU= 19.040
  19:10:29 STEP 2391 H=2391:00 +CPU= 29.246
  19:10:48 STEP 2392 H=2392:00 +CPU= 18.680
  19:11:08 STEP 2393 H=2393:00 +CPU= 19.020
  19:11:39 STEP 2394 H=2394:00 +CPU= 29.830
  19:11:57 STEP 2395 H=2395:00 +CPU= 18.014
  19:12:17 STEP 2396 H=2396:00 +CPU= 18.773
  19:12:47 STEP 2397 H=2397:00 +CPU= 29.151
  19:13:06 STEP 2398 H=2398:00 +CPU= 18.225
  19:13:25 STEP 2399 H=2399:00 +CPU= 18.848
  19:14:01 STEP 2400 H=2400:00 +CPU= 34.033
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002400
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002400
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMGGhq0f+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMSHhq0f+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMUAhq0f+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMGGhq0f+002388
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMSHhq0f+002388
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMUAhq0f+002388
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0441_1992050100_123_961_12178085_0_r1492906834_99.zip
Uploading the intermediate file: upload_file_99.zip
  19:14:20 STEP 2401 H=2401:00 +CPU= 18.499
  19:14:40 STEP 2402 H=2402:00 +CPU= 18.918
  19:15:10 STEP 2403 H=2403:00 +CPU= 29.311
  19:15:29 STEP 2404 H=2404:00 +CPU= 18.597
  19:15:48 STEP 2405 H=2405:00 +CPU= 18.488
  19:16:19 STEP 2406 H=2406:00 +CPU= 30.582
  19:16:37 STEP 2407 H=2407:00 +CPU= 18.265
  19:16:57 STEP 2408 H=2408:00 +CPU= 18.823
  19:17:27 STEP 2409 H=2409:00 +CPU= 29.619
  19:17:45 STEP 2410 H=2410:00 +CPU= 18.532
  19:18:05 STEP 2411 H=2411:00 +CPU= 18.592
  19:18:37 STEP 2412 H=2412:00 +CPU= 32.582
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002412
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002412
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002412
  19:18:56 STEP 2413 H=2413:00 +CPU= 18.411
  19:19:15 STEP 2414 H=2414:00 +CPU= 18.962
  19:19:45 STEP 2415 H=2415:00 +CPU= 29.585
  19:20:04 STEP 2416 H=2416:00 +CPU= 18.354
  19:20:23 STEP 2417 H=2417:00 +CPU= 18.419
  19:20:53 STEP 2418 H=2418:00 +CPU= 29.782
  19:21:11 STEP 2419 H=2419:00 +CPU= 18.103
  19:21:30 STEP 2420 H=2420:00 +CPU= 18.899
  19:22:00 STEP 2421 H=2421:00 +CPU= 29.421
  19:22:19 STEP 2422 H=2422:00 +CPU= 18.436
  19:22:39 STEP 2423 H=2423:00 +CPU= 18.859
  19:23:16 STEP 2424 H=2424:00 +CPU= 35.049
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002424
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002424
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMGGhq0f+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMSHhq0f+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMUAhq0f+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMGGhq0f+002412
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMSHhq0f+002412
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMUAhq0f+002412
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0441_1992050100_123_961_12178085_0_r1492906834_100.zip
Uploading the intermediate file: upload_file_100.zip
  19:23:36 STEP 2425 H=2425:00 +CPU= 19.960
  19:24:02 STEP 2426 H=2426:00 +CPU= 24.007
  19:24:38 STEP 2427 H=2427:00 +CPU= 34.917
  19:25:00 STEP 2428 H=2428:00 +CPU= 21.581
  19:25:19 STEP 2429 H=2429:00 +CPU= 19.149
  19:25:54 STEP 2430 H=2430:00 +CPU= 33.844
  19:26:14 STEP 2431 H=2431:00 +CPU= 20.058
  19:26:35 STEP 2432 H=2432:00 +CPU= 20.023
  19:27:07 STEP 2433 H=2433:00 +CPU= 31.337
  19:27:27 STEP 2434 H=2434:00 +CPU= 19.529
  19:27:47 STEP 2435 H=2435:00 +CPU= 19.052
  19:28:22 STEP 2436 H=2436:00 +CPU= 34.271
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002436
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002436
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002436
  19:28:41 STEP 2437 H=2437:00 +CPU= 19.022
  19:29:02 STEP 2438 H=2438:00 +CPU= 20.307
  19:29:38 STEP 2439 H=2439:00 +CPU= 35.880
  19:29:58 STEP 2440 H=2440:00 +CPU= 19.523
  19:30:18 STEP 2441 H=2441:00 +CPU= 19.413
  19:30:51 STEP 2442 H=2442:00 +CPU= 32.995
  19:31:11 STEP 2443 H=2443:00 +CPU= 19.053
  19:31:32 STEP 2444 H=2444:00 +CPU= 21.230
  19:32:06 STEP 2445 H=2445:00 +CPU= 32.487
  19:32:30 STEP 2446 H=2446:00 +CPU= 23.150
  19:32:52 STEP 2447 H=2447:00 +CPU= 21.783
  19:33:32 STEP 2448 H=2448:00 +CPU= 37.042
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002448
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002448
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMGGhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMSHhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMUAhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMGGhq0f+002436
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMSHhq0f+002436
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMUAhq0f+002436
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0441_1992050100_123_961_12178085_0_r1492906834_101.zip
Uploading the intermediate file: upload_file_101.zip
  19:33:54 STEP 2449 H=2449:00 +CPU= 20.538
  19:34:31 STEP 2450 H=2450:00 +CPU= 33.133
  19:35:23 STEP 2451 H=2451:00 +CPU= 49.364
  19:35:53 STEP 2452 H=2452:00 +CPU= 28.821
  19:36:23 STEP 2453 H=2453:00 +CPU= 28.247
  19:36:56 STEP 2454 H=2454:00 +CPU= 32.289
  19:37:16 STEP 2455 H=2455:00 +CPU= 19.681
  19:37:36 STEP 2456 H=2456:00 +CPU= 19.522
  19:38:15 STEP 2457 H=2457:00 +CPU= 37.630
  19:38:39 STEP 2458 H=2458:00 +CPU= 22.641
  19:39:01 STEP 2459 H=2459:00 +CPU= 21.655
  19:39:42 STEP 2460 H=2460:00 +CPU= 39.617
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002460
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002460
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002460
  19:40:02 STEP 2461 H=2461:00 +CPU= 19.814
  19:40:23 STEP 2462 H=2462:00 +CPU= 20.287
  19:40:54 STEP 2463 H=2463:00 +CPU= 30.625
  19:41:14 STEP 2464 H=2464:00 +CPU= 19.184
  19:41:35 STEP 2465 H=2465:00 +CPU= 20.263
  19:42:15 STEP 2466 H=2466:00 +CPU= 37.900
  19:42:34 STEP 2467 H=2467:00 +CPU= 18.891
  19:42:57 STEP 2468 H=2468:00 +CPU= 21.911
  19:43:32 STEP 2469 H=2469:00 +CPU= 34.604
  19:43:53 STEP 2470 H=2470:00 +CPU= 19.725
  19:44:13 STEP 2471 H=2471:00 +CPU= 18.956
  19:44:50 STEP 2472 H=2472:00 +CPU= 35.596
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002472
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002472
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMGGhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMSHhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMUAhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMGGhq0f+002460
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMSHhq0f+002460
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMUAhq0f+002460
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0441_1992050100_123_961_12178085_0_r1492906834_102.zip
Uploading the intermediate file: upload_file_102.zip
  19:45:10 STEP 2473 H=2473:00 +CPU= 18.795
  19:45:30 STEP 2474 H=2474:00 +CPU= 19.089
  19:46:01 STEP 2475 H=2475:00 +CPU= 29.728
  19:46:21 STEP 2476 H=2476:00 +CPU= 18.914
  19:46:40 STEP 2477 H=2477:00 +CPU= 18.701
  19:47:11 STEP 2478 H=2478:00 +CPU= 30.364
  19:47:36 STEP 2479 H=2479:00 +CPU= 17.802
  19:47:56 STEP 2480 H=2480:00 +CPU= 18.998
  19:48:27 STEP 2481 H=2481:00 +CPU= 30.418
  19:48:46 STEP 2482 H=2482:00 +CPU= 19.272
  19:49:06 STEP 2483 H=2483:00 +CPU= 18.761
  19:49:39 STEP 2484 H=2484:00 +CPU= 32.701
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002484
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002484
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002484
  19:49:57 STEP 2485 H=2485:00 +CPU= 18.396
  19:50:17 STEP 2486 H=2486:00 +CPU= 19.379
  19:50:48 STEP 2487 H=2487:00 +CPU= 29.856
  19:51:07 STEP 2488 H=2488:00 +CPU= 18.764
  19:51:26 STEP 2489 H=2489:00 +CPU= 18.611
  19:51:57 STEP 2490 H=2490:00 +CPU= 30.369
  19:52:16 STEP 2491 H=2491:00 +CPU= 18.346
  19:52:36 STEP 2492 H=2492:00 +CPU= 19.207
  19:53:06 STEP 2493 H=2493:00 +CPU= 29.925
  19:53:26 STEP 2494 H=2494:00 +CPU= 18.792
  19:53:45 STEP 2495 H=2495:00 +CPU= 18.922
  19:54:23 STEP 2496 H=2496:00 +CPU= 35.742
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002496
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002496
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMGGhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMSHhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMUAhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMGGhq0f+002484
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMSHhq0f+002484
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMUAhq0f+002484
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0441_1992050100_123_961_12178085_0_r1492906834_103.zip
Uploading the intermediate file: upload_file_103.zip
  19:54:42 STEP 2497 H=2497:00 +CPU= 18.530
  19:55:02 STEP 2498 H=2498:00 +CPU= 19.043
  19:55:32 STEP 2499 H=2499:00 +CPU= 29.836
  19:55:51 STEP 2500 H=2500:00 +CPU= 18.775
  19:56:10 STEP 2501 H=2501:00 +CPU= 18.719
  19:56:41 STEP 2502 H=2502:00 +CPU= 30.345
  19:56:59 STEP 2503 H=2503:00 +CPU= 18.309
  19:57:19 STEP 2504 H=2504:00 +CPU= 19.417
  19:57:50 STEP 2505 H=2505:00 +CPU= 29.886
  19:58:09 STEP 2506 H=2506:00 +CPU= 18.876
  19:58:28 STEP 2507 H=2507:00 +CPU= 18.982
  19:59:02 STEP 2508 H=2508:00 +CPU= 33.024
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002508
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002508
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002508
  19:59:20 STEP 2509 H=2509:00 +CPU= 18.091
  19:59:40 STEP 2510 H=2510:00 +CPU= 18.993
  20:00:10 STEP 2511 H=2511:00 +CPU= 29.779
  20:00:29 STEP 2512 H=2512:00 +CPU= 18.409
  20:00:48 STEP 2513 H=2513:00 +CPU= 18.618
  20:01:19 STEP 2514 H=2514:00 +CPU= 30.136
  20:01:38 STEP 2515 H=2515:00 +CPU= 18.216
  20:01:57 STEP 2516 H=2516:00 +CPU= 19.241
  20:02:28 STEP 2517 H=2517:00 +CPU= 29.756
  20:02:47 STEP 2518 H=2518:00 +CPU= 18.860
  20:03:07 STEP 2519 H=2519:00 +CPU= 19.200
  20:03:44 STEP 2520 H=2520:00 +CPU= 35.099
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002520
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002520
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMGGhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMSHhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMUAhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMGGhq0f+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMSHhq0f+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMUAhq0f+002508
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0441_1992050100_123_961_12178085_0_r1492906834_104.zip
Uploading the intermediate file: upload_file_104.zip
  20:04:04 STEP 2521 H=2521:00 +CPU= 18.805
  20:04:24 STEP 2522 H=2522:00 +CPU= 19.099
  20:04:55 STEP 2523 H=2523:00 +CPU= 30.116
  20:05:14 STEP 2524 H=2524:00 +CPU= 18.711
  20:05:33 STEP 2525 H=2525:00 +CPU= 18.587
  20:06:03 STEP 2526 H=2526:00 +CPU= 30.177
  20:06:22 STEP 2527 H=2527:00 +CPU= 18.295
  20:06:41 STEP 2528 H=2528:00 +CPU= 18.814
  20:07:11 STEP 2529 H=2529:00 +CPU= 29.450
  20:07:31 STEP 2530 H=2530:00 +CPU= 19.160
  20:07:50 STEP 2531 H=2531:00 +CPU= 18.699
  20:08:24 STEP 2532 H=2532:00 +CPU= 33.080
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002532
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002532
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002532
  20:08:42 STEP 2533 H=2533:00 +CPU= 18.078
  20:09:02 STEP 2534 H=2534:00 +CPU= 19.057
  20:09:32 STEP 2535 H=2535:00 +CPU= 29.813
  20:09:51 STEP 2536 H=2536:00 +CPU= 18.672
  20:10:10 STEP 2537 H=2537:00 +CPU= 18.744
  20:10:41 STEP 2538 H=2538:00 +CPU= 30.210
  20:11:00 STEP 2539 H=2539:00 +CPU= 18.298
  20:11:20 STEP 2540 H=2540:00 +CPU= 19.078
  20:11:50 STEP 2541 H=2541:00 +CPU= 29.949
  20:12:09 STEP 2542 H=2542:00 +CPU= 18.804
  20:12:29 STEP 2543 H=2543:00 +CPU= 19.089
  20:13:05 STEP 2544 H=2544:00 +CPU= 35.084
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002544
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002544
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMGGhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMSHhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMUAhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMGGhq0f+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMSHhq0f+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMUAhq0f+002532
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0441_1992050100_123_961_12178085_0_r1492906834_105.zip
Uploading the intermediate file: upload_file_105.zip
  20:13:24 STEP 2545 H=2545:00 +CPU= 17.899
  20:13:43 STEP 2546 H=2546:00 +CPU= 19.128
  20:14:14 STEP 2547 H=2547:00 +CPU= 30.008
  20:14:34 STEP 2548 H=2548:00 +CPU= 19.168
  20:14:53 STEP 2549 H=2549:00 +CPU= 18.519
  20:15:23 STEP 2550 H=2550:00 +CPU= 29.872
  20:15:42 STEP 2551 H=2551:00 +CPU= 18.192
  20:16:01 STEP 2552 H=2552:00 +CPU= 19.097
  20:16:34 STEP 2553 H=2553:00 +CPU= 32.332
  20:16:54 STEP 2554 H=2554:00 +CPU= 19.707
  20:17:14 STEP 2555 H=2555:00 +CPU= 19.008
  20:17:47 STEP 2556 H=2556:00 +CPU= 33.043
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002556
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002556
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002556
  20:18:07 STEP 2557 H=2557:00 +CPU= 19.152
  20:18:27 STEP 2558 H=2558:00 +CPU= 19.892
  20:19:02 STEP 2559 H=2559:00 +CPU= 33.661
  20:19:23 STEP 2560 H=2560:00 +CPU= 20.273
  20:19:43 STEP 2561 H=2561:00 +CPU= 19.610
  20:20:17 STEP 2562 H=2562:00 +CPU= 33.666
  20:20:39 STEP 2563 H=2563:00 +CPU= 21.262
  20:21:00 STEP 2564 H=2564:00 +CPU= 19.882
  20:21:35 STEP 2565 H=2565:00 +CPU= 30.604
  20:21:55 STEP 2566 H=2566:00 +CPU= 19.896
  20:22:16 STEP 2567 H=2567:00 +CPU= 19.800
  20:22:54 STEP 2568 H=2568:00 +CPU= 35.788
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002568
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002568
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMGGhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMSHhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMUAhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMGGhq0f+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMSHhq0f+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMUAhq0f+002556
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0441_1992050100_123_961_12178085_0_r1492906834_106.zip
Uploading the intermediate file: upload_file_106.zip
  20:23:14 STEP 2569 H=2569:00 +CPU= 19.147
Uploading trickle at timestep: 9244800
  20:23:35 STEP 2570 H=2570:00 +CPU= 20.310
  20:24:07 STEP 2571 H=2571:00 +CPU= 30.941
  20:24:27 STEP 2572 H=2572:00 +CPU= 19.516
  20:24:47 STEP 2573 H=2573:00 +CPU= 19.493
  20:25:19 STEP 2574 H=2574:00 +CPU= 31.331
  20:25:39 STEP 2575 H=2575:00 +CPU= 19.815
  20:26:00 STEP 2576 H=2576:00 +CPU= 21.247
  20:26:32 STEP 2577 H=2577:00 +CPU= 31.933
  20:26:53 STEP 2578 H=2578:00 +CPU= 20.546
  20:27:14 STEP 2579 H=2579:00 +CPU= 19.955
  20:27:50 STEP 2580 H=2580:00 +CPU= 35.271
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002580
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002580
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002580
  20:28:11 STEP 2581 H=2581:00 +CPU= 20.374
  20:28:33 STEP 2582 H=2582:00 +CPU= 20.999
  20:29:10 STEP 2583 H=2583:00 +CPU= 37.181
  20:29:31 STEP 2584 H=2584:00 +CPU= 20.468
  20:29:51 STEP 2585 H=2585:00 +CPU= 19.677
  20:30:24 STEP 2586 H=2586:00 +CPU= 31.829
  20:30:43 STEP 2587 H=2587:00 +CPU= 19.037
  20:31:03 STEP 2588 H=2588:00 +CPU= 20.066
  20:31:35 STEP 2589 H=2589:00 +CPU= 31.286
  20:31:55 STEP 2590 H=2590:00 +CPU= 19.883
  20:32:15 STEP 2591 H=2591:00 +CPU= 19.555
  20:32:53 STEP 2592 H=2592:00 +CPU= 36.191
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002592
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002592
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMGGhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMSHhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMUAhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMGGhq0f+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMSHhq0f+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085/ICMUAhq0f+002580
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0441_1992050100_123_961_12178085_0_r1492906834_107.zip
Uploading the intermediate file: upload_file_107.zip
  20:33:14 STEP 2593 H=2593:00 +CPU= 19.068
  20:33:34 STEP 2594 H=2594:00 +CPU= 19.807
  20:34:06 STEP 2595 H=2595:00 +CPU= 30.904
  20:34:26 STEP 2596 H=2596:00 +CPU= 19.990
  20:34:46 STEP 2597 H=2597:00 +CPU= 19.363
  20:35:18 STEP 2598 H=2598:00 +CPU= 31.476
  20:35:38 STEP 2599 H=2599:00 +CPU= 19.248
  20:35:58 STEP 2600 H=2600:00 +CPU= 19.873
  20:36:29 STEP 2601 H=2601:00 +CPU= 30.704
  20:36:50 STEP 2602 H=2602:00 +CPU= 20.055
  20:37:09 STEP 2603 H=2603:00 +CPU= 19.198
  20:37:43 STEP 2604 H=2604:00 +CPU= 33.461
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002604
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002604
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002604
  20:38:03 STEP 2605 H=2605:00 +CPU= 19.275
  20:38:23 STEP 2606 H=2606:00 +CPU= 19.684
  20:38:54 STEP 2607 H=2607:00 +CPU= 30.523
  20:39:14 STEP 2608 H=2608:00 +CPU= 19.721
  20:39:33 STEP 2609 H=2609:00 +CPU= 19.188
  20:40:05 STEP 2610 H=2610:00 +CPU= 30.833
  20:40:26 STEP 2611 H=2611:00 +CPU= 20.282
  20:40:46 STEP 2612 H=2612:00 +CPU= 19.876
  20:41:17 STEP 2613 H=2613:00 +CPU= 30.538
  20:41:37 STEP 2614 H=2614:00 +CPU= 19.596
  20:41:58 STEP 2615 H=2615:00 +CPU= 19.913
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1992050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0441
(argv4) batchid: 961
(argv5) wuid: 12178085
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/4
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178085
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/4/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/4/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_4f75e0dd6c37b93719f36a9dc627af34 to: /var/lib/boinc-client/slots/4/oifs_43r3_ps_0441_1992050100_123_961_12178085.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/4/oifs_43r3_ps_0441_1992050100_123_961_12178085.zip
ic_ancil_file: ic_ancil_12178085
ifsdata_file: ifsdata_12178085
climate_data_file: clim_data_12178085
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_2bd7670d158f0b79f9bd84244a41df84 to: /var/lib/boinc-client/slots/4/ic_ancil_12178085.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/4/ic_ancil_12178085.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_63cfec0ecd11d8aba0524152514ac9d4 to: /var/lib/boinc-client/slots/4/ifsdata/ifsdata_12178085.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/4/ifsdata/ifsdata_12178085.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/4/159l_2/clim_data_12178085.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/4/159l_2/clim_data_12178085.zip
Checking for progress XML file: /var/lib/boinc-client/slots/4/progress_file_12178085.xml
Opened progress file ok : /var/lib/boinc-client/slots/4/progress_file_12178085.xml
-- Model is restarting --
Adjusting last_iter, 2615, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/4/progress_file_12178085.xml
last_cpu_time: 61049
upload_file_number: 108
last_iter: 2591
last_upload: 9331200
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0441_1992050100_123_961_12178085_0_r1492906834
The child process has been launched with process id: 1708
Executing the command: /var/lib/boinc-client/slots/4/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:ih2-VirtualBox:1:1:1708:1708] [20230109:102040:1673259640:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:ih2-VirtualBox:1:1:1708:1708] [20230109:102040:1673259640:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:ih2-VirtualBox:1:1:1708:1708] [20230109:102040:1673259640:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:ih2-VirtualBox:1:1:1708:1708] [20230109:102040:1673259640:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:ih2-VirtualBox:1:1:1708:1708] [20230109:102040:1673259640:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:ih2-VirtualBox:1:1:1708:1708] [20230109:102040:1673259640:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:ih2-VirtualBox:1:1:1708:1708] [20230109:102040:1673259640:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:ih2-VirtualBox:1:1:1708:1708] [20230109:102040:1673259640:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:ih2-VirtualBox:1:1:1708:1708] [20230109:102040:1673259640:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:ih2-VirtualBox:1:1:1708:1708] [20230109:102040:1673259640:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:ih2-VirtualBox:1:1:1708:1708] [20230109:102040:1673259640:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:ih2-VirtualBox:1:1:1708:1708] [20230109:102040:1673259640:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:ih2-VirtualBox:1:1:1708:1708] [20230109:102040:1673259640:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:ih2-VirtualBox:1:1:1708:1708] [20230109:102040:1673259640:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:ih2-VirtualBox:1:1:1708:1708] [20230109:102040:1673259640:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:ih2-VirtualBox:1:1:1708:1708] [20230109:102040:1673259640:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ih2-VirtualBox:1:1:1708:1708] [20230109:102040:1673259640:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:ih2-VirtualBox:1:1:1708:1708] [20230109:102040:1673259640:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ih2-VirtualBox:1:1:1708:1708] [20230109:102040:1673259640:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:ih2-VirtualBox:1:1:1708:1708] [20230109:102040:1673259640:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:ih2-VirtualBox:1:1:1708:1708] [20230109:102040:1673259640:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ih2-VirtualBox:1:1:1708:1708] [20230109:102040:1673259640:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ih2-VirtualBox:1:1:1708:1708] [20230109:102040:1673259640:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:ih2-VirtualBox:1:1:1708:1708] [20230109:102040:1673259640:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ih2-VirtualBox:1:1:1708:1708] [20230109:102040:1673259640:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ih2-VirtualBox:1:1:1708:1708] [20230109:102040:1673259640:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ih2-VirtualBox:1:1:1708:1708] [20230109:102040:1673259640:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:ih2-VirtualBox:1:1:1708:1708] [20230109:102040:1673259640:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:ih2-VirtualBox:1:1:1708:1708] [20230109:102040:1673259640:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:ih2-VirtualBox:1:1:1708:1708] [20230109:102040:1673259640:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
ECCODES ERROR   :  IO ERROR: Inappropriate ioctl for device (Inappropriate ioctl for device)
 GRIB_READ_BYTES_REAL8        50000  FAILED         -11
 GRIB_API ERROR MSG: Input output problem
MPL_ABORT: CALLED FROM PROCESSOR      1 THRD     1
 MPL_ABORT: THRD           1   GRIB_READ_BYTES_REAL8 FAILED
[EC_DRHOOK:ih2-VirtualBox:1:1:1708:1708] [20230109:102043:1673259643:2.427] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3843] 1323 MB (maxheap), 459 MB (maxrss), 0 MB (maxstack)
[EC_DRHOOK:ih2-VirtualBox:1:1:1708:1708] [20230109:102043:1673259643:2.427] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :  MASTER 
[EC_DRHOOK:ih2-VirtualBox:1:1:1708:1708] [20230109:102043:1673259643:2.427] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :   CNT0 
[EC_DRHOOK:ih2-VirtualBox:1:1:1708:1708] [20230109:102043:1673259643:2.427] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :    CNT1 
[EC_DRHOOK:ih2-VirtualBox:1:1:1708:1708] [20230109:102043:1673259643:2.427] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :     CNT2 
[EC_DRHOOK:ih2-VirtualBox:1:1:1708:1708] [20230109:102043:1673259643:2.427] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :      CNT3 
[EC_DRHOOK:ih2-VirtualBox:1:1:1708:1708] [20230109:102043:1673259643:2.427] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :       RERESF 
[EC_DRHOOK:ih2-VirtualBox:1:1:1708:1708] [20230109:102043:1673259643:2.427] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :        IOSTREAM_MIX:IO_GET 
[EC_DRHOOK:ih2-VirtualBox:1:1:1708:1708] [20230109:102043:1673259643:2.427] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :         IOSTREAM_MIX:READ_RECORD 
[EC_DRHOOK:ih2-VirtualBox:1:1:1708:1708] [20230109:102043:1673259643:2.427] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :          >MPL-IOSTREAM READ_RECORD ( 650) 
[EC_DRHOOK:ih2-VirtualBox:1:1:1708:1708] [20230109:102043:1673259643:2.427] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :           GRIB_API:IGRIB_READ_BYTES_REAL8 
 SDL_TRACEBACK: Calling INTEL_TRBK, THRD =            1
 Process            1  thread            1  calling linux_trbk from intel_trbk()
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:240] Backtrace(s) for program '/var/lib/boinc-client/slots/4/oifs_43r3_model.exe' : sigcontextptr=0x7fffb8e8d280
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:277] Backtrace (size = 16) with plain hex-dump
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:340] [0]: [0x839273] : 0x839273
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:340] [1]: [0x839879] : 0x839879
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:340] [2]: [0x8c2957] : 0x8c2957
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:340] [3]: [0x8c3229] : 0x8c3229
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:340] [4]: [0xa048b9] : 0xa048b9
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:340] [5]: [0x9e3c9a] : 0x9e3c9a
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:340] [6]: [0x9d8b44] : 0x9d8b44
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:340] [7]: [0x54bcf3] : 0x54bcf3
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:340] [8]: [0x546a18] : 0x546a18
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:340] [9]: [0x546412] : 0x546412
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:340] [10]: [0x545e28] : 0x545e28
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:340] [11]: [0x40708d] : 0x40708d
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:340] [12]: [0x40220f] : 0x40220f
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:340] [13]: [0x4021a2] : 0x4021a2
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:340] [14]: [0x1dca390] : 0x1dca390
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:340] [15]: [0x40206e] : 0x40206e
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:370] End of backtrace(s)
 SDL_TRACEBACK: Done INTEL_TRBK, THRD =            1
abort: 
The child process terminated with status: 0
..Failed, model did not complete successfully

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:13:35 1512045 22262925 oifs_43r3_ps_0441_1992050100_123_961_12178085_0 9,244,800 59,936 0.0065
09 May 2023 16:13:35 1512045 22262925 oifs_43r3_ps_0441_1992050100_123_961_12178085_0 9,244,800 59,936 0.0065
09 May 2023 16:12:59 1512045 22262925 oifs_43r3_ps_0441_1992050100_123_961_12178085_0 8,380,800 54,301 0.0065
09 May 2023 16:12:59 1512045 22262925 oifs_43r3_ps_0441_1992050100_123_961_12178085_0 8,380,800 54,301 0.0065
09 May 2023 16:12:57 1512045 22262925 oifs_43r3_ps_0441_1992050100_123_961_12178085_0 7,516,800 48,777 0.0065
09 May 2023 16:11:27 1512045 22262925 oifs_43r3_ps_0441_1992050100_123_961_12178085_0 6,048,000 38,927 0.0064
09 May 2023 16:11:27 1512045 22262925 oifs_43r3_ps_0441_1992050100_123_961_12178085_0 6,048,000 38,927 0.0064
09 May 2023 16:11:24 1512045 22262925 oifs_43r3_ps_0441_1992050100_123_961_12178085_0 5,184,000 33,463 0.0065
09 May 2023 16:11:17 1512045 22262925 oifs_43r3_ps_0441_1992050100_123_961_12178085_0 4,320,000 27,997 0.0065
09 May 2023 16:11:14 1512045 22262925 oifs_43r3_ps_0441_1992050100_123_961_12178085_0 3,456,000 22,523 0.0065
09 May 2023 16:11:07 1512045 22262925 oifs_43r3_ps_0441_1992050100_123_961_12178085_0 2,592,000 17,053 0.0066
09 May 2023 16:11:04 1512045 22262925 oifs_43r3_ps_0441_1992050100_123_961_12178085_0 1,728,000 11,566 0.0067
09 May 2023 16:10:58 1512045 22262925 oifs_43r3_ps_0441_1992050100_123_961_12178085_0 864,000 5,918 0.0068
09 May 2023 16:10:58 1512045 22262925 oifs_43r3_ps_0441_1992050100_123_961_12178085_0 864,000 5,918 0.0068


©2024 climateprediction.net