climateprediction.net home page
Task 22266557

Task 22266557

Name oifs_43r3_ps_0874_1995050100_123_964_12181518_0
Workunit 12181518
Created 22 Dec 2022, 9:29:40 UTC
Sent 15 Jan 2023, 15:50:47 UTC
Report deadline 14 Feb 2023, 15:50:47 UTC
Received 19 Jan 2023, 15:11:38 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 1 (0x00000001) Unknown error code
Computer ID 1498859
Run time 23 hours 41 min 38 sec
CPU time 23 hours 37 min 17 sec
Validate state Invalid
Credit 12,096.00
Device peak FLOPS 3.97 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,391.17 MB
Peak swap size 4,978.07 MB
Peak disk usage 2,784.93 MB
Stderr
<core_client_version>7.18.1</core_client_version>
<![CDATA[
<message>
process exited with code 1 (0x1, -255)</message>
<stderr_txt>
2138 H=2138:00 +CPU= 32.727
  10:39:55 STEP 2139 H=2139:00 +CPU= 51.244
  10:40:29 STEP 2140 H=2140:00 +CPU= 34.131
  10:41:01 STEP 2141 H=2141:00 +CPU= 32.232
  10:41:59 STEP 2142 H=2142:00 +CPU= 57.516
  10:42:35 STEP 2143 H=2143:00 +CPU= 36.065
  10:43:10 STEP 2144 H=2144:00 +CPU= 34.629
  10:44:03 STEP 2145 H=2145:00 +CPU= 53.503
  10:44:40 STEP 2146 H=2146:00 +CPU= 36.447
  10:45:15 STEP 2147 H=2147:00 +CPU= 35.662
  10:46:15 STEP 2148 H=2148:00 +CPU= 59.826
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002148
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002148
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002148
  10:46:49 STEP 2149 H=2149:00 +CPU= 33.577
  10:47:24 STEP 2150 H=2150:00 +CPU= 35.499
  10:48:18 STEP 2151 H=2151:00 +CPU= 53.508
  10:48:52 STEP 2152 H=2152:00 +CPU= 34.029
  10:49:26 STEP 2153 H=2153:00 +CPU= 34.262
  10:50:22 STEP 2154 H=2154:00 +CPU= 55.929
  10:50:58 STEP 2155 H=2155:00 +CPU= 35.603
  10:51:33 STEP 2156 H=2156:00 +CPU= 34.762
  10:52:27 STEP 2157 H=2157:00 +CPU= 54.599
  10:53:01 STEP 2158 H=2158:00 +CPU= 33.915
  10:53:36 STEP 2159 H=2159:00 +CPU= 35.084
  10:54:42 STEP 2160 H=2160:00 +CPU= 65.578
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002160
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002160
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002160
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMGGhq0f+002136
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMSHhq0f+002136
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMUAhq0f+002136
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMGGhq0f+002148
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMSHhq0f+002148
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMUAhq0f+002148
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0874_1995050100_123_964_12181518_0_r1839081001_89.zip
Uploading the intermediate file: upload_file_89.zip
Uploading trickle at timestep: 7776000
  10:55:16 STEP 2161 H=2161:00 +CPU= 33.427
  10:55:49 STEP 2162 H=2162:00 +CPU= 33.651
  10:56:43 STEP 2163 H=2163:00 +CPU= 53.626
  10:57:16 STEP 2164 H=2164:00 +CPU= 33.327
  10:57:50 STEP 2165 H=2165:00 +CPU= 34.223
  10:58:48 STEP 2166 H=2166:00 +CPU= 57.886
  10:59:15 STEP 2167 H=2167:00 +CPU= 26.408
  10:59:41 STEP 2168 H=2168:00 +CPU= 26.036
  11:00:23 STEP 2169 H=2169:00 +CPU= 41.942
  11:00:56 STEP 2170 H=2170:00 +CPU= 32.749
  11:01:34 STEP 2171 H=2171:00 +CPU= 37.849
  11:02:34 STEP 2172 H=2172:00 +CPU= 59.893
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002172
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002172
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002172
  11:03:10 STEP 2173 H=2173:00 +CPU= 35.975
  11:03:43 STEP 2174 H=2174:00 +CPU= 33.426
  11:04:35 STEP 2175 H=2175:00 +CPU= 51.864
  11:05:07 STEP 2176 H=2176:00 +CPU= 32.061
  11:05:39 STEP 2177 H=2177:00 +CPU= 31.747
  11:06:31 STEP 2178 H=2178:00 +CPU= 52.556
  11:07:04 STEP 2179 H=2179:00 +CPU= 32.484
  11:07:37 STEP 2180 H=2180:00 +CPU= 33.184
  11:08:28 STEP 2181 H=2181:00 +CPU= 51.035
  11:09:01 STEP 2182 H=2182:00 +CPU= 32.785
  11:09:36 STEP 2183 H=2183:00 +CPU= 35.226
  11:10:38 STEP 2184 H=2184:00 +CPU= 61.413
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002184
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002184
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002184
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMGGhq0f+002160
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMSHhq0f+002160
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMUAhq0f+002160
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMGGhq0f+002172
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMSHhq0f+002172
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMUAhq0f+002172
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0874_1995050100_123_964_12181518_0_r1839081001_90.zip
Uploading the intermediate file: upload_file_90.zip
  11:11:10 STEP 2185 H=2185:00 +CPU= 32.035
  11:11:44 STEP 2186 H=2186:00 +CPU= 33.815
  11:12:36 STEP 2187 H=2187:00 +CPU= 52.311
  11:13:11 STEP 2188 H=2188:00 +CPU= 34.606
  11:13:43 STEP 2189 H=2189:00 +CPU= 32.050
  11:14:34 STEP 2190 H=2190:00 +CPU= 51.329
  11:15:06 STEP 2191 H=2191:00 +CPU= 31.622
  11:15:39 STEP 2192 H=2192:00 +CPU= 32.992
  11:16:32 STEP 2193 H=2193:00 +CPU= 53.547
  11:17:06 STEP 2194 H=2194:00 +CPU= 33.600
  11:17:39 STEP 2195 H=2195:00 +CPU= 32.684
  11:18:37 STEP 2196 H=2196:00 +CPU= 58.598
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002196
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002196
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002196
  11:19:10 STEP 2197 H=2197:00 +CPU= 32.344
  11:19:43 STEP 2198 H=2198:00 +CPU= 32.775
  11:20:34 STEP 2199 H=2199:00 +CPU= 51.814
  11:21:07 STEP 2200 H=2200:00 +CPU= 32.721
  11:21:39 STEP 2201 H=2201:00 +CPU= 32.226
  11:22:36 STEP 2202 H=2202:00 +CPU= 56.412
  11:23:09 STEP 2203 H=2203:00 +CPU= 32.842
  11:23:42 STEP 2204 H=2204:00 +CPU= 33.161
  11:24:35 STEP 2205 H=2205:00 +CPU= 53.437
  11:25:08 STEP 2206 H=2206:00 +CPU= 32.968
  11:25:41 STEP 2207 H=2207:00 +CPU= 32.292
  11:26:41 STEP 2208 H=2208:00 +CPU= 60.528
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002208
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002208
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002208
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMGGhq0f+002184
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMSHhq0f+002184
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMUAhq0f+002184
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMGGhq0f+002196
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMSHhq0f+002196
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMUAhq0f+002196
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0874_1995050100_123_964_12181518_0_r1839081001_91.zip
Uploading the intermediate file: upload_file_91.zip
  11:27:14 STEP 2209 H=2209:00 +CPU= 32.429
  11:27:50 STEP 2210 H=2210:00 +CPU= 36.569
  11:28:44 STEP 2211 H=2211:00 +CPU= 53.718
  11:29:17 STEP 2212 H=2212:00 +CPU= 33.192
  11:29:50 STEP 2213 H=2213:00 +CPU= 32.951
  11:30:48 STEP 2214 H=2214:00 +CPU= 57.140
  11:31:20 STEP 2215 H=2215:00 +CPU= 32.038
  11:31:52 STEP 2216 H=2216:00 +CPU= 32.628
  11:32:44 STEP 2217 H=2217:00 +CPU= 51.432
  11:33:17 STEP 2218 H=2218:00 +CPU= 33.238
  11:33:52 STEP 2219 H=2219:00 +CPU= 35.479
  11:34:58 STEP 2220 H=2220:00 +CPU= 65.517
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002220
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002220
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002220
  11:35:31 STEP 2221 H=2221:00 +CPU= 33.246
  11:36:07 STEP 2222 H=2222:00 +CPU= 35.697
  11:37:01 STEP 2223 H=2223:00 +CPU= 54.048
  11:37:35 STEP 2224 H=2224:00 +CPU= 33.774
  11:38:03 STEP 2225 H=2225:00 +CPU= 27.855
  11:38:52 STEP 2226 H=2226:00 +CPU= 49.607
  11:39:19 STEP 2227 H=2227:00 +CPU= 26.483
  11:39:46 STEP 2228 H=2228:00 +CPU= 26.784
  11:40:31 STEP 2229 H=2229:00 +CPU= 45.197
  11:40:58 STEP 2230 H=2230:00 +CPU= 27.382
  11:41:28 STEP 2231 H=2231:00 +CPU= 29.692
  11:42:25 STEP 2232 H=2232:00 +CPU= 56.863
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002232
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002232
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002232
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMGGhq0f+002208
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMSHhq0f+002208
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMUAhq0f+002208
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMGGhq0f+002220
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMSHhq0f+002220
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMUAhq0f+002220
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0874_1995050100_123_964_12181518_0_r1839081001_92.zip
Uploading the intermediate file: upload_file_92.zip
  11:42:54 STEP 2233 H=2233:00 +CPU= 28.478
  11:43:22 STEP 2234 H=2234:00 +CPU= 28.336
  11:44:09 STEP 2235 H=2235:00 +CPU= 47.043
  11:44:37 STEP 2236 H=2236:00 +CPU= 28.043
  11:45:05 STEP 2237 H=2237:00 +CPU= 28.159
  11:45:51 STEP 2238 H=2238:00 +CPU= 45.328
  11:46:19 STEP 2239 H=2239:00 +CPU= 28.011
  11:46:48 STEP 2240 H=2240:00 +CPU= 29.597
  11:47:35 STEP 2241 H=2241:00 +CPU= 46.784
  11:48:04 STEP 2242 H=2242:00 +CPU= 28.509
  11:48:30 STEP 2243 H=2243:00 +CPU= 26.627
  11:49:21 STEP 2244 H=2244:00 +CPU= 50.368
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002244
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002244
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002244
  11:49:50 STEP 2245 H=2245:00 +CPU= 29.386
  11:50:21 STEP 2246 H=2246:00 +CPU= 30.204
  11:51:09 STEP 2247 H=2247:00 +CPU= 48.006
  11:51:38 STEP 2248 H=2248:00 +CPU= 28.882
  11:52:05 STEP 2249 H=2249:00 +CPU= 27.878
  11:52:50 STEP 2250 H=2250:00 +CPU= 44.311
  11:53:17 STEP 2251 H=2251:00 +CPU= 27.674
  11:53:50 STEP 2252 H=2252:00 +CPU= 32.363
  11:54:32 STEP 2253 H=2253:00 +CPU= 42.425
  11:55:01 STEP 2254 H=2254:00 +CPU= 28.662
  11:55:32 STEP 2255 H=2255:00 +CPU= 31.359
  11:56:30 STEP 2256 H=2256:00 +CPU= 57.174
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002256
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002256
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002256
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMGGhq0f+002232
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMSHhq0f+002232
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMUAhq0f+002232
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMGGhq0f+002244
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMSHhq0f+002244
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMUAhq0f+002244
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0874_1995050100_123_964_12181518_0_r1839081001_93.zip
Uploading the intermediate file: upload_file_93.zip
  11:56:56 STEP 2257 H=2257:00 +CPU= 26.639
  11:57:24 STEP 2258 H=2258:00 +CPU= 27.336
  11:58:07 STEP 2259 H=2259:00 +CPU= 43.829
  11:58:35 STEP 2260 H=2260:00 +CPU= 27.819
  11:59:02 STEP 2261 H=2261:00 +CPU= 26.726
  11:59:45 STEP 2262 H=2262:00 +CPU= 42.952
  12:00:11 STEP 2263 H=2263:00 +CPU= 26.427
  12:00:38 STEP 2264 H=2264:00 +CPU= 26.070
  12:01:21 STEP 2265 H=2265:00 +CPU= 43.826
  12:01:49 STEP 2266 H=2266:00 +CPU= 27.770
  12:02:16 STEP 2267 H=2267:00 +CPU= 26.382
  12:03:02 STEP 2268 H=2268:00 +CPU= 46.222
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002268
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002268
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002268
  12:03:27 STEP 2269 H=2269:00 +CPU= 25.621
  12:03:54 STEP 2270 H=2270:00 +CPU= 26.385
  12:04:36 STEP 2271 H=2271:00 +CPU= 42.001
  12:05:03 STEP 2272 H=2272:00 +CPU= 27.285
  12:05:31 STEP 2273 H=2273:00 +CPU= 27.381
  12:06:14 STEP 2274 H=2274:00 +CPU= 43.805
  12:06:44 STEP 2275 H=2275:00 +CPU= 29.360
  12:07:11 STEP 2276 H=2276:00 +CPU= 26.651
  12:07:55 STEP 2277 H=2277:00 +CPU= 43.969
  12:08:21 STEP 2278 H=2278:00 +CPU= 26.824
  12:08:49 STEP 2279 H=2279:00 +CPU= 27.313
  12:09:38 STEP 2280 H=2280:00 +CPU= 49.568
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002280
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002280
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002280
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMGGhq0f+002256
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMSHhq0f+002256
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMUAhq0f+002256
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMGGhq0f+002268
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMSHhq0f+002268
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMUAhq0f+002268
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0874_1995050100_123_964_12181518_0_r1839081001_94.zip
Uploading the intermediate file: upload_file_94.zip
  12:10:05 STEP 2281 H=2281:00 +CPU= 26.131
  12:10:36 STEP 2282 H=2282:00 +CPU= 30.988
  12:11:24 STEP 2283 H=2283:00 +CPU= 48.126
  12:11:54 STEP 2284 H=2284:00 +CPU= 30.567
  12:12:22 STEP 2285 H=2285:00 +CPU= 28.072
  12:13:09 STEP 2286 H=2286:00 +CPU= 46.441
  12:13:35 STEP 2287 H=2287:00 +CPU= 26.500
  12:14:04 STEP 2288 H=2288:00 +CPU= 28.473
  12:14:52 STEP 2289 H=2289:00 +CPU= 47.815
  12:15:21 STEP 2290 H=2290:00 +CPU= 29.474
  12:15:50 STEP 2291 H=2291:00 +CPU= 28.564
  12:16:41 STEP 2292 H=2292:00 +CPU= 51.070
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002292
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002292
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002292
  12:17:10 STEP 2293 H=2293:00 +CPU= 29.048
  12:17:38 STEP 2294 H=2294:00 +CPU= 27.949
  12:18:23 STEP 2295 H=2295:00 +CPU= 45.468
  12:18:54 STEP 2296 H=2296:00 +CPU= 30.370
  12:19:22 STEP 2297 H=2297:00 +CPU= 27.674
  12:20:06 STEP 2298 H=2298:00 +CPU= 44.737
  12:20:34 STEP 2299 H=2299:00 +CPU= 27.192
  12:21:05 STEP 2300 H=2300:00 +CPU= 31.360
  12:21:57 STEP 2301 H=2301:00 +CPU= 51.766
  12:22:27 STEP 2302 H=2302:00 +CPU= 30.584
  12:22:58 STEP 2303 H=2303:00 +CPU= 30.226
  12:23:53 STEP 2304 H=2304:00 +CPU= 54.857
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002304
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002304
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002304
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMGGhq0f+002280
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMSHhq0f+002280
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMUAhq0f+002280
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMGGhq0f+002292
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMSHhq0f+002292
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMUAhq0f+002292
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0874_1995050100_123_964_12181518_0_r1839081001_95.zip
Uploading the intermediate file: upload_file_95.zip
  12:24:22 STEP 2305 H=2305:00 +CPU= 29.513
  12:24:52 STEP 2306 H=2306:00 +CPU= 29.608
  12:25:39 STEP 2307 H=2307:00 +CPU= 47.655
  12:26:09 STEP 2308 H=2308:00 +CPU= 29.137
  12:26:40 STEP 2309 H=2309:00 +CPU= 30.930
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  12:29:06 STEP 2310 H=2310:00 +CPU= 50.573
  12:29:37 STEP 2311 H=2311:00 +CPU= 30.204
  12:30:08 STEP 2312 H=2312:00 +CPU= 31.238
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  12:31:24 STEP 2313 H=2313:00 +CPU= 48.025
  12:31:57 STEP 2314 H=2314:00 +CPU= 32.186
  12:32:29 STEP 2315 H=2315:00 +CPU= 32.139
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  12:33:47 STEP 2316 H=2316:00 +CPU= 53.439
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002316
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002316
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002316
  12:34:16 STEP 2317 H=2317:00 +CPU= 29.059
  12:34:47 STEP 2318 H=2318:00 +CPU= 30.894
  12:35:37 STEP 2319 H=2319:00 +CPU= 49.806
  12:36:08 STEP 2320 H=2320:00 +CPU= 30.931
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  12:38:24 STEP 2321 H=2321:00 +CPU= 30.831
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  12:39:42 STEP 2322 H=2322:00 +CPU= 49.027
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  12:41:11 STEP 2323 H=2323:00 +CPU= 27.873
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  12:41:56 STEP 2324 H=2324:00 +CPU= 30.890
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  12:43:46 STEP 2325 H=2325:00 +CPU= 47.712
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  12:44:47 STEP 2326 H=2326:00 +CPU= 32.396
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  12:45:22 STEP 2327 H=2327:00 +CPU= 30.719
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  12:48:15 STEP 2328 H=2328:00 +CPU= 53.544
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002328
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002328
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002328
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMGGhq0f+002304
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMSHhq0f+002304
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMUAhq0f+002304
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMGGhq0f+002316
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMSHhq0f+002316
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMUAhq0f+002316
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0874_1995050100_123_964_12181518_0_r1839081001_96.zip
Uploading the intermediate file: upload_file_96.zip
  12:48:44 STEP 2329 H=2329:00 +CPU= 28.554
  12:49:13 STEP 2330 H=2330:00 +CPU= 28.766
  12:49:58 STEP 2331 H=2331:00 +CPU= 45.363
  12:50:25 STEP 2332 H=2332:00 +CPU= 27.351
  12:50:54 STEP 2333 H=2333:00 +CPU= 28.626
  12:51:41 STEP 2334 H=2334:00 +CPU= 47.239
  12:52:15 STEP 2335 H=2335:00 +CPU= 33.588
  12:52:50 STEP 2336 H=2336:00 +CPU= 35.022
  12:53:41 STEP 2337 H=2337:00 +CPU= 50.966
  12:54:12 STEP 2338 H=2338:00 +CPU= 31.443
  12:54:41 STEP 2339 H=2339:00 +CPU= 29.049
  12:55:32 STEP 2340 H=2340:00 +CPU= 50.798
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002340
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002340
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002340
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  12:56:20 STEP 2341 H=2341:00 +CPU= 30.525
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  12:57:01 STEP 2342 H=2342:00 +CPU= 28.836
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  12:58:36 STEP 2343 H=2343:00 +CPU= 47.866
  12:59:06 STEP 2344 H=2344:00 +CPU= 29.463
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  12:59:46 STEP 2345 H=2345:00 +CPU= 28.700
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  13:01:49 STEP 2346 H=2346:00 +CPU= 50.130
  13:02:20 STEP 2347 H=2347:00 +CPU= 31.685
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  13:03:22 STEP 2348 H=2348:00 +CPU= 29.988
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  13:05:13 STEP 2349 H=2349:00 +CPU= 48.949
  13:05:43 STEP 2350 H=2350:00 +CPU= 30.179
  13:06:10 STEP 2351 H=2351:00 +CPU= 26.965
  13:07:01 STEP 2352 H=2352:00 +CPU= 51.154
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002352
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002352
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002352
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMGGhq0f+002328
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMSHhq0f+002328
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMUAhq0f+002328
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMGGhq0f+002340
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMSHhq0f+002340
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMUAhq0f+002340
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0874_1995050100_123_964_12181518_0_r1839081001_97.zip
Uploading the intermediate file: upload_file_97.zip
  13:07:30 STEP 2353 H=2353:00 +CPU= 29.036
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  13:08:21 STEP 2354 H=2354:00 +CPU= 29.453
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  13:10:25 STEP 2355 H=2355:00 +CPU= 48.709
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  13:11:55 STEP 2356 H=2356:00 +CPU= 32.393
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  13:12:36 STEP 2357 H=2357:00 +CPU= 31.719
  13:13:27 STEP 2358 H=2358:00 +CPU= 50.594
  13:13:58 STEP 2359 H=2359:00 +CPU= 31.204
  13:14:28 STEP 2360 H=2360:00 +CPU= 30.121
  13:15:13 STEP 2361 H=2361:00 +CPU= 45.052
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  13:16:53 STEP 2362 H=2362:00 +CPU= 31.665
  13:17:24 STEP 2363 H=2363:00 +CPU= 30.785
  13:18:18 STEP 2364 H=2364:00 +CPU= 54.336
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002364
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002364
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002364
  13:18:48 STEP 2365 H=2365:00 +CPU= 29.828
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  13:19:55 STEP 2366 H=2366:00 +CPU= 28.786
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  13:21:24 STEP 2367 H=2367:00 +CPU= 46.338
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  13:22:26 STEP 2368 H=2368:00 +CPU= 31.363
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  13:23:09 STEP 2369 H=2369:00 +CPU= 30.051
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  13:24:25 STEP 2370 H=2370:00 +CPU= 49.044
  13:24:54 STEP 2371 H=2371:00 +CPU= 28.819
  13:25:25 STEP 2372 H=2372:00 +CPU= 31.174
  13:26:12 STEP 2373 H=2373:00 +CPU= 46.344
  13:26:41 STEP 2374 H=2374:00 +CPU= 29.081
  13:27:09 STEP 2375 H=2375:00 +CPU= 28.298
  13:28:07 STEP 2376 H=2376:00 +CPU= 57.882
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002376
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002376
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMGGhq0f+002352
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMSHhq0f+002352
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMUAhq0f+002352
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMGGhq0f+002364
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMSHhq0f+002364
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMUAhq0f+002364
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0874_1995050100_123_964_12181518_0_r1839081001_98.zip
Uploading the intermediate file: upload_file_98.zip
  13:28:35 STEP 2377 H=2377:00 +CPU= 28.329
  13:29:05 STEP 2378 H=2378:00 +CPU= 30.022
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  13:30:37 STEP 2379 H=2379:00 +CPU= 49.164
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  13:31:46 STEP 2380 H=2380:00 +CPU= 30.317
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  13:32:45 STEP 2381 H=2381:00 +CPU= 30.010
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  13:33:56 STEP 2382 H=2382:00 +CPU= 50.568
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  13:34:43 STEP 2383 H=2383:00 +CPU= 28.450
  13:35:13 STEP 2384 H=2384:00 +CPU= 30.536
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  13:38:08 STEP 2385 H=2385:00 +CPU= 48.859
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  13:41:18 STEP 2386 H=2386:00 +CPU= 31.960
  13:41:48 STEP 2387 H=2387:00 +CPU= 30.732
  13:42:41 STEP 2388 H=2388:00 +CPU= 52.528
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002388
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002388
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002388
  13:43:12 STEP 2389 H=2389:00 +CPU= 31.467
  13:43:44 STEP 2390 H=2390:00 +CPU= 31.572
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  13:45:39 STEP 2391 H=2391:00 +CPU= 48.896
  13:46:12 STEP 2392 H=2392:00 +CPU= 32.990
  13:46:43 STEP 2393 H=2393:00 +CPU= 31.189
  13:47:33 STEP 2394 H=2394:00 +CPU= 49.845
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  13:48:35 STEP 2395 H=2395:00 +CPU= 31.270
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  13:51:10 STEP 2396 H=2396:00 +CPU= 33.494
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  13:53:53 STEP 2397 H=2397:00 +CPU= 52.113
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  13:57:42 STEP 2398 H=2398:00 +CPU= 32.011
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  13:58:24 STEP 2399 H=2399:00 +CPU= 32.438
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  13:59:59 STEP 2400 H=2400:00 +CPU= 59.564
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002400
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002400
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMGGhq0f+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMSHhq0f+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMUAhq0f+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMGGhq0f+002388
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMSHhq0f+002388
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMUAhq0f+002388
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0874_1995050100_123_964_12181518_0_r1839081001_99.zip
Uploading the intermediate file: upload_file_99.zip
  14:00:29 STEP 2401 H=2401:00 +CPU= 29.053
Uploading trickle at timestep: 8640000
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:01:12 STEP 2402 H=2402:00 +CPU= 31.131
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:02:46 STEP 2403 H=2403:00 +CPU= 51.546
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:03:58 STEP 2404 H=2404:00 +CPU= 33.102
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:05:34 STEP 2405 H=2405:00 +CPU= 31.853
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:09:13 STEP 2406 H=2406:00 +CPU= 52.063
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:09:59 STEP 2407 H=2407:00 +CPU= 32.193
  14:10:37 STEP 2408 H=2408:00 +CPU= 37.754
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:12:25 STEP 2409 H=2409:00 +CPU= 55.053
  14:13:00 STEP 2410 H=2410:00 +CPU= 35.272
  14:13:34 STEP 2411 H=2411:00 +CPU= 34.296
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:15:19 STEP 2412 H=2412:00 +CPU= 60.578
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002412
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002412
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002412
  14:16:25 STEP 2413 H=2413:00 +CPU= 33.052
  14:16:57 STEP 2414 H=2414:00 +CPU= 31.876
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:18:41 STEP 2415 H=2415:00 +CPU= 51.085
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:20:02 STEP 2416 H=2416:00 +CPU= 33.362
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:20:51 STEP 2417 H=2417:00 +CPU= 28.122
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:22:03 STEP 2418 H=2418:00 +CPU= 46.415
  14:22:31 STEP 2419 H=2419:00 +CPU= 28.915
  14:23:02 STEP 2420 H=2420:00 +CPU= 30.723
  14:23:49 STEP 2421 H=2421:00 +CPU= 46.855
  14:24:18 STEP 2422 H=2422:00 +CPU= 28.539
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:25:57 STEP 2423 H=2423:00 +CPU= 30.531
  14:26:50 STEP 2424 H=2424:00 +CPU= 52.741
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002424
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002424
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMGGhq0f+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMSHhq0f+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMUAhq0f+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMGGhq0f+002412
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMSHhq0f+002412
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMUAhq0f+002412
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0874_1995050100_123_964_12181518_0_r1839081001_100.zip
Uploading the intermediate file: upload_file_100.zip
  14:27:19 STEP 2425 H=2425:00 +CPU= 28.416
  14:27:52 STEP 2426 H=2426:00 +CPU= 33.236
  14:28:41 STEP 2427 H=2427:00 +CPU= 48.655
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:30:17 STEP 2428 H=2428:00 +CPU= 28.570
  14:30:44 STEP 2429 H=2429:00 +CPU= 25.985
  14:31:28 STEP 2430 H=2430:00 +CPU= 44.402
  14:31:54 STEP 2431 H=2431:00 +CPU= 25.976
  14:32:21 STEP 2432 H=2432:00 +CPU= 26.782
  14:33:07 STEP 2433 H=2433:00 +CPU= 46.506
  14:33:35 STEP 2434 H=2434:00 +CPU= 27.240
  14:34:03 STEP 2435 H=2435:00 +CPU= 27.921
  14:34:53 STEP 2436 H=2436:00 +CPU= 50.398
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002436
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002436
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002436
  14:35:22 STEP 2437 H=2437:00 +CPU= 28.524
  14:35:47 STEP 2438 H=2438:00 +CPU= 25.560
  14:36:28 STEP 2439 H=2439:00 +CPU= 40.627
  14:36:54 STEP 2440 H=2440:00 +CPU= 26.263
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:38:02 STEP 2441 H=2441:00 +CPU= 26.077
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:39:42 STEP 2442 H=2442:00 +CPU= 44.240
  14:40:15 STEP 2443 H=2443:00 +CPU= 32.815
  14:40:44 STEP 2444 H=2444:00 +CPU= 29.403
  14:41:28 STEP 2445 H=2445:00 +CPU= 43.309
  14:41:56 STEP 2446 H=2446:00 +CPU= 28.224
  14:42:22 STEP 2447 H=2447:00 +CPU= 26.143
  14:43:13 STEP 2448 H=2448:00 +CPU= 50.610
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002448
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002448
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMGGhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMSHhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMUAhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMGGhq0f+002436
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMSHhq0f+002436
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMUAhq0f+002436
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0874_1995050100_123_964_12181518_0_r1839081001_101.zip
Uploading the intermediate file: upload_file_101.zip
  14:43:39 STEP 2449 H=2449:00 +CPU= 25.757
  14:44:06 STEP 2450 H=2450:00 +CPU= 27.795
  14:45:00 STEP 2451 H=2451:00 +CPU= 53.854
  14:45:36 STEP 2452 H=2452:00 +CPU= 35.758
  14:46:10 STEP 2453 H=2453:00 +CPU= 34.055
  14:47:04 STEP 2454 H=2454:00 +CPU= 53.556
  14:47:35 STEP 2455 H=2455:00 +CPU= 31.276
  14:48:09 STEP 2456 H=2456:00 +CPU= 33.697
  14:49:04 STEP 2457 H=2457:00 +CPU= 55.309
  14:49:37 STEP 2458 H=2458:00 +CPU= 32.813
  14:50:07 STEP 2459 H=2459:00 +CPU= 30.129
  14:51:05 STEP 2460 H=2460:00 +CPU= 57.591
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002460
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002460
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002460
  14:51:38 STEP 2461 H=2461:00 +CPU= 33.212
  14:52:14 STEP 2462 H=2462:00 +CPU= 35.719
  14:53:08 STEP 2463 H=2463:00 +CPU= 54.176
  14:53:39 STEP 2464 H=2464:00 +CPU= 30.683
  14:54:11 STEP 2465 H=2465:00 +CPU= 32.793
  14:55:09 STEP 2466 H=2466:00 +CPU= 57.202
  14:55:49 STEP 2467 H=2467:00 +CPU= 40.134
  14:56:29 STEP 2468 H=2468:00 +CPU= 40.170
  14:57:31 STEP 2469 H=2469:00 +CPU= 61.542
  14:58:09 STEP 2470 H=2470:00 +CPU= 38.000
  14:58:45 STEP 2471 H=2471:00 +CPU= 35.825
  14:59:48 STEP 2472 H=2472:00 +CPU= 63.006
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002472
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002472
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMGGhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMSHhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMUAhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMGGhq0f+002460
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMSHhq0f+002460
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMUAhq0f+002460
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0874_1995050100_123_964_12181518_0_r1839081001_102.zip
Uploading the intermediate file: upload_file_102.zip
  15:00:23 STEP 2473 H=2473:00 +CPU= 35.511
  15:00:55 STEP 2474 H=2474:00 +CPU= 31.395
  15:01:46 STEP 2475 H=2475:00 +CPU= 50.808
  15:02:15 STEP 2476 H=2476:00 +CPU= 29.100
  15:02:49 STEP 2477 H=2477:00 +CPU= 33.761
  15:03:42 STEP 2478 H=2478:00 +CPU= 53.567
  15:04:09 STEP 2479 H=2479:00 +CPU= 26.995
  15:04:34 STEP 2480 H=2480:00 +CPU= 24.684
  15:05:14 STEP 2481 H=2481:00 +CPU= 40.424
  15:05:40 STEP 2482 H=2482:00 +CPU= 26.019
  15:06:10 STEP 2483 H=2483:00 +CPU= 29.338
  15:07:09 STEP 2484 H=2484:00 +CPU= 58.992
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002484
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002484
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002484
  15:07:42 STEP 2485 H=2485:00 +CPU= 32.618
  15:08:14 STEP 2486 H=2486:00 +CPU= 32.147
  15:08:59 STEP 2487 H=2487:00 +CPU= 45.361
  15:09:25 STEP 2488 H=2488:00 +CPU= 26.318
  15:09:53 STEP 2489 H=2489:00 +CPU= 27.089
  15:10:36 STEP 2490 H=2490:00 +CPU= 43.581
  15:11:02 STEP 2491 H=2491:00 +CPU= 26.094
  15:11:29 STEP 2492 H=2492:00 +CPU= 26.265
  15:12:10 STEP 2493 H=2493:00 +CPU= 40.924
  15:12:34 STEP 2494 H=2494:00 +CPU= 24.009
  15:12:59 STEP 2495 H=2495:00 +CPU= 25.844
  15:13:53 STEP 2496 H=2496:00 +CPU= 53.097
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002496
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002496
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMGGhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMSHhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMUAhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMGGhq0f+002484
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMSHhq0f+002484
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMUAhq0f+002484
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0874_1995050100_123_964_12181518_0_r1839081001_103.zip
Uploading the intermediate file: upload_file_103.zip
  15:14:16 STEP 2497 H=2497:00 +CPU= 23.659
  15:14:41 STEP 2498 H=2498:00 +CPU= 24.401
  15:15:20 STEP 2499 H=2499:00 +CPU= 39.297
  15:15:45 STEP 2500 H=2500:00 +CPU= 24.975
  15:16:09 STEP 2501 H=2501:00 +CPU= 24.275
  15:16:51 STEP 2502 H=2502:00 +CPU= 41.396
  15:17:14 STEP 2503 H=2503:00 +CPU= 23.234
  15:17:39 STEP 2504 H=2504:00 +CPU= 24.490
  15:18:17 STEP 2505 H=2505:00 +CPU= 38.278
  15:18:42 STEP 2506 H=2506:00 +CPU= 24.889
  15:19:05 STEP 2507 H=2507:00 +CPU= 23.450
  15:19:46 STEP 2508 H=2508:00 +CPU= 41.090
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002508
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002508
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002508
  15:20:10 STEP 2509 H=2509:00 +CPU= 23.679
  15:20:34 STEP 2510 H=2510:00 +CPU= 24.089
  15:21:13 STEP 2511 H=2511:00 +CPU= 38.793
  15:21:38 STEP 2512 H=2512:00 +CPU= 25.114
  15:22:02 STEP 2513 H=2513:00 +CPU= 23.464
  15:22:40 STEP 2514 H=2514:00 +CPU= 37.958
  15:23:03 STEP 2515 H=2515:00 +CPU= 22.806
  15:23:27 STEP 2516 H=2516:00 +CPU= 24.438
  15:24:05 STEP 2517 H=2517:00 +CPU= 37.874
  15:24:29 STEP 2518 H=2518:00 +CPU= 23.845
  15:24:54 STEP 2519 H=2519:00 +CPU= 24.810
  15:25:38 STEP 2520 H=2520:00 +CPU= 44.700
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002520
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002520
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMGGhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMSHhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMUAhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMGGhq0f+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMSHhq0f+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMUAhq0f+002508
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0874_1995050100_123_964_12181518_0_r1839081001_104.zip
Uploading the intermediate file: upload_file_104.zip
  15:26:02 STEP 2521 H=2521:00 +CPU= 23.699
  15:26:27 STEP 2522 H=2522:00 +CPU= 24.659
  15:27:09 STEP 2523 H=2523:00 +CPU= 42.368
  15:27:35 STEP 2524 H=2524:00 +CPU= 25.660
  15:27:59 STEP 2525 H=2525:00 +CPU= 24.509
  15:28:39 STEP 2526 H=2526:00 +CPU= 39.735
  15:29:03 STEP 2527 H=2527:00 +CPU= 23.642
  15:29:27 STEP 2528 H=2528:00 +CPU= 23.781
  15:30:06 STEP 2529 H=2529:00 +CPU= 39.142
  15:30:30 STEP 2530 H=2530:00 +CPU= 24.169
  15:30:55 STEP 2531 H=2531:00 +CPU= 25.472
  15:31:44 STEP 2532 H=2532:00 +CPU= 48.684
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002532
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002532
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002532
  15:32:10 STEP 2533 H=2533:00 +CPU= 25.471
  15:32:36 STEP 2534 H=2534:00 +CPU= 26.162
  15:33:18 STEP 2535 H=2535:00 +CPU= 41.848
  15:33:44 STEP 2536 H=2536:00 +CPU= 26.143
  15:34:08 STEP 2537 H=2537:00 +CPU= 24.548
  15:34:55 STEP 2538 H=2538:00 +CPU= 46.615
  15:35:25 STEP 2539 H=2539:00 +CPU= 29.739
  15:35:51 STEP 2540 H=2540:00 +CPU= 26.546
  15:36:34 STEP 2541 H=2541:00 +CPU= 42.360
  15:36:59 STEP 2542 H=2542:00 +CPU= 25.013
  15:37:25 STEP 2543 H=2543:00 +CPU= 26.506
  15:38:12 STEP 2544 H=2544:00 +CPU= 46.541
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002544
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002544
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMGGhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMSHhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMUAhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMGGhq0f+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMSHhq0f+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMUAhq0f+002532
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0874_1995050100_123_964_12181518_0_r1839081001_105.zip
Uploading the intermediate file: upload_file_105.zip
  15:38:35 STEP 2545 H=2545:00 +CPU= 23.447
  15:38:59 STEP 2546 H=2546:00 +CPU= 23.952
  15:39:38 STEP 2547 H=2547:00 +CPU= 38.469
  15:40:01 STEP 2548 H=2548:00 +CPU= 23.311
  15:40:24 STEP 2549 H=2549:00 +CPU= 22.671
  15:41:02 STEP 2550 H=2550:00 +CPU= 38.558
  15:41:26 STEP 2551 H=2551:00 +CPU= 23.317
  15:41:49 STEP 2552 H=2552:00 +CPU= 23.720
  15:42:27 STEP 2553 H=2553:00 +CPU= 38.002
  15:42:52 STEP 2554 H=2554:00 +CPU= 24.090
  15:43:18 STEP 2555 H=2555:00 +CPU= 26.329
  15:44:06 STEP 2556 H=2556:00 +CPU= 47.594
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002556
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002556
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002556
  15:44:32 STEP 2557 H=2557:00 +CPU= 26.833
  15:45:00 STEP 2558 H=2558:00 +CPU= 27.552
  15:45:41 STEP 2559 H=2559:00 +CPU= 40.631
  15:46:10 STEP 2560 H=2560:00 +CPU= 28.797
  15:46:40 STEP 2561 H=2561:00 +CPU= 29.777
  15:47:27 STEP 2562 H=2562:00 +CPU= 46.500
  15:47:52 STEP 2563 H=2563:00 +CPU= 25.343
  15:48:17 STEP 2564 H=2564:00 +CPU= 24.881
  15:49:00 STEP 2565 H=2565:00 +CPU= 42.615
  15:49:29 STEP 2566 H=2566:00 +CPU= 29.104
  15:49:57 STEP 2567 H=2567:00 +CPU= 27.902
  15:50:49 STEP 2568 H=2568:00 +CPU= 51.817
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002568
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002568
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMGGhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMSHhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMUAhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMGGhq0f+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMSHhq0f+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518/ICMUAhq0f+002556
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0874_1995050100_123_964_12181518_0_r1839081001_106.zip
Uploading the intermediate file: upload_file_106.zip
  15:51:15 STEP 2569 H=2569:00 +CPU= 25.629
  15:51:40 STEP 2570 H=2570:00 +CPU= 25.153
  15:52:19 STEP 2571 H=2571:00 +CPU= 38.708
  15:52:45 STEP 2572 H=2572:00 +CPU= 25.798
  15:53:08 STEP 2573 H=2573:00 +CPU= 23.849
  15:53:50 STEP 2574 H=2574:00 +CPU= 41.113
  15:54:14 STEP 2575 H=2575:00 +CPU= 24.304
  15:54:38 STEP 2576 H=2576:00 +CPU= 24.521
  15:55:18 STEP 2577 H=2577:00 +CPU= 39.376
  15:55:45 STEP 2578 H=2578:00 +CPU= 26.988
  15:56:10 STEP 2579 H=2579:00 +CPU= 25.449
  15:56:58 STEP 2580 H=2580:00 +CPU= 47.360
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002580
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002580
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002580
  15:57:24 STEP 2581 H=2581:00 +CPU= 26.431
  16:01:33 STEP 2582 H=2582:00 +CPU= 25.030
  16:02:08 STEP 2583 H=2583:00 +CPU= 35.261
  16:02:29 STEP 2584 H=2584:00 +CPU= 21.008
  16:02:50 STEP 2585 H=2585:00 +CPU= 20.449
  16:03:25 STEP 2586 H=2586:00 +CPU= 35.048
  16:03:46 STEP 2587 H=2587:00 +CPU= 21.367
  16:04:09 STEP 2588 H=2588:00 +CPU= 23.049
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1995050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0874
(argv4) batchid: 964
(argv5) wuid: 12181518
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/1
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12181518
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/1/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/1/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_58d2f1a05b4834d5cf4e6f0dacc3b030 to: /var/lib/boinc-client/slots/1/oifs_43r3_ps_0874_1995050100_123_964_12181518.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/1/oifs_43r3_ps_0874_1995050100_123_964_12181518.zip
ic_ancil_file: ic_ancil_12181518
ifsdata_file: ifsdata_12181518
climate_data_file: clim_data_12181518
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_2ceef348be1274f94eb33dda1ca07283 to: /var/lib/boinc-client/slots/1/ic_ancil_12181518.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/1/ic_ancil_12181518.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_9c2d32dd83a1591385ff96e5041870ca to: /var/lib/boinc-client/slots/1/ifsdata/ifsdata_12181518.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/1/ifsdata/ifsdata_12181518.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/1/159l_2/clim_data_12181518.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/1/159l_2/clim_data_12181518.zip
Checking for progress XML file: /var/lib/boinc-client/slots/1/progress_file_12181518.xml
Opened progress file ok : /var/lib/boinc-client/slots/1/progress_file_12181518.xml
-- Model is restarting --
Adjusting last_iter, 2589, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/1/progress_file_12181518.xml
last_cpu_time: 85028
upload_file_number: 107
last_iter: 2567
last_upload: 9244800
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0874_1995050100_123_964_12181518_0_r1839081001
The child process has been launched with process id: 372112
Executing the command: /var/lib/boinc-client/slots/1/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:dbgrensenh27vm:1:1:372112:372112] [20230119:160904:1674140944:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:dbgrensenh27vm:1:1:372112:372112] [20230119:160904:1674140944:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:dbgrensenh27vm:1:1:372112:372112] [20230119:160904:1674140944:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:dbgrensenh27vm:1:1:372112:372112] [20230119:160904:1674140944:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:dbgrensenh27vm:1:1:372112:372112] [20230119:160904:1674140944:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:dbgrensenh27vm:1:1:372112:372112] [20230119:160904:1674140944:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:dbgrensenh27vm:1:1:372112:372112] [20230119:160904:1674140944:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:dbgrensenh27vm:1:1:372112:372112] [20230119:160904:1674140944:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:dbgrensenh27vm:1:1:372112:372112] [20230119:160904:1674140944:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:dbgrensenh27vm:1:1:372112:372112] [20230119:160904:1674140944:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:dbgrensenh27vm:1:1:372112:372112] [20230119:160904:1674140944:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:dbgrensenh27vm:1:1:372112:372112] [20230119:160904:1674140944:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:dbgrensenh27vm:1:1:372112:372112] [20230119:160904:1674140944:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:dbgrensenh27vm:1:1:372112:372112] [20230119:160904:1674140944:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:dbgrensenh27vm:1:1:372112:372112] [20230119:160904:1674140944:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:dbgrensenh27vm:1:1:372112:372112] [20230119:160904:1674140944:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:dbgrensenh27vm:1:1:372112:372112] [20230119:160904:1674140944:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:dbgrensenh27vm:1:1:372112:372112] [20230119:160904:1674140944:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:dbgrensenh27vm:1:1:372112:372112] [20230119:160904:1674140944:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:dbgrensenh27vm:1:1:372112:372112] [20230119:160904:1674140944:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:dbgrensenh27vm:1:1:372112:372112] [20230119:160904:1674140944:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:dbgrensenh27vm:1:1:372112:372112] [20230119:160904:1674140944:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:dbgrensenh27vm:1:1:372112:372112] [20230119:160904:1674140944:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:dbgrensenh27vm:1:1:372112:372112] [20230119:160904:1674140944:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:dbgrensenh27vm:1:1:372112:372112] [20230119:160904:1674140944:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:dbgrensenh27vm:1:1:372112:372112] [20230119:160904:1674140944:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:dbgrensenh27vm:1:1:372112:372112] [20230119:160904:1674140944:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:dbgrensenh27vm:1:1:372112:372112] [20230119:160904:1674140944:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:dbgrensenh27vm:1:1:372112:372112] [20230119:160904:1674140944:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:dbgrensenh27vm:1:1:372112:372112] [20230119:160904:1674140944:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
The child process terminated with status: 0
..Failed, model did not complete successfully

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:28:34 1498859 22266557 oifs_43r3_ps_0874_1995050100_123_964_12181518_0 8,640,000 78,664 0.0091
09 May 2023 16:28:17 1498859 22266557 oifs_43r3_ps_0874_1995050100_123_964_12181518_0 7,776,000 69,767 0.0090
09 May 2023 16:28:03 1498859 22266557 oifs_43r3_ps_0874_1995050100_123_964_12181518_0 6,912,000 60,626 0.0088
09 May 2023 16:27:49 1498859 22266557 oifs_43r3_ps_0874_1995050100_123_964_12181518_0 6,048,000 52,236 0.0086
09 May 2023 16:27:39 1498859 22266557 oifs_43r3_ps_0874_1995050100_123_964_12181518_0 5,184,000 44,808 0.0086
09 May 2023 16:27:29 1498859 22266557 oifs_43r3_ps_0874_1995050100_123_964_12181518_0 4,320,000 37,422 0.0087
09 May 2023 16:27:23 1498859 22266557 oifs_43r3_ps_0874_1995050100_123_964_12181518_0 3,456,000 29,985 0.0087
09 May 2023 16:26:54 1498859 22266557 oifs_43r3_ps_0874_1995050100_123_964_12181518_0 1,728,000 15,035 0.0087
09 May 2023 16:26:42 1498859 22266557 oifs_43r3_ps_0874_1995050100_123_964_12181518_0 864,000 7,720 0.0089


©2024 climateprediction.net