climateprediction.net home page
Task 22252128

Task 22252128

Name oifs_43r3_ps_0255_1982050100_123_951_12167899_0
Workunit 12167899
Created 20 Dec 2022, 21:40:09 UTC
Sent 11 Jan 2023, 18:54:58 UTC
Report deadline 10 Feb 2023, 18:54:58 UTC
Received 12 Jan 2023, 19:17:23 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 9 (0x00000009) Unknown error code
Computer ID 1462795
Run time 23 hours 26 min 36 sec
CPU time 23 hours 23 min 18 sec
Validate state Invalid
Credit 14,515.20
Device peak FLOPS 3.66 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,405.93 MB
Peak swap size 4,974.25 MB
Peak disk usage 2,347.15 MB
Stderr
<core_client_version>7.9.3</core_client_version>
<![CDATA[
<message>
process exited with code 9 (0x9, -247)</message>
<stderr_txt>
EP 2302 H=2302:00 +CPU= 24.429
  07:49:23 STEP 2303 H=2303:00 +CPU= 24.305
  07:50:07 STEP 2304 H=2304:00 +CPU= 44.313
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMGGhq0f+002304
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMSHhq0f+002304
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMUAhq0f+002304
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMGGhq0f+002280
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMSHhq0f+002280
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMUAhq0f+002280
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMGGhq0f+002292
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMSHhq0f+002292
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMUAhq0f+002292
Zipping up the intermediate file: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_0255_1982050100_123_951_12167899_0_r124317380_95.zip
Uploading the intermediate file: upload_file_95.zip
  07:50:31 STEP 2305 H=2305:00 +CPU= 23.358
  07:50:55 STEP 2306 H=2306:00 +CPU= 24.457
  07:51:33 STEP 2307 H=2307:00 +CPU= 38.201
  07:51:58 STEP 2308 H=2308:00 +CPU= 24.279
  07:52:21 STEP 2309 H=2309:00 +CPU= 23.731
  07:53:00 STEP 2310 H=2310:00 +CPU= 38.955
  07:53:24 STEP 2311 H=2311:00 +CPU= 23.483
  07:53:49 STEP 2312 H=2312:00 +CPU= 24.829
  07:54:28 STEP 2313 H=2313:00 +CPU= 39.307
  07:54:52 STEP 2314 H=2314:00 +CPU= 24.335
  07:55:16 STEP 2315 H=2315:00 +CPU= 23.405
  07:55:59 STEP 2316 H=2316:00 +CPU= 43.495
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMGGhq0f+002316
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMSHhq0f+002316
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMUAhq0f+002316
  07:56:23 STEP 2317 H=2317:00 +CPU= 23.310
  07:56:47 STEP 2318 H=2318:00 +CPU= 23.999
  07:57:25 STEP 2319 H=2319:00 +CPU= 38.142
  07:57:49 STEP 2320 H=2320:00 +CPU= 24.152
  07:58:13 STEP 2321 H=2321:00 +CPU= 23.683
  07:58:52 STEP 2322 H=2322:00 +CPU= 39.252
  07:59:15 STEP 2323 H=2323:00 +CPU= 23.163
  07:59:39 STEP 2324 H=2324:00 +CPU= 24.258
  08:00:17 STEP 2325 H=2325:00 +CPU= 38.065
  08:00:42 STEP 2326 H=2326:00 +CPU= 24.182
  08:01:06 STEP 2327 H=2327:00 +CPU= 24.387
  08:01:50 STEP 2328 H=2328:00 +CPU= 43.748
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMGGhq0f+002328
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMSHhq0f+002328
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMUAhq0f+002328
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMGGhq0f+002304
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMSHhq0f+002304
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMUAhq0f+002304
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMGGhq0f+002316
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMSHhq0f+002316
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMUAhq0f+002316
Zipping up the intermediate file: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_0255_1982050100_123_951_12167899_0_r124317380_96.zip
Uploading the intermediate file: upload_file_96.zip
  08:02:13 STEP 2329 H=2329:00 +CPU= 23.234
  08:02:37 STEP 2330 H=2330:00 +CPU= 24.374
  08:03:15 STEP 2331 H=2331:00 +CPU= 38.008
  08:03:39 STEP 2332 H=2332:00 +CPU= 23.991
  08:04:03 STEP 2333 H=2333:00 +CPU= 23.640
  08:04:42 STEP 2334 H=2334:00 +CPU= 38.858
  08:05:05 STEP 2335 H=2335:00 +CPU= 23.426
  08:05:30 STEP 2336 H=2336:00 +CPU= 24.278
  08:06:08 STEP 2337 H=2337:00 +CPU= 38.047
  08:06:32 STEP 2338 H=2338:00 +CPU= 24.414
  08:06:56 STEP 2339 H=2339:00 +CPU= 23.566
  08:07:37 STEP 2340 H=2340:00 +CPU= 41.953
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMGGhq0f+002340
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMSHhq0f+002340
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMUAhq0f+002340
  08:08:01 STEP 2341 H=2341:00 +CPU= 23.410
  08:08:25 STEP 2342 H=2342:00 +CPU= 24.308
  08:09:03 STEP 2343 H=2343:00 +CPU= 38.059
  08:09:27 STEP 2344 H=2344:00 +CPU= 24.061
  08:09:51 STEP 2345 H=2345:00 +CPU= 23.880
  08:10:31 STEP 2346 H=2346:00 +CPU= 39.294
  08:10:55 STEP 2347 H=2347:00 +CPU= 24.801
  08:11:20 STEP 2348 H=2348:00 +CPU= 24.521
  08:11:59 STEP 2349 H=2349:00 +CPU= 38.740
  08:12:23 STEP 2350 H=2350:00 +CPU= 24.863
  08:12:48 STEP 2351 H=2351:00 +CPU= 25.008
  08:13:36 STEP 2352 H=2352:00 +CPU= 47.264
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMGGhq0f+002352
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMSHhq0f+002352
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMUAhq0f+002352
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMGGhq0f+002328
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMSHhq0f+002328
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMUAhq0f+002328
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMGGhq0f+002340
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMSHhq0f+002340
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMUAhq0f+002340
Zipping up the intermediate file: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_0255_1982050100_123_951_12167899_0_r124317380_97.zip
Uploading the intermediate file: upload_file_97.zip
  08:14:00 STEP 2353 H=2353:00 +CPU= 24.724
  08:14:25 STEP 2354 H=2354:00 +CPU= 24.995
  08:15:04 STEP 2355 H=2355:00 +CPU= 38.943
  08:15:29 STEP 2356 H=2356:00 +CPU= 24.238
  08:15:52 STEP 2357 H=2357:00 +CPU= 22.933
  08:16:29 STEP 2358 H=2358:00 +CPU= 37.846
  08:16:52 STEP 2359 H=2359:00 +CPU= 22.688
  08:17:16 STEP 2360 H=2360:00 +CPU= 23.397
  08:17:53 STEP 2361 H=2361:00 +CPU= 37.118
  08:18:17 STEP 2362 H=2362:00 +CPU= 24.302
  08:18:40 STEP 2363 H=2363:00 +CPU= 22.742
  08:19:20 STEP 2364 H=2364:00 +CPU= 40.817
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMGGhq0f+002364
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMSHhq0f+002364
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMUAhq0f+002364
  08:19:43 STEP 2365 H=2365:00 +CPU= 22.972
  08:20:07 STEP 2366 H=2366:00 +CPU= 23.242
  08:20:44 STEP 2367 H=2367:00 +CPU= 36.856
  08:21:07 STEP 2368 H=2368:00 +CPU= 23.692
  08:21:31 STEP 2369 H=2369:00 +CPU= 23.500
  08:22:10 STEP 2370 H=2370:00 +CPU= 38.885
  08:22:33 STEP 2371 H=2371:00 +CPU= 23.472
  08:22:57 STEP 2372 H=2372:00 +CPU= 23.855
  08:23:35 STEP 2373 H=2373:00 +CPU= 38.087
  08:23:59 STEP 2374 H=2374:00 +CPU= 24.193
  08:24:23 STEP 2375 H=2375:00 +CPU= 24.077
  08:25:10 STEP 2376 H=2376:00 +CPU= 46.383
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMGGhq0f+002376
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMSHhq0f+002376
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMUAhq0f+002376
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMGGhq0f+002352
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMSHhq0f+002352
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMUAhq0f+002352
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMGGhq0f+002364
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMSHhq0f+002364
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMUAhq0f+002364
Zipping up the intermediate file: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_0255_1982050100_123_951_12167899_0_r124317380_98.zip
Uploading the intermediate file: upload_file_98.zip
  08:25:33 STEP 2377 H=2377:00 +CPU= 23.591
  08:25:57 STEP 2378 H=2378:00 +CPU= 23.211
  08:26:33 STEP 2379 H=2379:00 +CPU= 36.471
  08:26:56 STEP 2380 H=2380:00 +CPU= 22.857
  08:27:18 STEP 2381 H=2381:00 +CPU= 22.431
  08:27:55 STEP 2382 H=2382:00 +CPU= 36.627
  08:28:17 STEP 2383 H=2383:00 +CPU= 22.087
  08:28:40 STEP 2384 H=2384:00 +CPU= 22.715
  08:29:16 STEP 2385 H=2385:00 +CPU= 35.846
  08:29:39 STEP 2386 H=2386:00 +CPU= 23.081
  08:30:01 STEP 2387 H=2387:00 +CPU= 22.019
  08:30:41 STEP 2388 H=2388:00 +CPU= 39.935
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMGGhq0f+002388
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMSHhq0f+002388
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMUAhq0f+002388
  08:31:03 STEP 2389 H=2389:00 +CPU= 22.233
  08:31:26 STEP 2390 H=2390:00 +CPU= 22.799
  08:32:02 STEP 2391 H=2391:00 +CPU= 35.896
  08:32:24 STEP 2392 H=2392:00 +CPU= 22.761
  08:32:47 STEP 2393 H=2393:00 +CPU= 22.355
  08:33:23 STEP 2394 H=2394:00 +CPU= 36.832
  08:33:46 STEP 2395 H=2395:00 +CPU= 22.362
  08:34:09 STEP 2396 H=2396:00 +CPU= 22.756
  08:34:45 STEP 2397 H=2397:00 +CPU= 36.069
  08:35:08 STEP 2398 H=2398:00 +CPU= 23.085
  08:35:31 STEP 2399 H=2399:00 +CPU= 22.762
  08:36:14 STEP 2400 H=2400:00 +CPU= 43.164
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMGGhq0f+002400
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMSHhq0f+002400
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMUAhq0f+002400
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMGGhq0f+002376
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMSHhq0f+002376
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMUAhq0f+002376
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMGGhq0f+002388
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMSHhq0f+002388
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMUAhq0f+002388
Zipping up the intermediate file: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_0255_1982050100_123_951_12167899_0_r124317380_99.zip
Uploading the intermediate file: upload_file_99.zip
Uploading trickle at timestep: 8640000
  08:36:39 STEP 2401 H=2401:00 +CPU= 25.374
  08:37:03 STEP 2402 H=2402:00 +CPU= 24.388
  08:37:40 STEP 2403 H=2403:00 +CPU= 36.778
  08:38:03 STEP 2404 H=2404:00 +CPU= 22.968
  08:38:26 STEP 2405 H=2405:00 +CPU= 22.601
  08:39:03 STEP 2406 H=2406:00 +CPU= 36.768
  08:39:25 STEP 2407 H=2407:00 +CPU= 22.062
  08:39:47 STEP 2408 H=2408:00 +CPU= 22.613
  08:40:23 STEP 2409 H=2409:00 +CPU= 35.897
  08:40:46 STEP 2410 H=2410:00 +CPU= 22.767
  08:41:08 STEP 2411 H=2411:00 +CPU= 21.984
  08:41:48 STEP 2412 H=2412:00 +CPU= 39.990
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMGGhq0f+002412
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMSHhq0f+002412
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMUAhq0f+002412
  08:42:10 STEP 2413 H=2413:00 +CPU= 22.134
  08:42:33 STEP 2414 H=2414:00 +CPU= 22.638
  08:43:09 STEP 2415 H=2415:00 +CPU= 36.128
  08:43:32 STEP 2416 H=2416:00 +CPU= 23.097
  08:43:54 STEP 2417 H=2417:00 +CPU= 21.967
  08:44:31 STEP 2418 H=2418:00 +CPU= 36.763
  08:44:53 STEP 2419 H=2419:00 +CPU= 22.047
  08:45:15 STEP 2420 H=2420:00 +CPU= 22.798
  08:45:52 STEP 2421 H=2421:00 +CPU= 36.181
  08:46:14 STEP 2422 H=2422:00 +CPU= 22.749
  08:46:37 STEP 2423 H=2423:00 +CPU= 22.648
  08:47:21 STEP 2424 H=2424:00 +CPU= 43.462
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMGGhq0f+002424
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMSHhq0f+002424
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMUAhq0f+002424
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMGGhq0f+002400
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMSHhq0f+002400
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMUAhq0f+002400
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMGGhq0f+002412
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMSHhq0f+002412
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMUAhq0f+002412
Zipping up the intermediate file: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_0255_1982050100_123_951_12167899_0_r124317380_100.zip
Uploading the intermediate file: upload_file_100.zip
  08:47:43 STEP 2425 H=2425:00 +CPU= 22.321
  08:48:06 STEP 2426 H=2426:00 +CPU= 22.778
  08:48:42 STEP 2427 H=2427:00 +CPU= 36.598
  08:49:05 STEP 2428 H=2428:00 +CPU= 22.814
  08:49:27 STEP 2429 H=2429:00 +CPU= 22.388
  08:50:05 STEP 2430 H=2430:00 +CPU= 37.021
  08:50:27 STEP 2431 H=2431:00 +CPU= 22.116
  08:50:49 STEP 2432 H=2432:00 +CPU= 22.639
  08:51:25 STEP 2433 H=2433:00 +CPU= 35.886
  08:51:48 STEP 2434 H=2434:00 +CPU= 22.758
  08:52:10 STEP 2435 H=2435:00 +CPU= 21.905
  08:52:49 STEP 2436 H=2436:00 +CPU= 39.672
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMGGhq0f+002436
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMSHhq0f+002436
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMUAhq0f+002436
  08:53:12 STEP 2437 H=2437:00 +CPU= 22.166
  08:53:35 STEP 2438 H=2438:00 +CPU= 22.962
  08:54:11 STEP 2439 H=2439:00 +CPU= 35.898
  08:54:34 STEP 2440 H=2440:00 +CPU= 23.111
  08:54:56 STEP 2441 H=2441:00 +CPU= 21.953
  08:55:32 STEP 2442 H=2442:00 +CPU= 36.819
  08:55:55 STEP 2443 H=2443:00 +CPU= 22.116
  08:56:17 STEP 2444 H=2444:00 +CPU= 22.666
  08:56:53 STEP 2445 H=2445:00 +CPU= 35.982
  08:57:16 STEP 2446 H=2446:00 +CPU= 22.815
  08:57:39 STEP 2447 H=2447:00 +CPU= 22.843
  08:58:21 STEP 2448 H=2448:00 +CPU= 41.936
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMGGhq0f+002448
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMSHhq0f+002448
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMUAhq0f+002448
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMGGhq0f+002424
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMSHhq0f+002424
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMUAhq0f+002424
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMGGhq0f+002436
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMSHhq0f+002436
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMUAhq0f+002436
Zipping up the intermediate file: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_0255_1982050100_123_951_12167899_0_r124317380_101.zip
Uploading the intermediate file: upload_file_101.zip
  08:58:43 STEP 2449 H=2449:00 +CPU= 22.175
  08:59:06 STEP 2450 H=2450:00 +CPU= 22.800
  08:59:42 STEP 2451 H=2451:00 +CPU= 35.748
  09:00:04 STEP 2452 H=2452:00 +CPU= 22.795
  09:00:27 STEP 2453 H=2453:00 +CPU= 22.379
  09:01:04 STEP 2454 H=2454:00 +CPU= 37.068
  09:01:26 STEP 2455 H=2455:00 +CPU= 22.171
  09:01:49 STEP 2456 H=2456:00 +CPU= 23.459
  09:02:25 STEP 2457 H=2457:00 +CPU= 35.888
  09:02:48 STEP 2458 H=2458:00 +CPU= 22.907
  09:03:10 STEP 2459 H=2459:00 +CPU= 22.064
  09:03:50 STEP 2460 H=2460:00 +CPU= 39.724
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMGGhq0f+002460
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMSHhq0f+002460
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMUAhq0f+002460
  09:04:12 STEP 2461 H=2461:00 +CPU= 22.047
  09:04:35 STEP 2462 H=2462:00 +CPU= 22.578
  09:05:11 STEP 2463 H=2463:00 +CPU= 35.964
  09:05:34 STEP 2464 H=2464:00 +CPU= 23.293
  09:05:56 STEP 2465 H=2465:00 +CPU= 21.960
  09:06:33 STEP 2466 H=2466:00 +CPU= 36.759
  09:06:55 STEP 2467 H=2467:00 +CPU= 22.117
  09:07:17 STEP 2468 H=2468:00 +CPU= 22.623
  09:07:53 STEP 2469 H=2469:00 +CPU= 35.759
  09:08:16 STEP 2470 H=2470:00 +CPU= 22.742
  09:08:38 STEP 2471 H=2471:00 +CPU= 22.583
  09:09:20 STEP 2472 H=2472:00 +CPU= 42.014
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMGGhq0f+002472
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMSHhq0f+002472
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMUAhq0f+002472
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMGGhq0f+002448
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMSHhq0f+002448
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMUAhq0f+002448
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMGGhq0f+002460
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMSHhq0f+002460
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMUAhq0f+002460
Zipping up the intermediate file: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_0255_1982050100_123_951_12167899_0_r124317380_102.zip
Uploading the intermediate file: upload_file_102.zip
  09:09:43 STEP 2473 H=2473:00 +CPU= 22.293
  09:10:05 STEP 2474 H=2474:00 +CPU= 22.615
  09:10:41 STEP 2475 H=2475:00 +CPU= 36.071
  09:11:04 STEP 2476 H=2476:00 +CPU= 22.651
  09:11:26 STEP 2477 H=2477:00 +CPU= 22.196
  09:12:03 STEP 2478 H=2478:00 +CPU= 36.979
  09:12:26 STEP 2479 H=2479:00 +CPU= 22.452
  09:12:48 STEP 2480 H=2480:00 +CPU= 22.672
  09:13:24 STEP 2481 H=2481:00 +CPU= 35.795
  09:13:47 STEP 2482 H=2482:00 +CPU= 23.153
  09:14:09 STEP 2483 H=2483:00 +CPU= 21.961
  09:14:49 STEP 2484 H=2484:00 +CPU= 40.140
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMGGhq0f+002484
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMSHhq0f+002484
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMUAhq0f+002484
  09:15:13 STEP 2485 H=2485:00 +CPU= 23.174
  09:15:37 STEP 2486 H=2486:00 +CPU= 24.420
  09:16:13 STEP 2487 H=2487:00 +CPU= 36.176
  09:16:36 STEP 2488 H=2488:00 +CPU= 23.234
  09:16:59 STEP 2489 H=2489:00 +CPU= 22.365
  09:17:36 STEP 2490 H=2490:00 +CPU= 37.107
  09:17:58 STEP 2491 H=2491:00 +CPU= 22.022
  09:18:21 STEP 2492 H=2492:00 +CPU= 22.596
  09:18:56 STEP 2493 H=2493:00 +CPU= 35.723
  09:19:19 STEP 2494 H=2494:00 +CPU= 22.771
  09:19:42 STEP 2495 H=2495:00 +CPU= 22.515
  09:20:24 STEP 2496 H=2496:00 +CPU= 41.937
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMGGhq0f+002496
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMSHhq0f+002496
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMUAhq0f+002496
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMGGhq0f+002472
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMSHhq0f+002472
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMUAhq0f+002472
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMGGhq0f+002484
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMSHhq0f+002484
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMUAhq0f+002484
Zipping up the intermediate file: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_0255_1982050100_123_951_12167899_0_r124317380_103.zip
Uploading the intermediate file: upload_file_103.zip
  09:20:46 STEP 2497 H=2497:00 +CPU= 22.109
  09:21:08 STEP 2498 H=2498:00 +CPU= 22.612
  09:21:44 STEP 2499 H=2499:00 +CPU= 36.243
  09:22:07 STEP 2500 H=2500:00 +CPU= 22.773
  09:22:29 STEP 2501 H=2501:00 +CPU= 22.032
  09:23:06 STEP 2502 H=2502:00 +CPU= 37.190
  09:23:29 STEP 2503 H=2503:00 +CPU= 22.390
  09:23:52 STEP 2504 H=2504:00 +CPU= 22.829
  09:24:28 STEP 2505 H=2505:00 +CPU= 36.178
  09:24:51 STEP 2506 H=2506:00 +CPU= 22.832
  09:25:13 STEP 2507 H=2507:00 +CPU= 22.030
  09:25:53 STEP 2508 H=2508:00 +CPU= 39.774
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMGGhq0f+002508
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMSHhq0f+002508
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMUAhq0f+002508
  09:26:15 STEP 2509 H=2509:00 +CPU= 22.078
  09:26:37 STEP 2510 H=2510:00 +CPU= 22.699
  09:27:13 STEP 2511 H=2511:00 +CPU= 35.761
  09:27:36 STEP 2512 H=2512:00 +CPU= 22.959
  09:27:58 STEP 2513 H=2513:00 +CPU= 21.986
  09:28:35 STEP 2514 H=2514:00 +CPU= 36.511
  09:28:57 STEP 2515 H=2515:00 +CPU= 22.056
  09:29:19 STEP 2516 H=2516:00 +CPU= 22.627
  09:29:55 STEP 2517 H=2517:00 +CPU= 35.979
  09:30:18 STEP 2518 H=2518:00 +CPU= 22.952
  09:30:41 STEP 2519 H=2519:00 +CPU= 22.569
  09:31:23 STEP 2520 H=2520:00 +CPU= 41.934
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMGGhq0f+002520
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMSHhq0f+002520
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMUAhq0f+002520
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMGGhq0f+002496
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMSHhq0f+002496
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMUAhq0f+002496
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMGGhq0f+002508
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMSHhq0f+002508
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMUAhq0f+002508
Zipping up the intermediate file: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_0255_1982050100_123_951_12167899_0_r124317380_104.zip
Uploading the intermediate file: upload_file_104.zip
  09:31:45 STEP 2521 H=2521:00 +CPU= 22.044
  09:32:07 STEP 2522 H=2522:00 +CPU= 22.641
  09:32:43 STEP 2523 H=2523:00 +CPU= 35.825
  09:33:07 STEP 2524 H=2524:00 +CPU= 23.566
  09:33:29 STEP 2525 H=2525:00 +CPU= 22.487
  09:34:08 STEP 2526 H=2526:00 +CPU= 38.415
  09:34:30 STEP 2527 H=2527:00 +CPU= 22.693
  09:34:54 STEP 2528 H=2528:00 +CPU= 23.487
  09:35:31 STEP 2529 H=2529:00 +CPU= 37.187
  09:35:55 STEP 2530 H=2530:00 +CPU= 23.614
  09:36:17 STEP 2531 H=2531:00 +CPU= 22.512
  09:36:58 STEP 2532 H=2532:00 +CPU= 40.686
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMGGhq0f+002532
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMSHhq0f+002532
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMUAhq0f+002532
  09:37:21 STEP 2533 H=2533:00 +CPU= 22.961
  09:37:44 STEP 2534 H=2534:00 +CPU= 23.260
  09:38:21 STEP 2535 H=2535:00 +CPU= 36.826
  09:38:44 STEP 2536 H=2536:00 +CPU= 23.568
  09:39:07 STEP 2537 H=2537:00 +CPU= 22.548
  09:39:45 STEP 2538 H=2538:00 +CPU= 37.586
  09:40:07 STEP 2539 H=2539:00 +CPU= 22.541
  09:40:30 STEP 2540 H=2540:00 +CPU= 23.178
  09:41:07 STEP 2541 H=2541:00 +CPU= 36.836
  09:41:30 STEP 2542 H=2542:00 +CPU= 23.159
  09:41:53 STEP 2543 H=2543:00 +CPU= 23.160
  09:42:36 STEP 2544 H=2544:00 +CPU= 42.889
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMGGhq0f+002544
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMSHhq0f+002544
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMUAhq0f+002544
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMGGhq0f+002520
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMSHhq0f+002520
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMUAhq0f+002520
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMGGhq0f+002532
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMSHhq0f+002532
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMUAhq0f+002532
Zipping up the intermediate file: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_0255_1982050100_123_951_12167899_0_r124317380_105.zip
Uploading the intermediate file: upload_file_105.zip
  09:42:59 STEP 2545 H=2545:00 +CPU= 22.547
  09:43:22 STEP 2546 H=2546:00 +CPU= 23.208
  09:43:59 STEP 2547 H=2547:00 +CPU= 36.826
  09:44:22 STEP 2548 H=2548:00 +CPU= 23.323
  09:44:45 STEP 2549 H=2549:00 +CPU= 22.727
  09:45:23 STEP 2550 H=2550:00 +CPU= 38.225
  09:45:46 STEP 2551 H=2551:00 +CPU= 22.612
  09:46:09 STEP 2552 H=2552:00 +CPU= 23.478
  09:46:47 STEP 2553 H=2553:00 +CPU= 37.263
  09:47:10 STEP 2554 H=2554:00 +CPU= 23.371
  09:47:33 STEP 2555 H=2555:00 +CPU= 23.053
  09:48:14 STEP 2556 H=2556:00 +CPU= 40.774
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMGGhq0f+002556
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMSHhq0f+002556
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMUAhq0f+002556
  09:48:37 STEP 2557 H=2557:00 +CPU= 23.065
  09:49:01 STEP 2558 H=2558:00 +CPU= 24.401
  09:49:39 STEP 2559 H=2559:00 +CPU= 37.777
  09:50:03 STEP 2560 H=2560:00 +CPU= 23.765
  09:50:26 STEP 2561 H=2561:00 +CPU= 23.039
  09:51:03 STEP 2562 H=2562:00 +CPU= 36.782
  09:51:24 STEP 2563 H=2563:00 +CPU= 21.362
  09:51:46 STEP 2564 H=2564:00 +CPU= 22.137
  09:52:21 STEP 2565 H=2565:00 +CPU= 35.055
  09:52:43 STEP 2566 H=2566:00 +CPU= 22.004
  09:53:05 STEP 2567 H=2567:00 +CPU= 22.119
  09:53:46 STEP 2568 H=2568:00 +CPU= 40.831
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMGGhq0f+002568
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMSHhq0f+002568
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMUAhq0f+002568
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMGGhq0f+002544
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMSHhq0f+002544
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMUAhq0f+002544
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMGGhq0f+002556
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMSHhq0f+002556
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMUAhq0f+002556
Zipping up the intermediate file: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_0255_1982050100_123_951_12167899_0_r124317380_106.zip
Uploading the intermediate file: upload_file_106.zip
  09:54:08 STEP 2569 H=2569:00 +CPU= 21.457
  09:54:30 STEP 2570 H=2570:00 +CPU= 22.771
  09:55:06 STEP 2571 H=2571:00 +CPU= 35.684
  09:55:29 STEP 2572 H=2572:00 +CPU= 22.773
  09:55:51 STEP 2573 H=2573:00 +CPU= 22.299
  09:56:28 STEP 2574 H=2574:00 +CPU= 37.185
  09:56:50 STEP 2575 H=2575:00 +CPU= 22.031
  09:57:13 STEP 2576 H=2576:00 +CPU= 22.831
  09:57:49 STEP 2577 H=2577:00 +CPU= 36.163
  09:58:12 STEP 2578 H=2578:00 +CPU= 22.774
  09:58:34 STEP 2579 H=2579:00 +CPU= 22.127
  09:59:14 STEP 2580 H=2580:00 +CPU= 39.948
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMGGhq0f+002580
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMSHhq0f+002580
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMUAhq0f+002580
  09:59:36 STEP 2581 H=2581:00 +CPU= 22.002
  09:59:59 STEP 2582 H=2582:00 +CPU= 22.991
  10:00:37 STEP 2583 H=2583:00 +CPU= 38.127
  10:01:00 STEP 2584 H=2584:00 +CPU= 23.043
  10:01:23 STEP 2585 H=2585:00 +CPU= 22.063
  10:01:59 STEP 2586 H=2586:00 +CPU= 36.652
  10:02:21 STEP 2587 H=2587:00 +CPU= 21.921
  10:02:44 STEP 2588 H=2588:00 +CPU= 22.740
  10:03:20 STEP 2589 H=2589:00 +CPU= 35.887
  10:03:42 STEP 2590 H=2590:00 +CPU= 22.577
  10:04:05 STEP 2591 H=2591:00 +CPU= 22.666
  10:04:48 STEP 2592 H=2592:00 +CPU= 42.695
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMGGhq0f+002592
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMSHhq0f+002592
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMUAhq0f+002592
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMGGhq0f+002568
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMSHhq0f+002568
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMUAhq0f+002568
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMGGhq0f+002580
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMSHhq0f+002580
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMUAhq0f+002580
Zipping up the intermediate file: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_0255_1982050100_123_951_12167899_0_r124317380_107.zip
Uploading the intermediate file: upload_file_107.zip
  10:05:10 STEP 2593 H=2593:00 +CPU= 22.186
  10:05:33 STEP 2594 H=2594:00 +CPU= 22.843
  10:06:09 STEP 2595 H=2595:00 +CPU= 35.873
  10:06:31 STEP 2596 H=2596:00 +CPU= 22.722
  10:06:53 STEP 2597 H=2597:00 +CPU= 22.023
  10:07:31 STEP 2598 H=2598:00 +CPU= 37.327
  10:07:53 STEP 2599 H=2599:00 +CPU= 21.948
  10:08:15 STEP 2600 H=2600:00 +CPU= 22.798
  10:08:51 STEP 2601 H=2601:00 +CPU= 36.020
  10:09:14 STEP 2602 H=2602:00 +CPU= 22.643
  10:09:36 STEP 2603 H=2603:00 +CPU= 22.264
  10:10:17 STEP 2604 H=2604:00 +CPU= 40.186
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMGGhq0f+002604
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMSHhq0f+002604
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMUAhq0f+002604
  10:10:39 STEP 2605 H=2605:00 +CPU= 22.020
  10:11:01 STEP 2606 H=2606:00 +CPU= 22.821
  10:11:38 STEP 2607 H=2607:00 +CPU= 36.175
  10:12:00 STEP 2608 H=2608:00 +CPU= 22.651
  10:12:22 STEP 2609 H=2609:00 +CPU= 22.122
  10:12:59 STEP 2610 H=2610:00 +CPU= 36.833
  10:13:21 STEP 2611 H=2611:00 +CPU= 21.914
  10:13:44 STEP 2612 H=2612:00 +CPU= 22.769
  10:14:20 STEP 2613 H=2613:00 +CPU= 35.824
  10:14:42 STEP 2614 H=2614:00 +CPU= 22.570
  10:15:05 STEP 2615 H=2615:00 +CPU= 22.810
  10:15:47 STEP 2616 H=2616:00 +CPU= 41.863
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMGGhq0f+002616
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMSHhq0f+002616
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMUAhq0f+002616
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMGGhq0f+002592
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMSHhq0f+002592
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMUAhq0f+002592
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMGGhq0f+002604
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMSHhq0f+002604
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMUAhq0f+002604
Zipping up the intermediate file: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_0255_1982050100_123_951_12167899_0_r124317380_108.zip
Uploading the intermediate file: upload_file_108.zip
  10:16:09 STEP 2617 H=2617:00 +CPU= 21.892
  10:16:32 STEP 2618 H=2618:00 +CPU= 22.743
  10:17:08 STEP 2619 H=2619:00 +CPU= 35.999
  10:17:30 STEP 2620 H=2620:00 +CPU= 22.636
  10:17:52 STEP 2621 H=2621:00 +CPU= 22.073
  10:18:30 STEP 2622 H=2622:00 +CPU= 37.337
  10:18:52 STEP 2623 H=2623:00 +CPU= 21.943
  10:19:14 STEP 2624 H=2624:00 +CPU= 22.794
  10:19:50 STEP 2625 H=2625:00 +CPU= 35.733
  10:20:13 STEP 2626 H=2626:00 +CPU= 22.665
  10:20:35 STEP 2627 H=2627:00 +CPU= 22.125
  10:21:15 STEP 2628 H=2628:00 +CPU= 39.901
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMGGhq0f+002628
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMSHhq0f+002628
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMUAhq0f+002628
  10:21:37 STEP 2629 H=2629:00 +CPU= 22.189
  10:22:00 STEP 2630 H=2630:00 +CPU= 22.822
  10:22:36 STEP 2631 H=2631:00 +CPU= 35.838
  10:22:58 STEP 2632 H=2632:00 +CPU= 22.811
  10:23:21 STEP 2633 H=2633:00 +CPU= 22.085
  10:23:57 STEP 2634 H=2634:00 +CPU= 36.607
  10:24:19 STEP 2635 H=2635:00 +CPU= 21.900
  10:24:42 STEP 2636 H=2636:00 +CPU= 22.739
  10:25:17 STEP 2637 H=2637:00 +CPU= 35.664
  10:25:40 STEP 2638 H=2638:00 +CPU= 22.572
  10:26:03 STEP 2639 H=2639:00 +CPU= 22.652
  10:26:44 STEP 2640 H=2640:00 +CPU= 41.667
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMGGhq0f+002640
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMSHhq0f+002640
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMUAhq0f+002640
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMGGhq0f+002616
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMSHhq0f+002616
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMUAhq0f+002616
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMGGhq0f+002628
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMSHhq0f+002628
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMUAhq0f+002628
Zipping up the intermediate file: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_0255_1982050100_123_951_12167899_0_r124317380_109.zip
Uploading the intermediate file: upload_file_109.zip
  10:27:06 STEP 2641 H=2641:00 +CPU= 21.878
Uploading trickle at timestep: 9504000
  10:27:29 STEP 2642 H=2642:00 +CPU= 22.712
  10:28:05 STEP 2643 H=2643:00 +CPU= 35.763
  10:28:27 STEP 2644 H=2644:00 +CPU= 22.573
  10:28:49 STEP 2645 H=2645:00 +CPU= 22.070
  10:29:26 STEP 2646 H=2646:00 +CPU= 36.589
  10:29:48 STEP 2647 H=2647:00 +CPU= 22.168
  10:30:11 STEP 2648 H=2648:00 +CPU= 23.149
  10:30:48 STEP 2649 H=2649:00 +CPU= 36.569
  10:31:11 STEP 2650 H=2650:00 +CPU= 23.335
  10:31:33 STEP 2651 H=2651:00 +CPU= 22.077
  10:32:13 STEP 2652 H=2652:00 +CPU= 39.748
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMGGhq0f+002652
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMSHhq0f+002652
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMUAhq0f+002652
  10:32:35 STEP 2653 H=2653:00 +CPU= 21.953
  10:32:59 STEP 2654 H=2654:00 +CPU= 23.532
  10:33:34 STEP 2655 H=2655:00 +CPU= 35.794
  10:33:57 STEP 2656 H=2656:00 +CPU= 22.621
  10:34:19 STEP 2657 H=2657:00 +CPU= 22.260
  10:34:56 STEP 2658 H=2658:00 +CPU= 36.400
  10:35:18 STEP 2659 H=2659:00 +CPU= 21.974
  10:35:40 STEP 2660 H=2660:00 +CPU= 22.677
  10:36:16 STEP 2661 H=2661:00 +CPU= 35.739
  10:36:39 STEP 2662 H=2662:00 +CPU= 22.671
  10:37:01 STEP 2663 H=2663:00 +CPU= 22.553
  10:37:43 STEP 2664 H=2664:00 +CPU= 41.606
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMGGhq0f+002664
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMSHhq0f+002664
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMUAhq0f+002664
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMGGhq0f+002640
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMSHhq0f+002640
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMUAhq0f+002640
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMGGhq0f+002652
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMSHhq0f+002652
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMUAhq0f+002652
Zipping up the intermediate file: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_0255_1982050100_123_951_12167899_0_r124317380_110.zip
Uploading the intermediate file: upload_file_110.zip
  10:38:05 STEP 2665 H=2665:00 +CPU= 21.816
  10:38:27 STEP 2666 H=2666:00 +CPU= 22.658
  10:39:03 STEP 2667 H=2667:00 +CPU= 35.590
  10:39:25 STEP 2668 H=2668:00 +CPU= 22.568
  10:39:48 STEP 2669 H=2669:00 +CPU= 22.024
  10:40:24 STEP 2670 H=2670:00 +CPU= 36.441
  10:40:46 STEP 2671 H=2671:00 +CPU= 22.330
  10:41:09 STEP 2672 H=2672:00 +CPU= 22.962
  10:41:46 STEP 2673 H=2673:00 +CPU= 36.830
  10:42:09 STEP 2674 H=2674:00 +CPU= 22.750
  10:42:31 STEP 2675 H=2675:00 +CPU= 22.033
  10:43:10 STEP 2676 H=2676:00 +CPU= 39.430
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMGGhq0f+002676
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMSHhq0f+002676
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMUAhq0f+002676
  10:43:33 STEP 2677 H=2677:00 +CPU= 22.427
  10:43:55 STEP 2678 H=2678:00 +CPU= 22.657
  10:44:31 STEP 2679 H=2679:00 +CPU= 35.825
  10:44:54 STEP 2680 H=2680:00 +CPU= 22.739
  10:45:16 STEP 2681 H=2681:00 +CPU= 22.094
  10:45:53 STEP 2682 H=2682:00 +CPU= 36.937
  10:46:15 STEP 2683 H=2683:00 +CPU= 22.108
  10:46:38 STEP 2684 H=2684:00 +CPU= 22.609
  10:47:14 STEP 2685 H=2685:00 +CPU= 35.942
  10:47:36 STEP 2686 H=2686:00 +CPU= 22.715
  10:47:59 STEP 2687 H=2687:00 +CPU= 22.476
  10:48:43 STEP 2688 H=2688:00 +CPU= 44.507
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMGGhq0f+002688
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMSHhq0f+002688
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMUAhq0f+002688
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMGGhq0f+002664
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMSHhq0f+002664
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMUAhq0f+002664
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMGGhq0f+002676
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMSHhq0f+002676
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMUAhq0f+002676
Zipping up the intermediate file: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_0255_1982050100_123_951_12167899_0_r124317380_111.zip
Uploading the intermediate file: upload_file_111.zip
  10:49:06 STEP 2689 H=2689:00 +CPU= 22.870
  10:49:29 STEP 2690 H=2690:00 +CPU= 22.746
  10:50:05 STEP 2691 H=2691:00 +CPU= 35.977
  10:50:28 STEP 2692 H=2692:00 +CPU= 22.769
  10:50:50 STEP 2693 H=2693:00 +CPU= 21.923
  10:51:26 STEP 2694 H=2694:00 +CPU= 36.602
  10:51:49 STEP 2695 H=2695:00 +CPU= 22.490
  10:52:11 STEP 2696 H=2696:00 +CPU= 22.604
  10:52:47 STEP 2697 H=2697:00 +CPU= 36.034
  10:53:10 STEP 2698 H=2698:00 +CPU= 22.696
  10:53:32 STEP 2699 H=2699:00 +CPU= 21.899
  10:54:12 STEP 2700 H=2700:00 +CPU= 39.698
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMGGhq0f+002700
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMSHhq0f+002700
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMUAhq0f+002700
  10:54:34 STEP 2701 H=2701:00 +CPU= 22.055
  10:54:57 STEP 2702 H=2702:00 +CPU= 22.864
  10:55:33 STEP 2703 H=2703:00 +CPU= 35.946
  10:55:55 STEP 2704 H=2704:00 +CPU= 22.799
  10:56:17 STEP 2705 H=2705:00 +CPU= 21.904
  10:56:54 STEP 2706 H=2706:00 +CPU= 36.920
  10:57:16 STEP 2707 H=2707:00 +CPU= 22.041
  10:57:39 STEP 2708 H=2708:00 +CPU= 22.589
  10:58:15 STEP 2709 H=2709:00 +CPU= 35.755
  10:58:37 STEP 2710 H=2710:00 +CPU= 22.647
  10:59:00 STEP 2711 H=2711:00 +CPU= 22.560
  10:59:43 STEP 2712 H=2712:00 +CPU= 43.056
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMGGhq0f+002712
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMSHhq0f+002712
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMUAhq0f+002712
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMGGhq0f+002688
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMSHhq0f+002688
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMUAhq0f+002688
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMGGhq0f+002700
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMSHhq0f+002700
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMUAhq0f+002700
Zipping up the intermediate file: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_0255_1982050100_123_951_12167899_0_r124317380_112.zip
Uploading the intermediate file: upload_file_112.zip
  11:00:05 STEP 2713 H=2713:00 +CPU= 22.341
  11:00:28 STEP 2714 H=2714:00 +CPU= 22.775
  11:01:04 STEP 2715 H=2715:00 +CPU= 36.072
  11:01:27 STEP 2716 H=2716:00 +CPU= 22.737
  11:01:49 STEP 2717 H=2717:00 +CPU= 21.916
  11:02:25 STEP 2718 H=2718:00 +CPU= 36.761
  11:02:48 STEP 2719 H=2719:00 +CPU= 22.318
  11:03:10 STEP 2720 H=2720:00 +CPU= 22.680
  11:03:47 STEP 2721 H=2721:00 +CPU= 36.051
  11:04:09 STEP 2722 H=2722:00 +CPU= 22.751
  11:04:31 STEP 2723 H=2723:00 +CPU= 21.965
  11:05:11 STEP 2724 H=2724:00 +CPU= 39.613
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMGGhq0f+002724
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMSHhq0f+002724
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMUAhq0f+002724
  11:05:33 STEP 2725 H=2725:00 +CPU= 22.047
  11:05:56 STEP 2726 H=2726:00 +CPU= 22.644
  11:06:32 STEP 2727 H=2727:00 +CPU= 36.039
  11:06:54 STEP 2728 H=2728:00 +CPU= 22.843
  11:07:16 STEP 2729 H=2729:00 +CPU= 22.028
  11:07:53 STEP 2730 H=2730:00 +CPU= 36.624
  11:08:15 STEP 2731 H=2731:00 +CPU= 22.150
  11:08:38 STEP 2732 H=2732:00 +CPU= 22.622
  11:09:14 STEP 2733 H=2733:00 +CPU= 35.662
  11:09:36 STEP 2734 H=2734:00 +CPU= 22.667
  11:09:59 STEP 2735 H=2735:00 +CPU= 22.536
  11:10:43 STEP 2736 H=2736:00 +CPU= 44.369
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMGGhq0f+002736
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMSHhq0f+002736
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMUAhq0f+002736
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMGGhq0f+002712
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMSHhq0f+002712
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMUAhq0f+002712
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMGGhq0f+002724
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMSHhq0f+002724
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMUAhq0f+002724
Zipping up the intermediate file: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_0255_1982050100_123_951_12167899_0_r124317380_113.zip
Uploading the intermediate file: upload_file_113.zip
  11:11:07 STEP 2737 H=2737:00 +CPU= 24.335
  11:11:31 STEP 2738 H=2738:00 +CPU= 23.870
  11:12:08 STEP 2739 H=2739:00 +CPU= 37.173
  11:12:32 STEP 2740 H=2740:00 +CPU= 23.366
  11:12:55 STEP 2741 H=2741:00 +CPU= 22.778
  11:13:33 STEP 2742 H=2742:00 +CPU= 38.006
  11:13:56 STEP 2743 H=2743:00 +CPU= 22.963
  11:14:19 STEP 2744 H=2744:00 +CPU= 23.325
  11:14:56 STEP 2745 H=2745:00 +CPU= 37.042
  11:15:20 STEP 2746 H=2746:00 +CPU= 23.834
  11:15:42 STEP 2747 H=2747:00 +CPU= 22.646
  11:16:24 STEP 2748 H=2748:00 +CPU= 41.160
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMGGhq0f+002748
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMSHhq0f+002748
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMUAhq0f+002748
  11:16:47 STEP 2749 H=2749:00 +CPU= 23.129
  11:17:11 STEP 2750 H=2750:00 +CPU= 23.843
  11:17:48 STEP 2751 H=2751:00 +CPU= 37.662
  11:18:12 STEP 2752 H=2752:00 +CPU= 24.069
  11:18:35 STEP 2753 H=2753:00 +CPU= 23.085
  11:19:14 STEP 2754 H=2754:00 +CPU= 38.292
  11:19:37 STEP 2755 H=2755:00 +CPU= 23.013
  11:20:01 STEP 2756 H=2756:00 +CPU= 23.980
  11:20:38 STEP 2757 H=2757:00 +CPU= 37.323
  11:21:02 STEP 2758 H=2758:00 +CPU= 23.547
  11:21:25 STEP 2759 H=2759:00 +CPU= 23.679
  11:22:10 STEP 2760 H=2760:00 +CPU= 44.581
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMGGhq0f+002760
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMSHhq0f+002760
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMUAhq0f+002760
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMGGhq0f+002736
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMSHhq0f+002736
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMUAhq0f+002736
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMGGhq0f+002748
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMSHhq0f+002748
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMUAhq0f+002748
Zipping up the intermediate file: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_0255_1982050100_123_951_12167899_0_r124317380_114.zip
Uploading the intermediate file: upload_file_114.zip
  11:22:33 STEP 2761 H=2761:00 +CPU= 22.956
  11:22:56 STEP 2762 H=2762:00 +CPU= 23.464
  11:23:33 STEP 2763 H=2763:00 +CPU= 37.175
  11:23:57 STEP 2764 H=2764:00 +CPU= 23.670
  11:24:20 STEP 2765 H=2765:00 +CPU= 23.342
  11:25:00 STEP 2766 H=2766:00 +CPU= 39.174
  11:25:23 STEP 2767 H=2767:00 +CPU= 23.333
  11:25:47 STEP 2768 H=2768:00 +CPU= 24.146
  11:26:26 STEP 2769 H=2769:00 +CPU= 38.935
  11:26:50 STEP 2770 H=2770:00 +CPU= 24.350
  11:27:14 STEP 2771 H=2771:00 +CPU= 23.642
  11:27:56 STEP 2772 H=2772:00 +CPU= 42.156
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMGGhq0f+002772
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMSHhq0f+002772
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMUAhq0f+002772
  11:28:20 STEP 2773 H=2773:00 +CPU= 23.547
  11:28:44 STEP 2774 H=2774:00 +CPU= 24.081
  11:29:22 STEP 2775 H=2775:00 +CPU= 38.501
  11:29:46 STEP 2776 H=2776:00 +CPU= 23.770
  11:30:10 STEP 2777 H=2777:00 +CPU= 23.811
  11:30:49 STEP 2778 H=2778:00 +CPU= 38.764
  11:31:12 STEP 2779 H=2779:00 +CPU= 23.440
  11:31:36 STEP 2780 H=2780:00 +CPU= 23.836
  11:32:12 STEP 2781 H=2781:00 +CPU= 36.384
  11:32:35 STEP 2782 H=2782:00 +CPU= 22.977
  11:32:58 STEP 2783 H=2783:00 +CPU= 23.050
  11:33:41 STEP 2784 H=2784:00 +CPU= 42.339
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMGGhq0f+002784
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMSHhq0f+002784
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMUAhq0f+002784
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMGGhq0f+002760
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMSHhq0f+002760
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMUAhq0f+002760
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMGGhq0f+002772
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMSHhq0f+002772
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMUAhq0f+002772
Zipping up the intermediate file: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_0255_1982050100_123_951_12167899_0_r124317380_115.zip
Uploading the intermediate file: upload_file_115.zip
  11:34:04 STEP 2785 H=2785:00 +CPU= 23.639
  11:34:27 STEP 2786 H=2786:00 +CPU= 23.027
  11:35:04 STEP 2787 H=2787:00 +CPU= 36.891
  11:35:28 STEP 2788 H=2788:00 +CPU= 23.368
  11:35:50 STEP 2789 H=2789:00 +CPU= 22.551
  11:36:28 STEP 2790 H=2790:00 +CPU= 37.799
  11:36:51 STEP 2791 H=2791:00 +CPU= 22.729
  11:37:14 STEP 2792 H=2792:00 +CPU= 23.296
  11:37:51 STEP 2793 H=2793:00 +CPU= 36.558
  11:38:14 STEP 2794 H=2794:00 +CPU= 23.547
  11:38:37 STEP 2795 H=2795:00 +CPU= 22.518
  11:39:17 STEP 2796 H=2796:00 +CPU= 40.783
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMGGhq0f+002796
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMSHhq0f+002796
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMUAhq0f+002796
  11:39:40 STEP 2797 H=2797:00 +CPU= 22.789
  11:40:03 STEP 2798 H=2798:00 +CPU= 23.184
  11:40:41 STEP 2799 H=2799:00 +CPU= 37.181
  11:41:04 STEP 2800 H=2800:00 +CPU= 23.158
  11:41:26 STEP 2801 H=2801:00 +CPU= 22.387
  11:42:04 STEP 2802 H=2802:00 +CPU= 37.359
  11:42:26 STEP 2803 H=2803:00 +CPU= 22.525
  11:42:49 STEP 2804 H=2804:00 +CPU= 23.422
  11:43:26 STEP 2805 H=2805:00 +CPU= 36.599
  11:43:49 STEP 2806 H=2806:00 +CPU= 23.147
  11:44:12 STEP 2807 H=2807:00 +CPU= 23.120
  11:44:55 STEP 2808 H=2808:00 +CPU= 42.659
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMGGhq0f+002808
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMSHhq0f+002808
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMUAhq0f+002808
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMGGhq0f+002784
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMSHhq0f+002784
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMUAhq0f+002784
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMGGhq0f+002796
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMSHhq0f+002796
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMUAhq0f+002796
Zipping up the intermediate file: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_0255_1982050100_123_951_12167899_0_r124317380_116.zip
Uploading the intermediate file: upload_file_116.zip
  11:45:18 STEP 2809 H=2809:00 +CPU= 22.790
  11:45:41 STEP 2810 H=2810:00 +CPU= 23.057
  11:46:17 STEP 2811 H=2811:00 +CPU= 36.577
  11:46:41 STEP 2812 H=2812:00 +CPU= 23.275
  11:47:03 STEP 2813 H=2813:00 +CPU= 22.492
  11:47:41 STEP 2814 H=2814:00 +CPU= 37.800
  11:48:04 STEP 2815 H=2815:00 +CPU= 22.666
  11:48:27 STEP 2816 H=2816:00 +CPU= 23.179
  11:49:03 STEP 2817 H=2817:00 +CPU= 36.548
  11:49:28 STEP 2818 H=2818:00 +CPU= 24.339
  11:49:51 STEP 2819 H=2819:00 +CPU= 23.223
  11:50:31 STEP 2820 H=2820:00 +CPU= 40.264
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMGGhq0f+002820
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMSHhq0f+002820
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMUAhq0f+002820
  11:50:54 STEP 2821 H=2821:00 +CPU= 22.455
  11:51:17 STEP 2822 H=2822:00 +CPU= 23.027
  11:51:54 STEP 2823 H=2823:00 +CPU= 37.008
  11:52:17 STEP 2824 H=2824:00 +CPU= 23.044
  11:52:39 STEP 2825 H=2825:00 +CPU= 22.461
  11:53:17 STEP 2826 H=2826:00 +CPU= 37.319
  11:53:39 STEP 2827 H=2827:00 +CPU= 22.467
  11:54:02 STEP 2828 H=2828:00 +CPU= 23.419
  11:54:39 STEP 2829 H=2829:00 +CPU= 37.035
  11:55:03 STEP 2830 H=2830:00 +CPU= 23.211
  11:55:26 STEP 2831 H=2831:00 +CPU= 22.950
  11:56:08 STEP 2832 H=2832:00 +CPU= 42.689
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMGGhq0f+002832
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMSHhq0f+002832
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMUAhq0f+002832
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMGGhq0f+002808
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMSHhq0f+002808
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMUAhq0f+002808
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMGGhq0f+002820
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMSHhq0f+002820
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMUAhq0f+002820
Zipping up the intermediate file: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_0255_1982050100_123_951_12167899_0_r124317380_117.zip
Uploading the intermediate file: upload_file_117.zip
  11:56:31 STEP 2833 H=2833:00 +CPU= 22.439
  11:56:54 STEP 2834 H=2834:00 +CPU= 22.934
  11:57:30 STEP 2835 H=2835:00 +CPU= 36.306
  11:57:53 STEP 2836 H=2836:00 +CPU= 23.204
  11:58:16 STEP 2837 H=2837:00 +CPU= 22.524
  11:58:53 STEP 2838 H=2838:00 +CPU= 37.365
  11:59:16 STEP 2839 H=2839:00 +CPU= 23.110
  11:59:40 STEP 2840 H=2840:00 +CPU= 23.843
  12:00:17 STEP 2841 H=2841:00 +CPU= 36.886
  12:00:41 STEP 2842 H=2842:00 +CPU= 23.598
  12:01:03 STEP 2843 H=2843:00 +CPU= 22.812
  12:01:44 STEP 2844 H=2844:00 +CPU= 40.154
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMGGhq0f+002844
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMSHhq0f+002844
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMUAhq0f+002844
  12:02:06 STEP 2845 H=2845:00 +CPU= 22.493
  12:02:29 STEP 2846 H=2846:00 +CPU= 23.010
  12:03:06 STEP 2847 H=2847:00 +CPU= 36.810
  12:03:29 STEP 2848 H=2848:00 +CPU= 23.314
  12:03:52 STEP 2849 H=2849:00 +CPU= 22.356
  12:04:29 STEP 2850 H=2850:00 +CPU= 37.245
  12:04:51 STEP 2851 H=2851:00 +CPU= 22.391
  12:05:15 STEP 2852 H=2852:00 +CPU= 23.394
  12:05:51 STEP 2853 H=2853:00 +CPU= 36.507
  12:06:14 STEP 2854 H=2854:00 +CPU= 23.130
  12:06:37 STEP 2855 H=2855:00 +CPU= 23.011
  12:07:20 STEP 2856 H=2856:00 +CPU= 42.330
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMGGhq0f+002856
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMSHhq0f+002856
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMUAhq0f+002856
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMGGhq0f+002832
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMSHhq0f+002832
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMUAhq0f+002832
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMGGhq0f+002844
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMSHhq0f+002844
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMUAhq0f+002844
Zipping up the intermediate file: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_0255_1982050100_123_951_12167899_0_r124317380_118.zip
Uploading the intermediate file: upload_file_118.zip
  12:07:42 STEP 2857 H=2857:00 +CPU= 22.473
  12:08:05 STEP 2858 H=2858:00 +CPU= 23.027
  12:08:41 STEP 2859 H=2859:00 +CPU= 36.377
  12:09:05 STEP 2860 H=2860:00 +CPU= 23.181
  12:09:27 STEP 2861 H=2861:00 +CPU= 22.872
  12:10:05 STEP 2862 H=2862:00 +CPU= 37.147
  12:10:27 STEP 2863 H=2863:00 +CPU= 22.511
  12:10:51 STEP 2864 H=2864:00 +CPU= 23.431
  12:11:27 STEP 2865 H=2865:00 +CPU= 36.317
  12:11:50 STEP 2866 H=2866:00 +CPU= 23.105
  12:12:12 STEP 2867 H=2867:00 +CPU= 22.363
  12:12:53 STEP 2868 H=2868:00 +CPU= 40.425
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMGGhq0f+002868
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMSHhq0f+002868
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMUAhq0f+002868
  12:13:15 STEP 2869 H=2869:00 +CPU= 22.578
  12:13:38 STEP 2870 H=2870:00 +CPU= 23.090
  12:14:15 STEP 2871 H=2871:00 +CPU= 36.738
  12:14:39 STEP 2872 H=2872:00 +CPU= 23.635
  12:15:01 STEP 2873 H=2873:00 +CPU= 22.513
  12:15:39 STEP 2874 H=2874:00 +CPU= 37.688
  12:16:02 STEP 2875 H=2875:00 +CPU= 22.653
  12:16:25 STEP 2876 H=2876:00 +CPU= 23.444
  12:17:02 STEP 2877 H=2877:00 +CPU= 36.939
  12:17:25 STEP 2878 H=2878:00 +CPU= 23.359
  12:17:49 STEP 2879 H=2879:00 +CPU= 23.146
  12:18:31 STEP 2880 H=2880:00 +CPU= 42.479
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMGGhq0f+002880
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMSHhq0f+002880
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMUAhq0f+002880
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMGGhq0f+002856
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMSHhq0f+002856
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMUAhq0f+002856
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMGGhq0f+002868
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMSHhq0f+002868
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMUAhq0f+002868
Zipping up the intermediate file: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_0255_1982050100_123_951_12167899_0_r124317380_119.zip
Uploading the intermediate file: upload_file_119.zip
Uploading trickle at timestep: 10368000
  12:18:54 STEP 2881 H=2881:00 +CPU= 22.553
  12:19:17 STEP 2882 H=2882:00 +CPU= 23.037
  12:19:53 STEP 2883 H=2883:00 +CPU= 36.388
  12:20:16 STEP 2884 H=2884:00 +CPU= 23.258
  12:20:39 STEP 2885 H=2885:00 +CPU= 22.481
  12:21:16 STEP 2886 H=2886:00 +CPU= 37.267
  12:21:39 STEP 2887 H=2887:00 +CPU= 22.591
  12:22:02 STEP 2888 H=2888:00 +CPU= 23.127
  12:22:39 STEP 2889 H=2889:00 +CPU= 36.900
  12:23:02 STEP 2890 H=2890:00 +CPU= 23.313
  12:23:25 STEP 2891 H=2891:00 +CPU= 22.509
  12:24:05 STEP 2892 H=2892:00 +CPU= 40.698
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMGGhq0f+002892
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMSHhq0f+002892
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMUAhq0f+002892
  12:24:28 STEP 2893 H=2893:00 +CPU= 22.666
  12:24:51 STEP 2894 H=2894:00 +CPU= 23.074
  12:25:28 STEP 2895 H=2895:00 +CPU= 37.349
  12:25:52 STEP 2896 H=2896:00 +CPU= 23.582
  12:26:15 STEP 2897 H=2897:00 +CPU= 23.333
  12:26:53 STEP 2898 H=2898:00 +CPU= 38.028
  12:27:16 STEP 2899 H=2899:00 +CPU= 22.966
  12:27:40 STEP 2900 H=2900:00 +CPU= 23.669
  12:28:17 STEP 2901 H=2901:00 +CPU= 36.636
  12:28:40 STEP 2902 H=2902:00 +CPU= 23.457
  12:29:03 STEP 2903 H=2903:00 +CPU= 23.215
  12:29:47 STEP 2904 H=2904:00 +CPU= 43.456
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMGGhq0f+002904
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMSHhq0f+002904
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMUAhq0f+002904
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMGGhq0f+002880
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMSHhq0f+002880
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMUAhq0f+002880
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMGGhq0f+002892
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMSHhq0f+002892
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMUAhq0f+002892
Zipping up the intermediate file: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_0255_1982050100_123_951_12167899_0_r124317380_120.zip
Uploading the intermediate file: upload_file_120.zip
  12:30:10 STEP 2905 H=2905:00 +CPU= 23.415
  12:30:34 STEP 2906 H=2906:00 +CPU= 23.908
  12:31:12 STEP 2907 H=2907:00 +CPU= 38.106
  12:31:36 STEP 2908 H=2908:00 +CPU= 24.271
  12:32:00 STEP 2909 H=2909:00 +CPU= 23.363
  12:32:39 STEP 2910 H=2910:00 +CPU= 38.691
  12:33:02 STEP 2911 H=2911:00 +CPU= 23.516
  12:33:26 STEP 2912 H=2912:00 +CPU= 24.440
  12:34:05 STEP 2913 H=2913:00 +CPU= 38.166
  12:34:29 STEP 2914 H=2914:00 +CPU= 24.246
  12:34:53 STEP 2915 H=2915:00 +CPU= 23.792
  12:35:36 STEP 2916 H=2916:00 +CPU= 43.741
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMGGhq0f+002916
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMSHhq0f+002916
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMUAhq0f+002916
  12:36:00 STEP 2917 H=2917:00 +CPU= 23.158
  12:36:24 STEP 2918 H=2918:00 +CPU= 24.373
  12:37:02 STEP 2919 H=2919:00 +CPU= 38.269
  12:37:27 STEP 2920 H=2920:00 +CPU= 24.466
  12:37:50 STEP 2921 H=2921:00 +CPU= 23.237
  12:38:27 STEP 2922 H=2922:00 +CPU= 37.389
  12:38:50 STEP 2923 H=2923:00 +CPU= 22.480
  12:39:13 STEP 2924 H=2924:00 +CPU= 23.435
  12:39:50 STEP 2925 H=2925:00 +CPU= 36.555
  12:40:13 STEP 2926 H=2926:00 +CPU= 23.099
  12:40:36 STEP 2927 H=2927:00 +CPU= 23.063
  12:41:19 STEP 2928 H=2928:00 +CPU= 42.855
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMGGhq0f+002928
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMSHhq0f+002928
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMUAhq0f+002928
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMGGhq0f+002904
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMSHhq0f+002904
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMUAhq0f+002904
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMGGhq0f+002916
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMSHhq0f+002916
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMUAhq0f+002916
Zipping up the intermediate file: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_0255_1982050100_123_951_12167899_0_r124317380_121.zip
Uploading the intermediate file: upload_file_121.zip
  12:41:42 STEP 2929 H=2929:00 +CPU= 22.884
  12:42:05 STEP 2930 H=2930:00 +CPU= 23.578
  12:42:42 STEP 2931 H=2931:00 +CPU= 36.649
  12:43:05 STEP 2932 H=2932:00 +CPU= 23.158
  12:43:28 STEP 2933 H=2933:00 +CPU= 22.486
  12:44:05 STEP 2934 H=2934:00 +CPU= 37.410
  12:44:27 STEP 2935 H=2935:00 +CPU= 22.447
  12:44:52 STEP 2936 H=2936:00 +CPU= 24.421
  12:45:29 STEP 2937 H=2937:00 +CPU= 36.837
  12:45:52 STEP 2938 H=2938:00 +CPU= 23.216
  12:46:15 STEP 2939 H=2939:00 +CPU= 22.605
  12:46:56 STEP 2940 H=2940:00 +CPU= 41.149
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMGGhq0f+002940
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMSHhq0f+002940
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMUAhq0f+002940
  12:47:18 STEP 2941 H=2941:00 +CPU= 22.579
  12:47:42 STEP 2942 H=2942:00 +CPU= 23.597
  12:48:19 STEP 2943 H=2943:00 +CPU= 36.688
  12:48:42 STEP 2944 H=2944:00 +CPU= 23.194
  12:49:05 STEP 2945 H=2945:00 +CPU= 22.816
  12:49:42 STEP 2946 H=2946:00 +CPU= 37.462
  12:50:05 STEP 2947 H=2947:00 +CPU= 22.491
  12:50:28 STEP 2948 H=2948:00 +CPU= 23.571
  12:51:05 STEP 2949 H=2949:00 +CPU= 36.711
  12:51:28 STEP 2950 H=2950:00 +CPU= 23.181
  12:51:51 STEP 2951 H=2951:00 +CPU= 23.212
  12:52:33 STEP 2952 H=2952:00 +CPU= 41.490
The child process terminated with status: 0
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMGGhq0f+002952
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMSHhq0f+002952
Moving to projects directory: /mnt/boinc/data0/slots/4/ICMUAhq0f+002952
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMUAhq0f+002940
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMSHhq0f+002940
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMGGhq0f+002940
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMSHhq0f+002952
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMGGhq0f+002952
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMUAhq0f+002928
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMUAhq0f+002952
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMGGhq0f+002928
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12167899/ICMSHhq0f+002928
Zipping up the final file: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_0255_1982050100_123_951_12167899_0_r124317380_122.zip
Uploading the final file: upload_file_122.zip
Uploading trickle at timestep: 10623600
12:55:57 (13475): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:17:06 1462795 22252128 oifs_43r3_ps_0255_1982050100_123_951_12167899_0 10,623,600 84,198 0.0079
09 May 2023 16:17:06 1462795 22252128 oifs_43r3_ps_0255_1982050100_123_951_12167899_0 10,368,000 82,156 0.0079
09 May 2023 16:17:06 1462795 22252128 oifs_43r3_ps_0255_1982050100_123_951_12167899_0 10,368,000 82,156 0.0079
09 May 2023 16:16:59 1462795 22252128 oifs_43r3_ps_0255_1982050100_123_951_12167899_0 9,504,000 75,459 0.0079
09 May 2023 16:16:52 1462795 22252128 oifs_43r3_ps_0255_1982050100_123_951_12167899_0 8,640,000 68,822 0.0080
09 May 2023 16:16:46 1462795 22252128 oifs_43r3_ps_0255_1982050100_123_951_12167899_0 7,776,000 61,943 0.0080
09 May 2023 16:16:39 1462795 22252128 oifs_43r3_ps_0255_1982050100_123_951_12167899_0 6,912,000 54,876 0.0079
09 May 2023 16:16:32 1462795 22252128 oifs_43r3_ps_0255_1982050100_123_951_12167899_0 6,048,000 47,660 0.0079
09 May 2023 16:16:26 1462795 22252128 oifs_43r3_ps_0255_1982050100_123_951_12167899_0 5,184,000 40,704 0.0079
09 May 2023 16:16:20 1462795 22252128 oifs_43r3_ps_0255_1982050100_123_951_12167899_0 4,320,000 33,829 0.0078
09 May 2023 16:16:13 1462795 22252128 oifs_43r3_ps_0255_1982050100_123_951_12167899_0 3,456,000 27,014 0.0078
09 May 2023 16:16:10 1462795 22252128 oifs_43r3_ps_0255_1982050100_123_951_12167899_0 2,592,000 20,199 0.0078
09 May 2023 16:16:03 1462795 22252128 oifs_43r3_ps_0255_1982050100_123_951_12167899_0 1,728,000 13,495 0.0078
09 May 2023 16:15:57 1462795 22252128 oifs_43r3_ps_0255_1982050100_123_951_12167899_0 864,000 6,832 0.0079


©2024 cpdn.org