climateprediction.net home page
Task 22317055

Task 22317055

Name oifs_43r3_00hu_2019110100_123_993_12214080_1
Workunit 12214080
Created 25 Feb 2023, 14:17:50 UTC
Sent 25 Feb 2023, 14:18:00 UTC
Report deadline 26 Apr 2023, 14:18:00 UTC
Received 26 Feb 2023, 6:28:54 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1498009
Run time 11 hours 49 min 21 sec
CPU time 11 hours 44 min 57 sec
Validate state Valid
Credit 14,873.04
Device peak FLOPS 7.33 GFLOPS
Application version OpenIFS 43r3 v1.21
x86_64-pc-linux-gnu
Peak working set size 4,415.96 MB
Peak swap size 4,974.23 MB
Peak disk usage 1,268.56 MB
Stderr
<core_client_version>7.20.5</core_client_version>
<![CDATA[
<stderr_txt>
ip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMSHhnw4+002340
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMUAhnw4+002340
Zipping up the intermediate file: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_00hu_2019110100_123_993_12214080_1_r1002676986_97.zip
Uploading the intermediate file: upload_file_97.zip
  03:16:39 STEP 2353 H=2353:00 +CPU= 11.465
  03:16:50 STEP 2354 H=2354:00 +CPU= 11.607
  03:17:08 STEP 2355 H=2355:00 +CPU= 17.901
  03:17:20 STEP 2356 H=2356:00 +CPU= 11.823
  03:17:31 STEP 2357 H=2357:00 +CPU= 11.276
  03:17:49 STEP 2358 H=2358:00 +CPU= 18.190
  03:18:01 STEP 2359 H=2359:00 +CPU= 11.520
  03:18:13 STEP 2360 H=2360:00 +CPU= 11.615
  03:18:31 STEP 2361 H=2361:00 +CPU= 17.865
  03:18:42 STEP 2362 H=2362:00 +CPU= 11.821
  03:18:54 STEP 2363 H=2363:00 +CPU= 11.260
  03:19:13 STEP 2364 H=2364:00 +CPU= 19.433
Moving to projects directory: /hdd/boinc-client/slots/4/ICMGGhnw4+002364
Moving to projects directory: /hdd/boinc-client/slots/4/ICMSHhnw4+002364
Moving to projects directory: /hdd/boinc-client/slots/4/ICMUAhnw4+002364
  03:19:25 STEP 2365 H=2365:00 +CPU= 11.485
  03:19:36 STEP 2366 H=2366:00 +CPU= 11.600
  03:19:54 STEP 2367 H=2367:00 +CPU= 17.805
  03:20:06 STEP 2368 H=2368:00 +CPU= 11.818
  03:20:17 STEP 2369 H=2369:00 +CPU= 11.193
  03:20:35 STEP 2370 H=2370:00 +CPU= 18.226
  03:20:47 STEP 2371 H=2371:00 +CPU= 11.488
  03:20:58 STEP 2372 H=2372:00 +CPU= 11.532
  03:21:16 STEP 2373 H=2373:00 +CPU= 17.835
  03:21:28 STEP 2374 H=2374:00 +CPU= 11.804
  03:21:40 STEP 2375 H=2375:00 +CPU= 11.574
  03:22:01 STEP 2376 H=2376:00 +CPU= 20.823
Moving to projects directory: /hdd/boinc-client/slots/4/ICMGGhnw4+002376
Moving to projects directory: /hdd/boinc-client/slots/4/ICMSHhnw4+002376
Moving to projects directory: /hdd/boinc-client/slots/4/ICMUAhnw4+002376
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMGGhnw4+002352
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMSHhnw4+002352
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMUAhnw4+002352
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMGGhnw4+002364
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMSHhnw4+002364
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMUAhnw4+002364
Zipping up the intermediate file: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_00hu_2019110100_123_993_12214080_1_r1002676986_98.zip
Uploading the intermediate file: upload_file_98.zip
  03:22:12 STEP 2377 H=2377:00 +CPU= 11.527
  03:22:24 STEP 2378 H=2378:00 +CPU= 11.545
  03:22:42 STEP 2379 H=2379:00 +CPU= 17.901
  03:22:53 STEP 2380 H=2380:00 +CPU= 11.824
  03:23:05 STEP 2381 H=2381:00 +CPU= 11.160
  03:23:23 STEP 2382 H=2382:00 +CPU= 18.210
  03:23:34 STEP 2383 H=2383:00 +CPU= 11.518
  03:23:46 STEP 2384 H=2384:00 +CPU= 11.486
  03:24:04 STEP 2385 H=2385:00 +CPU= 17.807
  03:24:16 STEP 2386 H=2386:00 +CPU= 11.823
  03:24:27 STEP 2387 H=2387:00 +CPU= 11.157
  03:24:46 STEP 2388 H=2388:00 +CPU= 19.464
Moving to projects directory: /hdd/boinc-client/slots/4/ICMGGhnw4+002388
Moving to projects directory: /hdd/boinc-client/slots/4/ICMSHhnw4+002388
Moving to projects directory: /hdd/boinc-client/slots/4/ICMUAhnw4+002388
  03:24:58 STEP 2389 H=2389:00 +CPU= 11.462
  03:25:09 STEP 2390 H=2390:00 +CPU= 11.684
  03:25:27 STEP 2391 H=2391:00 +CPU= 17.790
  03:25:39 STEP 2392 H=2392:00 +CPU= 11.954
  03:25:50 STEP 2393 H=2393:00 +CPU= 11.290
  03:26:09 STEP 2394 H=2394:00 +CPU= 18.184
  03:26:20 STEP 2395 H=2395:00 +CPU= 11.582
  03:26:32 STEP 2396 H=2396:00 +CPU= 11.629
  03:26:50 STEP 2397 H=2397:00 +CPU= 17.795
  03:27:02 STEP 2398 H=2398:00 +CPU= 11.812
  03:27:13 STEP 2399 H=2399:00 +CPU= 11.593
  03:27:34 STEP 2400 H=2400:00 +CPU= 20.855
Moving to projects directory: /hdd/boinc-client/slots/4/ICMGGhnw4+002400
Moving to projects directory: /hdd/boinc-client/slots/4/ICMSHhnw4+002400
Moving to projects directory: /hdd/boinc-client/slots/4/ICMUAhnw4+002400
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMGGhnw4+002376
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMSHhnw4+002376
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMUAhnw4+002376
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMGGhnw4+002388
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMSHhnw4+002388
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMUAhnw4+002388
Zipping up the intermediate file: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_00hu_2019110100_123_993_12214080_1_r1002676986_99.zip
Uploading the intermediate file: upload_file_99.zip
  03:27:46 STEP 2401 H=2401:00 +CPU= 11.461
  03:27:57 STEP 2402 H=2402:00 +CPU= 11.606
Uploading trickle at timestep: 8640000
  03:28:15 STEP 2403 H=2403:00 +CPU= 17.822
  03:28:27 STEP 2404 H=2404:00 +CPU= 11.879
  03:28:38 STEP 2405 H=2405:00 +CPU= 11.279
  03:28:57 STEP 2406 H=2406:00 +CPU= 18.234
  03:29:08 STEP 2407 H=2407:00 +CPU= 11.567
  03:29:20 STEP 2408 H=2408:00 +CPU= 11.604
  03:29:38 STEP 2409 H=2409:00 +CPU= 17.864
  03:29:50 STEP 2410 H=2410:00 +CPU= 11.897
  03:30:01 STEP 2411 H=2411:00 +CPU= 11.281
  03:30:20 STEP 2412 H=2412:00 +CPU= 19.487
Moving to projects directory: /hdd/boinc-client/slots/4/ICMGGhnw4+002412
Moving to projects directory: /hdd/boinc-client/slots/4/ICMSHhnw4+002412
Moving to projects directory: /hdd/boinc-client/slots/4/ICMUAhnw4+002412
  03:30:32 STEP 2413 H=2413:00 +CPU= 11.466
  03:30:43 STEP 2414 H=2414:00 +CPU= 11.584
  03:31:01 STEP 2415 H=2415:00 +CPU= 17.832
  03:31:13 STEP 2416 H=2416:00 +CPU= 11.870
  03:31:25 STEP 2417 H=2417:00 +CPU= 11.383
  03:31:43 STEP 2418 H=2418:00 +CPU= 18.365
  03:31:55 STEP 2419 H=2419:00 +CPU= 11.530
  03:32:06 STEP 2420 H=2420:00 +CPU= 11.752
  03:32:24 STEP 2421 H=2421:00 +CPU= 17.914
  03:32:36 STEP 2422 H=2422:00 +CPU= 11.881
  03:32:48 STEP 2423 H=2423:00 +CPU= 11.714
  03:33:09 STEP 2424 H=2424:00 +CPU= 20.858
Moving to projects directory: /hdd/boinc-client/slots/4/ICMGGhnw4+002424
Moving to projects directory: /hdd/boinc-client/slots/4/ICMSHhnw4+002424
Moving to projects directory: /hdd/boinc-client/slots/4/ICMUAhnw4+002424
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMGGhnw4+002400
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMSHhnw4+002400
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMUAhnw4+002400
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMGGhnw4+002412
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMSHhnw4+002412
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMUAhnw4+002412
Zipping up the intermediate file: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_00hu_2019110100_123_993_12214080_1_r1002676986_100.zip
Uploading the intermediate file: upload_file_100.zip
  03:33:20 STEP 2425 H=2425:00 +CPU= 11.487
  03:33:32 STEP 2426 H=2426:00 +CPU= 11.600
  03:33:50 STEP 2427 H=2427:00 +CPU= 18.048
  03:34:02 STEP 2428 H=2428:00 +CPU= 11.903
  03:34:13 STEP 2429 H=2429:00 +CPU= 11.294
  03:34:31 STEP 2430 H=2430:00 +CPU= 18.227
  03:34:43 STEP 2431 H=2431:00 +CPU= 11.561
  03:34:55 STEP 2432 H=2432:00 +CPU= 11.672
  03:35:13 STEP 2433 H=2433:00 +CPU= 17.848
  03:35:25 STEP 2434 H=2434:00 +CPU= 11.884
  03:35:36 STEP 2435 H=2435:00 +CPU= 11.331
  03:35:55 STEP 2436 H=2436:00 +CPU= 19.502
Moving to projects directory: /hdd/boinc-client/slots/4/ICMGGhnw4+002436
Moving to projects directory: /hdd/boinc-client/slots/4/ICMSHhnw4+002436
Moving to projects directory: /hdd/boinc-client/slots/4/ICMUAhnw4+002436
  03:36:07 STEP 2437 H=2437:00 +CPU= 11.475
  03:36:18 STEP 2438 H=2438:00 +CPU= 11.607
  03:36:36 STEP 2439 H=2439:00 +CPU= 17.885
  03:36:48 STEP 2440 H=2440:00 +CPU= 11.817
  03:37:00 STEP 2441 H=2441:00 +CPU= 11.452
  03:37:18 STEP 2442 H=2442:00 +CPU= 18.277
  03:37:30 STEP 2443 H=2443:00 +CPU= 11.578
  03:37:41 STEP 2444 H=2444:00 +CPU= 11.825
  03:37:59 STEP 2445 H=2445:00 +CPU= 17.880
  03:38:11 STEP 2446 H=2446:00 +CPU= 11.851
  03:38:23 STEP 2447 H=2447:00 +CPU= 11.748
  03:38:44 STEP 2448 H=2448:00 +CPU= 20.900
Moving to projects directory: /hdd/boinc-client/slots/4/ICMGGhnw4+002448
Moving to projects directory: /hdd/boinc-client/slots/4/ICMSHhnw4+002448
Moving to projects directory: /hdd/boinc-client/slots/4/ICMUAhnw4+002448
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMGGhnw4+002424
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMSHhnw4+002424
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMUAhnw4+002424
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMGGhnw4+002436
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMSHhnw4+002436
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMUAhnw4+002436
Zipping up the intermediate file: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_00hu_2019110100_123_993_12214080_1_r1002676986_101.zip
Uploading the intermediate file: upload_file_101.zip
  03:38:56 STEP 2449 H=2449:00 +CPU= 11.538
  03:39:07 STEP 2450 H=2450:00 +CPU= 11.584
  03:39:25 STEP 2451 H=2451:00 +CPU= 17.914
  03:39:37 STEP 2452 H=2452:00 +CPU= 11.843
  03:39:48 STEP 2453 H=2453:00 +CPU= 11.303
  03:40:06 STEP 2454 H=2454:00 +CPU= 18.167
  03:40:18 STEP 2455 H=2455:00 +CPU= 11.511
  03:40:30 STEP 2456 H=2456:00 +CPU= 11.716
  03:40:48 STEP 2457 H=2457:00 +CPU= 17.845
  03:41:00 STEP 2458 H=2458:00 +CPU= 11.870
  03:41:11 STEP 2459 H=2459:00 +CPU= 11.348
  03:41:30 STEP 2460 H=2460:00 +CPU= 19.527
Moving to projects directory: /hdd/boinc-client/slots/4/ICMGGhnw4+002460
Moving to projects directory: /hdd/boinc-client/slots/4/ICMSHhnw4+002460
Moving to projects directory: /hdd/boinc-client/slots/4/ICMUAhnw4+002460
  03:41:42 STEP 2461 H=2461:00 +CPU= 11.489
  03:41:54 STEP 2462 H=2462:00 +CPU= 11.595
  03:42:12 STEP 2463 H=2463:00 +CPU= 17.910
  03:42:23 STEP 2464 H=2464:00 +CPU= 11.794
  03:42:35 STEP 2465 H=2465:00 +CPU= 11.405
  03:42:53 STEP 2466 H=2466:00 +CPU= 18.176
  03:43:05 STEP 2467 H=2467:00 +CPU= 11.613
  03:43:16 STEP 2468 H=2468:00 +CPU= 11.666
  03:43:34 STEP 2469 H=2469:00 +CPU= 17.777
  03:43:46 STEP 2470 H=2470:00 +CPU= 11.795
  03:43:58 STEP 2471 H=2471:00 +CPU= 11.697
  03:44:19 STEP 2472 H=2472:00 +CPU= 20.907
Moving to projects directory: /hdd/boinc-client/slots/4/ICMGGhnw4+002472
Moving to projects directory: /hdd/boinc-client/slots/4/ICMSHhnw4+002472
Moving to projects directory: /hdd/boinc-client/slots/4/ICMUAhnw4+002472
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMGGhnw4+002448
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMSHhnw4+002448
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMUAhnw4+002448
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMGGhnw4+002460
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMSHhnw4+002460
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMUAhnw4+002460
Zipping up the intermediate file: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_00hu_2019110100_123_993_12214080_1_r1002676986_102.zip
Uploading the intermediate file: upload_file_102.zip
  03:44:30 STEP 2473 H=2473:00 +CPU= 11.434
  03:44:42 STEP 2474 H=2474:00 +CPU= 11.623
  03:45:00 STEP 2475 H=2475:00 +CPU= 18.001
  03:45:12 STEP 2476 H=2476:00 +CPU= 11.873
  03:45:23 STEP 2477 H=2477:00 +CPU= 11.402
  03:45:41 STEP 2478 H=2478:00 +CPU= 18.201
  03:45:53 STEP 2479 H=2479:00 +CPU= 11.624
  03:46:05 STEP 2480 H=2480:00 +CPU= 11.770
  03:46:22 STEP 2481 H=2481:00 +CPU= 17.834
  03:46:34 STEP 2482 H=2482:00 +CPU= 11.933
  03:46:46 STEP 2483 H=2483:00 +CPU= 11.404
  03:47:05 STEP 2484 H=2484:00 +CPU= 19.487
Moving to projects directory: /hdd/boinc-client/slots/4/ICMGGhnw4+002484
Moving to projects directory: /hdd/boinc-client/slots/4/ICMSHhnw4+002484
Moving to projects directory: /hdd/boinc-client/slots/4/ICMUAhnw4+002484
  03:47:17 STEP 2485 H=2485:00 +CPU= 11.508
  03:47:29 STEP 2486 H=2486:00 +CPU= 11.637
  03:47:46 STEP 2487 H=2487:00 +CPU= 17.905
  03:47:58 STEP 2488 H=2488:00 +CPU= 11.854
  03:48:10 STEP 2489 H=2489:00 +CPU= 11.391
  03:48:28 STEP 2490 H=2490:00 +CPU= 18.250
  03:48:40 STEP 2491 H=2491:00 +CPU= 11.572
  03:48:51 STEP 2492 H=2492:00 +CPU= 11.682
  03:49:09 STEP 2493 H=2493:00 +CPU= 17.822
  03:49:21 STEP 2494 H=2494:00 +CPU= 11.851
  03:49:33 STEP 2495 H=2495:00 +CPU= 11.723
  03:49:54 STEP 2496 H=2496:00 +CPU= 20.847
Moving to projects directory: /hdd/boinc-client/slots/4/ICMGGhnw4+002496
Moving to projects directory: /hdd/boinc-client/slots/4/ICMSHhnw4+002496
Moving to projects directory: /hdd/boinc-client/slots/4/ICMUAhnw4+002496
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMGGhnw4+002472
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMSHhnw4+002472
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMUAhnw4+002472
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMGGhnw4+002484
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMSHhnw4+002484
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMUAhnw4+002484
Zipping up the intermediate file: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_00hu_2019110100_123_993_12214080_1_r1002676986_103.zip
Uploading the intermediate file: upload_file_103.zip
  03:50:05 STEP 2497 H=2497:00 +CPU= 11.486
  03:50:17 STEP 2498 H=2498:00 +CPU= 11.657
  03:50:35 STEP 2499 H=2499:00 +CPU= 17.893
  03:50:47 STEP 2500 H=2500:00 +CPU= 11.864
  03:50:58 STEP 2501 H=2501:00 +CPU= 11.345
  03:51:16 STEP 2502 H=2502:00 +CPU= 18.203
  03:51:28 STEP 2503 H=2503:00 +CPU= 11.539
  03:51:40 STEP 2504 H=2504:00 +CPU= 11.726
  03:51:57 STEP 2505 H=2505:00 +CPU= 17.821
  03:52:09 STEP 2506 H=2506:00 +CPU= 11.871
  03:52:21 STEP 2507 H=2507:00 +CPU= 11.336
  03:52:40 STEP 2508 H=2508:00 +CPU= 19.512
Moving to projects directory: /hdd/boinc-client/slots/4/ICMGGhnw4+002508
Moving to projects directory: /hdd/boinc-client/slots/4/ICMSHhnw4+002508
Moving to projects directory: /hdd/boinc-client/slots/4/ICMUAhnw4+002508
  03:52:52 STEP 2509 H=2509:00 +CPU= 11.501
  03:53:03 STEP 2510 H=2510:00 +CPU= 11.605
  03:53:21 STEP 2511 H=2511:00 +CPU= 17.949
  03:53:33 STEP 2512 H=2512:00 +CPU= 11.873
  03:53:45 STEP 2513 H=2513:00 +CPU= 11.411
  03:54:03 STEP 2514 H=2514:00 +CPU= 18.253
  03:54:15 STEP 2515 H=2515:00 +CPU= 11.623
  03:54:26 STEP 2516 H=2516:00 +CPU= 11.697
  03:54:44 STEP 2517 H=2517:00 +CPU= 17.864
  03:54:56 STEP 2518 H=2518:00 +CPU= 11.916
  03:55:08 STEP 2519 H=2519:00 +CPU= 11.723
  03:55:29 STEP 2520 H=2520:00 +CPU= 20.879
Moving to projects directory: /hdd/boinc-client/slots/4/ICMGGhnw4+002520
Moving to projects directory: /hdd/boinc-client/slots/4/ICMSHhnw4+002520
Moving to projects directory: /hdd/boinc-client/slots/4/ICMUAhnw4+002520
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMGGhnw4+002496
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMSHhnw4+002496
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMUAhnw4+002496
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMGGhnw4+002508
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMSHhnw4+002508
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMUAhnw4+002508
Zipping up the intermediate file: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_00hu_2019110100_123_993_12214080_1_r1002676986_104.zip
Uploading the intermediate file: upload_file_104.zip
  03:55:40 STEP 2521 H=2521:00 +CPU= 11.524
  03:55:52 STEP 2522 H=2522:00 +CPU= 11.618
  03:56:10 STEP 2523 H=2523:00 +CPU= 17.906
  03:56:22 STEP 2524 H=2524:00 +CPU= 11.885
  03:56:33 STEP 2525 H=2525:00 +CPU= 11.357
  03:56:51 STEP 2526 H=2526:00 +CPU= 18.195
  03:57:03 STEP 2527 H=2527:00 +CPU= 11.522
  03:57:15 STEP 2528 H=2528:00 +CPU= 11.724
  03:57:32 STEP 2529 H=2529:00 +CPU= 17.852
  03:57:44 STEP 2530 H=2530:00 +CPU= 11.912
  03:57:56 STEP 2531 H=2531:00 +CPU= 11.358
  03:58:15 STEP 2532 H=2532:00 +CPU= 19.537
Moving to projects directory: /hdd/boinc-client/slots/4/ICMGGhnw4+002532
Moving to projects directory: /hdd/boinc-client/slots/4/ICMSHhnw4+002532
Moving to projects directory: /hdd/boinc-client/slots/4/ICMUAhnw4+002532
  03:58:27 STEP 2533 H=2533:00 +CPU= 11.530
  03:58:39 STEP 2534 H=2534:00 +CPU= 11.609
  03:58:56 STEP 2535 H=2535:00 +CPU= 17.272
  03:59:07 STEP 2536 H=2536:00 +CPU= 11.065
  03:59:18 STEP 2537 H=2537:00 +CPU= 10.679
  03:59:35 STEP 2538 H=2538:00 +CPU= 17.105
  03:59:46 STEP 2539 H=2539:00 +CPU= 10.797
  03:59:57 STEP 2540 H=2540:00 +CPU= 11.031
  04:00:13 STEP 2541 H=2541:00 +CPU= 16.824
  04:00:25 STEP 2542 H=2542:00 +CPU= 11.114
  04:00:36 STEP 2543 H=2543:00 +CPU= 11.030
  04:00:55 STEP 2544 H=2544:00 +CPU= 19.632
Moving to projects directory: /hdd/boinc-client/slots/4/ICMGGhnw4+002544
Moving to projects directory: /hdd/boinc-client/slots/4/ICMSHhnw4+002544
Moving to projects directory: /hdd/boinc-client/slots/4/ICMUAhnw4+002544
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMGGhnw4+002520
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMSHhnw4+002520
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMUAhnw4+002520
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMGGhnw4+002532
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMSHhnw4+002532
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMUAhnw4+002532
Zipping up the intermediate file: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_00hu_2019110100_123_993_12214080_1_r1002676986_105.zip
Uploading the intermediate file: upload_file_105.zip
  04:01:06 STEP 2545 H=2545:00 +CPU= 10.722
  04:01:17 STEP 2546 H=2546:00 +CPU= 10.893
  04:01:34 STEP 2547 H=2547:00 +CPU= 16.861
  04:01:45 STEP 2548 H=2548:00 +CPU= 11.016
  04:01:55 STEP 2549 H=2549:00 +CPU= 10.662
  04:02:13 STEP 2550 H=2550:00 +CPU= 17.169
  04:02:24 STEP 2551 H=2551:00 +CPU= 10.838
  04:02:35 STEP 2552 H=2552:00 +CPU= 11.111
  04:02:52 STEP 2553 H=2553:00 +CPU= 16.889
  04:03:03 STEP 2554 H=2554:00 +CPU= 11.191
  04:03:14 STEP 2555 H=2555:00 +CPU= 10.797
  04:03:32 STEP 2556 H=2556:00 +CPU= 18.460
Moving to projects directory: /hdd/boinc-client/slots/4/ICMGGhnw4+002556
Moving to projects directory: /hdd/boinc-client/slots/4/ICMSHhnw4+002556
Moving to projects directory: /hdd/boinc-client/slots/4/ICMUAhnw4+002556
  04:03:43 STEP 2557 H=2557:00 +CPU= 10.812
  04:03:54 STEP 2558 H=2558:00 +CPU= 11.005
  04:04:11 STEP 2559 H=2559:00 +CPU= 16.879
  04:04:22 STEP 2560 H=2560:00 +CPU= 11.074
  04:04:33 STEP 2561 H=2561:00 +CPU= 10.727
  04:04:50 STEP 2562 H=2562:00 +CPU= 17.269
  04:05:01 STEP 2563 H=2563:00 +CPU= 10.811
  04:05:12 STEP 2564 H=2564:00 +CPU= 11.054
  04:05:29 STEP 2565 H=2565:00 +CPU= 17.032
  04:05:40 STEP 2566 H=2566:00 +CPU= 11.112
  04:05:51 STEP 2567 H=2567:00 +CPU= 11.043
  04:06:11 STEP 2568 H=2568:00 +CPU= 19.790
Moving to projects directory: /hdd/boinc-client/slots/4/ICMGGhnw4+002568
Moving to projects directory: /hdd/boinc-client/slots/4/ICMSHhnw4+002568
Moving to projects directory: /hdd/boinc-client/slots/4/ICMUAhnw4+002568
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMGGhnw4+002544
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMSHhnw4+002544
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMUAhnw4+002544
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMGGhnw4+002556
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMSHhnw4+002556
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMUAhnw4+002556
Zipping up the intermediate file: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_00hu_2019110100_123_993_12214080_1_r1002676986_106.zip
Uploading the intermediate file: upload_file_106.zip
  04:06:22 STEP 2569 H=2569:00 +CPU= 10.768
  04:06:33 STEP 2570 H=2570:00 +CPU= 10.989
  04:06:50 STEP 2571 H=2571:00 +CPU= 16.995
  04:07:01 STEP 2572 H=2572:00 +CPU= 11.104
  04:07:12 STEP 2573 H=2573:00 +CPU= 10.763
  04:07:29 STEP 2574 H=2574:00 +CPU= 17.276
  04:07:40 STEP 2575 H=2575:00 +CPU= 10.942
  04:07:51 STEP 2576 H=2576:00 +CPU= 11.098
  04:08:08 STEP 2577 H=2577:00 +CPU= 16.947
  04:08:19 STEP 2578 H=2578:00 +CPU= 11.209
  04:08:30 STEP 2579 H=2579:00 +CPU= 10.778
  04:08:48 STEP 2580 H=2580:00 +CPU= 18.455
Moving to projects directory: /hdd/boinc-client/slots/4/ICMGGhnw4+002580
Moving to projects directory: /hdd/boinc-client/slots/4/ICMSHhnw4+002580
Moving to projects directory: /hdd/boinc-client/slots/4/ICMUAhnw4+002580
  04:08:59 STEP 2581 H=2581:00 +CPU= 10.780
  04:09:10 STEP 2582 H=2582:00 +CPU= 11.051
  04:09:27 STEP 2583 H=2583:00 +CPU= 16.890
  04:09:38 STEP 2584 H=2584:00 +CPU= 11.087
  04:09:49 STEP 2585 H=2585:00 +CPU= 10.745
  04:10:06 STEP 2586 H=2586:00 +CPU= 17.278
  04:10:17 STEP 2587 H=2587:00 +CPU= 10.831
  04:10:28 STEP 2588 H=2588:00 +CPU= 11.103
  04:10:45 STEP 2589 H=2589:00 +CPU= 16.871
  04:10:56 STEP 2590 H=2590:00 +CPU= 11.141
  04:11:07 STEP 2591 H=2591:00 +CPU= 11.052
  04:11:27 STEP 2592 H=2592:00 +CPU= 19.761
Moving to projects directory: /hdd/boinc-client/slots/4/ICMGGhnw4+002592
Moving to projects directory: /hdd/boinc-client/slots/4/ICMSHhnw4+002592
Moving to projects directory: /hdd/boinc-client/slots/4/ICMUAhnw4+002592
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMGGhnw4+002568
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMSHhnw4+002568
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMUAhnw4+002568
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMGGhnw4+002580
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMSHhnw4+002580
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMUAhnw4+002580
Zipping up the intermediate file: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_00hu_2019110100_123_993_12214080_1_r1002676986_107.zip
Uploading the intermediate file: upload_file_107.zip
  04:11:38 STEP 2593 H=2593:00 +CPU= 10.739
  04:11:49 STEP 2594 H=2594:00 +CPU= 11.043
  04:12:06 STEP 2595 H=2595:00 +CPU= 16.998
  04:12:17 STEP 2596 H=2596:00 +CPU= 11.061
  04:12:28 STEP 2597 H=2597:00 +CPU= 10.754
  04:12:45 STEP 2598 H=2598:00 +CPU= 17.246
  04:12:56 STEP 2599 H=2599:00 +CPU= 10.879
  04:13:07 STEP 2600 H=2600:00 +CPU= 11.043
  04:13:24 STEP 2601 H=2601:00 +CPU= 16.881
  04:13:35 STEP 2602 H=2602:00 +CPU= 11.153
  04:13:46 STEP 2603 H=2603:00 +CPU= 10.737
  04:14:04 STEP 2604 H=2604:00 +CPU= 18.418
Moving to projects directory: /hdd/boinc-client/slots/4/ICMGGhnw4+002604
Moving to projects directory: /hdd/boinc-client/slots/4/ICMSHhnw4+002604
Moving to projects directory: /hdd/boinc-client/slots/4/ICMUAhnw4+002604
  04:14:15 STEP 2605 H=2605:00 +CPU= 10.760
  04:14:26 STEP 2606 H=2606:00 +CPU= 11.065
  04:14:43 STEP 2607 H=2607:00 +CPU= 16.854
  04:14:54 STEP 2608 H=2608:00 +CPU= 11.109
  04:15:05 STEP 2609 H=2609:00 +CPU= 10.745
  04:15:22 STEP 2610 H=2610:00 +CPU= 17.250
  04:15:33 STEP 2611 H=2611:00 +CPU= 10.844
  04:15:44 STEP 2612 H=2612:00 +CPU= 11.082
  04:16:01 STEP 2613 H=2613:00 +CPU= 17.086
  04:16:13 STEP 2614 H=2614:00 +CPU= 11.158
  04:16:24 STEP 2615 H=2615:00 +CPU= 11.102
  04:16:43 STEP 2616 H=2616:00 +CPU= 19.784
Moving to projects directory: /hdd/boinc-client/slots/4/ICMGGhnw4+002616
Moving to projects directory: /hdd/boinc-client/slots/4/ICMSHhnw4+002616
Moving to projects directory: /hdd/boinc-client/slots/4/ICMUAhnw4+002616
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMGGhnw4+002592
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMSHhnw4+002592
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMUAhnw4+002592
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMGGhnw4+002604
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMSHhnw4+002604
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMUAhnw4+002604
Zipping up the intermediate file: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_00hu_2019110100_123_993_12214080_1_r1002676986_108.zip
Uploading the intermediate file: upload_file_108.zip
  04:16:54 STEP 2617 H=2617:00 +CPU= 10.779
  04:17:05 STEP 2618 H=2618:00 +CPU= 11.090
  04:17:22 STEP 2619 H=2619:00 +CPU= 16.999
  04:17:34 STEP 2620 H=2620:00 +CPU= 11.180
  04:17:44 STEP 2621 H=2621:00 +CPU= 10.728
  04:18:02 STEP 2622 H=2622:00 +CPU= 17.238
  04:18:12 STEP 2623 H=2623:00 +CPU= 10.816
  04:18:23 STEP 2624 H=2624:00 +CPU= 11.064
  04:18:40 STEP 2625 H=2625:00 +CPU= 16.863
  04:18:51 STEP 2626 H=2626:00 +CPU= 11.097
  04:19:02 STEP 2627 H=2627:00 +CPU= 10.701
  04:19:21 STEP 2628 H=2628:00 +CPU= 18.427
Moving to projects directory: /hdd/boinc-client/slots/4/ICMGGhnw4+002628
Moving to projects directory: /hdd/boinc-client/slots/4/ICMSHhnw4+002628
Moving to projects directory: /hdd/boinc-client/slots/4/ICMUAhnw4+002628
  04:19:32 STEP 2629 H=2629:00 +CPU= 10.874
  04:19:43 STEP 2630 H=2630:00 +CPU= 11.070
  04:19:59 STEP 2631 H=2631:00 +CPU= 16.848
  04:20:11 STEP 2632 H=2632:00 +CPU= 11.163
  04:20:21 STEP 2633 H=2633:00 +CPU= 10.701
  04:20:39 STEP 2634 H=2634:00 +CPU= 17.215
  04:20:49 STEP 2635 H=2635:00 +CPU= 10.796
  04:21:00 STEP 2636 H=2636:00 +CPU= 11.041
  04:21:17 STEP 2637 H=2637:00 +CPU= 16.836
  04:21:28 STEP 2638 H=2638:00 +CPU= 11.085
  04:21:39 STEP 2639 H=2639:00 +CPU= 11.043
  04:21:59 STEP 2640 H=2640:00 +CPU= 19.697
Moving to projects directory: /hdd/boinc-client/slots/4/ICMGGhnw4+002640
Moving to projects directory: /hdd/boinc-client/slots/4/ICMSHhnw4+002640
Moving to projects directory: /hdd/boinc-client/slots/4/ICMUAhnw4+002640
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMGGhnw4+002616
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMSHhnw4+002616
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMUAhnw4+002616
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMGGhnw4+002628
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMSHhnw4+002628
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMUAhnw4+002628
Zipping up the intermediate file: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_00hu_2019110100_123_993_12214080_1_r1002676986_109.zip
Uploading the intermediate file: upload_file_109.zip
  04:22:10 STEP 2641 H=2641:00 +CPU= 10.841
  04:22:21 STEP 2642 H=2642:00 +CPU= 11.026
Uploading trickle at timestep: 9504000
  04:22:38 STEP 2643 H=2643:00 +CPU= 16.826
  04:22:49 STEP 2644 H=2644:00 +CPU= 11.101
  04:23:00 STEP 2645 H=2645:00 +CPU= 10.725
  04:23:17 STEP 2646 H=2646:00 +CPU= 17.231
  04:23:28 STEP 2647 H=2647:00 +CPU= 10.818
  04:23:39 STEP 2648 H=2648:00 +CPU= 11.088
  04:23:56 STEP 2649 H=2649:00 +CPU= 16.887
  04:24:07 STEP 2650 H=2650:00 +CPU= 11.158
  04:24:18 STEP 2651 H=2651:00 +CPU= 10.754
  04:24:36 STEP 2652 H=2652:00 +CPU= 18.427
Moving to projects directory: /hdd/boinc-client/slots/4/ICMGGhnw4+002652
Moving to projects directory: /hdd/boinc-client/slots/4/ICMSHhnw4+002652
Moving to projects directory: /hdd/boinc-client/slots/4/ICMUAhnw4+002652
  04:24:47 STEP 2653 H=2653:00 +CPU= 10.807
  04:24:58 STEP 2654 H=2654:00 +CPU= 11.034
  04:25:15 STEP 2655 H=2655:00 +CPU= 16.837
  04:25:26 STEP 2656 H=2656:00 +CPU= 11.097
  04:25:37 STEP 2657 H=2657:00 +CPU= 10.726
  04:25:54 STEP 2658 H=2658:00 +CPU= 17.210
  04:26:05 STEP 2659 H=2659:00 +CPU= 10.805
  04:26:16 STEP 2660 H=2660:00 +CPU= 11.069
  04:26:33 STEP 2661 H=2661:00 +CPU= 16.810
  04:26:44 STEP 2662 H=2662:00 +CPU= 11.098
  04:26:55 STEP 2663 H=2663:00 +CPU= 11.063
  04:27:15 STEP 2664 H=2664:00 +CPU= 19.711
Moving to projects directory: /hdd/boinc-client/slots/4/ICMGGhnw4+002664
Moving to projects directory: /hdd/boinc-client/slots/4/ICMSHhnw4+002664
Moving to projects directory: /hdd/boinc-client/slots/4/ICMUAhnw4+002664
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMGGhnw4+002640
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMSHhnw4+002640
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMUAhnw4+002640
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMGGhnw4+002652
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMSHhnw4+002652
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMUAhnw4+002652
Zipping up the intermediate file: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_00hu_2019110100_123_993_12214080_1_r1002676986_110.zip
Uploading the intermediate file: upload_file_110.zip
  04:27:26 STEP 2665 H=2665:00 +CPU= 10.751
  04:27:37 STEP 2666 H=2666:00 +CPU= 11.044
  04:27:54 STEP 2667 H=2667:00 +CPU= 16.860
  04:28:05 STEP 2668 H=2668:00 +CPU= 11.147
  04:28:15 STEP 2669 H=2669:00 +CPU= 10.726
  04:28:33 STEP 2670 H=2670:00 +CPU= 17.255
  04:28:44 STEP 2671 H=2671:00 +CPU= 10.831
  04:28:55 STEP 2672 H=2672:00 +CPU= 11.078
  04:29:12 STEP 2673 H=2673:00 +CPU= 16.888
  04:29:23 STEP 2674 H=2674:00 +CPU= 11.139
  04:29:34 STEP 2675 H=2675:00 +CPU= 10.762
  04:29:52 STEP 2676 H=2676:00 +CPU= 18.436
Moving to projects directory: /hdd/boinc-client/slots/4/ICMGGhnw4+002676
Moving to projects directory: /hdd/boinc-client/slots/4/ICMSHhnw4+002676
Moving to projects directory: /hdd/boinc-client/slots/4/ICMUAhnw4+002676
  04:30:03 STEP 2677 H=2677:00 +CPU= 10.798
  04:30:14 STEP 2678 H=2678:00 +CPU= 11.080
  04:30:31 STEP 2679 H=2679:00 +CPU= 16.874
  04:30:42 STEP 2680 H=2680:00 +CPU= 11.164
  04:30:53 STEP 2681 H=2681:00 +CPU= 10.720
  04:31:10 STEP 2682 H=2682:00 +CPU= 17.211
  04:31:21 STEP 2683 H=2683:00 +CPU= 10.819
  04:31:32 STEP 2684 H=2684:00 +CPU= 11.088
  04:31:49 STEP 2685 H=2685:00 +CPU= 16.835
  04:32:00 STEP 2686 H=2686:00 +CPU= 11.145
  04:32:11 STEP 2687 H=2687:00 +CPU= 11.080
  04:32:31 STEP 2688 H=2688:00 +CPU= 19.865
Moving to projects directory: /hdd/boinc-client/slots/4/ICMGGhnw4+002688
Moving to projects directory: /hdd/boinc-client/slots/4/ICMSHhnw4+002688
Moving to projects directory: /hdd/boinc-client/slots/4/ICMUAhnw4+002688
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMGGhnw4+002664
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMSHhnw4+002664
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMUAhnw4+002664
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMGGhnw4+002676
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMSHhnw4+002676
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMUAhnw4+002676
Zipping up the intermediate file: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_00hu_2019110100_123_993_12214080_1_r1002676986_111.zip
Uploading the intermediate file: upload_file_111.zip
  04:32:42 STEP 2689 H=2689:00 +CPU= 10.797
  04:32:53 STEP 2690 H=2690:00 +CPU= 11.072
  04:33:10 STEP 2691 H=2691:00 +CPU= 17.075
  04:33:21 STEP 2692 H=2692:00 +CPU= 11.173
  04:33:32 STEP 2693 H=2693:00 +CPU= 10.762
  04:33:49 STEP 2694 H=2694:00 +CPU= 17.264
  04:34:00 STEP 2695 H=2695:00 +CPU= 10.836
  04:34:11 STEP 2696 H=2696:00 +CPU= 11.082
  04:34:28 STEP 2697 H=2697:00 +CPU= 16.918
  04:34:39 STEP 2698 H=2698:00 +CPU= 11.158
  04:34:50 STEP 2699 H=2699:00 +CPU= 10.772
  04:35:09 STEP 2700 H=2700:00 +CPU= 18.514
Moving to projects directory: /hdd/boinc-client/slots/4/ICMGGhnw4+002700
Moving to projects directory: /hdd/boinc-client/slots/4/ICMSHhnw4+002700
Moving to projects directory: /hdd/boinc-client/slots/4/ICMUAhnw4+002700
  04:35:19 STEP 2701 H=2701:00 +CPU= 10.862
  04:35:31 STEP 2702 H=2702:00 +CPU= 11.123
  04:35:47 STEP 2703 H=2703:00 +CPU= 16.946
  04:35:59 STEP 2704 H=2704:00 +CPU= 11.196
  04:36:10 STEP 2705 H=2705:00 +CPU= 10.807
  04:36:27 STEP 2706 H=2706:00 +CPU= 17.233
  04:36:38 STEP 2707 H=2707:00 +CPU= 10.844
  04:36:49 STEP 2708 H=2708:00 +CPU= 11.103
  04:37:06 STEP 2709 H=2709:00 +CPU= 17.065
  04:37:17 STEP 2710 H=2710:00 +CPU= 11.155
  04:37:28 STEP 2711 H=2711:00 +CPU= 11.115
  04:37:48 STEP 2712 H=2712:00 +CPU= 19.852
Moving to projects directory: /hdd/boinc-client/slots/4/ICMGGhnw4+002712
Moving to projects directory: /hdd/boinc-client/slots/4/ICMSHhnw4+002712
Moving to projects directory: /hdd/boinc-client/slots/4/ICMUAhnw4+002712
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMGGhnw4+002688
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMSHhnw4+002688
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMUAhnw4+002688
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMGGhnw4+002700
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMSHhnw4+002700
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMUAhnw4+002700
Zipping up the intermediate file: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_00hu_2019110100_123_993_12214080_1_r1002676986_112.zip
Uploading the intermediate file: upload_file_112.zip
  04:37:59 STEP 2713 H=2713:00 +CPU= 10.822
  04:38:10 STEP 2714 H=2714:00 +CPU= 11.082
  04:38:27 STEP 2715 H=2715:00 +CPU= 17.059
  04:38:38 STEP 2716 H=2716:00 +CPU= 11.200
  04:38:49 STEP 2717 H=2717:00 +CPU= 10.779
  04:39:06 STEP 2718 H=2718:00 +CPU= 17.257
  04:39:17 STEP 2719 H=2719:00 +CPU= 10.845
  04:39:28 STEP 2720 H=2720:00 +CPU= 11.109
  04:39:45 STEP 2721 H=2721:00 +CPU= 16.908
  04:39:56 STEP 2722 H=2722:00 +CPU= 11.134
  04:40:07 STEP 2723 H=2723:00 +CPU= 10.789
  04:40:26 STEP 2724 H=2724:00 +CPU= 18.508
Moving to projects directory: /hdd/boinc-client/slots/4/ICMGGhnw4+002724
Moving to projects directory: /hdd/boinc-client/slots/4/ICMSHhnw4+002724
Moving to projects directory: /hdd/boinc-client/slots/4/ICMUAhnw4+002724
  04:40:37 STEP 2725 H=2725:00 +CPU= 10.862
  04:40:48 STEP 2726 H=2726:00 +CPU= 11.112
  04:41:05 STEP 2727 H=2727:00 +CPU= 16.957
  04:41:16 STEP 2728 H=2728:00 +CPU= 11.191
  04:41:27 STEP 2729 H=2729:00 +CPU= 10.783
  04:41:44 STEP 2730 H=2730:00 +CPU= 17.254
  04:41:55 STEP 2731 H=2731:00 +CPU= 10.873
  04:42:06 STEP 2732 H=2732:00 +CPU= 11.099
  04:42:23 STEP 2733 H=2733:00 +CPU= 16.853
  04:42:34 STEP 2734 H=2734:00 +CPU= 11.101
  04:42:45 STEP 2735 H=2735:00 +CPU= 11.089
  04:43:05 STEP 2736 H=2736:00 +CPU= 19.808
Moving to projects directory: /hdd/boinc-client/slots/4/ICMGGhnw4+002736
Moving to projects directory: /hdd/boinc-client/slots/4/ICMSHhnw4+002736
Moving to projects directory: /hdd/boinc-client/slots/4/ICMUAhnw4+002736
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMGGhnw4+002712
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMSHhnw4+002712
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMUAhnw4+002712
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMGGhnw4+002724
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMSHhnw4+002724
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMUAhnw4+002724
Zipping up the intermediate file: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_00hu_2019110100_123_993_12214080_1_r1002676986_113.zip
Uploading the intermediate file: upload_file_113.zip
  04:43:16 STEP 2737 H=2737:00 +CPU= 10.815
  04:43:27 STEP 2738 H=2738:00 +CPU= 11.089
  04:43:44 STEP 2739 H=2739:00 +CPU= 16.924
  04:43:55 STEP 2740 H=2740:00 +CPU= 11.141
  04:44:06 STEP 2741 H=2741:00 +CPU= 10.748
  04:44:23 STEP 2742 H=2742:00 +CPU= 17.245
  04:44:34 STEP 2743 H=2743:00 +CPU= 10.790
  04:44:45 STEP 2744 H=2744:00 +CPU= 11.057
  04:45:02 STEP 2745 H=2745:00 +CPU= 16.874
  04:45:13 STEP 2746 H=2746:00 +CPU= 11.116
  04:45:24 STEP 2747 H=2747:00 +CPU= 10.744
  04:45:42 STEP 2748 H=2748:00 +CPU= 18.467
Moving to projects directory: /hdd/boinc-client/slots/4/ICMGGhnw4+002748
Moving to projects directory: /hdd/boinc-client/slots/4/ICMSHhnw4+002748
Moving to projects directory: /hdd/boinc-client/slots/4/ICMUAhnw4+002748
  04:45:53 STEP 2749 H=2749:00 +CPU= 10.825
  04:46:04 STEP 2750 H=2750:00 +CPU= 11.081
  04:46:21 STEP 2751 H=2751:00 +CPU= 16.882
  04:46:32 STEP 2752 H=2752:00 +CPU= 11.150
  04:46:43 STEP 2753 H=2753:00 +CPU= 10.765
  04:47:00 STEP 2754 H=2754:00 +CPU= 17.211
  04:47:11 STEP 2755 H=2755:00 +CPU= 10.847
  04:47:22 STEP 2756 H=2756:00 +CPU= 11.077
  04:47:39 STEP 2757 H=2757:00 +CPU= 16.877
  04:47:50 STEP 2758 H=2758:00 +CPU= 11.111
  04:48:01 STEP 2759 H=2759:00 +CPU= 11.102
  04:48:21 STEP 2760 H=2760:00 +CPU= 19.837
Moving to projects directory: /hdd/boinc-client/slots/4/ICMGGhnw4+002760
Moving to projects directory: /hdd/boinc-client/slots/4/ICMSHhnw4+002760
Moving to projects directory: /hdd/boinc-client/slots/4/ICMUAhnw4+002760
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMGGhnw4+002736
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMSHhnw4+002736
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMUAhnw4+002736
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMGGhnw4+002748
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMSHhnw4+002748
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMUAhnw4+002748
Zipping up the intermediate file: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_00hu_2019110100_123_993_12214080_1_r1002676986_114.zip
Uploading the intermediate file: upload_file_114.zip
  04:48:32 STEP 2761 H=2761:00 +CPU= 10.793
  04:48:43 STEP 2762 H=2762:00 +CPU= 11.065
  04:49:00 STEP 2763 H=2763:00 +CPU= 16.896
  04:49:11 STEP 2764 H=2764:00 +CPU= 11.170
  04:49:22 STEP 2765 H=2765:00 +CPU= 10.753
  04:49:39 STEP 2766 H=2766:00 +CPU= 17.282
  04:49:50 STEP 2767 H=2767:00 +CPU= 10.834
  04:50:01 STEP 2768 H=2768:00 +CPU= 11.082
  04:50:18 STEP 2769 H=2769:00 +CPU= 16.943
  04:50:29 STEP 2770 H=2770:00 +CPU= 11.140
  04:50:40 STEP 2771 H=2771:00 +CPU= 10.769
  04:50:59 STEP 2772 H=2772:00 +CPU= 18.508
Moving to projects directory: /hdd/boinc-client/slots/4/ICMGGhnw4+002772
Moving to projects directory: /hdd/boinc-client/slots/4/ICMSHhnw4+002772
Moving to projects directory: /hdd/boinc-client/slots/4/ICMUAhnw4+002772
  04:51:09 STEP 2773 H=2773:00 +CPU= 10.849
  04:51:21 STEP 2774 H=2774:00 +CPU= 11.121
  04:51:38 STEP 2775 H=2775:00 +CPU= 16.937
  04:51:49 STEP 2776 H=2776:00 +CPU= 11.178
  04:52:00 STEP 2777 H=2777:00 +CPU= 10.779
  04:52:17 STEP 2778 H=2778:00 +CPU= 17.217
  04:52:28 STEP 2779 H=2779:00 +CPU= 10.856
  04:52:39 STEP 2780 H=2780:00 +CPU= 11.117
  04:52:56 STEP 2781 H=2781:00 +CPU= 17.039
  04:53:07 STEP 2782 H=2782:00 +CPU= 11.129
  04:53:18 STEP 2783 H=2783:00 +CPU= 11.114
  04:53:38 STEP 2784 H=2784:00 +CPU= 19.873
Moving to projects directory: /hdd/boinc-client/slots/4/ICMGGhnw4+002784
Moving to projects directory: /hdd/boinc-client/slots/4/ICMSHhnw4+002784
Moving to projects directory: /hdd/boinc-client/slots/4/ICMUAhnw4+002784
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMGGhnw4+002760
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMSHhnw4+002760
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMUAhnw4+002760
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMGGhnw4+002772
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMSHhnw4+002772
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMUAhnw4+002772
Zipping up the intermediate file: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_00hu_2019110100_123_993_12214080_1_r1002676986_115.zip
Uploading the intermediate file: upload_file_115.zip
  04:53:49 STEP 2785 H=2785:00 +CPU= 10.805
  04:54:00 STEP 2786 H=2786:00 +CPU= 11.069
  04:54:17 STEP 2787 H=2787:00 +CPU= 17.119
  04:54:28 STEP 2788 H=2788:00 +CPU= 11.149
  04:54:39 STEP 2789 H=2789:00 +CPU= 10.738
  04:54:56 STEP 2790 H=2790:00 +CPU= 17.266
  04:55:07 STEP 2791 H=2791:00 +CPU= 10.831
  04:55:18 STEP 2792 H=2792:00 +CPU= 11.075
  04:55:35 STEP 2793 H=2793:00 +CPU= 16.914
  04:55:46 STEP 2794 H=2794:00 +CPU= 11.149
  04:55:57 STEP 2795 H=2795:00 +CPU= 10.774
  04:56:16 STEP 2796 H=2796:00 +CPU= 18.504
Moving to projects directory: /hdd/boinc-client/slots/4/ICMGGhnw4+002796
Moving to projects directory: /hdd/boinc-client/slots/4/ICMSHhnw4+002796
Moving to projects directory: /hdd/boinc-client/slots/4/ICMUAhnw4+002796
  04:56:26 STEP 2797 H=2797:00 +CPU= 10.790
  04:56:37 STEP 2798 H=2798:00 +CPU= 11.082
  04:56:54 STEP 2799 H=2799:00 +CPU= 16.938
  04:57:06 STEP 2800 H=2800:00 +CPU= 11.157
  04:57:16 STEP 2801 H=2801:00 +CPU= 10.758
  04:57:34 STEP 2802 H=2802:00 +CPU= 17.260
  04:57:45 STEP 2803 H=2803:00 +CPU= 10.844
  04:57:56 STEP 2804 H=2804:00 +CPU= 11.085
  04:58:13 STEP 2805 H=2805:00 +CPU= 17.009
  04:58:24 STEP 2806 H=2806:00 +CPU= 11.133
  04:58:35 STEP 2807 H=2807:00 +CPU= 11.074
  04:58:55 STEP 2808 H=2808:00 +CPU= 19.800
Moving to projects directory: /hdd/boinc-client/slots/4/ICMGGhnw4+002808
Moving to projects directory: /hdd/boinc-client/slots/4/ICMSHhnw4+002808
Moving to projects directory: /hdd/boinc-client/slots/4/ICMUAhnw4+002808
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMGGhnw4+002784
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMSHhnw4+002784
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMUAhnw4+002784
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMGGhnw4+002796
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMSHhnw4+002796
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMUAhnw4+002796
Zipping up the intermediate file: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_00hu_2019110100_123_993_12214080_1_r1002676986_116.zip
Uploading the intermediate file: upload_file_116.zip
  04:59:06 STEP 2809 H=2809:00 +CPU= 10.776
  04:59:17 STEP 2810 H=2810:00 +CPU= 11.043
  04:59:34 STEP 2811 H=2811:00 +CPU= 17.009
  04:59:45 STEP 2812 H=2812:00 +CPU= 11.169
  04:59:56 STEP 2813 H=2813:00 +CPU= 10.722
  05:00:13 STEP 2814 H=2814:00 +CPU= 17.276
  05:00:24 STEP 2815 H=2815:00 +CPU= 10.835
  05:00:35 STEP 2816 H=2816:00 +CPU= 11.086
  05:00:52 STEP 2817 H=2817:00 +CPU= 16.934
  05:01:03 STEP 2818 H=2818:00 +CPU= 11.139
  05:01:14 STEP 2819 H=2819:00 +CPU= 10.783
  05:01:32 STEP 2820 H=2820:00 +CPU= 18.514
Moving to projects directory: /hdd/boinc-client/slots/4/ICMGGhnw4+002820
Moving to projects directory: /hdd/boinc-client/slots/4/ICMSHhnw4+002820
Moving to projects directory: /hdd/boinc-client/slots/4/ICMUAhnw4+002820
  05:01:43 STEP 2821 H=2821:00 +CPU= 10.805
  05:01:54 STEP 2822 H=2822:00 +CPU= 11.105
  05:02:11 STEP 2823 H=2823:00 +CPU= 16.917
  05:02:23 STEP 2824 H=2824:00 +CPU= 11.292
  05:02:33 STEP 2825 H=2825:00 +CPU= 10.746
  05:02:51 STEP 2826 H=2826:00 +CPU= 17.263
  05:03:01 STEP 2827 H=2827:00 +CPU= 10.840
  05:03:13 STEP 2828 H=2828:00 +CPU= 11.083
  05:03:30 STEP 2829 H=2829:00 +CPU= 17.070
  05:03:41 STEP 2830 H=2830:00 +CPU= 11.125
  05:03:52 STEP 2831 H=2831:00 +CPU= 11.092
  05:04:12 STEP 2832 H=2832:00 +CPU= 19.808
Moving to projects directory: /hdd/boinc-client/slots/4/ICMGGhnw4+002832
Moving to projects directory: /hdd/boinc-client/slots/4/ICMSHhnw4+002832
Moving to projects directory: /hdd/boinc-client/slots/4/ICMUAhnw4+002832
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMGGhnw4+002808
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMSHhnw4+002808
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMUAhnw4+002808
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMGGhnw4+002820
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMSHhnw4+002820
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMUAhnw4+002820
Zipping up the intermediate file: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_00hu_2019110100_123_993_12214080_1_r1002676986_117.zip
Uploading the intermediate file: upload_file_117.zip
  05:04:22 STEP 2833 H=2833:00 +CPU= 10.749
  05:04:34 STEP 2834 H=2834:00 +CPU= 11.076
  05:04:51 STEP 2835 H=2835:00 +CPU= 16.985
  05:05:02 STEP 2836 H=2836:00 +CPU= 11.225
  05:05:13 STEP 2837 H=2837:00 +CPU= 10.739
  05:05:30 STEP 2838 H=2838:00 +CPU= 17.251
  05:05:41 STEP 2839 H=2839:00 +CPU= 10.813
  05:05:52 STEP 2840 H=2840:00 +CPU= 11.061
  05:06:09 STEP 2841 H=2841:00 +CPU= 16.897
  05:06:20 STEP 2842 H=2842:00 +CPU= 11.121
  05:06:31 STEP 2843 H=2843:00 +CPU= 10.756
  05:06:49 STEP 2844 H=2844:00 +CPU= 18.480
Moving to projects directory: /hdd/boinc-client/slots/4/ICMGGhnw4+002844
Moving to projects directory: /hdd/boinc-client/slots/4/ICMSHhnw4+002844
Moving to projects directory: /hdd/boinc-client/slots/4/ICMUAhnw4+002844
  05:07:00 STEP 2845 H=2845:00 +CPU= 10.801
  05:07:11 STEP 2846 H=2846:00 +CPU= 11.072
  05:07:28 STEP 2847 H=2847:00 +CPU= 16.890
  05:07:39 STEP 2848 H=2848:00 +CPU= 11.154
  05:07:50 STEP 2849 H=2849:00 +CPU= 10.742
  05:08:07 STEP 2850 H=2850:00 +CPU= 17.223
  05:08:18 STEP 2851 H=2851:00 +CPU= 10.808
  05:08:29 STEP 2852 H=2852:00 +CPU= 11.080
  05:08:46 STEP 2853 H=2853:00 +CPU= 16.989
  05:08:57 STEP 2854 H=2854:00 +CPU= 11.116
  05:09:08 STEP 2855 H=2855:00 +CPU= 11.096
  05:09:28 STEP 2856 H=2856:00 +CPU= 19.773
Moving to projects directory: /hdd/boinc-client/slots/4/ICMGGhnw4+002856
Moving to projects directory: /hdd/boinc-client/slots/4/ICMSHhnw4+002856
Moving to projects directory: /hdd/boinc-client/slots/4/ICMUAhnw4+002856
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMGGhnw4+002832
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMSHhnw4+002832
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMUAhnw4+002832
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMGGhnw4+002844
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMSHhnw4+002844
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMUAhnw4+002844
Zipping up the intermediate file: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_00hu_2019110100_123_993_12214080_1_r1002676986_118.zip
Uploading the intermediate file: upload_file_118.zip
  05:09:39 STEP 2857 H=2857:00 +CPU= 10.776
  05:09:50 STEP 2858 H=2858:00 +CPU= 11.079
  05:10:07 STEP 2859 H=2859:00 +CPU= 17.056
  05:10:18 STEP 2860 H=2860:00 +CPU= 11.167
  05:10:29 STEP 2861 H=2861:00 +CPU= 10.740
  05:10:46 STEP 2862 H=2862:00 +CPU= 17.260
  05:10:57 STEP 2863 H=2863:00 +CPU= 10.820
  05:11:08 STEP 2864 H=2864:00 +CPU= 11.065
  05:11:25 STEP 2865 H=2865:00 +CPU= 16.899
  05:11:36 STEP 2866 H=2866:00 +CPU= 11.135
  05:11:47 STEP 2867 H=2867:00 +CPU= 10.772
  05:12:05 STEP 2868 H=2868:00 +CPU= 18.491
Moving to projects directory: /hdd/boinc-client/slots/4/ICMGGhnw4+002868
Moving to projects directory: /hdd/boinc-client/slots/4/ICMSHhnw4+002868
Moving to projects directory: /hdd/boinc-client/slots/4/ICMUAhnw4+002868
  05:12:16 STEP 2869 H=2869:00 +CPU= 10.823
  05:12:27 STEP 2870 H=2870:00 +CPU= 11.111
  05:12:44 STEP 2871 H=2871:00 +CPU= 16.912
  05:12:55 STEP 2872 H=2872:00 +CPU= 11.184
  05:13:06 STEP 2873 H=2873:00 +CPU= 10.778
  05:13:23 STEP 2874 H=2874:00 +CPU= 17.194
  05:13:34 STEP 2875 H=2875:00 +CPU= 10.862
  05:13:45 STEP 2876 H=2876:00 +CPU= 11.075
  05:14:02 STEP 2877 H=2877:00 +CPU= 16.847
  05:14:13 STEP 2878 H=2878:00 +CPU= 11.109
  05:14:25 STEP 2879 H=2879:00 +CPU= 11.101
  05:14:44 STEP 2880 H=2880:00 +CPU= 19.763
Moving to projects directory: /hdd/boinc-client/slots/4/ICMGGhnw4+002880
Moving to projects directory: /hdd/boinc-client/slots/4/ICMSHhnw4+002880
Moving to projects directory: /hdd/boinc-client/slots/4/ICMUAhnw4+002880
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMGGhnw4+002856
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMSHhnw4+002856
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMUAhnw4+002856
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMGGhnw4+002868
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMSHhnw4+002868
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMUAhnw4+002868
Zipping up the intermediate file: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_00hu_2019110100_123_993_12214080_1_r1002676986_119.zip
Uploading the intermediate file: upload_file_119.zip
  05:14:55 STEP 2881 H=2881:00 +CPU= 10.809
  05:15:06 STEP 2882 H=2882:00 +CPU= 11.085
Uploading trickle at timestep: 10368000
  05:15:23 STEP 2883 H=2883:00 +CPU= 16.856
  05:15:34 STEP 2884 H=2884:00 +CPU= 11.159
  05:15:45 STEP 2885 H=2885:00 +CPU= 10.737
  05:16:02 STEP 2886 H=2886:00 +CPU= 17.233
  05:16:13 STEP 2887 H=2887:00 +CPU= 10.808
  05:16:24 STEP 2888 H=2888:00 +CPU= 11.071
  05:16:41 STEP 2889 H=2889:00 +CPU= 16.877
  05:16:52 STEP 2890 H=2890:00 +CPU= 11.143
  05:17:03 STEP 2891 H=2891:00 +CPU= 10.777
  05:17:22 STEP 2892 H=2892:00 +CPU= 18.476
Moving to projects directory: /hdd/boinc-client/slots/4/ICMGGhnw4+002892
Moving to projects directory: /hdd/boinc-client/slots/4/ICMSHhnw4+002892
Moving to projects directory: /hdd/boinc-client/slots/4/ICMUAhnw4+002892
  05:17:32 STEP 2893 H=2893:00 +CPU= 10.850
  05:17:44 STEP 2894 H=2894:00 +CPU= 11.106
  05:18:01 STEP 2895 H=2895:00 +CPU= 16.953
  05:18:12 STEP 2896 H=2896:00 +CPU= 11.176
  05:18:23 STEP 2897 H=2897:00 +CPU= 10.776
  05:18:40 STEP 2898 H=2898:00 +CPU= 17.218
  05:18:51 STEP 2899 H=2899:00 +CPU= 10.867
  05:19:02 STEP 2900 H=2900:00 +CPU= 11.101
  05:19:19 STEP 2901 H=2901:00 +CPU= 17.038
  05:19:30 STEP 2902 H=2902:00 +CPU= 11.137
  05:19:41 STEP 2903 H=2903:00 +CPU= 11.109
  05:20:01 STEP 2904 H=2904:00 +CPU= 19.846
Moving to projects directory: /hdd/boinc-client/slots/4/ICMGGhnw4+002904
Moving to projects directory: /hdd/boinc-client/slots/4/ICMSHhnw4+002904
Moving to projects directory: /hdd/boinc-client/slots/4/ICMUAhnw4+002904
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMGGhnw4+002880
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMSHhnw4+002880
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMUAhnw4+002880
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMGGhnw4+002892
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMSHhnw4+002892
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMUAhnw4+002892
Zipping up the intermediate file: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_00hu_2019110100_123_993_12214080_1_r1002676986_120.zip
Uploading the intermediate file: upload_file_120.zip
  05:20:12 STEP 2905 H=2905:00 +CPU= 10.818
  05:20:23 STEP 2906 H=2906:00 +CPU= 11.073
  05:20:40 STEP 2907 H=2907:00 +CPU= 17.071
  05:20:51 STEP 2908 H=2908:00 +CPU= 11.150
  05:21:02 STEP 2909 H=2909:00 +CPU= 10.771
  05:21:19 STEP 2910 H=2910:00 +CPU= 17.238
  05:21:30 STEP 2911 H=2911:00 +CPU= 10.818
  05:21:41 STEP 2912 H=2912:00 +CPU= 11.065
  05:21:58 STEP 2913 H=2913:00 +CPU= 16.874
  05:22:09 STEP 2914 H=2914:00 +CPU= 11.104
  05:22:20 STEP 2915 H=2915:00 +CPU= 10.736
  05:22:38 STEP 2916 H=2916:00 +CPU= 18.458
Moving to projects directory: /hdd/boinc-client/slots/4/ICMGGhnw4+002916
Moving to projects directory: /hdd/boinc-client/slots/4/ICMSHhnw4+002916
Moving to projects directory: /hdd/boinc-client/slots/4/ICMUAhnw4+002916
  05:22:49 STEP 2917 H=2917:00 +CPU= 10.839
  05:23:00 STEP 2918 H=2918:00 +CPU= 11.098
  05:23:17 STEP 2919 H=2919:00 +CPU= 16.951
  05:23:29 STEP 2920 H=2920:00 +CPU= 11.163
  05:23:39 STEP 2921 H=2921:00 +CPU= 10.768
  05:23:56 STEP 2922 H=2922:00 +CPU= 17.190
  05:24:07 STEP 2923 H=2923:00 +CPU= 10.843
  05:24:18 STEP 2924 H=2924:00 +CPU= 11.059
  05:24:35 STEP 2925 H=2925:00 +CPU= 16.839
  05:24:46 STEP 2926 H=2926:00 +CPU= 11.091
  05:24:57 STEP 2927 H=2927:00 +CPU= 11.082
  05:25:17 STEP 2928 H=2928:00 +CPU= 19.764
Moving to projects directory: /hdd/boinc-client/slots/4/ICMGGhnw4+002928
Moving to projects directory: /hdd/boinc-client/slots/4/ICMSHhnw4+002928
Moving to projects directory: /hdd/boinc-client/slots/4/ICMUAhnw4+002928
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMGGhnw4+002904
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMSHhnw4+002904
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMUAhnw4+002904
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMGGhnw4+002916
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMSHhnw4+002916
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMUAhnw4+002916
Zipping up the intermediate file: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_00hu_2019110100_123_993_12214080_1_r1002676986_121.zip
Uploading the intermediate file: upload_file_121.zip
  05:25:28 STEP 2929 H=2929:00 +CPU= 10.812
  05:25:39 STEP 2930 H=2930:00 +CPU= 11.084
  05:25:56 STEP 2931 H=2931:00 +CPU= 16.889
  05:26:07 STEP 2932 H=2932:00 +CPU= 11.144
  05:26:18 STEP 2933 H=2933:00 +CPU= 10.742
  05:26:35 STEP 2934 H=2934:00 +CPU= 17.196
  05:26:46 STEP 2935 H=2935:00 +CPU= 10.806
  05:26:57 STEP 2936 H=2936:00 +CPU= 11.074
  05:27:14 STEP 2937 H=2937:00 +CPU= 16.850
  05:27:25 STEP 2938 H=2938:00 +CPU= 11.120
  05:27:36 STEP 2939 H=2939:00 +CPU= 10.754
  05:27:54 STEP 2940 H=2940:00 +CPU= 18.454
Moving to projects directory: /hdd/boinc-client/slots/4/ICMGGhnw4+002940
Moving to projects directory: /hdd/boinc-client/slots/4/ICMSHhnw4+002940
Moving to projects directory: /hdd/boinc-client/slots/4/ICMUAhnw4+002940
  05:28:05 STEP 2941 H=2941:00 +CPU= 10.851
  05:28:16 STEP 2942 H=2942:00 +CPU= 11.094
  05:28:33 STEP 2943 H=2943:00 +CPU= 16.910
  05:28:45 STEP 2944 H=2944:00 +CPU= 11.155
  05:28:55 STEP 2945 H=2945:00 +CPU= 10.803
  05:29:13 STEP 2946 H=2946:00 +CPU= 17.176
  05:29:23 STEP 2947 H=2947:00 +CPU= 10.832
  05:29:34 STEP 2948 H=2948:00 +CPU= 11.076
  05:29:51 STEP 2949 H=2949:00 +CPU= 16.820
  05:30:02 STEP 2950 H=2950:00 +CPU= 11.099
  05:30:14 STEP 2951 H=2951:00 +CPU= 11.084
  05:30:33 STEP 2952 H=2952:00 +CPU= 19.032
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

  FIELD LEV        AVERAGE               MINIMUM               MAXIMUM       
    101  60  3.19925486346338E-02 -1.00000000000000E+00  1.00000000000000E+00
  MAXGPFV : MAX. VALUE =    1.10212673327187     
  MAXGPFV : MAX. VALUE =   0.726272470781968     
 NSTEP =  2952 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGhnw4+002952 MODE=a
 IO-STREAM CLOSED - ICMGGhnw4+002952
 MPI-TASK:   1 -    299131562 BYTES IN      8 RECORDS TRANSFERRED IN    0.0002 SECONDS******** Mbytes/s, TOTAL TIME=    0.0055( 3.6%)
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200302231500  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200302233000  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200302234500  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200303000000  !!!!!!!!!!!! 
 05:30:33 STEP 2952 H=2952:00 +CPU= 19.032
 END CNT3
 NSTEP =  2952 CNT0   000000000  16.563  16.563  16.580   0.999               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ          654/    28953814 WRITTEN        46048/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1   1116    0      654        28275    46048 ************   111.9     0.0   111.8     0.7   178.5
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 ********* *********    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 ********* *********    100.00      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                 3200    1317.9    1317.9      9.96      0.00
   9 SPCM     - SPECTRAL COMP.                    2952     211.2     211.2      1.47      0.00
  10 SCAN2M - PHYSICS                             2953    6010.3    6010.3     41.90      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                247     696.2     696.2      0.41      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                126       9.9       9.9      0.00      0.00
  13 SCAN2M - RADIATION CALC.                      985    6353.6    6353.6     14.78      0.00
  14 SUINIF                                          1    1237.7    1237.7      0.00      0.00
  17 GRIDFPOS IN CNT4                              247      22.7      22.7      0.01      0.00
  18 SUSPECG                                         1     232.4     232.4      0.00      0.00
  19 SUSPEC                                          1     237.6     237.6      0.00      0.00
  24 SUGRIDU                                         1     784.2     784.2      0.00      0.00
  25 SPECRT                                          1     104.4     104.4      0.00      0.00
  26 SUGRIDF                                         1     111.5     111.5      0.00      0.00
  27 RESTART FILES - WRITING                       123    1398.0    1398.0      0.41      0.00
  28 RESTART FILES - READING                         1       0.0       0.0      0.00      0.00
  29 SU4FPOS IN CNT4                               247       0.0       0.0      0.00      0.00
  30 DYNFPOS IN CNT4                               247    1133.9    1133.9      0.66      0.00
  31 POSDDH IN STEPO                                13       0.4       0.4      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                   2953    1982.6    1982.6     13.82      0.00
  38 WAM      - TOTAL COST OF WAVE MODEL          2952    1477.4    1477.4     10.30      0.00
  39 SU0YOMB                                         1     148.6     148.6      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                   2953      13.0      13.0      0.09      0.00
  54 SPCM     - M TO S/S TO M TRANSP.             2952     199.4     199.4      1.39      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.             2952      29.6      29.6      0.21      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                126       0.1       0.1      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM    10094      78.8      78.8      1.88      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM      6152      79.3      79.3      1.15      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM       6152      29.5      29.5      0.43      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM     10094      28.1      28.1      0.67      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            2      11.2      11.2      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION          10094      11.0      11.0      0.26      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION           6152       9.9       9.9      0.14      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION          10094      12.1      12.1      0.29      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION           6152       7.7       7.7      0.11      0.00
 400 GSTATS                                     589499       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                564603       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME    42355.2 CPU TIME   42297.3 VECTOR TIME    42297.3


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY      250.9
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /hdd/boinc-client/slots/4/ICMGGhnw4+002952
Moving to projects directory: /hdd/boinc-client/slots/4/ICMSHhnw4+002952
Moving to projects directory: /hdd/boinc-client/slots/4/ICMUAhnw4+002952
Adding to the zip: /hdd/boinc-client/slots/4/NODE.001_01
Adding to the zip: /hdd/boinc-client/slots/4/ifs.stat
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMSHhnw4+002928
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMUAhnw4+002952
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMUAhnw4+002940
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMUAhnw4+002928
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMGGhnw4+002928
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMGGhnw4+002940
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMGGhnw4+002952
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMSHhnw4+002952
Adding to the zip: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_12214080/ICMSHhnw4+002940
Zipping up the final file: /hdd/boinc-client/projects/climateprediction.net/oifs_43r3_00hu_2019110100_123_993_12214080_1_r1002676986_122.zip
Uploading the final file: upload_file_122.zip
Uploading trickle at timestep: 10623600
05:33:54 (52345): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:54:19 1498009 22317055 oifs_43r3_00hu_2019110100_123_993_12214080_1 10,623,600 42,297 0.0040
09 May 2023 16:54:17 1498009 22317055 oifs_43r3_00hu_2019110100_123_993_12214080_1 10,368,000 41,358 0.0040
09 May 2023 16:54:16 1498009 22317055 oifs_43r3_00hu_2019110100_123_993_12214080_1 9,504,000 38,190 0.0040
09 May 2023 16:54:16 1498009 22317055 oifs_43r3_00hu_2019110100_123_993_12214080_1 8,640,000 34,931 0.0040
09 May 2023 16:54:13 1498009 22317055 oifs_43r3_00hu_2019110100_123_993_12214080_1 7,776,000 31,593 0.0041
09 May 2023 16:54:12 1498009 22317055 oifs_43r3_00hu_2019110100_123_993_12214080_1 6,912,000 28,244 0.0041
09 May 2023 16:54:10 1498009 22317055 oifs_43r3_00hu_2019110100_123_993_12214080_1 6,048,000 24,906 0.0041
09 May 2023 16:54:08 1498009 22317055 oifs_43r3_00hu_2019110100_123_993_12214080_1 5,184,000 21,558 0.0042
09 May 2023 16:54:05 1498009 22317055 oifs_43r3_00hu_2019110100_123_993_12214080_1 4,320,000 18,220 0.0042
09 May 2023 16:54:03 1498009 22317055 oifs_43r3_00hu_2019110100_123_993_12214080_1 3,456,000 14,861 0.0043
09 May 2023 16:54:01 1498009 22317055 oifs_43r3_00hu_2019110100_123_993_12214080_1 2,592,000 11,491 0.0044
09 May 2023 16:53:58 1498009 22317055 oifs_43r3_00hu_2019110100_123_993_12214080_1 1,728,000 7,887 0.0046
09 May 2023 16:53:56 1498009 22317055 oifs_43r3_00hu_2019110100_123_993_12214080_1 864,000 4,013 0.0046


©2024 climateprediction.net