climateprediction.net home page
Task 22302690

Task 22302690

Name oifs_43r3_ps_0978_2020050100_123_989_12206622_1
Workunit 12206622
Created 24 Jan 2023, 3:54:11 UTC
Sent 24 Jan 2023, 4:13:41 UTC
Report deadline 25 Mar 2023, 4:13:41 UTC
Received 27 Jan 2023, 5:15:57 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1536304
Run time 23 hours 37 min 17 sec
CPU time 23 hours 16 min 35 sec
Validate state Valid
Credit 14,873.04
Device peak FLOPS 5.67 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,418.05 MB
Peak swap size 4,978.08 MB
Peak disk usage 4,572.91 MB
Stderr
<core_client_version>7.20.5</core_client_version>
<![CDATA[
<stderr_txt>
_989_12206622_1_r2032690931_100.zip
Uploading the intermediate file: upload_file_100.zip
  16:04:24 STEP 2425 H=2425:00 +CPU= 22.700
  16:04:47 STEP 2426 H=2426:00 +CPU= 23.435
  16:05:23 STEP 2427 H=2427:00 +CPU= 35.290
  16:05:47 STEP 2428 H=2428:00 +CPU= 23.730
  16:06:10 STEP 2429 H=2429:00 +CPU= 22.711
  16:06:46 STEP 2430 H=2430:00 +CPU= 36.101
  16:07:08 STEP 2431 H=2431:00 +CPU= 22.322
  16:07:32 STEP 2432 H=2432:00 +CPU= 23.476
  16:08:07 STEP 2433 H=2433:00 +CPU= 34.698
  16:08:29 STEP 2434 H=2434:00 +CPU= 22.713
  16:08:52 STEP 2435 H=2435:00 +CPU= 22.579
  16:09:32 STEP 2436 H=2436:00 +CPU= 39.198
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002436
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002436
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002436
  16:09:55 STEP 2437 H=2437:00 +CPU= 22.909
  16:10:18 STEP 2438 H=2438:00 +CPU= 23.344
  16:10:55 STEP 2439 H=2439:00 +CPU= 36.331
  16:11:18 STEP 2440 H=2440:00 +CPU= 23.295
  16:11:41 STEP 2441 H=2441:00 +CPU= 23.009
  16:12:18 STEP 2442 H=2442:00 +CPU= 36.546
  16:12:40 STEP 2443 H=2443:00 +CPU= 22.019
  16:13:03 STEP 2444 H=2444:00 +CPU= 22.650
  16:13:39 STEP 2445 H=2445:00 +CPU= 35.698
  16:14:02 STEP 2446 H=2446:00 +CPU= 23.295
  16:14:25 STEP 2447 H=2447:00 +CPU= 23.113
  16:15:09 STEP 2448 H=2448:00 +CPU= 43.742
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002448
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002448
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMGGhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMSHhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMUAhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMGGhq0f+002436
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMSHhq0f+002436
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMUAhq0f+002436
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0978_2020050100_123_989_12206622_1_r2032690931_101.zip
Uploading the intermediate file: upload_file_101.zip
  16:15:32 STEP 2449 H=2449:00 +CPU= 22.760
  16:15:57 STEP 2450 H=2450:00 +CPU= 24.375
  16:16:33 STEP 2451 H=2451:00 +CPU= 35.770
  16:16:57 STEP 2452 H=2452:00 +CPU= 24.242
  16:17:21 STEP 2453 H=2453:00 +CPU= 23.338
  16:17:57 STEP 2454 H=2454:00 +CPU= 36.483
  16:18:20 STEP 2455 H=2455:00 +CPU= 22.499
  16:18:43 STEP 2456 H=2456:00 +CPU= 23.292
  16:19:19 STEP 2457 H=2457:00 +CPU= 35.065
  16:19:42 STEP 2458 H=2458:00 +CPU= 23.520
  16:20:06 STEP 2459 H=2459:00 +CPU= 23.275
  16:20:45 STEP 2460 H=2460:00 +CPU= 39.368
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002460
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002460
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002460
  16:21:08 STEP 2461 H=2461:00 +CPU= 22.922
  16:21:32 STEP 2462 H=2462:00 +CPU= 23.166
  16:22:07 STEP 2463 H=2463:00 +CPU= 35.472
  16:22:31 STEP 2464 H=2464:00 +CPU= 23.717
  16:22:54 STEP 2465 H=2465:00 +CPU= 23.065
  16:23:31 STEP 2466 H=2466:00 +CPU= 36.388
  16:23:53 STEP 2467 H=2467:00 +CPU= 22.420
  16:24:16 STEP 2468 H=2468:00 +CPU= 23.019
  16:24:53 STEP 2469 H=2469:00 +CPU= 36.258
  16:25:17 STEP 2470 H=2470:00 +CPU= 23.485
  16:25:41 STEP 2471 H=2471:00 +CPU= 23.870
  16:26:24 STEP 2472 H=2472:00 +CPU= 43.014
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002472
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002472
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMGGhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMSHhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMUAhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMGGhq0f+002460
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMSHhq0f+002460
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMUAhq0f+002460
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0978_2020050100_123_989_12206622_1_r2032690931_102.zip
Uploading the intermediate file: upload_file_102.zip
  16:26:46 STEP 2473 H=2473:00 +CPU= 22.468
  16:27:10 STEP 2474 H=2474:00 +CPU= 23.743
  16:27:46 STEP 2475 H=2475:00 +CPU= 35.235
  16:28:09 STEP 2476 H=2476:00 +CPU= 23.115
  16:28:32 STEP 2477 H=2477:00 +CPU= 22.550
  16:29:08 STEP 2478 H=2478:00 +CPU= 35.866
  16:29:31 STEP 2479 H=2479:00 +CPU= 23.277
  16:29:55 STEP 2480 H=2480:00 +CPU= 23.415
  16:30:30 STEP 2481 H=2481:00 +CPU= 35.638
  16:30:53 STEP 2482 H=2482:00 +CPU= 22.941
  16:31:16 STEP 2483 H=2483:00 +CPU= 22.529
  16:31:56 STEP 2484 H=2484:00 +CPU= 39.728
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002484
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002484
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002484
  16:32:19 STEP 2485 H=2485:00 +CPU= 22.733
  16:32:42 STEP 2486 H=2486:00 +CPU= 22.973
  16:33:18 STEP 2487 H=2487:00 +CPU= 36.249
  16:33:41 STEP 2488 H=2488:00 +CPU= 22.929
  16:34:05 STEP 2489 H=2489:00 +CPU= 23.176
  16:34:42 STEP 2490 H=2490:00 +CPU= 37.472
  16:35:05 STEP 2491 H=2491:00 +CPU= 23.119
  16:35:29 STEP 2492 H=2492:00 +CPU= 24.132
  16:36:05 STEP 2493 H=2493:00 +CPU= 35.657
  16:36:28 STEP 2494 H=2494:00 +CPU= 22.853
  16:36:51 STEP 2495 H=2495:00 +CPU= 23.249
  16:37:35 STEP 2496 H=2496:00 +CPU= 43.143
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002496
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002496
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMGGhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMSHhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMUAhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMGGhq0f+002484
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMSHhq0f+002484
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMUAhq0f+002484
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0978_2020050100_123_989_12206622_1_r2032690931_103.zip
Uploading the intermediate file: upload_file_103.zip
  16:37:58 STEP 2497 H=2497:00 +CPU= 22.691
  16:38:22 STEP 2498 H=2498:00 +CPU= 23.549
  16:38:57 STEP 2499 H=2499:00 +CPU= 35.230
  16:39:20 STEP 2500 H=2500:00 +CPU= 23.040
  16:39:43 STEP 2501 H=2501:00 +CPU= 22.370
  16:40:19 STEP 2502 H=2502:00 +CPU= 36.215
  16:40:41 STEP 2503 H=2503:00 +CPU= 22.161
  16:41:04 STEP 2504 H=2504:00 +CPU= 23.025
  16:41:40 STEP 2505 H=2505:00 +CPU= 35.621
  16:42:04 STEP 2506 H=2506:00 +CPU= 23.428
  16:42:27 STEP 2507 H=2507:00 +CPU= 22.554
  16:43:06 STEP 2508 H=2508:00 +CPU= 39.818
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002508
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002508
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002508
  16:43:29 STEP 2509 H=2509:00 +CPU= 22.116
  16:43:52 STEP 2510 H=2510:00 +CPU= 22.984
  16:44:28 STEP 2511 H=2511:00 +CPU= 36.016
  16:44:52 STEP 2512 H=2512:00 +CPU= 23.816
  16:45:16 STEP 2513 H=2513:00 +CPU= 23.733
  16:45:53 STEP 2514 H=2514:00 +CPU= 37.151
  16:46:16 STEP 2515 H=2515:00 +CPU= 22.968
  16:46:40 STEP 2516 H=2516:00 +CPU= 23.851
  16:47:16 STEP 2517 H=2517:00 +CPU= 35.715
  16:47:40 STEP 2518 H=2518:00 +CPU= 23.232
  16:48:03 STEP 2519 H=2519:00 +CPU= 22.734
  16:48:49 STEP 2520 H=2520:00 +CPU= 41.654
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002520
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002520
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMGGhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMSHhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMUAhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMGGhq0f+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMSHhq0f+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMUAhq0f+002508
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0978_2020050100_123_989_12206622_1_r2032690931_104.zip
Uploading the intermediate file: upload_file_104.zip
  16:49:11 STEP 2521 H=2521:00 +CPU= 21.894
  16:49:34 STEP 2522 H=2522:00 +CPU= 22.344
  16:50:08 STEP 2523 H=2523:00 +CPU= 34.646
  16:50:31 STEP 2524 H=2524:00 +CPU= 22.659
  16:50:53 STEP 2525 H=2525:00 +CPU= 21.944
  16:51:29 STEP 2526 H=2526:00 +CPU= 35.188
  16:51:50 STEP 2527 H=2527:00 +CPU= 21.793
  16:52:14 STEP 2528 H=2528:00 +CPU= 23.577
  16:52:49 STEP 2529 H=2529:00 +CPU= 34.491
  16:53:12 STEP 2530 H=2530:00 +CPU= 23.076
  16:53:34 STEP 2531 H=2531:00 +CPU= 22.107
  16:54:13 STEP 2532 H=2532:00 +CPU= 39.064
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002532
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002532
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002532
  16:54:36 STEP 2533 H=2533:00 +CPU= 22.219
  16:54:59 STEP 2534 H=2534:00 +CPU= 22.968
  16:55:34 STEP 2535 H=2535:00 +CPU= 34.824
  16:55:56 STEP 2536 H=2536:00 +CPU= 22.448
  16:56:18 STEP 2537 H=2537:00 +CPU= 21.925
  16:56:54 STEP 2538 H=2538:00 +CPU= 35.678
  16:57:16 STEP 2539 H=2539:00 +CPU= 21.795
  16:57:39 STEP 2540 H=2540:00 +CPU= 22.527
  16:58:14 STEP 2541 H=2541:00 +CPU= 34.887
  16:58:36 STEP 2542 H=2542:00 +CPU= 22.684
  16:58:59 STEP 2543 H=2543:00 +CPU= 22.772
  16:59:42 STEP 2544 H=2544:00 +CPU= 41.881
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002544
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002544
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMGGhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMSHhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMUAhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMGGhq0f+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMSHhq0f+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMUAhq0f+002532
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0978_2020050100_123_989_12206622_1_r2032690931_105.zip
Uploading the intermediate file: upload_file_105.zip
  17:00:04 STEP 2545 H=2545:00 +CPU= 22.378
  17:00:28 STEP 2546 H=2546:00 +CPU= 23.360
  17:01:03 STEP 2547 H=2547:00 +CPU= 35.044
  17:01:26 STEP 2548 H=2548:00 +CPU= 23.018
  17:01:49 STEP 2549 H=2549:00 +CPU= 22.785
  17:02:26 STEP 2550 H=2550:00 +CPU= 36.015
  17:02:48 STEP 2551 H=2551:00 +CPU= 22.489
  17:03:12 STEP 2552 H=2552:00 +CPU= 23.566
  17:03:49 STEP 2553 H=2553:00 +CPU= 36.761
  17:04:12 STEP 2554 H=2554:00 +CPU= 22.981
  17:04:35 STEP 2555 H=2555:00 +CPU= 22.192
  17:05:15 STEP 2556 H=2556:00 +CPU= 39.737
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002556
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002556
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002556
  17:05:38 STEP 2557 H=2557:00 +CPU= 22.691
  17:06:01 STEP 2558 H=2558:00 +CPU= 23.397
  17:06:38 STEP 2559 H=2559:00 +CPU= 36.372
  17:07:01 STEP 2560 H=2560:00 +CPU= 23.301
  17:07:23 STEP 2561 H=2561:00 +CPU= 22.238
  17:08:00 STEP 2562 H=2562:00 +CPU= 36.391
  17:08:22 STEP 2563 H=2563:00 +CPU= 22.325
  17:08:46 STEP 2564 H=2564:00 +CPU= 23.270
  17:09:21 STEP 2565 H=2565:00 +CPU= 35.437
  17:09:44 STEP 2566 H=2566:00 +CPU= 23.050
  17:10:08 STEP 2567 H=2567:00 +CPU= 22.868
  17:10:50 STEP 2568 H=2568:00 +CPU= 42.317
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002568
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002568
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMGGhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMSHhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMUAhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMGGhq0f+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMSHhq0f+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMUAhq0f+002556
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0978_2020050100_123_989_12206622_1_r2032690931_106.zip
Uploading the intermediate file: upload_file_106.zip
  17:11:13 STEP 2569 H=2569:00 +CPU= 22.098
  17:11:36 STEP 2570 H=2570:00 +CPU= 23.162
  17:12:12 STEP 2571 H=2571:00 +CPU= 35.973
  17:12:36 STEP 2572 H=2572:00 +CPU= 23.799
  17:12:59 STEP 2573 H=2573:00 +CPU= 22.901
  17:13:36 STEP 2574 H=2574:00 +CPU= 36.399
  17:13:59 STEP 2575 H=2575:00 +CPU= 22.736
  17:14:22 STEP 2576 H=2576:00 +CPU= 23.315
  17:14:58 STEP 2577 H=2577:00 +CPU= 34.911
  17:15:22 STEP 2578 H=2578:00 +CPU= 23.870
  17:15:45 STEP 2579 H=2579:00 +CPU= 22.390
  17:16:27 STEP 2580 H=2580:00 +CPU= 40.977
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002580
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002580
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002580
  17:16:49 STEP 2581 H=2581:00 +CPU= 22.144
  17:17:12 STEP 2582 H=2582:00 +CPU= 22.764
  17:17:48 STEP 2583 H=2583:00 +CPU= 35.917
  17:18:11 STEP 2584 H=2584:00 +CPU= 23.088
  17:18:33 STEP 2585 H=2585:00 +CPU= 21.997
  17:19:09 STEP 2586 H=2586:00 +CPU= 35.709
  17:19:32 STEP 2587 H=2587:00 +CPU= 22.335
  17:19:55 STEP 2588 H=2588:00 +CPU= 23.034
  17:20:30 STEP 2589 H=2589:00 +CPU= 35.711
  17:20:54 STEP 2590 H=2590:00 +CPU= 23.512
  17:21:18 STEP 2591 H=2591:00 +CPU= 24.051
  17:22:01 STEP 2592 H=2592:00 +CPU= 42.469
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002592
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002592
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMGGhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMSHhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMUAhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMGGhq0f+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMSHhq0f+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMUAhq0f+002580
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0978_2020050100_123_989_12206622_1_r2032690931_107.zip
Uploading the intermediate file: upload_file_107.zip
  17:22:24 STEP 2593 H=2593:00 +CPU= 23.065
  17:22:48 STEP 2594 H=2594:00 +CPU= 23.522
  17:23:24 STEP 2595 H=2595:00 +CPU= 35.358
  17:23:47 STEP 2596 H=2596:00 +CPU= 22.962
  17:24:11 STEP 2597 H=2597:00 +CPU= 23.254
  17:24:46 STEP 2598 H=2598:00 +CPU= 34.951
  17:25:08 STEP 2599 H=2599:00 +CPU= 22.461
  17:25:31 STEP 2600 H=2600:00 +CPU= 23.219
  17:26:05 STEP 2601 H=2601:00 +CPU= 33.922
  17:26:28 STEP 2602 H=2602:00 +CPU= 22.853
  17:26:50 STEP 2603 H=2603:00 +CPU= 21.872
  17:27:29 STEP 2604 H=2604:00 +CPU= 38.824
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002604
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002604
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002604
  17:27:51 STEP 2605 H=2605:00 +CPU= 21.859
  17:28:14 STEP 2606 H=2606:00 +CPU= 23.055
  17:28:50 STEP 2607 H=2607:00 +CPU= 35.180
  17:29:12 STEP 2608 H=2608:00 +CPU= 22.535
  17:29:34 STEP 2609 H=2609:00 +CPU= 21.851
  17:30:09 STEP 2610 H=2610:00 +CPU= 34.771
  17:30:31 STEP 2611 H=2611:00 +CPU= 21.601
  17:30:54 STEP 2612 H=2612:00 +CPU= 22.717
  17:31:28 STEP 2613 H=2613:00 +CPU= 34.030
  17:31:51 STEP 2614 H=2614:00 +CPU= 22.667
  17:32:14 STEP 2615 H=2615:00 +CPU= 22.908
  17:32:56 STEP 2616 H=2616:00 +CPU= 42.189
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002616
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002616
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMGGhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMSHhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMUAhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMGGhq0f+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMSHhq0f+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMUAhq0f+002604
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0978_2020050100_123_989_12206622_1_r2032690931_108.zip
Uploading the intermediate file: upload_file_108.zip
  17:33:18 STEP 2617 H=2617:00 +CPU= 21.925
  17:33:41 STEP 2618 H=2618:00 +CPU= 22.463
  17:34:16 STEP 2619 H=2619:00 +CPU= 34.194
  17:34:39 STEP 2620 H=2620:00 +CPU= 22.473
  17:35:01 STEP 2621 H=2621:00 +CPU= 22.343
  17:35:36 STEP 2622 H=2622:00 +CPU= 34.916
  17:35:58 STEP 2623 H=2623:00 +CPU= 22.298
  17:36:21 STEP 2624 H=2624:00 +CPU= 22.712
  17:36:56 STEP 2625 H=2625:00 +CPU= 34.718
  17:37:18 STEP 2626 H=2626:00 +CPU= 22.172
  17:37:40 STEP 2627 H=2627:00 +CPU= 21.754
  17:38:19 STEP 2628 H=2628:00 +CPU= 37.938
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002628
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002628
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002628
  17:38:41 STEP 2629 H=2629:00 +CPU= 22.213
  17:39:04 STEP 2630 H=2630:00 +CPU= 22.745
  17:39:38 STEP 2631 H=2631:00 +CPU= 34.447
  17:40:01 STEP 2632 H=2632:00 +CPU= 22.765
  17:40:23 STEP 2633 H=2633:00 +CPU= 22.246
  17:40:58 STEP 2634 H=2634:00 +CPU= 35.075
  17:41:21 STEP 2635 H=2635:00 +CPU= 22.041
  17:41:43 STEP 2636 H=2636:00 +CPU= 22.532
  17:42:18 STEP 2637 H=2637:00 +CPU= 34.531
  17:42:41 STEP 2638 H=2638:00 +CPU= 22.222
  17:43:03 STEP 2639 H=2639:00 +CPU= 22.248
  17:43:45 STEP 2640 H=2640:00 +CPU= 41.321
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002640
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002640
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMGGhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMSHhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMUAhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMGGhq0f+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMSHhq0f+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMUAhq0f+002628
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0978_2020050100_123_989_12206622_1_r2032690931_109.zip
Uploading the intermediate file: upload_file_109.zip
  17:44:07 STEP 2641 H=2641:00 +CPU= 22.087
Uploading trickle at timestep: 9504000
  17:44:30 STEP 2642 H=2642:00 +CPU= 22.575
  17:45:04 STEP 2643 H=2643:00 +CPU= 34.058
  17:45:27 STEP 2644 H=2644:00 +CPU= 22.561
  17:45:49 STEP 2645 H=2645:00 +CPU= 22.213
  17:46:24 STEP 2646 H=2646:00 +CPU= 35.001
  17:46:46 STEP 2647 H=2647:00 +CPU= 21.766
  17:47:08 STEP 2648 H=2648:00 +CPU= 22.446
  17:47:43 STEP 2649 H=2649:00 +CPU= 34.861
  17:48:07 STEP 2650 H=2650:00 +CPU= 23.520
  17:48:29 STEP 2651 H=2651:00 +CPU= 22.157
  17:49:08 STEP 2652 H=2652:00 +CPU= 38.780
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002652
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002652
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002652
  17:49:30 STEP 2653 H=2653:00 +CPU= 21.950
  17:49:53 STEP 2654 H=2654:00 +CPU= 22.787
  17:50:28 STEP 2655 H=2655:00 +CPU= 34.726
  17:50:52 STEP 2656 H=2656:00 +CPU= 23.979
  17:51:15 STEP 2657 H=2657:00 +CPU= 22.607
  17:51:51 STEP 2658 H=2658:00 +CPU= 35.856
  17:52:14 STEP 2659 H=2659:00 +CPU= 22.853
  17:52:37 STEP 2660 H=2660:00 +CPU= 23.115
  17:53:12 STEP 2661 H=2661:00 +CPU= 35.559
  17:53:36 STEP 2662 H=2662:00 +CPU= 23.694
  17:54:00 STEP 2663 H=2663:00 +CPU= 23.324
  17:54:42 STEP 2664 H=2664:00 +CPU= 42.155
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002664
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002664
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMGGhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMSHhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMUAhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMGGhq0f+002652
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMSHhq0f+002652
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMUAhq0f+002652
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0978_2020050100_123_989_12206622_1_r2032690931_110.zip
Uploading the intermediate file: upload_file_110.zip
  17:55:04 STEP 2665 H=2665:00 +CPU= 21.716
  17:55:26 STEP 2666 H=2666:00 +CPU= 22.707
  17:56:01 STEP 2667 H=2667:00 +CPU= 34.955
  17:56:25 STEP 2668 H=2668:00 +CPU= 23.195
  17:56:47 STEP 2669 H=2669:00 +CPU= 22.665
  17:57:23 STEP 2670 H=2670:00 +CPU= 35.218
  17:57:44 STEP 2671 H=2671:00 +CPU= 21.499
  17:58:07 STEP 2672 H=2672:00 +CPU= 22.388
  17:58:42 STEP 2673 H=2673:00 +CPU= 34.765
  17:59:05 STEP 2674 H=2674:00 +CPU= 22.871
  17:59:27 STEP 2675 H=2675:00 +CPU= 22.232
  18:00:06 STEP 2676 H=2676:00 +CPU= 38.848
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002676
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002676
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002676
  18:00:28 STEP 2677 H=2677:00 +CPU= 22.027
  18:00:52 STEP 2678 H=2678:00 +CPU= 23.441
  18:01:27 STEP 2679 H=2679:00 +CPU= 34.739
  18:01:50 STEP 2680 H=2680:00 +CPU= 23.202
  18:02:13 STEP 2681 H=2681:00 +CPU= 22.485
  18:02:48 STEP 2682 H=2682:00 +CPU= 35.248
  18:03:10 STEP 2683 H=2683:00 +CPU= 21.770
  18:03:33 STEP 2684 H=2684:00 +CPU= 22.793
  18:04:08 STEP 2685 H=2685:00 +CPU= 35.042
  18:04:31 STEP 2686 H=2686:00 +CPU= 22.838
  18:04:54 STEP 2687 H=2687:00 +CPU= 23.006
  18:05:36 STEP 2688 H=2688:00 +CPU= 42.171
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002688
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002688
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMGGhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMSHhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMUAhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMGGhq0f+002676
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMSHhq0f+002676
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMUAhq0f+002676
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0978_2020050100_123_989_12206622_1_r2032690931_111.zip
Uploading the intermediate file: upload_file_111.zip
  18:05:59 STEP 2689 H=2689:00 +CPU= 22.437
  18:06:22 STEP 2690 H=2690:00 +CPU= 22.881
  18:06:58 STEP 2691 H=2691:00 +CPU= 35.454
  18:07:21 STEP 2692 H=2692:00 +CPU= 22.945
  18:07:43 STEP 2693 H=2693:00 +CPU= 22.036
  18:08:19 STEP 2694 H=2694:00 +CPU= 35.815
  18:08:41 STEP 2695 H=2695:00 +CPU= 22.112
  18:09:04 STEP 2696 H=2696:00 +CPU= 22.983
  18:09:40 STEP 2697 H=2697:00 +CPU= 35.444
  18:10:03 STEP 2698 H=2698:00 +CPU= 23.007
  18:10:25 STEP 2699 H=2699:00 +CPU= 22.345
  18:11:05 STEP 2700 H=2700:00 +CPU= 39.867
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002700
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002700
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002700
  18:11:28 STEP 2701 H=2701:00 +CPU= 22.242
  18:11:51 STEP 2702 H=2702:00 +CPU= 23.023
  18:12:26 STEP 2703 H=2703:00 +CPU= 35.084
  18:12:50 STEP 2704 H=2704:00 +CPU= 23.813
  18:13:12 STEP 2705 H=2705:00 +CPU= 22.147
  18:13:47 STEP 2706 H=2706:00 +CPU= 35.069
  18:14:09 STEP 2707 H=2707:00 +CPU= 22.206
  18:14:33 STEP 2708 H=2708:00 +CPU= 23.167
  18:15:08 STEP 2709 H=2709:00 +CPU= 35.181
  18:15:31 STEP 2710 H=2710:00 +CPU= 22.523
  18:15:54 STEP 2711 H=2711:00 +CPU= 22.787
  18:16:35 STEP 2712 H=2712:00 +CPU= 41.142
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002712
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002712
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMGGhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMSHhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMUAhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMGGhq0f+002700
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMSHhq0f+002700
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMUAhq0f+002700
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0978_2020050100_123_989_12206622_1_r2032690931_112.zip
Uploading the intermediate file: upload_file_112.zip
  18:16:57 STEP 2713 H=2713:00 +CPU= 21.774
  18:17:20 STEP 2714 H=2714:00 +CPU= 23.030
  18:17:55 STEP 2715 H=2715:00 +CPU= 34.378
  18:18:18 STEP 2716 H=2716:00 +CPU= 22.627
  18:18:39 STEP 2717 H=2717:00 +CPU= 21.800
  18:19:15 STEP 2718 H=2718:00 +CPU= 35.396
  18:19:37 STEP 2719 H=2719:00 +CPU= 22.112
  18:20:00 STEP 2720 H=2720:00 +CPU= 22.554
  18:20:34 STEP 2721 H=2721:00 +CPU= 34.224
  18:20:57 STEP 2722 H=2722:00 +CPU= 22.840
  18:21:19 STEP 2723 H=2723:00 +CPU= 21.804
  18:21:59 STEP 2724 H=2724:00 +CPU= 39.544
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002724
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002724
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002724
  18:22:21 STEP 2725 H=2725:00 +CPU= 22.525
  18:22:45 STEP 2726 H=2726:00 +CPU= 23.677
  18:23:20 STEP 2727 H=2727:00 +CPU= 35.308
  18:23:43 STEP 2728 H=2728:00 +CPU= 22.888
  18:24:06 STEP 2729 H=2729:00 +CPU= 22.201
  18:24:42 STEP 2730 H=2730:00 +CPU= 36.112
  18:25:04 STEP 2731 H=2731:00 +CPU= 22.455
  18:25:27 STEP 2732 H=2732:00 +CPU= 23.066
  18:26:02 STEP 2733 H=2733:00 +CPU= 35.077
  18:26:26 STEP 2734 H=2734:00 +CPU= 23.567
  18:26:49 STEP 2735 H=2735:00 +CPU= 23.039
  18:27:32 STEP 2736 H=2736:00 +CPU= 42.087
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002736
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002736
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMGGhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMSHhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMUAhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMGGhq0f+002724
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMSHhq0f+002724
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMUAhq0f+002724
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0978_2020050100_123_989_12206622_1_r2032690931_113.zip
Uploading the intermediate file: upload_file_113.zip
  18:27:54 STEP 2737 H=2737:00 +CPU= 22.182
  18:28:17 STEP 2738 H=2738:00 +CPU= 23.019
  18:28:52 STEP 2739 H=2739:00 +CPU= 34.902
  18:29:15 STEP 2740 H=2740:00 +CPU= 22.913
  18:29:37 STEP 2741 H=2741:00 +CPU= 21.820
  18:30:13 STEP 2742 H=2742:00 +CPU= 35.323
  18:30:35 STEP 2743 H=2743:00 +CPU= 22.520
  18:30:58 STEP 2744 H=2744:00 +CPU= 22.479
  18:31:32 STEP 2745 H=2745:00 +CPU= 34.126
  18:31:55 STEP 2746 H=2746:00 +CPU= 23.234
  18:32:18 STEP 2747 H=2747:00 +CPU= 22.641
  18:32:58 STEP 2748 H=2748:00 +CPU= 39.151
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002748
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002748
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002748
  18:33:19 STEP 2749 H=2749:00 +CPU= 21.929
  18:33:43 STEP 2750 H=2750:00 +CPU= 23.176
  18:34:18 STEP 2751 H=2751:00 +CPU= 34.818
  18:34:41 STEP 2752 H=2752:00 +CPU= 22.826
  18:35:03 STEP 2753 H=2753:00 +CPU= 22.400
  18:35:38 STEP 2754 H=2754:00 +CPU= 35.056
  18:36:00 STEP 2755 H=2755:00 +CPU= 21.715
  18:36:22 STEP 2756 H=2756:00 +CPU= 22.532
  18:36:57 STEP 2757 H=2757:00 +CPU= 34.286
  18:37:20 STEP 2758 H=2758:00 +CPU= 22.688
  18:37:43 STEP 2759 H=2759:00 +CPU= 22.959
  18:38:26 STEP 2760 H=2760:00 +CPU= 42.169
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002760
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002760
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMGGhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMSHhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMUAhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMGGhq0f+002748
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMSHhq0f+002748
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMUAhq0f+002748
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0978_2020050100_123_989_12206622_1_r2032690931_114.zip
Uploading the intermediate file: upload_file_114.zip
  18:38:49 STEP 2761 H=2761:00 +CPU= 22.840
  18:39:11 STEP 2762 H=2762:00 +CPU= 22.672
  18:39:46 STEP 2763 H=2763:00 +CPU= 34.553
  18:40:08 STEP 2764 H=2764:00 +CPU= 22.400
  18:40:31 STEP 2765 H=2765:00 +CPU= 22.920
  18:41:08 STEP 2766 H=2766:00 +CPU= 36.115
  18:41:30 STEP 2767 H=2767:00 +CPU= 22.172
  18:41:53 STEP 2768 H=2768:00 +CPU= 22.699
  18:42:27 STEP 2769 H=2769:00 +CPU= 34.288
  18:42:50 STEP 2770 H=2770:00 +CPU= 22.599
  18:43:12 STEP 2771 H=2771:00 +CPU= 21.998
  18:43:51 STEP 2772 H=2772:00 +CPU= 38.229
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002772
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002772
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002772
  18:44:13 STEP 2773 H=2773:00 +CPU= 22.330
  18:44:35 STEP 2774 H=2774:00 +CPU= 22.360
  18:45:10 STEP 2775 H=2775:00 +CPU= 34.363
  18:45:33 STEP 2776 H=2776:00 +CPU= 23.005
  18:45:56 STEP 2777 H=2777:00 +CPU= 22.890
  18:46:31 STEP 2778 H=2778:00 +CPU= 35.510
  18:46:54 STEP 2779 H=2779:00 +CPU= 21.990
  18:47:16 STEP 2780 H=2780:00 +CPU= 22.770
  18:47:51 STEP 2781 H=2781:00 +CPU= 34.573
  18:48:14 STEP 2782 H=2782:00 +CPU= 22.533
  18:48:36 STEP 2783 H=2783:00 +CPU= 22.682
  18:49:18 STEP 2784 H=2784:00 +CPU= 41.421
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002784
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002784
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMGGhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMSHhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMUAhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMGGhq0f+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMSHhq0f+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMUAhq0f+002772
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0978_2020050100_123_989_12206622_1_r2032690931_115.zip
Uploading the intermediate file: upload_file_115.zip
  18:49:40 STEP 2785 H=2785:00 +CPU= 22.104
  18:50:03 STEP 2786 H=2786:00 +CPU= 22.877
  18:50:39 STEP 2787 H=2787:00 +CPU= 35.515
  18:51:02 STEP 2788 H=2788:00 +CPU= 22.489
  18:51:24 STEP 2789 H=2789:00 +CPU= 22.149
  18:52:00 STEP 2790 H=2790:00 +CPU= 35.943
  18:52:22 STEP 2791 H=2791:00 +CPU= 22.389
  18:52:46 STEP 2792 H=2792:00 +CPU= 23.098
  18:53:22 STEP 2793 H=2793:00 +CPU= 35.864
  18:53:45 STEP 2794 H=2794:00 +CPU= 23.487
  18:54:08 STEP 2795 H=2795:00 +CPU= 22.511
  18:54:47 STEP 2796 H=2796:00 +CPU= 38.865
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002796
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002796
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002796
  18:55:10 STEP 2797 H=2797:00 +CPU= 22.329
  18:55:33 STEP 2798 H=2798:00 +CPU= 23.010
  18:56:08 STEP 2799 H=2799:00 +CPU= 35.130
  18:56:31 STEP 2800 H=2800:00 +CPU= 23.237
  18:56:53 STEP 2801 H=2801:00 +CPU= 21.845
  18:57:29 STEP 2802 H=2802:00 +CPU= 35.909
  18:57:51 STEP 2803 H=2803:00 +CPU= 21.951
  18:58:15 STEP 2804 H=2804:00 +CPU= 23.519
  18:58:51 STEP 2805 H=2805:00 +CPU= 36.035
  18:59:14 STEP 2806 H=2806:00 +CPU= 22.753
  18:59:37 STEP 2807 H=2807:00 +CPU= 23.070
  19:00:19 STEP 2808 H=2808:00 +CPU= 41.819
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002808
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002808
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMGGhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMSHhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMUAhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMGGhq0f+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMSHhq0f+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMUAhq0f+002796
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0978_2020050100_123_989_12206622_1_r2032690931_116.zip
Uploading the intermediate file: upload_file_116.zip
  19:00:41 STEP 2809 H=2809:00 +CPU= 21.895
  19:01:03 STEP 2810 H=2810:00 +CPU= 22.443
  19:01:39 STEP 2811 H=2811:00 +CPU= 35.405
  19:02:02 STEP 2812 H=2812:00 +CPU= 22.780
  19:02:24 STEP 2813 H=2813:00 +CPU= 21.851
  19:02:59 STEP 2814 H=2814:00 +CPU= 34.973
  19:03:21 STEP 2815 H=2815:00 +CPU= 21.701
  19:03:43 STEP 2816 H=2816:00 +CPU= 22.366
  19:04:18 STEP 2817 H=2817:00 +CPU= 35.154
  19:04:42 STEP 2818 H=2818:00 +CPU= 23.742
  19:05:05 STEP 2819 H=2819:00 +CPU= 22.533
  19:05:44 STEP 2820 H=2820:00 +CPU= 39.151
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002820
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002820
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002820
  19:06:06 STEP 2821 H=2821:00 +CPU= 22.291
  19:06:29 STEP 2822 H=2822:00 +CPU= 22.871
  19:07:03 STEP 2823 H=2823:00 +CPU= 34.277
  19:07:26 STEP 2824 H=2824:00 +CPU= 22.480
  19:07:47 STEP 2825 H=2825:00 +CPU= 21.686
  19:08:23 STEP 2826 H=2826:00 +CPU= 35.009
  19:08:45 STEP 2827 H=2827:00 +CPU= 22.120
  19:09:08 STEP 2828 H=2828:00 +CPU= 22.690
  19:09:42 STEP 2829 H=2829:00 +CPU= 34.557
  19:10:05 STEP 2830 H=2830:00 +CPU= 23.083
  19:10:28 STEP 2831 H=2831:00 +CPU= 22.627
  19:11:09 STEP 2832 H=2832:00 +CPU= 40.908
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002832
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002832
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMGGhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMSHhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMUAhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMGGhq0f+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMSHhq0f+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMUAhq0f+002820
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0978_2020050100_123_989_12206622_1_r2032690931_117.zip
Uploading the intermediate file: upload_file_117.zip
  19:11:31 STEP 2833 H=2833:00 +CPU= 21.678
  19:11:54 STEP 2834 H=2834:00 +CPU= 22.697
  19:12:29 STEP 2835 H=2835:00 +CPU= 35.056
  19:12:52 STEP 2836 H=2836:00 +CPU= 22.436
  19:13:14 STEP 2837 H=2837:00 +CPU= 21.795
  19:13:49 STEP 2838 H=2838:00 +CPU= 35.070
  19:14:11 STEP 2839 H=2839:00 +CPU= 21.848
  19:14:33 STEP 2840 H=2840:00 +CPU= 22.358
  19:15:07 STEP 2841 H=2841:00 +CPU= 33.556
  19:15:29 STEP 2842 H=2842:00 +CPU= 21.913
  19:15:50 STEP 2843 H=2843:00 +CPU= 21.496
  19:16:28 STEP 2844 H=2844:00 +CPU= 37.117
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002844
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002844
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002844
  19:16:49 STEP 2845 H=2845:00 +CPU= 21.352
  19:17:11 STEP 2846 H=2846:00 +CPU= 21.828
  19:17:45 STEP 2847 H=2847:00 +CPU= 33.453
  19:18:07 STEP 2848 H=2848:00 +CPU= 22.092
  19:18:28 STEP 2849 H=2849:00 +CPU= 21.160
  19:19:02 STEP 2850 H=2850:00 +CPU= 34.458
  19:19:24 STEP 2851 H=2851:00 +CPU= 21.357
  19:19:46 STEP 2852 H=2852:00 +CPU= 21.821
  19:20:20 STEP 2853 H=2853:00 +CPU= 34.190
  19:20:43 STEP 2854 H=2854:00 +CPU= 22.500
  19:21:05 STEP 2855 H=2855:00 +CPU= 22.209
  19:21:46 STEP 2856 H=2856:00 +CPU= 40.879
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002856
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002856
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMGGhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMSHhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMUAhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMGGhq0f+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMSHhq0f+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMUAhq0f+002844
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0978_2020050100_123_989_12206622_1_r2032690931_118.zip
Uploading the intermediate file: upload_file_118.zip
  19:22:08 STEP 2857 H=2857:00 +CPU= 22.048
  19:22:31 STEP 2858 H=2858:00 +CPU= 22.481
  19:23:05 STEP 2859 H=2859:00 +CPU= 33.765
  19:23:27 STEP 2860 H=2860:00 +CPU= 22.349
  19:23:49 STEP 2861 H=2861:00 +CPU= 21.769
  19:24:24 STEP 2862 H=2862:00 +CPU= 34.747
  19:24:46 STEP 2863 H=2863:00 +CPU= 21.436
  19:25:08 STEP 2864 H=2864:00 +CPU= 22.024
  19:25:42 STEP 2865 H=2865:00 +CPU= 33.939
  19:26:04 STEP 2866 H=2866:00 +CPU= 22.615
  19:26:26 STEP 2867 H=2867:00 +CPU= 21.911
  19:27:05 STEP 2868 H=2868:00 +CPU= 38.754
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002868
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002868
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002868
  19:27:27 STEP 2869 H=2869:00 +CPU= 21.515
  19:27:49 STEP 2870 H=2870:00 +CPU= 22.321
  19:28:24 STEP 2871 H=2871:00 +CPU= 34.502
  19:28:46 STEP 2872 H=2872:00 +CPU= 22.461
  19:29:09 STEP 2873 H=2873:00 +CPU= 22.191
  19:29:43 STEP 2874 H=2874:00 +CPU= 34.773
  19:30:05 STEP 2875 H=2875:00 +CPU= 21.911
  19:30:28 STEP 2876 H=2876:00 +CPU= 22.528
  19:31:02 STEP 2877 H=2877:00 +CPU= 34.138
  19:31:25 STEP 2878 H=2878:00 +CPU= 22.488
  19:31:47 STEP 2879 H=2879:00 +CPU= 22.473
  19:32:28 STEP 2880 H=2880:00 +CPU= 41.002
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002880
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002880
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMGGhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMSHhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMUAhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMGGhq0f+002868
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMSHhq0f+002868
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMUAhq0f+002868
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0978_2020050100_123_989_12206622_1_r2032690931_119.zip
Uploading the intermediate file: upload_file_119.zip
  19:32:50 STEP 2881 H=2881:00 +CPU= 21.421
Uploading trickle at timestep: 10368000
  19:33:12 STEP 2882 H=2882:00 +CPU= 22.128
  19:33:47 STEP 2883 H=2883:00 +CPU= 35.105
  19:34:10 STEP 2884 H=2884:00 +CPU= 23.073
  19:34:32 STEP 2885 H=2885:00 +CPU= 21.752
  19:35:07 STEP 2886 H=2886:00 +CPU= 35.156
  19:35:29 STEP 2887 H=2887:00 +CPU= 21.925
  19:35:52 STEP 2888 H=2888:00 +CPU= 22.530
  19:36:27 STEP 2889 H=2889:00 +CPU= 34.588
  19:36:49 STEP 2890 H=2890:00 +CPU= 22.455
  19:37:11 STEP 2891 H=2891:00 +CPU= 21.739
  19:37:49 STEP 2892 H=2892:00 +CPU= 38.085
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002892
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002892
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002892
  19:38:11 STEP 2893 H=2893:00 +CPU= 21.520
  19:38:33 STEP 2894 H=2894:00 +CPU= 22.177
  19:39:07 STEP 2895 H=2895:00 +CPU= 34.170
  19:39:30 STEP 2896 H=2896:00 +CPU= 22.148
  19:39:51 STEP 2897 H=2897:00 +CPU= 21.284
  19:40:26 STEP 2898 H=2898:00 +CPU= 35.182
  19:40:48 STEP 2899 H=2899:00 +CPU= 21.733
  19:41:11 STEP 2900 H=2900:00 +CPU= 22.571
  19:41:45 STEP 2901 H=2901:00 +CPU= 34.569
  19:42:08 STEP 2902 H=2902:00 +CPU= 22.474
  19:42:30 STEP 2903 H=2903:00 +CPU= 22.212
  19:43:12 STEP 2904 H=2904:00 +CPU= 41.111
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002904
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002904
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMGGhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMSHhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMUAhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMGGhq0f+002892
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMSHhq0f+002892
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMUAhq0f+002892
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0978_2020050100_123_989_12206622_1_r2032690931_120.zip
Uploading the intermediate file: upload_file_120.zip
  19:43:34 STEP 2905 H=2905:00 +CPU= 21.590
  19:43:57 STEP 2906 H=2906:00 +CPU= 22.330
  19:44:31 STEP 2907 H=2907:00 +CPU= 33.970
  19:44:53 STEP 2908 H=2908:00 +CPU= 22.206
  19:45:14 STEP 2909 H=2909:00 +CPU= 21.510
  19:45:49 STEP 2910 H=2910:00 +CPU= 34.551
  19:46:11 STEP 2911 H=2911:00 +CPU= 21.728
  19:46:33 STEP 2912 H=2912:00 +CPU= 22.557
  19:47:08 STEP 2913 H=2913:00 +CPU= 34.377
  19:47:31 STEP 2914 H=2914:00 +CPU= 22.585
  19:47:52 STEP 2915 H=2915:00 +CPU= 21.796
  19:48:31 STEP 2916 H=2916:00 +CPU= 37.995
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002916
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002916
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002916
  19:48:52 STEP 2917 H=2917:00 +CPU= 21.721
  19:49:15 STEP 2918 H=2918:00 +CPU= 22.382
  19:49:49 STEP 2919 H=2919:00 +CPU= 34.314
  19:50:11 STEP 2920 H=2920:00 +CPU= 22.047
  19:50:33 STEP 2921 H=2921:00 +CPU= 21.405
  19:51:08 STEP 2922 H=2922:00 +CPU= 35.013
  19:51:29 STEP 2923 H=2923:00 +CPU= 21.508
  19:51:52 STEP 2924 H=2924:00 +CPU= 22.255
  19:52:25 STEP 2925 H=2925:00 +CPU= 33.833
  19:52:48 STEP 2926 H=2926:00 +CPU= 22.435
  19:53:10 STEP 2927 H=2927:00 +CPU= 22.462
  19:53:52 STEP 2928 H=2928:00 +CPU= 41.234
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002928
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002928
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMGGhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMSHhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMUAhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMGGhq0f+002916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMSHhq0f+002916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMUAhq0f+002916
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0978_2020050100_123_989_12206622_1_r2032690931_121.zip
Uploading the intermediate file: upload_file_121.zip
  19:54:14 STEP 2929 H=2929:00 +CPU= 21.649
  19:54:36 STEP 2930 H=2930:00 +CPU= 22.632
  19:55:10 STEP 2931 H=2931:00 +CPU= 33.933
  19:55:32 STEP 2932 H=2932:00 +CPU= 22.091
  19:55:54 STEP 2933 H=2933:00 +CPU= 21.347
  19:56:28 STEP 2934 H=2934:00 +CPU= 34.330
  19:56:50 STEP 2935 H=2935:00 +CPU= 21.883
  19:57:12 STEP 2936 H=2936:00 +CPU= 22.322
  19:57:46 STEP 2937 H=2937:00 +CPU= 33.872
  19:58:09 STEP 2938 H=2938:00 +CPU= 22.564
  19:58:31 STEP 2939 H=2939:00 +CPU= 21.721
  19:59:09 STEP 2940 H=2940:00 +CPU= 37.640
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002940
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002940
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002940
  19:59:30 STEP 2941 H=2941:00 +CPU= 21.479
  19:59:53 STEP 2942 H=2942:00 +CPU= 22.204
  20:00:26 STEP 2943 H=2943:00 +CPU= 33.558
  20:00:48 STEP 2944 H=2944:00 +CPU= 22.146
  20:01:10 STEP 2945 H=2945:00 +CPU= 21.832
  20:01:45 STEP 2946 H=2946:00 +CPU= 34.674
  20:02:07 STEP 2947 H=2947:00 +CPU= 21.381
  20:02:29 STEP 2948 H=2948:00 +CPU= 21.999
  20:03:02 STEP 2949 H=2949:00 +CPU= 33.403
  20:03:26 STEP 2950 H=2950:00 +CPU= 22.394
Quit request received from BOINC client, ending the child process
..Failed, model did not complete successfully
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2020050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0978
(argv4) batchid: 989
(argv5) wuid: 12206622
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/10
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/10/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/10/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_e357efc7b61645ed9cdb73617d3a3197 to: /var/lib/boinc-client/slots/10/oifs_43r3_ps_0978_2020050100_123_989_12206622.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/10/oifs_43r3_ps_0978_2020050100_123_989_12206622.zip
ic_ancil_file: ic_ancil_12206622
ifsdata_file: ifsdata_12206622
climate_data_file: clim_data_12206622
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_0a4d1ccdd466eeec47916e5558c67c3d to: /var/lib/boinc-client/slots/10/ic_ancil_12206622.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/10/ic_ancil_12206622.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_202867fbd1739adbd42f11c3e3e49769 to: /var/lib/boinc-client/slots/10/ifsdata/ifsdata_12206622.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/10/ifsdata/ifsdata_12206622.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/10/159l_2/clim_data_12206622.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/10/159l_2/clim_data_12206622.zip
Checking for progress XML file: /var/lib/boinc-client/slots/10/progress_file_12206622.xml
Opened progress file ok : /var/lib/boinc-client/slots/10/progress_file_12206622.xml
-- Model is restarting --
Adjusting last_iter, 2950, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/10/progress_file_12206622.xml
last_cpu_time: 83117
upload_file_number: 122
last_iter: 2927
last_upload: 10540800
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0978_2020050100_123_989_12206622_1_r2032690931
The child process has been launched with process id: 946010
Executing the command: /var/lib/boinc-client/slots/10/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:UbuntuStick:1:1:946010:946010] [20230124:200526:1674619526:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:UbuntuStick:1:1:946010:946010] [20230124:200526:1674619526:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:UbuntuStick:1:1:946010:946010] [20230124:200526:1674619526:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:UbuntuStick:1:1:946010:946010] [20230124:200526:1674619526:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:UbuntuStick:1:1:946010:946010] [20230124:200526:1674619526:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:UbuntuStick:1:1:946010:946010] [20230124:200526:1674619526:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:UbuntuStick:1:1:946010:946010] [20230124:200526:1674619526:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:UbuntuStick:1:1:946010:946010] [20230124:200526:1674619526:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:UbuntuStick:1:1:946010:946010] [20230124:200526:1674619526:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:UbuntuStick:1:1:946010:946010] [20230124:200526:1674619526:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:UbuntuStick:1:1:946010:946010] [20230124:200526:1674619526:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:UbuntuStick:1:1:946010:946010] [20230124:200526:1674619526:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:UbuntuStick:1:1:946010:946010] [20230124:200526:1674619526:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:UbuntuStick:1:1:946010:946010] [20230124:200526:1674619526:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:UbuntuStick:1:1:946010:946010] [20230124:200526:1674619526:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:UbuntuStick:1:1:946010:946010] [20230124:200526:1674619526:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:UbuntuStick:1:1:946010:946010] [20230124:200526:1674619526:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:UbuntuStick:1:1:946010:946010] [20230124:200526:1674619526:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:UbuntuStick:1:1:946010:946010] [20230124:200526:1674619526:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:UbuntuStick:1:1:946010:946010] [20230124:200526:1674619526:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:UbuntuStick:1:1:946010:946010] [20230124:200526:1674619526:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:UbuntuStick:1:1:946010:946010] [20230124:200526:1674619526:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:UbuntuStick:1:1:946010:946010] [20230124:200526:1674619526:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:UbuntuStick:1:1:946010:946010] [20230124:200526:1674619526:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:UbuntuStick:1:1:946010:946010] [20230124:200526:1674619526:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:UbuntuStick:1:1:946010:946010] [20230124:200526:1674619526:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:UbuntuStick:1:1:946010:946010] [20230124:200526:1674619526:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:UbuntuStick:1:1:946010:946010] [20230124:200526:1674619526:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:UbuntuStick:1:1:946010:946010] [20230124:200526:1674619526:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:UbuntuStick:1:1:946010:946010] [20230124:200526:1674619526:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  20:06:09 STEP 2928 H=2928:00 +CPU= 39.658
  20:06:32 STEP 2929 H=2929:00 +CPU= 22.186
  20:06:54 STEP 2930 H=2930:00 +CPU= 22.621
  20:07:28 STEP 2931 H=2931:00 +CPU= 33.890
  20:07:51 STEP 2932 H=2932:00 +CPU= 22.608
  20:08:12 STEP 2933 H=2933:00 +CPU= 21.463
  20:08:46 STEP 2934 H=2934:00 +CPU= 33.581
  20:09:07 STEP 2935 H=2935:00 +CPU= 21.039
  20:09:29 STEP 2936 H=2936:00 +CPU= 21.728
  20:10:02 STEP 2937 H=2937:00 +CPU= 32.981
  20:10:24 STEP 2938 H=2938:00 +CPU= 21.954
  20:10:46 STEP 2939 H=2939:00 +CPU= 21.927
  20:11:23 STEP 2940 H=2940:00 +CPU= 37.598
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002940
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002940
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002940
  20:11:45 STEP 2941 H=2941:00 +CPU= 21.554
  20:12:07 STEP 2942 H=2942:00 +CPU= 22.298
  20:12:41 STEP 2943 H=2943:00 +CPU= 33.776
  20:13:04 STEP 2944 H=2944:00 +CPU= 22.996
  20:13:26 STEP 2945 H=2945:00 +CPU= 21.900
  20:14:01 STEP 2946 H=2946:00 +CPU= 35.188
  20:14:23 STEP 2947 H=2947:00 +CPU= 21.862
  20:14:46 STEP 2948 H=2948:00 +CPU= 22.581
  20:15:20 STEP 2949 H=2949:00 +CPU= 34.324
  20:15:44 STEP 2950 H=2950:00 +CPU= 23.055
  20:16:06 STEP 2951 H=2951:00 +CPU= 22.737
  20:16:46 STEP 2952 H=2952:00 +CPU= 39.925
The child process terminated with status: 0
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002952
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002952
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMSHhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMUAhq0f+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMSHhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMSHhq0f+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMUAhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMUAhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMGGhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMGGhq0f+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12206622/ICMGGhq0f+002928
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0978_2020050100_123_989_12206622_1_r2032690931_122.zip
Uploading the final file: upload_file_122.zip
Uploading trickle at timestep: 10623600
20:20:10 (945996): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:40:14 1536304 22302690 oifs_43r3_ps_0978_2020050100_123_989_12206622_1 10,623,600 83,795 0.0079
09 May 2023 16:40:14 1536304 22302690 oifs_43r3_ps_0978_2020050100_123_989_12206622_1 10,623,600 83,795 0.0079
09 May 2023 16:40:14 1536304 22302690 oifs_43r3_ps_0978_2020050100_123_989_12206622_1 10,368,000 81,273 0.0078
09 May 2023 16:40:14 1536304 22302690 oifs_43r3_ps_0978_2020050100_123_989_12206622_1 10,368,000 81,273 0.0078
09 May 2023 16:40:08 1536304 22302690 oifs_43r3_ps_0978_2020050100_123_989_12206622_1 9,504,000 74,774 0.0079
09 May 2023 16:40:01 1536304 22302690 oifs_43r3_ps_0978_2020050100_123_989_12206622_1 8,640,000 68,165 0.0079
09 May 2023 16:40:01 1536304 22302690 oifs_43r3_ps_0978_2020050100_123_989_12206622_1 8,640,000 68,165 0.0079
09 May 2023 16:39:54 1536304 22302690 oifs_43r3_ps_0978_2020050100_123_989_12206622_1 7,776,000 61,464 0.0079
09 May 2023 16:39:47 1536304 22302690 oifs_43r3_ps_0978_2020050100_123_989_12206622_1 6,912,000 54,749 0.0079
09 May 2023 16:39:40 1536304 22302690 oifs_43r3_ps_0978_2020050100_123_989_12206622_1 6,048,000 48,156 0.0080
09 May 2023 16:39:40 1536304 22302690 oifs_43r3_ps_0978_2020050100_123_989_12206622_1 6,048,000 48,156 0.0080
09 May 2023 16:39:34 1536304 22302690 oifs_43r3_ps_0978_2020050100_123_989_12206622_1 5,184,000 41,573 0.0080
09 May 2023 16:39:34 1536304 22302690 oifs_43r3_ps_0978_2020050100_123_989_12206622_1 5,184,000 41,573 0.0080
09 May 2023 16:39:29 1536304 22302690 oifs_43r3_ps_0978_2020050100_123_989_12206622_1 4,320,000 35,072 0.0081
09 May 2023 16:39:29 1536304 22302690 oifs_43r3_ps_0978_2020050100_123_989_12206622_1 4,320,000 35,072 0.0081
09 May 2023 16:39:21 1536304 22302690 oifs_43r3_ps_0978_2020050100_123_989_12206622_1 3,456,000 28,253 0.0082
09 May 2023 16:39:21 1536304 22302690 oifs_43r3_ps_0978_2020050100_123_989_12206622_1 3,456,000 28,253 0.0082
09 May 2023 16:39:13 1536304 22302690 oifs_43r3_ps_0978_2020050100_123_989_12206622_1 2,592,000 21,270 0.0082
09 May 2023 16:39:13 1536304 22302690 oifs_43r3_ps_0978_2020050100_123_989_12206622_1 2,592,000 21,270 0.0082
09 May 2023 16:39:06 1536304 22302690 oifs_43r3_ps_0978_2020050100_123_989_12206622_1 1,728,000 14,462 0.0084


©2024 climateprediction.net