climateprediction.net home page
Task 22258824

Task 22258824

Name oifs_43r3_ps_0689_1981050100_123_950_12167333_1
Workunit 12167333
Created 21 Dec 2022, 14:14:21 UTC
Sent 21 Dec 2022, 14:15:04 UTC
Report deadline 20 Jan 2023, 14:15:04 UTC
Received 13 Jan 2023, 20:44:19 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1509575
Run time 23 hours 36 min 14 sec
CPU time 23 hours 16 min 38 sec
Validate state Valid
Credit 14,873.04
Device peak FLOPS 3.22 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,416.86 MB
Peak swap size 4,978.08 MB
Peak disk usage 2,179.62 MB
Stderr
<core_client_version>7.20.2</core_client_version>
<![CDATA[
<stderr_txt>
/lib/boinc-client/slots/0/ICMGGhq0f+002520
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002520
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMGGhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMSHhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMUAhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMGGhq0f+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMSHhq0f+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMUAhq0f+002508
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0689_1981050100_123_950_12167333_1_r1604022945_104.zip
Uploading the intermediate file: upload_file_104.zip
  17:08:45 STEP 2521 H=2521:00 +CPU= 17.727
  17:09:03 STEP 2522 H=2522:00 +CPU= 17.874
  17:09:31 STEP 2523 H=2523:00 +CPU= 27.481
  17:09:49 STEP 2524 H=2524:00 +CPU= 17.932
  17:10:06 STEP 2525 H=2525:00 +CPU= 17.423
  17:10:34 STEP 2526 H=2526:00 +CPU= 28.173
  17:10:52 STEP 2527 H=2527:00 +CPU= 17.398
  17:11:11 STEP 2528 H=2528:00 +CPU= 18.640
  17:11:39 STEP 2529 H=2529:00 +CPU= 28.460
  17:11:57 STEP 2530 H=2530:00 +CPU= 17.991
  17:12:15 STEP 2531 H=2531:00 +CPU= 18.141
  17:12:46 STEP 2532 H=2532:00 +CPU= 30.884
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002532
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002532
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002532
  17:13:04 STEP 2533 H=2533:00 +CPU= 17.542
  17:13:22 STEP 2534 H=2534:00 +CPU= 18.035
  17:13:50 STEP 2535 H=2535:00 +CPU= 27.915
  17:14:08 STEP 2536 H=2536:00 +CPU= 18.173
  17:14:26 STEP 2537 H=2537:00 +CPU= 17.820
  17:14:56 STEP 2538 H=2538:00 +CPU= 29.911
  17:15:20 STEP 2539 H=2539:00 +CPU= 23.963
  17:15:40 STEP 2540 H=2540:00 +CPU= 20.363
  17:16:08 STEP 2541 H=2541:00 +CPU= 27.612
  17:16:26 STEP 2542 H=2542:00 +CPU= 18.071
  17:16:44 STEP 2543 H=2543:00 +CPU= 18.075
  17:17:17 STEP 2544 H=2544:00 +CPU= 32.804
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002544
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002544
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMGGhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMSHhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMUAhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMGGhq0f+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMSHhq0f+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMUAhq0f+002532
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0689_1981050100_123_950_12167333_1_r1604022945_105.zip
Uploading the intermediate file: upload_file_105.zip
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:25:39 STEP 2545 H=2545:00 +CPU= 23.041
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:26:13 STEP 2546 H=2546:00 +CPU= 22.621
  20:26:41 STEP 2547 H=2547:00 +CPU= 27.891
  20:26:59 STEP 2548 H=2548:00 +CPU= 18.058
  20:27:19 STEP 2549 H=2549:00 +CPU= 19.907
  20:27:49 STEP 2550 H=2550:00 +CPU= 29.310
  20:28:08 STEP 2551 H=2551:00 +CPU= 19.351
  20:28:27 STEP 2552 H=2552:00 +CPU= 18.953
  20:28:56 STEP 2553 H=2553:00 +CPU= 28.995
  20:29:16 STEP 2554 H=2554:00 +CPU= 19.294
  20:29:39 STEP 2555 H=2555:00 +CPU= 23.483
  20:30:13 STEP 2556 H=2556:00 +CPU= 32.983
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002556
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002556
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002556
  20:30:31 STEP 2557 H=2557:00 +CPU= 18.657
  20:30:50 STEP 2558 H=2558:00 +CPU= 18.433
  20:31:18 STEP 2559 H=2559:00 +CPU= 28.053
  20:31:40 STEP 2560 H=2560:00 +CPU= 22.227
  20:32:01 STEP 2561 H=2561:00 +CPU= 20.132
  20:32:30 STEP 2562 H=2562:00 +CPU= 29.288
  20:32:50 STEP 2563 H=2563:00 +CPU= 19.595
  20:33:09 STEP 2564 H=2564:00 +CPU= 19.476
  20:33:43 STEP 2565 H=2565:00 +CPU= 33.034
  20:34:10 STEP 2566 H=2566:00 +CPU= 26.833
  20:34:37 STEP 2567 H=2567:00 +CPU= 27.065
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  10:49:10 STEP 2568 H=2568:00 +CPU= 47.068
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002568
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002568
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMGGhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMSHhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMUAhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMGGhq0f+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMSHhq0f+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMUAhq0f+002556
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0689_1981050100_123_950_12167333_1_r1604022945_106.zip
Uploading the intermediate file: upload_file_106.zip
  10:49:33 STEP 2569 H=2569:00 +CPU= 22.861
  10:49:56 STEP 2570 H=2570:00 +CPU= 23.140
  10:50:29 STEP 2571 H=2571:00 +CPU= 32.305
  10:50:56 STEP 2572 H=2572:00 +CPU= 26.816
  10:51:16 STEP 2573 H=2573:00 +CPU= 20.344
  10:51:48 STEP 2574 H=2574:00 +CPU= 31.407
  10:52:08 STEP 2575 H=2575:00 +CPU= 20.123
  10:52:27 STEP 2576 H=2576:00 +CPU= 18.804
  10:53:00 STEP 2577 H=2577:00 +CPU= 32.649
  10:53:25 STEP 2578 H=2578:00 +CPU= 24.490
  10:53:50 STEP 2579 H=2579:00 +CPU= 25.663
  10:54:23 STEP 2580 H=2580:00 +CPU= 31.938
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002580
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002580
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002580
  10:54:41 STEP 2581 H=2581:00 +CPU= 18.094
  10:54:59 STEP 2582 H=2582:00 +CPU= 18.002
  10:55:27 STEP 2583 H=2583:00 +CPU= 28.407
  10:55:46 STEP 2584 H=2584:00 +CPU= 18.805
  10:56:04 STEP 2585 H=2585:00 +CPU= 17.834
  10:56:34 STEP 2586 H=2586:00 +CPU= 29.510
  10:56:52 STEP 2587 H=2587:00 +CPU= 18.172
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  10:57:31 STEP 2588 H=2588:00 +CPU= 27.518
  10:58:12 STEP 2589 H=2589:00 +CPU= 41.208
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  11:02:52 STEP 2590 H=2590:00 +CPU= 28.086
  11:03:11 STEP 2591 H=2591:00 +CPU= 18.407
  11:03:44 STEP 2592 H=2592:00 +CPU= 33.391
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002592
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002592
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMGGhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMSHhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMUAhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMGGhq0f+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMSHhq0f+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMUAhq0f+002580
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0689_1981050100_123_950_12167333_1_r1604022945_107.zip
Uploading the intermediate file: upload_file_107.zip
  11:04:02 STEP 2593 H=2593:00 +CPU= 17.848
  11:04:20 STEP 2594 H=2594:00 +CPU= 18.167
  11:04:49 STEP 2595 H=2595:00 +CPU= 28.126
  11:05:07 STEP 2596 H=2596:00 +CPU= 18.385
  11:05:26 STEP 2597 H=2597:00 +CPU= 18.390
  11:05:55 STEP 2598 H=2598:00 +CPU= 29.022
  11:06:12 STEP 2599 H=2599:00 +CPU= 17.640
  11:06:31 STEP 2600 H=2600:00 +CPU= 18.326
  11:06:59 STEP 2601 H=2601:00 +CPU= 27.786
  11:07:17 STEP 2602 H=2602:00 +CPU= 18.125
  11:07:36 STEP 2603 H=2603:00 +CPU= 19.025
  11:08:06 STEP 2604 H=2604:00 +CPU= 30.612
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002604
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002604
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002604
  11:08:24 STEP 2605 H=2605:00 +CPU= 17.593
  11:08:42 STEP 2606 H=2606:00 +CPU= 18.080
  11:09:10 STEP 2607 H=2607:00 +CPU= 27.562
  11:09:28 STEP 2608 H=2608:00 +CPU= 18.058
  11:09:45 STEP 2609 H=2609:00 +CPU= 17.504
  11:10:14 STEP 2610 H=2610:00 +CPU= 28.096
  11:10:31 STEP 2611 H=2611:00 +CPU= 17.551
  11:10:49 STEP 2612 H=2612:00 +CPU= 18.016
  11:11:17 STEP 2613 H=2613:00 +CPU= 27.797
  11:11:35 STEP 2614 H=2614:00 +CPU= 17.998
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  11:12:10 STEP 2615 H=2615:00 +CPU= 23.563
  11:12:44 STEP 2616 H=2616:00 +CPU= 34.088
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002616
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002616
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMGGhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMSHhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMUAhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMGGhq0f+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMSHhq0f+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMUAhq0f+002604
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0689_1981050100_123_950_12167333_1_r1604022945_108.zip
Uploading the intermediate file: upload_file_108.zip
  11:13:02 STEP 2617 H=2617:00 +CPU= 17.667
  11:13:20 STEP 2618 H=2618:00 +CPU= 17.964
  11:13:48 STEP 2619 H=2619:00 +CPU= 27.695
  11:14:06 STEP 2620 H=2620:00 +CPU= 18.067
  11:14:24 STEP 2621 H=2621:00 +CPU= 17.630
  11:14:52 STEP 2622 H=2622:00 +CPU= 28.297
  11:15:16 STEP 2623 H=2623:00 +CPU= 24.002
  11:15:38 STEP 2624 H=2624:00 +CPU= 21.928
  11:16:06 STEP 2625 H=2625:00 +CPU= 27.654
  11:16:24 STEP 2626 H=2626:00 +CPU= 18.290
  11:16:44 STEP 2627 H=2627:00 +CPU= 19.797
  11:17:15 STEP 2628 H=2628:00 +CPU= 30.677
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002628
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002628
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002628
  11:17:33 STEP 2629 H=2629:00 +CPU= 17.911
  11:17:51 STEP 2630 H=2630:00 +CPU= 18.087
  11:18:18 STEP 2631 H=2631:00 +CPU= 27.613
  11:18:37 STEP 2632 H=2632:00 +CPU= 18.200
  11:18:54 STEP 2633 H=2633:00 +CPU= 17.476
  11:19:23 STEP 2634 H=2634:00 +CPU= 28.388
  11:19:40 STEP 2635 H=2635:00 +CPU= 17.532
  11:19:58 STEP 2636 H=2636:00 +CPU= 18.035
  11:20:26 STEP 2637 H=2637:00 +CPU= 27.686
  11:20:45 STEP 2638 H=2638:00 +CPU= 18.476
  11:21:03 STEP 2639 H=2639:00 +CPU= 18.047
  11:21:36 STEP 2640 H=2640:00 +CPU= 33.090
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002640
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002640
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMGGhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMSHhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMUAhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMGGhq0f+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMSHhq0f+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMUAhq0f+002628
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0689_1981050100_123_950_12167333_1_r1604022945_109.zip
Uploading the intermediate file: upload_file_109.zip
  11:21:53 STEP 2641 H=2641:00 +CPU= 17.543
Uploading trickle at timestep: 9504000
  11:22:12 STEP 2642 H=2642:00 +CPU= 18.300
  11:22:40 STEP 2643 H=2643:00 +CPU= 27.906
  11:22:58 STEP 2644 H=2644:00 +CPU= 18.067
  11:23:16 STEP 2645 H=2645:00 +CPU= 18.196
  11:23:53 STEP 2646 H=2646:00 +CPU= 36.754
  11:24:10 STEP 2647 H=2647:00 +CPU= 17.542
  11:24:28 STEP 2648 H=2648:00 +CPU= 18.208
  11:24:56 STEP 2649 H=2649:00 +CPU= 27.761
  11:25:15 STEP 2650 H=2650:00 +CPU= 18.192
  11:25:32 STEP 2651 H=2651:00 +CPU= 17.563
  11:26:03 STEP 2652 H=2652:00 +CPU= 30.677
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002652
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002652
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002652
  11:26:21 STEP 2653 H=2653:00 +CPU= 17.602
  11:26:39 STEP 2654 H=2654:00 +CPU= 18.089
  11:27:06 STEP 2655 H=2655:00 +CPU= 27.601
  11:27:25 STEP 2656 H=2656:00 +CPU= 18.202
  11:27:42 STEP 2657 H=2657:00 +CPU= 17.718
  11:28:10 STEP 2658 H=2658:00 +CPU= 28.088
  11:28:28 STEP 2659 H=2659:00 +CPU= 17.525
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  12:05:22 STEP 2660 H=2660:00 +CPU= 26.192
  12:05:59 STEP 2661 H=2661:00 +CPU= 36.039
  12:06:21 STEP 2662 H=2662:00 +CPU= 21.997
  12:06:43 STEP 2663 H=2663:00 +CPU= 21.450
  12:07:16 STEP 2664 H=2664:00 +CPU= 33.238
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002664
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002664
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMGGhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMSHhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMUAhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMGGhq0f+002652
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMSHhq0f+002652
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMUAhq0f+002652
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0689_1981050100_123_950_12167333_1_r1604022945_110.zip
Uploading the intermediate file: upload_file_110.zip
  12:07:34 STEP 2665 H=2665:00 +CPU= 17.612
  12:07:52 STEP 2666 H=2666:00 +CPU= 17.951
  12:08:20 STEP 2667 H=2667:00 +CPU= 27.822
  12:08:38 STEP 2668 H=2668:00 +CPU= 18.193
  12:08:56 STEP 2669 H=2669:00 +CPU= 18.206
  12:09:25 STEP 2670 H=2670:00 +CPU= 28.454
  12:09:42 STEP 2671 H=2671:00 +CPU= 17.624
  12:10:01 STEP 2672 H=2672:00 +CPU= 18.233
  12:10:37 STEP 2673 H=2673:00 +CPU= 35.757
  12:11:05 STEP 2674 H=2674:00 +CPU= 28.166
  12:11:30 STEP 2675 H=2675:00 +CPU= 24.444
  12:12:13 STEP 2676 H=2676:00 +CPU= 42.747
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002676
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002676
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002676
  12:12:40 STEP 2677 H=2677:00 +CPU= 27.461
  12:13:07 STEP 2678 H=2678:00 +CPU= 26.087
  12:13:49 STEP 2679 H=2679:00 +CPU= 42.266
  12:14:19 STEP 2680 H=2680:00 +CPU= 29.391
  12:14:46 STEP 2681 H=2681:00 +CPU= 26.924
  12:15:22 STEP 2682 H=2682:00 +CPU= 35.313
  12:15:44 STEP 2683 H=2683:00 +CPU= 22.030
  12:16:06 STEP 2684 H=2684:00 +CPU= 21.543
  12:16:39 STEP 2685 H=2685:00 +CPU= 32.860
  12:17:00 STEP 2686 H=2686:00 +CPU= 21.002
  12:17:22 STEP 2687 H=2687:00 +CPU= 21.322
  12:18:12 STEP 2688 H=2688:00 +CPU= 49.602
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002688
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002688
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMGGhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMSHhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMUAhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMGGhq0f+002676
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMSHhq0f+002676
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMUAhq0f+002676
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0689_1981050100_123_950_12167333_1_r1604022945_111.zip
Uploading the intermediate file: upload_file_111.zip
  12:18:35 STEP 2689 H=2689:00 +CPU= 23.425
  12:18:57 STEP 2690 H=2690:00 +CPU= 21.413
  12:19:30 STEP 2691 H=2691:00 +CPU= 32.604
  12:19:52 STEP 2692 H=2692:00 +CPU= 22.214
  12:20:14 STEP 2693 H=2693:00 +CPU= 21.850
  12:20:48 STEP 2694 H=2694:00 +CPU= 33.633
  12:21:10 STEP 2695 H=2695:00 +CPU= 21.208
  12:21:32 STEP 2696 H=2696:00 +CPU= 22.163
  12:22:06 STEP 2697 H=2697:00 +CPU= 34.111
  12:22:31 STEP 2698 H=2698:00 +CPU= 25.059
  12:22:53 STEP 2699 H=2699:00 +CPU= 21.407
  12:23:28 STEP 2700 H=2700:00 +CPU= 34.389
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002700
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002700
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002700
  12:23:52 STEP 2701 H=2701:00 +CPU= 24.080
  12:24:12 STEP 2702 H=2702:00 +CPU= 19.491
  12:24:41 STEP 2703 H=2703:00 +CPU= 29.436
  12:25:02 STEP 2704 H=2704:00 +CPU= 20.772
  12:25:22 STEP 2705 H=2705:00 +CPU= 19.645
  12:25:53 STEP 2706 H=2706:00 +CPU= 31.486
  12:26:19 STEP 2707 H=2707:00 +CPU= 24.844
  12:26:42 STEP 2708 H=2708:00 +CPU= 23.321
  12:27:17 STEP 2709 H=2709:00 +CPU= 34.566
  12:27:40 STEP 2710 H=2710:00 +CPU= 23.078
  12:27:59 STEP 2711 H=2711:00 +CPU= 19.109
  12:28:47 STEP 2712 H=2712:00 +CPU= 47.171
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002712
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002712
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMGGhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMSHhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMUAhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMGGhq0f+002700
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMSHhq0f+002700
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMUAhq0f+002700
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0689_1981050100_123_950_12167333_1_r1604022945_112.zip
Uploading the intermediate file: upload_file_112.zip
  12:29:18 STEP 2713 H=2713:00 +CPU= 31.034
  12:29:45 STEP 2714 H=2714:00 +CPU= 26.991
  12:30:17 STEP 2715 H=2715:00 +CPU= 31.470
  12:30:39 STEP 2716 H=2716:00 +CPU= 22.306
  12:31:03 STEP 2717 H=2717:00 +CPU= 23.234
  12:31:32 STEP 2718 H=2718:00 +CPU= 29.614
  12:31:56 STEP 2719 H=2719:00 +CPU= 23.251
  12:32:19 STEP 2720 H=2720:00 +CPU= 23.389
  12:32:52 STEP 2721 H=2721:00 +CPU= 32.715
  12:33:15 STEP 2722 H=2722:00 +CPU= 22.342
  12:33:36 STEP 2723 H=2723:00 +CPU= 20.764
  12:34:07 STEP 2724 H=2724:00 +CPU= 31.412
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002724
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002724
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002724
  12:34:25 STEP 2725 H=2725:00 +CPU= 17.762
  12:34:45 STEP 2726 H=2726:00 +CPU= 20.196
  12:35:17 STEP 2727 H=2727:00 +CPU= 31.814
  12:35:37 STEP 2728 H=2728:00 +CPU= 19.720
  12:35:58 STEP 2729 H=2729:00 +CPU= 21.043
  12:36:32 STEP 2730 H=2730:00 +CPU= 33.015
  12:36:49 STEP 2731 H=2731:00 +CPU= 17.777
  12:37:08 STEP 2732 H=2732:00 +CPU= 18.582
  12:37:36 STEP 2733 H=2733:00 +CPU= 28.340
  12:37:56 STEP 2734 H=2734:00 +CPU= 19.035
  12:38:15 STEP 2735 H=2735:00 +CPU= 19.160
  12:38:55 STEP 2736 H=2736:00 +CPU= 40.348
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002736
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002736
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMGGhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMSHhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMUAhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMGGhq0f+002724
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMSHhq0f+002724
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMUAhq0f+002724
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0689_1981050100_123_950_12167333_1_r1604022945_113.zip
Uploading the intermediate file: upload_file_113.zip
  12:39:17 STEP 2737 H=2737:00 +CPU= 21.504
  12:39:39 STEP 2738 H=2738:00 +CPU= 21.703
  12:40:12 STEP 2739 H=2739:00 +CPU= 33.334
  12:40:35 STEP 2740 H=2740:00 +CPU= 22.587
  12:40:58 STEP 2741 H=2741:00 +CPU= 22.881
  12:41:35 STEP 2742 H=2742:00 +CPU= 37.036
  12:42:04 STEP 2743 H=2743:00 +CPU= 28.121
  12:42:29 STEP 2744 H=2744:00 +CPU= 25.016
  12:43:02 STEP 2745 H=2745:00 +CPU= 32.540
  12:43:23 STEP 2746 H=2746:00 +CPU= 21.214
  12:43:42 STEP 2747 H=2747:00 +CPU= 19.370
  12:44:25 STEP 2748 H=2748:00 +CPU= 42.671
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002748
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002748
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002748
  12:44:44 STEP 2749 H=2749:00 +CPU= 18.586
  12:45:03 STEP 2750 H=2750:00 +CPU= 19.132
  12:45:32 STEP 2751 H=2751:00 +CPU= 28.479
  12:45:56 STEP 2752 H=2752:00 +CPU= 24.110
  12:46:20 STEP 2753 H=2753:00 +CPU= 23.795
  12:46:54 STEP 2754 H=2754:00 +CPU= 34.010
  12:47:14 STEP 2755 H=2755:00 +CPU= 19.313
  12:47:34 STEP 2756 H=2756:00 +CPU= 19.931
  12:48:08 STEP 2757 H=2757:00 +CPU= 33.650
  12:48:32 STEP 2758 H=2758:00 +CPU= 24.218
  12:48:55 STEP 2759 H=2759:00 +CPU= 22.773
  12:49:38 STEP 2760 H=2760:00 +CPU= 42.319
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002760
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002760
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMGGhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMSHhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMUAhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMGGhq0f+002748
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMSHhq0f+002748
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMUAhq0f+002748
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0689_1981050100_123_950_12167333_1_r1604022945_114.zip
Uploading the intermediate file: upload_file_114.zip
  12:50:04 STEP 2761 H=2761:00 +CPU= 25.875
  12:50:28 STEP 2762 H=2762:00 +CPU= 23.343
  12:51:03 STEP 2763 H=2763:00 +CPU= 35.193
  12:51:26 STEP 2764 H=2764:00 +CPU= 21.929
  12:51:45 STEP 2765 H=2765:00 +CPU= 19.748
  12:52:16 STEP 2766 H=2766:00 +CPU= 30.488
  12:52:39 STEP 2767 H=2767:00 +CPU= 22.415
  12:53:00 STEP 2768 H=2768:00 +CPU= 21.154
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  12:53:53 STEP 2769 H=2769:00 +CPU= 41.235
  12:54:13 STEP 2770 H=2770:00 +CPU= 19.943
  12:54:33 STEP 2771 H=2771:00 +CPU= 20.139
  12:55:10 STEP 2772 H=2772:00 +CPU= 37.002
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002772
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002772
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002772
  12:55:29 STEP 2773 H=2773:00 +CPU= 19.146
  12:55:52 STEP 2774 H=2774:00 +CPU= 22.571
  12:56:20 STEP 2775 H=2775:00 +CPU= 28.257
  12:56:39 STEP 2776 H=2776:00 +CPU= 18.753
  12:56:58 STEP 2777 H=2777:00 +CPU= 18.407
  12:57:31 STEP 2778 H=2778:00 +CPU= 33.267
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  12:58:22 STEP 2779 H=2779:00 +CPU= 28.378
  12:58:43 STEP 2780 H=2780:00 +CPU= 20.883
  12:59:19 STEP 2781 H=2781:00 +CPU= 35.885
  12:59:40 STEP 2782 H=2782:00 +CPU= 21.123
  13:00:03 STEP 2783 H=2783:00 +CPU= 22.175
  13:00:42 STEP 2784 H=2784:00 +CPU= 39.027
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002784
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002784
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMGGhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMSHhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMUAhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMGGhq0f+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMSHhq0f+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMUAhq0f+002772
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0689_1981050100_123_950_12167333_1_r1604022945_115.zip
Uploading the intermediate file: upload_file_115.zip
  13:01:00 STEP 2785 H=2785:00 +CPU= 18.021
  13:01:19 STEP 2786 H=2786:00 +CPU= 19.025
  13:01:51 STEP 2787 H=2787:00 +CPU= 32.088
  13:02:14 STEP 2788 H=2788:00 +CPU= 22.040
  13:02:35 STEP 2789 H=2789:00 +CPU= 21.008
  13:03:05 STEP 2790 H=2790:00 +CPU= 29.787
  13:03:23 STEP 2791 H=2791:00 +CPU= 18.465
  13:03:42 STEP 2792 H=2792:00 +CPU= 18.949
  13:04:14 STEP 2793 H=2793:00 +CPU= 31.262
  13:04:33 STEP 2794 H=2794:00 +CPU= 19.377
  13:04:53 STEP 2795 H=2795:00 +CPU= 20.223
  13:05:29 STEP 2796 H=2796:00 +CPU= 35.385
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002796
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002796
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002796
  13:05:52 STEP 2797 H=2797:00 +CPU= 22.422
  13:06:11 STEP 2798 H=2798:00 +CPU= 19.708
  13:06:40 STEP 2799 H=2799:00 +CPU= 28.386
  13:07:00 STEP 2800 H=2800:00 +CPU= 20.397
  13:07:18 STEP 2801 H=2801:00 +CPU= 17.879
  13:07:47 STEP 2802 H=2802:00 +CPU= 28.907
  13:08:06 STEP 2803 H=2803:00 +CPU= 18.784
  13:08:33 STEP 2804 H=2804:00 +CPU= 26.209
  13:09:05 STEP 2805 H=2805:00 +CPU= 32.450
  13:09:24 STEP 2806 H=2806:00 +CPU= 18.764
  13:09:43 STEP 2807 H=2807:00 +CPU= 18.637
  13:10:17 STEP 2808 H=2808:00 +CPU= 34.000
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002808
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002808
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMGGhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMSHhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMUAhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMGGhq0f+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMSHhq0f+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMUAhq0f+002796
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0689_1981050100_123_950_12167333_1_r1604022945_116.zip
Uploading the intermediate file: upload_file_116.zip
  13:10:35 STEP 2809 H=2809:00 +CPU= 18.037
  13:10:54 STEP 2810 H=2810:00 +CPU= 18.839
  13:11:23 STEP 2811 H=2811:00 +CPU= 28.623
  13:11:41 STEP 2812 H=2812:00 +CPU= 18.550
  13:12:01 STEP 2813 H=2813:00 +CPU= 19.295
  13:12:32 STEP 2814 H=2814:00 +CPU= 31.691
  13:12:53 STEP 2815 H=2815:00 +CPU= 20.656
  13:13:14 STEP 2816 H=2816:00 +CPU= 20.831
  13:13:53 STEP 2817 H=2817:00 +CPU= 38.459
  13:14:15 STEP 2818 H=2818:00 +CPU= 21.848
  13:14:36 STEP 2819 H=2819:00 +CPU= 20.671
  13:15:14 STEP 2820 H=2820:00 +CPU= 37.704
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002820
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002820
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002820
  13:15:42 STEP 2821 H=2821:00 +CPU= 28.042
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  13:16:29 STEP 2822 H=2822:00 +CPU= 24.551
  13:17:06 STEP 2823 H=2823:00 +CPU= 37.023
  13:17:28 STEP 2824 H=2824:00 +CPU= 21.516
  13:17:49 STEP 2825 H=2825:00 +CPU= 21.305
  13:18:24 STEP 2826 H=2826:00 +CPU= 34.191
  13:18:43 STEP 2827 H=2827:00 +CPU= 19.555
  13:19:05 STEP 2828 H=2828:00 +CPU= 21.416
  13:19:40 STEP 2829 H=2829:00 +CPU= 34.742
  13:20:04 STEP 2830 H=2830:00 +CPU= 23.944
  13:20:26 STEP 2831 H=2831:00 +CPU= 22.173
  13:21:05 STEP 2832 H=2832:00 +CPU= 38.408
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002832
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002832
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMGGhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMSHhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMUAhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMGGhq0f+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMSHhq0f+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMUAhq0f+002820
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0689_1981050100_123_950_12167333_1_r1604022945_117.zip
Uploading the intermediate file: upload_file_117.zip
  13:21:26 STEP 2833 H=2833:00 +CPU= 20.755
  13:21:47 STEP 2834 H=2834:00 +CPU= 20.957
  13:22:19 STEP 2835 H=2835:00 +CPU= 31.266
  13:22:40 STEP 2836 H=2836:00 +CPU= 20.792
  13:22:59 STEP 2837 H=2837:00 +CPU= 19.649
  13:23:33 STEP 2838 H=2838:00 +CPU= 32.945
  13:23:56 STEP 2839 H=2839:00 +CPU= 23.236
  13:24:24 STEP 2840 H=2840:00 +CPU= 27.854
  13:24:58 STEP 2841 H=2841:00 +CPU= 33.617
  13:25:18 STEP 2842 H=2842:00 +CPU= 20.119
  13:25:38 STEP 2843 H=2843:00 +CPU= 19.926
  13:26:11 STEP 2844 H=2844:00 +CPU= 32.911
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002844
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002844
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002844
  13:26:32 STEP 2845 H=2845:00 +CPU= 20.265
  13:26:53 STEP 2846 H=2846:00 +CPU= 20.699
  13:27:23 STEP 2847 H=2847:00 +CPU= 30.064
  13:27:44 STEP 2848 H=2848:00 +CPU= 20.416
  13:28:04 STEP 2849 H=2849:00 +CPU= 20.446
  13:28:35 STEP 2850 H=2850:00 +CPU= 31.047
  13:28:57 STEP 2851 H=2851:00 +CPU= 21.392
  13:29:21 STEP 2852 H=2852:00 +CPU= 23.453
  13:29:51 STEP 2853 H=2853:00 +CPU= 30.089
  13:30:13 STEP 2854 H=2854:00 +CPU= 21.665
  13:30:32 STEP 2855 H=2855:00 +CPU= 19.427
  13:31:09 STEP 2856 H=2856:00 +CPU= 36.411
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002856
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002856
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMGGhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMSHhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMUAhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMGGhq0f+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMSHhq0f+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMUAhq0f+002844
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0689_1981050100_123_950_12167333_1_r1604022945_118.zip
Uploading the intermediate file: upload_file_118.zip
  13:31:27 STEP 2857 H=2857:00 +CPU= 18.516
  13:31:46 STEP 2858 H=2858:00 +CPU= 18.885
  13:32:15 STEP 2859 H=2859:00 +CPU= 28.775
  13:32:40 STEP 2860 H=2860:00 +CPU= 24.444
  13:32:59 STEP 2861 H=2861:00 +CPU= 19.673
  13:33:34 STEP 2862 H=2862:00 +CPU= 34.735
  13:33:53 STEP 2863 H=2863:00 +CPU= 19.246
  13:34:12 STEP 2864 H=2864:00 +CPU= 18.587
  13:34:42 STEP 2865 H=2865:00 +CPU= 29.843
  13:35:01 STEP 2866 H=2866:00 +CPU= 18.590
  13:35:19 STEP 2867 H=2867:00 +CPU= 18.073
  13:35:50 STEP 2868 H=2868:00 +CPU= 31.452
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002868
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002868
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002868
  13:36:08 STEP 2869 H=2869:00 +CPU= 18.151
  13:36:27 STEP 2870 H=2870:00 +CPU= 18.560
  13:36:56 STEP 2871 H=2871:00 +CPU= 28.469
  13:37:15 STEP 2872 H=2872:00 +CPU= 19.046
  13:37:33 STEP 2873 H=2873:00 +CPU= 17.944
  13:38:03 STEP 2874 H=2874:00 +CPU= 30.010
  13:38:21 STEP 2875 H=2875:00 +CPU= 17.938
  13:38:39 STEP 2876 H=2876:00 +CPU= 18.628
  13:39:07 STEP 2877 H=2877:00 +CPU= 27.979
  13:39:26 STEP 2878 H=2878:00 +CPU= 18.328
  13:39:44 STEP 2879 H=2879:00 +CPU= 18.370
  13:40:19 STEP 2880 H=2880:00 +CPU= 35.116
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002880
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002880
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMGGhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMSHhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMUAhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMGGhq0f+002868
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMSHhq0f+002868
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMUAhq0f+002868
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0689_1981050100_123_950_12167333_1_r1604022945_119.zip
Uploading the intermediate file: upload_file_119.zip
  13:40:41 STEP 2881 H=2881:00 +CPU= 21.198
Uploading trickle at timestep: 10368000
  13:40:59 STEP 2882 H=2882:00 +CPU= 18.944
  13:41:28 STEP 2883 H=2883:00 +CPU= 28.131
  13:41:46 STEP 2884 H=2884:00 +CPU= 18.432
  13:42:04 STEP 2885 H=2885:00 +CPU= 17.414
  13:42:31 STEP 2886 H=2886:00 +CPU= 27.777
  13:42:49 STEP 2887 H=2887:00 +CPU= 17.287
  13:43:07 STEP 2888 H=2888:00 +CPU= 18.168
  13:43:35 STEP 2889 H=2889:00 +CPU= 28.192
  13:43:54 STEP 2890 H=2890:00 +CPU= 18.502
  13:44:12 STEP 2891 H=2891:00 +CPU= 18.073
  13:44:43 STEP 2892 H=2892:00 +CPU= 31.234
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002892
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002892
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002892
  13:45:01 STEP 2893 H=2893:00 +CPU= 17.841
  13:45:19 STEP 2894 H=2894:00 +CPU= 18.369
  13:45:47 STEP 2895 H=2895:00 +CPU= 27.688
  13:46:05 STEP 2896 H=2896:00 +CPU= 18.257
  13:46:23 STEP 2897 H=2897:00 +CPU= 17.781
  13:46:51 STEP 2898 H=2898:00 +CPU= 28.050
  13:47:08 STEP 2899 H=2899:00 +CPU= 17.199
  13:47:26 STEP 2900 H=2900:00 +CPU= 17.703
  13:47:54 STEP 2901 H=2901:00 +CPU= 27.761
  13:48:12 STEP 2902 H=2902:00 +CPU= 18.290
  13:48:30 STEP 2903 H=2903:00 +CPU= 18.164
  13:49:04 STEP 2904 H=2904:00 +CPU= 33.140
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002904
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002904
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMGGhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMSHhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMUAhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMGGhq0f+002892
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMSHhq0f+002892
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMUAhq0f+002892
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0689_1981050100_123_950_12167333_1_r1604022945_120.zip
Uploading the intermediate file: upload_file_120.zip
  13:49:21 STEP 2905 H=2905:00 +CPU= 17.812
  13:49:40 STEP 2906 H=2906:00 +CPU= 18.405
  13:50:08 STEP 2907 H=2907:00 +CPU= 27.960
  13:50:26 STEP 2908 H=2908:00 +CPU= 18.217
  13:50:44 STEP 2909 H=2909:00 +CPU= 17.829
  13:51:15 STEP 2910 H=2910:00 +CPU= 30.847
  13:51:33 STEP 2911 H=2911:00 +CPU= 18.316
  13:51:51 STEP 2912 H=2912:00 +CPU= 17.942
  13:52:22 STEP 2913 H=2913:00 +CPU= 30.946
  13:52:43 STEP 2914 H=2914:00 +CPU= 20.710
  13:53:03 STEP 2915 H=2915:00 +CPU= 20.376
  13:53:35 STEP 2916 H=2916:00 +CPU= 31.855
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002916
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002916
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002916
  13:53:56 STEP 2917 H=2917:00 +CPU= 20.592
  13:54:22 STEP 2918 H=2918:00 +CPU= 26.225
[EC_DRHOOK:OCI:1:1:12260:12260] [20221224:135438:1671908078:275941.741] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1538] Received signal#15 (SIGTERM) :: 4031MB (heap), 4407MB (maxrss), 0MB (maxstack), 0 (paging), nsigs = 1
[EC_DRHOOK:OCI:1:1:12260:12260] [20221224:135438:1671908078:275941.744] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1542] Also activating Harakiri-alarm (SIGALRM=14) to expire after 500s elapsed to prevent hangs, nsigs = 1
[EC_DRHOOK:OCI:1:1:12260:12260] [20221224:135438:1671908078:275941.744] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1544] Harakiri signal handler 'signal_harakiri' for signal#14 (SIGALRM) installed at 0x81f3c0 (old at (nil))
[EC_DRHOOK:OCI:1:1:12260:12260] [20221224:135438:1671908078:275941.744] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1617] Signal#15 was caused by unrecognized si_code [memaddr=0x1], nsigs = 1
[EC_DRHOOK:OCI:1:1:12260:12260] [20221224:135438:1671908078:275941.744] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1686] Starting DrHook backtrace for signal#15, nsigs = 1
[EC_DRHOOK:OCI:1:1:12260:12260] [20221224:135438:1671908078:275941.744] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3843] 4031 MB (maxheap), 4407 MB (maxrss), 0 MB (maxstack)
[EC_DRHOOK:OCI:1:1:12260:12260] [20221224:135438:1671908078:275941.744] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :  MASTER 
[EC_DRHOOK:OCI:1:1:12260:12260] [20221224:135438:1671908078:275941.745] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :   CNT0 
[EC_DRHOOK:OCI:1:1:12260:12260] [20221224:135438:1671908078:275941.745] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :    CNT1 
[EC_DRHOOK:OCI:1:1:12260:12260] [20221224:135438:1671908078:275941.745] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :     CNT2 
[EC_DRHOOK:OCI:1:1:12260:12260] [20221224:135438:1671908078:275941.745] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :      CNT3 
[EC_DRHOOK:OCI:1:1:12260:12260] [20221224:135438:1671908078:275941.745] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :       CNT4 
[EC_DRHOOK:OCI:1:1:12260:12260] [20221224:135438:1671908078:275941.745] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :        STEPO 
[EC_DRHOOK:OCI:1:1:12260:12260] [20221224:135438:1671908078:275941.745] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :         SCAN2M 
[EC_DRHOOK:OCI:1:1:12260:12260] [20221224:135438:1671908078:275941.745] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :          GP_MODEL_HEAP 
[EC_DRHOOK:OCI:1:1:12260:12260] [20221224:135438:1671908078:275941.745] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :           GP_MODEL 
[EC_DRHOOK:OCI:1:1:12260:12260] [20221224:135438:1671908078:275941.745] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :            RADDRV 
[EC_DRHOOK:OCI:1:1:12260:12260] [20221224:135438:1671908078:275941.745] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :             RADINTG 
[EC_DRHOOK:OCI:1:1:12260:12260] [20221224:135438:1671908078:275941.745] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :              >OMP-RADINTG-RADLSW       (1210) 
[EC_DRHOOK:OCI:1:1:12260:12260] [20221224:135438:1671908078:275941.745] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :               RADIATION_SCHEME 
[EC_DRHOOK:OCI:1:1:12260:12260] [20221224:135438:1671908078:275941.745] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :                radiation_interface:radiation 
[EC_DRHOOK:OCI:1:1:12260:12260] [20221224:135438:1671908078:275941.745] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :                 radiation_mcica_lw:solver_mcica_lw 
[EC_DRHOOK:OCI:1:1:12260:12260] [20221224:135438:1671908078:275941.746] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :                  radiation_cloud_generator:cloud_generator 
[EC_DRHOOK:OCI:1:1:12260:12260] [20221224:135438:1671908078:275941.746] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :                   RANDOM_NUMBERS_MIX:INITIALIZE_RANDOM_NUMBERS 
[EC_DRHOOK:OCI:1:1:12260:12260] [20221224:135439:1671908079:275942.747] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1734] DrHook backtrace done for signal#15, nsigs = 1
[EC_DRHOOK:OCI:1:1:12260:12260] [20221224:135439:1671908079:275942.747] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1785] Calling previous signal handler at 0x1ce8bb0 for signal#15, nsigs = 1
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source             
oifs_43r3_model.e  0000000001CE916B  Unknown               Unknown  Unknown
oifs_43r3_model.e  000000000081FFF1  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DC9090  Unknown               Unknown  Unknown
oifs_43r3_model.e  00000000008F1537  random_numbers_mi         179  random_numbers_mix.F90
oifs_43r3_model.e  000000000196F0E6  radiation_cloud_g         176  radiation_cloud_generator.F90
oifs_43r3_model.e  0000000001972EE7  radiation_mcica_l         179  radiation_mcica_lw.F90
oifs_43r3_model.e  0000000001862B6D  radiation_interfa         387  radiation_interface.F90
oifs_43r3_model.e  00000000012D30E5  radiation_scheme_         484  radiation_scheme.F90
oifs_43r3_model.e  000000000129A415  radintg_                 1455  radintg.F90
oifs_43r3_model.e  0000000001270124  raddrv_                   537  raddrv.F90
oifs_43r3_model.e  0000000000BFD839  gp_model_                 482  gp_model.F90
oifs_43r3_model.e  00000000012E9482  gp_model_heap_             74  gp_model_heap.F90
oifs_43r3_model.e  0000000000BBC1CE  scan2m_                   535  scan2m.F90
oifs_43r3_model.e  000000000057A664  stepo_                    327  stepo.F90
oifs_43r3_model.e  000000000055DEEC  cnt4_                    1133  cnt4.F90
oifs_43r3_model.e  00000000005471C9  cnt3_                     267  cnt3.F90
oifs_43r3_model.e  0000000000546412  cnt2_                      88  cnt2.F90
oifs_43r3_model.e  0000000000545E28  cnt1_                      92  cnt1.F90
oifs_43r3_model.e  000000000040708D  cnt0_                     146  cnt0.F90
oifs_43r3_model.e  000000000040220F  MAIN__                     96  master.F90
oifs_43r3_model.e  00000000004021A2  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DCA390  Unknown               Unknown  Unknown
oifs_43r3_model.e  000000000040206E  Unknown               Unknown  Unknown
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1981050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0689
(argv4) batchid: 950
(argv5) wuid: 12167333
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/0
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/0/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/0/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_cb3d3ddfd9fd77715fb7cf079ed72532 to: /var/lib/boinc-client/slots/0/oifs_43r3_ps_0689_1981050100_123_950_12167333.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/0/oifs_43r3_ps_0689_1981050100_123_950_12167333.zip
ic_ancil_file: ic_ancil_12167333
ifsdata_file: ifsdata_12167333
climate_data_file: clim_data_12167333
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_251c9bd563680bf2557741f9e1776d71 to: /var/lib/boinc-client/slots/0/ic_ancil_12167333.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/0/ic_ancil_12167333.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_04f077283c6e75207511b5aa0c5244c3 to: /var/lib/boinc-client/slots/0/ifsdata/ifsdata_12167333.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/0/ifsdata/ifsdata_12167333.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/0/159l_2/clim_data_12167333.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/0/159l_2/clim_data_12167333.zip
Checking for progress XML file: /var/lib/boinc-client/slots/0/progress_file_12167333.xml
Opened progress file ok : /var/lib/boinc-client/slots/0/progress_file_12167333.xml
-- Model is restarting --
Adjusting last_iter, 2919, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/0/progress_file_12167333.xml
last_cpu_time: 82187
upload_file_number: 121
last_iter: 2903
last_upload: 10454400
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0689_1981050100_123_950_12167333_1_r1604022945
The child process has been launched with process id: 3596
Executing the command: /var/lib/boinc-client/slots/0/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:OCI:1:1:3596:3596] [20221224:135459:1671908099:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:OCI:1:1:3596:3596] [20221224:135459:1671908099:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:OCI:1:1:3596:3596] [20221224:135459:1671908099:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:OCI:1:1:3596:3596] [20221224:135459:1671908099:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:OCI:1:1:3596:3596] [20221224:135459:1671908099:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:OCI:1:1:3596:3596] [20221224:135459:1671908099:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:OCI:1:1:3596:3596] [20221224:135459:1671908099:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:OCI:1:1:3596:3596] [20221224:135459:1671908099:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:OCI:1:1:3596:3596] [20221224:135459:1671908099:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:OCI:1:1:3596:3596] [20221224:135459:1671908099:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:OCI:1:1:3596:3596] [20221224:135459:1671908099:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:OCI:1:1:3596:3596] [20221224:135459:1671908099:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:OCI:1:1:3596:3596] [20221224:135459:1671908099:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:OCI:1:1:3596:3596] [20221224:135459:1671908099:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:OCI:1:1:3596:3596] [20221224:135459:1671908099:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:OCI:1:1:3596:3596] [20221224:135459:1671908099:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:OCI:1:1:3596:3596] [20221224:135459:1671908099:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:OCI:1:1:3596:3596] [20221224:135459:1671908099:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:OCI:1:1:3596:3596] [20221224:135459:1671908099:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:OCI:1:1:3596:3596] [20221224:135459:1671908099:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:OCI:1:1:3596:3596] [20221224:135459:1671908099:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:OCI:1:1:3596:3596] [20221224:135459:1671908099:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:OCI:1:1:3596:3596] [20221224:135459:1671908099:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:OCI:1:1:3596:3596] [20221224:135459:1671908099:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:OCI:1:1:3596:3596] [20221224:135459:1671908099:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:OCI:1:1:3596:3596] [20221224:135459:1671908099:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:OCI:1:1:3596:3596] [20221224:135459:1671908099:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:OCI:1:1:3596:3596] [20221224:135459:1671908099:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:OCI:1:1:3596:3596] [20221224:135459:1671908099:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:OCI:1:1:3596:3596] [20221224:135459:1671908099:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:07:12 STEP 2904 H=2904:00 +CPU= 46.633
  14:07:35 STEP 2905 H=2905:00 +CPU= 22.555
  14:07:54 STEP 2906 H=2906:00 +CPU= 18.804
  14:08:23 STEP 2907 H=2907:00 +CPU= 28.797
  14:08:42 STEP 2908 H=2908:00 +CPU= 19.011
  14:09:01 STEP 2909 H=2909:00 +CPU= 19.338
  14:09:40 STEP 2910 H=2910:00 +CPU= 38.060
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:12:36 STEP 2911 H=2911:00 +CPU= 24.264
  14:13:05 STEP 2912 H=2912:00 +CPU= 28.303
  14:13:49 STEP 2913 H=2913:00 +CPU= 43.965
  14:14:17 STEP 2914 H=2914:00 +CPU= 27.768
  14:14:45 STEP 2915 H=2915:00 +CPU= 27.454
  14:15:32 STEP 2916 H=2916:00 +CPU= 46.539
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002916
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002916
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002916
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:16:15 STEP 2917 H=2917:00 +CPU= 32.525
  14:16:43 STEP 2918 H=2918:00 +CPU= 27.802
  14:17:26 STEP 2919 H=2919:00 +CPU= 42.396
  14:17:53 STEP 2920 H=2920:00 +CPU= 27.177
  14:18:20 STEP 2921 H=2921:00 +CPU= 26.303
  14:19:02 STEP 2922 H=2922:00 +CPU= 41.765
  14:19:34 STEP 2923 H=2923:00 +CPU= 32.145
  14:20:01 STEP 2924 H=2924:00 +CPU= 26.730
  14:20:42 STEP 2925 H=2925:00 +CPU= 39.853
  14:21:08 STEP 2926 H=2926:00 +CPU= 25.774
  14:21:34 STEP 2927 H=2927:00 +CPU= 26.086
  14:22:20 STEP 2928 H=2928:00 +CPU= 45.330
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002928
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002928
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMGGhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMSHhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMUAhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMGGhq0f+002916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMSHhq0f+002916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMUAhq0f+002916
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0689_1981050100_123_950_12167333_1_r1604022945_121.zip
Uploading the intermediate file: upload_file_121.zip
  14:22:45 STEP 2929 H=2929:00 +CPU= 24.521
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:23:24 STEP 2930 H=2930:00 +CPU= 24.887
  14:24:04 STEP 2931 H=2931:00 +CPU= 40.137
  14:24:30 STEP 2932 H=2932:00 +CPU= 25.362
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:25:24 STEP 2933 H=2933:00 +CPU= 36.639
  14:26:06 STEP 2934 H=2934:00 +CPU= 42.082
  14:26:33 STEP 2935 H=2935:00 +CPU= 27.028
  14:27:01 STEP 2936 H=2936:00 +CPU= 27.101
  14:27:40 STEP 2937 H=2937:00 +CPU= 38.731
  14:28:08 STEP 2938 H=2938:00 +CPU= 27.878
  14:28:41 STEP 2939 H=2939:00 +CPU= 33.320
  14:29:41 STEP 2940 H=2940:00 +CPU= 59.350
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002940
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002940
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002940
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:30:22 STEP 2941 H=2941:00 +CPU= 29.862
  14:30:49 STEP 2942 H=2942:00 +CPU= 26.471
  14:31:29 STEP 2943 H=2943:00 +CPU= 39.769
  14:31:56 STEP 2944 H=2944:00 +CPU= 26.427
  14:32:21 STEP 2945 H=2945:00 +CPU= 24.890
  14:33:03 STEP 2946 H=2946:00 +CPU= 42.149
  14:33:30 STEP 2947 H=2947:00 +CPU= 26.436
  14:33:57 STEP 2948 H=2948:00 +CPU= 26.812
  14:34:39 STEP 2949 H=2949:00 +CPU= 41.345
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:35:35 STEP 2950 H=2950:00 +CPU= 34.679
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:36:26 STEP 2951 H=2951:00 +CPU= 39.031
  14:37:20 STEP 2952 H=2952:00 +CPU= 53.863
The child process terminated with status: 0
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002952
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002952
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMSHhq0f+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMGGhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMSHhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMUAhq0f+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMUAhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMSHhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMUAhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMGGhq0f+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12167333/ICMGGhq0f+002928
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0689_1981050100_123_950_12167333_1_r1604022945_122.zip
Uploading the final file: upload_file_122.zip
Uploading trickle at timestep: 10623600
14:40:44 (2586): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 15:53:06 1509575 22258824 oifs_43r3_ps_0689_1981050100_123_950_12167333_1 10,623,600 83,798 0.0079
09 May 2023 15:52:57 1509575 22258824 oifs_43r3_ps_0689_1981050100_123_950_12167333_1 10,368,000 81,345 0.0078
09 May 2023 15:52:43 1509575 22258824 oifs_43r3_ps_0689_1981050100_123_950_12167333_1 9,504,000 75,298 0.0079
09 May 2023 15:50:35 1509575 22258824 oifs_43r3_ps_0689_1981050100_123_950_12167333_1 8,640,000 69,003 0.0080
09 May 2023 15:50:22 1509575 22258824 oifs_43r3_ps_0689_1981050100_123_950_12167333_1 7,776,000 61,906 0.0080
09 May 2023 15:49:20 1509575 22258824 oifs_43r3_ps_0689_1981050100_123_950_12167333_1 6,912,000 55,655 0.0081
09 May 2023 15:49:11 1509575 22258824 oifs_43r3_ps_0689_1981050100_123_950_12167333_1 6,048,000 49,813 0.0082
09 May 2023 15:48:49 1509575 22258824 oifs_43r3_ps_0689_1981050100_123_950_12167333_1 5,184,000 43,341 0.0084
09 May 2023 15:48:36 1509575 22258824 oifs_43r3_ps_0689_1981050100_123_950_12167333_1 4,320,000 36,020 0.0083
09 May 2023 15:48:16 1509575 22258824 oifs_43r3_ps_0689_1981050100_123_950_12167333_1 3,456,000 29,689 0.0086
09 May 2023 15:47:05 1509575 22258824 oifs_43r3_ps_0689_1981050100_123_950_12167333_1 2,592,000 23,489 0.0091
09 May 2023 15:46:48 1509575 22258824 oifs_43r3_ps_0689_1981050100_123_950_12167333_1 1,728,000 15,800 0.0091
09 May 2023 15:46:21 1509575 22258824 oifs_43r3_ps_0689_1981050100_123_950_12167333_1 864,000 8,018 0.0093


©2024 cpdn.org