Task 22314964

Name	oifs_43r3_0050_2019110100_123_993_12213618_0
Workunit	12213618
Created	24 Feb 2023, 12:06:42 UTC
Sent	25 Feb 2023, 0:47:52 UTC
Report deadline	26 Apr 2023, 0:47:52 UTC
Received	25 Feb 2023, 18:58:02 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1532237
Run time	16 hours 44 min 20 sec
CPU time	16 hours 44 min 20 sec
Validate state	Valid
Credit	14,873.04
Device peak FLOPS	7.50 GFLOPS
Application version	OpenIFS 43r3 v1.21 x86_64-pc-linux-gnu
Peak working set size	4,407.71 MB
Peak swap size	4,974.79 MB
Peak disk usage	1,264.55 MB
Stderr	<core_client_version>7.16.6</core_client_version> <![CDATA[ <stderr_txt> H=2554:00 +CPU= 17.161 08:32:25 STEP 2555 H=2555:00 +CPU= 16.502 08:32:53 STEP 2556 H=2556:00 +CPU= 28.081 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMGGhnw4+002556 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMSHhnw4+002556 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMUAhnw4+002556 08:33:10 STEP 2557 H=2557:00 +CPU= 16.968 08:33:28 STEP 2558 H=2558:00 +CPU= 17.106 08:33:54 STEP 2559 H=2559:00 +CPU= 25.886 08:34:11 STEP 2560 H=2560:00 +CPU= 17.306 08:34:29 STEP 2561 H=2561:00 +CPU= 17.333 08:34:55 STEP 2562 H=2562:00 +CPU= 26.334 08:35:12 STEP 2563 H=2563:00 +CPU= 16.443 08:35:30 STEP 2564 H=2564:00 +CPU= 18.380 08:35:56 STEP 2565 H=2565:00 +CPU= 25.653 08:36:14 STEP 2566 H=2566:00 +CPU= 17.684 08:36:31 STEP 2567 H=2567:00 +CPU= 16.844 08:37:03 STEP 2568 H=2568:00 +CPU= 31.205 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMGGhnw4+002568 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMSHhnw4+002568 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMUAhnw4+002568 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMGGhnw4+002544 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMSHhnw4+002544 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMUAhnw4+002544 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMGGhnw4+002556 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMSHhnw4+002556 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMUAhnw4+002556 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_0050_2019110100_123_993_12213618_0_r1209190187_106.zip Uploading the intermediate file: upload_file_106.zip 08:37:20 STEP 2569 H=2569:00 +CPU= 17.547 08:37:37 STEP 2570 H=2570:00 +CPU= 16.785 08:38:03 STEP 2571 H=2571:00 +CPU= 25.487 08:38:20 STEP 2572 H=2572:00 +CPU= 17.419 08:38:37 STEP 2573 H=2573:00 +CPU= 16.821 08:39:05 STEP 2574 H=2574:00 +CPU= 27.220 08:39:23 STEP 2575 H=2575:00 +CPU= 17.526 08:39:40 STEP 2576 H=2576:00 +CPU= 17.557 08:40:06 STEP 2577 H=2577:00 +CPU= 24.924 08:40:23 STEP 2578 H=2578:00 +CPU= 17.555 08:40:41 STEP 2579 H=2579:00 +CPU= 17.178 08:41:10 STEP 2580 H=2580:00 +CPU= 29.045 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMGGhnw4+002580 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMSHhnw4+002580 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMUAhnw4+002580 08:41:28 STEP 2581 H=2581:00 +CPU= 18.110 08:41:47 STEP 2582 H=2582:00 +CPU= 18.445 08:42:13 STEP 2583 H=2583:00 +CPU= 25.455 08:42:31 STEP 2584 H=2584:00 +CPU= 18.000 08:42:48 STEP 2585 H=2585:00 +CPU= 17.056 08:43:15 STEP 2586 H=2586:00 +CPU= 26.827 08:43:33 STEP 2587 H=2587:00 +CPU= 17.846 08:43:52 STEP 2588 H=2588:00 +CPU= 18.407 08:44:19 STEP 2589 H=2589:00 +CPU= 26.950 08:44:37 STEP 2590 H=2590:00 +CPU= 17.722 08:44:54 STEP 2591 H=2591:00 +CPU= 16.824 08:45:24 STEP 2592 H=2592:00 +CPU= 29.705 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMGGhnw4+002592 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMSHhnw4+002592 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMUAhnw4+002592 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMGGhnw4+002568 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMSHhnw4+002568 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMUAhnw4+002568 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMGGhnw4+002580 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMSHhnw4+002580 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMUAhnw4+002580 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_0050_2019110100_123_993_12213618_0_r1209190187_107.zip Uploading the intermediate file: upload_file_107.zip 08:45:40 STEP 2593 H=2593:00 +CPU= 16.349 08:45:57 STEP 2594 H=2594:00 +CPU= 16.824 08:46:23 STEP 2595 H=2595:00 +CPU= 25.462 08:46:40 STEP 2596 H=2596:00 +CPU= 16.738 08:46:56 STEP 2597 H=2597:00 +CPU= 16.301 08:47:23 STEP 2598 H=2598:00 +CPU= 26.281 08:47:40 STEP 2599 H=2599:00 +CPU= 16.991 08:47:57 STEP 2600 H=2600:00 +CPU= 17.143 08:48:23 STEP 2601 H=2601:00 +CPU= 25.568 08:48:41 STEP 2602 H=2602:00 +CPU= 17.809 08:48:57 STEP 2603 H=2603:00 +CPU= 16.452 08:49:25 STEP 2604 H=2604:00 +CPU= 27.760 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMGGhnw4+002604 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMSHhnw4+002604 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMUAhnw4+002604 08:49:42 STEP 2605 H=2605:00 +CPU= 16.708 08:50:00 STEP 2606 H=2606:00 +CPU= 17.401 08:50:26 STEP 2607 H=2607:00 +CPU= 26.522 08:50:43 STEP 2608 H=2608:00 +CPU= 17.032 08:51:00 STEP 2609 H=2609:00 +CPU= 16.729 08:51:26 STEP 2610 H=2610:00 +CPU= 25.624 08:51:43 STEP 2611 H=2611:00 +CPU= 17.192 08:52:01 STEP 2612 H=2612:00 +CPU= 17.596 08:52:27 STEP 2613 H=2613:00 +CPU= 25.692 08:52:44 STEP 2614 H=2614:00 +CPU= 17.207 08:53:02 STEP 2615 H=2615:00 +CPU= 17.549 08:53:33 STEP 2616 H=2616:00 +CPU= 30.277 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMGGhnw4+002616 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMSHhnw4+002616 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMUAhnw4+002616 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMGGhnw4+002592 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMSHhnw4+002592 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMUAhnw4+002592 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMGGhnw4+002604 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMSHhnw4+002604 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMUAhnw4+002604 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_0050_2019110100_123_993_12213618_0_r1209190187_108.zip Uploading the intermediate file: upload_file_108.zip 08:53:50 STEP 2617 H=2617:00 +CPU= 16.862 08:54:06 STEP 2618 H=2618:00 +CPU= 16.575 08:54:32 STEP 2619 H=2619:00 +CPU= 25.435 08:54:50 STEP 2620 H=2620:00 +CPU= 17.616 08:55:06 STEP 2621 H=2621:00 +CPU= 16.330 08:55:32 STEP 2622 H=2622:00 +CPU= 26.026 08:55:50 STEP 2623 H=2623:00 +CPU= 17.102 08:56:07 STEP 2624 H=2624:00 +CPU= 17.448 08:56:33 STEP 2625 H=2625:00 +CPU= 25.349 08:56:50 STEP 2626 H=2626:00 +CPU= 17.324 08:57:07 STEP 2627 H=2627:00 +CPU= 16.437 08:57:35 STEP 2628 H=2628:00 +CPU= 28.113 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMGGhnw4+002628 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMSHhnw4+002628 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMUAhnw4+002628 08:57:51 STEP 2629 H=2629:00 +CPU= 16.251 08:58:09 STEP 2630 H=2630:00 +CPU= 17.469 08:58:34 STEP 2631 H=2631:00 +CPU= 25.193 08:58:51 STEP 2632 H=2632:00 +CPU= 16.987 08:59:08 STEP 2633 H=2633:00 +CPU= 16.623 08:59:34 STEP 2634 H=2634:00 +CPU= 26.117 08:59:51 STEP 2635 H=2635:00 +CPU= 16.597 09:00:08 STEP 2636 H=2636:00 +CPU= 16.766 09:00:34 STEP 2637 H=2637:00 +CPU= 26.246 09:00:52 STEP 2638 H=2638:00 +CPU= 17.835 09:01:10 STEP 2639 H=2639:00 +CPU= 17.239 09:01:42 STEP 2640 H=2640:00 +CPU= 31.851 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMGGhnw4+002640 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMSHhnw4+002640 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMUAhnw4+002640 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMGGhnw4+002616 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMSHhnw4+002616 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMUAhnw4+002616 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMGGhnw4+002628 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMSHhnw4+002628 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMUAhnw4+002628 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_0050_2019110100_123_993_12213618_0_r1209190187_109.zip Uploading the intermediate file: upload_file_109.zip 09:02:00 STEP 2641 H=2641:00 +CPU= 17.398 09:02:16 STEP 2642 H=2642:00 +CPU= 16.638 09:02:41 STEP 2643 H=2643:00 +CPU= 24.274 09:02:58 STEP 2644 H=2644:00 +CPU= 17.282 09:03:15 STEP 2645 H=2645:00 +CPU= 16.316 09:03:41 STEP 2646 H=2646:00 +CPU= 25.994 09:03:57 STEP 2647 H=2647:00 +CPU= 16.524 09:04:15 STEP 2648 H=2648:00 +CPU= 17.007 09:04:41 STEP 2649 H=2649:00 +CPU= 26.216 09:04:59 STEP 2650 H=2650:00 +CPU= 17.861 09:05:15 STEP 2651 H=2651:00 +CPU= 16.376 09:05:44 STEP 2652 H=2652:00 +CPU= 28.567 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMGGhnw4+002652 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMSHhnw4+002652 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMUAhnw4+002652 09:06:02 STEP 2653 H=2653:00 +CPU= 17.535 09:06:19 STEP 2654 H=2654:00 +CPU= 17.155 09:06:45 STEP 2655 H=2655:00 +CPU= 25.586 09:07:02 STEP 2656 H=2656:00 +CPU= 17.363 09:07:19 STEP 2657 H=2657:00 +CPU= 16.502 09:07:46 STEP 2658 H=2658:00 +CPU= 26.460 09:08:02 STEP 2659 H=2659:00 +CPU= 16.325 09:08:19 STEP 2660 H=2660:00 +CPU= 17.042 09:08:45 STEP 2661 H=2661:00 +CPU= 25.657 09:09:02 STEP 2662 H=2662:00 +CPU= 17.409 09:09:20 STEP 2663 H=2663:00 +CPU= 16.969 09:09:50 STEP 2664 H=2664:00 +CPU= 30.331 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMGGhnw4+002664 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMSHhnw4+002664 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMUAhnw4+002664 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMGGhnw4+002640 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMSHhnw4+002640 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMUAhnw4+002640 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMGGhnw4+002652 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMSHhnw4+002652 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMUAhnw4+002652 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_0050_2019110100_123_993_12213618_0_r1209190187_110.zip Uploading the intermediate file: upload_file_110.zip 09:10:08 STEP 2665 H=2665:00 +CPU= 17.385 09:10:25 STEP 2666 H=2666:00 +CPU= 16.453 09:10:50 STEP 2667 H=2667:00 +CPU= 25.823 09:11:08 STEP 2668 H=2668:00 +CPU= 17.204 09:11:24 STEP 2669 H=2669:00 +CPU= 16.275 09:11:51 STEP 2670 H=2670:00 +CPU= 26.498 09:12:08 STEP 2671 H=2671:00 +CPU= 16.907 09:12:25 STEP 2672 H=2672:00 +CPU= 16.845 09:12:51 STEP 2673 H=2673:00 +CPU= 25.628 09:13:08 STEP 2674 H=2674:00 +CPU= 17.212 09:13:25 STEP 2675 H=2675:00 +CPU= 17.108 09:13:54 STEP 2676 H=2676:00 +CPU= 28.094 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMGGhnw4+002676 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMSHhnw4+002676 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMUAhnw4+002676 09:14:10 STEP 2677 H=2677:00 +CPU= 16.311 09:14:28 STEP 2678 H=2678:00 +CPU= 17.572 09:14:54 STEP 2679 H=2679:00 +CPU= 26.083 09:15:11 STEP 2680 H=2680:00 +CPU= 17.433 09:15:28 STEP 2681 H=2681:00 +CPU= 16.843 09:15:56 STEP 2682 H=2682:00 +CPU= 26.895 09:16:12 STEP 2683 H=2683:00 +CPU= 16.046 09:16:29 STEP 2684 H=2684:00 +CPU= 17.570 09:16:56 STEP 2685 H=2685:00 +CPU= 26.044 09:17:13 STEP 2686 H=2686:00 +CPU= 17.150 09:17:30 STEP 2687 H=2687:00 +CPU= 16.801 09:18:00 STEP 2688 H=2688:00 +CPU= 29.780 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMGGhnw4+002688 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMSHhnw4+002688 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMUAhnw4+002688 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMGGhnw4+002664 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMSHhnw4+002664 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMUAhnw4+002664 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMGGhnw4+002676 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMSHhnw4+002676 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMUAhnw4+002676 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_0050_2019110100_123_993_12213618_0_r1209190187_111.zip Uploading the intermediate file: upload_file_111.zip 09:18:17 STEP 2689 H=2689:00 +CPU= 17.240 09:18:35 STEP 2690 H=2690:00 +CPU= 17.130 09:19:02 STEP 2691 H=2691:00 +CPU= 26.747 09:19:19 STEP 2692 H=2692:00 +CPU= 17.003 09:19:35 STEP 2693 H=2693:00 +CPU= 16.257 09:20:02 STEP 2694 H=2694:00 +CPU= 26.768 09:20:19 STEP 2695 H=2695:00 +CPU= 17.161 09:20:36 STEP 2696 H=2696:00 +CPU= 16.683 09:21:03 STEP 2697 H=2697:00 +CPU= 26.752 09:21:21 STEP 2698 H=2698:00 +CPU= 17.591 09:21:38 STEP 2699 H=2699:00 +CPU= 17.182 09:22:06 STEP 2700 H=2700:00 +CPU= 28.100 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMGGhnw4+002700 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMSHhnw4+002700 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMUAhnw4+002700 09:22:24 STEP 2701 H=2701:00 +CPU= 17.755 09:22:41 STEP 2702 H=2702:00 +CPU= 17.014 09:23:07 STEP 2703 H=2703:00 +CPU= 25.874 09:23:25 STEP 2704 H=2704:00 +CPU= 17.146 09:23:41 STEP 2705 H=2705:00 +CPU= 16.330 09:24:07 STEP 2706 H=2706:00 +CPU= 26.387 09:24:25 STEP 2707 H=2707:00 +CPU= 17.608 09:24:42 STEP 2708 H=2708:00 +CPU= 17.041 09:25:08 STEP 2709 H=2709:00 +CPU= 25.879 09:25:25 STEP 2710 H=2710:00 +CPU= 16.789 09:25:43 STEP 2711 H=2711:00 +CPU= 17.449 09:26:13 STEP 2712 H=2712:00 +CPU= 29.754 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMGGhnw4+002712 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMSHhnw4+002712 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMUAhnw4+002712 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMGGhnw4+002688 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMSHhnw4+002688 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMUAhnw4+002688 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMGGhnw4+002700 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMSHhnw4+002700 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMUAhnw4+002700 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_0050_2019110100_123_993_12213618_0_r1209190187_112.zip Uploading the intermediate file: upload_file_112.zip 09:26:30 STEP 2713 H=2713:00 +CPU= 17.138 09:26:48 STEP 2714 H=2714:00 +CPU= 17.094 09:27:14 STEP 2715 H=2715:00 +CPU= 25.835 09:27:30 STEP 2716 H=2716:00 +CPU= 16.739 09:27:47 STEP 2717 H=2717:00 +CPU= 16.509 09:28:14 STEP 2718 H=2718:00 +CPU= 26.318 09:28:31 STEP 2719 H=2719:00 +CPU= 17.239 09:28:48 STEP 2720 H=2720:00 +CPU= 16.402 09:29:13 STEP 2721 H=2721:00 +CPU= 25.368 09:29:31 STEP 2722 H=2722:00 +CPU= 17.438 09:29:48 STEP 2723 H=2723:00 +CPU= 17.514 09:30:17 STEP 2724 H=2724:00 +CPU= 28.184 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMGGhnw4+002724 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMSHhnw4+002724 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMUAhnw4+002724 09:30:34 STEP 2725 H=2725:00 +CPU= 17.176 09:30:51 STEP 2726 H=2726:00 +CPU= 16.763 09:31:17 STEP 2727 H=2727:00 +CPU= 26.138 09:31:34 STEP 2728 H=2728:00 +CPU= 17.008 09:31:51 STEP 2729 H=2729:00 +CPU= 16.838 09:32:18 STEP 2730 H=2730:00 +CPU= 25.910 09:32:35 STEP 2731 H=2731:00 +CPU= 17.120 09:32:52 STEP 2732 H=2732:00 +CPU= 16.574 09:33:18 STEP 2733 H=2733:00 +CPU= 26.016 09:33:35 STEP 2734 H=2734:00 +CPU= 17.744 09:33:52 STEP 2735 H=2735:00 +CPU= 16.837 09:34:22 STEP 2736 H=2736:00 +CPU= 29.216 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMGGhnw4+002736 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMSHhnw4+002736 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMUAhnw4+002736 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMGGhnw4+002712 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMSHhnw4+002712 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMUAhnw4+002712 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMGGhnw4+002724 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMSHhnw4+002724 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMUAhnw4+002724 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_0050_2019110100_123_993_12213618_0_r1209190187_113.zip Uploading the intermediate file: upload_file_113.zip 09:34:39 STEP 2737 H=2737:00 +CPU= 16.742 09:34:57 STEP 2738 H=2738:00 +CPU= 18.039 09:35:23 STEP 2739 H=2739:00 +CPU= 25.463 09:35:40 STEP 2740 H=2740:00 +CPU= 17.536 09:35:57 STEP 2741 H=2741:00 +CPU= 16.269 09:36:23 STEP 2742 H=2742:00 +CPU= 26.345 09:36:40 STEP 2743 H=2743:00 +CPU= 16.603 09:36:58 STEP 2744 H=2744:00 +CPU= 17.798 09:37:24 STEP 2745 H=2745:00 +CPU= 25.742 09:37:41 STEP 2746 H=2746:00 +CPU= 16.890 09:37:57 STEP 2747 H=2747:00 +CPU= 16.164 09:38:26 STEP 2748 H=2748:00 +CPU= 28.311 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMGGhnw4+002748 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMSHhnw4+002748 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMUAhnw4+002748 09:38:44 STEP 2749 H=2749:00 +CPU= 17.587 09:39:01 STEP 2750 H=2750:00 +CPU= 16.998 09:39:26 STEP 2751 H=2751:00 +CPU= 24.864 09:39:43 STEP 2752 H=2752:00 +CPU= 16.768 09:40:00 STEP 2753 H=2753:00 +CPU= 17.020 09:40:28 STEP 2754 H=2754:00 +CPU= 27.286 Quit request received from BOINC client, ending the child process >>> Printing last 70 lines from file: NODE.001_01 NSTEP = 2752 STEPO 0AAA00AAA SPECTRAL NORMS: Pattern 1 STEPO, YSPSDT_AR1 ( 1,...), SP NORMS 2D: 5.277067314915E-01 1.933219398256E-01 6.434498100985E-02 STEPO, YSPSDT_AR1 (SUM,...), SP NORMS 2D: 5.625386086897E-01 STEPO, YGPSDT ( 1,...), Grid Point Norms FIELD LEV AVERAGE MINIMUM MAXIMUM 101 60 -2.70829798238212E-02 -1.83026157963039E+00 2.56115737889419E+00 STEPO, YGPSDT[clipped]( 1,...), Grid Point Norms FIELD LEV AVERAGE MINIMUM MAXIMUM 101 60 -2.90022169449156E-02 -1.00000000000000E+00 1.00000000000000E+00 STEPO: evolving YSPSDT_AR1( 1) !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED. DATE IS: 20200223151500 !!!!!!!!!!!! !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED. DATE IS: 20200223153000 !!!!!!!!!!!! !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED. DATE IS: 20200223154500 !!!!!!!!!!!! !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED. DATE IS: 20200223160000 !!!!!!!!!!!! 09:39:43 STEP 2752 H=2752:00 +CPU= 16.768 NSTEP = 2753 STEPO 0AAA00AAA SPECTRAL NORMS: Pattern 1 STEPO, YSPSDT_AR1 ( 1,...), SP NORMS 2D: 5.436939312237E-01 1.985830029176E-01 6.451016830091E-02 STEPO, YSPSDT_AR1 (SUM,...), SP NORMS 2D: 5.767026831684E-01 STEPO, YGPSDT ( 1,...), Grid Point Norms FIELD LEV AVERAGE MINIMUM MAXIMUM 101 60 -1.76576901099099E-02 -2.35881649905345E+00 2.54703649877744E+00 STEPO, YGPSDT[clipped]( 1,...), Grid Point Norms FIELD LEV AVERAGE MINIMUM MAXIMUM 101 60 -1.81711909401857E-02 -1.00000000000000E+00 1.00000000000000E+00 STEPO: evolving YSPSDT_AR1( 1) !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED. DATE IS: 20200223161500 !!!!!!!!!!!! !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED. DATE IS: 20200223163000 !!!!!!!!!!!! !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED. DATE IS: 20200223164500 !!!!!!!!!!!! !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED. DATE IS: 20200223170000 !!!!!!!!!!!! 09:40:00 STEP 2753 H=2753:00 +CPU= 17.020 DATE= 2020 2 23 ISTEP= 2754: Reset RSOLINC= 1360.9440 RIP0= 1390.3484 SU_GHGCLIM, RCARDI,RCH4,RN2O,RCFC11,RCFC12,RNO2: 6.248620232976000E-004 9.609089255168670E-007 4.998719107099000E-007 9.565112577734999E-010 2.022325970022666E-009 7.940283000000001E-011 SUECAEC: GLOBAL AVERAGE VOLCANIC SULPHATE FOR (KINDAT,KMINUT) 20191101 165330 1.159977703455965E-004 SUECSO4: USE AVAILABLE FILES FOR DECADES: 2010 2020 SUBROUTINE SUECSO4:, UNWEIGHTED AVERAGE: 2.357386912650839E-003 NSTEP = 2754 STEPO 0AAA00AAA SPECTRAL NORMS: Pattern 1 STEPO, YSPSDT_AR1 ( 1,...), SP NORMS 2D: 5.318957959496E-01 1.977932545804E-01 6.381743515720E-02 STEPO, YSPSDT_AR1 (SUM,...), SP NORMS 2D: 5.664420964637E-01 STEPO, YGPSDT ( 1,...), Grid Point Norms FIELD LEV AVERAGE MINIMUM MAXIMUM 101 60 -1.40893996067712E-02 -2.18613035808632E+00 2.40611628403852E+00 STEPO, YGPSDT[clipped]( 1,...), Grid Point Norms FIELD LEV AVERAGE MINIMUM MAXIMUM 101 60 -1.60010424326117E-02 -1.00000000000000E+00 1.00000000000000E+00 STEPO: evolving YSPSDT_AR1( 1) !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED. DATE IS: 20200223171500 !!!!!!!!!!!! !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED. DATE IS: 20200223173000 !!!!!!!!!!!! !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED. DATE IS: 20200223174500 !!!!!!!!!!!! !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED. DATE IS: 20200223180000 !!!!!!!!!!!! 09:40:28 STEP 2754 H=2754:00 +CPU= 27.286 ISTEP= 2755 RSOLINC= 1360.9440 RI0= 1366.0000 ZI0= 1360.9440 RIP0= 1390.3226 ISTEP= 2755 ZI0= 1360.9440 ZSEASON= 1.021586957 REA=149597870000.00 RDEASO=148008869104.78 NSTEP = 2755 STEPO 0AAA00AAA SPECTRAL NORMS: Pattern 1 STEPO, YSPSDT_AR1 ( 1,...), SP NORMS 2D: 5.203503832903E-01 1.966870313165E-01 6.347722268160E-02 STEPO, YSPSDT_AR1 (SUM,...), SP NORMS 2D: 5.544397067301E-01 STEPO, YGPSDT ( 1,...), Grid Point Norms FIELD LEV AVERAGE MINIMUM MAXIMUM 101 60 -2.05565101530022E-02 -2.06835199179888E+00 2.12390641390189E+00 STEPO, YGPSDT[clipped]( 1,...), Grid Point Norms FIELD LEV AVERAGE MINIMUM MAXIMUM 101 60 -2.10105172315527E-02 -1.00000000000000E+00 1.00000000000000E+00 ------------------------------------------------ CNT0 not found; string returned was: 'STEPO' >>> Printing last 8 lines from file: ifs.stat 09:38:26 0AAA00AAA STEPO 2749 26.500 26.500 26.827 150:28 151:38 0.12033160678022E-04 2GB 0MB 09:38:44 0AAA00AAA STEPO 2750 17.587 17.587 17.964 150:45 151:56 0.12033160678022E-04 2GB 0MB 09:39:01 0AAA00AAA STEPO 2751 16.998 16.998 17.086 151:02 152:13 0.12033160678022E-04 2GB 0MB 09:39:26 0AAA00AAA STEPO 2752 24.863 24.863 24.998 151:27 152:38 0.12033160678022E-04 2GB 0MB 09:39:43 0AAA00AAA STEPO 2753 16.768 16.768 16.836 151:44 152:55 0.12033160678022E-04 2GB 0MB 09:40:00 0AAA00AAA STEPO 2754 17.065 17.065 17.173 152:01 153:12 0.12033160678022E-04 2GB 0MB 09:40:28 0AAA00AAA STEPO 2755 27.241 27.241 27.674 152:28 153:40 0.12033160678022E-04 2GB 0MB ------------------------------------------------ >>> Printing last 11 lines from file: rcf CSTEP = " 2736", CTIME = "01140000 ", NSTEPLPP = 201, 202, 49, 228226, 228227, 50, IPRGPNSRES = 1, IPRGPEWRES = 1, IPRTRWRES = 1, IPRTRVRES = 1, GMASS0 = 98323.0604018080 , GMASSI = 98322.4709928494 / ------------------------------------------------ >>> Printing last 17 lines from file: waminfo PARAM=10U/10V, REPRES=GG, ANALYSIS PERIOD = 0 FORECAST PERIOD = 9072000 WIND TIME STEP IN SECONDS = 3600 ANALYSIS FROM 20191101000000 TO 20191101000000 ASSIMILATION NO NEW FORECAST NO STATUS STORM1= UNFINISHED STATUS STORM2= UNFINISHED STATUS STORM3= UNFINISHED DATE FOR OUTPUT OF BOTH RESTART FILES = 00000000000000 LAST DATE FOR SPECTRA FILE OUTPUT = 20200303000000 BEGIN DATE FOR USING SURFACE CURRENT = 20191101000000 PARALLEL RESTART = YES NUMBER OF MPI TASKS USED = 1 ------------------------------------------------ >>> Printing last 8 lines from file: /var/lib/boinc-client/slots/14/progress_file_12213618.xml <running_values> <last_cpu_time>55867.070000</last_cpu_time> <upload_file_number>114</upload_file_number> <last_iter>2754</last_iter> <last_upload>9849600</last_upload> <model_completed>0</model_completed> </running_values> ------------------------------------------------ ..Failed, model did not complete successfully (argv0) ../../projects/climateprediction.net/oifs_43r3_1.21_x86_64-pc-linux-gnu (argv1) start_date: 2019110100 (argv2) exptid: hnw4 (argv3) unique_member_id: 0050 (argv4) batchid: 993 (argv5) wuid: 12213618 (argv6) fclen: 123 (argv7) app_name: oifs_43r3 (argv8) nthreads: 1 Working directory is: /var/lib/boinc-client/slots/14 Project directory is: /var/lib/boinc-client/projects/climateprediction.net/ app name: oifs_43r3 version: 1.21 Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618 ..mkdir for temp folder for results failed Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_app_1.21_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/14/oifs_43r3_app_1.21_x86_64-pc-linux-gnu.zip Unzipping the app zip file: /var/lib/boinc-client/slots/14/oifs_43r3_app_1.21_x86_64-pc-linux-gnu.zip Copying the namelist files from: ../../projects/climateprediction.net/jf_27a7cca6d3a11839d3e3928f11e1e24e to: /var/lib/boinc-client/slots/14/oifs_43r3_0050_2019110100_123_993_12213618.zip Unzipping the namelist zip file: /var/lib/boinc-client/slots/14/oifs_43r3_0050_2019110100_123_993_12213618.zip ic_ancil_file: ic_ancil_12213618 ifsdata_file: ifsdata_12213618 climate_data_file: clim_data_12213618 horiz_resolution: 159 vert_resolution: 60 grid_type: l_2 upload_interval: 24 utstep: 3600 nfrres: restart dump frequency (steps) 24 Copying IC ancils from: ../../projects/climateprediction.net/jf_b588841c92c14b5d5a69e91f8774ea85 to: /var/lib/boinc-client/slots/14/ic_ancil_12213618.zip Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/14/ic_ancil_12213618.zip ..mkdir for ifsdata folder failed Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_1d51341e046f1af2729c3a121dd4cf59 to: /var/lib/boinc-client/slots/14/ifsdata/ifsdata_12213618.zip Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/14/ifsdata/ifsdata_12213618.zip ..mkdir for the climate data folder failed Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/14/159l_2/clim_data_12213618.zip Unzipping the climate data zip file: /var/lib/boinc-client/slots/14/159l_2/clim_data_12213618.zip Checking for progress XML file: /var/lib/boinc-client/slots/14/progress_file_12213618.xml Opened progress file ok : /var/lib/boinc-client/slots/14/progress_file_12213618.xml -- Model is restarting -- Adjusting last_iter, 2754, to previous model restart step. Creating progress file: /var/lib/boinc-client/slots/14/progress_file_12213618.xml last_cpu_time: 55867 upload_file_number: 114 last_iter: 2737 last_upload: 9849600 model_completed: 0 total_length_of_simulation: 10627200 result_base_name: oifs_43r3_0050_2019110100_123_993_12213618_0_r1209190187 The child process has been launched with process id: 569278 Executing the command: /var/lib/boinc-client/slots/14/oifs_43r3_model.exe [EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1 [EC_DRHOOK:wkst-01.kalnet.xyz:1:1:569278:569278] [20230225:094135:1677343295:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2091] fp = 0x3124020 [EC_DRHOOK:wkst-01.kalnet.xyz:1:1:569278:569278] [20230225:094135:1677343295:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1 [EC_DRHOOK:wkst-01.kalnet.xyz:1:1:569278:569278] [20230225:094135:1677343295:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0) [EC_DRHOOK:wkst-01.kalnet.xyz:1:1:569278:569278] [20230225:094135:1677343295:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1 [EC_DRHOOK:wkst-01.kalnet.xyz:1:1:569278:569278] [20230225:094135:1677343295:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000 [EC_DRHOOK:wkst-01.kalnet.xyz:1:1:569278:569278] [20230225:094135:1677343295:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647) [EC_DRHOOK:wkst-01.kalnet.xyz:1:1:569278:569278] [20230225:094135:1677343295:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16 [EC_DRHOOK:wkst-01.kalnet.xyz:1:1:569278:569278] [20230225:094135:1677343295:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0 [EC_DRHOOK:wkst-01.kalnet.xyz:1:1:569278:569278] [20230225:094135:1677343295:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500 [EC_DRHOOK:wkst-01.kalnet.xyz:1:1:569278:569278] [20230225:094135:1677343295:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1 [EC_DRHOOK:wkst-01.kalnet.xyz:1:1:569278:569278] [20230225:094135:1677343295:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1 [EC_DRHOOK:wkst-01.kalnet.xyz:1:1:569278:569278] [20230225:094135:1677343295:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1 [EC_DRHOOK:wkst-01.kalnet.xyz:1:1:569278:569278] [20230225:094135:1677343295:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1 [EC_DRHOOK:wkst-01.kalnet.xyz:1:1:569278:569278] [20230225:094135:1677343295:0.000] [ignore_signals@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef> [EC_DRHOOK:wkst-01.kalnet.xyz:1:1:569278:569278] [20230225:094135:1677343295:0.000] [restore_default_signals@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef> [EC_DRHOOK:wkst-01.kalnet.xyz:1:1:569278:569278] [20230225:094135:1677343295:0.000] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x810730 (old at 0x1ce8440) [EC_DRHOOK:wkst-01.kalnet.xyz:1:1:569278:569278] [20230225:094135:1677343295:0.000] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x810730 (old at (nil)) [EC_DRHOOK:wkst-01.kalnet.xyz:1:1:569278:569278] [20230225:094135:1677343295:0.000] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x810730 (old at 0x1ce8440) [EC_DRHOOK:wkst-01.kalnet.xyz:1:1:569278:569278] [20230225:094135:1677343295:0.000] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x810730 (old at (nil)) [EC_DRHOOK:wkst-01.kalnet.xyz:1:1:569278:569278] [20230225:094135:1677343295:0.000] [trapfpe_treatment@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1 [EC_DRHOOK:wkst-01.kalnet.xyz:1:1:569278:569278] [20230225:094135:1677343295:0.000] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x810730 (old at 0x1ce8440) [EC_DRHOOK:wkst-01.kalnet.xyz:1:1:569278:569278] [20230225:094135:1677343295:0.000] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x810730 (old at 0x1ce8440) [EC_DRHOOK:wkst-01.kalnet.xyz:1:1:569278:569278] [20230225:094135:1677343295:0.000] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x810730 (old at (nil)) [EC_DRHOOK:wkst-01.kalnet.xyz:1:1:569278:569278] [20230225:094135:1677343295:0.000] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x810730 (old at 0x1ce8440) [EC_DRHOOK:wkst-01.kalnet.xyz:1:1:569278:569278] [20230225:094135:1677343295:0.000] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x810730 (old at 0x1ce8440) [EC_DRHOOK:wkst-01.kalnet.xyz:1:1:569278:569278] [20230225:094135:1677343295:0.000] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x810730 (old at 0x1ce8440) [EC_DRHOOK:wkst-01.kalnet.xyz:1:1:569278:569278] [20230225:094135:1677343295:0.000] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x810730 (old at (nil)) [EC_DRHOOK:wkst-01.kalnet.xyz:1:1:569278:569278] [20230225:094135:1677343295:0.000] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x810730 (old at (nil)) [EC_DRHOOK:wkst-01.kalnet.xyz:1:1:569278:569278] [20230225:094135:1677343295:0.000] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x810730 (old at (nil)) [EC_DRHOOK:wkst-01.kalnet.xyz:1:1:569278:569278] [20230225:094135:1677343295:0.000] [catch_signals@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef> 09:42:10 STEP 2736 H=2736:00 +CPU= 32.202 09:42:26 STEP 2737 H=2737:00 +CPU= 16.156 09:42:43 STEP 2738 H=2738:00 +CPU= 16.591 09:43:09 STEP 2739 H=2739:00 +CPU= 26.281 09:43:26 STEP 2740 H=2740:00 +CPU= 17.121 09:43:44 STEP 2741 H=2741:00 +CPU= 17.440 09:44:12 STEP 2742 H=2742:00 +CPU= 27.411 09:44:28 STEP 2743 H=2743:00 +CPU= 16.072 09:44:45 STEP 2744 H=2744:00 +CPU= 17.051 09:45:13 STEP 2745 H=2745:00 +CPU= 27.562 09:45:30 STEP 2746 H=2746:00 +CPU= 16.824 09:45:47 STEP 2747 H=2747:00 +CPU= 17.183 09:46:17 STEP 2748 H=2748:00 +CPU= 29.297 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMGGhnw4+002748 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMSHhnw4+002748 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMUAhnw4+002748 09:46:33 STEP 2749 H=2749:00 +CPU= 16.360 09:46:50 STEP 2750 H=2750:00 +CPU= 17.029 09:47:18 STEP 2751 H=2751:00 +CPU= 27.163 09:47:34 STEP 2752 H=2752:00 +CPU= 16.418 09:47:51 STEP 2753 H=2753:00 +CPU= 16.172 09:48:18 STEP 2754 H=2754:00 +CPU= 26.820 09:48:33 STEP 2755 H=2755:00 +CPU= 15.557 09:48:50 STEP 2756 H=2756:00 +CPU= 16.822 09:49:17 STEP 2757 H=2757:00 +CPU= 26.336 09:49:33 STEP 2758 H=2758:00 +CPU= 16.157 09:49:50 STEP 2759 H=2759:00 +CPU= 17.045 09:50:21 STEP 2760 H=2760:00 +CPU= 30.345 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMGGhnw4+002760 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMSHhnw4+002760 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMUAhnw4+002760 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMGGhnw4+002736 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMSHhnw4+002736 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMUAhnw4+002736 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMGGhnw4+002748 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMSHhnw4+002748 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMUAhnw4+002748 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_0050_2019110100_123_993_12213618_0_r1209190187_114.zip Uploading the intermediate file: upload_file_114.zip 09:50:37 STEP 2761 H=2761:00 +CPU= 15.752 09:50:53 STEP 2762 H=2762:00 +CPU= 16.460 09:51:20 STEP 2763 H=2763:00 +CPU= 26.165 09:51:36 STEP 2764 H=2764:00 +CPU= 16.397 09:51:52 STEP 2765 H=2765:00 +CPU= 15.966 09:52:20 STEP 2766 H=2766:00 +CPU= 26.978 09:52:35 STEP 2767 H=2767:00 +CPU= 15.565 09:52:52 STEP 2768 H=2768:00 +CPU= 17.094 09:53:19 STEP 2769 H=2769:00 +CPU= 26.244 09:53:35 STEP 2770 H=2770:00 +CPU= 16.391 09:53:52 STEP 2771 H=2771:00 +CPU= 16.613 09:54:20 STEP 2772 H=2772:00 +CPU= 28.133 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMGGhnw4+002772 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMSHhnw4+002772 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMUAhnw4+002772 09:54:37 STEP 2773 H=2773:00 +CPU= 16.482 09:54:54 STEP 2774 H=2774:00 +CPU= 16.764 09:55:22 STEP 2775 H=2775:00 +CPU= 27.446 09:55:39 STEP 2776 H=2776:00 +CPU= 16.850 09:55:55 STEP 2777 H=2777:00 +CPU= 16.445 09:56:23 STEP 2778 H=2778:00 +CPU= 27.463 09:56:39 STEP 2779 H=2779:00 +CPU= 16.395 09:56:56 STEP 2780 H=2780:00 +CPU= 16.825 09:57:23 STEP 2781 H=2781:00 +CPU= 26.746 09:57:40 STEP 2782 H=2782:00 +CPU= 16.257 09:57:57 STEP 2783 H=2783:00 +CPU= 17.489 09:58:28 STEP 2784 H=2784:00 +CPU= 30.478 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMGGhnw4+002784 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMSHhnw4+002784 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMUAhnw4+002784 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMGGhnw4+002760 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMSHhnw4+002760 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMUAhnw4+002760 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMGGhnw4+002772 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMSHhnw4+002772 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMUAhnw4+002772 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_0050_2019110100_123_993_12213618_0_r1209190187_115.zip Uploading the intermediate file: upload_file_115.zip 09:58:44 STEP 2785 H=2785:00 +CPU= 15.894 09:59:01 STEP 2786 H=2786:00 +CPU= 16.460 09:59:27 STEP 2787 H=2787:00 +CPU= 26.678 09:59:44 STEP 2788 H=2788:00 +CPU= 16.297 10:00:00 STEP 2789 H=2789:00 +CPU= 16.137 10:00:28 STEP 2790 H=2790:00 +CPU= 27.699 10:00:44 STEP 2791 H=2791:00 +CPU= 15.761 10:01:01 STEP 2792 H=2792:00 +CPU= 16.693 10:01:27 STEP 2793 H=2793:00 +CPU= 26.785 10:01:44 STEP 2794 H=2794:00 +CPU= 16.594 10:02:01 STEP 2795 H=2795:00 +CPU= 16.723 10:02:30 STEP 2796 H=2796:00 +CPU= 28.719 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMGGhnw4+002796 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMSHhnw4+002796 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMUAhnw4+002796 10:02:46 STEP 2797 H=2797:00 +CPU= 15.769 10:03:02 STEP 2798 H=2798:00 +CPU= 16.411 10:03:30 STEP 2799 H=2799:00 +CPU= 26.927 10:03:46 STEP 2800 H=2800:00 +CPU= 16.364 10:04:04 STEP 2801 H=2801:00 +CPU= 17.372 10:04:32 STEP 2802 H=2802:00 +CPU= 28.049 10:04:48 STEP 2803 H=2803:00 +CPU= 16.261 10:05:05 STEP 2804 H=2804:00 +CPU= 16.733 10:05:30 STEP 2805 H=2805:00 +CPU= 24.608 10:05:47 STEP 2806 H=2806:00 +CPU= 16.726 10:06:05 STEP 2807 H=2807:00 +CPU= 17.669 10:06:37 STEP 2808 H=2808:00 +CPU= 31.453 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMGGhnw4+002808 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMSHhnw4+002808 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMUAhnw4+002808 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMGGhnw4+002784 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMSHhnw4+002784 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMUAhnw4+002784 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMGGhnw4+002796 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMSHhnw4+002796 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMUAhnw4+002796 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_0050_2019110100_123_993_12213618_0_r1209190187_116.zip Uploading the intermediate file: upload_file_116.zip 10:06:53 STEP 2809 H=2809:00 +CPU= 16.481 10:07:10 STEP 2810 H=2810:00 +CPU= 17.024 10:07:38 STEP 2811 H=2811:00 +CPU= 27.154 10:07:55 STEP 2812 H=2812:00 +CPU= 17.018 10:08:11 STEP 2813 H=2813:00 +CPU= 16.313 10:08:38 STEP 2814 H=2814:00 +CPU= 26.321 10:08:54 STEP 2815 H=2815:00 +CPU= 15.955 10:09:10 STEP 2816 H=2816:00 +CPU= 16.349 10:09:36 STEP 2817 H=2817:00 +CPU= 25.894 10:09:54 STEP 2818 H=2818:00 +CPU= 17.321 10:10:10 STEP 2819 H=2819:00 +CPU= 16.370 10:10:39 STEP 2820 H=2820:00 +CPU= 28.730 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMGGhnw4+002820 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMSHhnw4+002820 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMUAhnw4+002820 10:10:56 STEP 2821 H=2821:00 +CPU= 16.514 10:11:13 STEP 2822 H=2822:00 +CPU= 16.897 10:11:39 STEP 2823 H=2823:00 +CPU= 25.688 10:11:56 STEP 2824 H=2824:00 +CPU= 17.144 10:12:12 STEP 2825 H=2825:00 +CPU= 16.346 10:12:39 STEP 2826 H=2826:00 +CPU= 26.664 10:12:56 STEP 2827 H=2827:00 +CPU= 16.330 10:13:13 STEP 2828 H=2828:00 +CPU= 17.144 10:13:40 STEP 2829 H=2829:00 +CPU= 26.744 10:13:57 STEP 2830 H=2830:00 +CPU= 16.432 10:14:13 STEP 2831 H=2831:00 +CPU= 16.573 10:14:44 STEP 2832 H=2832:00 +CPU= 30.438 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMGGhnw4+002832 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMSHhnw4+002832 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMUAhnw4+002832 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMGGhnw4+002808 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMSHhnw4+002808 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMUAhnw4+002808 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMGGhnw4+002820 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMSHhnw4+002820 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMUAhnw4+002820 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_0050_2019110100_123_993_12213618_0_r1209190187_117.zip Uploading the intermediate file: upload_file_117.zip 10:15:00 STEP 2833 H=2833:00 +CPU= 16.318 10:15:18 STEP 2834 H=2834:00 +CPU= 16.853 10:15:44 STEP 2835 H=2835:00 +CPU= 26.188 10:16:01 STEP 2836 H=2836:00 +CPU= 16.803 10:16:17 STEP 2837 H=2837:00 +CPU= 16.428 10:16:44 STEP 2838 H=2838:00 +CPU= 26.401 10:17:00 STEP 2839 H=2839:00 +CPU= 16.375 10:17:18 STEP 2840 H=2840:00 +CPU= 17.020 10:17:43 STEP 2841 H=2841:00 +CPU= 25.533 10:18:00 STEP 2842 H=2842:00 +CPU= 17.189 10:18:17 STEP 2843 H=2843:00 +CPU= 16.533 10:18:46 STEP 2844 H=2844:00 +CPU= 28.363 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMGGhnw4+002844 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMSHhnw4+002844 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMUAhnw4+002844 10:19:02 STEP 2845 H=2845:00 +CPU= 16.708 10:19:19 STEP 2846 H=2846:00 +CPU= 16.949 10:19:46 STEP 2847 H=2847:00 +CPU= 25.923 10:20:03 STEP 2848 H=2848:00 +CPU= 16.933 10:20:20 STEP 2849 H=2849:00 +CPU= 16.783 10:20:46 STEP 2850 H=2850:00 +CPU= 26.341 10:21:02 STEP 2851 H=2851:00 +CPU= 16.256 10:21:20 STEP 2852 H=2852:00 +CPU= 16.933 10:21:46 STEP 2853 H=2853:00 +CPU= 26.300 10:22:03 STEP 2854 H=2854:00 +CPU= 17.105 10:22:20 STEP 2855 H=2855:00 +CPU= 17.064 10:22:51 STEP 2856 H=2856:00 +CPU= 29.777 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMGGhnw4+002856 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMSHhnw4+002856 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMUAhnw4+002856 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMGGhnw4+002832 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMSHhnw4+002832 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMUAhnw4+002832 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMGGhnw4+002844 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMSHhnw4+002844 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMUAhnw4+002844 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_0050_2019110100_123_993_12213618_0_r1209190187_118.zip Uploading the intermediate file: upload_file_118.zip 10:23:07 STEP 2857 H=2857:00 +CPU= 16.542 10:23:24 STEP 2858 H=2858:00 +CPU= 16.982 10:23:50 STEP 2859 H=2859:00 +CPU= 25.090 10:24:07 STEP 2860 H=2860:00 +CPU= 17.756 10:24:24 STEP 2861 H=2861:00 +CPU= 16.231 10:24:51 STEP 2862 H=2862:00 +CPU= 26.625 10:25:08 STEP 2863 H=2863:00 +CPU= 16.902 10:25:25 STEP 2864 H=2864:00 +CPU= 16.836 10:25:51 STEP 2865 H=2865:00 +CPU= 26.048 10:26:09 STEP 2866 H=2866:00 +CPU= 17.728 10:26:25 STEP 2867 H=2867:00 +CPU= 16.376 10:26:53 STEP 2868 H=2868:00 +CPU= 27.966 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMGGhnw4+002868 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMSHhnw4+002868 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMUAhnw4+002868 10:27:11 STEP 2869 H=2869:00 +CPU= 17.536 10:27:28 STEP 2870 H=2870:00 +CPU= 16.917 10:27:53 STEP 2871 H=2871:00 +CPU= 25.172 10:28:11 STEP 2872 H=2872:00 +CPU= 17.283 10:28:28 STEP 2873 H=2873:00 +CPU= 16.723 10:28:54 STEP 2874 H=2874:00 +CPU= 25.849 10:29:11 STEP 2875 H=2875:00 +CPU= 17.096 10:29:28 STEP 2876 H=2876:00 +CPU= 16.950 10:29:54 STEP 2877 H=2877:00 +CPU= 25.417 10:30:11 STEP 2878 H=2878:00 +CPU= 17.475 10:30:28 STEP 2879 H=2879:00 +CPU= 17.122 10:30:59 STEP 2880 H=2880:00 +CPU= 30.380 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMGGhnw4+002880 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMSHhnw4+002880 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMUAhnw4+002880 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMGGhnw4+002856 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMSHhnw4+002856 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMUAhnw4+002856 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMGGhnw4+002868 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMSHhnw4+002868 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMUAhnw4+002868 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_0050_2019110100_123_993_12213618_0_r1209190187_119.zip Uploading the intermediate file: upload_file_119.zip 10:31:16 STEP 2881 H=2881:00 +CPU= 16.312 10:31:32 STEP 2882 H=2882:00 +CPU= 16.703 10:31:59 STEP 2883 H=2883:00 +CPU= 26.431 10:32:16 STEP 2884 H=2884:00 +CPU= 16.937 10:32:32 STEP 2885 H=2885:00 +CPU= 15.893 10:32:58 STEP 2886 H=2886:00 +CPU= 25.966 10:33:15 STEP 2887 H=2887:00 +CPU= 17.036 10:33:32 STEP 2888 H=2888:00 +CPU= 16.486 10:33:57 STEP 2889 H=2889:00 +CPU= 25.424 10:34:15 STEP 2890 H=2890:00 +CPU= 17.167 10:34:32 STEP 2891 H=2891:00 +CPU= 16.752 10:35:00 STEP 2892 H=2892:00 +CPU= 28.214 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMGGhnw4+002892 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMSHhnw4+002892 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMUAhnw4+002892 10:35:17 STEP 2893 H=2893:00 +CPU= 16.537 10:35:33 STEP 2894 H=2894:00 +CPU= 16.743 10:35:58 STEP 2895 H=2895:00 +CPU= 24.841 10:36:17 STEP 2896 H=2896:00 +CPU= 17.981 10:36:33 STEP 2897 H=2897:00 +CPU= 16.280 10:36:59 STEP 2898 H=2898:00 +CPU= 26.090 10:37:17 STEP 2899 H=2899:00 +CPU= 17.253 10:37:34 STEP 2900 H=2900:00 +CPU= 17.086 10:37:59 STEP 2901 H=2901:00 +CPU= 25.301 10:38:17 STEP 2902 H=2902:00 +CPU= 17.721 10:38:34 STEP 2903 H=2903:00 +CPU= 17.087 10:39:05 STEP 2904 H=2904:00 +CPU= 30.206 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMGGhnw4+002904 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMSHhnw4+002904 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMUAhnw4+002904 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMGGhnw4+002880 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMSHhnw4+002880 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMUAhnw4+002880 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMGGhnw4+002892 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMSHhnw4+002892 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMUAhnw4+002892 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_0050_2019110100_123_993_12213618_0_r1209190187_120.zip Uploading the intermediate file: upload_file_120.zip 10:39:22 STEP 2905 H=2905:00 +CPU= 16.553 10:39:38 STEP 2906 H=2906:00 +CPU= 16.570 10:40:04 STEP 2907 H=2907:00 +CPU= 25.824 10:40:22 STEP 2908 H=2908:00 +CPU= 18.130 10:40:39 STEP 2909 H=2909:00 +CPU= 16.213 10:41:06 STEP 2910 H=2910:00 +CPU= 26.734 10:41:24 STEP 2911 H=2911:00 +CPU= 17.927 10:41:42 STEP 2912 H=2912:00 +CPU= 17.960 10:42:08 STEP 2913 H=2913:00 +CPU= 26.209 10:42:25 STEP 2914 H=2914:00 +CPU= 16.947 10:42:42 STEP 2915 H=2915:00 +CPU= 16.784 10:43:10 STEP 2916 H=2916:00 +CPU= 27.550 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMGGhnw4+002916 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMSHhnw4+002916 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMUAhnw4+002916 10:43:26 STEP 2917 H=2917:00 +CPU= 16.293 10:43:43 STEP 2918 H=2918:00 +CPU= 16.975 10:44:09 STEP 2919 H=2919:00 +CPU= 25.375 10:44:26 STEP 2920 H=2920:00 +CPU= 16.780 10:44:42 STEP 2921 H=2921:00 +CPU= 16.205 10:45:09 STEP 2922 H=2922:00 +CPU= 26.767 10:45:26 STEP 2923 H=2923:00 +CPU= 16.883 10:45:44 STEP 2924 H=2924:00 +CPU= 17.256 10:46:10 STEP 2925 H=2925:00 +CPU= 25.784 10:46:26 STEP 2926 H=2926:00 +CPU= 16.632 10:46:45 STEP 2927 H=2927:00 +CPU= 17.915 10:47:16 STEP 2928 H=2928:00 +CPU= 31.445 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMGGhnw4+002928 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMSHhnw4+002928 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMUAhnw4+002928 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMGGhnw4+002904 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMSHhnw4+002904 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMUAhnw4+002904 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMGGhnw4+002916 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMSHhnw4+002916 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMUAhnw4+002916 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_0050_2019110100_123_993_12213618_0_r1209190187_121.zip Uploading the intermediate file: upload_file_121.zip 10:47:33 STEP 2929 H=2929:00 +CPU= 15.952 10:47:49 STEP 2930 H=2930:00 +CPU= 16.202 10:48:15 STEP 2931 H=2931:00 +CPU= 25.511 10:48:32 STEP 2932 H=2932:00 +CPU= 17.836 10:48:50 STEP 2933 H=2933:00 +CPU= 16.774 10:49:16 STEP 2934 H=2934:00 +CPU= 25.894 10:49:31 STEP 2935 H=2935:00 +CPU= 15.759 10:49:49 STEP 2936 H=2936:00 +CPU= 16.878 10:50:14 STEP 2937 H=2937:00 +CPU= 25.662 10:50:32 STEP 2938 H=2938:00 +CPU= 17.178 10:50:49 STEP 2939 H=2939:00 +CPU= 16.632 10:51:17 STEP 2940 H=2940:00 +CPU= 27.933 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMGGhnw4+002940 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMSHhnw4+002940 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMUAhnw4+002940 10:51:33 STEP 2941 H=2941:00 +CPU= 16.648 10:51:51 STEP 2942 H=2942:00 +CPU= 17.172 10:52:17 STEP 2943 H=2943:00 +CPU= 26.638 10:52:35 STEP 2944 H=2944:00 +CPU= 17.385 10:52:51 STEP 2945 H=2945:00 +CPU= 16.219 10:53:18 STEP 2946 H=2946:00 +CPU= 26.385 10:53:34 STEP 2947 H=2947:00 +CPU= 16.555 10:53:51 STEP 2948 H=2948:00 +CPU= 16.849 10:54:18 STEP 2949 H=2949:00 +CPU= 25.950 10:54:35 STEP 2950 H=2950:00 +CPU= 17.016 10:54:52 STEP 2951 H=2951:00 +CPU= 17.241 10:55:22 STEP 2952 H=2952:00 +CPU= 29.552 ..The child process terminated with status: 0 >>> Printing last 70 lines from file: NODE.001_01 STEPO, YSPSDT_AR1 ( 1,...), SP NORMS 2D: 4.865283731608E-01 1.865286143845E-01 6.362598939121E-02 STEPO, YSPSDT_AR1 (SUM,...), SP NORMS 2D: 5.260318722649E-01 STEPO, YGPSDT ( 1,...), Grid Point Norms FIELD LEV AVERAGE MINIMUM MAXIMUM 101 60 3.48989191816039E-02 -1.72994898449055E+00 1.89761310057317E+00 STEPO, YGPSDT[clipped]( 1,...), Grid Point Norms FIELD LEV AVERAGE MINIMUM MAXIMUM 101 60 3.19925486346338E-02 -1.00000000000000E+00 1.00000000000000E+00 MAXGPFV : MAX. VALUE = 1.11184008050640 MAXGPFV : MAX. VALUE = 0.762859972031342 NSTEP = 2952 SCAN2M_HPOS P IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH = ICMGGhnw4+002952 MODE=a IO-STREAM CLOSED - ICMGGhnw4+002952 MPI-TASK: 1 - 337137418 BYTES IN 8 RECORDS TRANSFERRED IN 0.0004 SECONDS842843.5 Mbytes/s, TOTAL TIME= 0.0082( 4.9%) !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED. DATE IS: 20200302231500 !!!!!!!!!!!! !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED. DATE IS: 20200302233000 !!!!!!!!!!!! !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED. DATE IS: 20200302234500 !!!!!!!!!!!! !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED. DATE IS: 20200303000000 !!!!!!!!!!!! 10:55:22 STEP 2952 H=2952:00 +CPU= 29.552 END CNT3 NSTEP = 2952 CNT0 000000000 25.779 25.779 25.944 0.994 0 0 0 0 0 IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ 35/ 804992476 WRITTEN 3357/********* -TASK-OPENED-OPEN-RECS IN -KBYTE IN -RECS OUT-KBYTE OUT-WALL -WALL IN-WALL OU-TOT IN -TOT OUT 1 84 0 35 786125 3357 ******** 12.9 1.2 11.8 1.6 18.3 ===-=== START OF TIMING STATISTICS ===-=== STATS FOR ALL TASKS NUM ROUTINE CALLS MEAN(ms) MAX(ms) FRAC(%) UNBAL(%) 0 CNT0 - COMPLETE EXECUTION 1 4427680.4 4427680.4 100.00 0.00 1 CNT4 - FORWARD INTEGRATION 1 4425250.8 4425250.8 99.95 0.00 8 SCAN2M - GRID-POINT DYNAMICS 235 2059.9 2059.9 10.93 0.00 9 SPCM - SPECTRAL COMP. 216 314.6 314.6 1.53 0.00 10 SCAN2M - PHYSICS 217 8601.7 8601.7 42.16 0.00 11 IOPACK - OUTPUT P.P. RESULTS 18 984.8 984.8 0.40 0.00 12 SPNORM - SPECTRAL NORM COMP. 10 19.2 19.2 0.00 0.00 13 SCAN2M - RADIATION CALC. 73 9267.5 9267.5 15.28 0.00 17 GRIDFPOS IN CNT4 18 40.2 40.2 0.02 0.00 27 RESTART FILES - WRITING 9 1969.5 1969.5 0.40 0.00 28 RESTART FILES - READING 1 2076.3 2076.3 0.05 0.00 29 SU4FPOS IN CNT4 18 0.1 0.1 0.00 0.00 30 DYNFPOS IN CNT4 18 1652.6 1652.6 0.67 0.00 31 POSDDH IN STEPO 1 8.0 8.0 0.00 0.00 37 CPGLAG - SL COMPUTATIONS 217 2520.2 2520.2 12.35 0.00 38 WAM - TOTAL COST OF WAVE MODEL 217 2081.1 2081.1 10.20 0.00 39 SU0YOMB 1 207.0 207.0 0.00 0.00 51 SCAN2M - SL COMM. PART 1 217 15.3 15.3 0.08 0.00 54 SPCM - M TO S/S TO M TRANSP. 216 222.5 222.5 1.09 0.00 55 SPCIMPF - S TO M/M TO S TRANSP. 216 22.9 22.9 0.11 0.00 56 SPNORM - SPECTRAL NORM COMM. 10 0.1 0.1 0.00 0.00 102 LTINV_CTL - INVERSE LEGENDRE TRANSFORM 744 104.2 104.2 1.75 0.00 103 LTDIR_CTL - DIRECT LEGENDRE TRANSFORM 450 102.1 102.1 1.04 0.00 106 FTDIR_CTL - DIRECT FOURIER TRANSFORM 450 43.1 43.1 0.44 0.00 107 FTINV_CTL - INVERSE FOURIER TRANSFORM 744 35.7 35.7 0.60 0.00 140 SULEG - COMP. OF LEGENDRE POL. 2 15.9 15.9 0.00 0.00 152 LTINV_CTL - M TO L TRANSPOSITION 744 18.1 18.1 0.30 0.00 153 LTDIR_CTL - L TO M TRANSPOSITION 450 16.1 16.1 0.16 0.00 157 FTINV_CTL - L TO G TRANSPOSITION 744 29.5 29.5 0.50 0.00 158 FTDIR_CTL - G TO L TRANSPOSITION 450 22.8 22.8 0.23 0.00 400 GSTATS 44195 0.0 0.0 0.00 0.00 401 GSTATS HOOK 42263 0.0 0.0 0.00 0.00 TOTAL MEASURED IMBALANCE = 0.0 SECONDS, 0.0 PERCENT TOTAL WALLCLOCK TIME 4427.7 CPU TIME 4393.7 VECTOR TIME 4393.7 ===-=== END OF TIMING STATISTICS ===-=== FORECAST DAYS PER DAY 2401.5 * END CNT0 *** ------------------------------------------------ Moving to projects directory: /var/lib/boinc-client/slots/14/ICMGGhnw4+002952 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMSHhnw4+002952 Moving to projects directory: /var/lib/boinc-client/slots/14/ICMUAhnw4+002952 Adding to the zip: /var/lib/boinc-client/slots/14/NODE.001_01 Adding to the zip: /var/lib/boinc-client/slots/14/ifs.stat Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMGGhnw4+002952 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMUAhnw4+002928 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMSHhnw4+002940 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMGGhnw4+002928 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMSHhnw4+002952 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMUAhnw4+002952 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMUAhnw4+002940 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMGGhnw4+002940 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213618/ICMSHhnw4+002928 Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_0050_2019110100_123_993_12213618_0_r1209190187_122.zip Uploading the final file: upload_file_122.zip Uploading trickle at timestep: 10623600 10:58:44 (569275): called boinc_finish(0) </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
09 May 2023 16:53:52	1532237	22314964	oifs_43r3_0050_2019110100_123_993_12213618_0	10,623,600	60,260	0.0057
09 May 2023 16:53:46	1532237	22314964	oifs_43r3_0050_2019110100_123_993_12213618_0	9,158,400	51,613	0.0056
09 May 2023 16:53:40	1532237	22314964	oifs_43r3_0050_2019110100_123_993_12213618_0	7,689,600	43,039	0.0056
09 May 2023 16:53:31	1532237	22314964	oifs_43r3_0050_2019110100_123_993_12213618_0	6,048,000	33,548	0.0055
09 May 2023 16:53:25	1532237	22314964	oifs_43r3_0050_2019110100_123_993_12213618_0	4,924,800	27,155	0.0055
09 May 2023 16:53:22	1532237	22314964	oifs_43r3_0050_2019110100_123_993_12213618_0	4,060,800	22,312	0.0055
09 May 2023 16:53:13	1532237	22314964	oifs_43r3_0050_2019110100_123_993_12213618_0	2,592,000	13,827	0.0053
09 May 2023 16:53:10	1532237	22314964	oifs_43r3_0050_2019110100_123_993_12213618_0	1,728,000	9,109	0.0053
09 May 2023 16:53:06	1532237	22314964	oifs_43r3_0050_2019110100_123_993_12213618_0	864,000	4,489	0.0052