climateprediction.net home page
Task 22298416

Task 22298416

Name oifs_43r3_ps_0718_1997050100_123_966_12183362_1
Workunit 12183362
Created 16 Jan 2023, 5:04:20 UTC
Sent 21 Jan 2023, 19:40:57 UTC
Report deadline 22 Mar 2023, 19:40:57 UTC
Received 4 Feb 2023, 21:06:45 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1525245
Run time 1 days 17 hours 6 min 4 sec
CPU time 1 days 11 hours 40 min 56 sec
Validate state Valid
Credit 14,873.04
Device peak FLOPS 4.12 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,418.82 MB
Peak swap size 4,978.08 MB
Peak disk usage 3,644.77 MB
Stderr
<core_client_version>7.18.1</core_client_version>
<![CDATA[
<stderr_txt>
ctory: /var/lib/boinc-client/slots/20/ICMUAhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMGGhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMSHhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMUAhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMGGhq0f+002484
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMSHhq0f+002484
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMUAhq0f+002484
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0718_1997050100_123_966_12183362_1_r206658911_103.zip
Uploading the intermediate file: upload_file_103.zip
  12:51:00 STEP 2497 H=2497:00 +CPU= 32.774
  12:51:39 STEP 2498 H=2498:00 +CPU= 33.641
  12:52:38 STEP 2499 H=2499:00 +CPU= 51.219
  12:53:16 STEP 2500 H=2500:00 +CPU= 34.220
  12:53:54 STEP 2501 H=2501:00 +CPU= 33.324
  12:54:55 STEP 2502 H=2502:00 +CPU= 52.904
  12:55:33 STEP 2503 H=2503:00 +CPU= 32.633
  12:56:11 STEP 2504 H=2504:00 +CPU= 33.705
  12:57:08 STEP 2505 H=2505:00 +CPU= 51.811
  12:57:47 STEP 2506 H=2506:00 +CPU= 33.862
  12:58:26 STEP 2507 H=2507:00 +CPU= 32.670
  12:59:32 STEP 2508 H=2508:00 +CPU= 57.081
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMGGhq0f+002508
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMSHhq0f+002508
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMUAhq0f+002508
  13:00:10 STEP 2509 H=2509:00 +CPU= 32.586
  13:00:49 STEP 2510 H=2510:00 +CPU= 33.672
  13:01:49 STEP 2511 H=2511:00 +CPU= 51.424
  13:02:27 STEP 2512 H=2512:00 +CPU= 33.589
  13:03:04 STEP 2513 H=2513:00 +CPU= 32.484
  13:04:02 STEP 2514 H=2514:00 +CPU= 53.063
  13:04:40 STEP 2515 H=2515:00 +CPU= 32.808
  13:05:18 STEP 2516 H=2516:00 +CPU= 33.324
  13:06:17 STEP 2517 H=2517:00 +CPU= 51.508
  13:06:55 STEP 2518 H=2518:00 +CPU= 33.754
  13:07:33 STEP 2519 H=2519:00 +CPU= 33.814
  13:08:44 STEP 2520 H=2520:00 +CPU= 61.485
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMGGhq0f+002520
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMSHhq0f+002520
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMUAhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMGGhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMSHhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMUAhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMGGhq0f+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMSHhq0f+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMUAhq0f+002508
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0718_1997050100_123_966_12183362_1_r206658911_104.zip
Uploading the intermediate file: upload_file_104.zip
  13:09:22 STEP 2521 H=2521:00 +CPU= 32.966
  13:10:01 STEP 2522 H=2522:00 +CPU= 34.580
  13:11:00 STEP 2523 H=2523:00 +CPU= 52.056
  13:11:39 STEP 2524 H=2524:00 +CPU= 35.385
  13:12:18 STEP 2525 H=2525:00 +CPU= 33.344
  13:13:19 STEP 2526 H=2526:00 +CPU= 53.574
  13:13:58 STEP 2527 H=2527:00 +CPU= 33.033
  13:14:35 STEP 2528 H=2528:00 +CPU= 33.975
  13:15:32 STEP 2529 H=2529:00 +CPU= 52.073
  13:16:10 STEP 2530 H=2530:00 +CPU= 34.130
  13:16:46 STEP 2531 H=2531:00 +CPU= 33.224
  13:17:52 STEP 2532 H=2532:00 +CPU= 58.740
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMGGhq0f+002532
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMSHhq0f+002532
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMUAhq0f+002532
  13:18:30 STEP 2533 H=2533:00 +CPU= 33.071
  13:19:08 STEP 2534 H=2534:00 +CPU= 34.043
  13:20:06 STEP 2535 H=2535:00 +CPU= 53.250
  13:20:44 STEP 2536 H=2536:00 +CPU= 34.519
  13:21:21 STEP 2537 H=2537:00 +CPU= 32.779
  13:22:22 STEP 2538 H=2538:00 +CPU= 53.027
  13:22:58 STEP 2539 H=2539:00 +CPU= 32.738
  13:23:36 STEP 2540 H=2540:00 +CPU= 34.027
  13:24:34 STEP 2541 H=2541:00 +CPU= 51.993
  13:25:13 STEP 2542 H=2542:00 +CPU= 34.248
  13:25:52 STEP 2543 H=2543:00 +CPU= 33.862
  13:27:02 STEP 2544 H=2544:00 +CPU= 61.547
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMGGhq0f+002544
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMSHhq0f+002544
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMUAhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMGGhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMSHhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMUAhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMGGhq0f+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMSHhq0f+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMUAhq0f+002532
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0718_1997050100_123_966_12183362_1_r206658911_105.zip
Uploading the intermediate file: upload_file_105.zip
  13:27:40 STEP 2545 H=2545:00 +CPU= 33.198
  13:28:19 STEP 2546 H=2546:00 +CPU= 34.276
  13:29:18 STEP 2547 H=2547:00 +CPU= 52.100
  13:29:57 STEP 2548 H=2548:00 +CPU= 34.006
  13:30:36 STEP 2549 H=2549:00 +CPU= 33.210
  13:31:35 STEP 2550 H=2550:00 +CPU= 53.204
  13:32:14 STEP 2551 H=2551:00 +CPU= 33.307
  13:32:53 STEP 2552 H=2552:00 +CPU= 34.366
  13:33:53 STEP 2553 H=2553:00 +CPU= 52.560
  13:34:32 STEP 2554 H=2554:00 +CPU= 34.577
  13:35:11 STEP 2555 H=2555:00 +CPU= 32.837
  13:36:16 STEP 2556 H=2556:00 +CPU= 57.875
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMGGhq0f+002556
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMSHhq0f+002556
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMUAhq0f+002556
  13:36:53 STEP 2557 H=2557:00 +CPU= 32.943
  13:37:30 STEP 2558 H=2558:00 +CPU= 33.626
  13:38:25 STEP 2559 H=2559:00 +CPU= 52.347
  13:39:02 STEP 2560 H=2560:00 +CPU= 34.039
  13:39:38 STEP 2561 H=2561:00 +CPU= 33.721
  13:40:38 STEP 2562 H=2562:00 +CPU= 52.674
  13:41:14 STEP 2563 H=2563:00 +CPU= 32.668
  13:41:53 STEP 2564 H=2564:00 +CPU= 33.557
  13:42:53 STEP 2565 H=2565:00 +CPU= 53.076
  13:43:33 STEP 2566 H=2566:00 +CPU= 33.565
  13:44:11 STEP 2567 H=2567:00 +CPU= 33.881
  13:45:21 STEP 2568 H=2568:00 +CPU= 61.192
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMGGhq0f+002568
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMSHhq0f+002568
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMUAhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMGGhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMSHhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMUAhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMGGhq0f+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMSHhq0f+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMUAhq0f+002556
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0718_1997050100_123_966_12183362_1_r206658911_106.zip
Uploading the intermediate file: upload_file_106.zip
  13:45:59 STEP 2569 H=2569:00 +CPU= 32.501
  13:46:37 STEP 2570 H=2570:00 +CPU= 33.805
  13:47:36 STEP 2571 H=2571:00 +CPU= 51.035
  13:48:15 STEP 2572 H=2572:00 +CPU= 33.960
  13:48:52 STEP 2573 H=2573:00 +CPU= 32.601
  13:49:52 STEP 2574 H=2574:00 +CPU= 53.742
  13:50:30 STEP 2575 H=2575:00 +CPU= 32.613
  13:51:08 STEP 2576 H=2576:00 +CPU= 33.407
  13:52:08 STEP 2577 H=2577:00 +CPU= 52.319
  13:52:47 STEP 2578 H=2578:00 +CPU= 34.128
  13:53:26 STEP 2579 H=2579:00 +CPU= 32.729
  13:54:36 STEP 2580 H=2580:00 +CPU= 57.369
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMGGhq0f+002580
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMSHhq0f+002580
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMUAhq0f+002580
  13:55:14 STEP 2581 H=2581:00 +CPU= 33.271
  13:55:53 STEP 2582 H=2582:00 +CPU= 34.295
  13:56:56 STEP 2583 H=2583:00 +CPU= 52.067
  13:57:36 STEP 2584 H=2584:00 +CPU= 33.837
  13:58:13 STEP 2585 H=2585:00 +CPU= 32.441
  13:59:13 STEP 2586 H=2586:00 +CPU= 52.523
  13:59:52 STEP 2587 H=2587:00 +CPU= 32.991
  14:00:30 STEP 2588 H=2588:00 +CPU= 33.690
  14:01:30 STEP 2589 H=2589:00 +CPU= 51.008
  14:02:10 STEP 2590 H=2590:00 +CPU= 33.351
  14:02:51 STEP 2591 H=2591:00 +CPU= 33.697
  14:04:00 STEP 2592 H=2592:00 +CPU= 60.869
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMGGhq0f+002592
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMSHhq0f+002592
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMUAhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMGGhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMSHhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMUAhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMGGhq0f+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMSHhq0f+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMUAhq0f+002580
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0718_1997050100_123_966_12183362_1_r206658911_107.zip
Uploading the intermediate file: upload_file_107.zip
  14:04:37 STEP 2593 H=2593:00 +CPU= 32.888
  14:05:15 STEP 2594 H=2594:00 +CPU= 34.219
  14:06:13 STEP 2595 H=2595:00 +CPU= 51.768
  14:06:50 STEP 2596 H=2596:00 +CPU= 33.884
  14:07:27 STEP 2597 H=2597:00 +CPU= 32.159
  14:08:29 STEP 2598 H=2598:00 +CPU= 52.895
  14:09:04 STEP 2599 H=2599:00 +CPU= 33.044
  14:09:42 STEP 2600 H=2600:00 +CPU= 33.816
  14:10:40 STEP 2601 H=2601:00 +CPU= 51.357
  14:11:18 STEP 2602 H=2602:00 +CPU= 33.634
  14:11:55 STEP 2603 H=2603:00 +CPU= 32.008
  14:13:00 STEP 2604 H=2604:00 +CPU= 57.294
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMGGhq0f+002604
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMSHhq0f+002604
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMUAhq0f+002604
  14:13:38 STEP 2605 H=2605:00 +CPU= 32.726
  14:14:16 STEP 2606 H=2606:00 +CPU= 33.726
  14:15:13 STEP 2607 H=2607:00 +CPU= 51.540
  14:15:52 STEP 2608 H=2608:00 +CPU= 33.488
  14:16:29 STEP 2609 H=2609:00 +CPU= 32.186
  14:17:28 STEP 2610 H=2610:00 +CPU= 52.344
  14:18:06 STEP 2611 H=2611:00 +CPU= 32.592
  14:18:44 STEP 2612 H=2612:00 +CPU= 33.875
  14:19:40 STEP 2613 H=2613:00 +CPU= 51.098
  14:20:18 STEP 2614 H=2614:00 +CPU= 33.407
  14:20:57 STEP 2615 H=2615:00 +CPU= 33.471
  14:22:04 STEP 2616 H=2616:00 +CPU= 59.907
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMGGhq0f+002616
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMSHhq0f+002616
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMUAhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMGGhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMSHhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMUAhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMGGhq0f+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMSHhq0f+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMUAhq0f+002604
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0718_1997050100_123_966_12183362_1_r206658911_108.zip
Uploading the intermediate file: upload_file_108.zip
  14:22:39 STEP 2617 H=2617:00 +CPU= 32.362
  14:23:14 STEP 2618 H=2618:00 +CPU= 33.564
  14:24:09 STEP 2619 H=2619:00 +CPU= 51.091
  14:24:44 STEP 2620 H=2620:00 +CPU= 33.530
  14:25:20 STEP 2621 H=2621:00 +CPU= 31.886
  14:26:21 STEP 2622 H=2622:00 +CPU= 51.750
  14:26:56 STEP 2623 H=2623:00 +CPU= 32.295
  14:27:33 STEP 2624 H=2624:00 +CPU= 33.012
  14:28:29 STEP 2625 H=2625:00 +CPU= 51.608
  14:29:06 STEP 2626 H=2626:00 +CPU= 32.767
  14:29:42 STEP 2627 H=2627:00 +CPU= 32.347
  14:30:47 STEP 2628 H=2628:00 +CPU= 56.276
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMGGhq0f+002628
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMSHhq0f+002628
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMUAhq0f+002628
  14:31:22 STEP 2629 H=2629:00 +CPU= 31.975
  14:32:02 STEP 2630 H=2630:00 +CPU= 33.192
  14:33:00 STEP 2631 H=2631:00 +CPU= 51.166
  14:33:37 STEP 2632 H=2632:00 +CPU= 33.434
  14:34:14 STEP 2633 H=2633:00 +CPU= 32.070
  14:35:13 STEP 2634 H=2634:00 +CPU= 52.315
  14:35:49 STEP 2635 H=2635:00 +CPU= 32.285
  14:36:25 STEP 2636 H=2636:00 +CPU= 32.674
  14:37:24 STEP 2637 H=2637:00 +CPU= 51.024
  14:38:01 STEP 2638 H=2638:00 +CPU= 32.866
  14:38:37 STEP 2639 H=2639:00 +CPU= 33.139
  14:39:45 STEP 2640 H=2640:00 +CPU= 60.429
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMGGhq0f+002640
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMSHhq0f+002640
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMUAhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMGGhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMSHhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMUAhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMGGhq0f+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMSHhq0f+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMUAhq0f+002628
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0718_1997050100_123_966_12183362_1_r206658911_109.zip
Uploading the intermediate file: upload_file_109.zip
  14:40:20 STEP 2641 H=2641:00 +CPU= 31.725
  14:40:58 STEP 2642 H=2642:00 +CPU= 33.152
  14:41:53 STEP 2643 H=2643:00 +CPU= 50.910
  14:42:29 STEP 2644 H=2644:00 +CPU= 33.093
  14:43:05 STEP 2645 H=2645:00 +CPU= 32.968
  14:44:04 STEP 2646 H=2646:00 +CPU= 51.596
  14:44:41 STEP 2647 H=2647:00 +CPU= 32.071
  14:45:19 STEP 2648 H=2648:00 +CPU= 32.894
  14:46:16 STEP 2649 H=2649:00 +CPU= 50.908
  14:46:54 STEP 2650 H=2650:00 +CPU= 32.889
  14:47:29 STEP 2651 H=2651:00 +CPU= 32.739
  14:48:35 STEP 2652 H=2652:00 +CPU= 58.408
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMGGhq0f+002652
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMSHhq0f+002652
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMUAhq0f+002652
  14:49:13 STEP 2653 H=2653:00 +CPU= 32.035
  14:49:49 STEP 2654 H=2654:00 +CPU= 33.698
  14:50:47 STEP 2655 H=2655:00 +CPU= 51.087
  14:51:24 STEP 2656 H=2656:00 +CPU= 33.437
  14:52:00 STEP 2657 H=2657:00 +CPU= 31.946
  14:53:00 STEP 2658 H=2658:00 +CPU= 52.214
  14:53:37 STEP 2659 H=2659:00 +CPU= 32.745
  14:54:14 STEP 2660 H=2660:00 +CPU= 33.725
  14:55:14 STEP 2661 H=2661:00 +CPU= 51.454
  14:55:52 STEP 2662 H=2662:00 +CPU= 32.731
  14:56:31 STEP 2663 H=2663:00 +CPU= 33.101
  14:57:41 STEP 2664 H=2664:00 +CPU= 60.658
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMGGhq0f+002664
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMSHhq0f+002664
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMUAhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMGGhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMSHhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMUAhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMGGhq0f+002652
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMSHhq0f+002652
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMUAhq0f+002652
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0718_1997050100_123_966_12183362_1_r206658911_110.zip
Uploading the intermediate file: upload_file_110.zip
Uploading trickle at timestep: 9590400
  14:58:17 STEP 2665 H=2665:00 +CPU= 32.996
  14:58:56 STEP 2666 H=2666:00 +CPU= 33.039
  14:59:56 STEP 2667 H=2667:00 +CPU= 51.112
  15:00:33 STEP 2668 H=2668:00 +CPU= 33.069
  15:01:08 STEP 2669 H=2669:00 +CPU= 32.634
  15:02:06 STEP 2670 H=2670:00 +CPU= 51.888
  15:02:41 STEP 2671 H=2671:00 +CPU= 31.911
  15:03:19 STEP 2672 H=2672:00 +CPU= 33.149
  15:04:19 STEP 2673 H=2673:00 +CPU= 50.891
  15:04:57 STEP 2674 H=2674:00 +CPU= 33.208
  15:05:33 STEP 2675 H=2675:00 +CPU= 32.776
  15:06:39 STEP 2676 H=2676:00 +CPU= 56.814
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMGGhq0f+002676
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMSHhq0f+002676
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMUAhq0f+002676
  15:07:15 STEP 2677 H=2677:00 +CPU= 32.354
  15:07:52 STEP 2678 H=2678:00 +CPU= 33.845
  15:08:50 STEP 2679 H=2679:00 +CPU= 50.628
  15:09:27 STEP 2680 H=2680:00 +CPU= 33.129
  15:10:03 STEP 2681 H=2681:00 +CPU= 31.984
  15:11:02 STEP 2682 H=2682:00 +CPU= 52.671
  15:11:37 STEP 2683 H=2683:00 +CPU= 32.320
  15:12:16 STEP 2684 H=2684:00 +CPU= 33.321
  15:13:14 STEP 2685 H=2685:00 +CPU= 50.626
  15:13:51 STEP 2686 H=2686:00 +CPU= 33.262
  15:14:27 STEP 2687 H=2687:00 +CPU= 35.606
  15:15:35 STEP 2688 H=2688:00 +CPU= 60.830
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMGGhq0f+002688
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMSHhq0f+002688
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMUAhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMGGhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMSHhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMUAhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMGGhq0f+002676
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMSHhq0f+002676
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMUAhq0f+002676
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0718_1997050100_123_966_12183362_1_r206658911_111.zip
Uploading the intermediate file: upload_file_111.zip
  15:16:12 STEP 2689 H=2689:00 +CPU= 32.003
  15:16:49 STEP 2690 H=2690:00 +CPU= 33.000
  15:17:45 STEP 2691 H=2691:00 +CPU= 51.425
  15:18:22 STEP 2692 H=2692:00 +CPU= 32.987
  15:18:57 STEP 2693 H=2693:00 +CPU= 32.583
  15:19:54 STEP 2694 H=2694:00 +CPU= 51.795
  15:20:28 STEP 2695 H=2695:00 +CPU= 31.868
  15:21:06 STEP 2696 H=2696:00 +CPU= 33.123
  15:22:03 STEP 2697 H=2697:00 +CPU= 51.675
  15:22:41 STEP 2698 H=2698:00 +CPU= 33.168
  15:23:17 STEP 2699 H=2699:00 +CPU= 32.873
  15:24:21 STEP 2700 H=2700:00 +CPU= 56.187
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMGGhq0f+002700
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMSHhq0f+002700
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMUAhq0f+002700
  15:24:55 STEP 2701 H=2701:00 +CPU= 31.649
  15:25:32 STEP 2702 H=2702:00 +CPU= 34.341
  15:26:29 STEP 2703 H=2703:00 +CPU= 50.836
  15:27:07 STEP 2704 H=2704:00 +CPU= 33.118
  15:27:42 STEP 2705 H=2705:00 +CPU= 31.988
  15:28:39 STEP 2706 H=2706:00 +CPU= 52.596
  15:29:14 STEP 2707 H=2707:00 +CPU= 31.448
  15:29:51 STEP 2708 H=2708:00 +CPU= 33.200
  15:30:47 STEP 2709 H=2709:00 +CPU= 52.422
  15:31:23 STEP 2710 H=2710:00 +CPU= 33.539
  15:31:59 STEP 2711 H=2711:00 +CPU= 33.193
  15:33:11 STEP 2712 H=2712:00 +CPU= 61.112
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMGGhq0f+002712
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMSHhq0f+002712
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMUAhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMGGhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMSHhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMUAhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMGGhq0f+002700
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMSHhq0f+002700
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMUAhq0f+002700
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0718_1997050100_123_966_12183362_1_r206658911_112.zip
Uploading the intermediate file: upload_file_112.zip
  15:33:46 STEP 2713 H=2713:00 +CPU= 32.305
  15:34:23 STEP 2714 H=2714:00 +CPU= 33.688
  15:35:20 STEP 2715 H=2715:00 +CPU= 50.658
  15:35:58 STEP 2716 H=2716:00 +CPU= 32.863
  15:36:34 STEP 2717 H=2717:00 +CPU= 32.103
  15:37:33 STEP 2718 H=2718:00 +CPU= 52.262
  15:38:10 STEP 2719 H=2719:00 +CPU= 32.330
  15:38:50 STEP 2720 H=2720:00 +CPU= 33.025
  15:39:52 STEP 2721 H=2721:00 +CPU= 51.417
  15:40:30 STEP 2722 H=2722:00 +CPU= 33.200
  15:41:08 STEP 2723 H=2723:00 +CPU= 32.378
  15:42:10 STEP 2724 H=2724:00 +CPU= 56.124
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMGGhq0f+002724
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMSHhq0f+002724
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMUAhq0f+002724
  15:42:44 STEP 2725 H=2725:00 +CPU= 31.364
  15:43:19 STEP 2726 H=2726:00 +CPU= 32.879
[EC_DRHOOK:tourte:1:1:11419:11419] [20230129:154403:1675003443:90217.832] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1538] Received signal#15 (SIGTERM) :: 3996MB (heap), 4419MB (maxrss), 0MB (maxstack), 0 (paging), nsigs = 1
[EC_DRHOOK:tourte:1:1:11419:11419] [20230129:154403:1675003443:90217.832] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1542] Also activating Harakiri-alarm (SIGALRM=14) to expire after 500s elapsed to prevent hangs, nsigs = 1
[EC_DRHOOK:tourte:1:1:11419:11419] [20230129:154403:1675003443:90217.832] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1544] Harakiri signal handler 'signal_harakiri' for signal#14 (SIGALRM) installed at 0x81f3c0 (old at (nil))
[EC_DRHOOK:tourte:1:1:11419:11419] [20230129:154403:1675003443:90217.832] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1617] Signal#15 was caused by unrecognized si_code [memaddr=0x1], nsigs = 1
[EC_DRHOOK:tourte:1:1:11419:11419] [20230129:154403:1675003443:90217.832] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1686] Starting DrHook backtrace for signal#15, nsigs = 1
[EC_DRHOOK:tourte:1:1:11419:11419] [20230129:154403:1675003443:90217.832] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3843] 3996 MB (maxheap), 4419 MB (maxrss), 0 MB (maxstack)
[EC_DRHOOK:tourte:1:1:11419:11419] [20230129:154403:1675003443:90217.832] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :  MASTER 
[EC_DRHOOK:tourte:1:1:11419:11419] [20230129:154403:1675003443:90217.832] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :   CNT0 
[EC_DRHOOK:tourte:1:1:11419:11419] [20230129:154403:1675003443:90217.832] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :    CNT1 
[EC_DRHOOK:tourte:1:1:11419:11419] [20230129:154403:1675003443:90217.832] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :     CNT2 
[EC_DRHOOK:tourte:1:1:11419:11419] [20230129:154403:1675003443:90217.832] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :      CNT3 
[EC_DRHOOK:tourte:1:1:11419:11419] [20230129:154403:1675003443:90217.832] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :       CNT4 
[EC_DRHOOK:tourte:1:1:11419:11419] [20230129:154403:1675003443:90217.832] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :        STEPO 
[EC_DRHOOK:tourte:1:1:11419:11419] [20230129:154403:1675003443:90217.832] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :         SCAN2M 
[EC_DRHOOK:tourte:1:1:11419:11419] [20230129:154403:1675003443:90217.832] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :          GP_MODEL_HEAP 
[EC_DRHOOK:tourte:1:1:11419:11419] [20230129:154403:1675003443:90217.832] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :           GP_MODEL 
[EC_DRHOOK:tourte:1:1:11419:11419] [20230129:154403:1675003443:90217.832] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :            EC_PHYS_DRV 
[EC_DRHOOK:tourte:1:1:11419:11419] [20230129:154403:1675003443:90217.832] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :             >OMP-PHYSICS CLDPP T/S    (1002) 
[EC_DRHOOK:tourte:1:1:11419:11419] [20230129:154403:1675003443:90217.832] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :              EC_PHYS 
[EC_DRHOOK:tourte:1:1:11419:11419] [20230129:154403:1675003443:90217.832] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :               CALLPAR 
[EC_DRHOOK:tourte:1:1:11419:11419] [20230129:154403:1675003443:90217.832] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :                CLOUD_LAYER 
[EC_DRHOOK:tourte:1:1:11419:11419] [20230129:154403:1675003443:90217.832] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :                 CLOUDSC 
[EC_DRHOOK:tourte:1:1:11419:11419] [20230129:154404:1675003444:90218.832] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1734] DrHook backtrace done for signal#15, nsigs = 1
[EC_DRHOOK:tourte:1:1:11419:11419] [20230129:154404:1675003444:90218.832] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1785] Calling previous signal handler at 0x1ce8bb0 for signal#15, nsigs = 1
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source             
oifs_43r3_model.e  0000000001CE916B  Unknown               Unknown  Unknown
oifs_43r3_model.e  000000000081FFF1  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DC9090  Unknown               Unknown  Unknown
oifs_43r3_model.e  000000000103244D  cloudsc_                 2920  cloudsc.F90
oifs_43r3_model.e  0000000001014D57  cloud_layer_              131  cloud_layer.F90
oifs_43r3_model.e  0000000000F1A790  callpar_                 1223  callpar.F90
oifs_43r3_model.e  0000000000E4940F  ec_phys_                  670  ec_phys.F90
oifs_43r3_model.e  0000000000E3610C  ec_phys_drv_              599  ec_phys_drv.F90
oifs_43r3_model.e  0000000000BFA3D3  gp_model_                 613  gp_model.F90
oifs_43r3_model.e  00000000012E9482  gp_model_heap_             74  gp_model_heap.F90
oifs_43r3_model.e  0000000000BBC1CE  scan2m_                   535  scan2m.F90
oifs_43r3_model.e  000000000057A664  stepo_                    327  stepo.F90
oifs_43r3_model.e  000000000055DEEC  cnt4_                    1133  cnt4.F90
oifs_43r3_model.e  00000000005471C9  cnt3_                     267  cnt3.F90
oifs_43r3_model.e  0000000000546412  cnt2_                      88  cnt2.F90
oifs_43r3_model.e  0000000000545E28  cnt1_                      92  cnt1.F90
oifs_43r3_model.e  000000000040708D  cnt0_                     146  cnt0.F90
oifs_43r3_model.e  000000000040220F  MAIN__                     96  master.F90
oifs_43r3_model.e  00000000004021A2  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DCA390  Unknown               Unknown  Unknown
oifs_43r3_model.e  000000000040206E  Unknown               Unknown  Unknown
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1997050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0718
(argv4) batchid: 966
(argv5) wuid: 12183362
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/20
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/20/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/20/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_60f2b75544e86af6a52c189963c13f75 to: /var/lib/boinc-client/slots/20/oifs_43r3_ps_0718_1997050100_123_966_12183362.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/20/oifs_43r3_ps_0718_1997050100_123_966_12183362.zip
ic_ancil_file: ic_ancil_12183362
ifsdata_file: ifsdata_12183362
climate_data_file: clim_data_12183362
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_b7f9d18c1aa4ec163d207118956bd5cb to: /var/lib/boinc-client/slots/20/ic_ancil_12183362.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/20/ic_ancil_12183362.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_a93794dac75aa08e36c24b57617ecb78 to: /var/lib/boinc-client/slots/20/ifsdata/ifsdata_12183362.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/20/ifsdata/ifsdata_12183362.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/20/159l_2/clim_data_12183362.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/20/159l_2/clim_data_12183362.zip
Checking for progress XML file: /var/lib/boinc-client/slots/20/progress_file_12183362.xml
Opened progress file ok : /var/lib/boinc-client/slots/20/progress_file_12183362.xml
-- Model is restarting --
Adjusting last_iter, 2727, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/20/progress_file_12183362.xml
last_cpu_time: 114139
upload_file_number: 113
last_iter: 2711
last_upload: 9763200
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0718_1997050100_123_966_12183362_1_r206658911
The child process has been launched with process id: 256102
Executing the command: /var/lib/boinc-client/slots/20/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:tourte:1:1:256102:256102] [20230204:155754:1675522674:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:tourte:1:1:256102:256102] [20230204:155754:1675522674:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:tourte:1:1:256102:256102] [20230204:155754:1675522674:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:tourte:1:1:256102:256102] [20230204:155754:1675522674:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:tourte:1:1:256102:256102] [20230204:155754:1675522674:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:tourte:1:1:256102:256102] [20230204:155754:1675522674:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:tourte:1:1:256102:256102] [20230204:155754:1675522674:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:tourte:1:1:256102:256102] [20230204:155754:1675522674:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:tourte:1:1:256102:256102] [20230204:155754:1675522674:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:tourte:1:1:256102:256102] [20230204:155754:1675522674:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:tourte:1:1:256102:256102] [20230204:155754:1675522674:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:tourte:1:1:256102:256102] [20230204:155754:1675522674:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:tourte:1:1:256102:256102] [20230204:155754:1675522674:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:tourte:1:1:256102:256102] [20230204:155754:1675522674:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:tourte:1:1:256102:256102] [20230204:155754:1675522674:0.001] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:tourte:1:1:256102:256102] [20230204:155754:1675522674:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:tourte:1:1:256102:256102] [20230204:155754:1675522674:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:tourte:1:1:256102:256102] [20230204:155754:1675522674:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:tourte:1:1:256102:256102] [20230204:155754:1675522674:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:tourte:1:1:256102:256102] [20230204:155754:1675522674:0.001] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:tourte:1:1:256102:256102] [20230204:155754:1675522674:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:tourte:1:1:256102:256102] [20230204:155754:1675522674:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:tourte:1:1:256102:256102] [20230204:155754:1675522674:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:tourte:1:1:256102:256102] [20230204:155754:1675522674:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:tourte:1:1:256102:256102] [20230204:155754:1675522674:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:tourte:1:1:256102:256102] [20230204:155754:1675522674:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:tourte:1:1:256102:256102] [20230204:155754:1675522674:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:tourte:1:1:256102:256102] [20230204:155754:1675522674:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:tourte:1:1:256102:256102] [20230204:155754:1675522674:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:tourte:1:1:256102:256102] [20230204:155754:1675522674:0.001] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  15:59:44 STEP 2712 H=2712:00 +CPU= 85.534
  16:00:42 STEP 2713 H=2713:00 +CPU= 47.813
  16:01:46 STEP 2714 H=2714:00 +CPU= 49.023
  16:03:25 STEP 2715 H=2715:00 +CPU= 75.772
  16:04:29 STEP 2716 H=2716:00 +CPU= 49.021
  16:05:28 STEP 2717 H=2717:00 +CPU= 47.143
  16:07:09 STEP 2718 H=2718:00 +CPU= 78.068
  16:08:09 STEP 2719 H=2719:00 +CPU= 47.875
  16:09:12 STEP 2720 H=2720:00 +CPU= 49.004
  16:10:52 STEP 2721 H=2721:00 +CPU= 75.814
  16:11:55 STEP 2722 H=2722:00 +CPU= 49.516
  16:13:06 STEP 2723 H=2723:00 +CPU= 47.835
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:39:13 STEP 2724 H=2724:00 +CPU= 84.708
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMGGhq0f+002724
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMSHhq0f+002724
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMUAhq0f+002724
  16:40:19 STEP 2725 H=2725:00 +CPU= 47.982
  16:41:24 STEP 2726 H=2726:00 +CPU= 49.534
  16:43:08 STEP 2727 H=2727:00 +CPU= 76.157
  16:44:14 STEP 2728 H=2728:00 +CPU= 49.224
  16:45:19 STEP 2729 H=2729:00 +CPU= 47.708
  16:47:05 STEP 2730 H=2730:00 +CPU= 78.764
  16:48:10 STEP 2731 H=2731:00 +CPU= 48.509
  16:49:16 STEP 2732 H=2732:00 +CPU= 50.104
  16:50:57 STEP 2733 H=2733:00 +CPU= 75.935
  16:52:03 STEP 2734 H=2734:00 +CPU= 49.134
  16:53:02 STEP 2735 H=2735:00 +CPU= 49.366
  16:55:00 STEP 2736 H=2736:00 +CPU= 90.410
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMGGhq0f+002736
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMSHhq0f+002736
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMUAhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMGGhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMSHhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMUAhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMGGhq0f+002724
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMSHhq0f+002724
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMUAhq0f+002724
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0718_1997050100_123_966_12183362_1_r206658911_113.zip
Uploading the intermediate file: upload_file_113.zip
  16:55:58 STEP 2737 H=2737:00 +CPU= 48.048
  16:56:59 STEP 2738 H=2738:00 +CPU= 49.615
  16:58:32 STEP 2739 H=2739:00 +CPU= 77.395
  16:59:33 STEP 2740 H=2740:00 +CPU= 49.258
  17:00:34 STEP 2741 H=2741:00 +CPU= 47.925
  17:02:16 STEP 2742 H=2742:00 +CPU= 78.349
  17:03:19 STEP 2743 H=2743:00 +CPU= 48.682
  17:04:24 STEP 2744 H=2744:00 +CPU= 49.779
  17:05:59 STEP 2745 H=2745:00 +CPU= 77.457
  17:07:05 STEP 2746 H=2746:00 +CPU= 49.599
  17:08:08 STEP 2747 H=2747:00 +CPU= 48.299
  17:10:01 STEP 2748 H=2748:00 +CPU= 85.980
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMGGhq0f+002748
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMSHhq0f+002748
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMUAhq0f+002748
  17:11:06 STEP 2749 H=2749:00 +CPU= 48.547
  17:12:10 STEP 2750 H=2750:00 +CPU= 50.083
  17:13:46 STEP 2751 H=2751:00 +CPU= 77.113
  17:14:53 STEP 2752 H=2752:00 +CPU= 49.812
  17:15:56 STEP 2753 H=2753:00 +CPU= 48.346
  17:17:37 STEP 2754 H=2754:00 +CPU= 78.100
  17:18:38 STEP 2755 H=2755:00 +CPU= 47.999
  17:19:43 STEP 2756 H=2756:00 +CPU= 49.413
  17:21:23 STEP 2757 H=2757:00 +CPU= 76.783
  17:22:25 STEP 2758 H=2758:00 +CPU= 49.981
  17:23:25 STEP 2759 H=2759:00 +CPU= 50.341
  17:25:18 STEP 2760 H=2760:00 +CPU= 89.981
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMGGhq0f+002760
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMSHhq0f+002760
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMUAhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMGGhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMSHhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMUAhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMGGhq0f+002748
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMSHhq0f+002748
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMUAhq0f+002748
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0718_1997050100_123_966_12183362_1_r206658911_114.zip
Uploading the intermediate file: upload_file_114.zip
  17:26:16 STEP 2761 H=2761:00 +CPU= 48.097
  17:27:16 STEP 2762 H=2762:00 +CPU= 50.003
  17:28:50 STEP 2763 H=2763:00 +CPU= 76.613
  17:29:51 STEP 2764 H=2764:00 +CPU= 50.534
  17:30:50 STEP 2765 H=2765:00 +CPU= 47.838
  17:32:26 STEP 2766 H=2766:00 +CPU= 78.310
  17:33:27 STEP 2767 H=2767:00 +CPU= 47.990
  17:34:27 STEP 2768 H=2768:00 +CPU= 49.699
  17:36:02 STEP 2769 H=2769:00 +CPU= 75.930
  17:37:03 STEP 2770 H=2770:00 +CPU= 49.400
  17:38:02 STEP 2771 H=2771:00 +CPU= 47.941
  17:39:47 STEP 2772 H=2772:00 +CPU= 84.981
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMGGhq0f+002772
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMSHhq0f+002772
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMUAhq0f+002772
  17:40:46 STEP 2773 H=2773:00 +CPU= 48.317
  17:41:47 STEP 2774 H=2774:00 +CPU= 49.690
  17:43:21 STEP 2775 H=2775:00 +CPU= 76.363
  17:44:25 STEP 2776 H=2776:00 +CPU= 50.014
  17:45:23 STEP 2777 H=2777:00 +CPU= 48.149
  17:47:00 STEP 2778 H=2778:00 +CPU= 77.966
  17:48:00 STEP 2779 H=2779:00 +CPU= 48.061
  17:48:58 STEP 2780 H=2780:00 +CPU= 49.981
  17:50:36 STEP 2781 H=2781:00 +CPU= 76.929
  17:51:39 STEP 2782 H=2782:00 +CPU= 49.950
  17:52:41 STEP 2783 H=2783:00 +CPU= 49.869
  17:54:35 STEP 2784 H=2784:00 +CPU= 89.971
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMGGhq0f+002784
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMSHhq0f+002784
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMUAhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMGGhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMSHhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMUAhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMGGhq0f+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMSHhq0f+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMUAhq0f+002772
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0718_1997050100_123_966_12183362_1_r206658911_115.zip
Uploading the intermediate file: upload_file_115.zip
  17:55:34 STEP 2785 H=2785:00 +CPU= 47.889
  17:56:36 STEP 2786 H=2786:00 +CPU= 49.994
  17:58:12 STEP 2787 H=2787:00 +CPU= 76.592
  17:59:13 STEP 2788 H=2788:00 +CPU= 49.569
  18:00:11 STEP 2789 H=2789:00 +CPU= 47.940
  18:01:46 STEP 2790 H=2790:00 +CPU= 78.413
  18:02:47 STEP 2791 H=2791:00 +CPU= 48.340
  18:03:51 STEP 2792 H=2792:00 +CPU= 50.141
  18:05:23 STEP 2793 H=2793:00 +CPU= 76.548
  18:06:23 STEP 2794 H=2794:00 +CPU= 49.751
  18:07:25 STEP 2795 H=2795:00 +CPU= 48.697
  18:09:18 STEP 2796 H=2796:00 +CPU= 85.484
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMGGhq0f+002796
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMSHhq0f+002796
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMUAhq0f+002796
  18:10:14 STEP 2797 H=2797:00 +CPU= 48.598
  18:11:18 STEP 2798 H=2798:00 +CPU= 49.903
  18:12:57 STEP 2799 H=2799:00 +CPU= 76.443
  18:13:59 STEP 2800 H=2800:00 +CPU= 49.734
  18:14:59 STEP 2801 H=2801:00 +CPU= 47.844
  18:16:38 STEP 2802 H=2802:00 +CPU= 78.801
  18:17:42 STEP 2803 H=2803:00 +CPU= 48.163
  18:18:47 STEP 2804 H=2804:00 +CPU= 50.059
  18:20:27 STEP 2805 H=2805:00 +CPU= 76.762
  18:21:32 STEP 2806 H=2806:00 +CPU= 49.379
  18:22:39 STEP 2807 H=2807:00 +CPU= 49.309
  18:24:33 STEP 2808 H=2808:00 +CPU= 90.964
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMGGhq0f+002808
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMSHhq0f+002808
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMUAhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMGGhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMSHhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMUAhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMGGhq0f+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMSHhq0f+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMUAhq0f+002796
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0718_1997050100_123_966_12183362_1_r206658911_116.zip
Uploading the intermediate file: upload_file_116.zip
  18:25:35 STEP 2809 H=2809:00 +CPU= 48.368
  18:26:39 STEP 2810 H=2810:00 +CPU= 49.849
  18:28:14 STEP 2811 H=2811:00 +CPU= 76.610
  18:29:16 STEP 2812 H=2812:00 +CPU= 49.909
  18:30:17 STEP 2813 H=2813:00 +CPU= 48.299
  18:31:54 STEP 2814 H=2814:00 +CPU= 78.294
  18:32:54 STEP 2815 H=2815:00 +CPU= 48.394
  18:33:59 STEP 2816 H=2816:00 +CPU= 49.972
  18:35:43 STEP 2817 H=2817:00 +CPU= 76.914
  18:36:44 STEP 2818 H=2818:00 +CPU= 49.620
  18:37:44 STEP 2819 H=2819:00 +CPU= 48.179
  18:39:30 STEP 2820 H=2820:00 +CPU= 85.205
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMGGhq0f+002820
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMSHhq0f+002820
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMUAhq0f+002820
  18:40:30 STEP 2821 H=2821:00 +CPU= 48.322
  18:41:35 STEP 2822 H=2822:00 +CPU= 49.690
  18:43:08 STEP 2823 H=2823:00 +CPU= 76.997
  18:44:11 STEP 2824 H=2824:00 +CPU= 50.041
  18:45:15 STEP 2825 H=2825:00 +CPU= 47.992
  18:46:55 STEP 2826 H=2826:00 +CPU= 78.791
  18:47:55 STEP 2827 H=2827:00 +CPU= 48.334
  18:48:54 STEP 2828 H=2828:00 +CPU= 50.269
  18:50:36 STEP 2829 H=2829:00 +CPU= 76.882
  18:51:44 STEP 2830 H=2830:00 +CPU= 50.089
  18:52:48 STEP 2831 H=2831:00 +CPU= 49.561
  18:54:31 STEP 2832 H=2832:00 +CPU= 90.124
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMGGhq0f+002832
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMSHhq0f+002832
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMUAhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMGGhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMSHhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMUAhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMGGhq0f+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMSHhq0f+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMUAhq0f+002820
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0718_1997050100_123_966_12183362_1_r206658911_117.zip
Uploading the intermediate file: upload_file_117.zip
  18:55:25 STEP 2833 H=2833:00 +CPU= 47.375
  18:56:20 STEP 2834 H=2834:00 +CPU= 49.911
  18:57:48 STEP 2835 H=2835:00 +CPU= 76.509
  18:58:43 STEP 2836 H=2836:00 +CPU= 50.143
  18:59:38 STEP 2837 H=2837:00 +CPU= 47.734
  19:01:05 STEP 2838 H=2838:00 +CPU= 78.545
  19:01:58 STEP 2839 H=2839:00 +CPU= 48.173
  19:02:53 STEP 2840 H=2840:00 +CPU= 50.048
  19:04:15 STEP 2841 H=2841:00 +CPU= 76.841
  19:05:11 STEP 2842 H=2842:00 +CPU= 49.041
  19:06:05 STEP 2843 H=2843:00 +CPU= 47.976
  19:07:37 STEP 2844 H=2844:00 +CPU= 85.470
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMGGhq0f+002844
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMSHhq0f+002844
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMUAhq0f+002844
  19:08:32 STEP 2845 H=2845:00 +CPU= 47.588
  19:09:26 STEP 2846 H=2846:00 +CPU= 50.224
  19:10:51 STEP 2847 H=2847:00 +CPU= 77.347
  19:11:46 STEP 2848 H=2848:00 +CPU= 49.341
  19:12:38 STEP 2849 H=2849:00 +CPU= 47.573
  19:14:04 STEP 2850 H=2850:00 +CPU= 78.113
  19:14:58 STEP 2851 H=2851:00 +CPU= 47.488
  19:15:52 STEP 2852 H=2852:00 +CPU= 49.372
  19:17:18 STEP 2853 H=2853:00 +CPU= 76.577
  19:18:11 STEP 2854 H=2854:00 +CPU= 48.534
  19:19:05 STEP 2855 H=2855:00 +CPU= 49.575
  19:20:49 STEP 2856 H=2856:00 +CPU= 91.492
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMGGhq0f+002856
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMSHhq0f+002856
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMUAhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMGGhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMSHhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMUAhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMGGhq0f+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMSHhq0f+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMUAhq0f+002844
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0718_1997050100_123_966_12183362_1_r206658911_118.zip
Uploading the intermediate file: upload_file_118.zip
  19:21:46 STEP 2857 H=2857:00 +CPU= 48.008
  19:22:42 STEP 2858 H=2858:00 +CPU= 50.263
  19:24:09 STEP 2859 H=2859:00 +CPU= 77.052
  19:25:09 STEP 2860 H=2860:00 +CPU= 49.453
  19:26:01 STEP 2861 H=2861:00 +CPU= 47.985
  19:27:29 STEP 2862 H=2862:00 +CPU= 78.208
  19:28:23 STEP 2863 H=2863:00 +CPU= 48.808
  19:29:16 STEP 2864 H=2864:00 +CPU= 49.364
  19:30:42 STEP 2865 H=2865:00 +CPU= 76.843
  19:31:37 STEP 2866 H=2866:00 +CPU= 50.484
  19:32:30 STEP 2867 H=2867:00 +CPU= 47.768
  19:34:10 STEP 2868 H=2868:00 +CPU= 85.457
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMGGhq0f+002868
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMSHhq0f+002868
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMUAhq0f+002868
  19:35:02 STEP 2869 H=2869:00 +CPU= 48.801
  19:35:56 STEP 2870 H=2870:00 +CPU= 49.495
  19:37:19 STEP 2871 H=2871:00 +CPU= 76.055
  19:38:13 STEP 2872 H=2872:00 +CPU= 50.049
  19:39:05 STEP 2873 H=2873:00 +CPU= 46.943
  19:40:31 STEP 2874 H=2874:00 +CPU= 78.003
  19:41:24 STEP 2875 H=2875:00 +CPU= 47.785
  19:42:17 STEP 2876 H=2876:00 +CPU= 48.657
  19:43:41 STEP 2877 H=2877:00 +CPU= 76.037
  19:44:34 STEP 2878 H=2878:00 +CPU= 48.903
  19:45:28 STEP 2879 H=2879:00 +CPU= 49.992
  19:47:07 STEP 2880 H=2880:00 +CPU= 91.348
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMGGhq0f+002880
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMSHhq0f+002880
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMUAhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMGGhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMSHhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMUAhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMGGhq0f+002868
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMSHhq0f+002868
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMUAhq0f+002868
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0718_1997050100_123_966_12183362_1_r206658911_119.zip
Uploading the intermediate file: upload_file_119.zip
  19:48:01 STEP 2881 H=2881:00 +CPU= 48.060
  19:48:59 STEP 2882 H=2882:00 +CPU= 49.735
  19:50:25 STEP 2883 H=2883:00 +CPU= 76.411
  19:51:18 STEP 2884 H=2884:00 +CPU= 49.862
  19:52:16 STEP 2885 H=2885:00 +CPU= 47.973
  19:53:47 STEP 2886 H=2886:00 +CPU= 77.751
  19:54:41 STEP 2887 H=2887:00 +CPU= 48.170
  19:55:36 STEP 2888 H=2888:00 +CPU= 49.968
  19:57:09 STEP 2889 H=2889:00 +CPU= 75.750
  19:58:06 STEP 2890 H=2890:00 +CPU= 49.223
  19:59:03 STEP 2891 H=2891:00 +CPU= 48.181
  20:00:43 STEP 2892 H=2892:00 +CPU= 85.510
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMGGhq0f+002892
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMSHhq0f+002892
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMUAhq0f+002892
  20:01:39 STEP 2893 H=2893:00 +CPU= 48.205
  20:02:34 STEP 2894 H=2894:00 +CPU= 48.406
  20:04:02 STEP 2895 H=2895:00 +CPU= 76.317
  20:05:00 STEP 2896 H=2896:00 +CPU= 49.782
  20:05:55 STEP 2897 H=2897:00 +CPU= 47.698
  20:07:27 STEP 2898 H=2898:00 +CPU= 78.264
  20:08:21 STEP 2899 H=2899:00 +CPU= 49.585
  20:09:17 STEP 2900 H=2900:00 +CPU= 49.475
  20:10:45 STEP 2901 H=2901:00 +CPU= 77.002
  20:11:40 STEP 2902 H=2902:00 +CPU= 49.017
  20:12:37 STEP 2903 H=2903:00 +CPU= 49.763
  20:14:20 STEP 2904 H=2904:00 +CPU= 91.364
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMGGhq0f+002904
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMSHhq0f+002904
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMUAhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMGGhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMSHhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMUAhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMGGhq0f+002892
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMSHhq0f+002892
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMUAhq0f+002892
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0718_1997050100_123_966_12183362_1_r206658911_120.zip
Uploading the intermediate file: upload_file_120.zip
  20:15:10 STEP 2905 H=2905:00 +CPU= 47.245
  20:16:07 STEP 2906 H=2906:00 +CPU= 50.412
  20:17:30 STEP 2907 H=2907:00 +CPU= 76.020
  20:18:24 STEP 2908 H=2908:00 +CPU= 49.284
  20:19:15 STEP 2909 H=2909:00 +CPU= 49.383
  20:20:42 STEP 2910 H=2910:00 +CPU= 79.562
  20:21:36 STEP 2911 H=2911:00 +CPU= 48.367
  20:22:32 STEP 2912 H=2912:00 +CPU= 49.919
  20:23:54 STEP 2913 H=2913:00 +CPU= 75.805
  20:24:50 STEP 2914 H=2914:00 +CPU= 49.967
  20:25:48 STEP 2915 H=2915:00 +CPU= 48.454
  20:27:27 STEP 2916 H=2916:00 +CPU= 85.357
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMGGhq0f+002916
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMSHhq0f+002916
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMUAhq0f+002916
  20:28:22 STEP 2917 H=2917:00 +CPU= 47.866
  20:29:17 STEP 2918 H=2918:00 +CPU= 49.645
  20:30:40 STEP 2919 H=2919:00 +CPU= 77.799
  20:31:35 STEP 2920 H=2920:00 +CPU= 50.204
  20:32:32 STEP 2921 H=2921:00 +CPU= 47.875
  20:34:06 STEP 2922 H=2922:00 +CPU= 78.373
  20:35:00 STEP 2923 H=2923:00 +CPU= 47.765
  20:35:55 STEP 2924 H=2924:00 +CPU= 49.335
  20:37:22 STEP 2925 H=2925:00 +CPU= 77.202
  20:38:19 STEP 2926 H=2926:00 +CPU= 50.414
  20:39:14 STEP 2927 H=2927:00 +CPU= 49.431
  20:40:52 STEP 2928 H=2928:00 +CPU= 91.114
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMGGhq0f+002928
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMSHhq0f+002928
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMUAhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMGGhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMSHhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMUAhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMGGhq0f+002916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMSHhq0f+002916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMUAhq0f+002916
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0718_1997050100_123_966_12183362_1_r206658911_121.zip
Uploading the intermediate file: upload_file_121.zip
  20:41:45 STEP 2929 H=2929:00 +CPU= 47.968
  20:42:40 STEP 2930 H=2930:00 +CPU= 50.083
  20:44:07 STEP 2931 H=2931:00 +CPU= 76.668
  20:45:01 STEP 2932 H=2932:00 +CPU= 49.660
  20:45:56 STEP 2933 H=2933:00 +CPU= 47.379
  20:47:24 STEP 2934 H=2934:00 +CPU= 79.289
  20:48:17 STEP 2935 H=2935:00 +CPU= 48.457
  20:49:12 STEP 2936 H=2936:00 +CPU= 49.619
  20:50:39 STEP 2937 H=2937:00 +CPU= 76.252
  20:51:33 STEP 2938 H=2938:00 +CPU= 49.484
  20:52:25 STEP 2939 H=2939:00 +CPU= 47.738
  20:54:00 STEP 2940 H=2940:00 +CPU= 85.300
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMGGhq0f+002940
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMSHhq0f+002940
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMUAhq0f+002940
  20:54:55 STEP 2941 H=2941:00 +CPU= 48.260
  20:55:52 STEP 2942 H=2942:00 +CPU= 49.371
  20:57:20 STEP 2943 H=2943:00 +CPU= 76.024
  20:58:17 STEP 2944 H=2944:00 +CPU= 49.524
  20:59:16 STEP 2945 H=2945:00 +CPU= 48.067
  21:00:44 STEP 2946 H=2946:00 +CPU= 78.910
  21:01:39 STEP 2947 H=2947:00 +CPU= 48.505
  21:02:37 STEP 2948 H=2948:00 +CPU= 49.612
  21:04:05 STEP 2949 H=2949:00 +CPU= 76.351
  21:05:02 STEP 2950 H=2950:00 +CPU= 50.059
  21:06:00 STEP 2951 H=2951:00 +CPU= 49.153
  21:07:39 STEP 2952 H=2952:00 +CPU= 87.839
The child process terminated with status: 0
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMGGhq0f+002952
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMSHhq0f+002952
Moving to projects directory: /var/lib/boinc-client/slots/20/ICMUAhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMUAhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMUAhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMUAhq0f+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMSHhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMGGhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMSHhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMGGhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMGGhq0f+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183362/ICMSHhq0f+002940
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0718_1997050100_123_966_12183362_1_r206658911_122.zip
Uploading the final file: upload_file_122.zip
Uploading trickle at timestep: 10623600
21:11:03 (256097): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:47:51 1525245 22298416 oifs_43r3_ps_0718_1997050100_123_966_12183362_1 10,623,600 128,456 0.0121
09 May 2023 16:44:58 1525245 22298416 oifs_43r3_ps_0718_1997050100_123_966_12183362_1 9,590,400 111,661 0.0116
09 May 2023 16:44:54 1525245 22298416 oifs_43r3_ps_0718_1997050100_123_966_12183362_1 8,726,400 102,043 0.0117
09 May 2023 16:44:50 1525245 22298416 oifs_43r3_ps_0718_1997050100_123_966_12183362_1 7,862,400 92,408 0.0118
09 May 2023 16:44:46 1525245 22298416 oifs_43r3_ps_0718_1997050100_123_966_12183362_1 6,998,400 82,794 0.0118
09 May 2023 16:44:41 1525245 22298416 oifs_43r3_ps_0718_1997050100_123_966_12183362_1 6,134,400 73,158 0.0119
09 May 2023 16:44:36 1525245 22298416 oifs_43r3_ps_0718_1997050100_123_966_12183362_1 5,270,400 63,528 0.0121
09 May 2023 16:44:32 1525245 22298416 oifs_43r3_ps_0718_1997050100_123_966_12183362_1 4,406,400 53,911 0.0122
09 May 2023 16:44:26 1525245 22298416 oifs_43r3_ps_0718_1997050100_123_966_12183362_1 3,542,400 44,284 0.0125
09 May 2023 16:35:52 1525245 22298416 oifs_43r3_ps_0718_1997050100_123_966_12183362_1 2,246,400 28,358 0.0126
09 May 2023 16:35:35 1525245 22298416 oifs_43r3_ps_0718_1997050100_123_966_12183362_1 1,382,400 18,454 0.0133


©2024 climateprediction.net