climateprediction.net home page
Task 22299917

Task 22299917

Name oifs_43r3_ps_0964_2018050100_123_987_12204608_1
Workunit 12204608
Created 19 Jan 2023, 17:04:43 UTC
Sent 21 Jan 2023, 19:40:57 UTC
Report deadline 22 Mar 2023, 19:40:57 UTC
Received 4 Feb 2023, 21:06:45 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1525245
Run time 1 days 16 hours 47 min 3 sec
CPU time 1 days 11 hours 29 min 30 sec
Validate state Valid
Credit 14,873.04
Device peak FLOPS 4.12 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,419.60 MB
Peak swap size 4,978.08 MB
Peak disk usage 3,644.68 MB
Stderr
<core_client_version>7.18.1</core_client_version>
<![CDATA[
<stderr_txt>
+CPU= 33.675
  12:49:52 STEP 2495 H=2495:00 +CPU= 34.082
  12:51:02 STEP 2496 H=2496:00 +CPU= 61.021
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhq0f+002496
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhq0f+002496
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMGGhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMSHhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMUAhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMGGhq0f+002484
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMSHhq0f+002484
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMUAhq0f+002484
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0964_2018050100_123_987_12204608_1_r1847394448_103.zip
Uploading the intermediate file: upload_file_103.zip
  12:51:39 STEP 2497 H=2497:00 +CPU= 33.441
  12:52:17 STEP 2498 H=2498:00 +CPU= 33.267
  12:53:15 STEP 2499 H=2499:00 +CPU= 52.167
  12:53:53 STEP 2500 H=2500:00 +CPU= 34.206
  12:54:29 STEP 2501 H=2501:00 +CPU= 32.153
  12:55:29 STEP 2502 H=2502:00 +CPU= 52.648
  12:56:06 STEP 2503 H=2503:00 +CPU= 33.443
  12:56:46 STEP 2504 H=2504:00 +CPU= 33.627
  12:57:42 STEP 2505 H=2505:00 +CPU= 52.029
  12:58:20 STEP 2506 H=2506:00 +CPU= 33.810
  12:58:56 STEP 2507 H=2507:00 +CPU= 33.814
  13:00:02 STEP 2508 H=2508:00 +CPU= 57.632
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhq0f+002508
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhq0f+002508
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhq0f+002508
  13:00:41 STEP 2509 H=2509:00 +CPU= 33.059
  13:01:20 STEP 2510 H=2510:00 +CPU= 33.604
  13:02:21 STEP 2511 H=2511:00 +CPU= 51.630
  13:02:59 STEP 2512 H=2512:00 +CPU= 34.363
  13:03:37 STEP 2513 H=2513:00 +CPU= 32.400
  13:04:36 STEP 2514 H=2514:00 +CPU= 53.036
  13:05:12 STEP 2515 H=2515:00 +CPU= 32.959
  13:05:51 STEP 2516 H=2516:00 +CPU= 33.452
  13:06:49 STEP 2517 H=2517:00 +CPU= 51.721
  13:07:29 STEP 2518 H=2518:00 +CPU= 34.884
  13:08:06 STEP 2519 H=2519:00 +CPU= 33.362
  13:09:17 STEP 2520 H=2520:00 +CPU= 61.033
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhq0f+002520
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhq0f+002520
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMGGhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMSHhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMUAhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMGGhq0f+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMSHhq0f+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMUAhq0f+002508
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0964_2018050100_123_987_12204608_1_r1847394448_104.zip
Uploading the intermediate file: upload_file_104.zip
  13:09:55 STEP 2521 H=2521:00 +CPU= 33.106
  13:10:33 STEP 2522 H=2522:00 +CPU= 34.468
  13:11:31 STEP 2523 H=2523:00 +CPU= 52.009
  13:12:09 STEP 2524 H=2524:00 +CPU= 34.184
  13:12:46 STEP 2525 H=2525:00 +CPU= 32.894
  13:13:45 STEP 2526 H=2526:00 +CPU= 53.119
  13:14:22 STEP 2527 H=2527:00 +CPU= 32.872
  13:15:00 STEP 2528 H=2528:00 +CPU= 34.527
  13:15:58 STEP 2529 H=2529:00 +CPU= 52.212
  13:16:35 STEP 2530 H=2530:00 +CPU= 33.783
  13:17:12 STEP 2531 H=2531:00 +CPU= 32.954
  13:18:18 STEP 2532 H=2532:00 +CPU= 58.556
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhq0f+002532
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhq0f+002532
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhq0f+002532
  13:18:57 STEP 2533 H=2533:00 +CPU= 34.165
  13:19:36 STEP 2534 H=2534:00 +CPU= 34.200
  13:20:34 STEP 2535 H=2535:00 +CPU= 52.148
  13:21:12 STEP 2536 H=2536:00 +CPU= 34.520
  13:21:51 STEP 2537 H=2537:00 +CPU= 32.811
  13:22:51 STEP 2538 H=2538:00 +CPU= 53.629
  13:23:29 STEP 2539 H=2539:00 +CPU= 33.329
  13:24:07 STEP 2540 H=2540:00 +CPU= 34.178
  13:25:08 STEP 2541 H=2541:00 +CPU= 52.765
  13:25:46 STEP 2542 H=2542:00 +CPU= 34.029
  13:26:25 STEP 2543 H=2543:00 +CPU= 34.555
  13:27:32 STEP 2544 H=2544:00 +CPU= 61.365
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhq0f+002544
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhq0f+002544
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMGGhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMSHhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMUAhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMGGhq0f+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMSHhq0f+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMUAhq0f+002532
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0964_2018050100_123_987_12204608_1_r1847394448_105.zip
Uploading the intermediate file: upload_file_105.zip
  13:28:09 STEP 2545 H=2545:00 +CPU= 32.826
  13:28:47 STEP 2546 H=2546:00 +CPU= 34.237
  13:29:48 STEP 2547 H=2547:00 +CPU= 51.903
  13:30:26 STEP 2548 H=2548:00 +CPU= 34.251
  13:31:02 STEP 2549 H=2549:00 +CPU= 32.860
  13:32:03 STEP 2550 H=2550:00 +CPU= 53.811
  13:32:41 STEP 2551 H=2551:00 +CPU= 33.155
  13:33:19 STEP 2552 H=2552:00 +CPU= 34.501
  13:34:16 STEP 2553 H=2553:00 +CPU= 51.885
  13:34:54 STEP 2554 H=2554:00 +CPU= 34.675
  13:35:31 STEP 2555 H=2555:00 +CPU= 33.393
  13:36:35 STEP 2556 H=2556:00 +CPU= 57.840
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhq0f+002556
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhq0f+002556
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhq0f+002556
  13:37:13 STEP 2557 H=2557:00 +CPU= 33.100
  13:37:48 STEP 2558 H=2558:00 +CPU= 33.846
  13:38:44 STEP 2559 H=2559:00 +CPU= 51.730
  13:39:21 STEP 2560 H=2560:00 +CPU= 33.995
  13:39:56 STEP 2561 H=2561:00 +CPU= 32.669
  13:40:55 STEP 2562 H=2562:00 +CPU= 52.902
  13:41:33 STEP 2563 H=2563:00 +CPU= 32.741
  13:42:11 STEP 2564 H=2564:00 +CPU= 33.629
  13:43:12 STEP 2565 H=2565:00 +CPU= 51.432
  13:43:51 STEP 2566 H=2566:00 +CPU= 33.799
  13:44:29 STEP 2567 H=2567:00 +CPU= 33.822
  13:45:39 STEP 2568 H=2568:00 +CPU= 60.633
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhq0f+002568
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhq0f+002568
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMGGhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMSHhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMUAhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMGGhq0f+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMSHhq0f+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMUAhq0f+002556
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0964_2018050100_123_987_12204608_1_r1847394448_106.zip
Uploading the intermediate file: upload_file_106.zip
  13:46:14 STEP 2569 H=2569:00 +CPU= 32.553
  13:46:53 STEP 2570 H=2570:00 +CPU= 33.403
  13:47:51 STEP 2571 H=2571:00 +CPU= 51.630
  13:48:28 STEP 2572 H=2572:00 +CPU= 33.434
  13:49:04 STEP 2573 H=2573:00 +CPU= 32.849
  13:50:02 STEP 2574 H=2574:00 +CPU= 52.733
  13:50:41 STEP 2575 H=2575:00 +CPU= 32.575
  13:51:21 STEP 2576 H=2576:00 +CPU= 33.510
  13:52:18 STEP 2577 H=2577:00 +CPU= 51.512
  13:52:57 STEP 2578 H=2578:00 +CPU= 33.666
  13:53:33 STEP 2579 H=2579:00 +CPU= 32.422
  13:54:38 STEP 2580 H=2580:00 +CPU= 58.095
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhq0f+002580
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhq0f+002580
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhq0f+002580
  13:55:15 STEP 2581 H=2581:00 +CPU= 32.588
  13:55:52 STEP 2582 H=2582:00 +CPU= 33.554
  13:56:52 STEP 2583 H=2583:00 +CPU= 51.578
  13:57:30 STEP 2584 H=2584:00 +CPU= 33.590
  13:58:07 STEP 2585 H=2585:00 +CPU= 32.388
  13:59:05 STEP 2586 H=2586:00 +CPU= 54.606
  13:59:42 STEP 2587 H=2587:00 +CPU= 32.771
  14:00:19 STEP 2588 H=2588:00 +CPU= 33.336
  14:01:16 STEP 2589 H=2589:00 +CPU= 51.473
  14:01:55 STEP 2590 H=2590:00 +CPU= 33.399
  14:02:34 STEP 2591 H=2591:00 +CPU= 33.638
  14:03:43 STEP 2592 H=2592:00 +CPU= 60.622
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhq0f+002592
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhq0f+002592
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMGGhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMSHhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMUAhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMGGhq0f+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMSHhq0f+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMUAhq0f+002580
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0964_2018050100_123_987_12204608_1_r1847394448_107.zip
Uploading the intermediate file: upload_file_107.zip
  14:04:20 STEP 2593 H=2593:00 +CPU= 34.176
  14:04:55 STEP 2594 H=2594:00 +CPU= 33.646
  14:05:54 STEP 2595 H=2595:00 +CPU= 51.190
  14:06:33 STEP 2596 H=2596:00 +CPU= 34.031
  14:07:09 STEP 2597 H=2597:00 +CPU= 33.513
  14:08:10 STEP 2598 H=2598:00 +CPU= 53.012
  14:08:48 STEP 2599 H=2599:00 +CPU= 32.513
  14:09:25 STEP 2600 H=2600:00 +CPU= 33.597
  14:10:22 STEP 2601 H=2601:00 +CPU= 51.347
  14:11:00 STEP 2602 H=2602:00 +CPU= 33.664
  14:11:39 STEP 2603 H=2603:00 +CPU= 33.547
  14:12:44 STEP 2604 H=2604:00 +CPU= 57.593
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhq0f+002604
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhq0f+002604
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhq0f+002604
  14:13:22 STEP 2605 H=2605:00 +CPU= 32.808
  14:14:00 STEP 2606 H=2606:00 +CPU= 33.579
  14:14:58 STEP 2607 H=2607:00 +CPU= 51.061
  14:15:38 STEP 2608 H=2608:00 +CPU= 33.635
  14:16:14 STEP 2609 H=2609:00 +CPU= 32.701
  14:17:15 STEP 2610 H=2610:00 +CPU= 52.095
  14:17:52 STEP 2611 H=2611:00 +CPU= 32.522
  14:18:31 STEP 2612 H=2612:00 +CPU= 33.169
  14:19:29 STEP 2613 H=2613:00 +CPU= 51.886
  14:20:08 STEP 2614 H=2614:00 +CPU= 33.673
  14:20:48 STEP 2615 H=2615:00 +CPU= 33.738
  14:21:54 STEP 2616 H=2616:00 +CPU= 60.086
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhq0f+002616
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhq0f+002616
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMGGhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMSHhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMUAhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMGGhq0f+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMSHhq0f+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMUAhq0f+002604
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0964_2018050100_123_987_12204608_1_r1847394448_108.zip
Uploading the intermediate file: upload_file_108.zip
  14:22:29 STEP 2617 H=2617:00 +CPU= 32.414
  14:23:04 STEP 2618 H=2618:00 +CPU= 32.890
  14:23:59 STEP 2619 H=2619:00 +CPU= 52.116
  14:24:35 STEP 2620 H=2620:00 +CPU= 34.694
  14:25:12 STEP 2621 H=2621:00 +CPU= 32.313
  14:26:14 STEP 2622 H=2622:00 +CPU= 51.918
  14:26:50 STEP 2623 H=2623:00 +CPU= 31.951
  14:27:29 STEP 2624 H=2624:00 +CPU= 34.177
  14:28:28 STEP 2625 H=2625:00 +CPU= 50.407
  14:29:06 STEP 2626 H=2626:00 +CPU= 34.108
  14:29:42 STEP 2627 H=2627:00 +CPU= 31.849
  14:30:46 STEP 2628 H=2628:00 +CPU= 57.297
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhq0f+002628
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhq0f+002628
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhq0f+002628
  14:31:22 STEP 2629 H=2629:00 +CPU= 31.998
  14:31:58 STEP 2630 H=2630:00 +CPU= 33.295
  14:32:55 STEP 2631 H=2631:00 +CPU= 51.353
  14:33:32 STEP 2632 H=2632:00 +CPU= 33.127
  14:34:07 STEP 2633 H=2633:00 +CPU= 32.418
  14:35:05 STEP 2634 H=2634:00 +CPU= 51.494
  14:35:42 STEP 2635 H=2635:00 +CPU= 32.134
  14:36:21 STEP 2636 H=2636:00 +CPU= 33.509
  14:37:19 STEP 2637 H=2637:00 +CPU= 51.242
  14:37:57 STEP 2638 H=2638:00 +CPU= 32.874
  14:38:35 STEP 2639 H=2639:00 +CPU= 32.762
  14:39:45 STEP 2640 H=2640:00 +CPU= 59.935
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhq0f+002640
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhq0f+002640
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMGGhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMSHhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMUAhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMGGhq0f+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMSHhq0f+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMUAhq0f+002628
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0964_2018050100_123_987_12204608_1_r1847394448_109.zip
Uploading the intermediate file: upload_file_109.zip
  14:40:21 STEP 2641 H=2641:00 +CPU= 32.195
  14:40:59 STEP 2642 H=2642:00 +CPU= 34.508
  14:41:56 STEP 2643 H=2643:00 +CPU= 50.908
  14:42:36 STEP 2644 H=2644:00 +CPU= 33.746
  14:43:11 STEP 2645 H=2645:00 +CPU= 32.002
  14:44:07 STEP 2646 H=2646:00 +CPU= 51.514
  14:44:43 STEP 2647 H=2647:00 +CPU= 32.063
  14:45:21 STEP 2648 H=2648:00 +CPU= 33.163
  14:46:17 STEP 2649 H=2649:00 +CPU= 50.589
  14:46:54 STEP 2650 H=2650:00 +CPU= 34.006
  14:47:29 STEP 2651 H=2651:00 +CPU= 32.019
  14:48:32 STEP 2652 H=2652:00 +CPU= 55.891
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhq0f+002652
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhq0f+002652
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhq0f+002652
  14:49:08 STEP 2653 H=2653:00 +CPU= 32.586
  14:49:45 STEP 2654 H=2654:00 +CPU= 32.848
  14:50:40 STEP 2655 H=2655:00 +CPU= 50.919
  14:51:17 STEP 2656 H=2656:00 +CPU= 32.942
  14:51:54 STEP 2657 H=2657:00 +CPU= 32.155
  14:52:52 STEP 2658 H=2658:00 +CPU= 52.529
  14:53:28 STEP 2659 H=2659:00 +CPU= 32.516
  14:54:05 STEP 2660 H=2660:00 +CPU= 34.004
  14:54:59 STEP 2661 H=2661:00 +CPU= 50.127
  14:55:36 STEP 2662 H=2662:00 +CPU= 33.389
  14:56:12 STEP 2663 H=2663:00 +CPU= 33.329
  14:57:18 STEP 2664 H=2664:00 +CPU= 59.852
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhq0f+002664
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhq0f+002664
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMGGhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMSHhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMUAhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMGGhq0f+002652
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMSHhq0f+002652
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMUAhq0f+002652
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0964_2018050100_123_987_12204608_1_r1847394448_110.zip
Uploading the intermediate file: upload_file_110.zip
Uploading trickle at timestep: 9590400
  14:57:53 STEP 2665 H=2665:00 +CPU= 31.785
  14:58:30 STEP 2666 H=2666:00 +CPU= 32.871
  14:59:27 STEP 2667 H=2667:00 +CPU= 51.160
  15:00:03 STEP 2668 H=2668:00 +CPU= 32.783
  15:00:39 STEP 2669 H=2669:00 +CPU= 31.742
  15:01:35 STEP 2670 H=2670:00 +CPU= 51.861
  15:02:12 STEP 2671 H=2671:00 +CPU= 32.389
  15:02:48 STEP 2672 H=2672:00 +CPU= 32.991
  15:03:46 STEP 2673 H=2673:00 +CPU= 50.523
  15:04:23 STEP 2674 H=2674:00 +CPU= 33.247
  15:05:02 STEP 2675 H=2675:00 +CPU= 32.241
  15:06:07 STEP 2676 H=2676:00 +CPU= 56.108
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhq0f+002676
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhq0f+002676
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhq0f+002676
  15:06:44 STEP 2677 H=2677:00 +CPU= 32.042
  15:07:22 STEP 2678 H=2678:00 +CPU= 33.267
  15:08:20 STEP 2679 H=2679:00 +CPU= 50.498
  15:08:59 STEP 2680 H=2680:00 +CPU= 33.740
  15:09:37 STEP 2681 H=2681:00 +CPU= 32.073
  15:10:37 STEP 2682 H=2682:00 +CPU= 52.554
  15:11:14 STEP 2683 H=2683:00 +CPU= 32.009
  15:11:51 STEP 2684 H=2684:00 +CPU= 33.166
  15:12:49 STEP 2685 H=2685:00 +CPU= 51.164
  15:13:25 STEP 2686 H=2686:00 +CPU= 32.770
  15:14:01 STEP 2687 H=2687:00 +CPU= 33.211
  15:15:08 STEP 2688 H=2688:00 +CPU= 59.702
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhq0f+002688
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhq0f+002688
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMGGhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMSHhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMUAhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMGGhq0f+002676
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMSHhq0f+002676
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMUAhq0f+002676
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0964_2018050100_123_987_12204608_1_r1847394448_111.zip
Uploading the intermediate file: upload_file_111.zip
  15:15:45 STEP 2689 H=2689:00 +CPU= 32.194
  15:16:22 STEP 2690 H=2690:00 +CPU= 33.004
  15:17:20 STEP 2691 H=2691:00 +CPU= 51.379
  15:17:56 STEP 2692 H=2692:00 +CPU= 33.611
  15:18:31 STEP 2693 H=2693:00 +CPU= 31.970
  15:19:29 STEP 2694 H=2694:00 +CPU= 52.707
  15:20:04 STEP 2695 H=2695:00 +CPU= 32.343
  15:20:42 STEP 2696 H=2696:00 +CPU= 33.074
  15:21:42 STEP 2697 H=2697:00 +CPU= 50.823
  15:22:20 STEP 2698 H=2698:00 +CPU= 33.597
  15:22:57 STEP 2699 H=2699:00 +CPU= 31.723
  15:24:02 STEP 2700 H=2700:00 +CPU= 56.632
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhq0f+002700
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhq0f+002700
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhq0f+002700
  15:24:39 STEP 2701 H=2701:00 +CPU= 31.860
  15:25:15 STEP 2702 H=2702:00 +CPU= 33.412
  15:26:12 STEP 2703 H=2703:00 +CPU= 51.013
  15:26:50 STEP 2704 H=2704:00 +CPU= 33.946
  15:27:27 STEP 2705 H=2705:00 +CPU= 31.863
  15:28:26 STEP 2706 H=2706:00 +CPU= 52.189
  15:29:05 STEP 2707 H=2707:00 +CPU= 31.856
  15:29:42 STEP 2708 H=2708:00 +CPU= 33.017
  15:30:38 STEP 2709 H=2709:00 +CPU= 50.495
  15:31:17 STEP 2710 H=2710:00 +CPU= 33.748
  15:31:54 STEP 2711 H=2711:00 +CPU= 33.047
  15:33:03 STEP 2712 H=2712:00 +CPU= 60.195
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhq0f+002712
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhq0f+002712
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMGGhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMSHhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMUAhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMGGhq0f+002700
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMSHhq0f+002700
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMUAhq0f+002700
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0964_2018050100_123_987_12204608_1_r1847394448_112.zip
Uploading the intermediate file: upload_file_112.zip
  15:33:40 STEP 2713 H=2713:00 +CPU= 32.471
  15:34:17 STEP 2714 H=2714:00 +CPU= 33.551
  15:35:16 STEP 2715 H=2715:00 +CPU= 50.304
  15:35:53 STEP 2716 H=2716:00 +CPU= 32.742
  15:36:29 STEP 2717 H=2717:00 +CPU= 31.755
  15:37:28 STEP 2718 H=2718:00 +CPU= 53.307
  15:38:05 STEP 2719 H=2719:00 +CPU= 33.394
  15:38:46 STEP 2720 H=2720:00 +CPU= 33.072
  15:39:44 STEP 2721 H=2721:00 +CPU= 50.540
  15:40:20 STEP 2722 H=2722:00 +CPU= 32.981
  15:40:55 STEP 2723 H=2723:00 +CPU= 32.362
  15:41:56 STEP 2724 H=2724:00 +CPU= 55.878
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhq0f+002724
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhq0f+002724
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhq0f+002724
  15:42:30 STEP 2725 H=2725:00 +CPU= 31.757
  15:43:05 STEP 2726 H=2726:00 +CPU= 32.816
  15:44:02 STEP 2727 H=2727:00 +CPU= 50.042
[EC_DRHOOK:tourte:1:1:11576:11576] [20230129:154403:1675003443:89911.728] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1538] Received signal#15 (SIGTERM) :: 2640MB (heap), 4419MB (maxrss), 0MB (maxstack), 0 (paging), nsigs = 1
[EC_DRHOOK:tourte:1:1:11576:11576] [20230129:154403:1675003443:89911.732] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1542] Also activating Harakiri-alarm (SIGALRM=14) to expire after 500s elapsed to prevent hangs, nsigs = 1
[EC_DRHOOK:tourte:1:1:11576:11576] [20230129:154403:1675003443:89911.732] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1544] Harakiri signal handler 'signal_harakiri' for signal#14 (SIGALRM) installed at 0x81f3c0 (old at (nil))
[EC_DRHOOK:tourte:1:1:11576:11576] [20230129:154403:1675003443:89911.732] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1617] Signal#15 was caused by unrecognized si_code [memaddr=0x1], nsigs = 1
[EC_DRHOOK:tourte:1:1:11576:11576] [20230129:154403:1675003443:89911.732] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1686] Starting DrHook backtrace for signal#15, nsigs = 1
[EC_DRHOOK:tourte:1:1:11576:11576] [20230129:154403:1675003443:89911.732] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3843] 2640 MB (maxheap), 4419 MB (maxrss), 0 MB (maxstack)
[EC_DRHOOK:tourte:1:1:11576:11576] [20230129:154403:1675003443:89911.732] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :  MASTER 
[EC_DRHOOK:tourte:1:1:11576:11576] [20230129:154403:1675003443:89911.732] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :   CNT0 
[EC_DRHOOK:tourte:1:1:11576:11576] [20230129:154403:1675003443:89911.732] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :    CNT1 
[EC_DRHOOK:tourte:1:1:11576:11576] [20230129:154403:1675003443:89911.732] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :     CNT2 
[EC_DRHOOK:tourte:1:1:11576:11576] [20230129:154403:1675003443:89911.732] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :      CNT3 
[EC_DRHOOK:tourte:1:1:11576:11576] [20230129:154403:1675003443:89911.732] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :       CNT4 
[EC_DRHOOK:tourte:1:1:11576:11576] [20230129:154403:1675003443:89911.732] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :        STEPO 
[EC_DRHOOK:tourte:1:1:11576:11576] [20230129:154403:1675003443:89911.732] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :         TRANSINVH 
[EC_DRHOOK:tourte:1:1:11576:11576] [20230129:154403:1675003443:89911.732] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :          TRANSINV_MDL 
[EC_DRHOOK:tourte:1:1:11576:11576] [20230129:154403:1675003443:89911.732] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :           INV_TRANS 
[EC_DRHOOK:tourte:1:1:11576:11576] [20230129:154403:1675003443:89911.732] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :            >TRS-LTINV_CTL   - INVERSE( 102) 
[EC_DRHOOK:tourte:1:1:11576:11576] [20230129:154403:1675003443:89911.732] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :             >OMP-LTINV_CTL   - INVERSE(1647) 
[EC_DRHOOK:tourte:1:1:11576:11576] [20230129:154403:1675003443:89911.732] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :              LTINV_MOD 
[EC_DRHOOK:tourte:1:1:11576:11576] [20230129:154403:1675003443:89911.732] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :               LE_DGEMM 
[EC_DRHOOK:tourte:1:1:11576:11576] [20230129:154404:1675003444:89912.732] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1734] DrHook backtrace done for signal#15, nsigs = 1
[EC_DRHOOK:tourte:1:1:11576:11576] [20230129:154404:1675003444:89912.732] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1785] Calling previous signal handler at 0x1ce8bb0 for signal#15, nsigs = 1
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source             
oifs_43r3_model.e  0000000001CE916B  Unknown               Unknown  Unknown
oifs_43r3_model.e  000000000081FFF1  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DC9090  Unknown               Unknown  Unknown
oifs_43r3_model.e  00000000017111DC  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000000ADFBE7  leinv_mod_mp_lein         158  leinv_mod.F90
oifs_43r3_model.e  0000000000AD9DFC  ltinv_mod_mp_ltin         296  ltinv_mod.F90
oifs_43r3_model.e  0000000000AD7AA3  ltinv_ctl_mod_mp_         100  ltinv_ctl_mod.F90
oifs_43r3_model.e  0000000000ACA56F  inv_trans_ctl_mod         274  inv_trans_ctl_mod.F90
oifs_43r3_model.e  000000000085346D  inv_trans_                600  inv_trans.F90
oifs_43r3_model.e  000000000133D94C  transinv_mdl_             286  transinv_mdl.F90
oifs_43r3_model.e  0000000001334D43  transinvh_                104  transinvh.F90
oifs_43r3_model.e  0000000000579C15  stepo_                    265  stepo.F90
oifs_43r3_model.e  000000000055DEEC  cnt4_                    1133  cnt4.F90
oifs_43r3_model.e  00000000005471C9  cnt3_                     267  cnt3.F90
oifs_43r3_model.e  0000000000546412  cnt2_                      88  cnt2.F90
oifs_43r3_model.e  0000000000545E28  cnt1_                      92  cnt1.F90
oifs_43r3_model.e  000000000040708D  cnt0_                     146  cnt0.F90
oifs_43r3_model.e  000000000040220F  MAIN__                     96  master.F90
oifs_43r3_model.e  00000000004021A2  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DCA390  Unknown               Unknown  Unknown
oifs_43r3_model.e  000000000040206E  Unknown               Unknown  Unknown
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2018050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0964
(argv4) batchid: 987
(argv5) wuid: 12204608
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/22
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/22/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/22/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_f4c3e9599697122defad40515fd60c0a to: /var/lib/boinc-client/slots/22/oifs_43r3_ps_0964_2018050100_123_987_12204608.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/22/oifs_43r3_ps_0964_2018050100_123_987_12204608.zip
ic_ancil_file: ic_ancil_12204608
ifsdata_file: ifsdata_12204608
climate_data_file: clim_data_12204608
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_4d02cda7f469f2e8c25c00ddfdf2ed45 to: /var/lib/boinc-client/slots/22/ic_ancil_12204608.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/22/ic_ancil_12204608.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_7b82c04fd976fee021b343ec62c3bc9e to: /var/lib/boinc-client/slots/22/ifsdata/ifsdata_12204608.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/22/ifsdata/ifsdata_12204608.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/22/159l_2/clim_data_12204608.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/22/159l_2/clim_data_12204608.zip
Checking for progress XML file: /var/lib/boinc-client/slots/22/progress_file_12204608.xml
Opened progress file ok : /var/lib/boinc-client/slots/22/progress_file_12204608.xml
-- Model is restarting --
Adjusting last_iter, 2727, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/22/progress_file_12204608.xml
last_cpu_time: 113437
upload_file_number: 113
last_iter: 2711
last_upload: 9763200
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0964_2018050100_123_987_12204608_1_r1847394448
The child process has been launched with process id: 256121
Executing the command: /var/lib/boinc-client/slots/22/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:tourte:1:1:256121:256121] [20230204:160009:1675522809:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:tourte:1:1:256121:256121] [20230204:160009:1675522809:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:tourte:1:1:256121:256121] [20230204:160009:1675522809:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:tourte:1:1:256121:256121] [20230204:160009:1675522809:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:tourte:1:1:256121:256121] [20230204:160009:1675522809:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:tourte:1:1:256121:256121] [20230204:160009:1675522809:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:tourte:1:1:256121:256121] [20230204:160009:1675522809:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:tourte:1:1:256121:256121] [20230204:160009:1675522809:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:tourte:1:1:256121:256121] [20230204:160009:1675522809:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:tourte:1:1:256121:256121] [20230204:160009:1675522809:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:tourte:1:1:256121:256121] [20230204:160009:1675522809:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:tourte:1:1:256121:256121] [20230204:160009:1675522809:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:tourte:1:1:256121:256121] [20230204:160009:1675522809:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:tourte:1:1:256121:256121] [20230204:160009:1675522809:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:tourte:1:1:256121:256121] [20230204:160009:1675522809:0.001] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:tourte:1:1:256121:256121] [20230204:160009:1675522809:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:tourte:1:1:256121:256121] [20230204:160009:1675522809:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:tourte:1:1:256121:256121] [20230204:160009:1675522809:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:tourte:1:1:256121:256121] [20230204:160009:1675522809:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:tourte:1:1:256121:256121] [20230204:160009:1675522809:0.001] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:tourte:1:1:256121:256121] [20230204:160009:1675522809:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:tourte:1:1:256121:256121] [20230204:160009:1675522809:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:tourte:1:1:256121:256121] [20230204:160009:1675522809:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:tourte:1:1:256121:256121] [20230204:160009:1675522809:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:tourte:1:1:256121:256121] [20230204:160009:1675522809:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:tourte:1:1:256121:256121] [20230204:160009:1675522809:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:tourte:1:1:256121:256121] [20230204:160009:1675522809:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:tourte:1:1:256121:256121] [20230204:160009:1675522809:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:tourte:1:1:256121:256121] [20230204:160009:1675522809:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:tourte:1:1:256121:256121] [20230204:160009:1675522809:0.001] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  16:02:11 STEP 2712 H=2712:00 +CPU= 86.045
  16:03:12 STEP 2713 H=2713:00 +CPU= 47.941
  16:04:16 STEP 2714 H=2714:00 +CPU= 49.073
  16:05:50 STEP 2715 H=2715:00 +CPU= 75.899
  16:06:54 STEP 2716 H=2716:00 +CPU= 49.319
  16:07:57 STEP 2717 H=2717:00 +CPU= 47.954
  16:09:42 STEP 2718 H=2718:00 +CPU= 78.029
  16:10:45 STEP 2719 H=2719:00 +CPU= 47.785
  16:11:48 STEP 2720 H=2720:00 +CPU= 49.517
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:37:35 STEP 2721 H=2721:00 +CPU= 76.169
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:38:58 STEP 2722 H=2722:00 +CPU= 49.491
  16:39:59 STEP 2723 H=2723:00 +CPU= 48.204
  16:41:52 STEP 2724 H=2724:00 +CPU= 84.362
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhq0f+002724
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhq0f+002724
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhq0f+002724
  16:42:54 STEP 2725 H=2725:00 +CPU= 48.005
  16:43:58 STEP 2726 H=2726:00 +CPU= 49.443
  16:45:40 STEP 2727 H=2727:00 +CPU= 75.428
  16:46:47 STEP 2728 H=2728:00 +CPU= 49.787
  16:47:52 STEP 2729 H=2729:00 +CPU= 48.326
  16:49:32 STEP 2730 H=2730:00 +CPU= 77.936
  16:50:29 STEP 2731 H=2731:00 +CPU= 47.869
  16:51:27 STEP 2732 H=2732:00 +CPU= 48.825
  16:53:03 STEP 2733 H=2733:00 +CPU= 76.221
  16:54:05 STEP 2734 H=2734:00 +CPU= 49.168
  16:55:05 STEP 2735 H=2735:00 +CPU= 49.404
  16:56:58 STEP 2736 H=2736:00 +CPU= 90.372
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhq0f+002736
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhq0f+002736
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMGGhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMSHhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMUAhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMGGhq0f+002724
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMSHhq0f+002724
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMUAhq0f+002724
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0964_2018050100_123_987_12204608_1_r1847394448_113.zip
Uploading the intermediate file: upload_file_113.zip
  16:57:58 STEP 2737 H=2737:00 +CPU= 48.762
  16:59:02 STEP 2738 H=2738:00 +CPU= 49.827
  17:00:39 STEP 2739 H=2739:00 +CPU= 77.304
  17:01:40 STEP 2740 H=2740:00 +CPU= 49.863
  17:02:43 STEP 2741 H=2741:00 +CPU= 48.463
  17:04:29 STEP 2742 H=2742:00 +CPU= 78.109
  17:05:29 STEP 2743 H=2743:00 +CPU= 48.714
  17:06:32 STEP 2744 H=2744:00 +CPU= 49.933
  17:08:06 STEP 2745 H=2745:00 +CPU= 76.625
  17:09:08 STEP 2746 H=2746:00 +CPU= 49.713
  17:10:08 STEP 2747 H=2747:00 +CPU= 48.726
  17:11:53 STEP 2748 H=2748:00 +CPU= 85.009
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhq0f+002748
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhq0f+002748
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhq0f+002748
  17:12:51 STEP 2749 H=2749:00 +CPU= 48.220
  17:13:52 STEP 2750 H=2750:00 +CPU= 49.609
  17:15:21 STEP 2751 H=2751:00 +CPU= 76.782
  17:16:20 STEP 2752 H=2752:00 +CPU= 50.060
  17:17:20 STEP 2753 H=2753:00 +CPU= 48.213
  17:18:58 STEP 2754 H=2754:00 +CPU= 78.320
  17:19:56 STEP 2755 H=2755:00 +CPU= 48.163
  17:20:55 STEP 2756 H=2756:00 +CPU= 49.124
  17:22:28 STEP 2757 H=2757:00 +CPU= 76.604
  17:23:27 STEP 2758 H=2758:00 +CPU= 50.361
  17:24:27 STEP 2759 H=2759:00 +CPU= 49.746
  17:26:18 STEP 2760 H=2760:00 +CPU= 91.066
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhq0f+002760
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhq0f+002760
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMGGhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMSHhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMUAhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMGGhq0f+002748
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMSHhq0f+002748
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMUAhq0f+002748
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0964_2018050100_123_987_12204608_1_r1847394448_114.zip
Uploading the intermediate file: upload_file_114.zip
  17:27:18 STEP 2761 H=2761:00 +CPU= 48.628
  17:28:21 STEP 2762 H=2762:00 +CPU= 49.676
  17:29:53 STEP 2763 H=2763:00 +CPU= 75.854
  17:30:55 STEP 2764 H=2764:00 +CPU= 49.519
  17:31:54 STEP 2765 H=2765:00 +CPU= 47.781
  17:33:31 STEP 2766 H=2766:00 +CPU= 77.785
  17:34:31 STEP 2767 H=2767:00 +CPU= 48.133
  17:35:32 STEP 2768 H=2768:00 +CPU= 49.603
  17:37:06 STEP 2769 H=2769:00 +CPU= 76.481
  17:38:08 STEP 2770 H=2770:00 +CPU= 49.863
  17:39:09 STEP 2771 H=2771:00 +CPU= 48.571
  17:40:52 STEP 2772 H=2772:00 +CPU= 85.105
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhq0f+002772
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhq0f+002772
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhq0f+002772
  17:41:53 STEP 2773 H=2773:00 +CPU= 48.145
  17:42:54 STEP 2774 H=2774:00 +CPU= 49.533
  17:44:27 STEP 2775 H=2775:00 +CPU= 76.372
  17:45:28 STEP 2776 H=2776:00 +CPU= 50.204
  17:46:26 STEP 2777 H=2777:00 +CPU= 48.751
  17:48:01 STEP 2778 H=2778:00 +CPU= 78.281
  17:49:00 STEP 2779 H=2779:00 +CPU= 47.840
  17:50:01 STEP 2780 H=2780:00 +CPU= 49.864
  17:51:39 STEP 2781 H=2781:00 +CPU= 76.337
  17:52:39 STEP 2782 H=2782:00 +CPU= 49.402
  17:53:41 STEP 2783 H=2783:00 +CPU= 49.568
  17:55:35 STEP 2784 H=2784:00 +CPU= 90.209
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhq0f+002784
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhq0f+002784
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMGGhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMSHhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMUAhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMGGhq0f+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMSHhq0f+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMUAhq0f+002772
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0964_2018050100_123_987_12204608_1_r1847394448_115.zip
Uploading the intermediate file: upload_file_115.zip
  17:56:35 STEP 2785 H=2785:00 +CPU= 48.187
  17:57:34 STEP 2786 H=2786:00 +CPU= 49.840
  17:59:08 STEP 2787 H=2787:00 +CPU= 76.335
  18:00:08 STEP 2788 H=2788:00 +CPU= 50.168
  18:01:09 STEP 2789 H=2789:00 +CPU= 47.831
  18:02:47 STEP 2790 H=2790:00 +CPU= 78.393
  18:03:47 STEP 2791 H=2791:00 +CPU= 48.304
  18:04:48 STEP 2792 H=2792:00 +CPU= 49.564
  18:06:24 STEP 2793 H=2793:00 +CPU= 76.651
  18:07:28 STEP 2794 H=2794:00 +CPU= 49.745
  18:08:29 STEP 2795 H=2795:00 +CPU= 48.207
  18:10:14 STEP 2796 H=2796:00 +CPU= 84.875
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhq0f+002796
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhq0f+002796
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhq0f+002796
  18:11:12 STEP 2797 H=2797:00 +CPU= 48.620
  18:12:14 STEP 2798 H=2798:00 +CPU= 49.495
  18:13:51 STEP 2799 H=2799:00 +CPU= 76.336
  18:14:57 STEP 2800 H=2800:00 +CPU= 49.789
  18:16:00 STEP 2801 H=2801:00 +CPU= 48.659
  18:17:42 STEP 2802 H=2802:00 +CPU= 78.550
  18:18:42 STEP 2803 H=2803:00 +CPU= 48.045
  18:19:43 STEP 2804 H=2804:00 +CPU= 49.597
  18:21:16 STEP 2805 H=2805:00 +CPU= 76.786
  18:22:16 STEP 2806 H=2806:00 +CPU= 50.061
  18:23:19 STEP 2807 H=2807:00 +CPU= 49.656
  18:25:12 STEP 2808 H=2808:00 +CPU= 90.035
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhq0f+002808
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhq0f+002808
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMGGhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMSHhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMUAhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMGGhq0f+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMSHhq0f+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMUAhq0f+002796
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0964_2018050100_123_987_12204608_1_r1847394448_116.zip
Uploading the intermediate file: upload_file_116.zip
  18:26:11 STEP 2809 H=2809:00 +CPU= 47.973
  18:27:12 STEP 2810 H=2810:00 +CPU= 49.992
  18:28:46 STEP 2811 H=2811:00 +CPU= 76.418
  18:29:48 STEP 2812 H=2812:00 +CPU= 49.895
  18:30:44 STEP 2813 H=2813:00 +CPU= 47.854
  18:32:25 STEP 2814 H=2814:00 +CPU= 79.086
  18:33:31 STEP 2815 H=2815:00 +CPU= 47.965
  18:34:41 STEP 2816 H=2816:00 +CPU= 49.387
  18:36:28 STEP 2817 H=2817:00 +CPU= 77.125
  18:37:31 STEP 2818 H=2818:00 +CPU= 50.030
  18:38:33 STEP 2819 H=2819:00 +CPU= 48.103
  18:40:23 STEP 2820 H=2820:00 +CPU= 86.014
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhq0f+002820
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhq0f+002820
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhq0f+002820
  18:41:24 STEP 2821 H=2821:00 +CPU= 48.429
  18:42:27 STEP 2822 H=2822:00 +CPU= 49.267
  18:44:06 STEP 2823 H=2823:00 +CPU= 76.354
  18:45:11 STEP 2824 H=2824:00 +CPU= 50.142
  18:46:14 STEP 2825 H=2825:00 +CPU= 48.468
  18:47:58 STEP 2826 H=2826:00 +CPU= 78.677
  18:49:03 STEP 2827 H=2827:00 +CPU= 48.452
  18:50:05 STEP 2828 H=2828:00 +CPU= 49.497
  18:51:54 STEP 2829 H=2829:00 +CPU= 76.997
  18:52:58 STEP 2830 H=2830:00 +CPU= 50.438
  18:53:56 STEP 2831 H=2831:00 +CPU= 50.518
  18:55:47 STEP 2832 H=2832:00 +CPU= 90.930
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhq0f+002832
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhq0f+002832
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMGGhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMSHhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMUAhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMGGhq0f+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMSHhq0f+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMUAhq0f+002820
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0964_2018050100_123_987_12204608_1_r1847394448_117.zip
Uploading the intermediate file: upload_file_117.zip
  18:56:44 STEP 2833 H=2833:00 +CPU= 47.981
  18:57:40 STEP 2834 H=2834:00 +CPU= 50.088
  18:59:09 STEP 2835 H=2835:00 +CPU= 76.061
  19:00:08 STEP 2836 H=2836:00 +CPU= 48.923
  19:01:04 STEP 2837 H=2837:00 +CPU= 48.944
  19:02:30 STEP 2838 H=2838:00 +CPU= 81.106
  19:03:26 STEP 2839 H=2839:00 +CPU= 48.169
  19:04:24 STEP 2840 H=2840:00 +CPU= 50.267
  19:05:52 STEP 2841 H=2841:00 +CPU= 77.245
  19:06:50 STEP 2842 H=2842:00 +CPU= 49.914
  19:07:45 STEP 2843 H=2843:00 +CPU= 48.609
  19:09:18 STEP 2844 H=2844:00 +CPU= 85.594
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhq0f+002844
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhq0f+002844
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhq0f+002844
  19:10:12 STEP 2845 H=2845:00 +CPU= 47.995
  19:11:08 STEP 2846 H=2846:00 +CPU= 50.156
  19:12:37 STEP 2847 H=2847:00 +CPU= 76.668
  19:13:32 STEP 2848 H=2848:00 +CPU= 50.116
  19:14:30 STEP 2849 H=2849:00 +CPU= 48.120
  19:16:00 STEP 2850 H=2850:00 +CPU= 78.061
  19:16:55 STEP 2851 H=2851:00 +CPU= 49.153
  19:17:50 STEP 2852 H=2852:00 +CPU= 50.458
  19:19:16 STEP 2853 H=2853:00 +CPU= 77.266
  19:20:14 STEP 2854 H=2854:00 +CPU= 49.682
  19:21:11 STEP 2855 H=2855:00 +CPU= 50.347
  19:22:55 STEP 2856 H=2856:00 +CPU= 91.219
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhq0f+002856
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhq0f+002856
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMGGhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMSHhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMUAhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMGGhq0f+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMSHhq0f+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMUAhq0f+002844
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0964_2018050100_123_987_12204608_1_r1847394448_118.zip
Uploading the intermediate file: upload_file_118.zip
  19:23:49 STEP 2857 H=2857:00 +CPU= 47.205
  19:24:45 STEP 2858 H=2858:00 +CPU= 50.859
  19:26:11 STEP 2859 H=2859:00 +CPU= 75.295
  19:27:10 STEP 2860 H=2860:00 +CPU= 49.623
  19:28:06 STEP 2861 H=2861:00 +CPU= 48.259
  19:29:34 STEP 2862 H=2862:00 +CPU= 78.078
  19:30:30 STEP 2863 H=2863:00 +CPU= 48.576
  19:31:27 STEP 2864 H=2864:00 +CPU= 50.332
  19:32:52 STEP 2865 H=2865:00 +CPU= 75.967
  19:33:49 STEP 2866 H=2866:00 +CPU= 49.590
  19:34:46 STEP 2867 H=2867:00 +CPU= 48.485
  19:36:23 STEP 2868 H=2868:00 +CPU= 84.394
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhq0f+002868
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhq0f+002868
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhq0f+002868
  19:37:18 STEP 2869 H=2869:00 +CPU= 48.298
  19:38:14 STEP 2870 H=2870:00 +CPU= 50.496
  19:39:46 STEP 2871 H=2871:00 +CPU= 77.268
  19:40:44 STEP 2872 H=2872:00 +CPU= 49.709
  19:41:37 STEP 2873 H=2873:00 +CPU= 49.147
  19:43:07 STEP 2874 H=2874:00 +CPU= 77.323
  19:44:03 STEP 2875 H=2875:00 +CPU= 48.404
  19:44:58 STEP 2876 H=2876:00 +CPU= 49.628
  19:46:26 STEP 2877 H=2877:00 +CPU= 76.006
  19:47:26 STEP 2878 H=2878:00 +CPU= 50.330
  19:48:23 STEP 2879 H=2879:00 +CPU= 50.069
  19:50:01 STEP 2880 H=2880:00 +CPU= 89.717
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhq0f+002880
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhq0f+002880
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMGGhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMSHhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMUAhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMGGhq0f+002868
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMSHhq0f+002868
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMUAhq0f+002868
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0964_2018050100_123_987_12204608_1_r1847394448_119.zip
Uploading the intermediate file: upload_file_119.zip
  19:50:55 STEP 2881 H=2881:00 +CPU= 48.442
  19:51:50 STEP 2882 H=2882:00 +CPU= 49.740
  19:53:13 STEP 2883 H=2883:00 +CPU= 75.813
  19:54:08 STEP 2884 H=2884:00 +CPU= 49.360
  19:55:04 STEP 2885 H=2885:00 +CPU= 47.891
  19:56:31 STEP 2886 H=2886:00 +CPU= 77.933
  19:57:26 STEP 2887 H=2887:00 +CPU= 47.587
  19:58:20 STEP 2888 H=2888:00 +CPU= 50.398
  19:59:46 STEP 2889 H=2889:00 +CPU= 77.218
  20:00:41 STEP 2890 H=2890:00 +CPU= 50.603
  20:01:38 STEP 2891 H=2891:00 +CPU= 48.745
  20:03:15 STEP 2892 H=2892:00 +CPU= 85.112
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhq0f+002892
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhq0f+002892
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhq0f+002892
  20:04:10 STEP 2893 H=2893:00 +CPU= 48.082
  20:05:05 STEP 2894 H=2894:00 +CPU= 49.801
  20:06:33 STEP 2895 H=2895:00 +CPU= 77.745
  20:07:28 STEP 2896 H=2896:00 +CPU= 49.814
  20:08:21 STEP 2897 H=2897:00 +CPU= 48.590
  20:09:51 STEP 2898 H=2898:00 +CPU= 78.184
  20:10:46 STEP 2899 H=2899:00 +CPU= 48.897
  20:11:43 STEP 2900 H=2900:00 +CPU= 49.830
  20:13:11 STEP 2901 H=2901:00 +CPU= 76.647
  20:14:07 STEP 2902 H=2902:00 +CPU= 49.803
  20:15:06 STEP 2903 H=2903:00 +CPU= 49.390
  20:16:47 STEP 2904 H=2904:00 +CPU= 90.939
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhq0f+002904
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhq0f+002904
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMGGhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMSHhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMUAhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMGGhq0f+002892
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMSHhq0f+002892
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMUAhq0f+002892
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0964_2018050100_123_987_12204608_1_r1847394448_120.zip
Uploading the intermediate file: upload_file_120.zip
  20:17:41 STEP 2905 H=2905:00 +CPU= 47.889
  20:18:36 STEP 2906 H=2906:00 +CPU= 49.418
  20:20:04 STEP 2907 H=2907:00 +CPU= 76.612
  20:20:59 STEP 2908 H=2908:00 +CPU= 49.251
  20:21:51 STEP 2909 H=2909:00 +CPU= 48.008
  20:23:19 STEP 2910 H=2910:00 +CPU= 79.001
  20:24:13 STEP 2911 H=2911:00 +CPU= 47.441
  20:25:07 STEP 2912 H=2912:00 +CPU= 49.464
  20:26:34 STEP 2913 H=2913:00 +CPU= 76.465
  20:27:28 STEP 2914 H=2914:00 +CPU= 49.289
  20:28:19 STEP 2915 H=2915:00 +CPU= 49.266
  20:29:52 STEP 2916 H=2916:00 +CPU= 85.701
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhq0f+002916
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhq0f+002916
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhq0f+002916
  20:30:44 STEP 2917 H=2917:00 +CPU= 47.682
  20:31:37 STEP 2918 H=2918:00 +CPU= 49.593
  20:33:02 STEP 2919 H=2919:00 +CPU= 76.479
  20:33:55 STEP 2920 H=2920:00 +CPU= 49.003
  20:34:49 STEP 2921 H=2921:00 +CPU= 48.511
  20:36:17 STEP 2922 H=2922:00 +CPU= 80.062
  20:37:11 STEP 2923 H=2923:00 +CPU= 47.422
  20:38:07 STEP 2924 H=2924:00 +CPU= 50.811
  20:39:37 STEP 2925 H=2925:00 +CPU= 76.081
  20:40:31 STEP 2926 H=2926:00 +CPU= 50.276
  20:41:27 STEP 2927 H=2927:00 +CPU= 49.853
  20:43:09 STEP 2928 H=2928:00 +CPU= 90.707
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhq0f+002928
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhq0f+002928
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMGGhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMSHhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMUAhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMGGhq0f+002916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMSHhq0f+002916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMUAhq0f+002916
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0964_2018050100_123_987_12204608_1_r1847394448_121.zip
Uploading the intermediate file: upload_file_121.zip
  20:44:03 STEP 2929 H=2929:00 +CPU= 47.671
  20:44:55 STEP 2930 H=2930:00 +CPU= 49.724
  20:46:20 STEP 2931 H=2931:00 +CPU= 76.517
  20:47:14 STEP 2932 H=2932:00 +CPU= 50.007
  20:48:06 STEP 2933 H=2933:00 +CPU= 47.837
  20:49:34 STEP 2934 H=2934:00 +CPU= 78.585
  20:50:27 STEP 2935 H=2935:00 +CPU= 49.019
  20:51:22 STEP 2936 H=2936:00 +CPU= 49.920
  20:52:48 STEP 2937 H=2937:00 +CPU= 76.903
  20:53:44 STEP 2938 H=2938:00 +CPU= 49.127
  20:54:40 STEP 2939 H=2939:00 +CPU= 48.190
  20:56:13 STEP 2940 H=2940:00 +CPU= 84.941
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhq0f+002940
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhq0f+002940
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhq0f+002940
  20:57:08 STEP 2941 H=2941:00 +CPU= 48.351
  20:58:03 STEP 2942 H=2942:00 +CPU= 49.865
  20:59:28 STEP 2943 H=2943:00 +CPU= 76.466
  21:00:22 STEP 2944 H=2944:00 +CPU= 49.649
  21:01:15 STEP 2945 H=2945:00 +CPU= 47.379
  21:02:44 STEP 2946 H=2946:00 +CPU= 78.254
  21:03:38 STEP 2947 H=2947:00 +CPU= 47.952
  21:04:32 STEP 2948 H=2948:00 +CPU= 49.174
  21:05:58 STEP 2949 H=2949:00 +CPU= 76.555
  21:06:54 STEP 2950 H=2950:00 +CPU= 49.644
  21:07:47 STEP 2951 H=2951:00 +CPU= 50.590
  21:09:20 STEP 2952 H=2952:00 +CPU= 87.860
The child process terminated with status: 0
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhq0f+002952
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhq0f+002952
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMUAhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMUAhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMUAhq0f+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMSHhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMGGhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMSHhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMGGhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMGGhq0f+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12204608/ICMSHhq0f+002940
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0964_2018050100_123_987_12204608_1_r1847394448_122.zip
Uploading the final file: upload_file_122.zip
Uploading trickle at timestep: 10623600
21:12:45 (256117): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:47:53 1525245 22299917 oifs_43r3_ps_0964_2018050100_123_987_12204608_1 10,623,600 127,769 0.0120
09 May 2023 16:44:58 1525245 22299917 oifs_43r3_ps_0964_2018050100_123_987_12204608_1 9,590,400 110,959 0.0116
09 May 2023 16:44:54 1525245 22299917 oifs_43r3_ps_0964_2018050100_123_987_12204608_1 8,726,400 101,329 0.0116
09 May 2023 16:44:50 1525245 22299917 oifs_43r3_ps_0964_2018050100_123_987_12204608_1 7,862,400 91,702 0.0117
09 May 2023 16:44:46 1525245 22299917 oifs_43r3_ps_0964_2018050100_123_987_12204608_1 6,998,400 82,088 0.0117
09 May 2023 16:44:42 1525245 22299917 oifs_43r3_ps_0964_2018050100_123_987_12204608_1 6,134,400 72,465 0.0118
09 May 2023 16:44:38 1525245 22299917 oifs_43r3_ps_0964_2018050100_123_987_12204608_1 5,270,400 62,815 0.0119
09 May 2023 16:44:32 1525245 22299917 oifs_43r3_ps_0964_2018050100_123_987_12204608_1 4,406,400 53,184 0.0121
09 May 2023 16:44:26 1525245 22299917 oifs_43r3_ps_0964_2018050100_123_987_12204608_1 3,542,400 43,553 0.0123
09 May 2023 16:35:52 1525245 22299917 oifs_43r3_ps_0964_2018050100_123_987_12204608_1 2,246,400 27,654 0.0123
09 May 2023 16:35:29 1525245 22299917 oifs_43r3_ps_0964_2018050100_123_987_12204608_1 1,382,400 17,735 0.0128


©2024 climateprediction.net