climateprediction.net home page
Task 22277994

Task 22277994

Name oifs_43r3_ps_0622_2006050100_123_975_12192266_0
Workunit 12192266
Created 23 Dec 2022, 13:39:34 UTC
Sent 19 Jan 2023, 7:44:00 UTC
Report deadline 20 Mar 2023, 7:44:00 UTC
Received 20 Jan 2023, 10:46:01 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1527784
Run time 16 hours 54 min 44 sec
CPU time 16 hours 25 min 13 sec
Validate state Valid
Credit 14,873.04
Device peak FLOPS 6.66 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,414.77 MB
Peak swap size 4,978.08 MB
Peak disk usage 2,017.20 MB
Stderr
<core_client_version>7.18.1</core_client_version>
<![CDATA[
<stderr_txt>
_12192266/ICMUAhq0f+002484
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0622_2006050100_123_975_12192266_0_r796883046_103.zip
Uploading the intermediate file: upload_file_103.zip
  00:08:21 STEP 2497 H=2497:00 +CPU= 15.860
  00:08:37 STEP 2498 H=2498:00 +CPU= 15.840
  00:09:01 STEP 2499 H=2499:00 +CPU= 23.982
  00:09:17 STEP 2500 H=2500:00 +CPU= 16.330
  00:09:33 STEP 2501 H=2501:00 +CPU= 15.650
  00:09:58 STEP 2502 H=2502:00 +CPU= 24.368
  00:10:14 STEP 2503 H=2503:00 +CPU= 15.878
  00:10:30 STEP 2504 H=2504:00 +CPU= 15.992
  00:10:54 STEP 2505 H=2505:00 +CPU= 23.926
  00:11:10 STEP 2506 H=2506:00 +CPU= 16.384
  00:11:26 STEP 2507 H=2507:00 +CPU= 15.728
  00:11:53 STEP 2508 H=2508:00 +CPU= 26.483
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002508
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002508
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002508
  00:12:09 STEP 2509 H=2509:00 +CPU= 15.927
  00:12:25 STEP 2510 H=2510:00 +CPU= 16.046
  00:12:49 STEP 2511 H=2511:00 +CPU= 23.930
  00:13:06 STEP 2512 H=2512:00 +CPU= 16.384
  00:13:21 STEP 2513 H=2513:00 +CPU= 15.643
  00:13:46 STEP 2514 H=2514:00 +CPU= 24.474
  00:14:02 STEP 2515 H=2515:00 +CPU= 15.923
  00:14:18 STEP 2516 H=2516:00 +CPU= 16.139
  00:14:42 STEP 2517 H=2517:00 +CPU= 24.003
  00:14:59 STEP 2518 H=2518:00 +CPU= 16.373
  00:15:15 STEP 2519 H=2519:00 +CPU= 16.277
  00:15:44 STEP 2520 H=2520:00 +CPU= 28.604
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002520
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002520
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMGGhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMSHhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMUAhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMGGhq0f+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMSHhq0f+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMUAhq0f+002508
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0622_2006050100_123_975_12192266_0_r796883046_104.zip
Uploading the intermediate file: upload_file_104.zip
  00:16:00 STEP 2521 H=2521:00 +CPU= 15.977
  00:16:17 STEP 2522 H=2522:00 +CPU= 15.931
  00:16:41 STEP 2523 H=2523:00 +CPU= 23.962
  00:16:57 STEP 2524 H=2524:00 +CPU= 16.229
  00:17:13 STEP 2525 H=2525:00 +CPU= 15.595
  00:17:38 STEP 2526 H=2526:00 +CPU= 24.398
  00:17:54 STEP 2527 H=2527:00 +CPU= 15.969
  00:18:10 STEP 2528 H=2528:00 +CPU= 16.033
  00:18:34 STEP 2529 H=2529:00 +CPU= 23.985
  00:18:50 STEP 2530 H=2530:00 +CPU= 16.313
  00:19:06 STEP 2531 H=2531:00 +CPU= 15.704
  00:19:33 STEP 2532 H=2532:00 +CPU= 26.394
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002532
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002532
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002532
  00:19:49 STEP 2533 H=2533:00 +CPU= 15.970
  00:20:05 STEP 2534 H=2534:00 +CPU= 16.043
  00:20:30 STEP 2535 H=2535:00 +CPU= 24.034
  00:20:46 STEP 2536 H=2536:00 +CPU= 16.412
  00:21:02 STEP 2537 H=2537:00 +CPU= 15.720
  00:21:26 STEP 2538 H=2538:00 +CPU= 24.483
  00:21:42 STEP 2539 H=2539:00 +CPU= 15.961
  00:21:59 STEP 2540 H=2540:00 +CPU= 16.145
  00:22:23 STEP 2541 H=2541:00 +CPU= 23.922
  00:22:39 STEP 2542 H=2542:00 +CPU= 16.343
  00:22:56 STEP 2543 H=2543:00 +CPU= 16.360
  00:23:24 STEP 2544 H=2544:00 +CPU= 28.443
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002544
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002544
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMGGhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMSHhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMUAhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMGGhq0f+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMSHhq0f+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMUAhq0f+002532
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0622_2006050100_123_975_12192266_0_r796883046_105.zip
Uploading the intermediate file: upload_file_105.zip
  00:23:40 STEP 2545 H=2545:00 +CPU= 15.926
  00:23:57 STEP 2546 H=2546:00 +CPU= 16.123
  00:24:21 STEP 2547 H=2547:00 +CPU= 23.883
  00:24:37 STEP 2548 H=2548:00 +CPU= 16.452
  00:24:53 STEP 2549 H=2549:00 +CPU= 15.823
  00:25:18 STEP 2550 H=2550:00 +CPU= 24.498
  00:25:34 STEP 2551 H=2551:00 +CPU= 16.024
  00:25:50 STEP 2552 H=2552:00 +CPU= 16.230
  00:26:15 STEP 2553 H=2553:00 +CPU= 24.026
  00:26:31 STEP 2554 H=2554:00 +CPU= 16.502
  00:26:47 STEP 2555 H=2555:00 +CPU= 15.861
  00:27:14 STEP 2556 H=2556:00 +CPU= 26.395
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002556
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002556
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002556
  00:27:29 STEP 2557 H=2557:00 +CPU= 15.066
  00:27:44 STEP 2558 H=2558:00 +CPU= 14.879
  00:28:06 STEP 2559 H=2559:00 +CPU= 21.839
  00:28:20 STEP 2560 H=2560:00 +CPU= 13.959
  00:28:33 STEP 2561 H=2561:00 +CPU= 13.444
  00:28:55 STEP 2562 H=2562:00 +CPU= 21.410
  00:29:08 STEP 2563 H=2563:00 +CPU= 13.519
  00:29:22 STEP 2564 H=2564:00 +CPU= 13.815
  00:29:43 STEP 2565 H=2565:00 +CPU= 20.925
  00:29:57 STEP 2566 H=2566:00 +CPU= 13.914
  00:30:11 STEP 2567 H=2567:00 +CPU= 13.889
  00:30:36 STEP 2568 H=2568:00 +CPU= 24.961
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002568
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002568
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMGGhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMSHhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMUAhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMGGhq0f+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMSHhq0f+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMUAhq0f+002556
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0622_2006050100_123_975_12192266_0_r796883046_106.zip
Uploading the intermediate file: upload_file_106.zip
  00:30:49 STEP 2569 H=2569:00 +CPU= 13.681
  00:31:04 STEP 2570 H=2570:00 +CPU= 14.717
  00:31:27 STEP 2571 H=2571:00 +CPU= 22.383
  00:31:42 STEP 2572 H=2572:00 +CPU= 15.060
  00:31:56 STEP 2573 H=2573:00 +CPU= 14.513
  00:32:19 STEP 2574 H=2574:00 +CPU= 22.843
  00:32:34 STEP 2575 H=2575:00 +CPU= 14.700
  00:32:49 STEP 2576 H=2576:00 +CPU= 15.010
  00:33:12 STEP 2577 H=2577:00 +CPU= 22.436
  00:33:27 STEP 2578 H=2578:00 +CPU= 15.143
  00:33:42 STEP 2579 H=2579:00 +CPU= 14.670
  00:34:07 STEP 2580 H=2580:00 +CPU= 24.721
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002580
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002580
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002580
  00:34:21 STEP 2581 H=2581:00 +CPU= 14.759
  00:34:36 STEP 2582 H=2582:00 +CPU= 15.024
  00:34:59 STEP 2583 H=2583:00 +CPU= 22.460
  00:35:14 STEP 2584 H=2584:00 +CPU= 15.182
  00:35:29 STEP 2585 H=2585:00 +CPU= 14.630
  00:35:52 STEP 2586 H=2586:00 +CPU= 22.912
  00:36:07 STEP 2587 H=2587:00 +CPU= 14.750
  00:36:22 STEP 2588 H=2588:00 +CPU= 15.073
  00:36:45 STEP 2589 H=2589:00 +CPU= 22.486
  00:37:00 STEP 2590 H=2590:00 +CPU= 15.142
  00:37:15 STEP 2591 H=2591:00 +CPU= 15.122
  00:37:42 STEP 2592 H=2592:00 +CPU= 26.717
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002592
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002592
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMGGhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMSHhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMUAhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMGGhq0f+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMSHhq0f+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMUAhq0f+002580
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0622_2006050100_123_975_12192266_0_r796883046_107.zip
Uploading the intermediate file: upload_file_107.zip
  00:37:57 STEP 2593 H=2593:00 +CPU= 14.772
  00:38:12 STEP 2594 H=2594:00 +CPU= 14.968
  00:38:35 STEP 2595 H=2595:00 +CPU= 22.399
  00:38:50 STEP 2596 H=2596:00 +CPU= 15.152
  00:39:05 STEP 2597 H=2597:00 +CPU= 14.673
  00:39:28 STEP 2598 H=2598:00 +CPU= 22.867
  00:39:43 STEP 2599 H=2599:00 +CPU= 14.805
  00:39:58 STEP 2600 H=2600:00 +CPU= 15.091
  00:40:21 STEP 2601 H=2601:00 +CPU= 22.481
  00:40:36 STEP 2602 H=2602:00 +CPU= 15.187
  00:40:51 STEP 2603 H=2603:00 +CPU= 14.696
  00:41:15 STEP 2604 H=2604:00 +CPU= 24.663
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002604
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002604
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002604
  00:41:30 STEP 2605 H=2605:00 +CPU= 14.761
  00:41:46 STEP 2606 H=2606:00 +CPU= 15.175
  00:42:08 STEP 2607 H=2607:00 +CPU= 22.473
  00:42:23 STEP 2608 H=2608:00 +CPU= 15.208
  00:42:38 STEP 2609 H=2609:00 +CPU= 14.709
  00:43:01 STEP 2610 H=2610:00 +CPU= 22.901
  00:43:16 STEP 2611 H=2611:00 +CPU= 14.783
  00:43:31 STEP 2612 H=2612:00 +CPU= 15.069
  00:43:54 STEP 2613 H=2613:00 +CPU= 22.484
  00:44:09 STEP 2614 H=2614:00 +CPU= 15.170
  00:44:24 STEP 2615 H=2615:00 +CPU= 15.097
  00:44:51 STEP 2616 H=2616:00 +CPU= 26.656
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002616
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002616
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMGGhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMSHhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMUAhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMGGhq0f+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMSHhq0f+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMUAhq0f+002604
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0622_2006050100_123_975_12192266_0_r796883046_108.zip
Uploading the intermediate file: upload_file_108.zip
  00:45:06 STEP 2617 H=2617:00 +CPU= 14.831
  00:45:21 STEP 2618 H=2618:00 +CPU= 15.011
  00:45:44 STEP 2619 H=2619:00 +CPU= 22.425
  00:45:59 STEP 2620 H=2620:00 +CPU= 15.120
  00:46:14 STEP 2621 H=2621:00 +CPU= 14.658
  00:46:37 STEP 2622 H=2622:00 +CPU= 22.914
  00:46:52 STEP 2623 H=2623:00 +CPU= 14.715
  00:47:07 STEP 2624 H=2624:00 +CPU= 15.062
  00:47:30 STEP 2625 H=2625:00 +CPU= 22.425
  00:47:45 STEP 2626 H=2626:00 +CPU= 15.158
  00:48:00 STEP 2627 H=2627:00 +CPU= 14.628
  00:48:25 STEP 2628 H=2628:00 +CPU= 24.735
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002628
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002628
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002628
  00:48:40 STEP 2629 H=2629:00 +CPU= 14.902
  00:48:55 STEP 2630 H=2630:00 +CPU= 15.116
  00:49:17 STEP 2631 H=2631:00 +CPU= 22.424
  00:49:32 STEP 2632 H=2632:00 +CPU= 15.167
  00:49:47 STEP 2633 H=2633:00 +CPU= 14.689
  00:50:10 STEP 2634 H=2634:00 +CPU= 22.886
  00:50:25 STEP 2635 H=2635:00 +CPU= 14.703
  00:50:40 STEP 2636 H=2636:00 +CPU= 15.044
  00:51:03 STEP 2637 H=2637:00 +CPU= 22.396
  00:51:18 STEP 2638 H=2638:00 +CPU= 15.098
  00:51:33 STEP 2639 H=2639:00 +CPU= 15.117
  00:52:00 STEP 2640 H=2640:00 +CPU= 26.572
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002640
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002640
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMGGhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMSHhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMUAhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMGGhq0f+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMSHhq0f+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMUAhq0f+002628
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0622_2006050100_123_975_12192266_0_r796883046_109.zip
Uploading the intermediate file: upload_file_109.zip
  00:52:15 STEP 2641 H=2641:00 +CPU= 14.708
Uploading trickle at timestep: 9504000
  00:52:30 STEP 2642 H=2642:00 +CPU= 15.138
  00:52:53 STEP 2643 H=2643:00 +CPU= 22.415
  00:53:08 STEP 2644 H=2644:00 +CPU= 15.093
  00:53:23 STEP 2645 H=2645:00 +CPU= 14.626
  00:53:46 STEP 2646 H=2646:00 +CPU= 22.898
  00:54:01 STEP 2647 H=2647:00 +CPU= 14.709
  00:54:16 STEP 2648 H=2648:00 +CPU= 15.082
  00:54:39 STEP 2649 H=2649:00 +CPU= 22.418
  00:54:54 STEP 2650 H=2650:00 +CPU= 15.122
  00:55:08 STEP 2651 H=2651:00 +CPU= 14.654
  00:55:33 STEP 2652 H=2652:00 +CPU= 24.667
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002652
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002652
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002652
  00:55:48 STEP 2653 H=2653:00 +CPU= 14.793
  00:56:03 STEP 2654 H=2654:00 +CPU= 15.092
  00:56:26 STEP 2655 H=2655:00 +CPU= 22.418
  00:56:41 STEP 2656 H=2656:00 +CPU= 15.177
  00:56:56 STEP 2657 H=2657:00 +CPU= 14.635
  00:57:19 STEP 2658 H=2658:00 +CPU= 22.856
  00:57:33 STEP 2659 H=2659:00 +CPU= 14.764
  00:57:49 STEP 2660 H=2660:00 +CPU= 15.100
  00:58:11 STEP 2661 H=2661:00 +CPU= 22.418
  00:58:26 STEP 2662 H=2662:00 +CPU= 15.159
  00:58:41 STEP 2663 H=2663:00 +CPU= 15.098
  00:59:08 STEP 2664 H=2664:00 +CPU= 26.557
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002664
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002664
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMGGhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMSHhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMUAhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMGGhq0f+002652
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMSHhq0f+002652
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMUAhq0f+002652
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0622_2006050100_123_975_12192266_0_r796883046_110.zip
Uploading the intermediate file: upload_file_110.zip
  00:59:23 STEP 2665 H=2665:00 +CPU= 14.711
  00:59:38 STEP 2666 H=2666:00 +CPU= 15.042
  01:00:01 STEP 2667 H=2667:00 +CPU= 22.455
  01:00:16 STEP 2668 H=2668:00 +CPU= 15.116
  01:00:31 STEP 2669 H=2669:00 +CPU= 14.609
  01:00:54 STEP 2670 H=2670:00 +CPU= 23.044
  01:01:09 STEP 2671 H=2671:00 +CPU= 14.758
  01:01:24 STEP 2672 H=2672:00 +CPU= 15.042
  01:01:47 STEP 2673 H=2673:00 +CPU= 22.468
  01:02:02 STEP 2674 H=2674:00 +CPU= 15.185
  01:02:17 STEP 2675 H=2675:00 +CPU= 14.683
  01:02:42 STEP 2676 H=2676:00 +CPU= 24.755
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002676
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002676
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002676
  01:02:57 STEP 2677 H=2677:00 +CPU= 14.739
  01:03:12 STEP 2678 H=2678:00 +CPU= 15.050
  01:03:34 STEP 2679 H=2679:00 +CPU= 22.450
  01:03:50 STEP 2680 H=2680:00 +CPU= 15.236
  01:04:05 STEP 2681 H=2681:00 +CPU= 14.619
  01:04:28 STEP 2682 H=2682:00 +CPU= 23.036
  01:04:42 STEP 2683 H=2683:00 +CPU= 14.713
  01:04:58 STEP 2684 H=2684:00 +CPU= 15.037
  01:05:20 STEP 2685 H=2685:00 +CPU= 22.612
  01:05:36 STEP 2686 H=2686:00 +CPU= 15.213
  01:05:51 STEP 2687 H=2687:00 +CPU= 15.162
  01:06:18 STEP 2688 H=2688:00 +CPU= 26.599
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002688
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002688
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMGGhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMSHhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMUAhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMGGhq0f+002676
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMSHhq0f+002676
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMUAhq0f+002676
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0622_2006050100_123_975_12192266_0_r796883046_111.zip
Uploading the intermediate file: upload_file_111.zip
  01:06:33 STEP 2689 H=2689:00 +CPU= 14.726
  01:06:48 STEP 2690 H=2690:00 +CPU= 14.881
  01:07:10 STEP 2691 H=2691:00 +CPU= 22.551
  01:07:26 STEP 2692 H=2692:00 +CPU= 15.064
  01:07:40 STEP 2693 H=2693:00 +CPU= 14.513
  01:08:03 STEP 2694 H=2694:00 +CPU= 23.024
  01:08:18 STEP 2695 H=2695:00 +CPU= 14.654
  01:08:33 STEP 2696 H=2696:00 +CPU= 14.913
  01:08:56 STEP 2697 H=2697:00 +CPU= 22.484
  01:09:11 STEP 2698 H=2698:00 +CPU= 15.048
  01:09:25 STEP 2699 H=2699:00 +CPU= 14.505
  01:09:50 STEP 2700 H=2700:00 +CPU= 24.906
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002700
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002700
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002700
  01:10:05 STEP 2701 H=2701:00 +CPU= 14.819
  01:10:20 STEP 2702 H=2702:00 +CPU= 15.018
  01:10:43 STEP 2703 H=2703:00 +CPU= 22.464
  01:10:58 STEP 2704 H=2704:00 +CPU= 15.164
  01:11:13 STEP 2705 H=2705:00 +CPU= 14.523
  01:11:36 STEP 2706 H=2706:00 +CPU= 23.022
  01:11:51 STEP 2707 H=2707:00 +CPU= 14.671
  01:12:06 STEP 2708 H=2708:00 +CPU= 15.028
  01:12:28 STEP 2709 H=2709:00 +CPU= 22.527
  01:12:44 STEP 2710 H=2710:00 +CPU= 15.164
  01:12:59 STEP 2711 H=2711:00 +CPU= 15.119
  01:13:26 STEP 2712 H=2712:00 +CPU= 26.677
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002712
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002712
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMGGhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMSHhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMUAhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMGGhq0f+002700
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMSHhq0f+002700
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMUAhq0f+002700
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0622_2006050100_123_975_12192266_0_r796883046_112.zip
Uploading the intermediate file: upload_file_112.zip
  01:13:41 STEP 2713 H=2713:00 +CPU= 14.698
  01:13:56 STEP 2714 H=2714:00 +CPU= 14.865
  01:14:19 STEP 2715 H=2715:00 +CPU= 22.593
  01:14:34 STEP 2716 H=2716:00 +CPU= 15.192
  01:14:49 STEP 2717 H=2717:00 +CPU= 14.610
  01:15:12 STEP 2718 H=2718:00 +CPU= 23.067
  01:15:27 STEP 2719 H=2719:00 +CPU= 14.781
  01:15:42 STEP 2720 H=2720:00 +CPU= 15.003
  01:16:05 STEP 2721 H=2721:00 +CPU= 22.559
  01:16:20 STEP 2722 H=2722:00 +CPU= 15.172
  01:16:34 STEP 2723 H=2723:00 +CPU= 14.640
  01:17:00 STEP 2724 H=2724:00 +CPU= 24.965
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002724
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002724
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002724
  01:17:14 STEP 2725 H=2725:00 +CPU= 14.781
  01:17:30 STEP 2726 H=2726:00 +CPU= 15.004
  01:17:52 STEP 2727 H=2727:00 +CPU= 22.565
  01:18:08 STEP 2728 H=2728:00 +CPU= 15.231
  01:18:22 STEP 2729 H=2729:00 +CPU= 14.598
  01:18:45 STEP 2730 H=2730:00 +CPU= 23.039
  01:19:00 STEP 2731 H=2731:00 +CPU= 14.883
  01:19:16 STEP 2732 H=2732:00 +CPU= 15.080
  01:19:38 STEP 2733 H=2733:00 +CPU= 22.602
  01:19:54 STEP 2734 H=2734:00 +CPU= 15.319
  01:20:09 STEP 2735 H=2735:00 +CPU= 15.074
  01:20:36 STEP 2736 H=2736:00 +CPU= 26.818
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002736
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002736
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMGGhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMSHhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMUAhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMGGhq0f+002724
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMSHhq0f+002724
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMUAhq0f+002724
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0622_2006050100_123_975_12192266_0_r796883046_113.zip
Uploading the intermediate file: upload_file_113.zip
  01:20:51 STEP 2737 H=2737:00 +CPU= 14.711
 SMILAG TRAJECTORY UNDERGROUND      1 TIMES.
  POINT=            4  MAX ETADOT VERTICAL VEL.=   9.632632031156947E-007
  LON  =    20.0000000000000       degrees
  LAT  =   -39.8128523737712       degrees
  01:21:06 STEP 2738 H=2738:00 +CPU= 14.839
  01:21:29 STEP 2739 H=2739:00 +CPU= 22.569
  01:21:44 STEP 2740 H=2740:00 +CPU= 15.246
  01:21:59 STEP 2741 H=2741:00 +CPU= 14.660
  01:22:22 STEP 2742 H=2742:00 +CPU= 23.076
  01:22:37 STEP 2743 H=2743:00 +CPU= 14.854
  01:22:52 STEP 2744 H=2744:00 +CPU= 15.026
  01:23:15 STEP 2745 H=2745:00 +CPU= 22.556
  01:23:30 STEP 2746 H=2746:00 +CPU= 15.213
  01:23:45 STEP 2747 H=2747:00 +CPU= 14.524
  01:24:10 STEP 2748 H=2748:00 +CPU= 25.043
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002748
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002748
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002748
  01:24:25 STEP 2749 H=2749:00 +CPU= 14.849
  01:24:40 STEP 2750 H=2750:00 +CPU= 15.044
  01:25:03 STEP 2751 H=2751:00 +CPU= 22.741
  01:25:18 STEP 2752 H=2752:00 +CPU= 15.363
  01:25:33 STEP 2753 H=2753:00 +CPU= 14.665
  01:25:56 STEP 2754 H=2754:00 +CPU= 23.048
  01:26:11 STEP 2755 H=2755:00 +CPU= 14.783
  01:26:26 STEP 2756 H=2756:00 +CPU= 15.074
  01:26:49 STEP 2757 H=2757:00 +CPU= 22.599
  01:27:04 STEP 2758 H=2758:00 +CPU= 15.197
  01:27:19 STEP 2759 H=2759:00 +CPU= 15.027
  01:27:46 STEP 2760 H=2760:00 +CPU= 26.767
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002760
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002760
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMGGhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMSHhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMUAhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMGGhq0f+002748
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMSHhq0f+002748
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMUAhq0f+002748
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0622_2006050100_123_975_12192266_0_r796883046_114.zip
Uploading the intermediate file: upload_file_114.zip
  01:28:01 STEP 2761 H=2761:00 +CPU= 14.756
  01:28:16 STEP 2762 H=2762:00 +CPU= 14.867
  01:28:39 STEP 2763 H=2763:00 +CPU= 22.554
  01:28:54 STEP 2764 H=2764:00 +CPU= 15.104
  01:29:09 STEP 2765 H=2765:00 +CPU= 14.497
  01:29:32 STEP 2766 H=2766:00 +CPU= 22.906
  01:29:47 STEP 2767 H=2767:00 +CPU= 14.678
  01:30:02 STEP 2768 H=2768:00 +CPU= 14.974
  01:30:24 STEP 2769 H=2769:00 +CPU= 22.462
  01:30:40 STEP 2770 H=2770:00 +CPU= 15.150
  01:30:54 STEP 2771 H=2771:00 +CPU= 14.530
  01:31:19 STEP 2772 H=2772:00 +CPU= 24.899
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002772
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002772
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002772
  01:31:34 STEP 2773 H=2773:00 +CPU= 14.815
  01:31:49 STEP 2774 H=2774:00 +CPU= 15.020
  01:32:12 STEP 2775 H=2775:00 +CPU= 22.439
  01:32:27 STEP 2776 H=2776:00 +CPU= 15.088
  01:32:42 STEP 2777 H=2777:00 +CPU= 14.552
  01:33:05 STEP 2778 H=2778:00 +CPU= 22.965
  01:33:19 STEP 2779 H=2779:00 +CPU= 14.719
  01:33:34 STEP 2780 H=2780:00 +CPU= 15.019
  01:33:57 STEP 2781 H=2781:00 +CPU= 22.451
  01:34:12 STEP 2782 H=2782:00 +CPU= 15.098
  01:34:27 STEP 2783 H=2783:00 +CPU= 15.026
  01:34:55 STEP 2784 H=2784:00 +CPU= 26.874
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002784
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002784
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMGGhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMSHhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMUAhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMGGhq0f+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMSHhq0f+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMUAhq0f+002772
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0622_2006050100_123_975_12192266_0_r796883046_115.zip
Uploading the intermediate file: upload_file_115.zip
  01:35:09 STEP 2785 H=2785:00 +CPU= 14.706
  01:35:24 STEP 2786 H=2786:00 +CPU= 15.033
  01:35:47 STEP 2787 H=2787:00 +CPU= 22.370
  01:36:02 STEP 2788 H=2788:00 +CPU= 15.049
  01:36:17 STEP 2789 H=2789:00 +CPU= 14.569
  01:36:40 STEP 2790 H=2790:00 +CPU= 22.902
  01:36:55 STEP 2791 H=2791:00 +CPU= 14.806
  01:37:10 STEP 2792 H=2792:00 +CPU= 14.955
  01:37:32 STEP 2793 H=2793:00 +CPU= 22.440
  01:37:48 STEP 2794 H=2794:00 +CPU= 15.157
  01:38:02 STEP 2795 H=2795:00 +CPU= 14.536
  01:38:27 STEP 2796 H=2796:00 +CPU= 24.921
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002796
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002796
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002796
  01:38:42 STEP 2797 H=2797:00 +CPU= 14.891
  01:38:57 STEP 2798 H=2798:00 +CPU= 15.126
  01:39:20 STEP 2799 H=2799:00 +CPU= 22.502
  01:39:35 STEP 2800 H=2800:00 +CPU= 15.159
  01:39:50 STEP 2801 H=2801:00 +CPU= 14.539
  01:40:13 STEP 2802 H=2802:00 +CPU= 22.896
  01:40:28 STEP 2803 H=2803:00 +CPU= 14.706
  01:40:43 STEP 2804 H=2804:00 +CPU= 14.976
  01:41:06 STEP 2805 H=2805:00 +CPU= 22.431
  01:41:21 STEP 2806 H=2806:00 +CPU= 15.138
  01:41:36 STEP 2807 H=2807:00 +CPU= 14.982
  01:42:03 STEP 2808 H=2808:00 +CPU= 26.751
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002808
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002808
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMGGhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMSHhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMUAhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMGGhq0f+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMSHhq0f+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMUAhq0f+002796
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0622_2006050100_123_975_12192266_0_r796883046_116.zip
Uploading the intermediate file: upload_file_116.zip
  01:42:18 STEP 2809 H=2809:00 +CPU= 14.675
  01:42:33 STEP 2810 H=2810:00 +CPU= 15.016
  01:42:56 STEP 2811 H=2811:00 +CPU= 22.295
  01:43:11 STEP 2812 H=2812:00 +CPU= 15.025
  01:43:25 STEP 2813 H=2813:00 +CPU= 14.501
  01:43:48 STEP 2814 H=2814:00 +CPU= 22.897
  01:44:03 STEP 2815 H=2815:00 +CPU= 14.681
  01:44:18 STEP 2816 H=2816:00 +CPU= 15.053
  01:44:41 STEP 2817 H=2817:00 +CPU= 22.391
  01:44:56 STEP 2818 H=2818:00 +CPU= 15.089
  01:45:11 STEP 2819 H=2819:00 +CPU= 14.489
  01:45:35 STEP 2820 H=2820:00 +CPU= 24.865
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002820
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002820
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002820
  01:45:50 STEP 2821 H=2821:00 +CPU= 14.822
  01:46:06 STEP 2822 H=2822:00 +CPU= 15.113
  01:46:28 STEP 2823 H=2823:00 +CPU= 22.339
  01:46:43 STEP 2824 H=2824:00 +CPU= 15.101
  01:46:58 STEP 2825 H=2825:00 +CPU= 14.598
  01:47:21 STEP 2826 H=2826:00 +CPU= 22.836
  01:47:36 STEP 2827 H=2827:00 +CPU= 14.711
  01:47:51 STEP 2828 H=2828:00 +CPU= 15.016
  01:48:13 STEP 2829 H=2829:00 +CPU= 22.427
  01:48:28 STEP 2830 H=2830:00 +CPU= 15.177
  01:48:44 STEP 2831 H=2831:00 +CPU= 15.019
  01:49:11 STEP 2832 H=2832:00 +CPU= 26.828
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002832
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002832
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMGGhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMSHhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMUAhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMGGhq0f+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMSHhq0f+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMUAhq0f+002820
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0622_2006050100_123_975_12192266_0_r796883046_117.zip
Uploading the intermediate file: upload_file_117.zip
  01:49:26 STEP 2833 H=2833:00 +CPU= 14.740
  01:49:41 STEP 2834 H=2834:00 +CPU= 14.993
  01:50:03 STEP 2835 H=2835:00 +CPU= 22.289
  01:50:19 STEP 2836 H=2836:00 +CPU= 15.209
  01:50:33 STEP 2837 H=2837:00 +CPU= 14.651
  01:50:57 STEP 2838 H=2838:00 +CPU= 22.928
  01:51:11 STEP 2839 H=2839:00 +CPU= 14.859
  01:51:27 STEP 2840 H=2840:00 +CPU= 15.100
  01:51:49 STEP 2841 H=2841:00 +CPU= 22.479
  01:52:04 STEP 2842 H=2842:00 +CPU= 15.220
  01:52:19 STEP 2843 H=2843:00 +CPU= 14.599
  01:52:44 STEP 2844 H=2844:00 +CPU= 24.832
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002844
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002844
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002844
  01:52:59 STEP 2845 H=2845:00 +CPU= 14.701
  01:53:14 STEP 2846 H=2846:00 +CPU= 14.994
  01:53:36 STEP 2847 H=2847:00 +CPU= 22.314
  01:53:52 STEP 2848 H=2848:00 +CPU= 15.212
  01:54:06 STEP 2849 H=2849:00 +CPU= 14.658
  01:54:29 STEP 2850 H=2850:00 +CPU= 22.951
  01:54:44 STEP 2851 H=2851:00 +CPU= 14.859
  01:54:59 STEP 2852 H=2852:00 +CPU= 15.028
  01:55:22 STEP 2853 H=2853:00 +CPU= 22.366
  01:55:37 STEP 2854 H=2854:00 +CPU= 15.234
  01:55:52 STEP 2855 H=2855:00 +CPU= 15.088
  01:56:20 STEP 2856 H=2856:00 +CPU= 26.860
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002856
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002856
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMGGhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMSHhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMUAhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMGGhq0f+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMSHhq0f+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMUAhq0f+002844
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0622_2006050100_123_975_12192266_0_r796883046_118.zip
Uploading the intermediate file: upload_file_118.zip
  01:56:35 STEP 2857 H=2857:00 +CPU= 14.815
  01:56:50 STEP 2858 H=2858:00 +CPU= 14.943
  01:57:13 STEP 2859 H=2859:00 +CPU= 22.325
  01:57:28 STEP 2860 H=2860:00 +CPU= 15.092
  01:57:43 STEP 2861 H=2861:00 +CPU= 14.523
  01:58:05 STEP 2862 H=2862:00 +CPU= 22.815
  01:58:20 STEP 2863 H=2863:00 +CPU= 14.660
  01:58:35 STEP 2864 H=2864:00 +CPU= 14.944
  01:58:58 STEP 2865 H=2865:00 +CPU= 22.435
  01:59:13 STEP 2866 H=2866:00 +CPU= 15.135
  01:59:27 STEP 2867 H=2867:00 +CPU= 14.478
  01:59:52 STEP 2868 H=2868:00 +CPU= 24.819
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002868
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002868
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002868
  02:00:07 STEP 2869 H=2869:00 +CPU= 14.746
  02:00:22 STEP 2870 H=2870:00 +CPU= 15.062
  02:00:45 STEP 2871 H=2871:00 +CPU= 22.358
  02:01:00 STEP 2872 H=2872:00 +CPU= 15.171
  02:01:15 STEP 2873 H=2873:00 +CPU= 14.609
  02:01:38 STEP 2874 H=2874:00 +CPU= 22.912
  02:01:53 STEP 2875 H=2875:00 +CPU= 14.753
  02:02:08 STEP 2876 H=2876:00 +CPU= 14.971
  02:02:30 STEP 2877 H=2877:00 +CPU= 22.402
  02:02:45 STEP 2878 H=2878:00 +CPU= 15.119
  02:03:01 STEP 2879 H=2879:00 +CPU= 14.969
  02:03:28 STEP 2880 H=2880:00 +CPU= 26.743
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002880
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002880
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMGGhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMSHhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMUAhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMGGhq0f+002868
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMSHhq0f+002868
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMUAhq0f+002868
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0622_2006050100_123_975_12192266_0_r796883046_119.zip
Uploading the intermediate file: upload_file_119.zip
  02:03:42 STEP 2881 H=2881:00 +CPU= 14.591
Uploading trickle at timestep: 10368000
  02:03:57 STEP 2882 H=2882:00 +CPU= 14.781
  02:04:20 STEP 2883 H=2883:00 +CPU= 22.390
  02:04:35 STEP 2884 H=2884:00 +CPU= 15.087
  02:04:50 STEP 2885 H=2885:00 +CPU= 14.538
  02:05:13 STEP 2886 H=2886:00 +CPU= 22.815
  02:05:27 STEP 2887 H=2887:00 +CPU= 14.705
  02:05:43 STEP 2888 H=2888:00 +CPU= 15.028
  02:06:05 STEP 2889 H=2889:00 +CPU= 22.503
  02:06:20 STEP 2890 H=2890:00 +CPU= 15.148
  02:06:35 STEP 2891 H=2891:00 +CPU= 14.537
  02:07:00 STEP 2892 H=2892:00 +CPU= 24.749
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002892
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002892
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002892
  02:07:15 STEP 2893 H=2893:00 +CPU= 14.638
  02:07:30 STEP 2894 H=2894:00 +CPU= 14.899
  02:07:52 STEP 2895 H=2895:00 +CPU= 22.294
  02:08:07 STEP 2896 H=2896:00 +CPU= 15.068
  02:08:22 STEP 2897 H=2897:00 +CPU= 14.554
  02:08:45 STEP 2898 H=2898:00 +CPU= 22.776
  02:08:59 STEP 2899 H=2899:00 +CPU= 14.700
  02:09:15 STEP 2900 H=2900:00 +CPU= 14.968
  02:09:37 STEP 2901 H=2901:00 +CPU= 22.332
  02:09:52 STEP 2902 H=2902:00 +CPU= 15.033
  02:10:07 STEP 2903 H=2903:00 +CPU= 14.900
  02:10:34 STEP 2904 H=2904:00 +CPU= 26.718
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002904
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002904
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMGGhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMSHhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMUAhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMGGhq0f+002892
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMSHhq0f+002892
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMUAhq0f+002892
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0622_2006050100_123_975_12192266_0_r796883046_120.zip
Uploading the intermediate file: upload_file_120.zip
  02:10:49 STEP 2905 H=2905:00 +CPU= 14.747
  02:11:04 STEP 2906 H=2906:00 +CPU= 14.980
  02:11:27 STEP 2907 H=2907:00 +CPU= 22.371
  02:11:42 STEP 2908 H=2908:00 +CPU= 14.961
  02:11:56 STEP 2909 H=2909:00 +CPU= 14.475
  02:12:19 STEP 2910 H=2910:00 +CPU= 22.789
  02:12:34 STEP 2911 H=2911:00 +CPU= 14.682
  02:12:49 STEP 2912 H=2912:00 +CPU= 14.950
  02:13:12 STEP 2913 H=2913:00 +CPU= 22.368
  02:13:27 STEP 2914 H=2914:00 +CPU= 15.073
  02:13:41 STEP 2915 H=2915:00 +CPU= 14.447
  02:14:06 STEP 2916 H=2916:00 +CPU= 24.827
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002916
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002916
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002916
  02:14:22 STEP 2917 H=2917:00 +CPU= 14.906
  02:14:39 STEP 2918 H=2918:00 +CPU= 15.407
  02:15:06 STEP 2919 H=2919:00 +CPU= 22.976
  02:15:21 STEP 2920 H=2920:00 +CPU= 15.124
  02:15:35 STEP 2921 H=2921:00 +CPU= 14.236
Suspend request received from the BOINC client, suspending the child process
[EC_DRHOOK:antony-OptiPlex-3060:1:1:7443:7443] [20230120:021601:1674180961:59796.044] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1538] Received signal#15 (SIGTERM) :: 4031MB (heap), 4407MB (maxrss), 0MB (maxstack), 0 (paging), nsigs = 1
[EC_DRHOOK:antony-OptiPlex-3060:1:1:7443:7443] [20230120:021601:1674180961:59796.054] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1542] Also activating Harakiri-alarm (SIGALRM=14) to expire after 500s elapsed to prevent hangs, nsigs = 1
[EC_DRHOOK:antony-OptiPlex-3060:1:1:7443:7443] [20230120:021601:1674180961:59796.054] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1544] Harakiri signal handler 'signal_harakiri' for signal#14 (SIGALRM) installed at 0x81f3c0 (old at (nil))
[EC_DRHOOK:antony-OptiPlex-3060:1:1:7443:7443] [20230120:021601:1674180961:59796.054] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1617] Signal#15 was caused by unrecognized si_code [memaddr=0x1], nsigs = 1
[EC_DRHOOK:antony-OptiPlex-3060:1:1:7443:7443] [20230120:021601:1674180961:59796.054] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1686] Starting DrHook backtrace for signal#15, nsigs = 1
[EC_DRHOOK:antony-OptiPlex-3060:1:1:7443:7443] [20230120:021601:1674180961:59796.054] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3843] 4031 MB (maxheap), 4407 MB (maxrss), 0 MB (maxstack)
[EC_DRHOOK:antony-OptiPlex-3060:1:1:7443:7443] [20230120:021601:1674180961:59796.054] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :  MASTER 
[EC_DRHOOK:antony-OptiPlex-3060:1:1:7443:7443] [20230120:021601:1674180961:59796.054] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :   CNT0 
[EC_DRHOOK:antony-OptiPlex-3060:1:1:7443:7443] [20230120:021601:1674180961:59796.054] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :    CNT1 
[EC_DRHOOK:antony-OptiPlex-3060:1:1:7443:7443] [20230120:021601:1674180961:59796.054] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :     CNT2 
[EC_DRHOOK:antony-OptiPlex-3060:1:1:7443:7443] [20230120:021601:1674180961:59796.054] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :      CNT3 
[EC_DRHOOK:antony-OptiPlex-3060:1:1:7443:7443] [20230120:021601:1674180961:59796.054] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :       CNT4 
[EC_DRHOOK:antony-OptiPlex-3060:1:1:7443:7443] [20230120:021601:1674180961:59796.054] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :        STEPO 
[EC_DRHOOK:antony-OptiPlex-3060:1:1:7443:7443] [20230120:021601:1674180961:59796.054] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :         SCAN2M 
[EC_DRHOOK:antony-OptiPlex-3060:1:1:7443:7443] [20230120:021601:1674180961:59796.054] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :          GP_MODEL_HEAP 
[EC_DRHOOK:antony-OptiPlex-3060:1:1:7443:7443] [20230120:021601:1674180961:59796.054] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :           GP_MODEL 
[EC_DRHOOK:antony-OptiPlex-3060:1:1:7443:7443] [20230120:021601:1674180961:59796.054] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :            RADDRV 
[EC_DRHOOK:antony-OptiPlex-3060:1:1:7443:7443] [20230120:021601:1674180961:59796.054] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :             RADINTG 
[EC_DRHOOK:antony-OptiPlex-3060:1:1:7443:7443] [20230120:021601:1674180961:59796.054] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :              >OMP-RADINTG-RADLSW       (1210) 
[EC_DRHOOK:antony-OptiPlex-3060:1:1:7443:7443] [20230120:021601:1674180961:59796.054] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :               RADIATION_SCHEME 
[EC_DRHOOK:antony-OptiPlex-3060:1:1:7443:7443] [20230120:021601:1674180961:59796.055] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :                radiation_interface:radiation 
[EC_DRHOOK:antony-OptiPlex-3060:1:1:7443:7443] [20230120:021601:1674180961:59796.055] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :                 radiation_mcica_sw:solver_mcica_sw 
[EC_DRHOOK:antony-OptiPlex-3060:1:1:7443:7443] [20230120:021602:1674180962:59797.059] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1734] DrHook backtrace done for signal#15, nsigs = 1
[EC_DRHOOK:antony-OptiPlex-3060:1:1:7443:7443] [20230120:021602:1674180962:59797.059] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1785] Calling previous signal handler at 0x1ce8bb0 for signal#15, nsigs = 1
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source             
oifs_43r3_model.e  0000000001CE916B  Unknown               Unknown  Unknown
oifs_43r3_model.e  000000000081FFF1  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DC9090  Unknown               Unknown  Unknown
oifs_43r3_model.e  000000000196ABFB  radiation_mcica_s         286  radiation_mcica_sw.F90
oifs_43r3_model.e  0000000001862DC8  radiation_interfa         419  radiation_interface.F90
oifs_43r3_model.e  00000000012D30E5  radiation_scheme_         484  radiation_scheme.F90
oifs_43r3_model.e  000000000129A415  radintg_                 1455  radintg.F90
oifs_43r3_model.e  0000000001270124  raddrv_                   537  raddrv.F90
oifs_43r3_model.e  0000000000BFD839  gp_model_                 482  gp_model.F90
oifs_43r3_model.e  00000000012E9482  gp_model_heap_             74  gp_model_heap.F90
oifs_43r3_model.e  0000000000BBC1CE  scan2m_                   535  scan2m.F90
oifs_43r3_model.e  000000000057A664  stepo_                    327  stepo.F90
oifs_43r3_model.e  000000000055DEEC  cnt4_                    1133  cnt4.F90
oifs_43r3_model.e  00000000005471C9  cnt3_                     267  cnt3.F90
oifs_43r3_model.e  0000000000546412  cnt2_                      88  cnt2.F90
oifs_43r3_model.e  0000000000545E28  cnt1_                      92  cnt1.F90
oifs_43r3_model.e  000000000040708D  cnt0_                     146  cnt0.F90
oifs_43r3_model.e  000000000040220F  MAIN__                     96  master.F90
oifs_43r3_model.e  00000000004021A2  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DCA390  Unknown               Unknown  Unknown
oifs_43r3_model.e  000000000040206E  Unknown               Unknown  Unknown
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2006050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0622
(argv4) batchid: 975
(argv5) wuid: 12192266
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/12
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/12/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/12/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_b5386b69d4f340f701cca53b4501aed9 to: /var/lib/boinc-client/slots/12/oifs_43r3_ps_0622_2006050100_123_975_12192266.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/12/oifs_43r3_ps_0622_2006050100_123_975_12192266.zip
ic_ancil_file: ic_ancil_12192266
ifsdata_file: ifsdata_12192266
climate_data_file: clim_data_12192266
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_e6577ac2e731220956abe0afb2d071ea to: /var/lib/boinc-client/slots/12/ic_ancil_12192266.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/12/ic_ancil_12192266.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_363038cc5fc0b3fd32990da2e571ec55 to: /var/lib/boinc-client/slots/12/ifsdata/ifsdata_12192266.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/12/ifsdata/ifsdata_12192266.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/12/159l_2/clim_data_12192266.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/12/159l_2/clim_data_12192266.zip
Checking for progress XML file: /var/lib/boinc-client/slots/12/progress_file_12192266.xml
Opened progress file ok : /var/lib/boinc-client/slots/12/progress_file_12192266.xml
-- Model is restarting --
Adjusting last_iter, 2921, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/12/progress_file_12192266.xml
last_cpu_time: 58238
upload_file_number: 121
last_iter: 2903
last_upload: 10454400
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0622_2006050100_123_975_12192266_0_r796883046
The child process has been launched with process id: 4323
Executing the command: /var/lib/boinc-client/slots/12/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:antony-OptiPlex-3060:1:1:4323:4323] [20230120:092900:1674206940:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:antony-OptiPlex-3060:1:1:4323:4323] [20230120:092900:1674206940:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:antony-OptiPlex-3060:1:1:4323:4323] [20230120:092900:1674206940:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:antony-OptiPlex-3060:1:1:4323:4323] [20230120:092900:1674206940:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:antony-OptiPlex-3060:1:1:4323:4323] [20230120:092900:1674206940:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:antony-OptiPlex-3060:1:1:4323:4323] [20230120:092900:1674206940:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:antony-OptiPlex-3060:1:1:4323:4323] [20230120:092900:1674206940:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:antony-OptiPlex-3060:1:1:4323:4323] [20230120:092900:1674206940:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:antony-OptiPlex-3060:1:1:4323:4323] [20230120:092900:1674206940:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:antony-OptiPlex-3060:1:1:4323:4323] [20230120:092900:1674206940:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:antony-OptiPlex-3060:1:1:4323:4323] [20230120:092900:1674206940:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:antony-OptiPlex-3060:1:1:4323:4323] [20230120:092900:1674206940:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:antony-OptiPlex-3060:1:1:4323:4323] [20230120:092900:1674206940:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:antony-OptiPlex-3060:1:1:4323:4323] [20230120:092900:1674206940:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:antony-OptiPlex-3060:1:1:4323:4323] [20230120:092900:1674206940:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:antony-OptiPlex-3060:1:1:4323:4323] [20230120:092900:1674206940:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:antony-OptiPlex-3060:1:1:4323:4323] [20230120:092900:1674206940:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:antony-OptiPlex-3060:1:1:4323:4323] [20230120:092900:1674206940:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:antony-OptiPlex-3060:1:1:4323:4323] [20230120:092900:1674206940:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:antony-OptiPlex-3060:1:1:4323:4323] [20230120:092900:1674206940:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:antony-OptiPlex-3060:1:1:4323:4323] [20230120:092900:1674206940:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:antony-OptiPlex-3060:1:1:4323:4323] [20230120:092900:1674206940:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:antony-OptiPlex-3060:1:1:4323:4323] [20230120:092900:1674206940:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:antony-OptiPlex-3060:1:1:4323:4323] [20230120:092900:1674206940:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:antony-OptiPlex-3060:1:1:4323:4323] [20230120:092900:1674206940:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:antony-OptiPlex-3060:1:1:4323:4323] [20230120:092900:1674206940:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:antony-OptiPlex-3060:1:1:4323:4323] [20230120:092900:1674206940:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:antony-OptiPlex-3060:1:1:4323:4323] [20230120:092900:1674206940:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:antony-OptiPlex-3060:1:1:4323:4323] [20230120:092900:1674206940:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:antony-OptiPlex-3060:1:1:4323:4323] [20230120:092900:1674206940:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  09:29:28 STEP 2904 H=2904:00 +CPU= 23.984
  09:29:43 STEP 2905 H=2905:00 +CPU= 14.379
  09:29:59 STEP 2906 H=2906:00 +CPU= 15.018
  09:30:22 STEP 2907 H=2907:00 +CPU= 22.366
  09:30:37 STEP 2908 H=2908:00 +CPU= 14.976
  09:30:52 STEP 2909 H=2909:00 +CPU= 14.443
  09:31:15 STEP 2910 H=2910:00 +CPU= 22.745
  09:31:29 STEP 2911 H=2911:00 +CPU= 14.646
  09:31:45 STEP 2912 H=2912:00 +CPU= 14.847
  09:32:07 STEP 2913 H=2913:00 +CPU= 22.314
  09:32:22 STEP 2914 H=2914:00 +CPU= 15.082
  09:32:37 STEP 2915 H=2915:00 +CPU= 14.526
  09:33:02 STEP 2916 H=2916:00 +CPU= 24.664
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002916
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002916
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002916
  09:33:17 STEP 2917 H=2917:00 +CPU= 14.709
  09:33:32 STEP 2918 H=2918:00 +CPU= 14.864
  09:33:55 STEP 2919 H=2919:00 +CPU= 22.394
  09:34:10 STEP 2920 H=2920:00 +CPU= 15.103
  09:34:25 STEP 2921 H=2921:00 +CPU= 14.562
  09:34:48 STEP 2922 H=2922:00 +CPU= 22.899
  09:35:03 STEP 2923 H=2923:00 +CPU= 14.782
  09:35:18 STEP 2924 H=2924:00 +CPU= 14.893
  09:35:41 STEP 2925 H=2925:00 +CPU= 22.431
  09:35:56 STEP 2926 H=2926:00 +CPU= 15.082
  09:36:11 STEP 2927 H=2927:00 +CPU= 15.055
  09:36:39 STEP 2928 H=2928:00 +CPU= 26.551
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002928
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002928
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMGGhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMSHhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMUAhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMGGhq0f+002916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMSHhq0f+002916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMUAhq0f+002916
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0622_2006050100_123_975_12192266_0_r796883046_121.zip
Uploading the intermediate file: upload_file_121.zip
  09:36:54 STEP 2929 H=2929:00 +CPU= 14.857
  09:37:10 STEP 2930 H=2930:00 +CPU= 15.015
  09:37:34 STEP 2931 H=2931:00 +CPU= 22.716
  09:37:50 STEP 2932 H=2932:00 +CPU= 15.247
  09:38:05 STEP 2933 H=2933:00 +CPU= 14.719
  09:38:29 STEP 2934 H=2934:00 +CPU= 23.007
  09:38:44 STEP 2935 H=2935:00 +CPU= 14.750
  09:38:59 STEP 2936 H=2936:00 +CPU= 14.893
  09:39:22 STEP 2937 H=2937:00 +CPU= 22.548
  09:39:37 STEP 2938 H=2938:00 +CPU= 15.153
  09:39:52 STEP 2939 H=2939:00 +CPU= 14.598
  09:40:17 STEP 2940 H=2940:00 +CPU= 24.800
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002940
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002940
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002940
  09:40:32 STEP 2941 H=2941:00 +CPU= 14.738
  09:40:49 STEP 2942 H=2942:00 +CPU= 15.233
  09:41:13 STEP 2943 H=2943:00 +CPU= 22.669
  09:41:29 STEP 2944 H=2944:00 +CPU= 15.257
  09:41:44 STEP 2945 H=2945:00 +CPU= 14.658
  09:42:07 STEP 2946 H=2946:00 +CPU= 22.855
  09:42:23 STEP 2947 H=2947:00 +CPU= 14.976
  09:42:38 STEP 2948 H=2948:00 +CPU= 14.994
  09:43:02 STEP 2949 H=2949:00 +CPU= 22.825
  09:43:19 STEP 2950 H=2950:00 +CPU= 15.518
  09:43:35 STEP 2951 H=2951:00 +CPU= 15.195
  09:44:01 STEP 2952 H=2952:00 +CPU= 25.298
The child process terminated with status: 0
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMGGhq0f+002952
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMSHhq0f+002952
Moving to projects directory: /var/lib/boinc-client/slots/12/ICMUAhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMGGhq0f+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMGGhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMUAhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMUAhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMUAhq0f+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMSHhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMGGhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMSHhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192266/ICMSHhq0f+002940
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0622_2006050100_123_975_12192266_0_r796883046_122.zip
Uploading the final file: upload_file_122.zip
Uploading trickle at timestep: 10623600
09:47:24 (4315): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:30:40 1527784 22277994 oifs_43r3_ps_0622_2006050100_123_975_12192266_0 10,623,600 59,113 0.0056
09 May 2023 16:29:48 1527784 22277994 oifs_43r3_ps_0622_2006050100_123_975_12192266_0 10,368,000 57,524 0.0055
09 May 2023 16:29:42 1527784 22277994 oifs_43r3_ps_0622_2006050100_123_975_12192266_0 9,504,000 53,263 0.0056
09 May 2023 16:29:36 1527784 22277994 oifs_43r3_ps_0622_2006050100_123_975_12192266_0 8,640,000 48,832 0.0057
09 May 2023 16:29:31 1527784 22277994 oifs_43r3_ps_0622_2006050100_123_975_12192266_0 7,776,000 44,256 0.0057
09 May 2023 16:29:20 1527784 22277994 oifs_43r3_ps_0622_2006050100_123_975_12192266_0 6,912,000 39,676 0.0057
09 May 2023 16:29:14 1527784 22277994 oifs_43r3_ps_0622_2006050100_123_975_12192266_0 6,048,000 35,097 0.0058
09 May 2023 16:29:08 1527784 22277994 oifs_43r3_ps_0622_2006050100_123_975_12192266_0 5,184,000 30,326 0.0058
09 May 2023 16:28:56 1527784 22277994 oifs_43r3_ps_0622_2006050100_123_975_12192266_0 4,320,000 25,301 0.0059
09 May 2023 16:28:51 1527784 22277994 oifs_43r3_ps_0622_2006050100_123_975_12192266_0 3,456,000 20,250 0.0059
09 May 2023 16:28:45 1527784 22277994 oifs_43r3_ps_0622_2006050100_123_975_12192266_0 2,592,000 15,158 0.0058
09 May 2023 16:28:34 1527784 22277994 oifs_43r3_ps_0622_2006050100_123_975_12192266_0 1,728,000 10,125 0.0059
09 May 2023 16:28:28 1527784 22277994 oifs_43r3_ps_0622_2006050100_123_975_12192266_0 864,000 5,115 0.0059


©2024 climateprediction.net