climateprediction.net home page
Task 22271183

Task 22271183

Name oifs_43r3_ps_0196_2000050100_123_969_12185840_0
Workunit 12185840
Created 22 Dec 2022, 20:48:48 UTC
Sent 23 Jan 2023, 5:47:45 UTC
Report deadline 24 Mar 2023, 5:47:45 UTC
Received 25 Jan 2023, 14:40:55 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1494992
Run time 20 hours 36 min 22 sec
CPU time 20 hours 13 min 46 sec
Validate state Valid
Credit 14,873.04
Device peak FLOPS 5.26 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,417.94 MB
Peak swap size 4,978.08 MB
Peak disk usage 5,368.89 MB
Stderr
<core_client_version>7.20.2</core_client_version>
<![CDATA[
<stderr_txt>
0:00 +CPU= 20.562
  20:18:22 STEP 2481 H=2481:00 +CPU= 31.150
  20:18:42 STEP 2482 H=2482:00 +CPU= 20.417
  20:19:02 STEP 2483 H=2483:00 +CPU= 19.828
  20:19:37 STEP 2484 H=2484:00 +CPU= 34.587
Moving to projects directory: /var/lib/boinc/slots/20/ICMGGhq0f+002484
Moving to projects directory: /var/lib/boinc/slots/20/ICMSHhq0f+002484
Moving to projects directory: /var/lib/boinc/slots/20/ICMUAhq0f+002484
  20:19:57 STEP 2485 H=2485:00 +CPU= 19.698
  20:20:18 STEP 2486 H=2486:00 +CPU= 20.492
  20:20:49 STEP 2487 H=2487:00 +CPU= 31.112
  20:21:10 STEP 2488 H=2488:00 +CPU= 20.367
  20:21:30 STEP 2489 H=2489:00 +CPU= 19.879
  20:22:02 STEP 2490 H=2490:00 +CPU= 31.816
  20:22:22 STEP 2491 H=2491:00 +CPU= 19.702
  20:22:43 STEP 2492 H=2492:00 +CPU= 20.597
  20:23:14 STEP 2493 H=2493:00 +CPU= 31.114
  20:23:35 STEP 2494 H=2494:00 +CPU= 20.548
  20:23:56 STEP 2495 H=2495:00 +CPU= 20.859
  20:24:34 STEP 2496 H=2496:00 +CPU= 37.510
Moving to projects directory: /var/lib/boinc/slots/20/ICMGGhq0f+002496
Moving to projects directory: /var/lib/boinc/slots/20/ICMSHhq0f+002496
Moving to projects directory: /var/lib/boinc/slots/20/ICMUAhq0f+002496
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMGGhq0f+002472
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMSHhq0f+002472
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMUAhq0f+002472
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMGGhq0f+002484
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMSHhq0f+002484
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMUAhq0f+002484
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0196_2000050100_123_969_12185840_0_r544783557_103.zip
Uploading the intermediate file: upload_file_103.zip
  20:24:53 STEP 2497 H=2497:00 +CPU= 19.618
  20:25:14 STEP 2498 H=2498:00 +CPU= 20.421
  20:25:46 STEP 2499 H=2499:00 +CPU= 31.326
  20:26:06 STEP 2500 H=2500:00 +CPU= 20.484
  20:26:26 STEP 2501 H=2501:00 +CPU= 19.751
  20:26:58 STEP 2502 H=2502:00 +CPU= 32.052
  20:27:18 STEP 2503 H=2503:00 +CPU= 19.710
  20:27:39 STEP 2504 H=2504:00 +CPU= 20.412
  20:28:10 STEP 2505 H=2505:00 +CPU= 31.368
  20:28:31 STEP 2506 H=2506:00 +CPU= 20.356
  20:28:51 STEP 2507 H=2507:00 +CPU= 19.894
  20:29:26 STEP 2508 H=2508:00 +CPU= 34.640
Moving to projects directory: /var/lib/boinc/slots/20/ICMGGhq0f+002508
Moving to projects directory: /var/lib/boinc/slots/20/ICMSHhq0f+002508
Moving to projects directory: /var/lib/boinc/slots/20/ICMUAhq0f+002508
  20:29:46 STEP 2509 H=2509:00 +CPU= 19.764
  20:30:06 STEP 2510 H=2510:00 +CPU= 20.372
  20:30:38 STEP 2511 H=2511:00 +CPU= 31.123
  20:30:59 STEP 2512 H=2512:00 +CPU= 20.595
  20:31:18 STEP 2513 H=2513:00 +CPU= 19.642
  20:31:51 STEP 2514 H=2514:00 +CPU= 31.963
  20:32:11 STEP 2515 H=2515:00 +CPU= 19.707
  20:32:31 STEP 2516 H=2516:00 +CPU= 20.515
  20:33:03 STEP 2517 H=2517:00 +CPU= 31.236
  20:33:23 STEP 2518 H=2518:00 +CPU= 20.546
  20:33:44 STEP 2519 H=2519:00 +CPU= 20.635
  20:34:22 STEP 2520 H=2520:00 +CPU= 37.152
Moving to projects directory: /var/lib/boinc/slots/20/ICMGGhq0f+002520
Moving to projects directory: /var/lib/boinc/slots/20/ICMSHhq0f+002520
Moving to projects directory: /var/lib/boinc/slots/20/ICMUAhq0f+002520
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMGGhq0f+002496
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMSHhq0f+002496
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMUAhq0f+002496
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMGGhq0f+002508
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMSHhq0f+002508
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMUAhq0f+002508
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0196_2000050100_123_969_12185840_0_r544783557_104.zip
Uploading the intermediate file: upload_file_104.zip
  20:34:41 STEP 2521 H=2521:00 +CPU= 19.600
  20:35:02 STEP 2522 H=2522:00 +CPU= 20.574
  20:35:34 STEP 2523 H=2523:00 +CPU= 31.291
  20:35:54 STEP 2524 H=2524:00 +CPU= 20.276
  20:36:14 STEP 2525 H=2525:00 +CPU= 19.893
  20:36:46 STEP 2526 H=2526:00 +CPU= 31.960
  20:37:06 STEP 2527 H=2527:00 +CPU= 19.678
  20:37:27 STEP 2528 H=2528:00 +CPU= 20.463
  20:37:58 STEP 2529 H=2529:00 +CPU= 31.077
  20:38:19 STEP 2530 H=2530:00 +CPU= 20.447
  20:38:39 STEP 2531 H=2531:00 +CPU= 20.043
  20:39:14 STEP 2532 H=2532:00 +CPU= 34.588
Moving to projects directory: /var/lib/boinc/slots/20/ICMGGhq0f+002532
Moving to projects directory: /var/lib/boinc/slots/20/ICMSHhq0f+002532
Moving to projects directory: /var/lib/boinc/slots/20/ICMUAhq0f+002532
  20:39:34 STEP 2533 H=2533:00 +CPU= 19.814
  20:39:55 STEP 2534 H=2534:00 +CPU= 20.441
  20:40:26 STEP 2535 H=2535:00 +CPU= 31.340
  20:40:47 STEP 2536 H=2536:00 +CPU= 20.363
  20:41:07 STEP 2537 H=2537:00 +CPU= 19.751
  20:41:41 STEP 2538 H=2538:00 +CPU= 32.171
  20:42:02 STEP 2539 H=2539:00 +CPU= 19.767
  20:42:22 STEP 2540 H=2540:00 +CPU= 20.594
  20:42:54 STEP 2541 H=2541:00 +CPU= 31.014
  20:43:14 STEP 2542 H=2542:00 +CPU= 20.342
  20:43:35 STEP 2543 H=2543:00 +CPU= 20.310
  20:44:13 STEP 2544 H=2544:00 +CPU= 37.604
Moving to projects directory: /var/lib/boinc/slots/20/ICMGGhq0f+002544
Moving to projects directory: /var/lib/boinc/slots/20/ICMSHhq0f+002544
Moving to projects directory: /var/lib/boinc/slots/20/ICMUAhq0f+002544
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMGGhq0f+002520
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMSHhq0f+002520
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMUAhq0f+002520
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMGGhq0f+002532
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMSHhq0f+002532
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMUAhq0f+002532
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0196_2000050100_123_969_12185840_0_r544783557_105.zip
Uploading the intermediate file: upload_file_105.zip
  20:44:33 STEP 2545 H=2545:00 +CPU= 19.635
  20:44:53 STEP 2546 H=2546:00 +CPU= 20.303
  20:45:25 STEP 2547 H=2547:00 +CPU= 31.113
  20:45:45 STEP 2548 H=2548:00 +CPU= 20.225
  20:46:05 STEP 2549 H=2549:00 +CPU= 19.712
  20:46:37 STEP 2550 H=2550:00 +CPU= 31.801
  20:46:57 STEP 2551 H=2551:00 +CPU= 19.627
  20:47:17 STEP 2552 H=2552:00 +CPU= 20.372
  20:47:49 STEP 2553 H=2553:00 +CPU= 31.142
  20:48:09 STEP 2554 H=2554:00 +CPU= 20.413
 SMILAG TRAJECTORY UNDERGROUND      1 TIMES.
  POINT=            4  MAX ETADOT VERTICAL VEL.=   2.671757993459284E-007
  LON  =    20.0000000000000       degrees
  LAT  =   -35.3269057618723       degrees
  20:48:29 STEP 2555 H=2555:00 +CPU= 19.627
  20:49:05 STEP 2556 H=2556:00 +CPU= 35.502
Moving to projects directory: /var/lib/boinc/slots/20/ICMGGhq0f+002556
Moving to projects directory: /var/lib/boinc/slots/20/ICMSHhq0f+002556
Moving to projects directory: /var/lib/boinc/slots/20/ICMUAhq0f+002556
  20:49:25 STEP 2557 H=2557:00 +CPU= 20.099
  20:49:46 STEP 2558 H=2558:00 +CPU= 20.395
  20:50:17 STEP 2559 H=2559:00 +CPU= 31.255
  20:50:38 STEP 2560 H=2560:00 +CPU= 20.715
  20:50:58 STEP 2561 H=2561:00 +CPU= 19.838
  20:51:31 STEP 2562 H=2562:00 +CPU= 32.091
  20:51:50 STEP 2563 H=2563:00 +CPU= 19.810
  20:52:11 STEP 2564 H=2564:00 +CPU= 20.476
  20:52:43 STEP 2565 H=2565:00 +CPU= 31.245
  20:53:03 STEP 2566 H=2566:00 +CPU= 20.544
  20:53:24 STEP 2567 H=2567:00 +CPU= 20.312
  20:54:01 STEP 2568 H=2568:00 +CPU= 37.356
Moving to projects directory: /var/lib/boinc/slots/20/ICMGGhq0f+002568
Moving to projects directory: /var/lib/boinc/slots/20/ICMSHhq0f+002568
Moving to projects directory: /var/lib/boinc/slots/20/ICMUAhq0f+002568
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMGGhq0f+002544
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMSHhq0f+002544
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMUAhq0f+002544
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMGGhq0f+002556
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMSHhq0f+002556
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMUAhq0f+002556
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0196_2000050100_123_969_12185840_0_r544783557_106.zip
Uploading the intermediate file: upload_file_106.zip
  20:54:21 STEP 2569 H=2569:00 +CPU= 19.792
  20:54:42 STEP 2570 H=2570:00 +CPU= 20.371
  20:55:13 STEP 2571 H=2571:00 +CPU= 31.148
  20:55:34 STEP 2572 H=2572:00 +CPU= 20.291
  20:55:54 STEP 2573 H=2573:00 +CPU= 19.887
  20:56:26 STEP 2574 H=2574:00 +CPU= 32.232
  20:56:47 STEP 2575 H=2575:00 +CPU= 19.832
  20:57:07 STEP 2576 H=2576:00 +CPU= 20.549
  20:57:39 STEP 2577 H=2577:00 +CPU= 31.248
  20:57:59 STEP 2578 H=2578:00 +CPU= 20.409
  20:58:20 STEP 2579 H=2579:00 +CPU= 19.852
  20:58:55 STEP 2580 H=2580:00 +CPU= 34.671
Moving to projects directory: /var/lib/boinc/slots/20/ICMGGhq0f+002580
Moving to projects directory: /var/lib/boinc/slots/20/ICMSHhq0f+002580
Moving to projects directory: /var/lib/boinc/slots/20/ICMUAhq0f+002580
  20:59:15 STEP 2581 H=2581:00 +CPU= 19.700
  20:59:36 STEP 2582 H=2582:00 +CPU= 20.770
  21:00:07 STEP 2583 H=2583:00 +CPU= 31.345
  21:00:28 STEP 2584 H=2584:00 +CPU= 20.378
  21:00:48 STEP 2585 H=2585:00 +CPU= 19.670
  21:01:20 STEP 2586 H=2586:00 +CPU= 31.870
  21:01:39 STEP 2587 H=2587:00 +CPU= 19.681
  21:02:00 STEP 2588 H=2588:00 +CPU= 20.382
  21:02:31 STEP 2589 H=2589:00 +CPU= 31.000
  21:02:52 STEP 2590 H=2590:00 +CPU= 20.367
  21:03:12 STEP 2591 H=2591:00 +CPU= 20.226
  21:03:49 STEP 2592 H=2592:00 +CPU= 37.045
Moving to projects directory: /var/lib/boinc/slots/20/ICMGGhq0f+002592
Moving to projects directory: /var/lib/boinc/slots/20/ICMSHhq0f+002592
Moving to projects directory: /var/lib/boinc/slots/20/ICMUAhq0f+002592
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMGGhq0f+002568
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMSHhq0f+002568
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMUAhq0f+002568
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMGGhq0f+002580
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMSHhq0f+002580
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMUAhq0f+002580
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0196_2000050100_123_969_12185840_0_r544783557_107.zip
Uploading the intermediate file: upload_file_107.zip
  21:04:09 STEP 2593 H=2593:00 +CPU= 19.555
  21:04:30 STEP 2594 H=2594:00 +CPU= 20.471
  21:05:03 STEP 2595 H=2595:00 +CPU= 31.263
  21:05:24 STEP 2596 H=2596:00 +CPU= 20.544
  21:05:45 STEP 2597 H=2597:00 +CPU= 19.932
  21:06:19 STEP 2598 H=2598:00 +CPU= 32.336
  21:06:41 STEP 2599 H=2599:00 +CPU= 20.080
  21:07:02 STEP 2600 H=2600:00 +CPU= 20.590
  21:07:34 STEP 2601 H=2601:00 +CPU= 31.357
  21:07:56 STEP 2602 H=2602:00 +CPU= 20.733
  21:08:17 STEP 2603 H=2603:00 +CPU= 19.989
  21:08:53 STEP 2604 H=2604:00 +CPU= 34.885
Moving to projects directory: /var/lib/boinc/slots/20/ICMGGhq0f+002604
Moving to projects directory: /var/lib/boinc/slots/20/ICMSHhq0f+002604
Moving to projects directory: /var/lib/boinc/slots/20/ICMUAhq0f+002604
  21:09:13 STEP 2605 H=2605:00 +CPU= 19.852
  21:09:34 STEP 2606 H=2606:00 +CPU= 20.500
  21:10:06 STEP 2607 H=2607:00 +CPU= 31.154
  21:10:26 STEP 2608 H=2608:00 +CPU= 20.290
  21:10:46 STEP 2609 H=2609:00 +CPU= 20.033
  21:11:19 STEP 2610 H=2610:00 +CPU= 32.176
  21:11:39 STEP 2611 H=2611:00 +CPU= 19.659
  21:12:01 STEP 2612 H=2612:00 +CPU= 20.616
  21:12:32 STEP 2613 H=2613:00 +CPU= 31.078
  21:12:52 STEP 2614 H=2614:00 +CPU= 20.413
  21:13:13 STEP 2615 H=2615:00 +CPU= 20.377
  21:13:50 STEP 2616 H=2616:00 +CPU= 37.034
Moving to projects directory: /var/lib/boinc/slots/20/ICMGGhq0f+002616
Moving to projects directory: /var/lib/boinc/slots/20/ICMSHhq0f+002616
Moving to projects directory: /var/lib/boinc/slots/20/ICMUAhq0f+002616
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMGGhq0f+002592
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMSHhq0f+002592
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMUAhq0f+002592
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMGGhq0f+002604
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMSHhq0f+002604
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMUAhq0f+002604
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0196_2000050100_123_969_12185840_0_r544783557_108.zip
Uploading the intermediate file: upload_file_108.zip
  21:14:10 STEP 2617 H=2617:00 +CPU= 19.659
  21:14:30 STEP 2618 H=2618:00 +CPU= 20.352
  21:15:02 STEP 2619 H=2619:00 +CPU= 31.200
  21:15:22 STEP 2620 H=2620:00 +CPU= 20.426
  21:15:43 STEP 2621 H=2621:00 +CPU= 20.273
  21:16:15 STEP 2622 H=2622:00 +CPU= 32.582
  21:16:35 STEP 2623 H=2623:00 +CPU= 19.630
  21:16:56 STEP 2624 H=2624:00 +CPU= 20.442
  21:17:27 STEP 2625 H=2625:00 +CPU= 31.061
  21:17:47 STEP 2626 H=2626:00 +CPU= 20.349
  21:18:07 STEP 2627 H=2627:00 +CPU= 19.662
  21:18:42 STEP 2628 H=2628:00 +CPU= 34.601
Moving to projects directory: /var/lib/boinc/slots/20/ICMGGhq0f+002628
Moving to projects directory: /var/lib/boinc/slots/20/ICMSHhq0f+002628
Moving to projects directory: /var/lib/boinc/slots/20/ICMUAhq0f+002628
  21:19:02 STEP 2629 H=2629:00 +CPU= 19.629
  21:19:22 STEP 2630 H=2630:00 +CPU= 20.315
  21:19:53 STEP 2631 H=2631:00 +CPU= 30.942
  21:20:13 STEP 2632 H=2632:00 +CPU= 20.353
  21:20:33 STEP 2633 H=2633:00 +CPU= 19.771
  21:21:05 STEP 2634 H=2634:00 +CPU= 31.730
  21:21:25 STEP 2635 H=2635:00 +CPU= 19.740
  21:21:45 STEP 2636 H=2636:00 +CPU= 20.390
  21:22:17 STEP 2637 H=2637:00 +CPU= 31.066
  21:22:37 STEP 2638 H=2638:00 +CPU= 20.292
  21:22:57 STEP 2639 H=2639:00 +CPU= 20.281
  21:23:35 STEP 2640 H=2640:00 +CPU= 37.085
Moving to projects directory: /var/lib/boinc/slots/20/ICMGGhq0f+002640
Moving to projects directory: /var/lib/boinc/slots/20/ICMSHhq0f+002640
Moving to projects directory: /var/lib/boinc/slots/20/ICMUAhq0f+002640
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMGGhq0f+002616
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMSHhq0f+002616
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMUAhq0f+002616
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMGGhq0f+002628
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMSHhq0f+002628
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMUAhq0f+002628
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0196_2000050100_123_969_12185840_0_r544783557_109.zip
Uploading the intermediate file: upload_file_109.zip
  21:23:54 STEP 2641 H=2641:00 +CPU= 19.547
 SMILAG TRAJECTORY UNDERGROUND      1 TIMES.
  POINT=            8  MAX ETADOT VERTICAL VEL.=   3.307842215017628E-007
  LON  =    168.000000000000       degrees
  LAT  =   -30.8409554950018       degrees
  21:24:15 STEP 2642 H=2642:00 +CPU= 20.643
  21:24:47 STEP 2643 H=2643:00 +CPU= 31.748
 SMILAG TRAJECTORY UNDERGROUND      1 TIMES.
  POINT=           14  MAX ETADOT VERTICAL VEL.=   2.964223355786863E-007
  LON  =    167.500000000000       degrees
  LAT  =   -31.9624433520880       degrees
  21:25:07 STEP 2644 H=2644:00 +CPU= 20.382
  21:25:27 STEP 2645 H=2645:00 +CPU= 19.867
 SMILAG TRAJECTORY UNDERGROUND      1 TIMES.
  POINT=           15  MAX ETADOT VERTICAL VEL.=   9.732282413575802E-008
  LON  =    166.250000000000       degrees
  LAT  =   -33.0839310244466       degrees
  21:26:00 STEP 2646 H=2646:00 +CPU= 32.235
  21:26:19 STEP 2647 H=2647:00 +CPU= 19.740
  21:26:40 STEP 2648 H=2648:00 +CPU= 20.587
  21:27:11 STEP 2649 H=2649:00 +CPU= 30.998
  21:27:32 STEP 2650 H=2650:00 +CPU= 20.488
  21:27:52 STEP 2651 H=2651:00 +CPU= 19.865
  21:28:27 STEP 2652 H=2652:00 +CPU= 34.789
Moving to projects directory: /var/lib/boinc/slots/20/ICMGGhq0f+002652
Moving to projects directory: /var/lib/boinc/slots/20/ICMSHhq0f+002652
Moving to projects directory: /var/lib/boinc/slots/20/ICMUAhq0f+002652
  21:28:47 STEP 2653 H=2653:00 +CPU= 19.859
  21:29:07 STEP 2654 H=2654:00 +CPU= 20.617
  21:29:39 STEP 2655 H=2655:00 +CPU= 31.125
  21:29:59 STEP 2656 H=2656:00 +CPU= 20.322
  21:30:19 STEP 2657 H=2657:00 +CPU= 19.670
  21:30:51 STEP 2658 H=2658:00 +CPU= 31.970
  21:31:11 STEP 2659 H=2659:00 +CPU= 19.741
  21:31:32 STEP 2660 H=2660:00 +CPU= 20.805
  21:32:03 STEP 2661 H=2661:00 +CPU= 31.193
  21:32:24 STEP 2662 H=2662:00 +CPU= 20.542
  21:32:44 STEP 2663 H=2663:00 +CPU= 20.501
  21:33:22 STEP 2664 H=2664:00 +CPU= 37.414
Moving to projects directory: /var/lib/boinc/slots/20/ICMGGhq0f+002664
Moving to projects directory: /var/lib/boinc/slots/20/ICMSHhq0f+002664
Moving to projects directory: /var/lib/boinc/slots/20/ICMUAhq0f+002664
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMGGhq0f+002640
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMSHhq0f+002640
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMUAhq0f+002640
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMGGhq0f+002652
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMSHhq0f+002652
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMUAhq0f+002652
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0196_2000050100_123_969_12185840_0_r544783557_110.zip
Uploading the intermediate file: upload_file_110.zip
  21:33:41 STEP 2665 H=2665:00 +CPU= 19.550
  21:34:02 STEP 2666 H=2666:00 +CPU= 20.338
  21:34:33 STEP 2667 H=2667:00 +CPU= 31.070
  21:34:54 STEP 2668 H=2668:00 +CPU= 20.258
  21:35:13 STEP 2669 H=2669:00 +CPU= 19.737
  21:35:46 STEP 2670 H=2670:00 +CPU= 32.018
  21:36:05 STEP 2671 H=2671:00 +CPU= 19.667
  21:36:26 STEP 2672 H=2672:00 +CPU= 20.675
  21:36:57 STEP 2673 H=2673:00 +CPU= 31.256
  21:37:18 STEP 2674 H=2674:00 +CPU= 20.369
  21:37:38 STEP 2675 H=2675:00 +CPU= 19.746
  21:38:13 STEP 2676 H=2676:00 +CPU= 34.623
Moving to projects directory: /var/lib/boinc/slots/20/ICMGGhq0f+002676
Moving to projects directory: /var/lib/boinc/slots/20/ICMSHhq0f+002676
Moving to projects directory: /var/lib/boinc/slots/20/ICMUAhq0f+002676
  21:38:33 STEP 2677 H=2677:00 +CPU= 20.022
  21:38:53 STEP 2678 H=2678:00 +CPU= 20.473
  21:39:25 STEP 2679 H=2679:00 +CPU= 31.362
  21:39:46 STEP 2680 H=2680:00 +CPU= 20.746
  21:40:06 STEP 2681 H=2681:00 +CPU= 20.229
  21:40:38 STEP 2682 H=2682:00 +CPU= 31.778
  21:40:58 STEP 2683 H=2683:00 +CPU= 19.813
  21:41:19 STEP 2684 H=2684:00 +CPU= 20.893
  21:41:50 STEP 2685 H=2685:00 +CPU= 31.371
  21:42:11 STEP 2686 H=2686:00 +CPU= 20.943
  21:42:32 STEP 2687 H=2687:00 +CPU= 20.933
  21:43:10 STEP 2688 H=2688:00 +CPU= 37.302
Moving to projects directory: /var/lib/boinc/slots/20/ICMGGhq0f+002688
Moving to projects directory: /var/lib/boinc/slots/20/ICMSHhq0f+002688
Moving to projects directory: /var/lib/boinc/slots/20/ICMUAhq0f+002688
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMGGhq0f+002664
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMSHhq0f+002664
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMUAhq0f+002664
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMGGhq0f+002676
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMSHhq0f+002676
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMUAhq0f+002676
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0196_2000050100_123_969_12185840_0_r544783557_111.zip
Uploading the intermediate file: upload_file_111.zip
  21:43:30 STEP 2689 H=2689:00 +CPU= 19.873
Uploading trickle at timestep: 9676800
  21:43:51 STEP 2690 H=2690:00 +CPU= 20.795
  21:44:23 STEP 2691 H=2691:00 +CPU= 31.961
  21:44:44 STEP 2692 H=2692:00 +CPU= 20.820
  21:45:04 STEP 2693 H=2693:00 +CPU= 20.162
  21:45:36 STEP 2694 H=2694:00 +CPU= 32.020
  21:45:56 STEP 2695 H=2695:00 +CPU= 19.901
  21:46:17 STEP 2696 H=2696:00 +CPU= 20.778
  21:46:48 STEP 2697 H=2697:00 +CPU= 31.405
  21:47:09 STEP 2698 H=2698:00 +CPU= 20.625
  21:47:29 STEP 2699 H=2699:00 +CPU= 19.973
  21:48:04 STEP 2700 H=2700:00 +CPU= 34.898
Moving to projects directory: /var/lib/boinc/slots/20/ICMGGhq0f+002700
Moving to projects directory: /var/lib/boinc/slots/20/ICMSHhq0f+002700
Moving to projects directory: /var/lib/boinc/slots/20/ICMUAhq0f+002700
  21:48:24 STEP 2701 H=2701:00 +CPU= 19.890
  21:48:45 STEP 2702 H=2702:00 +CPU= 20.748
  21:49:16 STEP 2703 H=2703:00 +CPU= 31.111
  21:49:37 STEP 2704 H=2704:00 +CPU= 20.680
  21:49:57 STEP 2705 H=2705:00 +CPU= 20.116
  21:50:30 STEP 2706 H=2706:00 +CPU= 32.629
  21:50:50 STEP 2707 H=2707:00 +CPU= 19.880
  21:51:11 STEP 2708 H=2708:00 +CPU= 20.587
  21:51:42 STEP 2709 H=2709:00 +CPU= 31.476
  21:52:03 STEP 2710 H=2710:00 +CPU= 20.568
  21:52:24 STEP 2711 H=2711:00 +CPU= 20.638
  21:53:02 STEP 2712 H=2712:00 +CPU= 37.646
Moving to projects directory: /var/lib/boinc/slots/20/ICMGGhq0f+002712
Moving to projects directory: /var/lib/boinc/slots/20/ICMSHhq0f+002712
Moving to projects directory: /var/lib/boinc/slots/20/ICMUAhq0f+002712
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMGGhq0f+002688
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMSHhq0f+002688
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMUAhq0f+002688
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMGGhq0f+002700
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMSHhq0f+002700
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMUAhq0f+002700
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0196_2000050100_123_969_12185840_0_r544783557_112.zip
Uploading the intermediate file: upload_file_112.zip
  21:53:22 STEP 2713 H=2713:00 +CPU= 19.986
  21:53:42 STEP 2714 H=2714:00 +CPU= 20.539
  21:54:14 STEP 2715 H=2715:00 +CPU= 31.298
  21:54:34 STEP 2716 H=2716:00 +CPU= 20.427
  21:54:55 STEP 2717 H=2717:00 +CPU= 20.094
  21:55:27 STEP 2718 H=2718:00 +CPU= 32.535
  21:55:48 STEP 2719 H=2719:00 +CPU= 20.241
  21:56:09 STEP 2720 H=2720:00 +CPU= 20.912
  21:56:41 STEP 2721 H=2721:00 +CPU= 31.854
  21:57:01 STEP 2722 H=2722:00 +CPU= 20.582
  21:57:21 STEP 2723 H=2723:00 +CPU= 19.907
  21:57:56 STEP 2724 H=2724:00 +CPU= 34.800
Moving to projects directory: /var/lib/boinc/slots/20/ICMGGhq0f+002724
Moving to projects directory: /var/lib/boinc/slots/20/ICMSHhq0f+002724
Moving to projects directory: /var/lib/boinc/slots/20/ICMUAhq0f+002724
  21:58:16 STEP 2725 H=2725:00 +CPU= 19.911
  21:58:37 STEP 2726 H=2726:00 +CPU= 20.867
  21:59:09 STEP 2727 H=2727:00 +CPU= 31.192
  21:59:29 STEP 2728 H=2728:00 +CPU= 20.493
  21:59:49 STEP 2729 H=2729:00 +CPU= 19.818
  22:00:22 STEP 2730 H=2730:00 +CPU= 32.606
  22:00:42 STEP 2731 H=2731:00 +CPU= 20.017
  22:01:03 STEP 2732 H=2732:00 +CPU= 20.889
  22:01:34 STEP 2733 H=2733:00 +CPU= 31.204
  22:01:55 STEP 2734 H=2734:00 +CPU= 20.700
  22:02:16 STEP 2735 H=2735:00 +CPU= 20.493
  22:02:53 STEP 2736 H=2736:00 +CPU= 37.452
Moving to projects directory: /var/lib/boinc/slots/20/ICMGGhq0f+002736
Moving to projects directory: /var/lib/boinc/slots/20/ICMSHhq0f+002736
Moving to projects directory: /var/lib/boinc/slots/20/ICMUAhq0f+002736
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMGGhq0f+002712
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMSHhq0f+002712
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMUAhq0f+002712
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMGGhq0f+002724
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMSHhq0f+002724
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMUAhq0f+002724
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0196_2000050100_123_969_12185840_0_r544783557_113.zip
Uploading the intermediate file: upload_file_113.zip
  22:03:13 STEP 2737 H=2737:00 +CPU= 19.862
  22:03:34 STEP 2738 H=2738:00 +CPU= 20.757
  22:04:06 STEP 2739 H=2739:00 +CPU= 31.747
  22:04:27 STEP 2740 H=2740:00 +CPU= 20.395
  22:04:46 STEP 2741 H=2741:00 +CPU= 19.717
  22:05:18 STEP 2742 H=2742:00 +CPU= 32.019
  22:05:38 STEP 2743 H=2743:00 +CPU= 19.710
  22:05:59 STEP 2744 H=2744:00 +CPU= 20.726
  22:06:31 STEP 2745 H=2745:00 +CPU= 31.547
  22:06:52 STEP 2746 H=2746:00 +CPU= 21.081
  22:07:12 STEP 2747 H=2747:00 +CPU= 19.951
  22:07:47 STEP 2748 H=2748:00 +CPU= 34.983
Moving to projects directory: /var/lib/boinc/slots/20/ICMGGhq0f+002748
Moving to projects directory: /var/lib/boinc/slots/20/ICMSHhq0f+002748
Moving to projects directory: /var/lib/boinc/slots/20/ICMUAhq0f+002748
  22:08:08 STEP 2749 H=2749:00 +CPU= 20.395
  22:08:29 STEP 2750 H=2750:00 +CPU= 21.076
  22:09:01 STEP 2751 H=2751:00 +CPU= 31.864
  22:09:22 STEP 2752 H=2752:00 +CPU= 20.866
  22:09:42 STEP 2753 H=2753:00 +CPU= 20.289
  22:10:15 STEP 2754 H=2754:00 +CPU= 32.835
  22:10:35 STEP 2755 H=2755:00 +CPU= 19.914
  22:10:56 STEP 2756 H=2756:00 +CPU= 20.839
  22:11:28 STEP 2757 H=2757:00 +CPU= 31.968
  22:11:49 STEP 2758 H=2758:00 +CPU= 20.537
  22:12:10 STEP 2759 H=2759:00 +CPU= 20.577
  22:12:47 STEP 2760 H=2760:00 +CPU= 37.398
Moving to projects directory: /var/lib/boinc/slots/20/ICMGGhq0f+002760
Moving to projects directory: /var/lib/boinc/slots/20/ICMSHhq0f+002760
Moving to projects directory: /var/lib/boinc/slots/20/ICMUAhq0f+002760
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMGGhq0f+002736
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMSHhq0f+002736
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMUAhq0f+002736
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMGGhq0f+002748
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMSHhq0f+002748
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMUAhq0f+002748
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0196_2000050100_123_969_12185840_0_r544783557_114.zip
Uploading the intermediate file: upload_file_114.zip
  22:13:07 STEP 2761 H=2761:00 +CPU= 19.917
  22:13:28 STEP 2762 H=2762:00 +CPU= 20.553
  22:14:00 STEP 2763 H=2763:00 +CPU= 32.005
  22:14:21 STEP 2764 H=2764:00 +CPU= 20.510
  22:14:41 STEP 2765 H=2765:00 +CPU= 20.001
  22:15:13 STEP 2766 H=2766:00 +CPU= 32.421
  22:15:33 STEP 2767 H=2767:00 +CPU= 19.876
  22:15:54 STEP 2768 H=2768:00 +CPU= 20.563
  22:16:25 STEP 2769 H=2769:00 +CPU= 31.222
  22:16:46 STEP 2770 H=2770:00 +CPU= 20.673
  22:17:07 STEP 2771 H=2771:00 +CPU= 20.493
  22:17:42 STEP 2772 H=2772:00 +CPU= 35.168
Moving to projects directory: /var/lib/boinc/slots/20/ICMGGhq0f+002772
Moving to projects directory: /var/lib/boinc/slots/20/ICMSHhq0f+002772
Moving to projects directory: /var/lib/boinc/slots/20/ICMUAhq0f+002772
  22:18:03 STEP 2773 H=2773:00 +CPU= 20.384
  22:18:24 STEP 2774 H=2774:00 +CPU= 20.982
  22:18:56 STEP 2775 H=2775:00 +CPU= 32.183
  22:19:18 STEP 2776 H=2776:00 +CPU= 21.521
  22:19:39 STEP 2777 H=2777:00 +CPU= 20.509
  22:20:12 STEP 2778 H=2778:00 +CPU= 33.060
  22:20:33 STEP 2779 H=2779:00 +CPU= 20.462
  22:20:54 STEP 2780 H=2780:00 +CPU= 20.981
  22:21:26 STEP 2781 H=2781:00 +CPU= 31.850
  22:21:47 STEP 2782 H=2782:00 +CPU= 20.779
  22:22:08 STEP 2783 H=2783:00 +CPU= 21.001
  22:22:46 STEP 2784 H=2784:00 +CPU= 38.443
Moving to projects directory: /var/lib/boinc/slots/20/ICMGGhq0f+002784
Moving to projects directory: /var/lib/boinc/slots/20/ICMSHhq0f+002784
Moving to projects directory: /var/lib/boinc/slots/20/ICMUAhq0f+002784
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMGGhq0f+002760
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMSHhq0f+002760
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMUAhq0f+002760
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMGGhq0f+002772
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMSHhq0f+002772
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMUAhq0f+002772
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0196_2000050100_123_969_12185840_0_r544783557_115.zip
Uploading the intermediate file: upload_file_115.zip
  22:23:07 STEP 2785 H=2785:00 +CPU= 20.355
  22:23:28 STEP 2786 H=2786:00 +CPU= 21.167
  22:24:01 STEP 2787 H=2787:00 +CPU= 32.475
  22:24:22 STEP 2788 H=2788:00 +CPU= 21.302
  22:24:43 STEP 2789 H=2789:00 +CPU= 20.413
  22:25:16 STEP 2790 H=2790:00 +CPU= 32.908
  22:25:36 STEP 2791 H=2791:00 +CPU= 20.646
  22:25:58 STEP 2792 H=2792:00 +CPU= 21.201
  22:26:30 STEP 2793 H=2793:00 +CPU= 32.450
  22:26:52 STEP 2794 H=2794:00 +CPU= 21.215
  22:27:12 STEP 2795 H=2795:00 +CPU= 20.600
  22:27:49 STEP 2796 H=2796:00 +CPU= 36.323
Moving to projects directory: /var/lib/boinc/slots/20/ICMGGhq0f+002796
Moving to projects directory: /var/lib/boinc/slots/20/ICMSHhq0f+002796
Moving to projects directory: /var/lib/boinc/slots/20/ICMUAhq0f+002796
  22:28:10 STEP 2797 H=2797:00 +CPU= 21.043
  22:28:32 STEP 2798 H=2798:00 +CPU= 22.021
  22:29:05 STEP 2799 H=2799:00 +CPU= 32.840
  22:29:27 STEP 2800 H=2800:00 +CPU= 21.740
  22:29:49 STEP 2801 H=2801:00 +CPU= 21.259
  22:30:23 STEP 2802 H=2802:00 +CPU= 34.040
  22:30:44 STEP 2803 H=2803:00 +CPU= 21.074
  22:31:06 STEP 2804 H=2804:00 +CPU= 21.579
  22:31:39 STEP 2805 H=2805:00 +CPU= 33.255
  22:32:02 STEP 2806 H=2806:00 +CPU= 22.408
  22:32:25 STEP 2807 H=2807:00 +CPU= 22.812
  22:33:05 STEP 2808 H=2808:00 +CPU= 40.528
Moving to projects directory: /var/lib/boinc/slots/20/ICMGGhq0f+002808
Moving to projects directory: /var/lib/boinc/slots/20/ICMSHhq0f+002808
Moving to projects directory: /var/lib/boinc/slots/20/ICMUAhq0f+002808
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMGGhq0f+002784
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMSHhq0f+002784
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMUAhq0f+002784
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMGGhq0f+002796
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMSHhq0f+002796
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMUAhq0f+002796
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0196_2000050100_123_969_12185840_0_r544783557_116.zip
Uploading the intermediate file: upload_file_116.zip
  22:33:27 STEP 2809 H=2809:00 +CPU= 21.334
  22:33:49 STEP 2810 H=2810:00 +CPU= 22.338
  22:34:23 STEP 2811 H=2811:00 +CPU= 33.541
  22:34:45 STEP 2812 H=2812:00 +CPU= 21.711
  22:35:06 STEP 2813 H=2813:00 +CPU= 20.924
  22:35:40 STEP 2814 H=2814:00 +CPU= 34.080
  22:36:02 STEP 2815 H=2815:00 +CPU= 20.866
  22:36:24 STEP 2816 H=2816:00 +CPU= 21.686
  22:36:57 STEP 2817 H=2817:00 +CPU= 33.341
  22:37:19 STEP 2818 H=2818:00 +CPU= 21.785
  22:37:41 STEP 2819 H=2819:00 +CPU= 21.564
  22:38:19 STEP 2820 H=2820:00 +CPU= 37.102
Moving to projects directory: /var/lib/boinc/slots/20/ICMGGhq0f+002820
Moving to projects directory: /var/lib/boinc/slots/20/ICMSHhq0f+002820
Moving to projects directory: /var/lib/boinc/slots/20/ICMUAhq0f+002820
  22:38:40 STEP 2821 H=2821:00 +CPU= 21.073
  22:39:02 STEP 2822 H=2822:00 +CPU= 22.152
  22:39:36 STEP 2823 H=2823:00 +CPU= 33.224
  22:39:58 STEP 2824 H=2824:00 +CPU= 21.935
  22:40:19 STEP 2825 H=2825:00 +CPU= 21.328
  22:40:53 STEP 2826 H=2826:00 +CPU= 34.062
  22:41:14 STEP 2827 H=2827:00 +CPU= 20.912
  22:41:37 STEP 2828 H=2828:00 +CPU= 22.902
  22:42:13 STEP 2829 H=2829:00 +CPU= 34.554
  22:42:39 STEP 2830 H=2830:00 +CPU= 22.817
  22:43:03 STEP 2831 H=2831:00 +CPU= 23.098
  22:43:46 STEP 2832 H=2832:00 +CPU= 41.279
Moving to projects directory: /var/lib/boinc/slots/20/ICMGGhq0f+002832
Moving to projects directory: /var/lib/boinc/slots/20/ICMSHhq0f+002832
Moving to projects directory: /var/lib/boinc/slots/20/ICMUAhq0f+002832
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMGGhq0f+002808
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMSHhq0f+002808
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMUAhq0f+002808
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMGGhq0f+002820
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMSHhq0f+002820
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMUAhq0f+002820
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0196_2000050100_123_969_12185840_0_r544783557_117.zip
Uploading the intermediate file: upload_file_117.zip
  22:44:09 STEP 2833 H=2833:00 +CPU= 21.671
  22:44:32 STEP 2834 H=2834:00 +CPU= 22.893
  22:45:06 STEP 2835 H=2835:00 +CPU= 34.168
  22:45:33 STEP 2836 H=2836:00 +CPU= 22.878
  22:45:56 STEP 2837 H=2837:00 +CPU= 22.254
  22:46:32 STEP 2838 H=2838:00 +CPU= 35.263
  22:46:55 STEP 2839 H=2839:00 +CPU= 22.099
  22:47:18 STEP 2840 H=2840:00 +CPU= 22.822
  22:47:57 STEP 2841 H=2841:00 +CPU= 35.038
  22:48:22 STEP 2842 H=2842:00 +CPU= 23.391
  22:48:45 STEP 2843 H=2843:00 +CPU= 22.187
  22:49:24 STEP 2844 H=2844:00 +CPU= 38.335
Moving to projects directory: /var/lib/boinc/slots/20/ICMGGhq0f+002844
Moving to projects directory: /var/lib/boinc/slots/20/ICMSHhq0f+002844
Moving to projects directory: /var/lib/boinc/slots/20/ICMUAhq0f+002844
  22:49:48 STEP 2845 H=2845:00 +CPU= 22.306
  22:50:11 STEP 2846 H=2846:00 +CPU= 22.791
  22:50:48 STEP 2847 H=2847:00 +CPU= 35.071
  22:51:13 STEP 2848 H=2848:00 +CPU= 23.275
  22:51:35 STEP 2849 H=2849:00 +CPU= 22.078
  22:52:12 STEP 2850 H=2850:00 +CPU= 35.667
  22:52:36 STEP 2851 H=2851:00 +CPU= 22.622
  22:53:01 STEP 2852 H=2852:00 +CPU= 22.892
  22:53:38 STEP 2853 H=2853:00 +CPU= 35.172
  22:54:03 STEP 2854 H=2854:00 +CPU= 23.413
  22:54:28 STEP 2855 H=2855:00 +CPU= 22.847
  22:55:13 STEP 2856 H=2856:00 +CPU= 42.035
Moving to projects directory: /var/lib/boinc/slots/20/ICMGGhq0f+002856
Moving to projects directory: /var/lib/boinc/slots/20/ICMSHhq0f+002856
Moving to projects directory: /var/lib/boinc/slots/20/ICMUAhq0f+002856
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMGGhq0f+002832
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMSHhq0f+002832
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMUAhq0f+002832
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMGGhq0f+002844
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMSHhq0f+002844
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMUAhq0f+002844
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0196_2000050100_123_969_12185840_0_r544783557_118.zip
Uploading the intermediate file: upload_file_118.zip
  22:55:37 STEP 2857 H=2857:00 +CPU= 22.870
  22:56:01 STEP 2858 H=2858:00 +CPU= 22.834
  22:56:39 STEP 2859 H=2859:00 +CPU= 35.395
  22:57:05 STEP 2860 H=2860:00 +CPU= 23.761
  22:57:30 STEP 2861 H=2861:00 +CPU= 22.186
  22:58:07 STEP 2862 H=2862:00 +CPU= 35.753
  22:58:30 STEP 2863 H=2863:00 +CPU= 22.458
  22:58:54 STEP 2864 H=2864:00 +CPU= 22.858
  22:59:32 STEP 2865 H=2865:00 +CPU= 34.984
  22:59:57 STEP 2866 H=2866:00 +CPU= 23.037
  23:00:20 STEP 2867 H=2867:00 +CPU= 22.281
  23:01:00 STEP 2868 H=2868:00 +CPU= 38.467
Moving to projects directory: /var/lib/boinc/slots/20/ICMGGhq0f+002868
Moving to projects directory: /var/lib/boinc/slots/20/ICMSHhq0f+002868
Moving to projects directory: /var/lib/boinc/slots/20/ICMUAhq0f+002868
  23:01:23 STEP 2869 H=2869:00 +CPU= 22.256
  23:01:46 STEP 2870 H=2870:00 +CPU= 22.795
  23:02:22 STEP 2871 H=2871:00 +CPU= 34.532
  23:02:47 STEP 2872 H=2872:00 +CPU= 23.610
  23:03:10 STEP 2873 H=2873:00 +CPU= 22.176
[EC_DRHOOK:proxy-server:1:1:2172:2172] [20230124:230319:1674597799:63723.237] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1538] Received signal#15 (SIGTERM) :: 4035MB (heap), 4419MB (maxrss), 0MB (maxstack), 0 (paging), nsigs = 1
[EC_DRHOOK:proxy-server:1:1:2172:2172] [20230124:230319:1674597799:63723.237] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1542] Also activating Harakiri-alarm (SIGALRM=14) to expire after 500s elapsed to prevent hangs, nsigs = 1
[EC_DRHOOK:proxy-server:1:1:2172:2172] [20230124:230319:1674597799:63723.237] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1544] Harakiri signal handler 'signal_harakiri' for signal#14 (SIGALRM) installed at 0x81f3c0 (old at (nil))
[EC_DRHOOK:proxy-server:1:1:2172:2172] [20230124:230319:1674597799:63723.237] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1617] Signal#15 was caused by unrecognized si_code [memaddr=0x1], nsigs = 1
[EC_DRHOOK:proxy-server:1:1:2172:2172] [20230124:230319:1674597799:63723.237] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1686] Starting DrHook backtrace for signal#15, nsigs = 1
[EC_DRHOOK:proxy-server:1:1:2172:2172] [20230124:230319:1674597799:63723.237] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3843] 4035 MB (maxheap), 4419 MB (maxrss), 0 MB (maxstack)
[EC_DRHOOK:proxy-server:1:1:2172:2172] [20230124:230319:1674597799:63723.237] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :  MASTER 
[EC_DRHOOK:proxy-server:1:1:2172:2172] [20230124:230319:1674597799:63723.237] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :   CNT0 
[EC_DRHOOK:proxy-server:1:1:2172:2172] [20230124:230319:1674597799:63723.237] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :    CNT1 
[EC_DRHOOK:proxy-server:1:1:2172:2172] [20230124:230319:1674597799:63723.237] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :     CNT2 
[EC_DRHOOK:proxy-server:1:1:2172:2172] [20230124:230319:1674597799:63723.237] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :      CNT3 
[EC_DRHOOK:proxy-server:1:1:2172:2172] [20230124:230319:1674597799:63723.237] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :       CNT4 
[EC_DRHOOK:proxy-server:1:1:2172:2172] [20230124:230319:1674597799:63723.237] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :        STEPO 
[EC_DRHOOK:proxy-server:1:1:2172:2172] [20230124:230319:1674597799:63723.237] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :         SCAN2M 
[EC_DRHOOK:proxy-server:1:1:2172:2172] [20230124:230319:1674597799:63723.237] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :          GP_MODEL_HEAP 
[EC_DRHOOK:proxy-server:1:1:2172:2172] [20230124:230319:1674597799:63723.237] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :           GP_MODEL 
[EC_DRHOOK:proxy-server:1:1:2172:2172] [20230124:230319:1674597799:63723.237] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :            RADDRV 
[EC_DRHOOK:proxy-server:1:1:2172:2172] [20230124:230319:1674597799:63723.237] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :             RADINTG 
[EC_DRHOOK:proxy-server:1:1:2172:2172] [20230124:230319:1674597799:63723.237] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :              >OMP-RADINTG-RADLSW       (1210) 
[EC_DRHOOK:proxy-server:1:1:2172:2172] [20230124:230319:1674597799:63723.237] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :               RADIATION_SCHEME 
[EC_DRHOOK:proxy-server:1:1:2172:2172] [20230124:230319:1674597799:63723.237] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :                radiation_interface:radiation 
[EC_DRHOOK:proxy-server:1:1:2172:2172] [20230124:230319:1674597799:63723.237] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :                 radiation_mcica_lw:solver_mcica_lw 
[EC_DRHOOK:proxy-server:1:1:2172:2172] [20230124:230320:1674597800:63724.237] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1734] DrHook backtrace done for signal#15, nsigs = 1
[EC_DRHOOK:proxy-server:1:1:2172:2172] [20230124:230320:1674597800:63724.237] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1785] Calling previous signal handler at 0x1ce8bb0 for signal#15, nsigs = 1
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source             
oifs_43r3_model.e  0000000001CE916B  Unknown               Unknown  Unknown
oifs_43r3_model.e  000000000081FFF1  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DC9090  Unknown               Unknown  Unknown
oifs_43r3_model.e  000000000188BC1D  radiation_two_str         284  radiation_two_stream.F90
oifs_43r3_model.e  000000000197279F  radiation_mcica_l         159  radiation_mcica_lw.F90
oifs_43r3_model.e  0000000001862B6D  radiation_interfa         387  radiation_interface.F90
oifs_43r3_model.e  00000000012D30E5  radiation_scheme_         484  radiation_scheme.F90
oifs_43r3_model.e  000000000129A415  radintg_                 1455  radintg.F90
oifs_43r3_model.e  0000000001270124  raddrv_                   537  raddrv.F90
oifs_43r3_model.e  0000000000BFD839  gp_model_                 482  gp_model.F90
oifs_43r3_model.e  00000000012E9482  gp_model_heap_             74  gp_model_heap.F90
oifs_43r3_model.e  0000000000BBC1CE  scan2m_                   535  scan2m.F90
oifs_43r3_model.e  000000000057A664  stepo_                    327  stepo.F90
oifs_43r3_model.e  000000000055DEEC  cnt4_                    1133  cnt4.F90
oifs_43r3_model.e  00000000005471C9  cnt3_                     267  cnt3.F90
oifs_43r3_model.e  0000000000546412  cnt2_                      88  cnt2.F90
oifs_43r3_model.e  0000000000545E28  cnt1_                      92  cnt1.F90
oifs_43r3_model.e  000000000040708D  cnt0_                     146  cnt0.F90
oifs_43r3_model.e  000000000040220F  MAIN__                     96  master.F90
oifs_43r3_model.e  00000000004021A2  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DCA390  Unknown               Unknown  Unknown
oifs_43r3_model.e  000000000040206E  Unknown               Unknown  Unknown
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2000050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0196
(argv4) batchid: 969
(argv5) wuid: 12185840
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc/slots/20
Project directory is: /var/lib/boinc/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840
..mkdir for temp folder for results failed
Copying: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc/slots/20/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc/slots/20/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_408003e791a03bd8be080847385cd503 to: /var/lib/boinc/slots/20/oifs_43r3_ps_0196_2000050100_123_969_12185840.zip
Unzipping the namelist zip file: /var/lib/boinc/slots/20/oifs_43r3_ps_0196_2000050100_123_969_12185840.zip
ic_ancil_file: ic_ancil_12185840
ifsdata_file: ifsdata_12185840
climate_data_file: clim_data_12185840
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_dae680db940fd3e9183affce8ec446cc to: /var/lib/boinc/slots/20/ic_ancil_12185840.zip
Unzipping the IC ancils zip file: /var/lib/boinc/slots/20/ic_ancil_12185840.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_689b5417025df5ad70d11c0b5ef4f0c3 to: /var/lib/boinc/slots/20/ifsdata/ifsdata_12185840.zip
Unzipping the ifsdata_zip file: /var/lib/boinc/slots/20/ifsdata/ifsdata_12185840.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc/slots/20/159l_2/clim_data_12185840.zip
Unzipping the climate data zip file: /var/lib/boinc/slots/20/159l_2/clim_data_12185840.zip
Checking for progress XML file: /var/lib/boinc/slots/20/progress_file_12185840.xml
Opened progress file ok : /var/lib/boinc/slots/20/progress_file_12185840.xml
-- Model is restarting --
Adjusting last_iter, 2873, to previous model restart step.
Creating progress file: /var/lib/boinc/slots/20/progress_file_12185840.xml
last_cpu_time: 70200
upload_file_number: 119
last_iter: 2855
last_upload: 10281600
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0196_2000050100_123_969_12185840_0_r544783557
The child process has been launched with process id: 2064
Executing the command: /var/lib/boinc/slots/20/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:proxy-server:1:1:2064:2064] [20230125:051612:1674620172:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:proxy-server:1:1:2064:2064] [20230125:051612:1674620172:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:proxy-server:1:1:2064:2064] [20230125:051612:1674620172:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:proxy-server:1:1:2064:2064] [20230125:051612:1674620172:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:proxy-server:1:1:2064:2064] [20230125:051612:1674620172:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:proxy-server:1:1:2064:2064] [20230125:051612:1674620172:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:proxy-server:1:1:2064:2064] [20230125:051612:1674620172:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:proxy-server:1:1:2064:2064] [20230125:051612:1674620172:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:proxy-server:1:1:2064:2064] [20230125:051612:1674620172:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:proxy-server:1:1:2064:2064] [20230125:051612:1674620172:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:proxy-server:1:1:2064:2064] [20230125:051612:1674620172:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:proxy-server:1:1:2064:2064] [20230125:051612:1674620172:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:proxy-server:1:1:2064:2064] [20230125:051612:1674620172:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:proxy-server:1:1:2064:2064] [20230125:051612:1674620172:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:proxy-server:1:1:2064:2064] [20230125:051612:1674620172:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:proxy-server:1:1:2064:2064] [20230125:051612:1674620172:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:proxy-server:1:1:2064:2064] [20230125:051612:1674620172:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:proxy-server:1:1:2064:2064] [20230125:051612:1674620172:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:proxy-server:1:1:2064:2064] [20230125:051612:1674620172:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:proxy-server:1:1:2064:2064] [20230125:051612:1674620172:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:proxy-server:1:1:2064:2064] [20230125:051612:1674620172:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:proxy-server:1:1:2064:2064] [20230125:051612:1674620172:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:proxy-server:1:1:2064:2064] [20230125:051612:1674620172:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:proxy-server:1:1:2064:2064] [20230125:051612:1674620172:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:proxy-server:1:1:2064:2064] [20230125:051612:1674620172:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:proxy-server:1:1:2064:2064] [20230125:051612:1674620172:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:proxy-server:1:1:2064:2064] [20230125:051612:1674620172:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:proxy-server:1:1:2064:2064] [20230125:051612:1674620172:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:proxy-server:1:1:2064:2064] [20230125:051612:1674620172:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:proxy-server:1:1:2064:2064] [20230125:051612:1674620172:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  05:16:56 STEP 2856 H=2856:00 +CPU= 37.330
  05:17:17 STEP 2857 H=2857:00 +CPU= 21.021
  05:17:39 STEP 2858 H=2858:00 +CPU= 21.294
  05:18:11 STEP 2859 H=2859:00 +CPU= 32.204
  05:18:33 STEP 2860 H=2860:00 +CPU= 22.061
  05:18:54 STEP 2861 H=2861:00 +CPU= 21.123
  05:19:29 STEP 2862 H=2862:00 +CPU= 33.864
  05:19:51 STEP 2863 H=2863:00 +CPU= 20.938
  05:20:13 STEP 2864 H=2864:00 +CPU= 21.825
  05:20:46 STEP 2865 H=2865:00 +CPU= 33.096
  05:21:08 STEP 2866 H=2866:00 +CPU= 21.848
  05:21:29 STEP 2867 H=2867:00 +CPU= 20.722
  05:22:05 STEP 2868 H=2868:00 +CPU= 35.995
Moving to projects directory: /var/lib/boinc/slots/20/ICMGGhq0f+002868
Moving to projects directory: /var/lib/boinc/slots/20/ICMSHhq0f+002868
Moving to projects directory: /var/lib/boinc/slots/20/ICMUAhq0f+002868
  05:22:26 STEP 2869 H=2869:00 +CPU= 20.899
  05:22:49 STEP 2870 H=2870:00 +CPU= 21.544
  05:23:24 STEP 2871 H=2871:00 +CPU= 32.936
  05:23:48 STEP 2872 H=2872:00 +CPU= 21.883
  05:24:10 STEP 2873 H=2873:00 +CPU= 20.927
  05:24:45 STEP 2874 H=2874:00 +CPU= 33.685
  05:25:07 STEP 2875 H=2875:00 +CPU= 21.201
  05:25:30 STEP 2876 H=2876:00 +CPU= 21.757
  05:26:06 STEP 2877 H=2877:00 +CPU= 32.983
  05:26:28 STEP 2878 H=2878:00 +CPU= 21.758
  05:26:50 STEP 2879 H=2879:00 +CPU= 21.697
  05:27:31 STEP 2880 H=2880:00 +CPU= 39.093
Moving to projects directory: /var/lib/boinc/slots/20/ICMGGhq0f+002880
Moving to projects directory: /var/lib/boinc/slots/20/ICMSHhq0f+002880
Moving to projects directory: /var/lib/boinc/slots/20/ICMUAhq0f+002880
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMGGhq0f+002856
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMSHhq0f+002856
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMUAhq0f+002856
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMGGhq0f+002868
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMSHhq0f+002868
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMUAhq0f+002868
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0196_2000050100_123_969_12185840_0_r544783557_119.zip
Uploading the intermediate file: upload_file_119.zip
  05:27:53 STEP 2881 H=2881:00 +CPU= 21.047
  05:28:17 STEP 2882 H=2882:00 +CPU= 22.097
  05:28:52 STEP 2883 H=2883:00 +CPU= 33.032
  05:29:16 STEP 2884 H=2884:00 +CPU= 22.067
  05:29:39 STEP 2885 H=2885:00 +CPU= 21.834
  05:30:14 STEP 2886 H=2886:00 +CPU= 34.481
  05:30:38 STEP 2887 H=2887:00 +CPU= 22.168
  05:31:02 STEP 2888 H=2888:00 +CPU= 23.348
  05:31:37 STEP 2889 H=2889:00 +CPU= 33.876
  05:32:02 STEP 2890 H=2890:00 +CPU= 23.586
  05:32:26 STEP 2891 H=2891:00 +CPU= 22.704
  05:33:05 STEP 2892 H=2892:00 +CPU= 38.607
Moving to projects directory: /var/lib/boinc/slots/20/ICMGGhq0f+002892
Moving to projects directory: /var/lib/boinc/slots/20/ICMSHhq0f+002892
Moving to projects directory: /var/lib/boinc/slots/20/ICMUAhq0f+002892
  05:33:30 STEP 2893 H=2893:00 +CPU= 22.589
  05:33:57 STEP 2894 H=2894:00 +CPU= 24.264
  05:34:34 STEP 2895 H=2895:00 +CPU= 35.229
  05:34:58 STEP 2896 H=2896:00 +CPU= 23.145
  05:35:21 STEP 2897 H=2897:00 +CPU= 22.823
  05:35:59 STEP 2898 H=2898:00 +CPU= 35.913
  05:36:24 STEP 2899 H=2899:00 +CPU= 22.597
  05:36:49 STEP 2900 H=2900:00 +CPU= 23.804
  05:37:25 STEP 2901 H=2901:00 +CPU= 35.240
  05:37:48 STEP 2902 H=2902:00 +CPU= 22.792
  05:38:12 STEP 2903 H=2903:00 +CPU= 23.710
  05:38:54 STEP 2904 H=2904:00 +CPU= 41.467
Moving to projects directory: /var/lib/boinc/slots/20/ICMGGhq0f+002904
Moving to projects directory: /var/lib/boinc/slots/20/ICMSHhq0f+002904
Moving to projects directory: /var/lib/boinc/slots/20/ICMUAhq0f+002904
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMGGhq0f+002880
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMSHhq0f+002880
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMUAhq0f+002880
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMGGhq0f+002892
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMSHhq0f+002892
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMUAhq0f+002892
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0196_2000050100_123_969_12185840_0_r544783557_120.zip
Uploading the intermediate file: upload_file_120.zip
  05:39:17 STEP 2905 H=2905:00 +CPU= 22.637
  05:39:40 STEP 2906 H=2906:00 +CPU= 23.044
  05:40:16 STEP 2907 H=2907:00 +CPU= 35.129
  05:40:40 STEP 2908 H=2908:00 +CPU= 24.033
  05:41:05 STEP 2909 H=2909:00 +CPU= 22.927
  05:41:44 STEP 2910 H=2910:00 +CPU= 37.135
  05:42:09 STEP 2911 H=2911:00 +CPU= 23.240
  05:42:34 STEP 2912 H=2912:00 +CPU= 23.680
  05:43:13 STEP 2913 H=2913:00 +CPU= 36.248
  05:43:39 STEP 2914 H=2914:00 +CPU= 23.821
  05:44:03 STEP 2915 H=2915:00 +CPU= 22.888
  05:44:44 STEP 2916 H=2916:00 +CPU= 39.063
Moving to projects directory: /var/lib/boinc/slots/20/ICMGGhq0f+002916
Moving to projects directory: /var/lib/boinc/slots/20/ICMSHhq0f+002916
Moving to projects directory: /var/lib/boinc/slots/20/ICMUAhq0f+002916
  05:45:08 STEP 2917 H=2917:00 +CPU= 22.694
  05:45:33 STEP 2918 H=2918:00 +CPU= 23.565
  05:46:10 STEP 2919 H=2919:00 +CPU= 35.187
  05:46:33 STEP 2920 H=2920:00 +CPU= 22.876
  05:46:55 STEP 2921 H=2921:00 +CPU= 21.975
  05:47:30 STEP 2922 H=2922:00 +CPU= 35.205
  05:47:53 STEP 2923 H=2923:00 +CPU= 23.025
  05:48:17 STEP 2924 H=2924:00 +CPU= 23.069
  05:48:52 STEP 2925 H=2925:00 +CPU= 35.157
  05:49:16 STEP 2926 H=2926:00 +CPU= 23.940
  05:49:39 STEP 2927 H=2927:00 +CPU= 22.403
  05:50:20 STEP 2928 H=2928:00 +CPU= 41.573
Moving to projects directory: /var/lib/boinc/slots/20/ICMGGhq0f+002928
Moving to projects directory: /var/lib/boinc/slots/20/ICMSHhq0f+002928
Moving to projects directory: /var/lib/boinc/slots/20/ICMUAhq0f+002928
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMGGhq0f+002904
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMSHhq0f+002904
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMUAhq0f+002904
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMGGhq0f+002916
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMSHhq0f+002916
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMUAhq0f+002916
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0196_2000050100_123_969_12185840_0_r544783557_121.zip
Uploading the intermediate file: upload_file_121.zip
  05:50:43 STEP 2929 H=2929:00 +CPU= 22.303
  05:51:06 STEP 2930 H=2930:00 +CPU= 23.313
  05:51:42 STEP 2931 H=2931:00 +CPU= 34.806
  05:52:05 STEP 2932 H=2932:00 +CPU= 23.052
  05:52:28 STEP 2933 H=2933:00 +CPU= 22.126
  05:53:04 STEP 2934 H=2934:00 +CPU= 35.622
  05:53:26 STEP 2935 H=2935:00 +CPU= 22.545
  05:53:50 STEP 2936 H=2936:00 +CPU= 23.063
  05:54:25 STEP 2937 H=2937:00 +CPU= 35.131
  05:54:48 STEP 2938 H=2938:00 +CPU= 23.457
  05:55:11 STEP 2939 H=2939:00 +CPU= 22.129
  05:55:50 STEP 2940 H=2940:00 +CPU= 38.886
Moving to projects directory: /var/lib/boinc/slots/20/ICMGGhq0f+002940
Moving to projects directory: /var/lib/boinc/slots/20/ICMSHhq0f+002940
Moving to projects directory: /var/lib/boinc/slots/20/ICMUAhq0f+002940
  05:56:12 STEP 2941 H=2941:00 +CPU= 22.422
  05:56:35 STEP 2942 H=2942:00 +CPU= 22.991
  05:57:09 STEP 2943 H=2943:00 +CPU= 33.651
  05:57:33 STEP 2944 H=2944:00 +CPU= 23.665
  05:57:55 STEP 2945 H=2945:00 +CPU= 21.835
  05:58:31 STEP 2946 H=2946:00 +CPU= 35.612
  05:58:53 STEP 2947 H=2947:00 +CPU= 22.593
  05:59:17 STEP 2948 H=2948:00 +CPU= 23.095
  05:59:51 STEP 2949 H=2949:00 +CPU= 34.522
  06:00:15 STEP 2950 H=2950:00 +CPU= 23.603
  06:00:39 STEP 2951 H=2951:00 +CPU= 23.198
  06:01:19 STEP 2952 H=2952:00 +CPU= 39.154
The child process terminated with status: 0
Moving to projects directory: /var/lib/boinc/slots/20/ICMGGhq0f+002952
Moving to projects directory: /var/lib/boinc/slots/20/ICMSHhq0f+002952
Moving to projects directory: /var/lib/boinc/slots/20/ICMUAhq0f+002952
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMGGhq0f+002940
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMUAhq0f+002940
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMGGhq0f+002928
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMSHhq0f+002928
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMSHhq0f+002952
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMSHhq0f+002940
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMUAhq0f+002928
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMGGhq0f+002952
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12185840/ICMUAhq0f+002952
Zipping up the final file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0196_2000050100_123_969_12185840_0_r544783557_122.zip
Uploading the final file: upload_file_122.zip
Uploading trickle at timestep: 10623600
06:04:42 (1612): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:40:16 1494992 22271183 oifs_43r3_ps_0196_2000050100_123_969_12185840_0 10,623,600 72,826 0.0069
09 May 2023 16:40:16 1494992 22271183 oifs_43r3_ps_0196_2000050100_123_969_12185840_0 10,623,600 72,826 0.0069
09 May 2023 16:39:51 1494992 22271183 oifs_43r3_ps_0196_2000050100_123_969_12185840_0 9,676,800 65,490 0.0068
09 May 2023 16:39:51 1494992 22271183 oifs_43r3_ps_0196_2000050100_123_969_12185840_0 9,676,800 65,490 0.0068
09 May 2023 16:39:44 1494992 22271183 oifs_43r3_ps_0196_2000050100_123_969_12185840_0 8,812,800 59,651 0.0068
09 May 2023 16:39:26 1494992 22271183 oifs_43r3_ps_0196_2000050100_123_969_12185840_0 7,948,800 53,753 0.0068
09 May 2023 16:39:17 1494992 22271183 oifs_43r3_ps_0196_2000050100_123_969_12185840_0 7,084,800 47,994 0.0068
09 May 2023 16:38:53 1494992 22271183 oifs_43r3_ps_0196_2000050100_123_969_12185840_0 6,220,800 42,217 0.0068
09 May 2023 16:38:20 1494992 22271183 oifs_43r3_ps_0196_2000050100_123_969_12185840_0 4,924,800 33,188 0.0067
09 May 2023 16:38:05 1494992 22271183 oifs_43r3_ps_0196_2000050100_123_969_12185840_0 3,456,000 23,333 0.0068
09 May 2023 16:37:38 1494992 22271183 oifs_43r3_ps_0196_2000050100_123_969_12185840_0 2,592,000 17,301 0.0067
09 May 2023 16:37:30 1494992 22271183 oifs_43r3_ps_0196_2000050100_123_969_12185840_0 1,728,000 11,603 0.0067
09 May 2023 16:37:14 1494992 22271183 oifs_43r3_ps_0196_2000050100_123_969_12185840_0 864,000 5,916 0.0068


©2024 cpdn.org