climateprediction.net home page
Task 22303257

Task 22303257

Name oifs_43r3_ps_0487_1994050100_123_963_12180131_1
Workunit 12180131
Created 25 Jan 2023, 1:51:19 UTC
Sent 25 Jan 2023, 2:19:22 UTC
Report deadline 26 Mar 2023, 2:19:22 UTC
Received 25 Jan 2023, 20:29:10 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 5 (0x00000005) Unknown error code
Computer ID 1462795
Run time 17 hours 34 min 51 sec
CPU time 17 hours 34 min 51 sec
Validate state Invalid
Credit 10,886.40
Device peak FLOPS 3.66 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,404.38 MB
Peak swap size 4,974.25 MB
Peak disk usage 2,368.78 MB
Stderr
<core_client_version>7.9.3</core_client_version>
<![CDATA[
<message>
process exited with code 5 (0x5, -251)</message>
<stderr_txt>
ifs_43r3_ps_12180131/ICMSHhq0f+001536
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMUAhq0f+001536
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMGGhq0f+001548
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMSHhq0f+001548
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMUAhq0f+001548
Zipping up the intermediate file: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_0487_1994050100_123_963_12180131_1_r249300447_64.zip
Uploading the intermediate file: upload_file_64.zip
  08:48:25 STEP 1561 H=1561:00 +CPU= 22.845
  08:48:48 STEP 1562 H=1562:00 +CPU= 23.677
  08:49:26 STEP 1563 H=1563:00 +CPU= 37.305
  08:49:50 STEP 1564 H=1564:00 +CPU= 23.787
  08:50:12 STEP 1565 H=1565:00 +CPU= 22.906
  08:50:50 STEP 1566 H=1566:00 +CPU= 37.977
  08:51:13 STEP 1567 H=1567:00 +CPU= 23.097
  08:51:37 STEP 1568 H=1568:00 +CPU= 23.591
  08:52:14 STEP 1569 H=1569:00 +CPU= 37.055
  08:52:38 STEP 1570 H=1570:00 +CPU= 23.694
  08:53:01 STEP 1571 H=1571:00 +CPU= 23.148
  08:53:42 STEP 1572 H=1572:00 +CPU= 40.692
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMGGhq0f+001572
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMSHhq0f+001572
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMUAhq0f+001572
  08:54:05 STEP 1573 H=1573:00 +CPU= 22.839
  08:54:28 STEP 1574 H=1574:00 +CPU= 23.417
  08:55:05 STEP 1575 H=1575:00 +CPU= 37.060
  08:55:29 STEP 1576 H=1576:00 +CPU= 23.778
  08:55:52 STEP 1577 H=1577:00 +CPU= 22.784
  08:56:29 STEP 1578 H=1578:00 +CPU= 37.869
  08:56:52 STEP 1579 H=1579:00 +CPU= 22.810
  08:57:16 STEP 1580 H=1580:00 +CPU= 23.489
  08:57:54 STEP 1581 H=1581:00 +CPU= 37.820
  08:58:17 STEP 1582 H=1582:00 +CPU= 23.636
  08:58:41 STEP 1583 H=1583:00 +CPU= 23.359
  08:59:24 STEP 1584 H=1584:00 +CPU= 43.177
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMGGhq0f+001584
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMSHhq0f+001584
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMUAhq0f+001584
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMGGhq0f+001560
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMSHhq0f+001560
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMUAhq0f+001560
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMGGhq0f+001572
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMSHhq0f+001572
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMUAhq0f+001572
Zipping up the intermediate file: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_0487_1994050100_123_963_12180131_1_r249300447_65.zip
Uploading the intermediate file: upload_file_65.zip
  08:59:46 STEP 1585 H=1585:00 +CPU= 22.687
  09:00:10 STEP 1586 H=1586:00 +CPU= 24.035
  09:00:47 STEP 1587 H=1587:00 +CPU= 36.816
  09:01:11 STEP 1588 H=1588:00 +CPU= 23.433
  09:01:33 STEP 1589 H=1589:00 +CPU= 22.651
  09:02:11 STEP 1590 H=1590:00 +CPU= 37.745
  09:02:34 STEP 1591 H=1591:00 +CPU= 22.695
  09:02:57 STEP 1592 H=1592:00 +CPU= 23.379
  09:03:34 STEP 1593 H=1593:00 +CPU= 36.966
  09:03:58 STEP 1594 H=1594:00 +CPU= 23.418
  09:04:21 STEP 1595 H=1595:00 +CPU= 23.141
  09:05:01 STEP 1596 H=1596:00 +CPU= 40.627
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMGGhq0f+001596
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMSHhq0f+001596
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMUAhq0f+001596
  09:05:24 STEP 1597 H=1597:00 +CPU= 22.740
  09:05:47 STEP 1598 H=1598:00 +CPU= 23.359
  09:06:25 STEP 1599 H=1599:00 +CPU= 37.122
  09:06:48 STEP 1600 H=1600:00 +CPU= 23.537
  09:07:11 STEP 1601 H=1601:00 +CPU= 22.655
  09:07:48 STEP 1602 H=1602:00 +CPU= 37.718
  09:08:11 STEP 1603 H=1603:00 +CPU= 22.728
  09:08:35 STEP 1604 H=1604:00 +CPU= 23.632
  09:09:12 STEP 1605 H=1605:00 +CPU= 37.571
  09:09:36 STEP 1606 H=1606:00 +CPU= 23.412
  09:09:59 STEP 1607 H=1607:00 +CPU= 23.373
  09:10:43 STEP 1608 H=1608:00 +CPU= 43.301
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMGGhq0f+001608
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMSHhq0f+001608
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMUAhq0f+001608
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMGGhq0f+001584
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMSHhq0f+001584
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMUAhq0f+001584
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMGGhq0f+001596
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMSHhq0f+001596
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMUAhq0f+001596
Zipping up the intermediate file: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_0487_1994050100_123_963_12180131_1_r249300447_66.zip
Uploading the intermediate file: upload_file_66.zip
  09:11:05 STEP 1609 H=1609:00 +CPU= 22.889
  09:11:29 STEP 1610 H=1610:00 +CPU= 23.653
  09:12:06 STEP 1611 H=1611:00 +CPU= 37.188
  09:12:30 STEP 1612 H=1612:00 +CPU= 23.519
  09:12:52 STEP 1613 H=1613:00 +CPU= 22.685
  09:13:30 STEP 1614 H=1614:00 +CPU= 37.896
  09:13:53 STEP 1615 H=1615:00 +CPU= 22.985
  09:14:17 STEP 1616 H=1616:00 +CPU= 23.566
  09:14:54 STEP 1617 H=1617:00 +CPU= 37.131
  09:15:18 STEP 1618 H=1618:00 +CPU= 23.964
  09:15:41 STEP 1619 H=1619:00 +CPU= 23.217
  09:16:22 STEP 1620 H=1620:00 +CPU= 40.682
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMGGhq0f+001620
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMSHhq0f+001620
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMUAhq0f+001620
  09:16:45 STEP 1621 H=1621:00 +CPU= 22.870
  09:17:08 STEP 1622 H=1622:00 +CPU= 23.445
  09:17:45 STEP 1623 H=1623:00 +CPU= 37.070
  09:18:09 STEP 1624 H=1624:00 +CPU= 23.736
  09:18:32 STEP 1625 H=1625:00 +CPU= 22.766
  09:19:10 STEP 1626 H=1626:00 +CPU= 37.878
  09:19:33 STEP 1627 H=1627:00 +CPU= 22.807
  09:19:57 STEP 1628 H=1628:00 +CPU= 24.253
  09:20:35 STEP 1629 H=1629:00 +CPU= 38.223
  09:20:59 STEP 1630 H=1630:00 +CPU= 23.780
  09:21:22 STEP 1631 H=1631:00 +CPU= 23.539
  09:22:06 STEP 1632 H=1632:00 +CPU= 43.161
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMGGhq0f+001632
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMSHhq0f+001632
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMUAhq0f+001632
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMGGhq0f+001608
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMSHhq0f+001608
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMUAhq0f+001608
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMGGhq0f+001620
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMSHhq0f+001620
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMUAhq0f+001620
Zipping up the intermediate file: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_0487_1994050100_123_963_12180131_1_r249300447_67.zip
Uploading the intermediate file: upload_file_67.zip
  09:22:28 STEP 1633 H=1633:00 +CPU= 22.816
  09:22:52 STEP 1634 H=1634:00 +CPU= 23.755
  09:23:29 STEP 1635 H=1635:00 +CPU= 36.990
  09:23:53 STEP 1636 H=1636:00 +CPU= 23.655
  09:24:16 STEP 1637 H=1637:00 +CPU= 22.911
  09:24:53 STEP 1638 H=1638:00 +CPU= 37.808
  09:25:16 STEP 1639 H=1639:00 +CPU= 22.899
  09:25:40 STEP 1640 H=1640:00 +CPU= 23.591
  09:26:17 STEP 1641 H=1641:00 +CPU= 36.953
  09:26:41 STEP 1642 H=1642:00 +CPU= 23.822
  09:27:04 STEP 1643 H=1643:00 +CPU= 22.873
  09:27:44 STEP 1644 H=1644:00 +CPU= 40.715
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMGGhq0f+001644
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMSHhq0f+001644
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMUAhq0f+001644
  09:28:07 STEP 1645 H=1645:00 +CPU= 22.951
  09:28:31 STEP 1646 H=1646:00 +CPU= 23.553
  09:29:08 STEP 1647 H=1647:00 +CPU= 36.966
  09:29:32 STEP 1648 H=1648:00 +CPU= 23.786
  09:29:54 STEP 1649 H=1649:00 +CPU= 22.874
  09:30:32 STEP 1650 H=1650:00 +CPU= 38.016
  09:30:56 STEP 1651 H=1651:00 +CPU= 23.047
  09:31:20 STEP 1652 H=1652:00 +CPU= 24.282
  09:31:57 STEP 1653 H=1653:00 +CPU= 37.170
  09:32:21 STEP 1654 H=1654:00 +CPU= 23.774
  09:32:44 STEP 1655 H=1655:00 +CPU= 23.364
  09:33:28 STEP 1656 H=1656:00 +CPU= 43.699
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMGGhq0f+001656
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMSHhq0f+001656
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMUAhq0f+001656
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMGGhq0f+001632
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMSHhq0f+001632
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMUAhq0f+001632
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMGGhq0f+001644
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMSHhq0f+001644
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMUAhq0f+001644
Zipping up the intermediate file: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_0487_1994050100_123_963_12180131_1_r249300447_68.zip
Uploading the intermediate file: upload_file_68.zip
  09:33:51 STEP 1657 H=1657:00 +CPU= 22.731
  09:34:14 STEP 1658 H=1658:00 +CPU= 23.566
  09:34:51 STEP 1659 H=1659:00 +CPU= 36.870
  09:35:15 STEP 1660 H=1660:00 +CPU= 23.473
  09:35:37 STEP 1661 H=1661:00 +CPU= 22.654
  09:36:15 STEP 1662 H=1662:00 +CPU= 37.615
  09:36:38 STEP 1663 H=1663:00 +CPU= 22.933
  09:37:01 STEP 1664 H=1664:00 +CPU= 23.422
  09:37:38 STEP 1665 H=1665:00 +CPU= 37.002
  09:38:02 STEP 1666 H=1666:00 +CPU= 23.693
  09:38:25 STEP 1667 H=1667:00 +CPU= 22.918
  09:39:06 STEP 1668 H=1668:00 +CPU= 40.845
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMGGhq0f+001668
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMSHhq0f+001668
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMUAhq0f+001668
  09:39:29 STEP 1669 H=1669:00 +CPU= 23.131
  09:39:52 STEP 1670 H=1670:00 +CPU= 23.536
  09:40:29 STEP 1671 H=1671:00 +CPU= 37.238
  09:40:53 STEP 1672 H=1672:00 +CPU= 23.912
  09:41:16 STEP 1673 H=1673:00 +CPU= 22.974
  09:41:54 STEP 1674 H=1674:00 +CPU= 38.093
  09:42:18 STEP 1675 H=1675:00 +CPU= 23.604
  09:42:42 STEP 1676 H=1676:00 +CPU= 23.766
  09:43:19 STEP 1677 H=1677:00 +CPU= 37.203
  09:43:43 STEP 1678 H=1678:00 +CPU= 23.707
  09:44:06 STEP 1679 H=1679:00 +CPU= 23.362
  09:44:50 STEP 1680 H=1680:00 +CPU= 43.662
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMGGhq0f+001680
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMSHhq0f+001680
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMUAhq0f+001680
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMGGhq0f+001656
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMSHhq0f+001656
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMUAhq0f+001656
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMGGhq0f+001668
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMSHhq0f+001668
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMUAhq0f+001668
Zipping up the intermediate file: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_0487_1994050100_123_963_12180131_1_r249300447_69.zip
Uploading the intermediate file: upload_file_69.zip
  09:45:13 STEP 1681 H=1681:00 +CPU= 23.211
Uploading trickle at timestep: 6048000
  09:45:37 STEP 1682 H=1682:00 +CPU= 24.410
  09:46:16 STEP 1683 H=1683:00 +CPU= 38.438
  09:46:40 STEP 1684 H=1684:00 +CPU= 24.439
  09:47:04 STEP 1685 H=1685:00 +CPU= 23.242
  09:47:42 STEP 1686 H=1686:00 +CPU= 38.628
  09:48:05 STEP 1687 H=1687:00 +CPU= 23.254
  09:48:29 STEP 1688 H=1688:00 +CPU= 23.807
  09:49:07 STEP 1689 H=1689:00 +CPU= 37.356
  09:49:31 STEP 1690 H=1690:00 +CPU= 24.086
  09:49:54 STEP 1691 H=1691:00 +CPU= 22.958
  09:50:35 STEP 1692 H=1692:00 +CPU= 41.104
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMGGhq0f+001692
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMSHhq0f+001692
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMUAhq0f+001692
  09:50:58 STEP 1693 H=1693:00 +CPU= 23.076
  09:51:22 STEP 1694 H=1694:00 +CPU= 23.708
  09:51:59 STEP 1695 H=1695:00 +CPU= 37.237
  09:52:23 STEP 1696 H=1696:00 +CPU= 23.898
  09:52:46 STEP 1697 H=1697:00 +CPU= 22.925
  09:53:24 STEP 1698 H=1698:00 +CPU= 38.437
  09:53:47 STEP 1699 H=1699:00 +CPU= 23.007
  09:54:11 STEP 1700 H=1700:00 +CPU= 23.834
  09:54:48 STEP 1701 H=1701:00 +CPU= 36.780
  09:55:11 STEP 1702 H=1702:00 +CPU= 23.594
  09:55:35 STEP 1703 H=1703:00 +CPU= 23.301
  09:56:18 STEP 1704 H=1704:00 +CPU= 42.998
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMGGhq0f+001704
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMSHhq0f+001704
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMUAhq0f+001704
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMGGhq0f+001680
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMSHhq0f+001680
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMUAhq0f+001680
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMGGhq0f+001692
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMSHhq0f+001692
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMUAhq0f+001692
Zipping up the intermediate file: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_0487_1994050100_123_963_12180131_1_r249300447_70.zip
Uploading the intermediate file: upload_file_70.zip
  09:56:40 STEP 1705 H=1705:00 +CPU= 22.817
  09:57:04 STEP 1706 H=1706:00 +CPU= 23.754
  09:57:41 STEP 1707 H=1707:00 +CPU= 36.867
  09:58:05 STEP 1708 H=1708:00 +CPU= 23.714
  09:58:27 STEP 1709 H=1709:00 +CPU= 22.738
  09:59:05 STEP 1710 H=1710:00 +CPU= 37.792
  09:59:28 STEP 1711 H=1711:00 +CPU= 22.899
  09:59:52 STEP 1712 H=1712:00 +CPU= 23.567
  10:00:29 STEP 1713 H=1713:00 +CPU= 37.140
  10:00:53 STEP 1714 H=1714:00 +CPU= 23.911
  10:01:16 STEP 1715 H=1715:00 +CPU= 23.268
  10:01:57 STEP 1716 H=1716:00 +CPU= 40.621
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMGGhq0f+001716
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMSHhq0f+001716
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMUAhq0f+001716
  10:02:19 STEP 1717 H=1717:00 +CPU= 22.785
  10:02:43 STEP 1718 H=1718:00 +CPU= 23.245
  10:03:20 STEP 1719 H=1719:00 +CPU= 36.887
  10:03:43 STEP 1720 H=1720:00 +CPU= 23.550
  10:04:06 STEP 1721 H=1721:00 +CPU= 22.666
  10:04:44 STEP 1722 H=1722:00 +CPU= 38.273
  10:05:07 STEP 1723 H=1723:00 +CPU= 22.869
  10:05:31 STEP 1724 H=1724:00 +CPU= 23.763
  10:06:08 STEP 1725 H=1725:00 +CPU= 36.812
  10:06:31 STEP 1726 H=1726:00 +CPU= 23.630
  10:06:55 STEP 1727 H=1727:00 +CPU= 23.337
  10:07:38 STEP 1728 H=1728:00 +CPU= 42.969
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMGGhq0f+001728
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMSHhq0f+001728
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMUAhq0f+001728
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMGGhq0f+001704
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMSHhq0f+001704
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMUAhq0f+001704
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMGGhq0f+001716
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMSHhq0f+001716
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMUAhq0f+001716
Zipping up the intermediate file: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_0487_1994050100_123_963_12180131_1_r249300447_71.zip
Uploading the intermediate file: upload_file_71.zip
  10:08:00 STEP 1729 H=1729:00 +CPU= 22.874
  10:08:24 STEP 1730 H=1730:00 +CPU= 23.761
  10:09:01 STEP 1731 H=1731:00 +CPU= 36.944
  10:09:25 STEP 1732 H=1732:00 +CPU= 23.702
  10:09:48 STEP 1733 H=1733:00 +CPU= 22.776
  10:10:26 STEP 1734 H=1734:00 +CPU= 37.944
  10:10:49 STEP 1735 H=1735:00 +CPU= 23.118
  10:11:12 STEP 1736 H=1736:00 +CPU= 23.623
  10:11:49 STEP 1737 H=1737:00 +CPU= 36.991
  10:12:13 STEP 1738 H=1738:00 +CPU= 23.990
  10:12:37 STEP 1739 H=1739:00 +CPU= 23.415
  10:13:18 STEP 1740 H=1740:00 +CPU= 40.898
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMGGhq0f+001740
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMSHhq0f+001740
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMUAhq0f+001740
  10:13:40 STEP 1741 H=1741:00 +CPU= 22.893
  10:14:04 STEP 1742 H=1742:00 +CPU= 23.498
  10:14:41 STEP 1743 H=1743:00 +CPU= 37.152
  10:15:05 STEP 1744 H=1744:00 +CPU= 24.053
  10:15:28 STEP 1745 H=1745:00 +CPU= 22.983
  10:16:07 STEP 1746 H=1746:00 +CPU= 38.454
  10:16:30 STEP 1747 H=1747:00 +CPU= 23.471
  10:16:54 STEP 1748 H=1748:00 +CPU= 23.751
  10:17:31 STEP 1749 H=1749:00 +CPU= 37.354
  10:17:55 STEP 1750 H=1750:00 +CPU= 23.767
  10:18:19 STEP 1751 H=1751:00 +CPU= 23.577
  10:19:02 STEP 1752 H=1752:00 +CPU= 43.546
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMGGhq0f+001752
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMSHhq0f+001752
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMUAhq0f+001752
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMGGhq0f+001728
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMSHhq0f+001728
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMUAhq0f+001728
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMGGhq0f+001740
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMSHhq0f+001740
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMUAhq0f+001740
Zipping up the intermediate file: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_0487_1994050100_123_963_12180131_1_r249300447_72.zip
Uploading the intermediate file: upload_file_72.zip
  10:19:25 STEP 1753 H=1753:00 +CPU= 23.162
  10:19:49 STEP 1754 H=1754:00 +CPU= 24.033
  10:20:27 STEP 1755 H=1755:00 +CPU= 37.287
  10:20:51 STEP 1756 H=1756:00 +CPU= 23.963
  10:21:13 STEP 1757 H=1757:00 +CPU= 22.868
  10:21:51 STEP 1758 H=1758:00 +CPU= 37.721
  10:22:14 STEP 1759 H=1759:00 +CPU= 23.005
  10:22:38 STEP 1760 H=1760:00 +CPU= 23.526
  10:23:15 STEP 1761 H=1761:00 +CPU= 36.977
  10:23:38 STEP 1762 H=1762:00 +CPU= 23.681
  10:24:01 STEP 1763 H=1763:00 +CPU= 23.131
  10:24:42 STEP 1764 H=1764:00 +CPU= 40.498
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMGGhq0f+001764
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMSHhq0f+001764
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMUAhq0f+001764
  10:25:05 STEP 1765 H=1765:00 +CPU= 22.745
  10:25:28 STEP 1766 H=1766:00 +CPU= 23.321
  10:26:05 STEP 1767 H=1767:00 +CPU= 36.805
  10:26:28 STEP 1768 H=1768:00 +CPU= 23.608
  10:26:52 STEP 1769 H=1769:00 +CPU= 23.363
  10:27:30 STEP 1770 H=1770:00 +CPU= 37.770
  10:27:53 STEP 1771 H=1771:00 +CPU= 23.137
  10:28:16 STEP 1772 H=1772:00 +CPU= 23.433
  10:28:53 STEP 1773 H=1773:00 +CPU= 37.017
  10:29:17 STEP 1774 H=1774:00 +CPU= 23.598
  10:29:40 STEP 1775 H=1775:00 +CPU= 23.445
  10:30:24 STEP 1776 H=1776:00 +CPU= 43.497
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMGGhq0f+001776
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMSHhq0f+001776
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMUAhq0f+001776
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMGGhq0f+001752
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMSHhq0f+001752
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMUAhq0f+001752
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMGGhq0f+001764
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMSHhq0f+001764
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMUAhq0f+001764
Zipping up the intermediate file: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_0487_1994050100_123_963_12180131_1_r249300447_73.zip
Uploading the intermediate file: upload_file_73.zip
  10:30:47 STEP 1777 H=1777:00 +CPU= 22.797
  10:31:10 STEP 1778 H=1778:00 +CPU= 23.644
  10:31:47 STEP 1779 H=1779:00 +CPU= 37.205
  10:32:11 STEP 1780 H=1780:00 +CPU= 23.758
  10:32:34 STEP 1781 H=1781:00 +CPU= 22.814
  10:33:12 STEP 1782 H=1782:00 +CPU= 37.784
  10:33:35 STEP 1783 H=1783:00 +CPU= 22.958
  10:33:58 STEP 1784 H=1784:00 +CPU= 23.579
  10:34:35 STEP 1785 H=1785:00 +CPU= 36.960
  10:34:59 STEP 1786 H=1786:00 +CPU= 23.715
  10:35:22 STEP 1787 H=1787:00 +CPU= 23.151
  10:36:03 STEP 1788 H=1788:00 +CPU= 40.573
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMGGhq0f+001788
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMSHhq0f+001788
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMUAhq0f+001788
  10:36:25 STEP 1789 H=1789:00 +CPU= 22.775
  10:36:49 STEP 1790 H=1790:00 +CPU= 23.312
  10:37:26 STEP 1791 H=1791:00 +CPU= 36.886
  10:37:49 STEP 1792 H=1792:00 +CPU= 23.568
  10:38:13 STEP 1793 H=1793:00 +CPU= 23.353
  10:38:51 STEP 1794 H=1794:00 +CPU= 38.043
  10:39:13 STEP 1795 H=1795:00 +CPU= 22.823
  10:39:37 STEP 1796 H=1796:00 +CPU= 23.447
  10:40:14 STEP 1797 H=1797:00 +CPU= 36.881
  10:40:37 STEP 1798 H=1798:00 +CPU= 23.560
  10:41:01 STEP 1799 H=1799:00 +CPU= 23.355
  10:41:44 STEP 1800 H=1800:00 +CPU= 43.078
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMGGhq0f+001800
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMSHhq0f+001800
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMUAhq0f+001800
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMGGhq0f+001776
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMSHhq0f+001776
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMUAhq0f+001776
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMGGhq0f+001788
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMSHhq0f+001788
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMUAhq0f+001788
Zipping up the intermediate file: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_0487_1994050100_123_963_12180131_1_r249300447_74.zip
Uploading the intermediate file: upload_file_74.zip
  10:42:07 STEP 1801 H=1801:00 +CPU= 22.855
  10:42:30 STEP 1802 H=1802:00 +CPU= 23.799
  10:43:07 STEP 1803 H=1803:00 +CPU= 36.897
  10:43:31 STEP 1804 H=1804:00 +CPU= 23.694
  10:43:54 STEP 1805 H=1805:00 +CPU= 22.826
  10:44:32 STEP 1806 H=1806:00 +CPU= 38.084
  10:44:55 STEP 1807 H=1807:00 +CPU= 23.231
  10:45:19 STEP 1808 H=1808:00 +CPU= 24.060
  10:45:57 STEP 1809 H=1809:00 +CPU= 38.209
  10:46:21 STEP 1810 H=1810:00 +CPU= 23.988
  10:46:45 STEP 1811 H=1811:00 +CPU= 23.416
  10:47:26 STEP 1812 H=1812:00 +CPU= 40.929
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMGGhq0f+001812
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMSHhq0f+001812
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMUAhq0f+001812
  10:47:49 STEP 1813 H=1813:00 +CPU= 23.037
  10:48:12 STEP 1814 H=1814:00 +CPU= 23.568
  10:48:50 STEP 1815 H=1815:00 +CPU= 37.273
  10:49:14 STEP 1816 H=1816:00 +CPU= 24.437
  10:49:37 STEP 1817 H=1817:00 +CPU= 23.033
  10:50:15 STEP 1818 H=1818:00 +CPU= 38.141
  10:50:38 STEP 1819 H=1819:00 +CPU= 22.792
  10:51:02 STEP 1820 H=1820:00 +CPU= 23.413
  10:51:38 STEP 1821 H=1821:00 +CPU= 36.842
  10:52:02 STEP 1822 H=1822:00 +CPU= 23.558
  10:52:25 STEP 1823 H=1823:00 +CPU= 23.231
  10:53:08 STEP 1824 H=1824:00 +CPU= 42.918
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMGGhq0f+001824
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMSHhq0f+001824
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMUAhq0f+001824
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMGGhq0f+001800
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMSHhq0f+001800
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMUAhq0f+001800
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMGGhq0f+001812
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMSHhq0f+001812
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMUAhq0f+001812
Zipping up the intermediate file: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_0487_1994050100_123_963_12180131_1_r249300447_75.zip
Uploading the intermediate file: upload_file_75.zip
  10:53:31 STEP 1825 H=1825:00 +CPU= 22.843
  10:53:55 STEP 1826 H=1826:00 +CPU= 23.709
  10:54:32 STEP 1827 H=1827:00 +CPU= 37.708
  10:54:56 STEP 1828 H=1828:00 +CPU= 24.052
  10:55:22 STEP 1829 H=1829:00 +CPU= 25.308
  10:56:01 STEP 1830 H=1830:00 +CPU= 38.840
  10:56:24 STEP 1831 H=1831:00 +CPU= 23.072
  10:56:47 STEP 1832 H=1832:00 +CPU= 23.802
  10:57:25 STEP 1833 H=1833:00 +CPU= 37.521
  10:57:49 STEP 1834 H=1834:00 +CPU= 24.060
  10:58:12 STEP 1835 H=1835:00 +CPU= 23.119
  10:58:53 STEP 1836 H=1836:00 +CPU= 41.173
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMGGhq0f+001836
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMSHhq0f+001836
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMUAhq0f+001836
  10:59:16 STEP 1837 H=1837:00 +CPU= 22.779
  10:59:40 STEP 1838 H=1838:00 +CPU= 23.698
  11:00:17 STEP 1839 H=1839:00 +CPU= 37.537
  11:00:41 STEP 1840 H=1840:00 +CPU= 23.882
  11:01:04 STEP 1841 H=1841:00 +CPU= 23.138
  11:01:43 STEP 1842 H=1842:00 +CPU= 38.640
  11:02:06 STEP 1843 H=1843:00 +CPU= 22.923
  11:02:30 STEP 1844 H=1844:00 +CPU= 23.833
  11:03:07 STEP 1845 H=1845:00 +CPU= 37.422
  11:03:31 STEP 1846 H=1846:00 +CPU= 23.638
  11:03:55 STEP 1847 H=1847:00 +CPU= 23.723
  11:04:38 STEP 1848 H=1848:00 +CPU= 43.685
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMGGhq0f+001848
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMSHhq0f+001848
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMUAhq0f+001848
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMGGhq0f+001824
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMSHhq0f+001824
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMUAhq0f+001824
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMGGhq0f+001836
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMSHhq0f+001836
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMUAhq0f+001836
Zipping up the intermediate file: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_0487_1994050100_123_963_12180131_1_r249300447_76.zip
Uploading the intermediate file: upload_file_76.zip
  11:05:01 STEP 1849 H=1849:00 +CPU= 22.942
  11:05:25 STEP 1850 H=1850:00 +CPU= 23.810
  11:06:02 STEP 1851 H=1851:00 +CPU= 37.255
  11:06:26 STEP 1852 H=1852:00 +CPU= 23.502
  11:06:49 STEP 1853 H=1853:00 +CPU= 23.112
  11:07:27 STEP 1854 H=1854:00 +CPU= 38.051
  11:07:50 STEP 1855 H=1855:00 +CPU= 22.824
  11:08:14 STEP 1856 H=1856:00 +CPU= 23.725
  11:08:51 STEP 1857 H=1857:00 +CPU= 37.864
  11:09:15 STEP 1858 H=1858:00 +CPU= 23.641
  11:09:38 STEP 1859 H=1859:00 +CPU= 23.151
  11:10:20 STEP 1860 H=1860:00 +CPU= 41.544
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMGGhq0f+001860
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMSHhq0f+001860
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMUAhq0f+001860
  11:10:43 STEP 1861 H=1861:00 +CPU= 23.022
  11:11:07 STEP 1862 H=1862:00 +CPU= 23.854
  11:11:45 STEP 1863 H=1863:00 +CPU= 37.982
  11:12:09 STEP 1864 H=1864:00 +CPU= 24.197
  11:12:32 STEP 1865 H=1865:00 +CPU= 23.140
  11:13:10 STEP 1866 H=1866:00 +CPU= 38.498
  11:13:33 STEP 1867 H=1867:00 +CPU= 22.832
  11:13:57 STEP 1868 H=1868:00 +CPU= 23.875
  11:14:35 STEP 1869 H=1869:00 +CPU= 37.422
  11:14:58 STEP 1870 H=1870:00 +CPU= 23.440
  11:15:22 STEP 1871 H=1871:00 +CPU= 24.158
  11:16:07 STEP 1872 H=1872:00 +CPU= 44.387
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMGGhq0f+001872
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMSHhq0f+001872
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMUAhq0f+001872
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMGGhq0f+001848
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMSHhq0f+001848
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMUAhq0f+001848
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMGGhq0f+001860
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMSHhq0f+001860
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMUAhq0f+001860
Zipping up the intermediate file: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_0487_1994050100_123_963_12180131_1_r249300447_77.zip
Uploading the intermediate file: upload_file_77.zip
  11:16:29 STEP 1873 H=1873:00 +CPU= 22.694
  11:16:53 STEP 1874 H=1874:00 +CPU= 23.649
  11:17:30 STEP 1875 H=1875:00 +CPU= 37.482
  11:17:54 STEP 1876 H=1876:00 +CPU= 23.652
  11:18:17 STEP 1877 H=1877:00 +CPU= 23.209
  11:18:56 STEP 1878 H=1878:00 +CPU= 38.345
  11:19:19 STEP 1879 H=1879:00 +CPU= 22.978
  11:19:42 STEP 1880 H=1880:00 +CPU= 23.896
  11:20:20 STEP 1881 H=1881:00 +CPU= 37.767
  11:20:44 STEP 1882 H=1882:00 +CPU= 23.639
  11:21:07 STEP 1883 H=1883:00 +CPU= 23.175
  11:21:48 STEP 1884 H=1884:00 +CPU= 41.296
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMGGhq0f+001884
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMSHhq0f+001884
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMUAhq0f+001884
  11:22:11 STEP 1885 H=1885:00 +CPU= 22.934
  11:22:35 STEP 1886 H=1886:00 +CPU= 23.888
  11:23:13 STEP 1887 H=1887:00 +CPU= 37.777
  11:23:36 STEP 1888 H=1888:00 +CPU= 23.459
  11:24:00 STEP 1889 H=1889:00 +CPU= 23.077
  11:24:38 STEP 1890 H=1890:00 +CPU= 38.312
  11:25:01 STEP 1891 H=1891:00 +CPU= 22.817
  11:25:24 STEP 1892 H=1892:00 +CPU= 23.682
  11:26:02 STEP 1893 H=1893:00 +CPU= 37.438
  11:26:26 STEP 1894 H=1894:00 +CPU= 23.819
  11:26:49 STEP 1895 H=1895:00 +CPU= 23.754
  11:27:33 STEP 1896 H=1896:00 +CPU= 43.958
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMGGhq0f+001896
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMSHhq0f+001896
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMUAhq0f+001896
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMGGhq0f+001872
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMSHhq0f+001872
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMUAhq0f+001872
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMGGhq0f+001884
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMSHhq0f+001884
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMUAhq0f+001884
Zipping up the intermediate file: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_0487_1994050100_123_963_12180131_1_r249300447_78.zip
Uploading the intermediate file: upload_file_78.zip
  11:27:56 STEP 1897 H=1897:00 +CPU= 23.092
  11:28:20 STEP 1898 H=1898:00 +CPU= 24.016
  11:28:58 STEP 1899 H=1899:00 +CPU= 37.538
  11:29:22 STEP 1900 H=1900:00 +CPU= 23.734
  11:29:45 STEP 1901 H=1901:00 +CPU= 23.219
  11:30:23 STEP 1902 H=1902:00 +CPU= 38.352
  11:30:46 STEP 1903 H=1903:00 +CPU= 22.866
  11:31:10 STEP 1904 H=1904:00 +CPU= 23.867
  11:31:48 STEP 1905 H=1905:00 +CPU= 37.583
  11:32:11 STEP 1906 H=1906:00 +CPU= 23.619
  11:32:34 STEP 1907 H=1907:00 +CPU= 23.105
  11:33:15 STEP 1908 H=1908:00 +CPU= 41.134
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMGGhq0f+001908
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMSHhq0f+001908
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMUAhq0f+001908
  11:33:38 STEP 1909 H=1909:00 +CPU= 22.951
  11:34:02 STEP 1910 H=1910:00 +CPU= 23.872
  11:34:40 STEP 1911 H=1911:00 +CPU= 37.887
  11:35:04 STEP 1912 H=1912:00 +CPU= 23.611
  11:35:27 STEP 1913 H=1913:00 +CPU= 23.097
  11:36:05 STEP 1914 H=1914:00 +CPU= 38.384
  11:36:28 STEP 1915 H=1915:00 +CPU= 22.905
  11:36:52 STEP 1916 H=1916:00 +CPU= 24.247
  11:37:30 STEP 1917 H=1917:00 +CPU= 37.699
  11:37:54 STEP 1918 H=1918:00 +CPU= 23.595
  11:38:18 STEP 1919 H=1919:00 +CPU= 23.996
  11:39:01 STEP 1920 H=1920:00 +CPU= 43.662
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMGGhq0f+001920
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMSHhq0f+001920
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMUAhq0f+001920
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMGGhq0f+001896
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMSHhq0f+001896
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMUAhq0f+001896
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMGGhq0f+001908
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMSHhq0f+001908
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMUAhq0f+001908
Zipping up the intermediate file: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_0487_1994050100_123_963_12180131_1_r249300447_79.zip
Uploading the intermediate file: upload_file_79.zip
Uploading trickle at timestep: 6912000
  11:39:25 STEP 1921 H=1921:00 +CPU= 23.041
  11:39:48 STEP 1922 H=1922:00 +CPU= 23.883
  11:40:26 STEP 1923 H=1923:00 +CPU= 37.410
  11:40:50 STEP 1924 H=1924:00 +CPU= 23.716
  11:41:13 STEP 1925 H=1925:00 +CPU= 23.285
  11:41:51 STEP 1926 H=1926:00 +CPU= 38.272
  11:42:14 STEP 1927 H=1927:00 +CPU= 22.972
  11:42:38 STEP 1928 H=1928:00 +CPU= 24.127
  11:43:16 STEP 1929 H=1929:00 +CPU= 37.552
  11:43:39 STEP 1930 H=1930:00 +CPU= 23.696
  11:44:03 STEP 1931 H=1931:00 +CPU= 23.168
  11:44:44 STEP 1932 H=1932:00 +CPU= 41.344
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMGGhq0f+001932
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMSHhq0f+001932
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMUAhq0f+001932
  11:45:07 STEP 1933 H=1933:00 +CPU= 23.314
  11:45:31 STEP 1934 H=1934:00 +CPU= 23.929
  11:46:09 STEP 1935 H=1935:00 +CPU= 38.030
  11:46:33 STEP 1936 H=1936:00 +CPU= 23.735
  11:46:56 STEP 1937 H=1937:00 +CPU= 23.249
  11:47:35 STEP 1938 H=1938:00 +CPU= 38.391
  11:47:57 STEP 1939 H=1939:00 +CPU= 22.848
  11:48:21 STEP 1940 H=1940:00 +CPU= 23.888
  11:48:59 STEP 1941 H=1941:00 +CPU= 37.594
  11:49:23 STEP 1942 H=1942:00 +CPU= 23.644
  11:49:47 STEP 1943 H=1943:00 +CPU= 24.057
  11:50:30 STEP 1944 H=1944:00 +CPU= 43.542
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMGGhq0f+001944
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMSHhq0f+001944
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMUAhq0f+001944
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMGGhq0f+001920
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMSHhq0f+001920
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMUAhq0f+001920
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMGGhq0f+001932
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMSHhq0f+001932
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMUAhq0f+001932
Zipping up the intermediate file: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_0487_1994050100_123_963_12180131_1_r249300447_80.zip
Uploading the intermediate file: upload_file_80.zip
  11:50:54 STEP 1945 H=1945:00 +CPU= 24.095
  11:51:18 STEP 1946 H=1946:00 +CPU= 23.859
  11:51:55 STEP 1947 H=1947:00 +CPU= 37.156
  11:52:19 STEP 1948 H=1948:00 +CPU= 23.826
  11:52:42 STEP 1949 H=1949:00 +CPU= 23.210
  11:53:21 STEP 1950 H=1950:00 +CPU= 38.182
  11:53:44 STEP 1951 H=1951:00 +CPU= 23.219
  11:54:08 STEP 1952 H=1952:00 +CPU= 23.846
  11:54:45 STEP 1953 H=1953:00 +CPU= 37.320
  11:55:09 STEP 1954 H=1954:00 +CPU= 23.765
  11:55:32 STEP 1955 H=1955:00 +CPU= 22.984
  11:56:13 STEP 1956 H=1956:00 +CPU= 41.302
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMGGhq0f+001956
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMSHhq0f+001956
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMUAhq0f+001956
  11:56:36 STEP 1957 H=1957:00 +CPU= 23.228
  11:57:00 STEP 1958 H=1958:00 +CPU= 23.968
  11:57:38 STEP 1959 H=1959:00 +CPU= 37.646
  11:58:02 STEP 1960 H=1960:00 +CPU= 23.977
  11:58:25 STEP 1961 H=1961:00 +CPU= 23.285
  11:59:04 STEP 1962 H=1962:00 +CPU= 38.514
  11:59:27 STEP 1963 H=1963:00 +CPU= 23.007
  11:59:51 STEP 1964 H=1964:00 +CPU= 24.236
  12:00:29 STEP 1965 H=1965:00 +CPU= 37.741
  12:00:53 STEP 1966 H=1966:00 +CPU= 24.127
  12:01:17 STEP 1967 H=1967:00 +CPU= 23.820
  12:02:00 STEP 1968 H=1968:00 +CPU= 43.753
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMGGhq0f+001968
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMSHhq0f+001968
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMUAhq0f+001968
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMGGhq0f+001944
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMSHhq0f+001944
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMUAhq0f+001944
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMGGhq0f+001956
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMSHhq0f+001956
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMUAhq0f+001956
Zipping up the intermediate file: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_0487_1994050100_123_963_12180131_1_r249300447_81.zip
Uploading the intermediate file: upload_file_81.zip
  12:02:24 STEP 1969 H=1969:00 +CPU= 23.252
  12:02:48 STEP 1970 H=1970:00 +CPU= 23.915
  12:03:25 STEP 1971 H=1971:00 +CPU= 37.295
  12:03:49 STEP 1972 H=1972:00 +CPU= 24.025
  12:04:12 STEP 1973 H=1973:00 +CPU= 23.303
  12:04:51 STEP 1974 H=1974:00 +CPU= 38.373
  12:05:14 STEP 1975 H=1975:00 +CPU= 23.123
  12:05:38 STEP 1976 H=1976:00 +CPU= 23.894
  12:06:15 STEP 1977 H=1977:00 +CPU= 37.298
  12:06:39 STEP 1978 H=1978:00 +CPU= 23.821
  12:07:02 STEP 1979 H=1979:00 +CPU= 23.126
  12:07:43 STEP 1980 H=1980:00 +CPU= 41.053
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMGGhq0f+001980
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMSHhq0f+001980
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMUAhq0f+001980
  12:08:06 STEP 1981 H=1981:00 +CPU= 23.202
  12:08:30 STEP 1982 H=1982:00 +CPU= 24.144
  12:09:08 STEP 1983 H=1983:00 +CPU= 37.462
  12:09:31 STEP 1984 H=1984:00 +CPU= 23.857
  12:09:55 STEP 1985 H=1985:00 +CPU= 23.108
  12:10:33 STEP 1986 H=1986:00 +CPU= 38.306
  12:10:56 STEP 1987 H=1987:00 +CPU= 23.466
  12:11:20 STEP 1988 H=1988:00 +CPU= 24.094
  12:11:58 STEP 1989 H=1989:00 +CPU= 37.620
  12:12:22 STEP 1990 H=1990:00 +CPU= 23.857
  12:12:46 STEP 1991 H=1991:00 +CPU= 23.834
  12:13:30 STEP 1992 H=1992:00 +CPU= 43.835
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMGGhq0f+001992
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMSHhq0f+001992
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMUAhq0f+001992
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMGGhq0f+001968
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMSHhq0f+001968
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMUAhq0f+001968
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMGGhq0f+001980
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMSHhq0f+001980
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMUAhq0f+001980
Zipping up the intermediate file: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_0487_1994050100_123_963_12180131_1_r249300447_82.zip
Uploading the intermediate file: upload_file_82.zip
  12:13:53 STEP 1993 H=1993:00 +CPU= 23.123
  12:14:17 STEP 1994 H=1994:00 +CPU= 23.810
  12:14:54 STEP 1995 H=1995:00 +CPU= 37.167
  12:15:18 STEP 1996 H=1996:00 +CPU= 23.924
  12:15:41 STEP 1997 H=1997:00 +CPU= 23.097
  12:16:19 STEP 1998 H=1998:00 +CPU= 38.301
  12:16:42 STEP 1999 H=1999:00 +CPU= 23.139
  12:17:06 STEP 2000 H=2000:00 +CPU= 23.912
  12:17:43 STEP 2001 H=2001:00 +CPU= 37.298
  12:18:07 STEP 2002 H=2002:00 +CPU= 23.751
  12:18:30 STEP 2003 H=2003:00 +CPU= 23.110
  12:19:12 STEP 2004 H=2004:00 +CPU= 41.197
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMGGhq0f+002004
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMSHhq0f+002004
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMUAhq0f+002004
  12:19:35 STEP 2005 H=2005:00 +CPU= 23.208
  12:19:59 STEP 2006 H=2006:00 +CPU= 24.196
  12:20:36 STEP 2007 H=2007:00 +CPU= 37.559
  12:21:00 STEP 2008 H=2008:00 +CPU= 23.930
  12:21:24 STEP 2009 H=2009:00 +CPU= 23.216
  12:22:02 STEP 2010 H=2010:00 +CPU= 38.424
  12:22:25 STEP 2011 H=2011:00 +CPU= 23.160
  12:22:49 STEP 2012 H=2012:00 +CPU= 23.878
  12:23:28 STEP 2013 H=2013:00 +CPU= 39.360
  12:23:52 STEP 2014 H=2014:00 +CPU= 24.008
  12:24:16 STEP 2015 H=2015:00 +CPU= 23.887
  12:25:00 STEP 2016 H=2016:00 +CPU= 43.449
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMGGhq0f+002016
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMSHhq0f+002016
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMUAhq0f+002016
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMGGhq0f+001992
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMSHhq0f+001992
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMUAhq0f+001992
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMGGhq0f+002004
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMSHhq0f+002004
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMUAhq0f+002004
Zipping up the intermediate file: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_0487_1994050100_123_963_12180131_1_r249300447_83.zip
Uploading the intermediate file: upload_file_83.zip
  12:25:23 STEP 2017 H=2017:00 +CPU= 23.269
  12:25:47 STEP 2018 H=2018:00 +CPU= 23.917
  12:26:24 STEP 2019 H=2019:00 +CPU= 37.332
  12:26:48 STEP 2020 H=2020:00 +CPU= 23.877
  12:27:12 STEP 2021 H=2021:00 +CPU= 23.298
  12:27:50 STEP 2022 H=2022:00 +CPU= 38.196
  12:28:13 STEP 2023 H=2023:00 +CPU= 23.157
  12:28:37 STEP 2024 H=2024:00 +CPU= 23.733
  12:29:14 STEP 2025 H=2025:00 +CPU= 37.257
  12:29:38 STEP 2026 H=2026:00 +CPU= 23.667
  12:30:01 STEP 2027 H=2027:00 +CPU= 23.097
  12:30:42 STEP 2028 H=2028:00 +CPU= 41.402
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMGGhq0f+002028
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMSHhq0f+002028
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMUAhq0f+002028
  12:31:05 STEP 2029 H=2029:00 +CPU= 23.322
  12:31:30 STEP 2030 H=2030:00 +CPU= 24.126
  12:32:07 STEP 2031 H=2031:00 +CPU= 37.795
  12:32:31 STEP 2032 H=2032:00 +CPU= 24.011
  12:32:55 STEP 2033 H=2033:00 +CPU= 23.248
  12:33:33 STEP 2034 H=2034:00 +CPU= 38.714
  12:33:57 STEP 2035 H=2035:00 +CPU= 23.181
  12:34:21 STEP 2036 H=2036:00 +CPU= 24.196
  12:34:58 STEP 2037 H=2037:00 +CPU= 37.408
  12:35:22 STEP 2038 H=2038:00 +CPU= 23.998
  12:35:46 STEP 2039 H=2039:00 +CPU= 23.889
  12:36:30 STEP 2040 H=2040:00 +CPU= 43.525
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMGGhq0f+002040
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMSHhq0f+002040
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMUAhq0f+002040
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMGGhq0f+002016
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMSHhq0f+002016
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMUAhq0f+002016
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMGGhq0f+002028
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMSHhq0f+002028
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMUAhq0f+002028
Zipping up the intermediate file: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_0487_1994050100_123_963_12180131_1_r249300447_84.zip
Uploading the intermediate file: upload_file_84.zip
  12:36:53 STEP 2041 H=2041:00 +CPU= 22.945
  12:37:16 STEP 2042 H=2042:00 +CPU= 23.655
  12:37:54 STEP 2043 H=2043:00 +CPU= 37.316
  12:38:18 STEP 2044 H=2044:00 +CPU= 24.168
  12:38:41 STEP 2045 H=2045:00 +CPU= 23.127
  12:39:19 STEP 2046 H=2046:00 +CPU= 38.284
  12:39:42 STEP 2047 H=2047:00 +CPU= 23.107
  12:40:06 STEP 2048 H=2048:00 +CPU= 23.782
  12:40:43 STEP 2049 H=2049:00 +CPU= 37.500
  12:41:07 STEP 2050 H=2050:00 +CPU= 23.778
  12:41:30 STEP 2051 H=2051:00 +CPU= 22.961
  12:42:11 STEP 2052 H=2052:00 +CPU= 41.263
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMGGhq0f+002052
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMSHhq0f+002052
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMUAhq0f+002052
  12:42:35 STEP 2053 H=2053:00 +CPU= 23.506
  12:42:59 STEP 2054 H=2054:00 +CPU= 24.105
  12:43:37 STEP 2055 H=2055:00 +CPU= 37.546
  12:44:01 STEP 2056 H=2056:00 +CPU= 24.070
  12:44:24 STEP 2057 H=2057:00 +CPU= 23.381
  12:45:02 STEP 2058 H=2058:00 +CPU= 38.275
  12:45:25 STEP 2059 H=2059:00 +CPU= 22.921
  12:45:49 STEP 2060 H=2060:00 +CPU= 23.984
  12:46:27 STEP 2061 H=2061:00 +CPU= 37.263
  12:46:50 STEP 2062 H=2062:00 +CPU= 23.703
  12:47:14 STEP 2063 H=2063:00 +CPU= 23.492
  12:47:57 STEP 2064 H=2064:00 +CPU= 43.478
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMGGhq0f+002064
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMSHhq0f+002064
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMUAhq0f+002064
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMGGhq0f+002040
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMSHhq0f+002040
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMUAhq0f+002040
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMGGhq0f+002052
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMSHhq0f+002052
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMUAhq0f+002052
Zipping up the intermediate file: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_0487_1994050100_123_963_12180131_1_r249300447_85.zip
Uploading the intermediate file: upload_file_85.zip
  12:48:20 STEP 2065 H=2065:00 +CPU= 23.137
  12:48:44 STEP 2066 H=2066:00 +CPU= 23.608
  12:49:22 STEP 2067 H=2067:00 +CPU= 37.578
  12:49:46 STEP 2068 H=2068:00 +CPU= 23.900
  12:50:09 STEP 2069 H=2069:00 +CPU= 22.978
  12:50:47 STEP 2070 H=2070:00 +CPU= 38.253
  12:51:10 STEP 2071 H=2071:00 +CPU= 23.012
  12:51:33 STEP 2072 H=2072:00 +CPU= 23.690
  12:52:11 STEP 2073 H=2073:00 +CPU= 37.368
  12:52:35 STEP 2074 H=2074:00 +CPU= 23.703
  12:52:57 STEP 2075 H=2075:00 +CPU= 22.877
  12:53:39 STEP 2076 H=2076:00 +CPU= 41.338
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMGGhq0f+002076
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMSHhq0f+002076
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMUAhq0f+002076
  12:54:02 STEP 2077 H=2077:00 +CPU= 23.524
  12:54:26 STEP 2078 H=2078:00 +CPU= 23.936
  12:55:03 STEP 2079 H=2079:00 +CPU= 37.252
  12:55:27 STEP 2080 H=2080:00 +CPU= 23.971
  12:55:51 STEP 2081 H=2081:00 +CPU= 23.330
  12:56:30 STEP 2082 H=2082:00 +CPU= 38.741
  12:56:53 STEP 2083 H=2083:00 +CPU= 23.253
  12:57:17 STEP 2084 H=2084:00 +CPU= 23.877
  12:57:54 STEP 2085 H=2085:00 +CPU= 37.591
  12:58:18 STEP 2086 H=2086:00 +CPU= 23.730
  12:58:42 STEP 2087 H=2087:00 +CPU= 23.598
  12:59:25 STEP 2088 H=2088:00 +CPU= 43.492
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMGGhq0f+002088
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMSHhq0f+002088
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMUAhq0f+002088
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMGGhq0f+002064
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMSHhq0f+002064
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMUAhq0f+002064
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMGGhq0f+002076
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMSHhq0f+002076
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMUAhq0f+002076
Zipping up the intermediate file: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_0487_1994050100_123_963_12180131_1_r249300447_86.zip
Uploading the intermediate file: upload_file_86.zip
  12:59:48 STEP 2089 H=2089:00 +CPU= 23.062
  13:00:12 STEP 2090 H=2090:00 +CPU= 23.772
  13:00:50 STEP 2091 H=2091:00 +CPU= 38.262
  13:01:14 STEP 2092 H=2092:00 +CPU= 24.120
  13:01:37 STEP 2093 H=2093:00 +CPU= 23.153
  13:02:16 STEP 2094 H=2094:00 +CPU= 38.151
  13:02:39 STEP 2095 H=2095:00 +CPU= 23.052
  13:03:02 STEP 2096 H=2096:00 +CPU= 23.784
  13:03:40 STEP 2097 H=2097:00 +CPU= 37.499
  13:04:04 STEP 2098 H=2098:00 +CPU= 23.747
  13:04:27 STEP 2099 H=2099:00 +CPU= 23.137
  13:05:08 STEP 2100 H=2100:00 +CPU= 41.235
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMGGhq0f+002100
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMSHhq0f+002100
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMUAhq0f+002100
  13:05:32 STEP 2101 H=2101:00 +CPU= 23.578
  13:05:56 STEP 2102 H=2102:00 +CPU= 24.064
  13:06:33 STEP 2103 H=2103:00 +CPU= 37.475
  13:06:57 STEP 2104 H=2104:00 +CPU= 24.095
  13:07:21 STEP 2105 H=2105:00 +CPU= 23.223
  13:07:59 STEP 2106 H=2106:00 +CPU= 38.780
  13:08:22 STEP 2107 H=2107:00 +CPU= 22.970
  13:08:46 STEP 2108 H=2108:00 +CPU= 23.855
  13:09:24 STEP 2109 H=2109:00 +CPU= 37.461
  13:09:47 STEP 2110 H=2110:00 +CPU= 23.688
  13:10:11 STEP 2111 H=2111:00 +CPU= 23.724
  13:10:54 STEP 2112 H=2112:00 +CPU= 43.320
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMGGhq0f+002112
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMSHhq0f+002112
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMUAhq0f+002112
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMGGhq0f+002088
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMSHhq0f+002088
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMUAhq0f+002088
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMGGhq0f+002100
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMSHhq0f+002100
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMUAhq0f+002100
Zipping up the intermediate file: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_0487_1994050100_123_963_12180131_1_r249300447_87.zip
Uploading the intermediate file: upload_file_87.zip
  13:11:17 STEP 2113 H=2113:00 +CPU= 23.046
  13:11:41 STEP 2114 H=2114:00 +CPU= 24.083
  13:12:19 STEP 2115 H=2115:00 +CPU= 37.354
  13:12:43 STEP 2116 H=2116:00 +CPU= 23.962
  13:13:06 STEP 2117 H=2117:00 +CPU= 23.173
  13:13:44 STEP 2118 H=2118:00 +CPU= 38.238
  13:14:07 STEP 2119 H=2119:00 +CPU= 23.196
  13:14:31 STEP 2120 H=2120:00 +CPU= 23.957
  13:15:09 STEP 2121 H=2121:00 +CPU= 37.545
  13:15:33 STEP 2122 H=2122:00 +CPU= 23.964
  13:15:56 STEP 2123 H=2123:00 +CPU= 23.281
  13:16:38 STEP 2124 H=2124:00 +CPU= 41.412
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMGGhq0f+002124
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMSHhq0f+002124
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMUAhq0f+002124
  13:17:01 STEP 2125 H=2125:00 +CPU= 23.603
  13:17:26 STEP 2126 H=2126:00 +CPU= 24.347
  13:18:03 STEP 2127 H=2127:00 +CPU= 37.610
  13:18:27 STEP 2128 H=2128:00 +CPU= 23.923
  13:18:50 STEP 2129 H=2129:00 +CPU= 23.192
  13:19:29 STEP 2130 H=2130:00 +CPU= 38.816
  13:19:52 STEP 2131 H=2131:00 +CPU= 23.007
  13:20:16 STEP 2132 H=2132:00 +CPU= 23.812
  13:20:54 STEP 2133 H=2133:00 +CPU= 37.695
  13:21:17 STEP 2134 H=2134:00 +CPU= 23.725
  13:21:41 STEP 2135 H=2135:00 +CPU= 23.846
  13:22:25 STEP 2136 H=2136:00 +CPU= 43.519
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMGGhq0f+002136
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMSHhq0f+002136
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMUAhq0f+002136
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMGGhq0f+002112
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMSHhq0f+002112
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMUAhq0f+002112
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMGGhq0f+002124
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMSHhq0f+002124
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMUAhq0f+002124
Zipping up the intermediate file: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_0487_1994050100_123_963_12180131_1_r249300447_88.zip
Uploading the intermediate file: upload_file_88.zip
  13:22:48 STEP 2137 H=2137:00 +CPU= 23.046
  13:23:12 STEP 2138 H=2138:00 +CPU= 24.103
  13:23:49 STEP 2139 H=2139:00 +CPU= 37.535
  13:24:14 STEP 2140 H=2140:00 +CPU= 24.592
  13:24:39 STEP 2141 H=2141:00 +CPU= 24.822
  13:25:18 STEP 2142 H=2142:00 +CPU= 39.055
  13:25:41 STEP 2143 H=2143:00 +CPU= 23.063
  13:26:05 STEP 2144 H=2144:00 +CPU= 23.921
  13:26:43 STEP 2145 H=2145:00 +CPU= 37.680
  13:27:06 STEP 2146 H=2146:00 +CPU= 23.729
  13:27:29 STEP 2147 H=2147:00 +CPU= 23.110
  13:28:11 STEP 2148 H=2148:00 +CPU= 41.473
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMGGhq0f+002148
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMSHhq0f+002148
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMUAhq0f+002148
  13:28:34 STEP 2149 H=2149:00 +CPU= 23.270
  13:28:58 STEP 2150 H=2150:00 +CPU= 23.586
  13:29:35 STEP 2151 H=2151:00 +CPU= 37.484
  13:29:59 STEP 2152 H=2152:00 +CPU= 23.702
  13:30:22 STEP 2153 H=2153:00 +CPU= 22.958
  13:31:00 STEP 2154 H=2154:00 +CPU= 38.254
  13:31:23 STEP 2155 H=2155:00 +CPU= 22.930
  13:31:47 STEP 2156 H=2156:00 +CPU= 23.688
  13:32:24 STEP 2157 H=2157:00 +CPU= 37.368
  13:32:48 STEP 2158 H=2158:00 +CPU= 23.518
  13:33:11 STEP 2159 H=2159:00 +CPU= 23.507
  13:33:55 STEP 2160 H=2160:00 +CPU= 43.427
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMGGhq0f+002160
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMSHhq0f+002160
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMUAhq0f+002160
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMGGhq0f+002136
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMSHhq0f+002136
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMUAhq0f+002136
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMGGhq0f+002148
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMSHhq0f+002148
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMUAhq0f+002148
Zipping up the intermediate file: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_0487_1994050100_123_963_12180131_1_r249300447_89.zip
Uploading the intermediate file: upload_file_89.zip
  13:34:18 STEP 2161 H=2161:00 +CPU= 23.429
Uploading trickle at timestep: 7776000
  13:34:42 STEP 2162 H=2162:00 +CPU= 23.723
  13:35:19 STEP 2163 H=2163:00 +CPU= 37.385
  13:35:43 STEP 2164 H=2164:00 +CPU= 23.857
  13:36:06 STEP 2165 H=2165:00 +CPU= 23.197
  13:36:44 STEP 2166 H=2166:00 +CPU= 38.286
  13:37:08 STEP 2167 H=2167:00 +CPU= 23.111
  13:37:31 STEP 2168 H=2168:00 +CPU= 23.858
  13:38:09 STEP 2169 H=2169:00 +CPU= 37.547
  13:38:33 STEP 2170 H=2170:00 +CPU= 23.817
  13:38:56 STEP 2171 H=2171:00 +CPU= 23.174
  13:39:37 STEP 2172 H=2172:00 +CPU= 41.286
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMGGhq0f+002172
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMSHhq0f+002172
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMUAhq0f+002172
  13:40:01 STEP 2173 H=2173:00 +CPU= 23.509
  13:40:25 STEP 2174 H=2174:00 +CPU= 23.748
  13:41:02 STEP 2175 H=2175:00 +CPU= 37.586
  13:41:26 STEP 2176 H=2176:00 +CPU= 24.010
  13:41:49 STEP 2177 H=2177:00 +CPU= 22.598
  13:42:28 STEP 2178 H=2178:00 +CPU= 39.159
  13:42:52 STEP 2179 H=2179:00 +CPU= 23.677
  13:43:16 STEP 2180 H=2180:00 +CPU= 24.453
  13:43:54 STEP 2181 H=2181:00 +CPU= 38.113
  13:44:18 STEP 2182 H=2182:00 +CPU= 24.262
  13:44:43 STEP 2183 H=2183:00 +CPU= 24.461
  13:45:27 STEP 2184 H=2184:00 +CPU= 44.234
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMGGhq0f+002184
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMSHhq0f+002184
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMUAhq0f+002184
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMGGhq0f+002160
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMSHhq0f+002160
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMUAhq0f+002160
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMGGhq0f+002172
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMSHhq0f+002172
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMUAhq0f+002172
Zipping up the intermediate file: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_0487_1994050100_123_963_12180131_1_r249300447_90.zip
Uploading the intermediate file: upload_file_90.zip
  13:45:50 STEP 2185 H=2185:00 +CPU= 23.131
  13:46:14 STEP 2186 H=2186:00 +CPU= 24.133
  13:46:52 STEP 2187 H=2187:00 +CPU= 38.053
  13:47:17 STEP 2188 H=2188:00 +CPU= 24.235
  13:47:40 STEP 2189 H=2189:00 +CPU= 23.577
  13:48:19 STEP 2190 H=2190:00 +CPU= 38.995
  13:48:44 STEP 2191 H=2191:00 +CPU= 24.421
  13:49:08 STEP 2192 H=2192:00 +CPU= 24.363
  13:49:46 STEP 2193 H=2193:00 +CPU= 38.427
  13:50:11 STEP 2194 H=2194:00 +CPU= 24.409
  13:50:34 STEP 2195 H=2195:00 +CPU= 23.237
  13:51:16 STEP 2196 H=2196:00 +CPU= 41.979
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMGGhq0f+002196
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMSHhq0f+002196
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMUAhq0f+002196
  13:51:39 STEP 2197 H=2197:00 +CPU= 23.329
  13:52:03 STEP 2198 H=2198:00 +CPU= 23.281
  13:52:40 STEP 2199 H=2199:00 +CPU= 36.836
  13:53:03 STEP 2200 H=2200:00 +CPU= 23.038
  13:53:25 STEP 2201 H=2201:00 +CPU= 22.535
  13:54:03 STEP 2202 H=2202:00 +CPU= 37.704
  13:54:25 STEP 2203 H=2203:00 +CPU= 22.393
  13:54:48 STEP 2204 H=2204:00 +CPU= 23.224
  13:55:25 STEP 2205 H=2205:00 +CPU= 36.907
  13:55:48 STEP 2206 H=2206:00 +CPU= 23.161
  13:56:12 STEP 2207 H=2207:00 +CPU= 23.180
  13:56:54 STEP 2208 H=2208:00 +CPU= 42.533
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMGGhq0f+002208
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMSHhq0f+002208
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMUAhq0f+002208
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMGGhq0f+002184
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMSHhq0f+002184
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMUAhq0f+002184
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMGGhq0f+002196
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMSHhq0f+002196
Adding to the zip: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_12180131/ICMUAhq0f+002196
Zipping up the intermediate file: /mnt/boinc/data0/projects/climateprediction.net/oifs_43r3_ps_0487_1994050100_123_963_12180131_1_r249300447_91.zip
Uploading the intermediate file: upload_file_91.zip
  13:57:17 STEP 2209 H=2209:00 +CPU= 22.502
  13:57:40 STEP 2210 H=2210:00 +CPU= 23.194
  13:58:16 STEP 2211 H=2211:00 +CPU= 36.544
  13:58:40 STEP 2212 H=2212:00 +CPU= 23.222
  13:59:02 STEP 2213 H=2213:00 +CPU= 22.671
  13:59:40 STEP 2214 H=2214:00 +CPU= 37.478
  14:00:02 STEP 2215 H=2215:00 +CPU= 22.605
  14:00:26 STEP 2216 H=2216:00 +CPU= 23.286
  14:01:02 STEP 2217 H=2217:00 +CPU= 36.492
  14:01:25 STEP 2218 H=2218:00 +CPU= 23.136
  14:01:48 STEP 2219 H=2219:00 +CPU= 22.465
  14:02:28 STEP 2220 H=2220:00 +CPU= 40.111
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMGGhq0f+002220
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMSHhq0f+002220
Moving to projects directory: /mnt/boinc/data0/slots/3/ICMUAhq0f+002220
  14:02:50 STEP 2221 H=2221:00 +CPU= 22.406
  14:03:13 STEP 2222 H=2222:00 +CPU= 23.105
  14:03:50 STEP 2223 H=2223:00 +CPU= 36.729
Suspend request received from the BOINC client, suspending the child process
double free or corruption (out)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:41:11 1462795 22303257 oifs_43r3_ps_0487_1994050100_123_963_12180131_1 7,776,000 61,482 0.0079
09 May 2023 16:41:04 1462795 22303257 oifs_43r3_ps_0487_1994050100_123_963_12180131_1 6,912,000 54,585 0.0079
09 May 2023 16:40:57 1462795 22303257 oifs_43r3_ps_0487_1994050100_123_963_12180131_1 6,048,000 47,738 0.0079
09 May 2023 16:40:51 1462795 22303257 oifs_43r3_ps_0487_1994050100_123_963_12180131_1 5,184,000 40,912 0.0079
09 May 2023 16:40:51 1462795 22303257 oifs_43r3_ps_0487_1994050100_123_963_12180131_1 5,184,000 40,912 0.0079
09 May 2023 16:40:45 1462795 22303257 oifs_43r3_ps_0487_1994050100_123_963_12180131_1 4,320,000 34,075 0.0079
09 May 2023 16:40:45 1462795 22303257 oifs_43r3_ps_0487_1994050100_123_963_12180131_1 4,320,000 34,075 0.0079
09 May 2023 16:40:30 1462795 22303257 oifs_43r3_ps_0487_1994050100_123_963_12180131_1 3,456,000 27,280 0.0079
09 May 2023 16:40:25 1462795 22303257 oifs_43r3_ps_0487_1994050100_123_963_12180131_1 2,592,000 20,473 0.0079
09 May 2023 16:40:19 1462795 22303257 oifs_43r3_ps_0487_1994050100_123_963_12180131_1 1,728,000 13,626 0.0079
09 May 2023 16:40:19 1462795 22303257 oifs_43r3_ps_0487_1994050100_123_963_12180131_1 1,728,000 13,626 0.0079
09 May 2023 16:40:17 1462795 22303257 oifs_43r3_ps_0487_1994050100_123_963_12180131_1 864,000 6,761 0.0078


©2024 cpdn.org