climateprediction.net home page
Task 22253774

Task 22253774

Name oifs_43r3_ps_0837_1983050100_123_952_12169481_0
Workunit 12169481
Created 21 Dec 2022, 1:49:02 UTC
Sent 4 Jan 2023, 15:54:05 UTC
Report deadline 3 Feb 2023, 15:54:05 UTC
Received 9 Jan 2023, 7:04:23 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 1 (0x00000001) Unknown error code
Computer ID 1498859
Run time 19 hours 50 min 22 sec
CPU time 18 hours 41 min 22 sec
Validate state Invalid
Credit 10,523.52
Device peak FLOPS 3.97 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,344.43 MB
Peak swap size 4,978.08 MB
Peak disk usage 4,371.92 MB
Stderr
<core_client_version>7.18.1</core_client_version>
<![CDATA[
<message>
process exited with code 1 (0x1, -255)</message>
<stderr_txt>
STEP 1551 H=1551:00 +CPU= 40.531
  03:21:25 STEP 1552 H=1552:00 +CPU= 25.163
  03:21:50 STEP 1553 H=1553:00 +CPU= 24.852
  03:22:31 STEP 1554 H=1554:00 +CPU= 41.247
  03:22:56 STEP 1555 H=1555:00 +CPU= 24.896
  03:23:22 STEP 1556 H=1556:00 +CPU= 25.600
  03:24:02 STEP 1557 H=1557:00 +CPU= 40.436
  03:24:28 STEP 1558 H=1558:00 +CPU= 25.429
  03:24:54 STEP 1559 H=1559:00 +CPU= 25.738
  03:25:41 STEP 1560 H=1560:00 +CPU= 47.150
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001560
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001560
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001560
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMGGhq0f+001536
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMSHhq0f+001536
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMUAhq0f+001536
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMGGhq0f+001548
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMSHhq0f+001548
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMUAhq0f+001548
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0837_1983050100_123_952_12169481_0_r1393861530_64.zip
Uploading the intermediate file: upload_file_64.zip
  03:26:05 STEP 1561 H=1561:00 +CPU= 24.536
  03:26:31 STEP 1562 H=1562:00 +CPU= 25.253
  03:27:12 STEP 1563 H=1563:00 +CPU= 41.157
  03:27:40 STEP 1564 H=1564:00 +CPU= 28.582
  03:28:08 STEP 1565 H=1565:00 +CPU= 27.209
  03:28:51 STEP 1566 H=1566:00 +CPU= 43.831
  03:29:18 STEP 1567 H=1567:00 +CPU= 26.345
  03:29:45 STEP 1568 H=1568:00 +CPU= 27.133
  03:30:28 STEP 1569 H=1569:00 +CPU= 43.431
  03:30:53 STEP 1570 H=1570:00 +CPU= 25.053
  03:31:18 STEP 1571 H=1571:00 +CPU= 24.935
  03:32:03 STEP 1572 H=1572:00 +CPU= 44.642
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001572
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001572
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001572
  03:32:29 STEP 1573 H=1573:00 +CPU= 25.563
  03:32:55 STEP 1574 H=1574:00 +CPU= 26.373
  03:33:36 STEP 1575 H=1575:00 +CPU= 40.669
  03:34:02 STEP 1576 H=1576:00 +CPU= 25.983
  03:34:27 STEP 1577 H=1577:00 +CPU= 24.941
  03:35:08 STEP 1578 H=1578:00 +CPU= 40.900
  03:35:32 STEP 1579 H=1579:00 +CPU= 24.718
  03:35:58 STEP 1580 H=1580:00 +CPU= 25.470
  03:36:38 STEP 1581 H=1581:00 +CPU= 40.246
  03:37:03 STEP 1582 H=1582:00 +CPU= 25.248
  03:37:29 STEP 1583 H=1583:00 +CPU= 25.366
  03:38:17 STEP 1584 H=1584:00 +CPU= 47.941
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001584
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001584
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001584
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMGGhq0f+001560
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMSHhq0f+001560
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMUAhq0f+001560
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMGGhq0f+001572
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMSHhq0f+001572
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMUAhq0f+001572
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0837_1983050100_123_952_12169481_0_r1393861530_65.zip
Uploading the intermediate file: upload_file_65.zip
  03:38:42 STEP 1585 H=1585:00 +CPU= 25.238
  03:39:08 STEP 1586 H=1586:00 +CPU= 25.752
  03:39:49 STEP 1587 H=1587:00 +CPU= 40.979
  03:40:14 STEP 1588 H=1588:00 +CPU= 25.104
  03:40:39 STEP 1589 H=1589:00 +CPU= 24.839
  03:41:19 STEP 1590 H=1590:00 +CPU= 40.752
  03:41:44 STEP 1591 H=1591:00 +CPU= 24.656
  03:42:09 STEP 1592 H=1592:00 +CPU= 25.282
  03:42:50 STEP 1593 H=1593:00 +CPU= 40.152
  03:43:15 STEP 1594 H=1594:00 +CPU= 25.266
  03:43:40 STEP 1595 H=1595:00 +CPU= 24.726
  03:44:24 STEP 1596 H=1596:00 +CPU= 44.438
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001596
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001596
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001596
  03:44:49 STEP 1597 H=1597:00 +CPU= 24.598
  03:45:14 STEP 1598 H=1598:00 +CPU= 25.215
  03:45:54 STEP 1599 H=1599:00 +CPU= 40.245
  03:46:20 STEP 1600 H=1600:00 +CPU= 25.390
  03:46:45 STEP 1601 H=1601:00 +CPU= 25.066
  03:47:25 STEP 1602 H=1602:00 +CPU= 40.655
  03:47:50 STEP 1603 H=1603:00 +CPU= 24.724
  03:48:15 STEP 1604 H=1604:00 +CPU= 25.203
  03:48:56 STEP 1605 H=1605:00 +CPU= 40.234
  03:49:21 STEP 1606 H=1606:00 +CPU= 25.335
  03:49:46 STEP 1607 H=1607:00 +CPU= 25.433
  03:50:33 STEP 1608 H=1608:00 +CPU= 47.107
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001608
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001608
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001608
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMGGhq0f+001584
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMSHhq0f+001584
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMUAhq0f+001584
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMGGhq0f+001596
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMSHhq0f+001596
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMUAhq0f+001596
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0837_1983050100_123_952_12169481_0_r1393861530_66.zip
Uploading the intermediate file: upload_file_66.zip
  03:50:58 STEP 1609 H=1609:00 +CPU= 24.783
Uploading trickle at timestep: 5788800
  03:51:24 STEP 1610 H=1610:00 +CPU= 25.255
  03:52:04 STEP 1611 H=1611:00 +CPU= 40.705
  03:52:29 STEP 1612 H=1612:00 +CPU= 25.114
  03:52:54 STEP 1613 H=1613:00 +CPU= 24.665
  03:53:35 STEP 1614 H=1614:00 +CPU= 40.989
  03:54:00 STEP 1615 H=1615:00 +CPU= 24.687
  03:54:26 STEP 1616 H=1616:00 +CPU= 26.224
  03:55:07 STEP 1617 H=1617:00 +CPU= 40.486
  03:55:32 STEP 1618 H=1618:00 +CPU= 25.446
  03:55:57 STEP 1619 H=1619:00 +CPU= 24.813
  03:56:41 STEP 1620 H=1620:00 +CPU= 44.245
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001620
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001620
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001620
  03:57:06 STEP 1621 H=1621:00 +CPU= 24.687
  03:57:31 STEP 1622 H=1622:00 +CPU= 25.160
  03:58:11 STEP 1623 H=1623:00 +CPU= 40.153
  03:58:36 STEP 1624 H=1624:00 +CPU= 25.298
  03:59:01 STEP 1625 H=1625:00 +CPU= 24.780
  03:59:43 STEP 1626 H=1626:00 +CPU= 41.555
  04:00:08 STEP 1627 H=1627:00 +CPU= 24.911
  04:00:33 STEP 1628 H=1628:00 +CPU= 25.374
  04:01:13 STEP 1629 H=1629:00 +CPU= 40.174
  04:01:39 STEP 1630 H=1630:00 +CPU= 25.442
  04:02:04 STEP 1631 H=1631:00 +CPU= 25.441
  04:02:52 STEP 1632 H=1632:00 +CPU= 47.422
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001632
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001632
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001632
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMGGhq0f+001608
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMSHhq0f+001608
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMUAhq0f+001608
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMGGhq0f+001620
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMSHhq0f+001620
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMUAhq0f+001620
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0837_1983050100_123_952_12169481_0_r1393861530_67.zip
Uploading the intermediate file: upload_file_67.zip
  04:03:17 STEP 1633 H=1633:00 +CPU= 25.025
  04:03:43 STEP 1634 H=1634:00 +CPU= 26.717
  04:04:24 STEP 1635 H=1635:00 +CPU= 40.296
  04:04:49 STEP 1636 H=1636:00 +CPU= 25.279
  04:05:14 STEP 1637 H=1637:00 +CPU= 24.620
  04:05:55 STEP 1638 H=1638:00 +CPU= 41.214
  04:06:20 STEP 1639 H=1639:00 +CPU= 25.115
  04:06:45 STEP 1640 H=1640:00 +CPU= 25.254
  04:07:25 STEP 1641 H=1641:00 +CPU= 40.073
  04:07:51 STEP 1642 H=1642:00 +CPU= 25.530
  04:08:16 STEP 1643 H=1643:00 +CPU= 24.621
  04:09:00 STEP 1644 H=1644:00 +CPU= 44.492
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001644
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001644
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001644
  04:09:25 STEP 1645 H=1645:00 +CPU= 24.811
  04:09:50 STEP 1646 H=1646:00 +CPU= 25.472
  04:10:31 STEP 1647 H=1647:00 +CPU= 40.252
  04:10:56 STEP 1648 H=1648:00 +CPU= 25.274
  04:11:21 STEP 1649 H=1649:00 +CPU= 24.749
  04:12:02 STEP 1650 H=1650:00 +CPU= 40.996
  04:12:26 STEP 1651 H=1651:00 +CPU= 24.689
  04:12:52 STEP 1652 H=1652:00 +CPU= 25.061
  04:13:31 STEP 1653 H=1653:00 +CPU= 39.984
  04:13:57 STEP 1654 H=1654:00 +CPU= 25.337
  04:14:22 STEP 1655 H=1655:00 +CPU= 25.515
  04:15:10 STEP 1656 H=1656:00 +CPU= 47.132
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001656
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001656
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMGGhq0f+001632
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMSHhq0f+001632
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMUAhq0f+001632
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMGGhq0f+001644
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMSHhq0f+001644
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMUAhq0f+001644
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0837_1983050100_123_952_12169481_0_r1393861530_68.zip
Uploading the intermediate file: upload_file_68.zip
  04:15:34 STEP 1657 H=1657:00 +CPU= 24.798
  04:16:00 STEP 1658 H=1658:00 +CPU= 25.405
  04:16:40 STEP 1659 H=1659:00 +CPU= 40.651
  04:17:06 STEP 1660 H=1660:00 +CPU= 25.313
  04:17:31 STEP 1661 H=1661:00 +CPU= 24.878
  04:18:12 STEP 1662 H=1662:00 +CPU= 41.196
  04:18:37 STEP 1663 H=1663:00 +CPU= 25.141
  04:19:03 STEP 1664 H=1664:00 +CPU= 25.646
  04:19:43 STEP 1665 H=1665:00 +CPU= 40.541
  04:20:09 STEP 1666 H=1666:00 +CPU= 25.379
  04:20:33 STEP 1667 H=1667:00 +CPU= 24.769
  04:21:19 STEP 1668 H=1668:00 +CPU= 45.659
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001668
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001668
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001668
  04:21:44 STEP 1669 H=1669:00 +CPU= 25.141
  04:22:10 STEP 1670 H=1670:00 +CPU= 25.387
  04:22:50 STEP 1671 H=1671:00 +CPU= 40.398
  04:23:15 STEP 1672 H=1672:00 +CPU= 25.292
  04:23:40 STEP 1673 H=1673:00 +CPU= 24.716
  04:24:21 STEP 1674 H=1674:00 +CPU= 41.000
  04:24:46 STEP 1675 H=1675:00 +CPU= 24.675
  04:25:11 STEP 1676 H=1676:00 +CPU= 25.369
  04:25:52 STEP 1677 H=1677:00 +CPU= 40.550
  04:26:17 STEP 1678 H=1678:00 +CPU= 25.579
  04:26:43 STEP 1679 H=1679:00 +CPU= 25.374
  04:27:30 STEP 1680 H=1680:00 +CPU= 47.189
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001680
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001680
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001680
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMGGhq0f+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMSHhq0f+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMUAhq0f+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMGGhq0f+001668
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMSHhq0f+001668
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMUAhq0f+001668
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0837_1983050100_123_952_12169481_0_r1393861530_69.zip
Uploading the intermediate file: upload_file_69.zip
  04:27:55 STEP 1681 H=1681:00 +CPU= 24.759
  04:28:20 STEP 1682 H=1682:00 +CPU= 25.223
  04:29:00 STEP 1683 H=1683:00 +CPU= 40.070
  04:29:25 STEP 1684 H=1684:00 +CPU= 25.165
  04:29:50 STEP 1685 H=1685:00 +CPU= 24.757
  04:30:31 STEP 1686 H=1686:00 +CPU= 41.131
  04:30:56 STEP 1687 H=1687:00 +CPU= 25.056
  04:31:22 STEP 1688 H=1688:00 +CPU= 25.405
  04:32:02 STEP 1689 H=1689:00 +CPU= 40.453
  04:32:27 STEP 1690 H=1690:00 +CPU= 25.388
  04:32:52 STEP 1691 H=1691:00 +CPU= 24.879
  04:33:37 STEP 1692 H=1692:00 +CPU= 44.465
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001692
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001692
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001692
  04:34:03 STEP 1693 H=1693:00 +CPU= 26.028
  04:34:29 STEP 1694 H=1694:00 +CPU= 25.649
  04:35:09 STEP 1695 H=1695:00 +CPU= 40.588
  04:35:35 STEP 1696 H=1696:00 +CPU= 25.523
  04:35:59 STEP 1697 H=1697:00 +CPU= 24.780
  04:36:40 STEP 1698 H=1698:00 +CPU= 40.679
  04:37:05 STEP 1699 H=1699:00 +CPU= 24.554
  04:37:30 STEP 1700 H=1700:00 +CPU= 25.299
  04:38:11 STEP 1701 H=1701:00 +CPU= 40.516
  04:38:36 STEP 1702 H=1702:00 +CPU= 25.340
  04:39:03 STEP 1703 H=1703:00 +CPU= 26.793
  04:39:51 STEP 1704 H=1704:00 +CPU= 48.369
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001704
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001704
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMGGhq0f+001680
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMSHhq0f+001680
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMUAhq0f+001680
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMGGhq0f+001692
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMSHhq0f+001692
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMUAhq0f+001692
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0837_1983050100_123_952_12169481_0_r1393861530_70.zip
Uploading the intermediate file: upload_file_70.zip
  04:40:16 STEP 1705 H=1705:00 +CPU= 25.160
  04:40:42 STEP 1706 H=1706:00 +CPU= 26.047
  04:41:23 STEP 1707 H=1707:00 +CPU= 40.702
  04:41:48 STEP 1708 H=1708:00 +CPU= 25.254
  04:42:13 STEP 1709 H=1709:00 +CPU= 24.657
  04:42:54 STEP 1710 H=1710:00 +CPU= 40.886
  04:43:19 STEP 1711 H=1711:00 +CPU= 25.029
  04:43:44 STEP 1712 H=1712:00 +CPU= 25.368
  04:44:25 STEP 1713 H=1713:00 +CPU= 40.256
  04:44:50 STEP 1714 H=1714:00 +CPU= 25.239
  04:45:14 STEP 1715 H=1715:00 +CPU= 24.685
  04:45:59 STEP 1716 H=1716:00 +CPU= 44.943
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001716
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001716
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001716
  04:46:24 STEP 1717 H=1717:00 +CPU= 24.609
  04:46:49 STEP 1718 H=1718:00 +CPU= 25.291
  04:47:30 STEP 1719 H=1719:00 +CPU= 40.312
  04:47:55 STEP 1720 H=1720:00 +CPU= 25.394
  04:48:20 STEP 1721 H=1721:00 +CPU= 24.830
  04:49:01 STEP 1722 H=1722:00 +CPU= 40.876
  04:49:26 STEP 1723 H=1723:00 +CPU= 24.719
  04:49:51 STEP 1724 H=1724:00 +CPU= 25.265
  04:50:31 STEP 1725 H=1725:00 +CPU= 40.318
  04:50:56 STEP 1726 H=1726:00 +CPU= 25.235
  04:51:22 STEP 1727 H=1727:00 +CPU= 25.401
  04:52:09 STEP 1728 H=1728:00 +CPU= 47.058
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001728
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001728
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMGGhq0f+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMSHhq0f+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMUAhq0f+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMGGhq0f+001716
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMSHhq0f+001716
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMUAhq0f+001716
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0837_1983050100_123_952_12169481_0_r1393861530_71.zip
Uploading the intermediate file: upload_file_71.zip
  04:52:34 STEP 1729 H=1729:00 +CPU= 25.040
  04:53:00 STEP 1730 H=1730:00 +CPU= 25.832
  04:53:40 STEP 1731 H=1731:00 +CPU= 40.256
  04:54:05 STEP 1732 H=1732:00 +CPU= 25.362
  04:54:30 STEP 1733 H=1733:00 +CPU= 24.619
  04:55:11 STEP 1734 H=1734:00 +CPU= 41.000
  04:55:36 STEP 1735 H=1735:00 +CPU= 24.862
  04:56:01 STEP 1736 H=1736:00 +CPU= 25.461
  04:56:42 STEP 1737 H=1737:00 +CPU= 40.372
  04:57:07 STEP 1738 H=1738:00 +CPU= 25.207
  04:57:32 STEP 1739 H=1739:00 +CPU= 24.823
  04:58:16 STEP 1740 H=1740:00 +CPU= 44.414
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001740
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001740
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001740
  04:58:41 STEP 1741 H=1741:00 +CPU= 24.914
  04:59:07 STEP 1742 H=1742:00 +CPU= 25.753
  04:59:47 STEP 1743 H=1743:00 +CPU= 40.252
  05:00:13 STEP 1744 H=1744:00 +CPU= 25.454
  05:00:37 STEP 1745 H=1745:00 +CPU= 24.677
  05:01:18 STEP 1746 H=1746:00 +CPU= 40.977
  05:01:43 STEP 1747 H=1747:00 +CPU= 24.732
  05:02:08 STEP 1748 H=1748:00 +CPU= 25.343
  05:02:49 STEP 1749 H=1749:00 +CPU= 40.395
  05:03:14 STEP 1750 H=1750:00 +CPU= 25.607
  05:03:40 STEP 1751 H=1751:00 +CPU= 25.479
  05:04:28 STEP 1752 H=1752:00 +CPU= 48.403
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001752
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001752
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMGGhq0f+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMSHhq0f+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMUAhq0f+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMGGhq0f+001740
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMSHhq0f+001740
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMUAhq0f+001740
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0837_1983050100_123_952_12169481_0_r1393861530_72.zip
Uploading the intermediate file: upload_file_72.zip
  05:04:53 STEP 1753 H=1753:00 +CPU= 24.890
  05:05:19 STEP 1754 H=1754:00 +CPU= 25.407
  05:05:59 STEP 1755 H=1755:00 +CPU= 40.163
  05:06:24 STEP 1756 H=1756:00 +CPU= 25.182
  05:06:49 STEP 1757 H=1757:00 +CPU= 24.693
  05:07:29 STEP 1758 H=1758:00 +CPU= 40.714
  05:07:54 STEP 1759 H=1759:00 +CPU= 24.748
  05:08:19 STEP 1760 H=1760:00 +CPU= 25.213
  05:09:00 STEP 1761 H=1761:00 +CPU= 40.130
  05:09:25 STEP 1762 H=1762:00 +CPU= 25.498
  05:09:50 STEP 1763 H=1763:00 +CPU= 24.657
  05:10:34 STEP 1764 H=1764:00 +CPU= 44.561
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001764
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001764
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001764
  05:10:59 STEP 1765 H=1765:00 +CPU= 24.625
  05:11:24 STEP 1766 H=1766:00 +CPU= 25.444
  05:12:05 STEP 1767 H=1767:00 +CPU= 40.307
  05:12:30 STEP 1768 H=1768:00 +CPU= 25.525
  05:12:55 STEP 1769 H=1769:00 +CPU= 24.643
  05:13:36 STEP 1770 H=1770:00 +CPU= 41.033
  05:14:01 STEP 1771 H=1771:00 +CPU= 24.702
  05:14:26 STEP 1772 H=1772:00 +CPU= 25.228
  05:15:06 STEP 1773 H=1773:00 +CPU= 40.393
  05:15:32 STEP 1774 H=1774:00 +CPU= 25.339
  05:15:57 STEP 1775 H=1775:00 +CPU= 24.991
  05:16:44 STEP 1776 H=1776:00 +CPU= 47.127
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001776
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001776
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMGGhq0f+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMSHhq0f+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMUAhq0f+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMGGhq0f+001764
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMSHhq0f+001764
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMUAhq0f+001764
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0837_1983050100_123_952_12169481_0_r1393861530_73.zip
Uploading the intermediate file: upload_file_73.zip
  05:17:08 STEP 1777 H=1777:00 +CPU= 24.552
  05:17:34 STEP 1778 H=1778:00 +CPU= 25.165
  05:18:14 STEP 1779 H=1779:00 +CPU= 40.293
  05:18:39 STEP 1780 H=1780:00 +CPU= 25.291
  05:19:04 STEP 1781 H=1781:00 +CPU= 25.161
  05:19:46 STEP 1782 H=1782:00 +CPU= 41.165
  05:20:10 STEP 1783 H=1783:00 +CPU= 24.817
  05:20:36 STEP 1784 H=1784:00 +CPU= 25.428
  05:21:16 STEP 1785 H=1785:00 +CPU= 40.497
  05:21:43 STEP 1786 H=1786:00 +CPU= 26.245
  05:22:08 STEP 1787 H=1787:00 +CPU= 25.211
  05:22:52 STEP 1788 H=1788:00 +CPU= 44.561
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001788
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001788
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001788
  05:23:17 STEP 1789 H=1789:00 +CPU= 24.927
  05:23:43 STEP 1790 H=1790:00 +CPU= 25.388
  05:24:23 STEP 1791 H=1791:00 +CPU= 40.501
  05:24:48 STEP 1792 H=1792:00 +CPU= 25.098
  05:25:13 STEP 1793 H=1793:00 +CPU= 24.882
  05:25:55 STEP 1794 H=1794:00 +CPU= 41.314
  05:26:19 STEP 1795 H=1795:00 +CPU= 24.861
  05:26:45 STEP 1796 H=1796:00 +CPU= 25.319
  05:27:25 STEP 1797 H=1797:00 +CPU= 40.270
  05:27:50 STEP 1798 H=1798:00 +CPU= 25.344
  05:28:15 STEP 1799 H=1799:00 +CPU= 25.141
  05:29:03 STEP 1800 H=1800:00 +CPU= 47.391
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001800
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001800
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMGGhq0f+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMSHhq0f+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMUAhq0f+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMGGhq0f+001788
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMSHhq0f+001788
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMUAhq0f+001788
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0837_1983050100_123_952_12169481_0_r1393861530_74.zip
Uploading the intermediate file: upload_file_74.zip
  05:29:28 STEP 1801 H=1801:00 +CPU= 24.892
  05:29:53 STEP 1802 H=1802:00 +CPU= 25.214
  05:30:34 STEP 1803 H=1803:00 +CPU= 40.534
  05:30:59 STEP 1804 H=1804:00 +CPU= 25.386
  05:31:24 STEP 1805 H=1805:00 +CPU= 24.825
  05:32:05 STEP 1806 H=1806:00 +CPU= 40.975
  05:32:30 STEP 1807 H=1807:00 +CPU= 24.778
  05:32:55 STEP 1808 H=1808:00 +CPU= 25.414
  05:33:35 STEP 1809 H=1809:00 +CPU= 40.312
  05:34:01 STEP 1810 H=1810:00 +CPU= 25.299
  05:34:26 STEP 1811 H=1811:00 +CPU= 25.349
  05:35:11 STEP 1812 H=1812:00 +CPU= 44.599
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001812
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001812
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001812
  05:35:35 STEP 1813 H=1813:00 +CPU= 24.651
  05:36:01 STEP 1814 H=1814:00 +CPU= 25.209
  05:36:41 STEP 1815 H=1815:00 +CPU= 40.414
  05:37:06 STEP 1816 H=1816:00 +CPU= 25.464
  05:37:31 STEP 1817 H=1817:00 +CPU= 24.877
  05:38:13 STEP 1818 H=1818:00 +CPU= 41.441
  05:38:37 STEP 1819 H=1819:00 +CPU= 24.701
  05:39:03 STEP 1820 H=1820:00 +CPU= 25.451
  05:39:43 STEP 1821 H=1821:00 +CPU= 40.331
  05:40:09 STEP 1822 H=1822:00 +CPU= 25.889
  05:40:35 STEP 1823 H=1823:00 +CPU= 26.207
  05:41:24 STEP 1824 H=1824:00 +CPU= 48.109
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001824
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001824
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMGGhq0f+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMSHhq0f+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMUAhq0f+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMGGhq0f+001812
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMSHhq0f+001812
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMUAhq0f+001812
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0837_1983050100_123_952_12169481_0_r1393861530_75.zip
Uploading the intermediate file: upload_file_75.zip
  05:41:49 STEP 1825 H=1825:00 +CPU= 25.312
  05:42:14 STEP 1826 H=1826:00 +CPU= 25.341
  05:42:55 STEP 1827 H=1827:00 +CPU= 40.412
  05:43:20 STEP 1828 H=1828:00 +CPU= 25.429
  05:43:45 STEP 1829 H=1829:00 +CPU= 24.738
  05:44:26 STEP 1830 H=1830:00 +CPU= 41.077
  05:44:51 STEP 1831 H=1831:00 +CPU= 24.612
  05:45:16 STEP 1832 H=1832:00 +CPU= 25.518
  05:45:57 STEP 1833 H=1833:00 +CPU= 40.577
  05:46:22 STEP 1834 H=1834:00 +CPU= 25.192
  05:46:46 STEP 1835 H=1835:00 +CPU= 24.398
  05:47:31 STEP 1836 H=1836:00 +CPU= 44.360
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001836
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001836
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001836
  05:47:55 STEP 1837 H=1837:00 +CPU= 24.680
  05:48:21 STEP 1838 H=1838:00 +CPU= 25.582
  05:49:01 STEP 1839 H=1839:00 +CPU= 40.467
  05:49:27 STEP 1840 H=1840:00 +CPU= 25.501
  05:49:51 STEP 1841 H=1841:00 +CPU= 24.483
  05:50:33 STEP 1842 H=1842:00 +CPU= 41.263
  05:50:57 STEP 1843 H=1843:00 +CPU= 24.651
  05:51:22 STEP 1844 H=1844:00 +CPU= 25.051
  05:52:02 STEP 1845 H=1845:00 +CPU= 40.041
  05:52:28 STEP 1846 H=1846:00 +CPU= 25.416
  05:52:53 STEP 1847 H=1847:00 +CPU= 25.347
  05:53:41 STEP 1848 H=1848:00 +CPU= 47.373
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001848
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001848
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMGGhq0f+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMSHhq0f+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMUAhq0f+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMGGhq0f+001836
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMSHhq0f+001836
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMUAhq0f+001836
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0837_1983050100_123_952_12169481_0_r1393861530_76.zip
Uploading the intermediate file: upload_file_76.zip
  05:54:05 STEP 1849 H=1849:00 +CPU= 24.678
Uploading trickle at timestep: 6652800
  05:54:31 STEP 1850 H=1850:00 +CPU= 25.521
  05:55:11 STEP 1851 H=1851:00 +CPU= 40.365
  05:55:37 STEP 1852 H=1852:00 +CPU= 25.373
  05:56:01 STEP 1853 H=1853:00 +CPU= 24.797
  05:56:42 STEP 1854 H=1854:00 +CPU= 40.903
  05:57:07 STEP 1855 H=1855:00 +CPU= 24.587
  05:57:32 STEP 1856 H=1856:00 +CPU= 25.257
  05:58:13 STEP 1857 H=1857:00 +CPU= 40.326
  05:58:38 STEP 1858 H=1858:00 +CPU= 25.315
  05:59:03 STEP 1859 H=1859:00 +CPU= 24.749
  05:59:47 STEP 1860 H=1860:00 +CPU= 44.151
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001860
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001860
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001860
  06:00:12 STEP 1861 H=1861:00 +CPU= 24.621
  06:00:37 STEP 1862 H=1862:00 +CPU= 25.640
  06:01:17 STEP 1863 H=1863:00 +CPU= 40.140
  06:01:43 STEP 1864 H=1864:00 +CPU= 25.230
  06:02:07 STEP 1865 H=1865:00 +CPU= 24.566
  06:02:48 STEP 1866 H=1866:00 +CPU= 40.840
  06:03:13 STEP 1867 H=1867:00 +CPU= 24.653
  06:03:38 STEP 1868 H=1868:00 +CPU= 25.490
  06:04:18 STEP 1869 H=1869:00 +CPU= 40.099
  06:04:44 STEP 1870 H=1870:00 +CPU= 25.905
  06:05:10 STEP 1871 H=1871:00 +CPU= 25.644
  06:05:57 STEP 1872 H=1872:00 +CPU= 47.373
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001872
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001872
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMGGhq0f+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMSHhq0f+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMUAhq0f+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMGGhq0f+001860
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMSHhq0f+001860
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMUAhq0f+001860
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0837_1983050100_123_952_12169481_0_r1393861530_77.zip
Uploading the intermediate file: upload_file_77.zip
  06:06:22 STEP 1873 H=1873:00 +CPU= 24.772
  06:06:48 STEP 1874 H=1874:00 +CPU= 25.450
  06:07:28 STEP 1875 H=1875:00 +CPU= 40.495
  06:07:54 STEP 1876 H=1876:00 +CPU= 25.843
  06:08:19 STEP 1877 H=1877:00 +CPU= 24.885
  06:09:00 STEP 1878 H=1878:00 +CPU= 41.299
  06:09:25 STEP 1879 H=1879:00 +CPU= 24.862
  06:09:50 STEP 1880 H=1880:00 +CPU= 25.322
  06:10:31 STEP 1881 H=1881:00 +CPU= 40.541
  06:10:56 STEP 1882 H=1882:00 +CPU= 25.282
  06:11:21 STEP 1883 H=1883:00 +CPU= 24.570
  06:12:05 STEP 1884 H=1884:00 +CPU= 44.275
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001884
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001884
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001884
  06:12:30 STEP 1885 H=1885:00 +CPU= 24.825
  06:12:56 STEP 1886 H=1886:00 +CPU= 25.562
  06:13:36 STEP 1887 H=1887:00 +CPU= 40.564
  06:14:02 STEP 1888 H=1888:00 +CPU= 25.501
  06:14:27 STEP 1889 H=1889:00 +CPU= 25.269
  06:15:08 STEP 1890 H=1890:00 +CPU= 40.938
  06:15:33 STEP 1891 H=1891:00 +CPU= 24.934
  06:15:58 STEP 1892 H=1892:00 +CPU= 25.291
  06:16:38 STEP 1893 H=1893:00 +CPU= 40.218
  06:17:04 STEP 1894 H=1894:00 +CPU= 25.161
  06:17:29 STEP 1895 H=1895:00 +CPU= 25.515
  06:18:17 STEP 1896 H=1896:00 +CPU= 47.499
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001896
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001896
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMGGhq0f+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMSHhq0f+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMUAhq0f+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMGGhq0f+001884
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMSHhq0f+001884
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMUAhq0f+001884
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0837_1983050100_123_952_12169481_0_r1393861530_78.zip
Uploading the intermediate file: upload_file_78.zip
  06:18:42 STEP 1897 H=1897:00 +CPU= 25.281
  06:19:08 STEP 1898 H=1898:00 +CPU= 25.683
  06:19:48 STEP 1899 H=1899:00 +CPU= 40.627
  06:20:14 STEP 1900 H=1900:00 +CPU= 25.448
  06:20:39 STEP 1901 H=1901:00 +CPU= 24.888
  06:21:21 STEP 1902 H=1902:00 +CPU= 42.303
  06:21:45 STEP 1903 H=1903:00 +CPU= 24.350
  06:22:11 STEP 1904 H=1904:00 +CPU= 25.325
  06:22:51 STEP 1905 H=1905:00 +CPU= 40.454
  06:23:16 STEP 1906 H=1906:00 +CPU= 25.181
  06:23:41 STEP 1907 H=1907:00 +CPU= 25.105
  06:24:26 STEP 1908 H=1908:00 +CPU= 44.788
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001908
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001908
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001908
  06:24:51 STEP 1909 H=1909:00 +CPU= 24.934
  06:25:16 STEP 1910 H=1910:00 +CPU= 25.296
  06:25:57 STEP 1911 H=1911:00 +CPU= 40.095
  06:26:22 STEP 1912 H=1912:00 +CPU= 25.396
  06:26:47 STEP 1913 H=1913:00 +CPU= 24.767
  06:27:28 STEP 1914 H=1914:00 +CPU= 41.118
  06:27:53 STEP 1915 H=1915:00 +CPU= 24.828
  06:28:18 STEP 1916 H=1916:00 +CPU= 25.389
  06:28:59 STEP 1917 H=1917:00 +CPU= 40.634
  06:29:24 STEP 1918 H=1918:00 +CPU= 25.518
  06:29:50 STEP 1919 H=1919:00 +CPU= 25.615
  06:30:37 STEP 1920 H=1920:00 +CPU= 47.191
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001920
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001920
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMGGhq0f+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMSHhq0f+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMUAhq0f+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMGGhq0f+001908
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMSHhq0f+001908
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMUAhq0f+001908
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0837_1983050100_123_952_12169481_0_r1393861530_79.zip
Uploading the intermediate file: upload_file_79.zip
  06:31:02 STEP 1921 H=1921:00 +CPU= 24.540
  06:31:27 STEP 1922 H=1922:00 +CPU= 25.080
  06:32:07 STEP 1923 H=1923:00 +CPU= 40.268
  06:32:32 STEP 1924 H=1924:00 +CPU= 25.310
  06:32:57 STEP 1925 H=1925:00 +CPU= 24.565
  06:33:38 STEP 1926 H=1926:00 +CPU= 41.211
  06:34:03 STEP 1927 H=1927:00 +CPU= 24.746
  06:34:28 STEP 1928 H=1928:00 +CPU= 25.477
  06:35:09 STEP 1929 H=1929:00 +CPU= 40.094
  06:35:35 STEP 1930 H=1930:00 +CPU= 26.446
  06:36:00 STEP 1931 H=1931:00 +CPU= 24.614
  06:36:44 STEP 1932 H=1932:00 +CPU= 44.624
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001932
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001932
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001932
  06:37:09 STEP 1933 H=1933:00 +CPU= 24.731
  06:37:35 STEP 1934 H=1934:00 +CPU= 25.475
  06:38:15 STEP 1935 H=1935:00 +CPU= 40.277
  06:38:40 STEP 1936 H=1936:00 +CPU= 25.282
  06:39:05 STEP 1937 H=1937:00 +CPU= 24.646
  06:39:46 STEP 1938 H=1938:00 +CPU= 41.013
  06:40:10 STEP 1939 H=1939:00 +CPU= 24.685
  06:40:36 STEP 1940 H=1940:00 +CPU= 25.233
  06:41:16 STEP 1941 H=1941:00 +CPU= 40.710
  06:41:42 STEP 1942 H=1942:00 +CPU= 25.696
  06:42:08 STEP 1943 H=1943:00 +CPU= 25.977
  06:42:56 STEP 1944 H=1944:00 +CPU= 47.708
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001944
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001944
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001944
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMGGhq0f+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMSHhq0f+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMUAhq0f+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMGGhq0f+001932
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMSHhq0f+001932
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMUAhq0f+001932
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0837_1983050100_123_952_12169481_0_r1393861530_80.zip
Uploading the intermediate file: upload_file_80.zip
  06:43:21 STEP 1945 H=1945:00 +CPU= 24.701
  06:43:46 STEP 1946 H=1946:00 +CPU= 25.441
  06:44:26 STEP 1947 H=1947:00 +CPU= 40.251
  06:44:51 STEP 1948 H=1948:00 +CPU= 25.123
  06:45:16 STEP 1949 H=1949:00 +CPU= 24.708
  06:45:57 STEP 1950 H=1950:00 +CPU= 41.036
  06:46:22 STEP 1951 H=1951:00 +CPU= 24.931
  06:46:47 STEP 1952 H=1952:00 +CPU= 25.269
  06:47:28 STEP 1953 H=1953:00 +CPU= 40.271
  06:47:53 STEP 1954 H=1954:00 +CPU= 25.425
  06:48:18 STEP 1955 H=1955:00 +CPU= 24.794
  06:49:03 STEP 1956 H=1956:00 +CPU= 44.512
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001956
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001956
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001956
  06:49:28 STEP 1957 H=1957:00 +CPU= 25.071
  06:49:53 STEP 1958 H=1958:00 +CPU= 25.339
  06:50:33 STEP 1959 H=1959:00 +CPU= 40.388
  06:50:59 STEP 1960 H=1960:00 +CPU= 25.586
  06:51:24 STEP 1961 H=1961:00 +CPU= 24.758
  06:52:05 STEP 1962 H=1962:00 +CPU= 40.762
  06:52:29 STEP 1963 H=1963:00 +CPU= 24.780
  06:52:55 STEP 1964 H=1964:00 +CPU= 25.357
  06:53:35 STEP 1965 H=1965:00 +CPU= 40.459
  06:54:00 STEP 1966 H=1966:00 +CPU= 25.254
  06:54:26 STEP 1967 H=1967:00 +CPU= 25.766
  06:55:13 STEP 1968 H=1968:00 +CPU= 46.669
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001968
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001968
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001968
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMGGhq0f+001944
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMSHhq0f+001944
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMUAhq0f+001944
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMGGhq0f+001956
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMSHhq0f+001956
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMUAhq0f+001956
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0837_1983050100_123_952_12169481_0_r1393861530_81.zip
Uploading the intermediate file: upload_file_81.zip
  06:55:38 STEP 1969 H=1969:00 +CPU= 24.957
  06:56:03 STEP 1970 H=1970:00 +CPU= 25.260
  06:56:43 STEP 1971 H=1971:00 +CPU= 40.305
  06:57:10 STEP 1972 H=1972:00 +CPU= 26.395
  06:57:38 STEP 1973 H=1973:00 +CPU= 27.813
  06:58:24 STEP 1974 H=1974:00 +CPU= 45.848
  06:58:47 STEP 1975 H=1975:00 +CPU= 23.363
  06:59:10 STEP 1976 H=1976:00 +CPU= 23.434
  06:59:47 STEP 1977 H=1977:00 +CPU= 36.367
  07:00:14 STEP 1978 H=1978:00 +CPU= 27.131
  07:00:36 STEP 1979 H=1979:00 +CPU= 22.330
  07:01:19 STEP 1980 H=1980:00 +CPU= 42.520
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001980
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001980
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001980
  07:01:42 STEP 1981 H=1981:00 +CPU= 23.062
  07:02:08 STEP 1982 H=1982:00 +CPU= 26.100
  07:02:50 STEP 1983 H=1983:00 +CPU= 42.332
  07:03:14 STEP 1984 H=1984:00 +CPU= 23.955
  07:03:38 STEP 1985 H=1985:00 +CPU= 23.717
  07:04:19 STEP 1986 H=1986:00 +CPU= 40.729
  07:04:43 STEP 1987 H=1987:00 +CPU= 24.246
  07:05:09 STEP 1988 H=1988:00 +CPU= 25.492
  07:05:54 STEP 1989 H=1989:00 +CPU= 45.218
  07:06:19 STEP 1990 H=1990:00 +CPU= 24.789
  07:06:44 STEP 1991 H=1991:00 +CPU= 25.348
  07:07:33 STEP 1992 H=1992:00 +CPU= 49.168
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001992
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001992
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001992
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMGGhq0f+001968
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMSHhq0f+001968
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMUAhq0f+001968
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMGGhq0f+001980
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMSHhq0f+001980
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMUAhq0f+001980
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0837_1983050100_123_952_12169481_0_r1393861530_82.zip
Uploading the intermediate file: upload_file_82.zip
  07:07:59 STEP 1993 H=1993:00 +CPU= 25.181
  07:08:25 STEP 1994 H=1994:00 +CPU= 26.164
  07:09:06 STEP 1995 H=1995:00 +CPU= 40.607
  07:09:31 STEP 1996 H=1996:00 +CPU= 25.619
  07:09:55 STEP 1997 H=1997:00 +CPU= 23.747
  07:10:35 STEP 1998 H=1998:00 +CPU= 39.530
  07:11:00 STEP 1999 H=1999:00 +CPU= 25.495
  07:11:26 STEP 2000 H=2000:00 +CPU= 25.942
  07:12:05 STEP 2001 H=2001:00 +CPU= 38.998
  07:12:30 STEP 2002 H=2002:00 +CPU= 24.589
  07:12:53 STEP 2003 H=2003:00 +CPU= 23.601
  07:13:36 STEP 2004 H=2004:00 +CPU= 42.390
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002004
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002004
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002004
  07:14:00 STEP 2005 H=2005:00 +CPU= 23.793
  07:14:25 STEP 2006 H=2006:00 +CPU= 25.171
  07:15:04 STEP 2007 H=2007:00 +CPU= 38.770
  07:15:28 STEP 2008 H=2008:00 +CPU= 24.222
  07:15:51 STEP 2009 H=2009:00 +CPU= 23.618
  07:16:33 STEP 2010 H=2010:00 +CPU= 41.138
  07:16:57 STEP 2011 H=2011:00 +CPU= 24.357
  07:17:21 STEP 2012 H=2012:00 +CPU= 24.231
  07:18:00 STEP 2013 H=2013:00 +CPU= 39.074
  07:18:26 STEP 2014 H=2014:00 +CPU= 25.311
  07:18:54 STEP 2015 H=2015:00 +CPU= 28.350
  07:19:41 STEP 2016 H=2016:00 +CPU= 45.260
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002016
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002016
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002016
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMGGhq0f+001992
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMSHhq0f+001992
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMUAhq0f+001992
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMGGhq0f+002004
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMSHhq0f+002004
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMUAhq0f+002004
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0837_1983050100_123_952_12169481_0_r1393861530_83.zip
Uploading the intermediate file: upload_file_83.zip
  07:20:06 STEP 2017 H=2017:00 +CPU= 24.750
  07:20:38 STEP 2018 H=2018:00 +CPU= 31.590
  07:21:21 STEP 2019 H=2019:00 +CPU= 42.560
  07:21:51 STEP 2020 H=2020:00 +CPU= 29.119
  07:22:13 STEP 2021 H=2021:00 +CPU= 22.245
  07:22:53 STEP 2022 H=2022:00 +CPU= 40.000
  07:23:17 STEP 2023 H=2023:00 +CPU= 23.702
  07:23:41 STEP 2024 H=2024:00 +CPU= 23.630
  07:24:18 STEP 2025 H=2025:00 +CPU= 37.418
  07:24:43 STEP 2026 H=2026:00 +CPU= 24.483
  07:25:06 STEP 2027 H=2027:00 +CPU= 23.512
  07:25:50 STEP 2028 H=2028:00 +CPU= 44.075
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002028
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002028
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002028
  07:26:14 STEP 2029 H=2029:00 +CPU= 23.953
  07:26:38 STEP 2030 H=2030:00 +CPU= 23.472
  07:27:16 STEP 2031 H=2031:00 +CPU= 37.768
  07:27:41 STEP 2032 H=2032:00 +CPU= 25.537
  07:28:06 STEP 2033 H=2033:00 +CPU= 24.460
  07:28:43 STEP 2034 H=2034:00 +CPU= 37.477
  07:29:07 STEP 2035 H=2035:00 +CPU= 22.971
  07:29:30 STEP 2036 H=2036:00 +CPU= 23.224
  07:30:08 STEP 2037 H=2037:00 +CPU= 38.421
  07:30:34 STEP 2038 H=2038:00 +CPU= 25.312
  07:30:59 STEP 2039 H=2039:00 +CPU= 25.015
  07:31:44 STEP 2040 H=2040:00 +CPU= 45.061
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002040
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002040
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002040
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMGGhq0f+002016
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMSHhq0f+002016
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMUAhq0f+002016
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMGGhq0f+002028
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMSHhq0f+002028
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMUAhq0f+002028
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0837_1983050100_123_952_12169481_0_r1393861530_84.zip
Uploading the intermediate file: upload_file_84.zip
  07:32:06 STEP 2041 H=2041:00 +CPU= 22.431
  07:32:33 STEP 2042 H=2042:00 +CPU= 26.929
  07:33:14 STEP 2043 H=2043:00 +CPU= 40.994
  07:33:42 STEP 2044 H=2044:00 +CPU= 27.332
  07:34:08 STEP 2045 H=2045:00 +CPU= 25.583
  07:34:48 STEP 2046 H=2046:00 +CPU= 39.726
  07:35:12 STEP 2047 H=2047:00 +CPU= 24.382
  07:35:37 STEP 2048 H=2048:00 +CPU= 24.658
  07:36:17 STEP 2049 H=2049:00 +CPU= 39.770
  07:36:44 STEP 2050 H=2050:00 +CPU= 27.547
  07:37:09 STEP 2051 H=2051:00 +CPU= 25.289
  07:37:54 STEP 2052 H=2052:00 +CPU= 44.807
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002052
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002052
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002052
  07:38:18 STEP 2053 H=2053:00 +CPU= 23.809
  07:38:42 STEP 2054 H=2054:00 +CPU= 24.281
  07:39:21 STEP 2055 H=2055:00 +CPU= 39.051
  07:39:46 STEP 2056 H=2056:00 +CPU= 24.042
  07:40:09 STEP 2057 H=2057:00 +CPU= 23.584
  07:40:47 STEP 2058 H=2058:00 +CPU= 38.193
  07:41:11 STEP 2059 H=2059:00 +CPU= 23.151
  07:41:35 STEP 2060 H=2060:00 +CPU= 24.228
  07:42:15 STEP 2061 H=2061:00 +CPU= 39.466
  07:42:40 STEP 2062 H=2062:00 +CPU= 25.144
  07:43:05 STEP 2063 H=2063:00 +CPU= 25.162
  07:43:53 STEP 2064 H=2064:00 +CPU= 48.229
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002064
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002064
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002064
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMGGhq0f+002040
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMSHhq0f+002040
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMUAhq0f+002040
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMGGhq0f+002052
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMSHhq0f+002052
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMUAhq0f+002052
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0837_1983050100_123_952_12169481_0_r1393861530_85.zip
Uploading the intermediate file: upload_file_85.zip
  07:44:17 STEP 2065 H=2065:00 +CPU= 23.841
  07:44:42 STEP 2066 H=2066:00 +CPU= 24.993
  07:45:23 STEP 2067 H=2067:00 +CPU= 40.519
  07:45:48 STEP 2068 H=2068:00 +CPU= 24.941
  07:46:13 STEP 2069 H=2069:00 +CPU= 25.406
  07:46:55 STEP 2070 H=2070:00 +CPU= 41.456
  07:47:22 STEP 2071 H=2071:00 +CPU= 26.939
  07:47:48 STEP 2072 H=2072:00 +CPU= 26.382
  07:48:27 STEP 2073 H=2073:00 +CPU= 38.955
  07:48:52 STEP 2074 H=2074:00 +CPU= 24.335
  07:49:18 STEP 2075 H=2075:00 +CPU= 26.647
  07:50:04 STEP 2076 H=2076:00 +CPU= 45.526
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002076
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002076
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002076
  07:50:32 STEP 2077 H=2077:00 +CPU= 27.987
  07:50:58 STEP 2078 H=2078:00 +CPU= 25.966
  07:51:43 STEP 2079 H=2079:00 +CPU= 44.323
  07:52:09 STEP 2080 H=2080:00 +CPU= 26.068
  07:52:34 STEP 2081 H=2081:00 +CPU= 25.100
  07:53:16 STEP 2082 H=2082:00 +CPU= 42.405
  07:53:43 STEP 2083 H=2083:00 +CPU= 26.504
  07:54:10 STEP 2084 H=2084:00 +CPU= 27.068
  07:54:52 STEP 2085 H=2085:00 +CPU= 41.726
  07:55:19 STEP 2086 H=2086:00 +CPU= 26.822
  07:55:45 STEP 2087 H=2087:00 +CPU= 26.035
  07:56:32 STEP 2088 H=2088:00 +CPU= 47.507
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+002088
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+002088
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+002088
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMGGhq0f+002064
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMSHhq0f+002064
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMUAhq0f+002064
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMGGhq0f+002076
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMSHhq0f+002076
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481/ICMUAhq0f+002076
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0837_1983050100_123_952_12169481_0_r1393861530_86.zip
Uploading the intermediate file: upload_file_86.zip
  07:56:58 STEP 2089 H=2089:00 +CPU= 25.360
Uploading trickle at timestep: 7516800
  07:57:24 STEP 2090 H=2090:00 +CPU= 26.515
  07:58:09 STEP 2091 H=2091:00 +CPU= 44.211
  07:58:36 STEP 2092 H=2092:00 +CPU= 26.949
  07:59:02 STEP 2093 H=2093:00 +CPU= 26.052
  07:59:45 STEP 2094 H=2094:00 +CPU= 42.499
  08:00:11 STEP 2095 H=2095:00 +CPU= 26.223
The child process terminated with status: 0
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1983050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0837
(argv4) batchid: 952
(argv5) wuid: 12169481
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/4
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12169481
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/4/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/4/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_494747c5ebe010896d01a0511d8513bc to: /var/lib/boinc-client/slots/4/oifs_43r3_ps_0837_1983050100_123_952_12169481.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/4/oifs_43r3_ps_0837_1983050100_123_952_12169481.zip
ic_ancil_file: ic_ancil_12169481
ifsdata_file: ifsdata_12169481
climate_data_file: clim_data_12169481
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_dfcaa25e9088af629637133127a6d143 to: /var/lib/boinc-client/slots/4/ic_ancil_12169481.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/4/ic_ancil_12169481.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_1ab01f8f139f76502fcc733f48dd71f4 to: /var/lib/boinc-client/slots/4/ifsdata/ifsdata_12169481.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/4/ifsdata/ifsdata_12169481.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/4/159l_2/clim_data_12169481.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/4/159l_2/clim_data_12169481.zip
Checking for progress XML file: /var/lib/boinc-client/slots/4/progress_file_12169481.xml
Opened progress file ok : /var/lib/boinc-client/slots/4/progress_file_12169481.xml
-- Model is restarting --
Adjusting last_iter, 2096, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/4/progress_file_12169481.xml
last_cpu_time: 67218
upload_file_number: 87
last_iter: 2087
last_upload: 7516800
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0837_1983050100_123_952_12169481_0_r1393861530
The child process has been launched with process id: 92417
Executing the command: /var/lib/boinc-client/slots/4/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:dbgrensenh27vm:1:1:92417:92417] [20230109:080047:1673247647:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:dbgrensenh27vm:1:1:92417:92417] [20230109:080047:1673247647:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:dbgrensenh27vm:1:1:92417:92417] [20230109:080047:1673247647:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:dbgrensenh27vm:1:1:92417:92417] [20230109:080047:1673247647:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:dbgrensenh27vm:1:1:92417:92417] [20230109:080047:1673247647:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:dbgrensenh27vm:1:1:92417:92417] [20230109:080047:1673247647:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:dbgrensenh27vm:1:1:92417:92417] [20230109:080047:1673247647:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:dbgrensenh27vm:1:1:92417:92417] [20230109:080047:1673247647:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:dbgrensenh27vm:1:1:92417:92417] [20230109:080047:1673247647:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:dbgrensenh27vm:1:1:92417:92417] [20230109:080047:1673247647:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:dbgrensenh27vm:1:1:92417:92417] [20230109:080047:1673247647:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:dbgrensenh27vm:1:1:92417:92417] [20230109:080047:1673247647:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:dbgrensenh27vm:1:1:92417:92417] [20230109:080047:1673247647:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:dbgrensenh27vm:1:1:92417:92417] [20230109:080047:1673247647:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:dbgrensenh27vm:1:1:92417:92417] [20230109:080047:1673247647:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:dbgrensenh27vm:1:1:92417:92417] [20230109:080047:1673247647:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:dbgrensenh27vm:1:1:92417:92417] [20230109:080047:1673247647:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:dbgrensenh27vm:1:1:92417:92417] [20230109:080047:1673247647:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:dbgrensenh27vm:1:1:92417:92417] [20230109:080047:1673247647:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:dbgrensenh27vm:1:1:92417:92417] [20230109:080047:1673247647:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:dbgrensenh27vm:1:1:92417:92417] [20230109:080047:1673247647:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:dbgrensenh27vm:1:1:92417:92417] [20230109:080047:1673247647:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:dbgrensenh27vm:1:1:92417:92417] [20230109:080047:1673247647:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:dbgrensenh27vm:1:1:92417:92417] [20230109:080047:1673247647:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:dbgrensenh27vm:1:1:92417:92417] [20230109:080047:1673247647:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:dbgrensenh27vm:1:1:92417:92417] [20230109:080047:1673247647:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:dbgrensenh27vm:1:1:92417:92417] [20230109:080047:1673247647:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:dbgrensenh27vm:1:1:92417:92417] [20230109:080047:1673247647:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:dbgrensenh27vm:1:1:92417:92417] [20230109:080047:1673247647:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:dbgrensenh27vm:1:1:92417:92417] [20230109:080047:1673247647:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  08:01:44 STEP 2088 H=2088:00 +CPU= 53.649
The child process terminated with status: 0
..Failed, model did not complete successfully

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:13:27 1498859 22253774 oifs_43r3_ps_0837_1983050100_123_952_12169481_0 7,516,800 66,997 0.0089
09 May 2023 16:13:22 1498859 22253774 oifs_43r3_ps_0837_1983050100_123_952_12169481_0 6,652,800 59,632 0.0090
09 May 2023 16:13:18 1498859 22253774 oifs_43r3_ps_0837_1983050100_123_952_12169481_0 5,788,800 52,249 0.0090
09 May 2023 16:13:13 1498859 22253774 oifs_43r3_ps_0837_1983050100_123_952_12169481_0 4,924,800 44,848 0.0091
09 May 2023 16:13:09 1498859 22253774 oifs_43r3_ps_0837_1983050100_123_952_12169481_0 4,060,800 37,479 0.0092
09 May 2023 16:13:04 1498859 22253774 oifs_43r3_ps_0837_1983050100_123_952_12169481_0 3,196,800 30,088 0.0094
09 May 2023 16:12:58 1498859 22253774 oifs_43r3_ps_0837_1983050100_123_952_12169481_0 2,332,800 22,737 0.0097
09 May 2023 16:12:53 1498859 22253774 oifs_43r3_ps_0837_1983050100_123_952_12169481_0 1,468,800 15,939 0.0109


©2024 climateprediction.net