climateprediction.net home page
Task 22505805

Task 22505805

Name oifs_43r3_bl_a4bf_2016092300_20_1018_12293922_1
Workunit 12293922
Created 12 Aug 2024, 8:47:22 UTC
Sent 12 Aug 2024, 8:48:33 UTC
Report deadline 11 Oct 2024, 8:48:33 UTC
Received 14 Aug 2024, 3:22:54 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1552211
Run time 13 hours 22 min 49 sec
CPU time 13 hours 22 min 49 sec
Validate state Valid
Credit 2,635.55
Device peak FLOPS 1.00 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.13
x86_64-pc-linux-gnu
Peak working set size 5,023.21 MB
Peak swap size 5,981.07 MB
Peak disk usage 1,965.16 MB
Stderr
<core_client_version>7.24.1</core_client_version>
<![CDATA[
<stderr_txt>
he zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMGGh7zg+001464
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMSHh7zg+001464
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMUAh7zg+001464
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMGGh7zg+001476
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMSHh7zg+001476
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMUAh7zg+001476
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMGGh7zg+001488
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMSHh7zg+001488
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMUAh7zg+001488
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMGGh7zg+001500
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMSHh7zg+001500
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMUAh7zg+001500
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMGGh7zg+001512
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMSHh7zg+001512
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMUAh7zg+001512
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMGGh7zg+001524
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMSHh7zg+001524
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMUAh7zg+001524
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a4bf_2016092300_20_1018_12293922_1_r277166911_15.zip
Uploading the intermediate file: upload_file_15.zip
  07:10:14 STEP 1537 H= 384:15 +CPU= 22.318
  07:10:38 STEP 1538 H= 384:30 +CPU= 23.965
  07:11:00 STEP 1539 H= 384:45 +CPU= 21.854
  07:11:23 STEP 1540 H= 385:00 +CPU= 23.096
  07:11:44 STEP 1541 H= 385:15 +CPU= 20.781
  07:12:07 STEP 1542 H= 385:30 +CPU= 22.646
  07:12:28 STEP 1543 H= 385:45 +CPU= 21.387
  07:12:52 STEP 1544 H= 386:00 +CPU= 23.935
  07:13:15 STEP 1545 H= 386:15 +CPU= 22.819
  07:13:38 STEP 1546 H= 386:30 +CPU= 23.190
  07:14:02 STEP 1547 H= 386:45 +CPU= 23.889
  07:14:30 STEP 1548 H= 387:00 +CPU= 27.662
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001548
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001548
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001548
  07:14:53 STEP 1549 H= 387:15 +CPU= 22.720
  07:15:14 STEP 1550 H= 387:30 +CPU= 21.604
  07:15:38 STEP 1551 H= 387:45 +CPU= 23.888
  07:15:58 STEP 1552 H= 388:00 +CPU= 19.588
  07:16:17 STEP 1553 H= 388:15 +CPU= 19.123
  07:16:37 STEP 1554 H= 388:30 +CPU= 20.247
  07:16:57 STEP 1555 H= 388:45 +CPU= 19.771
  07:17:20 STEP 1556 H= 389:00 +CPU= 22.699
  07:17:44 STEP 1557 H= 389:15 +CPU= 24.509
  07:18:08 STEP 1558 H= 389:30 +CPU= 23.302
  07:18:31 STEP 1559 H= 389:45 +CPU= 23.376
  07:18:59 STEP 1560 H= 390:00 +CPU= 27.736
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001560
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001560
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001560
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  07:38:05 STEP 1561 H= 390:15 +CPU= 20.660
  07:38:31 STEP 1562 H= 390:30 +CPU= 25.417
  07:38:54 STEP 1563 H= 390:45 +CPU= 23.702
  07:39:17 STEP 1564 H= 391:00 +CPU= 23.054
  07:39:41 STEP 1565 H= 391:15 +CPU= 23.946
  07:40:07 STEP 1566 H= 391:30 +CPU= 25.614
  07:40:30 STEP 1567 H= 391:45 +CPU= 23.188
  07:40:54 STEP 1568 H= 392:00 +CPU= 23.420
  07:41:16 STEP 1569 H= 392:15 +CPU= 22.240
  07:41:39 STEP 1570 H= 392:30 +CPU= 22.785
  07:42:01 STEP 1571 H= 392:45 +CPU= 22.297
  07:42:28 STEP 1572 H= 393:00 +CPU= 26.690
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001572
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001572
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001572
  07:42:51 STEP 1573 H= 393:15 +CPU= 23.310
  07:43:16 STEP 1574 H= 393:30 +CPU= 24.362
  07:43:40 STEP 1575 H= 393:45 +CPU= 23.953
  07:44:04 STEP 1576 H= 394:00 +CPU= 24.330
  07:44:26 STEP 1577 H= 394:15 +CPU= 22.377
  07:44:49 STEP 1578 H= 394:30 +CPU= 22.916
  07:45:13 STEP 1579 H= 394:45 +CPU= 23.307
  07:45:38 STEP 1580 H= 395:00 +CPU= 24.955
  07:46:02 STEP 1581 H= 395:15 +CPU= 24.832
  07:46:27 STEP 1582 H= 395:30 +CPU= 24.847
  07:46:46 STEP 1583 H= 395:45 +CPU= 19.072
  07:47:15 STEP 1584 H= 396:00 +CPU= 28.770
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001584
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001584
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001584
  07:47:38 STEP 1585 H= 396:15 +CPU= 22.242
  07:48:00 STEP 1586 H= 396:30 +CPU= 22.105
  07:48:24 STEP 1587 H= 396:45 +CPU= 23.916
  07:48:48 STEP 1588 H= 397:00 +CPU= 24.222
  07:49:09 STEP 1589 H= 397:15 +CPU= 21.042
  07:49:34 STEP 1590 H= 397:30 +CPU= 25.234
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  07:50:18 STEP 1591 H= 397:45 +CPU= 22.269
  07:50:38 STEP 1592 H= 398:00 +CPU= 20.165
  07:50:56 STEP 1593 H= 398:15 +CPU= 18.169
  07:51:18 STEP 1594 H= 398:30 +CPU= 21.950
  07:51:39 STEP 1595 H= 398:45 +CPU= 20.682
  07:52:07 STEP 1596 H= 399:00 +CPU= 28.201
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001596
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001596
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001596
  07:52:28 STEP 1597 H= 399:15 +CPU= 21.101
  07:52:48 STEP 1598 H= 399:30 +CPU= 19.955
  07:53:05 STEP 1599 H= 399:45 +CPU= 17.262
  07:53:27 STEP 1600 H= 400:00 +CPU= 21.784
  07:53:48 STEP 1601 H= 400:15 +CPU= 20.444
  07:54:05 STEP 1602 H= 400:30 +CPU= 17.729
  07:54:26 STEP 1603 H= 400:45 +CPU= 21.022
  07:54:45 STEP 1604 H= 401:00 +CPU= 18.799
  07:55:04 STEP 1605 H= 401:15 +CPU= 19.229
  07:55:25 STEP 1606 H= 401:30 +CPU= 20.279
  07:55:44 STEP 1607 H= 401:45 +CPU= 18.875
  07:56:07 STEP 1608 H= 402:00 +CPU= 23.550
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001608
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001608
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001608
  07:56:25 STEP 1609 H= 402:15 +CPU= 17.560
  07:56:43 STEP 1610 H= 402:30 +CPU= 17.952
  07:57:02 STEP 1611 H= 402:45 +CPU= 19.303
  07:57:23 STEP 1612 H= 403:00 +CPU= 20.878
  07:57:43 STEP 1613 H= 403:15 +CPU= 19.699
  07:58:03 STEP 1614 H= 403:30 +CPU= 20.448
  07:58:23 STEP 1615 H= 403:45 +CPU= 19.771
  07:58:44 STEP 1616 H= 404:00 +CPU= 21.317
  07:59:05 STEP 1617 H= 404:15 +CPU= 20.234
  07:59:25 STEP 1618 H= 404:30 +CPU= 20.474
  07:59:44 STEP 1619 H= 404:45 +CPU= 19.274
  08:00:09 STEP 1620 H= 405:00 +CPU= 24.838
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001620
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001620
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001620
  08:00:27 STEP 1621 H= 405:15 +CPU= 17.737
  08:00:48 STEP 1622 H= 405:30 +CPU= 21.281
  08:01:08 STEP 1623 H= 405:45 +CPU= 20.243
  08:01:30 STEP 1624 H= 406:00 +CPU= 21.586
  08:01:50 STEP 1625 H= 406:15 +CPU= 19.643
  08:02:12 STEP 1626 H= 406:30 +CPU= 21.809
  08:02:31 STEP 1627 H= 406:45 +CPU= 18.992
  08:02:51 STEP 1628 H= 407:00 +CPU= 20.778
  08:03:11 STEP 1629 H= 407:15 +CPU= 19.540
  08:03:31 STEP 1630 H= 407:30 +CPU= 19.819
  08:03:50 STEP 1631 H= 407:45 +CPU= 19.519
  08:04:18 STEP 1632 H= 408:00 +CPU= 27.378
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001632
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001632
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001632
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMGGh7zg+001536
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMSHh7zg+001536
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMUAh7zg+001536
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMGGh7zg+001548
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMSHh7zg+001548
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMUAh7zg+001548
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMGGh7zg+001560
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMSHh7zg+001560
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMUAh7zg+001560
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMGGh7zg+001572
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMSHh7zg+001572
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMUAh7zg+001572
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMGGh7zg+001584
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMSHh7zg+001584
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMUAh7zg+001584
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMGGh7zg+001596
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMSHh7zg+001596
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMUAh7zg+001596
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMGGh7zg+001608
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMSHh7zg+001608
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMUAh7zg+001608
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMGGh7zg+001620
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMSHh7zg+001620
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMUAh7zg+001620
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a4bf_2016092300_20_1018_12293922_1_r277166911_16.zip
Uploading the intermediate file: upload_file_16.zip
  08:04:38 STEP 1633 H= 408:15 +CPU= 19.933
  08:04:59 STEP 1634 H= 408:30 +CPU= 21.065
  08:05:18 STEP 1635 H= 408:45 +CPU= 19.326
  08:05:40 STEP 1636 H= 409:00 +CPU= 21.502
  08:06:00 STEP 1637 H= 409:15 +CPU= 19.852
  08:06:21 STEP 1638 H= 409:30 +CPU= 21.364
  08:06:44 STEP 1639 H= 409:45 +CPU= 23.372
  08:07:06 STEP 1640 H= 410:00 +CPU= 21.971
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  08:27:35 STEP 1641 H= 410:15 +CPU= 21.778
  08:27:59 STEP 1642 H= 410:30 +CPU= 24.444
  08:28:23 STEP 1643 H= 410:45 +CPU= 23.156
  08:28:51 STEP 1644 H= 411:00 +CPU= 28.699
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001644
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001644
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001644
  08:29:14 STEP 1645 H= 411:15 +CPU= 22.868
  08:29:37 STEP 1646 H= 411:30 +CPU= 22.907
  08:29:58 STEP 1647 H= 411:45 +CPU= 20.775
  08:30:22 STEP 1648 H= 412:00 +CPU= 24.135
  08:30:45 STEP 1649 H= 412:15 +CPU= 22.968
  08:31:09 STEP 1650 H= 412:30 +CPU= 23.757
  08:31:34 STEP 1651 H= 412:45 +CPU= 25.246
  08:31:57 STEP 1652 H= 413:00 +CPU= 22.445
  08:32:18 STEP 1653 H= 413:15 +CPU= 20.907
  08:32:40 STEP 1654 H= 413:30 +CPU= 22.652
  08:33:05 STEP 1655 H= 413:45 +CPU= 24.634
  08:33:34 STEP 1656 H= 414:00 +CPU= 28.680
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001656
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001656
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001656
  08:33:55 STEP 1657 H= 414:15 +CPU= 21.031
  08:34:17 STEP 1658 H= 414:30 +CPU= 22.033
  08:34:38 STEP 1659 H= 414:45 +CPU= 20.938
  08:35:03 STEP 1660 H= 415:00 +CPU= 25.160
  08:35:24 STEP 1661 H= 415:15 +CPU= 20.817
  08:35:49 STEP 1662 H= 415:30 +CPU= 24.591
  08:36:11 STEP 1663 H= 415:45 +CPU= 22.060
  08:36:35 STEP 1664 H= 416:00 +CPU= 24.383
  08:36:57 STEP 1665 H= 416:15 +CPU= 22.156
  08:37:19 STEP 1666 H= 416:30 +CPU= 21.897
  08:37:39 STEP 1667 H= 416:45 +CPU= 20.139
  08:38:10 STEP 1668 H= 417:00 +CPU= 30.387
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001668
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001668
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001668
  08:38:33 STEP 1669 H= 417:15 +CPU= 22.869
  08:38:56 STEP 1670 H= 417:30 +CPU= 23.215
  08:39:19 STEP 1671 H= 417:45 +CPU= 22.857
  08:39:40 STEP 1672 H= 418:00 +CPU= 20.738
  08:40:03 STEP 1673 H= 418:15 +CPU= 23.121
  08:40:26 STEP 1674 H= 418:30 +CPU= 23.537
  08:40:51 STEP 1675 H= 418:45 +CPU= 24.437
  08:41:15 STEP 1676 H= 419:00 +CPU= 23.975
  08:41:38 STEP 1677 H= 419:15 +CPU= 22.738
  08:42:00 STEP 1678 H= 419:30 +CPU= 22.255
  08:42:22 STEP 1679 H= 419:45 +CPU= 22.303
  08:42:53 STEP 1680 H= 420:00 +CPU= 30.274
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001680
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001680
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001680
  08:43:17 STEP 1681 H= 420:15 +CPU= 24.468
  08:43:41 STEP 1682 H= 420:30 +CPU= 23.830
  08:44:03 STEP 1683 H= 420:45 +CPU= 21.483
  08:44:26 STEP 1684 H= 421:00 +CPU= 23.008
  08:44:48 STEP 1685 H= 421:15 +CPU= 21.439
  08:45:11 STEP 1686 H= 421:30 +CPU= 23.053
  08:45:35 STEP 1687 H= 421:45 +CPU= 22.385
  08:45:59 STEP 1688 H= 422:00 +CPU= 23.774
  08:46:24 STEP 1689 H= 422:15 +CPU= 22.352
  08:46:48 STEP 1690 H= 422:30 +CPU= 22.976
  08:47:13 STEP 1691 H= 422:45 +CPU= 23.366
  08:47:43 STEP 1692 H= 423:00 +CPU= 28.912
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001692
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001692
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001692
  08:48:08 STEP 1693 H= 423:15 +CPU= 23.780
  08:48:32 STEP 1694 H= 423:30 +CPU= 23.553
  08:48:56 STEP 1695 H= 423:45 +CPU= 23.715
  08:49:22 STEP 1696 H= 424:00 +CPU= 23.903
  08:49:46 STEP 1697 H= 424:15 +CPU= 23.217
  08:50:10 STEP 1698 H= 424:30 +CPU= 22.601
  08:50:35 STEP 1699 H= 424:45 +CPU= 23.568
  08:51:00 STEP 1700 H= 425:00 +CPU= 24.092
  08:51:24 STEP 1701 H= 425:15 +CPU= 22.938
  08:51:48 STEP 1702 H= 425:30 +CPU= 23.234
  08:52:13 STEP 1703 H= 425:45 +CPU= 23.461
  08:52:43 STEP 1704 H= 426:00 +CPU= 28.710
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001704
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001704
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001704
  08:53:07 STEP 1705 H= 426:15 +CPU= 23.265
  08:53:32 STEP 1706 H= 426:30 +CPU= 23.165
  08:53:56 STEP 1707 H= 426:45 +CPU= 23.015
  08:54:21 STEP 1708 H= 427:00 +CPU= 23.596
  08:54:46 STEP 1709 H= 427:15 +CPU= 23.126
  08:55:10 STEP 1710 H= 427:30 +CPU= 23.303
  08:55:34 STEP 1711 H= 427:45 +CPU= 23.264
  08:56:00 STEP 1712 H= 428:00 +CPU= 23.650
  08:56:24 STEP 1713 H= 428:15 +CPU= 23.040
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  08:57:09 STEP 1714 H= 428:30 +CPU= 22.600
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  08:57:52 STEP 1715 H= 428:45 +CPU= 21.569
  08:58:16 STEP 1716 H= 429:00 +CPU= 23.835
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001716
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001716
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001716
  08:58:36 STEP 1717 H= 429:15 +CPU= 19.679
  08:58:57 STEP 1718 H= 429:30 +CPU= 20.652
  08:59:16 STEP 1719 H= 429:45 +CPU= 19.573
  08:59:39 STEP 1720 H= 430:00 +CPU= 22.270
  08:59:59 STEP 1721 H= 430:15 +CPU= 20.817
  09:00:20 STEP 1722 H= 430:30 +CPU= 20.725
  09:00:44 STEP 1723 H= 430:45 +CPU= 20.135
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  09:21:15 STEP 1724 H= 431:00 +CPU= 23.838
  09:21:39 STEP 1725 H= 431:15 +CPU= 23.212
  09:22:03 STEP 1726 H= 431:30 +CPU= 23.285
  09:22:28 STEP 1727 H= 431:45 +CPU= 23.530
  09:23:02 STEP 1728 H= 432:00 +CPU= 32.286
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001728
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001728
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMGGh7zg+001632
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMSHh7zg+001632
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMUAh7zg+001632
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMGGh7zg+001644
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMSHh7zg+001644
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMUAh7zg+001644
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMGGh7zg+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMSHh7zg+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMUAh7zg+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMGGh7zg+001668
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMSHh7zg+001668
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMUAh7zg+001668
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMGGh7zg+001680
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMSHh7zg+001680
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMUAh7zg+001680
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMGGh7zg+001692
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMSHh7zg+001692
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMUAh7zg+001692
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMGGh7zg+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMSHh7zg+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMUAh7zg+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMGGh7zg+001716
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMSHh7zg+001716
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMUAh7zg+001716
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a4bf_2016092300_20_1018_12293922_1_r277166911_17.zip
Uploading the intermediate file: upload_file_17.zip
  09:23:26 STEP 1729 H= 432:15 +CPU= 23.641
  09:23:51 STEP 1730 H= 432:30 +CPU= 23.412
  09:24:15 STEP 1731 H= 432:45 +CPU= 23.468
  09:24:40 STEP 1732 H= 433:00 +CPU= 24.103
  09:25:04 STEP 1733 H= 433:15 +CPU= 22.876
  09:25:29 STEP 1734 H= 433:30 +CPU= 23.898
  09:25:53 STEP 1735 H= 433:45 +CPU= 23.456
  09:26:17 STEP 1736 H= 434:00 +CPU= 22.723
  09:26:40 STEP 1737 H= 434:15 +CPU= 22.845
  09:27:05 STEP 1738 H= 434:30 +CPU= 23.614
  09:27:29 STEP 1739 H= 434:45 +CPU= 23.354
  09:27:59 STEP 1740 H= 435:00 +CPU= 29.201
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001740
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001740
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001740
  09:28:23 STEP 1741 H= 435:15 +CPU= 23.108
  09:28:47 STEP 1742 H= 435:30 +CPU= 23.520
  09:29:11 STEP 1743 H= 435:45 +CPU= 23.163
  09:29:36 STEP 1744 H= 436:00 +CPU= 24.168
  09:30:00 STEP 1745 H= 436:15 +CPU= 23.258
  09:30:24 STEP 1746 H= 436:30 +CPU= 23.016
  09:30:49 STEP 1747 H= 436:45 +CPU= 23.991
  09:31:13 STEP 1748 H= 437:00 +CPU= 23.642
  09:31:38 STEP 1749 H= 437:15 +CPU= 23.692
  09:32:02 STEP 1750 H= 437:30 +CPU= 23.266
  09:32:26 STEP 1751 H= 437:45 +CPU= 23.221
  09:32:56 STEP 1752 H= 438:00 +CPU= 28.644
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001752
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001752
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001752
  09:33:20 STEP 1753 H= 438:15 +CPU= 23.257
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  09:34:03 STEP 1754 H= 438:30 +CPU= 21.646
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  09:34:45 STEP 1755 H= 438:45 +CPU= 20.745
  09:35:08 STEP 1756 H= 439:00 +CPU= 21.896
  09:35:30 STEP 1757 H= 439:15 +CPU= 21.473
  09:35:51 STEP 1758 H= 439:30 +CPU= 21.352
  09:36:13 STEP 1759 H= 439:45 +CPU= 21.285
  09:36:35 STEP 1760 H= 440:00 +CPU= 21.837
  09:36:57 STEP 1761 H= 440:15 +CPU= 21.350
  09:37:19 STEP 1762 H= 440:30 +CPU= 21.466
  09:37:41 STEP 1763 H= 440:45 +CPU= 21.560
  09:38:09 STEP 1764 H= 441:00 +CPU= 26.850
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001764
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001764
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001764
  09:38:30 STEP 1765 H= 441:15 +CPU= 21.144
  09:38:53 STEP 1766 H= 441:30 +CPU= 22.321
  09:39:15 STEP 1767 H= 441:45 +CPU= 21.479
  09:39:38 STEP 1768 H= 442:00 +CPU= 22.102
  09:39:59 STEP 1769 H= 442:15 +CPU= 21.185
  09:40:21 STEP 1770 H= 442:30 +CPU= 20.975
  09:40:42 STEP 1771 H= 442:45 +CPU= 21.244
  09:41:05 STEP 1772 H= 443:00 +CPU= 21.838
  09:41:27 STEP 1773 H= 443:15 +CPU= 21.333
  09:41:48 STEP 1774 H= 443:30 +CPU= 21.147
  09:42:10 STEP 1775 H= 443:45 +CPU= 21.546
  09:42:41 STEP 1776 H= 444:00 +CPU= 29.841
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001776
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001776
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001776
  09:43:03 STEP 1777 H= 444:15 +CPU= 21.498
  09:43:24 STEP 1778 H= 444:30 +CPU= 21.374
  09:43:46 STEP 1779 H= 444:45 +CPU= 21.406
  09:44:09 STEP 1780 H= 445:00 +CPU= 21.728
  09:44:30 STEP 1781 H= 445:15 +CPU= 21.499
  09:44:52 STEP 1782 H= 445:30 +CPU= 21.439
  09:45:14 STEP 1783 H= 445:45 +CPU= 21.196
  09:45:37 STEP 1784 H= 446:00 +CPU= 22.425
  09:45:59 STEP 1785 H= 446:15 +CPU= 21.906
  09:46:21 STEP 1786 H= 446:30 +CPU= 21.138
  09:46:43 STEP 1787 H= 446:45 +CPU= 21.281
  09:47:10 STEP 1788 H= 447:00 +CPU= 26.710
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001788
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001788
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001788
  09:47:32 STEP 1789 H= 447:15 +CPU= 21.238
  09:47:54 STEP 1790 H= 447:30 +CPU= 21.849
  09:48:16 STEP 1791 H= 447:45 +CPU= 21.099
  09:48:39 STEP 1792 H= 448:00 +CPU= 22.364
  09:49:02 STEP 1793 H= 448:15 +CPU= 22.860
  09:49:26 STEP 1794 H= 448:30 +CPU= 22.733
  09:49:50 STEP 1795 H= 448:45 +CPU= 23.085
  09:50:15 STEP 1796 H= 449:00 +CPU= 23.445
  09:50:38 STEP 1797 H= 449:15 +CPU= 22.737
  09:51:01 STEP 1798 H= 449:30 +CPU= 21.721
  09:51:23 STEP 1799 H= 449:45 +CPU= 21.935
  09:51:52 STEP 1800 H= 450:00 +CPU= 27.733
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001800
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001800
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001800
  09:52:14 STEP 1801 H= 450:15 +CPU= 21.453
  09:52:36 STEP 1802 H= 450:30 +CPU= 21.385
  09:52:58 STEP 1803 H= 450:45 +CPU= 21.235
  09:53:20 STEP 1804 H= 451:00 +CPU= 22.100
  09:53:43 STEP 1805 H= 451:15 +CPU= 22.190
  09:54:06 STEP 1806 H= 451:30 +CPU= 21.799
  09:54:29 STEP 1807 H= 451:45 +CPU= 22.315
  09:54:53 STEP 1808 H= 452:00 +CPU= 22.741
  09:55:16 STEP 1809 H= 452:15 +CPU= 21.859
Suspend request received from the BOINC client, suspending the child process
[EC_DRHOOK:Mint18:1:1:198859:198859] [20240813:100230:1723564950:32616.851] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1538] Received signal#15 (SIGTERM) :: 5298MB (heap), 4796MB (maxrss), 0MB (maxstack), 0 (paging), nsigs = 1
[EC_DRHOOK:Mint18:1:1:198859:198859] [20240813:100230:1723564950:32616.851] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1542] Also activating Harakiri-alarm (SIGALRM=14) to expire after 500s elapsed to prevent hangs, nsigs = 1
[EC_DRHOOK:Mint18:1:1:198859:198859] [20240813:100230:1723564950:32616.851] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1544] Harakiri signal handler 'signal_harakiri' for signal#14 (SIGALRM) installed at 0x820890 (old at (nil))
[EC_DRHOOK:Mint18:1:1:198859:198859] [20240813:100230:1723564950:32616.851] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1617] Signal#15 was caused by unrecognized si_code [memaddr=0x1], nsigs = 1
[EC_DRHOOK:Mint18:1:1:198859:198859] [20240813:100230:1723564950:32616.851] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1686] Starting DrHook backtrace for signal#15, nsigs = 1
[EC_DRHOOK:Mint18:1:1:198859:198859] [20240813:100230:1723564950:32616.851] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3843] 5298 MB (maxheap), 4796 MB (maxrss), 0 MB (maxstack)
[EC_DRHOOK:Mint18:1:1:198859:198859] [20240813:100230:1723564950:32616.851] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :  MASTER 
[EC_DRHOOK:Mint18:1:1:198859:198859] [20240813:100230:1723564950:32616.851] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :   CNT0 
[EC_DRHOOK:Mint18:1:1:198859:198859] [20240813:100230:1723564950:32616.851] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :    CNT1 
[EC_DRHOOK:Mint18:1:1:198859:198859] [20240813:100230:1723564950:32616.851] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :     CNT2 
[EC_DRHOOK:Mint18:1:1:198859:198859] [20240813:100230:1723564950:32616.851] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :      CNT3 
[EC_DRHOOK:Mint18:1:1:198859:198859] [20240813:100230:1723564950:32616.851] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :       CNT4 
[EC_DRHOOK:Mint18:1:1:198859:198859] [20240813:100230:1723564950:32616.851] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :        STEPO 
[EC_DRHOOK:Mint18:1:1:198859:198859] [20240813:100230:1723564950:32616.851] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :         SCAN2M 
[EC_DRHOOK:Mint18:1:1:198859:198859] [20240813:100230:1723564950:32616.851] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :          GP_MODEL_HEAP 
[EC_DRHOOK:Mint18:1:1:198859:198859] [20240813:100230:1723564950:32616.851] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :           GP_MODEL 
[EC_DRHOOK:Mint18:1:1:198859:198859] [20240813:100230:1723564950:32616.851] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :            CALL_SL_HEAP 
[EC_DRHOOK:Mint18:1:1:198859:198859] [20240813:100230:1723564950:32616.851] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :             CALL_SL 
[EC_DRHOOK:Mint18:1:1:198859:198859] [20240813:100230:1723564950:32616.851] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :              >OMP-CALL_SL     2        (1005) 
[EC_DRHOOK:Mint18:1:1:198859:198859] [20240813:100230:1723564950:32616.851] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :               LAPINEB 
[EC_DRHOOK:Mint18:1:1:198859:198859] [20240813:100230:1723564950:32616.851] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :                LARCINB 
[EC_DRHOOK:Mint18:1:1:198859:198859] [20240813:100230:1723564950:32616.851] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :                 LAITLI 
[EC_DRHOOK:Mint18:1:1:198859:198859] [20240813:100231:1723564951:32617.851] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1734] DrHook backtrace done for signal#15, nsigs = 1
[EC_DRHOOK:Mint18:1:1:198859:198859] [20240813:100231:1723564951:32617.851] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1785] Calling previous signal handler at 0x1cf8da0 for signal#15, nsigs = 1
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source             
oifs_43r3_model.e  0000000001CF935B  Unknown               Unknown  Unknown
oifs_43r3_model.e  00000000008214C1  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DD5490  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000000BEC146  laitli_                   151  laitli.F90
oifs_43r3_model.e  0000000000DCEF68  larcinb_                  354  larcinb.F90
oifs_43r3_model.e  0000000000D8A8F8  lapineb_                  451  lapineb.F90
oifs_43r3_model.e  0000000000D57FC1  call_sl_                  363  call_sl.F90
oifs_43r3_model.e  0000000000D54BBC  call_sl_heap_              94  call_sl_heap.F90
oifs_43r3_model.e  0000000000BD4FD8  gp_model_                 533  gp_model.F90
oifs_43r3_model.e  00000000012C5002  gp_model_heap_             74  gp_model_heap.F90
oifs_43r3_model.e  0000000000BACBAE  scan2m_                   535  scan2m.F90
oifs_43r3_model.e  0000000000688153  stepo_                    327  stepo.F90
oifs_43r3_model.e  00000000004CD1DC  cnt4_                    1133  cnt4.F90
oifs_43r3_model.e  00000000004B5D85  cnt3_                     267  cnt3.F90
oifs_43r3_model.e  00000000004B4F52  cnt2_                      88  cnt2.F90
oifs_43r3_model.e  000000000049D638  cnt1_                      92  cnt1.F90
oifs_43r3_model.e  0000000000406FBD  cnt0_                     146  cnt0.F90
oifs_43r3_model.e  0000000000401E7F  MAIN__                     96  master.F90
oifs_43r3_model.e  0000000000401E12  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DCC34A  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DCDBE7  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000000401CD5  Unknown               Unknown  Unknown
(argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.13_x86_64-pc-linux-gnu
(argv1) start_date: 2016092300
(argv2) exptid: h7zg
(argv3) unique_member_id: a4bf
(argv4) batchid: 1018
(argv5) wuid: 12293922
(argv6) fclen: 20
(argv7) app_name: oifs_43r3_bl
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/2
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_bl
version: 1.13
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/2/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/2/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_7316c7601f61d10d4062291f5d25b6d0 to: /var/lib/boinc-client/slots/2/oifs_43r3_bl_a4bf_2016092300_20_1018_12293922.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/2/oifs_43r3_bl_a4bf_2016092300_20_1018_12293922.zip
ic_ancil_file: ic_ancil_12293922
ifsdata_file: ifsdata_12293922
climate_data_file: clim_data_12293922
horiz_resolution: 159
vert_resolution: 91
grid_type: l_2
upload_interval: 96
utstep: 900
nfrres: restart dump frequency (steps) 48
Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /var/lib/boinc-client/slots/2/ic_ancil_12293922.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/2/ic_ancil_12293922.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_2807f2a3754f6f27f400c1a5697da00f to: /var/lib/boinc-client/slots/2/ifsdata/ifsdata_12293922.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/2/ifsdata/ifsdata_12293922.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/2/159l_2/clim_data_12293922.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/2/159l_2/clim_data_12293922.zip
Checking for progress XML file: /var/lib/boinc-client/slots/2/progress_file_12293922.xml
Opened progress file ok : /var/lib/boinc-client/slots/2/progress_file_12293922.xml
-- Model is restarting --
Adjusting last_iter, 1810, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/2/progress_file_12293922.xml
last_cpu_time: 44741
upload_file_number: 18
last_iter: 1777
last_upload: 1555200
model_completed: 0
total_length_of_simulation: 1728000
result_base_name: oifs_43r3_bl_a4bf_2016092300_20_1018_12293922_1_r277166911
The child process has been launched with process id: 235457
Executing the command: /var/lib/boinc-client/slots/2/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:Mint18:1:1:235457:235457] [20240813:181519:1723594519:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2091] fp = 0x314f440
[EC_DRHOOK:Mint18:1:1:235457:235457] [20240813:181519:1723594519:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:Mint18:1:1:235457:235457] [20240813:181519:1723594519:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:Mint18:1:1:235457:235457] [20240813:181519:1723594519:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:Mint18:1:1:235457:235457] [20240813:181519:1723594519:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:Mint18:1:1:235457:235457] [20240813:181519:1723594519:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:Mint18:1:1:235457:235457] [20240813:181519:1723594519:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:Mint18:1:1:235457:235457] [20240813:181519:1723594519:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:Mint18:1:1:235457:235457] [20240813:181519:1723594519:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:Mint18:1:1:235457:235457] [20240813:181519:1723594519:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:Mint18:1:1:235457:235457] [20240813:181519:1723594519:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:Mint18:1:1:235457:235457] [20240813:181519:1723594519:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:Mint18:1:1:235457:235457] [20240813:181519:1723594519:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:Mint18:1:1:235457:235457] [20240813:181519:1723594519:0.000] [ignore_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:Mint18:1:1:235457:235457] [20240813:181519:1723594519:0.000] [restore_default_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:Mint18:1:1:235457:235457] [20240813:181519:1723594519:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Mint18:1:1:235457:235457] [20240813:181519:1723594519:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Mint18:1:1:235457:235457] [20240813:181519:1723594519:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Mint18:1:1:235457:235457] [20240813:181519:1723594519:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Mint18:1:1:235457:235457] [20240813:181519:1723594519:0.000] [trapfpe_treatment@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:Mint18:1:1:235457:235457] [20240813:181519:1723594519:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Mint18:1:1:235457:235457] [20240813:181519:1723594519:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Mint18:1:1:235457:235457] [20240813:181519:1723594519:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Mint18:1:1:235457:235457] [20240813:181519:1723594519:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Mint18:1:1:235457:235457] [20240813:181519:1723594519:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Mint18:1:1:235457:235457] [20240813:181519:1723594519:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Mint18:1:1:235457:235457] [20240813:181519:1723594519:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Mint18:1:1:235457:235457] [20240813:181519:1723594519:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Mint18:1:1:235457:235457] [20240813:181519:1723594519:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Mint18:1:1:235457:235457] [20240813:181519:1723594519:0.000] [catch_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  18:15:45 STEP 1776 H= 444:00 +CPU= 21.885
  18:16:04 STEP 1777 H= 444:15 +CPU= 18.313
  18:16:24 STEP 1778 H= 444:30 +CPU= 20.648
  18:16:46 STEP 1779 H= 444:45 +CPU= 21.459
  18:17:06 STEP 1780 H= 445:00 +CPU= 19.593
  18:17:27 STEP 1781 H= 445:15 +CPU= 21.764
  18:17:45 STEP 1782 H= 445:30 +CPU= 18.021
  18:18:02 STEP 1783 H= 445:45 +CPU= 16.950
  18:18:24 STEP 1784 H= 446:00 +CPU= 21.160
  18:18:44 STEP 1785 H= 446:15 +CPU= 20.315
  18:19:06 STEP 1786 H= 446:30 +CPU= 22.182
  18:19:26 STEP 1787 H= 446:45 +CPU= 19.652
  18:19:51 STEP 1788 H= 447:00 +CPU= 25.206
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001788
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001788
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001788
  18:20:12 STEP 1789 H= 447:15 +CPU= 20.810
  18:20:33 STEP 1790 H= 447:30 +CPU= 21.435
  18:20:53 STEP 1791 H= 447:45 +CPU= 20.001
  18:21:16 STEP 1792 H= 448:00 +CPU= 22.583
  18:21:35 STEP 1793 H= 448:15 +CPU= 19.399
  18:21:55 STEP 1794 H= 448:30 +CPU= 19.677
  18:22:15 STEP 1795 H= 448:45 +CPU= 19.645
  18:22:35 STEP 1796 H= 449:00 +CPU= 20.288
  18:22:54 STEP 1797 H= 449:15 +CPU= 19.083
  18:23:15 STEP 1798 H= 449:30 +CPU= 20.478
  18:23:35 STEP 1799 H= 449:45 +CPU= 20.311
  18:24:02 STEP 1800 H= 450:00 +CPU= 26.790
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001800
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001800
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001800
  18:24:22 STEP 1801 H= 450:15 +CPU= 19.860
  18:24:39 STEP 1802 H= 450:30 +CPU= 17.595
  18:24:58 STEP 1803 H= 450:45 +CPU= 18.871
  18:25:21 STEP 1804 H= 451:00 +CPU= 22.443
  18:25:43 STEP 1805 H= 451:15 +CPU= 21.874
  18:26:02 STEP 1806 H= 451:30 +CPU= 18.999
  18:26:21 STEP 1807 H= 451:45 +CPU= 19.412
  18:26:43 STEP 1808 H= 452:00 +CPU= 22.191
  18:27:04 STEP 1809 H= 452:15 +CPU= 20.380
  18:27:25 STEP 1810 H= 452:30 +CPU= 21.750
  18:27:44 STEP 1811 H= 452:45 +CPU= 19.096
  18:28:10 STEP 1812 H= 453:00 +CPU= 25.752
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001812
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001812
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001812
  18:28:27 STEP 1813 H= 453:15 +CPU= 17.169
  18:28:52 STEP 1814 H= 453:30 +CPU= 24.179
  18:29:13 STEP 1815 H= 453:45 +CPU= 20.903
  18:29:33 STEP 1816 H= 454:00 +CPU= 20.345
  18:29:53 STEP 1817 H= 454:15 +CPU= 20.403
  18:30:13 STEP 1818 H= 454:30 +CPU= 19.234
  18:30:31 STEP 1819 H= 454:45 +CPU= 18.812
  18:30:50 STEP 1820 H= 455:00 +CPU= 18.857
  18:31:11 STEP 1821 H= 455:15 +CPU= 21.015
  18:31:30 STEP 1822 H= 455:30 +CPU= 18.796
  18:31:49 STEP 1823 H= 455:45 +CPU= 19.026
  18:32:17 STEP 1824 H= 456:00 +CPU= 27.842
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001824
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001824
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMGGh7zg+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMSHh7zg+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMUAh7zg+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMGGh7zg+001740
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMSHh7zg+001740
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMUAh7zg+001740
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMGGh7zg+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMSHh7zg+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMUAh7zg+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMGGh7zg+001764
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMSHh7zg+001764
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMUAh7zg+001764
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMGGh7zg+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMSHh7zg+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMUAh7zg+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMGGh7zg+001788
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMSHh7zg+001788
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMUAh7zg+001788
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMGGh7zg+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMSHh7zg+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMUAh7zg+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMGGh7zg+001812
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMSHh7zg+001812
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMUAh7zg+001812
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a4bf_2016092300_20_1018_12293922_1_r277166911_18.zip
Uploading the intermediate file: upload_file_18.zip
  18:32:37 STEP 1825 H= 456:15 +CPU= 20.267
  18:32:56 STEP 1826 H= 456:30 +CPU= 18.725
  18:33:18 STEP 1827 H= 456:45 +CPU= 22.171
  18:33:37 STEP 1828 H= 457:00 +CPU= 18.274
  18:33:55 STEP 1829 H= 457:15 +CPU= 18.123
  18:34:18 STEP 1830 H= 457:30 +CPU= 23.296
  18:34:37 STEP 1831 H= 457:45 +CPU= 19.256
  18:34:57 STEP 1832 H= 458:00 +CPU= 19.784
  18:35:18 STEP 1833 H= 458:15 +CPU= 21.270
  18:35:36 STEP 1834 H= 458:30 +CPU= 17.572
  18:35:57 STEP 1835 H= 458:45 +CPU= 21.119
  18:36:23 STEP 1836 H= 459:00 +CPU= 26.110
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001836
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001836
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001836
  18:36:43 STEP 1837 H= 459:15 +CPU= 19.506
  18:37:00 STEP 1838 H= 459:30 +CPU= 17.038
  18:37:20 STEP 1839 H= 459:45 +CPU= 20.134
  18:37:44 STEP 1840 H= 460:00 +CPU= 20.973
  18:38:10 STEP 1841 H= 460:15 +CPU= 19.357
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:53:05 STEP 1842 H= 460:30 +CPU= 20.198
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:53:50 STEP 1843 H= 460:45 +CPU= 24.469
  18:54:17 STEP 1844 H= 461:00 +CPU= 26.308
  18:54:41 STEP 1845 H= 461:15 +CPU= 24.640
  18:55:06 STEP 1846 H= 461:30 +CPU= 24.556
  18:55:30 STEP 1847 H= 461:45 +CPU= 23.976
  18:56:00 STEP 1848 H= 462:00 +CPU= 29.856
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001848
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001848
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001848
  18:56:24 STEP 1849 H= 462:15 +CPU= 24.542
  18:56:49 STEP 1850 H= 462:30 +CPU= 24.042
  18:57:12 STEP 1851 H= 462:45 +CPU= 23.139
  18:57:39 STEP 1852 H= 463:00 +CPU= 27.162
  18:58:06 STEP 1853 H= 463:15 +CPU= 26.730
  18:58:32 STEP 1854 H= 463:30 +CPU= 26.264
  18:58:58 STEP 1855 H= 463:45 +CPU= 25.718
  18:59:24 STEP 1856 H= 464:00 +CPU= 26.230
  18:59:50 STEP 1857 H= 464:15 +CPU= 25.254
  19:00:17 STEP 1858 H= 464:30 +CPU= 23.545
  19:00:44 STEP 1859 H= 464:45 +CPU= 22.293
  19:01:16 STEP 1860 H= 465:00 +CPU= 28.029
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001860
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001860
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001860
  19:01:43 STEP 1861 H= 465:15 +CPU= 22.916
  19:02:09 STEP 1862 H= 465:30 +CPU= 23.297
  19:02:36 STEP 1863 H= 465:45 +CPU= 25.585
  19:03:03 STEP 1864 H= 466:00 +CPU= 26.464
  19:03:30 STEP 1865 H= 466:15 +CPU= 26.216
  19:03:56 STEP 1866 H= 466:30 +CPU= 26.165
  19:04:22 STEP 1867 H= 466:45 +CPU= 25.976
  19:04:48 STEP 1868 H= 467:00 +CPU= 26.194
  19:05:14 STEP 1869 H= 467:15 +CPU= 25.710
  19:05:41 STEP 1870 H= 467:30 +CPU= 26.764
  19:06:07 STEP 1871 H= 467:45 +CPU= 26.246
  19:06:42 STEP 1872 H= 468:00 +CPU= 34.767
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001872
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001872
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001872
  19:07:09 STEP 1873 H= 468:15 +CPU= 26.945
  19:07:35 STEP 1874 H= 468:30 +CPU= 25.175
  19:08:00 STEP 1875 H= 468:45 +CPU= 25.495
  19:08:27 STEP 1876 H= 469:00 +CPU= 26.929
  19:08:50 STEP 1877 H= 469:15 +CPU= 22.781
  19:09:17 STEP 1878 H= 469:30 +CPU= 26.941
  19:09:43 STEP 1879 H= 469:45 +CPU= 25.430
  19:10:10 STEP 1880 H= 470:00 +CPU= 27.279
  19:10:36 STEP 1881 H= 470:15 +CPU= 25.916
  19:11:02 STEP 1882 H= 470:30 +CPU= 25.209
  19:11:28 STEP 1883 H= 470:45 +CPU= 25.839
  19:12:01 STEP 1884 H= 471:00 +CPU= 32.831
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001884
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001884
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001884
  19:12:28 STEP 1885 H= 471:15 +CPU= 26.987
  19:12:54 STEP 1886 H= 471:30 +CPU= 26.467
  19:13:21 STEP 1887 H= 471:45 +CPU= 26.983
  19:13:49 STEP 1888 H= 472:00 +CPU= 27.921
  19:14:15 STEP 1889 H= 472:15 +CPU= 25.638
  19:14:42 STEP 1890 H= 472:30 +CPU= 26.749
  19:15:07 STEP 1891 H= 472:45 +CPU= 25.200
  19:15:35 STEP 1892 H= 473:00 +CPU= 27.331
  19:16:01 STEP 1893 H= 473:15 +CPU= 26.051
  19:16:29 STEP 1894 H= 473:30 +CPU= 27.741
  19:16:54 STEP 1895 H= 473:45 +CPU= 25.490
  19:17:29 STEP 1896 H= 474:00 +CPU= 34.429
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001896
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001896
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001896
  19:17:55 STEP 1897 H= 474:15 +CPU= 25.671
  19:18:17 STEP 1898 H= 474:30 +CPU= 22.606
  19:18:45 STEP 1899 H= 474:45 +CPU= 27.190
  19:19:10 STEP 1900 H= 475:00 +CPU= 25.507
  19:19:37 STEP 1901 H= 475:15 +CPU= 26.432
  19:20:03 STEP 1902 H= 475:30 +CPU= 25.861
  19:20:28 STEP 1903 H= 475:45 +CPU= 25.511
  19:20:54 STEP 1904 H= 476:00 +CPU= 25.952
  19:21:20 STEP 1905 H= 476:15 +CPU= 25.449
  19:21:47 STEP 1906 H= 476:30 +CPU= 26.909
  19:22:15 STEP 1907 H= 476:45 +CPU= 27.494
  19:22:46 STEP 1908 H= 477:00 +CPU= 30.764
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001908
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001908
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001908
  19:23:12 STEP 1909 H= 477:15 +CPU= 25.862
  19:23:38 STEP 1910 H= 477:30 +CPU= 26.659
  19:24:04 STEP 1911 H= 477:45 +CPU= 25.111
  19:24:29 STEP 1912 H= 478:00 +CPU= 25.195
  19:24:57 STEP 1913 H= 478:15 +CPU= 27.991
  19:25:23 STEP 1914 H= 478:30 +CPU= 25.984
  19:25:50 STEP 1915 H= 478:45 +CPU= 26.769
  19:26:16 STEP 1916 H= 479:00 +CPU= 25.877
  19:26:41 STEP 1917 H= 479:15 +CPU= 25.489
  19:27:06 STEP 1918 H= 479:30 +CPU= 24.761
  19:27:31 STEP 1919 H= 479:45 +CPU= 24.624
  19:28:04 STEP 1920 H= 480:00 +CPU= 32.339
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

 
DDH------------------------------------------------------------------------
I                                                                         I
I TIME =  480.000H DDH * Diagnostic Var.,     AREA                GLOBAL  I
I                                                                         I
I-------------------------------------------------------------------------I
I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I     -0.9578808648E-21      I      -0.1335714538E-06      I
ICloud fractionI      0.0000000000E+00      I       0.2957698769E-01      I
I  Relat. Hum. I      0.2144229495E+00      I       0.3038467460E+00      I
I  PASS 01     I      0.0000000000E+00      I       0.3125048947E+03      I
DDH------------------------------------------------------------------------
  
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1920 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001920 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001920
 MPI-TASK:   1 -    309710660 BYTES IN      7 RECORDS TRANSFERRED IN    0.0005 SECONDS619421.3 Mbytes/s, TOTAL TIME=    0.0099( 5.1%)
 19:28:04 STEP 1920 H= 480:00 +CPU= 32.339
 END CNT3
 NSTEP =  1920 CNT0   000000000  23.665  23.665  23.804   0.994               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ           46/  1069125708 WRITTEN         4290/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1     78    0       46      1044068     4290 ************     8.9     2.1     6.8     2.9    13.8
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 4364673.7 4364673.7    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 4360294.1 4360294.1     99.90      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                  157   10154.1   10154.1     36.52      0.00
   9 SPCM     - SPECTRAL COMP.                     144     751.2     751.2      2.48      0.00
  10 SCAN2M - PHYSICS                              145   10126.4   10126.4     33.64      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                 12     821.4     821.4      0.23      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                  7      58.8      58.8      0.01      0.00
  17 GRIDFPOS IN CNT4                               12      24.7      24.7      0.01      0.00
  27 RESTART FILES - WRITING                         3    3285.5    3285.5      0.23      0.00
  28 RESTART FILES - READING                         1    3768.8    3768.8      0.09      0.00
  29 SU4FPOS IN CNT4                                12       0.0       0.0      0.00      0.00
  30 DYNFPOS IN CNT4                                12    5082.7    5082.7      1.40      0.00
  31 POSDDH IN STEPO                                 1       5.9       5.9      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                    145    5195.1    5195.1     17.26      0.00
  39 SU0YOMB                                         1     367.0     367.0      0.01      0.00
  51 SCAN2M   - SL COMM. PART 1                    145      23.8      23.8      0.08      0.00
  54 SPCM     - M TO S/S TO M TRANSP.              144     367.3     367.3      1.21      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.              144      59.3      59.3      0.20      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                  7       0.2       0.2      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM      316     343.4     343.4      2.49      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM       300     201.0     201.0      1.38      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM        300      81.8      81.8      0.56      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM       316     113.1     113.1      0.82      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1      37.9      37.9      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION            316      66.3      66.3      0.48      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION            300      35.3      35.3      0.24      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION            316      95.8      95.8      0.69      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION            300      47.1      47.1      0.32      0.00
 400 GSTATS                                      17763       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                 16473       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME     4364.7 CPU TIME    3428.5 VECTOR TIME     3428.5


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY      396.3
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001920
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001920
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001920
Adding to the zip: /var/lib/boinc-client/slots/2/NODE.001_01
Adding to the zip: /var/lib/boinc-client/slots/2/ifs.stat
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMSHh7zg+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMUAh7zg+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMGGh7zg+001884
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMSHh7zg+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMGGh7zg+001908
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMSHh7zg+001908
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMUAh7zg+001884
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMUAh7zg+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMUAh7zg+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMSHh7zg+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMGGh7zg+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMUAh7zg+001836
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMGGh7zg+001860
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMGGh7zg+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMSHh7zg+001836
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMGGh7zg+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMUAh7zg+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMSHh7zg+001884
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMGGh7zg+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMUAh7zg+001908
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMGGh7zg+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMUAh7zg+001860
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMGGh7zg+001836
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMSHh7zg+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMSHh7zg+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMUAh7zg+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293922/ICMSHh7zg+001860
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a4bf_2016092300_20_1018_12293922_1_r277166911_19.zip
Uploading the final file: upload_file_19.zip
Uploading trickle at timestep: 1727100
19:31:32 (235435): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
14 Aug 2024 03:23:37 1552211 22505805 oifs_43r3_bl_a4bf_2016092300_20_1018_12293922_1 1,727,100 48,169 0.0279


©2024 cpdn.org