climateprediction.net (CPDN) home page
Task 22444198

Task 22444198

Name oifs_43r3_bl_a1r6_2016092300_20_1018_12290601_0
Workunit 12290601
Created 12 Jun 2024, 23:17:55 UTC
Sent 13 Jun 2024, 12:43:00 UTC
Report deadline 12 Aug 2024, 12:43:00 UTC
Received 14 Jun 2024, 11:36:16 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1494567
Run time 13 hours 18 min 13 sec
CPU time 13 hours 12 min 52 sec
Validate state Valid
Credit 2,635.55
Device peak FLOPS 4.47 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.13
x86_64-pc-linux-gnu
Peak working set size 4.91 GB
Peak swap size 5.84 GB
Peak disk usage 1.32 GB
Stderr
<core_client_version>7.16.6</core_client_version>
<![CDATA[
<stderr_txt>
3_bl_12290601/ICMSHh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMGGh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMSHh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMUAh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMGGh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMSHh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMUAh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMGGh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMSHh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMUAh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMGGh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMSHh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMUAh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMGGh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMSHh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMUAh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMGGh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMSHh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMUAh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMGGh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMSHh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMUAh7zg+001428
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a1r6_2016092300_20_1018_12290601_0_r605627487_14.zip
Uploading the intermediate file: upload_file_14.zip
  15:39:40 STEP 1441 H= 360:15 +CPU= 24.076
  15:40:04 STEP 1442 H= 360:30 +CPU= 24.070
  15:40:28 STEP 1443 H= 360:45 +CPU= 24.060
  15:40:52 STEP 1444 H= 361:00 +CPU= 24.642
  15:41:17 STEP 1445 H= 361:15 +CPU= 24.159
  15:41:41 STEP 1446 H= 361:30 +CPU= 24.196
  15:42:05 STEP 1447 H= 361:45 +CPU= 24.032
  15:42:30 STEP 1448 H= 362:00 +CPU= 24.622
  15:42:54 STEP 1449 H= 362:15 +CPU= 24.123
  15:43:18 STEP 1450 H= 362:30 +CPU= 23.961
  15:43:42 STEP 1451 H= 362:45 +CPU= 23.996
  15:44:12 STEP 1452 H= 363:00 +CPU= 29.832
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001452
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001452
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001452
  15:44:35 STEP 1453 H= 363:15 +CPU= 23.969
  15:45:00 STEP 1454 H= 363:30 +CPU= 24.036
  15:45:24 STEP 1455 H= 363:45 +CPU= 24.016
  15:45:48 STEP 1456 H= 364:00 +CPU= 24.595
  15:46:12 STEP 1457 H= 364:15 +CPU= 24.140
  15:46:37 STEP 1458 H= 364:30 +CPU= 24.188
  15:47:01 STEP 1459 H= 364:45 +CPU= 24.200
  15:47:25 STEP 1460 H= 365:00 +CPU= 24.575
  15:47:49 STEP 1461 H= 365:15 +CPU= 24.120
  15:48:14 STEP 1462 H= 365:30 +CPU= 24.068
  15:48:38 STEP 1463 H= 365:45 +CPU= 23.966
  15:49:07 STEP 1464 H= 366:00 +CPU= 29.832
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001464
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001464
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001464
  15:49:31 STEP 1465 H= 366:15 +CPU= 23.945
  15:49:55 STEP 1466 H= 366:30 +CPU= 23.982
  15:50:19 STEP 1467 H= 366:45 +CPU= 24.050
  15:50:44 STEP 1468 H= 367:00 +CPU= 24.551
  15:51:08 STEP 1469 H= 367:15 +CPU= 24.080
  15:51:32 STEP 1470 H= 367:30 +CPU= 24.168
  15:51:56 STEP 1471 H= 367:45 +CPU= 24.186
  15:52:21 STEP 1472 H= 368:00 +CPU= 24.705
  15:52:45 STEP 1473 H= 368:15 +CPU= 24.038
  15:53:09 STEP 1474 H= 368:30 +CPU= 23.938
  15:53:33 STEP 1475 H= 368:45 +CPU= 24.081
  15:54:03 STEP 1476 H= 369:00 +CPU= 29.835
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001476
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001476
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001476
  15:54:27 STEP 1477 H= 369:15 +CPU= 23.940
  15:54:51 STEP 1478 H= 369:30 +CPU= 24.084
  15:55:15 STEP 1479 H= 369:45 +CPU= 24.108
  15:55:40 STEP 1480 H= 370:00 +CPU= 24.651
  15:56:04 STEP 1481 H= 370:15 +CPU= 24.151
  15:56:28 STEP 1482 H= 370:30 +CPU= 24.181
  15:56:53 STEP 1483 H= 370:45 +CPU= 24.190
  15:57:17 STEP 1484 H= 371:00 +CPU= 24.707
  15:57:41 STEP 1485 H= 371:15 +CPU= 24.154
  15:58:05 STEP 1486 H= 371:30 +CPU= 24.034
  15:58:29 STEP 1487 H= 371:45 +CPU= 24.015
  15:59:02 STEP 1488 H= 372:00 +CPU= 32.235
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001488
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001488
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001488
  15:59:26 STEP 1489 H= 372:15 +CPU= 24.105
  15:59:50 STEP 1490 H= 372:30 +CPU= 23.946
  16:00:14 STEP 1491 H= 372:45 +CPU= 24.013
  16:00:39 STEP 1492 H= 373:00 +CPU= 24.642
  16:01:03 STEP 1493 H= 373:15 +CPU= 24.061
  16:01:27 STEP 1494 H= 373:30 +CPU= 24.049
  16:01:51 STEP 1495 H= 373:45 +CPU= 24.172
  16:02:16 STEP 1496 H= 374:00 +CPU= 24.723
  16:02:40 STEP 1497 H= 374:15 +CPU= 24.166
  16:03:04 STEP 1498 H= 374:30 +CPU= 24.111
  16:03:28 STEP 1499 H= 374:45 +CPU= 24.152
  16:03:58 STEP 1500 H= 375:00 +CPU= 29.648
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001500
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001500
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001500
  16:04:22 STEP 1501 H= 375:15 +CPU= 24.082
  16:04:46 STEP 1502 H= 375:30 +CPU= 24.076
  16:05:10 STEP 1503 H= 375:45 +CPU= 23.940
  16:05:35 STEP 1504 H= 376:00 +CPU= 24.695
  16:05:59 STEP 1505 H= 376:15 +CPU= 24.042
  16:06:23 STEP 1506 H= 376:30 +CPU= 24.083
  16:06:47 STEP 1507 H= 376:45 +CPU= 24.077
  16:07:12 STEP 1508 H= 377:00 +CPU= 24.713
  16:07:36 STEP 1509 H= 377:15 +CPU= 24.165
  16:08:00 STEP 1510 H= 377:30 +CPU= 24.187
  16:08:24 STEP 1511 H= 377:45 +CPU= 24.098
  16:08:54 STEP 1512 H= 378:00 +CPU= 29.784
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001512
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001512
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001512
  16:09:18 STEP 1513 H= 378:15 +CPU= 24.043
  16:09:42 STEP 1514 H= 378:30 +CPU= 24.131
  16:10:06 STEP 1515 H= 378:45 +CPU= 24.026
  16:10:31 STEP 1516 H= 379:00 +CPU= 24.504
  16:10:55 STEP 1517 H= 379:15 +CPU= 24.059
  16:11:19 STEP 1518 H= 379:30 +CPU= 24.047
  16:11:43 STEP 1519 H= 379:45 +CPU= 24.060
  16:12:08 STEP 1520 H= 380:00 +CPU= 24.699
  16:12:32 STEP 1521 H= 380:15 +CPU= 24.159
  16:12:56 STEP 1522 H= 380:30 +CPU= 24.163
  16:13:20 STEP 1523 H= 380:45 +CPU= 24.183
  16:13:50 STEP 1524 H= 381:00 +CPU= 29.811
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001524
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001524
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001524
  16:14:13 STEP 1525 H= 381:15 +CPU= 23.192
  16:14:35 STEP 1526 H= 381:30 +CPU= 21.637
  16:14:57 STEP 1527 H= 381:45 +CPU= 21.584
  16:15:19 STEP 1528 H= 382:00 +CPU= 22.487
  16:15:41 STEP 1529 H= 382:15 +CPU= 21.660
  16:16:03 STEP 1530 H= 382:30 +CPU= 21.998
  16:16:25 STEP 1531 H= 382:45 +CPU= 21.768
  16:16:47 STEP 1532 H= 383:00 +CPU= 22.262
  16:17:09 STEP 1533 H= 383:15 +CPU= 21.723
  16:17:30 STEP 1534 H= 383:30 +CPU= 21.670
  16:17:52 STEP 1535 H= 383:45 +CPU= 21.659
  16:18:21 STEP 1536 H= 384:00 +CPU= 29.415
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001536
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001536
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001536
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMGGh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMSHh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMGGh7zg+001452
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMSHh7zg+001452
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMUAh7zg+001452
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMGGh7zg+001464
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMSHh7zg+001464
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMUAh7zg+001464
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMGGh7zg+001476
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMSHh7zg+001476
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMUAh7zg+001476
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMGGh7zg+001488
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMSHh7zg+001488
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMUAh7zg+001488
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMGGh7zg+001500
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMSHh7zg+001500
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMUAh7zg+001500
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMGGh7zg+001512
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMSHh7zg+001512
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMUAh7zg+001512
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMGGh7zg+001524
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMSHh7zg+001524
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMUAh7zg+001524
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a1r6_2016092300_20_1018_12290601_0_r605627487_15.zip
Uploading the intermediate file: upload_file_15.zip
  16:18:43 STEP 1537 H= 384:15 +CPU= 21.794
  16:19:05 STEP 1538 H= 384:30 +CPU= 21.852
  16:19:27 STEP 1539 H= 384:45 +CPU= 21.755
  16:19:49 STEP 1540 H= 385:00 +CPU= 22.122
  16:20:11 STEP 1541 H= 385:15 +CPU= 21.619
  16:20:32 STEP 1542 H= 385:30 +CPU= 21.620
  16:20:54 STEP 1543 H= 385:45 +CPU= 21.561
  16:21:16 STEP 1544 H= 386:00 +CPU= 22.143
  16:21:37 STEP 1545 H= 386:15 +CPU= 21.592
  16:21:59 STEP 1546 H= 386:30 +CPU= 21.642
  16:22:21 STEP 1547 H= 386:45 +CPU= 21.583
  16:22:48 STEP 1548 H= 387:00 +CPU= 26.804
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001548
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001548
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001548
  16:23:09 STEP 1549 H= 387:15 +CPU= 21.575
  16:23:31 STEP 1550 H= 387:30 +CPU= 21.646
  16:23:52 STEP 1551 H= 387:45 +CPU= 21.592
  16:24:14 STEP 1552 H= 388:00 +CPU= 22.089
  16:24:36 STEP 1553 H= 388:15 +CPU= 21.549
  16:24:58 STEP 1554 H= 388:30 +CPU= 21.606
  16:25:19 STEP 1555 H= 388:45 +CPU= 21.566
  16:25:41 STEP 1556 H= 389:00 +CPU= 22.099
  16:26:03 STEP 1557 H= 389:15 +CPU= 21.568
  16:26:24 STEP 1558 H= 389:30 +CPU= 21.616
  16:26:46 STEP 1559 H= 389:45 +CPU= 21.604
  16:27:13 STEP 1560 H= 390:00 +CPU= 26.877
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001560
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001560
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001560
  16:27:35 STEP 1561 H= 390:15 +CPU= 21.640
  16:27:56 STEP 1562 H= 390:30 +CPU= 21.630
  16:28:18 STEP 1563 H= 390:45 +CPU= 21.675
  16:28:40 STEP 1564 H= 391:00 +CPU= 22.161
  16:29:02 STEP 1565 H= 391:15 +CPU= 21.646
  16:29:24 STEP 1566 H= 391:30 +CPU= 21.697
  16:29:45 STEP 1567 H= 391:45 +CPU= 21.627
  16:30:07 STEP 1568 H= 392:00 +CPU= 22.172
  16:30:29 STEP 1569 H= 392:15 +CPU= 21.666
  16:30:51 STEP 1570 H= 392:30 +CPU= 21.630
  16:31:12 STEP 1571 H= 392:45 +CPU= 21.642
  16:31:39 STEP 1572 H= 393:00 +CPU= 26.833
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001572
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001572
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001572
  16:32:01 STEP 1573 H= 393:15 +CPU= 21.702
  16:32:23 STEP 1574 H= 393:30 +CPU= 21.693
  16:32:44 STEP 1575 H= 393:45 +CPU= 21.664
  16:33:06 STEP 1576 H= 394:00 +CPU= 22.150
  16:33:28 STEP 1577 H= 394:15 +CPU= 21.663
  16:33:50 STEP 1578 H= 394:30 +CPU= 21.685
  16:34:11 STEP 1579 H= 394:45 +CPU= 21.714
  16:34:34 STEP 1580 H= 395:00 +CPU= 22.196
  16:34:55 STEP 1581 H= 395:15 +CPU= 21.637
  16:35:17 STEP 1582 H= 395:30 +CPU= 21.689
  16:35:39 STEP 1583 H= 395:45 +CPU= 21.614
  16:36:08 STEP 1584 H= 396:00 +CPU= 29.418
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001584
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001584
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001584
  16:36:30 STEP 1585 H= 396:15 +CPU= 21.715
  16:36:51 STEP 1586 H= 396:30 +CPU= 21.603
  16:37:13 STEP 1587 H= 396:45 +CPU= 21.662
  16:37:35 STEP 1588 H= 397:00 +CPU= 22.223
  16:37:57 STEP 1589 H= 397:15 +CPU= 21.699
  16:38:19 STEP 1590 H= 397:30 +CPU= 21.648
  16:38:40 STEP 1591 H= 397:45 +CPU= 21.706
  16:39:03 STEP 1592 H= 398:00 +CPU= 22.169
  16:39:24 STEP 1593 H= 398:15 +CPU= 21.615
  16:39:46 STEP 1594 H= 398:30 +CPU= 21.611
  16:40:08 STEP 1595 H= 398:45 +CPU= 21.640
  16:40:34 STEP 1596 H= 399:00 +CPU= 26.917
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001596
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001596
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001596
  16:40:56 STEP 1597 H= 399:15 +CPU= 21.611
  16:41:18 STEP 1598 H= 399:30 +CPU= 21.588
  16:41:39 STEP 1599 H= 399:45 +CPU= 21.601
  16:42:01 STEP 1600 H= 400:00 +CPU= 22.151
  16:42:23 STEP 1601 H= 400:15 +CPU= 21.613
  16:42:45 STEP 1602 H= 400:30 +CPU= 21.733
  16:43:06 STEP 1603 H= 400:45 +CPU= 21.604
  16:43:29 STEP 1604 H= 401:00 +CPU= 22.154
  16:43:50 STEP 1605 H= 401:15 +CPU= 21.657
  16:44:12 STEP 1606 H= 401:30 +CPU= 21.649
  16:44:34 STEP 1607 H= 401:45 +CPU= 21.667
  16:45:01 STEP 1608 H= 402:00 +CPU= 26.894
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001608
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001608
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001608
  16:45:22 STEP 1609 H= 402:15 +CPU= 21.632
  16:45:44 STEP 1610 H= 402:30 +CPU= 21.589
  16:46:05 STEP 1611 H= 402:45 +CPU= 21.620
  16:46:28 STEP 1612 H= 403:00 +CPU= 22.191
  16:46:49 STEP 1613 H= 403:15 +CPU= 21.664
  16:47:11 STEP 1614 H= 403:30 +CPU= 21.633
  16:47:33 STEP 1615 H= 403:45 +CPU= 21.597
  16:47:55 STEP 1616 H= 404:00 +CPU= 22.145
  16:48:16 STEP 1617 H= 404:15 +CPU= 21.632
  16:48:38 STEP 1618 H= 404:30 +CPU= 21.676
  16:49:00 STEP 1619 H= 404:45 +CPU= 21.573
  16:49:26 STEP 1620 H= 405:00 +CPU= 26.911
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001620
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001620
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001620
  16:49:48 STEP 1621 H= 405:15 +CPU= 21.642
  16:50:10 STEP 1622 H= 405:30 +CPU= 21.662
  16:50:31 STEP 1623 H= 405:45 +CPU= 21.655
  16:50:54 STEP 1624 H= 406:00 +CPU= 22.176
  16:51:15 STEP 1625 H= 406:15 +CPU= 21.600
  16:51:37 STEP 1626 H= 406:30 +CPU= 21.614
  16:51:59 STEP 1627 H= 406:45 +CPU= 21.605
  16:52:21 STEP 1628 H= 407:00 +CPU= 22.169
  16:52:42 STEP 1629 H= 407:15 +CPU= 21.583
  16:53:04 STEP 1630 H= 407:30 +CPU= 21.598
  16:53:26 STEP 1631 H= 407:45 +CPU= 21.662
  16:53:55 STEP 1632 H= 408:00 +CPU= 29.336
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001632
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001632
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001632
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMGGh7zg+001536
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMSHh7zg+001536
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMUAh7zg+001536
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMGGh7zg+001548
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMSHh7zg+001548
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMUAh7zg+001548
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMGGh7zg+001560
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMSHh7zg+001560
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMUAh7zg+001560
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMGGh7zg+001572
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMSHh7zg+001572
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMUAh7zg+001572
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMGGh7zg+001584
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMSHh7zg+001584
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMUAh7zg+001584
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMGGh7zg+001596
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMSHh7zg+001596
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMUAh7zg+001596
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMGGh7zg+001608
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMSHh7zg+001608
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMUAh7zg+001608
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMGGh7zg+001620
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMSHh7zg+001620
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMUAh7zg+001620
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a1r6_2016092300_20_1018_12290601_0_r605627487_16.zip
Uploading the intermediate file: upload_file_16.zip
  16:54:17 STEP 1633 H= 408:15 +CPU= 21.790
  16:54:39 STEP 1634 H= 408:30 +CPU= 21.965
  16:55:00 STEP 1635 H= 408:45 +CPU= 21.698
  16:55:23 STEP 1636 H= 409:00 +CPU= 22.170
  16:55:44 STEP 1637 H= 409:15 +CPU= 21.624
  16:56:06 STEP 1638 H= 409:30 +CPU= 21.672
  16:56:28 STEP 1639 H= 409:45 +CPU= 21.685
  16:56:50 STEP 1640 H= 410:00 +CPU= 22.086
  16:57:11 STEP 1641 H= 410:15 +CPU= 21.642
  16:57:33 STEP 1642 H= 410:30 +CPU= 21.594
  16:57:55 STEP 1643 H= 410:45 +CPU= 21.639
  16:58:21 STEP 1644 H= 411:00 +CPU= 26.850
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001644
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001644
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001644
  16:58:43 STEP 1645 H= 411:15 +CPU= 21.570
  16:59:05 STEP 1646 H= 411:30 +CPU= 21.636
  16:59:26 STEP 1647 H= 411:45 +CPU= 21.674
  16:59:48 STEP 1648 H= 412:00 +CPU= 22.139
  17:00:10 STEP 1649 H= 412:15 +CPU= 21.640
  17:00:32 STEP 1650 H= 412:30 +CPU= 21.671
  17:00:53 STEP 1651 H= 412:45 +CPU= 21.620
  17:01:16 STEP 1652 H= 413:00 +CPU= 22.190
  17:01:37 STEP 1653 H= 413:15 +CPU= 21.617
  17:01:59 STEP 1654 H= 413:30 +CPU= 21.617
  17:02:21 STEP 1655 H= 413:45 +CPU= 21.622
  17:02:47 STEP 1656 H= 414:00 +CPU= 26.893
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001656
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001656
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001656
  17:03:09 STEP 1657 H= 414:15 +CPU= 21.665
  17:03:31 STEP 1658 H= 414:30 +CPU= 21.648
  17:03:52 STEP 1659 H= 414:45 +CPU= 21.598
  17:04:15 STEP 1660 H= 415:00 +CPU= 22.234
  17:04:36 STEP 1661 H= 415:15 +CPU= 21.598
  17:04:58 STEP 1662 H= 415:30 +CPU= 21.650
  17:05:20 STEP 1663 H= 415:45 +CPU= 21.629
  17:05:42 STEP 1664 H= 416:00 +CPU= 22.152
  17:06:03 STEP 1665 H= 416:15 +CPU= 21.599
  17:06:25 STEP 1666 H= 416:30 +CPU= 21.660
  17:06:47 STEP 1667 H= 416:45 +CPU= 21.626
  17:07:14 STEP 1668 H= 417:00 +CPU= 26.908
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001668
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001668
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001668
  17:07:35 STEP 1669 H= 417:15 +CPU= 21.653
  17:07:57 STEP 1670 H= 417:30 +CPU= 21.611
  17:08:18 STEP 1671 H= 417:45 +CPU= 21.607
  17:08:41 STEP 1672 H= 418:00 +CPU= 22.182
  17:09:02 STEP 1673 H= 418:15 +CPU= 21.604
  17:09:24 STEP 1674 H= 418:30 +CPU= 21.593
  17:09:45 STEP 1675 H= 418:45 +CPU= 21.580
  17:10:08 STEP 1676 H= 419:00 +CPU= 22.171
  17:10:29 STEP 1677 H= 419:15 +CPU= 21.681
  17:10:51 STEP 1678 H= 419:30 +CPU= 21.555
  17:11:13 STEP 1679 H= 419:45 +CPU= 21.631
  17:11:42 STEP 1680 H= 420:00 +CPU= 29.389
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001680
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001680
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001680
  17:12:04 STEP 1681 H= 420:15 +CPU= 21.673
  17:12:25 STEP 1682 H= 420:30 +CPU= 21.668
  17:12:47 STEP 1683 H= 420:45 +CPU= 21.614
  17:13:09 STEP 1684 H= 421:00 +CPU= 22.166
  17:13:31 STEP 1685 H= 421:15 +CPU= 21.668
  17:13:52 STEP 1686 H= 421:30 +CPU= 21.714
  17:14:14 STEP 1687 H= 421:45 +CPU= 21.625
  17:14:36 STEP 1688 H= 422:00 +CPU= 22.140
  17:14:58 STEP 1689 H= 422:15 +CPU= 21.579
  17:15:20 STEP 1690 H= 422:30 +CPU= 21.668
  17:15:41 STEP 1691 H= 422:45 +CPU= 21.712
  17:16:08 STEP 1692 H= 423:00 +CPU= 26.875
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001692
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001692
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001692
  17:16:30 STEP 1693 H= 423:15 +CPU= 21.736
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.13_x86_64-pc-linux-gnu
(argv1) start_date: 2016092300
(argv2) exptid: h7zg
(argv3) unique_member_id: a1r6
(argv4) batchid: 1018
(argv5) wuid: 12290601
(argv6) fclen: 20
(argv7) app_name: oifs_43r3_bl
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/1
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_bl
version: 1.13
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/1/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/1/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_a758cb8d35e20099f2837cb04249aaeb to: /var/lib/boinc-client/slots/1/oifs_43r3_bl_a1r6_2016092300_20_1018_12290601.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/1/oifs_43r3_bl_a1r6_2016092300_20_1018_12290601.zip
ic_ancil_file: ic_ancil_12290601
ifsdata_file: ifsdata_12290601
climate_data_file: clim_data_12290601
horiz_resolution: 159
vert_resolution: 91
grid_type: l_2
upload_interval: 96
utstep: 900
nfrres: restart dump frequency (steps) 48
Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /var/lib/boinc-client/slots/1/ic_ancil_12290601.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/1/ic_ancil_12290601.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_5cbed336321744dffee881a9f8082b68 to: /var/lib/boinc-client/slots/1/ifsdata/ifsdata_12290601.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/1/ifsdata/ifsdata_12290601.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/1/159l_2/clim_data_12290601.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/1/159l_2/clim_data_12290601.zip
Checking for progress XML file: /var/lib/boinc-client/slots/1/progress_file_12290601.xml
Opened progress file ok : /var/lib/boinc-client/slots/1/progress_file_12290601.xml
-- Model is restarting --
Adjusting last_iter, 1694, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/1/progress_file_12290601.xml
last_cpu_time: 41538
upload_file_number: 17
last_iter: 1681
last_upload: 1468800
model_completed: 0
total_length_of_simulation: 1728000
result_base_name: oifs_43r3_bl_a1r6_2016092300_20_1018_12290601_0_r605627487
The child process has been launched with process id: 47911
Executing the command: /var/lib/boinc-client/slots/1/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:CB-Boinc-01:1:1:47911:47911] [20240613:172025:1718324425:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2091] fp = 0x314f440
[EC_DRHOOK:CB-Boinc-01:1:1:47911:47911] [20240613:172025:1718324425:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:CB-Boinc-01:1:1:47911:47911] [20240613:172025:1718324425:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:CB-Boinc-01:1:1:47911:47911] [20240613:172025:1718324425:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:CB-Boinc-01:1:1:47911:47911] [20240613:172025:1718324425:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:CB-Boinc-01:1:1:47911:47911] [20240613:172025:1718324425:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:CB-Boinc-01:1:1:47911:47911] [20240613:172025:1718324425:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:CB-Boinc-01:1:1:47911:47911] [20240613:172025:1718324425:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:CB-Boinc-01:1:1:47911:47911] [20240613:172025:1718324425:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:CB-Boinc-01:1:1:47911:47911] [20240613:172025:1718324425:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:CB-Boinc-01:1:1:47911:47911] [20240613:172025:1718324425:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:CB-Boinc-01:1:1:47911:47911] [20240613:172025:1718324425:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:CB-Boinc-01:1:1:47911:47911] [20240613:172025:1718324425:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:CB-Boinc-01:1:1:47911:47911] [20240613:172025:1718324425:0.000] [ignore_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:CB-Boinc-01:1:1:47911:47911] [20240613:172025:1718324425:0.000] [restore_default_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:CB-Boinc-01:1:1:47911:47911] [20240613:172025:1718324425:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:CB-Boinc-01:1:1:47911:47911] [20240613:172025:1718324425:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:CB-Boinc-01:1:1:47911:47911] [20240613:172025:1718324425:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:CB-Boinc-01:1:1:47911:47911] [20240613:172025:1718324425:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x820cf0 (old at (nil))
[EC_DRHOOK:CB-Boinc-01:1:1:47911:47911] [20240613:172025:1718324425:0.000] [trapfpe_treatment@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:CB-Boinc-01:1:1:47911:47911] [20240613:172025:1718324425:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:CB-Boinc-01:1:1:47911:47911] [20240613:172025:1718324425:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:CB-Boinc-01:1:1:47911:47911] [20240613:172025:1718324425:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x820cf0 (old at (nil))
[EC_DRHOOK:CB-Boinc-01:1:1:47911:47911] [20240613:172025:1718324425:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:CB-Boinc-01:1:1:47911:47911] [20240613:172025:1718324425:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:CB-Boinc-01:1:1:47911:47911] [20240613:172025:1718324425:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:CB-Boinc-01:1:1:47911:47911] [20240613:172025:1718324425:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x820cf0 (old at (nil))
[EC_DRHOOK:CB-Boinc-01:1:1:47911:47911] [20240613:172025:1718324425:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x820cf0 (old at (nil))
[EC_DRHOOK:CB-Boinc-01:1:1:47911:47911] [20240613:172025:1718324425:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:CB-Boinc-01:1:1:47911:47911] [20240613:172025:1718324425:0.000] [catch_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  17:21:59 STEP 1680 H= 420:00 +CPU= 25.136
  17:22:25 STEP 1681 H= 420:15 +CPU= 25.465
  17:23:08 STEP 1682 H= 420:30 +CPU= 24.980
  17:23:39 STEP 1683 H= 420:45 +CPU= 25.672
  02:38:15 STEP 1684 H= 421:00 +CPU= 39.934
  02:39:14 STEP 1685 H= 421:15 +CPU= 24.712
  02:39:38 STEP 1686 H= 421:30 +CPU= 24.183
  02:40:04 STEP 1687 H= 421:45 +CPU= 25.604
  02:40:58 STEP 1688 H= 422:00 +CPU= 26.166
  02:41:22 STEP 1689 H= 422:15 +CPU= 24.110
  02:41:48 STEP 1690 H= 422:30 +CPU= 25.990
  02:42:13 STEP 1691 H= 422:45 +CPU= 24.742
  02:42:46 STEP 1692 H= 423:00 +CPU= 30.172
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001692
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001692
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001692
  02:43:11 STEP 1693 H= 423:15 +CPU= 25.228
  02:45:06 STEP 1694 H= 423:30 +CPU= 26.428
  02:45:33 STEP 1695 H= 423:45 +CPU= 26.287
  02:45:58 STEP 1696 H= 424:00 +CPU= 25.099
  02:46:22 STEP 1697 H= 424:15 +CPU= 24.223
  02:46:47 STEP 1698 H= 424:30 +CPU= 24.676
  02:47:40 STEP 1699 H= 424:45 +CPU= 26.021
  02:48:05 STEP 1700 H= 425:00 +CPU= 24.709
  02:48:29 STEP 1701 H= 425:15 +CPU= 24.165
  02:48:54 STEP 1702 H= 425:30 +CPU= 25.385
  02:49:44 STEP 1703 H= 425:45 +CPU= 25.797
  02:50:23 STEP 1704 H= 426:00 +CPU= 30.615
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001704
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001704
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001704
  02:50:47 STEP 1705 H= 426:15 +CPU= 24.213
  02:51:11 STEP 1706 H= 426:30 +CPU= 24.552
  02:51:39 STEP 1707 H= 426:45 +CPU= 27.127
  02:52:05 STEP 1708 H= 427:00 +CPU= 24.847
  02:52:29 STEP 1709 H= 427:15 +CPU= 24.129
  02:52:53 STEP 1710 H= 427:30 +CPU= 24.665
  02:53:58 STEP 1711 H= 427:45 +CPU= 25.620
  02:54:23 STEP 1712 H= 428:00 +CPU= 25.084
  02:54:52 STEP 1713 H= 428:15 +CPU= 25.365
  02:55:18 STEP 1714 H= 428:30 +CPU= 23.622
  02:55:43 STEP 1715 H= 428:45 +CPU= 24.213
  02:56:15 STEP 1716 H= 429:00 +CPU= 31.552
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001716
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001716
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001716
  02:59:19 STEP 1717 H= 429:15 +CPU= 26.480
  02:59:44 STEP 1718 H= 429:30 +CPU= 24.342
  03:00:08 STEP 1719 H= 429:45 +CPU= 24.242
  03:00:33 STEP 1720 H= 430:00 +CPU= 24.748
  03:00:57 STEP 1721 H= 430:15 +CPU= 24.138
  03:01:21 STEP 1722 H= 430:30 +CPU= 24.146
  03:01:45 STEP 1723 H= 430:45 +CPU= 24.149
  03:02:10 STEP 1724 H= 431:00 +CPU= 24.762
  03:02:34 STEP 1725 H= 431:15 +CPU= 24.132
  03:02:58 STEP 1726 H= 431:30 +CPU= 24.161
  03:03:23 STEP 1727 H= 431:45 +CPU= 24.171
  03:04:13 STEP 1728 H= 432:00 +CPU= 32.537
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001728
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001728
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMGGh7zg+001632
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMSHh7zg+001632
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMUAh7zg+001632
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMGGh7zg+001644
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMSHh7zg+001644
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMUAh7zg+001644
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMGGh7zg+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMSHh7zg+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMUAh7zg+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMGGh7zg+001668
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMSHh7zg+001668
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMUAh7zg+001668
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMGGh7zg+001680
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMSHh7zg+001680
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMUAh7zg+001680
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMGGh7zg+001692
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMSHh7zg+001692
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMUAh7zg+001692
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMGGh7zg+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMSHh7zg+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMUAh7zg+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMGGh7zg+001716
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMSHh7zg+001716
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMUAh7zg+001716
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a1r6_2016092300_20_1018_12290601_0_r605627487_17.zip
Uploading the intermediate file: upload_file_17.zip
  03:04:38 STEP 1729 H= 432:15 +CPU= 24.238
  03:05:02 STEP 1730 H= 432:30 +CPU= 24.158
  03:05:26 STEP 1731 H= 432:45 +CPU= 24.213
  03:05:51 STEP 1732 H= 433:00 +CPU= 24.648
  03:06:15 STEP 1733 H= 433:15 +CPU= 24.127
  03:06:39 STEP 1734 H= 433:30 +CPU= 24.116
  03:07:03 STEP 1735 H= 433:45 +CPU= 24.130
  03:07:28 STEP 1736 H= 434:00 +CPU= 24.632
  03:07:52 STEP 1737 H= 434:15 +CPU= 24.124
  03:08:16 STEP 1738 H= 434:30 +CPU= 24.136
  03:08:40 STEP 1739 H= 434:45 +CPU= 24.119
  03:09:10 STEP 1740 H= 435:00 +CPU= 29.914
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001740
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001740
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001740
  03:09:34 STEP 1741 H= 435:15 +CPU= 24.143
  03:09:59 STEP 1742 H= 435:30 +CPU= 24.263
  03:10:23 STEP 1743 H= 435:45 +CPU= 24.206
  03:10:48 STEP 1744 H= 436:00 +CPU= 24.641
  03:11:12 STEP 1745 H= 436:15 +CPU= 24.133
  03:11:36 STEP 1746 H= 436:30 +CPU= 24.131
  03:12:00 STEP 1747 H= 436:45 +CPU= 24.139
  03:12:25 STEP 1748 H= 437:00 +CPU= 24.650
  03:12:49 STEP 1749 H= 437:15 +CPU= 24.141
  03:13:13 STEP 1750 H= 437:30 +CPU= 24.141
  03:13:37 STEP 1751 H= 437:45 +CPU= 24.164
  03:14:07 STEP 1752 H= 438:00 +CPU= 29.913
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001752
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001752
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001752
  03:14:31 STEP 1753 H= 438:15 +CPU= 24.173
  03:14:56 STEP 1754 H= 438:30 +CPU= 24.167
  03:15:20 STEP 1755 H= 438:45 +CPU= 24.293
  03:15:45 STEP 1756 H= 439:00 +CPU= 24.735
  03:16:09 STEP 1757 H= 439:15 +CPU= 24.192
  03:16:33 STEP 1758 H= 439:30 +CPU= 24.168
  03:16:57 STEP 1759 H= 439:45 +CPU= 24.203
  03:17:22 STEP 1760 H= 440:00 +CPU= 24.733
  03:17:46 STEP 1761 H= 440:15 +CPU= 24.189
  03:18:11 STEP 1762 H= 440:30 +CPU= 24.205
  03:18:35 STEP 1763 H= 440:45 +CPU= 24.211
  03:19:05 STEP 1764 H= 441:00 +CPU= 29.953
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001764
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001764
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001764
  03:19:29 STEP 1765 H= 441:15 +CPU= 24.182
  03:19:53 STEP 1766 H= 441:30 +CPU= 24.247
  03:20:18 STEP 1767 H= 441:45 +CPU= 24.174
  03:20:42 STEP 1768 H= 442:00 +CPU= 24.813
  03:21:07 STEP 1769 H= 442:15 +CPU= 24.213
  03:21:31 STEP 1770 H= 442:30 +CPU= 24.165
  03:21:55 STEP 1771 H= 442:45 +CPU= 24.140
  03:22:20 STEP 1772 H= 443:00 +CPU= 24.663
  03:22:44 STEP 1773 H= 443:15 +CPU= 24.152
  03:23:08 STEP 1774 H= 443:30 +CPU= 24.126
  03:23:32 STEP 1775 H= 443:45 +CPU= 24.151
  03:24:05 STEP 1776 H= 444:00 +CPU= 32.722
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001776
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001776
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001776
  03:24:29 STEP 1777 H= 444:15 +CPU= 24.327
  03:24:54 STEP 1778 H= 444:30 +CPU= 24.276
  03:25:18 STEP 1779 H= 444:45 +CPU= 24.271
  03:25:43 STEP 1780 H= 445:00 +CPU= 24.706
  03:26:07 STEP 1781 H= 445:15 +CPU= 24.226
  03:26:31 STEP 1782 H= 445:30 +CPU= 24.248
  03:26:55 STEP 1783 H= 445:45 +CPU= 24.240
  03:27:20 STEP 1784 H= 446:00 +CPU= 24.748
  03:27:44 STEP 1785 H= 446:15 +CPU= 24.234
  03:28:09 STEP 1786 H= 446:30 +CPU= 24.277
  03:28:33 STEP 1787 H= 446:45 +CPU= 24.258
  03:29:03 STEP 1788 H= 447:00 +CPU= 30.019
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001788
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001788
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001788
  03:29:27 STEP 1789 H= 447:15 +CPU= 24.245
  03:29:51 STEP 1790 H= 447:30 +CPU= 24.212
  03:30:16 STEP 1791 H= 447:45 +CPU= 24.210
  03:30:40 STEP 1792 H= 448:00 +CPU= 24.748
  03:31:05 STEP 1793 H= 448:15 +CPU= 24.374
  03:31:29 STEP 1794 H= 448:30 +CPU= 24.266
  03:31:53 STEP 1795 H= 448:45 +CPU= 24.210
  03:32:18 STEP 1796 H= 449:00 +CPU= 24.737
  03:32:43 STEP 1797 H= 449:15 +CPU= 24.275
  03:33:07 STEP 1798 H= 449:30 +CPU= 24.264
  03:33:31 STEP 1799 H= 449:45 +CPU= 24.209
  03:34:01 STEP 1800 H= 450:00 +CPU= 29.994
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001800
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001800
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001800
  03:34:25 STEP 1801 H= 450:15 +CPU= 24.234
  03:34:49 STEP 1802 H= 450:30 +CPU= 24.188
  03:35:14 STEP 1803 H= 450:45 +CPU= 24.200
  03:35:38 STEP 1804 H= 451:00 +CPU= 24.738
  03:36:03 STEP 1805 H= 451:15 +CPU= 24.182
  03:36:27 STEP 1806 H= 451:30 +CPU= 24.188
  03:36:51 STEP 1807 H= 451:45 +CPU= 24.179
  03:37:16 STEP 1808 H= 452:00 +CPU= 24.661
  03:37:40 STEP 1809 H= 452:15 +CPU= 24.167
  03:38:04 STEP 1810 H= 452:30 +CPU= 24.171
  03:38:28 STEP 1811 H= 452:45 +CPU= 24.181
  03:38:58 STEP 1812 H= 453:00 +CPU= 30.039
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001812
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001812
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001812
  03:39:23 STEP 1813 H= 453:15 +CPU= 24.321
  03:39:47 STEP 1814 H= 453:30 +CPU= 24.285
  03:40:11 STEP 1815 H= 453:45 +CPU= 24.243
  03:40:36 STEP 1816 H= 454:00 +CPU= 24.763
  03:41:00 STEP 1817 H= 454:15 +CPU= 24.242
  03:41:25 STEP 1818 H= 454:30 +CPU= 24.238
  03:41:49 STEP 1819 H= 454:45 +CPU= 24.235
  03:42:14 STEP 1820 H= 455:00 +CPU= 24.778
  03:42:38 STEP 1821 H= 455:15 +CPU= 24.219
  03:43:02 STEP 1822 H= 455:30 +CPU= 24.236
  03:43:26 STEP 1823 H= 455:45 +CPU= 24.246
  03:43:59 STEP 1824 H= 456:00 +CPU= 32.561
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001824
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001824
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMGGh7zg+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMSHh7zg+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMUAh7zg+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMGGh7zg+001740
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMSHh7zg+001740
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMUAh7zg+001740
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMGGh7zg+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMSHh7zg+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMUAh7zg+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMGGh7zg+001764
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMSHh7zg+001764
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMUAh7zg+001764
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMGGh7zg+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMSHh7zg+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMUAh7zg+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMGGh7zg+001788
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMSHh7zg+001788
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMUAh7zg+001788
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMGGh7zg+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMSHh7zg+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMUAh7zg+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMGGh7zg+001812
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMSHh7zg+001812
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMUAh7zg+001812
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a1r6_2016092300_20_1018_12290601_0_r605627487_18.zip
Uploading the intermediate file: upload_file_18.zip
  03:44:24 STEP 1825 H= 456:15 +CPU= 24.311
  03:44:48 STEP 1826 H= 456:30 +CPU= 24.429
  03:45:12 STEP 1827 H= 456:45 +CPU= 24.195
  03:45:37 STEP 1828 H= 457:00 +CPU= 24.722
  03:46:01 STEP 1829 H= 457:15 +CPU= 24.232
  03:46:26 STEP 1830 H= 457:30 +CPU= 24.205
  03:46:50 STEP 1831 H= 457:45 +CPU= 24.196
  03:47:15 STEP 1832 H= 458:00 +CPU= 24.746
  03:47:39 STEP 1833 H= 458:15 +CPU= 24.228
  03:48:03 STEP 1834 H= 458:30 +CPU= 24.188
  03:48:27 STEP 1835 H= 458:45 +CPU= 24.197
  03:48:57 STEP 1836 H= 459:00 +CPU= 29.931
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001836
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001836
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001836
  03:49:21 STEP 1837 H= 459:15 +CPU= 24.207
  03:49:46 STEP 1838 H= 459:30 +CPU= 24.219
  03:50:10 STEP 1839 H= 459:45 +CPU= 24.218
  03:50:35 STEP 1840 H= 460:00 +CPU= 24.716
  03:50:59 STEP 1841 H= 460:15 +CPU= 24.199
  03:51:23 STEP 1842 H= 460:30 +CPU= 24.195
  03:51:47 STEP 1843 H= 460:45 +CPU= 24.185
  03:52:12 STEP 1844 H= 461:00 +CPU= 24.737
  03:52:36 STEP 1845 H= 461:15 +CPU= 24.206
  03:53:00 STEP 1846 H= 461:30 +CPU= 24.207
  03:53:25 STEP 1847 H= 461:45 +CPU= 24.233
  03:53:55 STEP 1848 H= 462:00 +CPU= 30.002
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001848
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001848
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001848
  03:54:19 STEP 1849 H= 462:15 +CPU= 24.202
  03:54:43 STEP 1850 H= 462:30 +CPU= 24.206
  03:55:07 STEP 1851 H= 462:45 +CPU= 24.205
  03:55:32 STEP 1852 H= 463:00 +CPU= 24.732
  03:55:56 STEP 1853 H= 463:15 +CPU= 24.208
  03:56:20 STEP 1854 H= 463:30 +CPU= 24.210
  03:56:45 STEP 1855 H= 463:45 +CPU= 24.213
  03:57:09 STEP 1856 H= 464:00 +CPU= 24.764
  03:57:34 STEP 1857 H= 464:15 +CPU= 24.216
  03:57:58 STEP 1858 H= 464:30 +CPU= 24.219
  03:58:22 STEP 1859 H= 464:45 +CPU= 24.222
  03:58:52 STEP 1860 H= 465:00 +CPU= 30.202
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001860
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001860
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001860
  03:59:17 STEP 1861 H= 465:15 +CPU= 24.325
  03:59:41 STEP 1862 H= 465:30 +CPU= 24.332
  04:00:05 STEP 1863 H= 465:45 +CPU= 24.322
  04:00:30 STEP 1864 H= 466:00 +CPU= 24.863
  04:00:55 STEP 1865 H= 466:15 +CPU= 24.320
  04:01:19 STEP 1866 H= 466:30 +CPU= 24.394
  04:01:44 STEP 1867 H= 466:45 +CPU= 24.343
  04:02:08 STEP 1868 H= 467:00 +CPU= 24.829
  04:02:33 STEP 1869 H= 467:15 +CPU= 24.284
  04:02:57 STEP 1870 H= 467:30 +CPU= 24.323
  04:03:21 STEP 1871 H= 467:45 +CPU= 24.302
  04:03:54 STEP 1872 H= 468:00 +CPU= 32.566
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001872
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001872
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001872
  04:04:18 STEP 1873 H= 468:15 +CPU= 24.206
  04:04:43 STEP 1874 H= 468:30 +CPU= 24.234
  04:05:07 STEP 1875 H= 468:45 +CPU= 24.210
  04:05:32 STEP 1876 H= 469:00 +CPU= 24.714
  04:05:56 STEP 1877 H= 469:15 +CPU= 24.209
  04:06:20 STEP 1878 H= 469:30 +CPU= 24.217
  04:06:45 STEP 1879 H= 469:45 +CPU= 24.331
  04:07:09 STEP 1880 H= 470:00 +CPU= 24.745
  04:07:34 STEP 1881 H= 470:15 +CPU= 24.306
  04:07:58 STEP 1882 H= 470:30 +CPU= 24.206
  04:08:22 STEP 1883 H= 470:45 +CPU= 24.215
  04:08:52 STEP 1884 H= 471:00 +CPU= 30.012
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001884
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001884
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001884
  04:09:16 STEP 1885 H= 471:15 +CPU= 24.188
  04:09:41 STEP 1886 H= 471:30 +CPU= 24.182
  04:10:05 STEP 1887 H= 471:45 +CPU= 24.211
  04:10:30 STEP 1888 H= 472:00 +CPU= 24.741
  04:10:54 STEP 1889 H= 472:15 +CPU= 24.188
  04:11:18 STEP 1890 H= 472:30 +CPU= 24.202
  04:11:42 STEP 1891 H= 472:45 +CPU= 24.187
  04:12:07 STEP 1892 H= 473:00 +CPU= 24.727
  04:12:31 STEP 1893 H= 473:15 +CPU= 24.199
  04:12:55 STEP 1894 H= 473:30 +CPU= 24.189
  04:13:20 STEP 1895 H= 473:45 +CPU= 24.203
  04:13:50 STEP 1896 H= 474:00 +CPU= 29.973
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001896
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001896
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001896
  04:14:14 STEP 1897 H= 474:15 +CPU= 24.190
  04:14:38 STEP 1898 H= 474:30 +CPU= 24.235
  04:15:02 STEP 1899 H= 474:45 +CPU= 24.216
  04:15:27 STEP 1900 H= 475:00 +CPU= 24.750
  04:15:51 STEP 1901 H= 475:15 +CPU= 24.219
  04:16:15 STEP 1902 H= 475:30 +CPU= 24.200
  04:16:40 STEP 1903 H= 475:45 +CPU= 24.198
  04:17:05 STEP 1904 H= 476:00 +CPU= 24.825
  04:17:29 STEP 1905 H= 476:15 +CPU= 24.221
  04:17:53 STEP 1906 H= 476:30 +CPU= 24.191
  04:18:17 STEP 1907 H= 476:45 +CPU= 24.219
  04:18:48 STEP 1908 H= 477:00 +CPU= 30.173
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001908
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001908
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001908
  04:19:12 STEP 1909 H= 477:15 +CPU= 24.362
  04:19:36 STEP 1910 H= 477:30 +CPU= 24.369
  04:20:01 STEP 1911 H= 477:45 +CPU= 24.348
  04:20:26 STEP 1912 H= 478:00 +CPU= 24.853
  04:20:50 STEP 1913 H= 478:15 +CPU= 24.310
  04:21:14 STEP 1914 H= 478:30 +CPU= 24.327
  04:21:39 STEP 1915 H= 478:45 +CPU= 24.321
  04:22:04 STEP 1916 H= 479:00 +CPU= 24.864
  04:22:28 STEP 1917 H= 479:15 +CPU= 24.315
  04:22:52 STEP 1918 H= 479:30 +CPU= 24.327
  04:23:17 STEP 1919 H= 479:45 +CPU= 24.297
  04:23:48 STEP 1920 H= 480:00 +CPU= 30.630
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

 
DDH------------------------------------------------------------------------
I                                                                         I
I TIME =  480.000H DDH * Diagnostic Var.,     AREA                GLOBAL  I
I                                                                         I
I-------------------------------------------------------------------------I
I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I      0.2410668648E-21      I       0.1228758207E-06      I
ICloud fractionI      0.0000000000E+00      I       0.1489406042E-02      I
I  Relat. Hum. I      0.4776118020E+00      I       0.4846082813E+00      I
I  PASS 01     I      0.0000000000E+00      I       0.2364842263E+02      I
DDH------------------------------------------------------------------------
  
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1920 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001920 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001920
 MPI-TASK:   1 -    300407700 BYTES IN      7 RECORDS TRANSFERRED IN    0.0004 SECONDS751019.3 Mbytes/s, TOTAL TIME=    0.0085( 4.7%)
 04:23:48 STEP 1920 H= 480:00 +CPU= 30.630
 END CNT3
 NSTEP =  1920 CNT0   000000000  22.886  22.886  23.172   0.988               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ           46/  1069125708 WRITTEN         7150/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1    128    0       46      1044068     7150 ************    43.5    33.3    10.3    33.8    39.3
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 ********* *********    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 ********* *********     99.91      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                  261    4217.1    4217.1      2.77      0.00
   9 SPCM     - SPECTRAL COMP.                     240     731.8     731.8      0.44      0.00
  10 SCAN2M - PHYSICS                              241   49687.1   49687.1     30.08      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                 20    1553.0    1553.0      0.08      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                 11      63.8      63.8      0.00      0.00
  17 GRIDFPOS IN CNT4                               20      21.9      21.9      0.00      0.00
  27 RESTART FILES - WRITING                         5    6207.7    6207.7      0.08      0.00
  28 RESTART FILES - READING                         1   34389.9   34389.9      0.09      0.00
  29 SU4FPOS IN CNT4                                20      27.9      27.9      0.00      0.00
  30 DYNFPOS IN CNT4                                20    5307.1    5307.1      0.27      0.00
  31 POSDDH IN STEPO                                 2     213.5     213.5      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                    241  106819.7  106819.7     64.68      0.00
  39 SU0YOMB                                         1     317.2     317.2      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                    241      42.8      42.8      0.03      0.00
  54 SPCM     - M TO S/S TO M TRANSP.              240     393.6     393.6      0.24      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.              240      55.4      55.4      0.03      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                 11      38.5      38.5      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM      524     351.5     351.5      0.46      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM       500     225.9     225.9      0.28      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM        500      77.3      77.3      0.10      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM       524     119.4     119.4      0.16      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1      38.9      38.9      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION            524      40.3      40.3      0.05      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION            500      22.8      22.8      0.03      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION            524     107.6     107.6      0.14      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION            500      34.9      34.9      0.04      0.00
 400 GSTATS                                      28864       0.1       0.1      0.01      0.00
 401 GSTATS HOOK                                 26802       0.3       0.3      0.02      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME    39803.7 CPU TIME    6034.5 VECTOR TIME     6034.5


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY       43.5
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001920
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001920
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001920
Adding to the zip: /var/lib/boinc-client/slots/1/NODE.001_01
Adding to the zip: /var/lib/boinc-client/slots/1/ifs.stat
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMGGh7zg+001884
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMUAh7zg+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMUAh7zg+001860
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMUAh7zg+001836
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMUAh7zg+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMUAh7zg+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMUAh7zg+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMSHh7zg+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMGGh7zg+001908
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMGGh7zg+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMGGh7zg+001860
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMGGh7zg+001836
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMSHh7zg+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMSHh7zg+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMUAh7zg+001908
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMGGh7zg+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMSHh7zg+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMSHh7zg+001908
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMGGh7zg+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMGGh7zg+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMUAh7zg+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMSHh7zg+001836
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMUAh7zg+001884
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMSHh7zg+001884
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMSHh7zg+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMSHh7zg+001860
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290601/ICMGGh7zg+001920
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a1r6_2016092300_20_1018_12290601_0_r605627487_19.zip
Uploading the final file: upload_file_19.zip
Uploading trickle at timestep: 1727100
04:27:18 (47908): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
14 Jun 2024 11:36:59 1494567 22444198 oifs_43r3_bl_a1r6_2016092300_20_1018_12290601_0 1,727,100 47,572 0.0275
13 Jun 2024 19:58:11 1494567 22444198 oifs_43r3_bl_a1r6_2016092300_20_1018_12290601_0 864,000 23,835 0.0276


©2024 cpdn.org