climateprediction.net home page
Task 22443273

Task 22443273

Name oifs_43r3_bl_a11r_2016092300_20_1018_12289686_0
Workunit 12289686
Created 12 Jun 2024, 21:55:59 UTC
Sent 14 Jun 2024, 4:58:30 UTC
Report deadline 13 Aug 2024, 4:58:30 UTC
Received 14 Jun 2024, 20:43:37 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1551266
Run time 13 hours 10 min 18 sec
CPU time 13 hours 10 min 18 sec
Validate state Valid
Credit 2,635.55
Device peak FLOPS 5.19 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.13
x86_64-pc-linux-gnu
Peak working set size 4,994.92 MB
Peak swap size 5,981.07 MB
Peak disk usage 1,286.15 MB
Stderr
<core_client_version>7.16.5</core_client_version>
<![CDATA[
<stderr_txt>
rediction.net/oifs_43r3_bl_12289686/ICMUAh7zg+001356
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMGGh7zg+001368
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMSHh7zg+001368
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMUAh7zg+001368
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMGGh7zg+001380
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMSHh7zg+001380
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMUAh7zg+001380
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMGGh7zg+001392
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMSHh7zg+001392
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMUAh7zg+001392
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMGGh7zg+001404
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMSHh7zg+001404
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMUAh7zg+001404
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMGGh7zg+001416
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMSHh7zg+001416
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMUAh7zg+001416
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMGGh7zg+001428
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMSHh7zg+001428
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMUAh7zg+001428
Zipping up the intermediate file: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_a11r_2016092300_20_1018_12289686_0_r1342456576_14.zip
  18:28:55 STEP 1441 H= 360:15 +CPU= 13.107
Uploading the intermediate file: upload_file_14.zip
  18:29:08 STEP 1442 H= 360:30 +CPU= 13.176
  18:29:21 STEP 1443 H= 360:45 +CPU= 13.301
  18:29:35 STEP 1444 H= 361:00 +CPU= 13.696
  18:29:48 STEP 1445 H= 361:15 +CPU= 13.209
  18:30:02 STEP 1446 H= 361:30 +CPU= 13.606
  18:30:15 STEP 1447 H= 361:45 +CPU= 13.234
  18:30:29 STEP 1448 H= 362:00 +CPU= 13.660
  18:30:42 STEP 1449 H= 362:15 +CPU= 13.233
  18:30:55 STEP 1450 H= 362:30 +CPU= 13.243
  18:31:08 STEP 1451 H= 362:45 +CPU= 12.872
  18:31:25 STEP 1452 H= 363:00 +CPU= 17.161
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMGGh7zg+001452
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMSHh7zg+001452
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMUAh7zg+001452
  18:31:38 STEP 1453 H= 363:15 +CPU= 13.185
  18:31:52 STEP 1454 H= 363:30 +CPU= 13.208
  18:32:05 STEP 1455 H= 363:45 +CPU= 13.175
  18:32:19 STEP 1456 H= 364:00 +CPU= 13.669
  18:32:32 STEP 1457 H= 364:15 +CPU= 13.220
  18:32:45 STEP 1458 H= 364:30 +CPU= 13.233
  18:32:58 STEP 1459 H= 364:45 +CPU= 13.240
  18:33:12 STEP 1460 H= 365:00 +CPU= 13.635
  18:33:25 STEP 1461 H= 365:15 +CPU= 13.136
  18:33:38 STEP 1462 H= 365:30 +CPU= 13.162
  18:33:51 STEP 1463 H= 365:45 +CPU= 13.225
  18:34:08 STEP 1464 H= 366:00 +CPU= 17.033
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMGGh7zg+001464
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMSHh7zg+001464
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMUAh7zg+001464
  18:34:21 STEP 1465 H= 366:15 +CPU= 12.980
  18:34:34 STEP 1466 H= 366:30 +CPU= 12.977
  18:34:47 STEP 1467 H= 366:45 +CPU= 12.987
  18:35:01 STEP 1468 H= 367:00 +CPU= 13.410
  18:35:14 STEP 1469 H= 367:15 +CPU= 12.956
  18:35:27 STEP 1470 H= 367:30 +CPU= 12.971
  18:35:40 STEP 1471 H= 367:45 +CPU= 13.096
  18:35:53 STEP 1472 H= 368:00 +CPU= 13.583
  18:36:07 STEP 1473 H= 368:15 +CPU= 13.179
  18:36:20 STEP 1474 H= 368:30 +CPU= 13.173
  18:36:33 STEP 1475 H= 368:45 +CPU= 13.216
  18:36:50 STEP 1476 H= 369:00 +CPU= 17.230
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMGGh7zg+001476
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMSHh7zg+001476
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMUAh7zg+001476
  18:37:04 STEP 1477 H= 369:15 +CPU= 13.423
  18:37:17 STEP 1478 H= 369:30 +CPU= 13.232
  18:37:30 STEP 1479 H= 369:45 +CPU= 12.973
  18:37:43 STEP 1480 H= 370:00 +CPU= 13.279
  18:37:56 STEP 1481 H= 370:15 +CPU= 12.965
  18:38:09 STEP 1482 H= 370:30 +CPU= 12.897
  18:38:22 STEP 1483 H= 370:45 +CPU= 12.916
  18:38:36 STEP 1484 H= 371:00 +CPU= 13.546
  18:38:48 STEP 1485 H= 371:15 +CPU= 12.861
  18:39:01 STEP 1486 H= 371:30 +CPU= 12.955
  18:39:14 STEP 1487 H= 371:45 +CPU= 12.941
  18:39:34 STEP 1488 H= 372:00 +CPU= 20.074
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMGGh7zg+001488
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMSHh7zg+001488
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMUAh7zg+001488
  18:39:47 STEP 1489 H= 372:15 +CPU= 13.028
  18:40:00 STEP 1490 H= 372:30 +CPU= 12.878
  18:40:13 STEP 1491 H= 372:45 +CPU= 13.087
  18:40:27 STEP 1492 H= 373:00 +CPU= 13.443
  18:40:40 STEP 1493 H= 373:15 +CPU= 12.911
  18:40:53 STEP 1494 H= 373:30 +CPU= 12.868
  18:41:05 STEP 1495 H= 373:45 +CPU= 12.916
  18:41:19 STEP 1496 H= 374:00 +CPU= 13.271
  18:41:32 STEP 1497 H= 374:15 +CPU= 12.857
  18:41:44 STEP 1498 H= 374:30 +CPU= 12.837
  18:41:58 STEP 1499 H= 374:45 +CPU= 13.108
  18:42:15 STEP 1500 H= 375:00 +CPU= 17.030
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMGGh7zg+001500
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMSHh7zg+001500
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMUAh7zg+001500
  18:42:28 STEP 1501 H= 375:15 +CPU= 13.039
  18:42:41 STEP 1502 H= 375:30 +CPU= 12.958
  18:42:53 STEP 1503 H= 375:45 +CPU= 12.822
  18:43:07 STEP 1504 H= 376:00 +CPU= 13.299
  18:43:20 STEP 1505 H= 376:15 +CPU= 13.177
  18:43:33 STEP 1506 H= 376:30 +CPU= 12.928
  18:43:46 STEP 1507 H= 376:45 +CPU= 12.875
  18:43:59 STEP 1508 H= 377:00 +CPU= 13.434
  18:44:12 STEP 1509 H= 377:15 +CPU= 13.169
  18:44:25 STEP 1510 H= 377:30 +CPU= 12.864
  18:44:38 STEP 1511 H= 377:45 +CPU= 12.933
  18:44:56 STEP 1512 H= 378:00 +CPU= 17.559
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMGGh7zg+001512
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMSHh7zg+001512
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMUAh7zg+001512
  18:45:09 STEP 1513 H= 378:15 +CPU= 13.151
  18:45:22 STEP 1514 H= 378:30 +CPU= 13.263
  18:45:35 STEP 1515 H= 378:45 +CPU= 13.211
  18:45:49 STEP 1516 H= 379:00 +CPU= 13.761
  18:46:02 STEP 1517 H= 379:15 +CPU= 13.089
  18:46:15 STEP 1518 H= 379:30 +CPU= 13.069
  18:46:29 STEP 1519 H= 379:45 +CPU= 13.155
  18:46:42 STEP 1520 H= 380:00 +CPU= 13.530
  18:46:55 STEP 1521 H= 380:15 +CPU= 13.131
  18:47:08 STEP 1522 H= 380:30 +CPU= 13.136
  18:47:21 STEP 1523 H= 380:45 +CPU= 13.137
  18:47:39 STEP 1524 H= 381:00 +CPU= 17.065
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMGGh7zg+001524
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMSHh7zg+001524
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMUAh7zg+001524
  18:47:52 STEP 1525 H= 381:15 +CPU= 13.139
  18:48:05 STEP 1526 H= 381:30 +CPU= 13.091
  18:48:18 STEP 1527 H= 381:45 +CPU= 13.107
  18:48:31 STEP 1528 H= 382:00 +CPU= 13.562
  18:48:44 STEP 1529 H= 382:15 +CPU= 13.087
  18:48:57 STEP 1530 H= 382:30 +CPU= 12.927
  18:49:10 STEP 1531 H= 382:45 +CPU= 12.979
  18:49:24 STEP 1532 H= 383:00 +CPU= 13.427
  18:49:37 STEP 1533 H= 383:15 +CPU= 12.952
  18:49:50 STEP 1534 H= 383:30 +CPU= 13.058
  18:50:03 STEP 1535 H= 383:45 +CPU= 13.145
  18:50:23 STEP 1536 H= 384:00 +CPU= 20.172
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMGGh7zg+001536
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMSHh7zg+001536
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMUAh7zg+001536
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMGGh7zg+001440
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMSHh7zg+001440
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMUAh7zg+001440
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMGGh7zg+001452
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMSHh7zg+001452
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMUAh7zg+001452
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMGGh7zg+001464
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMSHh7zg+001464
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMUAh7zg+001464
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMGGh7zg+001476
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMSHh7zg+001476
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMUAh7zg+001476
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMGGh7zg+001488
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMSHh7zg+001488
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMUAh7zg+001488
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMGGh7zg+001500
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMSHh7zg+001500
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMUAh7zg+001500
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMGGh7zg+001512
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMSHh7zg+001512
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMUAh7zg+001512
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMGGh7zg+001524
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMSHh7zg+001524
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMUAh7zg+001524
Zipping up the intermediate file: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_a11r_2016092300_20_1018_12289686_0_r1342456576_15.zip
Uploading the intermediate file: upload_file_15.zip
  18:50:36 STEP 1537 H= 384:15 +CPU= 13.083
  18:50:49 STEP 1538 H= 384:30 +CPU= 12.967
  18:51:02 STEP 1539 H= 384:45 +CPU= 12.906
  18:51:15 STEP 1540 H= 385:00 +CPU= 13.350
  18:51:28 STEP 1541 H= 385:15 +CPU= 12.821
  18:51:41 STEP 1542 H= 385:30 +CPU= 12.793
  18:51:54 STEP 1543 H= 385:45 +CPU= 12.828
  18:52:07 STEP 1544 H= 386:00 +CPU= 13.231
  18:52:20 STEP 1545 H= 386:15 +CPU= 12.809
  18:52:33 STEP 1546 H= 386:30 +CPU= 12.833
  18:52:46 STEP 1547 H= 386:45 +CPU= 12.840
  18:53:02 STEP 1548 H= 387:00 +CPU= 16.677
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMGGh7zg+001548
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMSHh7zg+001548
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMUAh7zg+001548
  18:53:15 STEP 1549 H= 387:15 +CPU= 13.158
  18:53:29 STEP 1550 H= 387:30 +CPU= 13.317
  18:53:42 STEP 1551 H= 387:45 +CPU= 13.135
  18:53:56 STEP 1552 H= 388:00 +CPU= 13.647
  18:54:09 STEP 1553 H= 388:15 +CPU= 13.182
  18:54:22 STEP 1554 H= 388:30 +CPU= 13.145
  18:54:35 STEP 1555 H= 388:45 +CPU= 13.129
  18:54:49 STEP 1556 H= 389:00 +CPU= 13.567
  18:55:02 STEP 1557 H= 389:15 +CPU= 13.097
  18:55:15 STEP 1558 H= 389:30 +CPU= 13.118
  18:55:28 STEP 1559 H= 389:45 +CPU= 13.126
  18:55:45 STEP 1560 H= 390:00 +CPU= 17.113
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMGGh7zg+001560
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMSHh7zg+001560
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMUAh7zg+001560
  18:55:58 STEP 1561 H= 390:15 +CPU= 13.106
  18:56:11 STEP 1562 H= 390:30 +CPU= 13.161
  18:56:25 STEP 1563 H= 390:45 +CPU= 13.183
  18:56:38 STEP 1564 H= 391:00 +CPU= 13.422
  18:56:51 STEP 1565 H= 391:15 +CPU= 12.923
  18:57:04 STEP 1566 H= 391:30 +CPU= 12.919
  18:57:17 STEP 1567 H= 391:45 +CPU= 12.983
  18:57:30 STEP 1568 H= 392:00 +CPU= 13.395
  18:57:43 STEP 1569 H= 392:15 +CPU= 12.922
  18:57:56 STEP 1570 H= 392:30 +CPU= 12.888
  18:58:09 STEP 1571 H= 392:45 +CPU= 12.888
  18:58:26 STEP 1572 H= 393:00 +CPU= 16.788
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMGGh7zg+001572
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMSHh7zg+001572
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMUAh7zg+001572
  18:58:39 STEP 1573 H= 393:15 +CPU= 12.885
  18:58:52 STEP 1574 H= 393:30 +CPU= 12.937
  18:59:05 STEP 1575 H= 393:45 +CPU= 12.995
  18:59:18 STEP 1576 H= 394:00 +CPU= 13.555
  18:59:31 STEP 1577 H= 394:15 +CPU= 13.148
  18:59:44 STEP 1578 H= 394:30 +CPU= 13.113
  18:59:57 STEP 1579 H= 394:45 +CPU= 13.150
  19:00:11 STEP 1580 H= 395:00 +CPU= 13.628
  19:00:24 STEP 1581 H= 395:15 +CPU= 13.157
  19:00:37 STEP 1582 H= 395:30 +CPU= 13.131
  19:00:51 STEP 1583 H= 395:45 +CPU= 13.108
  19:01:11 STEP 1584 H= 396:00 +CPU= 20.227
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMGGh7zg+001584
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMSHh7zg+001584
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMUAh7zg+001584
  19:01:24 STEP 1585 H= 396:15 +CPU= 13.022
  19:01:37 STEP 1586 H= 396:30 +CPU= 13.034
  19:01:50 STEP 1587 H= 396:45 +CPU= 13.165
  19:02:04 STEP 1588 H= 397:00 +CPU= 13.610
  19:02:17 STEP 1589 H= 397:15 +CPU= 13.116
  19:02:30 STEP 1590 H= 397:30 +CPU= 13.105
  19:02:43 STEP 1591 H= 397:45 +CPU= 13.224
  19:02:56 STEP 1592 H= 398:00 +CPU= 13.433
  19:03:09 STEP 1593 H= 398:15 +CPU= 12.966
  19:03:22 STEP 1594 H= 398:30 +CPU= 12.975
  19:03:35 STEP 1595 H= 398:45 +CPU= 13.002
  19:03:53 STEP 1596 H= 399:00 +CPU= 17.144
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMGGh7zg+001596
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMSHh7zg+001596
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMUAh7zg+001596
  19:04:06 STEP 1597 H= 399:15 +CPU= 13.165
  19:04:19 STEP 1598 H= 399:30 +CPU= 13.264
  19:04:32 STEP 1599 H= 399:45 +CPU= 13.244
  19:04:46 STEP 1600 H= 400:00 +CPU= 13.345
  19:04:59 STEP 1601 H= 400:15 +CPU= 12.927
  19:05:12 STEP 1602 H= 400:30 +CPU= 13.009
  19:05:25 STEP 1603 H= 400:45 +CPU= 13.084
  19:05:38 STEP 1604 H= 401:00 +CPU= 13.596
  19:05:51 STEP 1605 H= 401:15 +CPU= 13.097
  19:06:04 STEP 1606 H= 401:30 +CPU= 13.067
  19:06:17 STEP 1607 H= 401:45 +CPU= 12.992
  19:06:34 STEP 1608 H= 402:00 +CPU= 16.948
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMGGh7zg+001608
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMSHh7zg+001608
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMUAh7zg+001608
  19:06:47 STEP 1609 H= 402:15 +CPU= 12.993
  19:07:00 STEP 1610 H= 402:30 +CPU= 13.055
  19:07:13 STEP 1611 H= 402:45 +CPU= 13.051
  19:07:27 STEP 1612 H= 403:00 +CPU= 13.511
  19:07:40 STEP 1613 H= 403:15 +CPU= 13.148
  19:07:53 STEP 1614 H= 403:30 +CPU= 13.212
  19:08:07 STEP 1615 H= 403:45 +CPU= 13.340
  19:08:20 STEP 1616 H= 404:00 +CPU= 13.748
  19:08:34 STEP 1617 H= 404:15 +CPU= 13.292
  19:08:47 STEP 1618 H= 404:30 +CPU= 13.244
  19:09:00 STEP 1619 H= 404:45 +CPU= 13.318
  19:09:17 STEP 1620 H= 405:00 +CPU= 16.957
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMGGh7zg+001620
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMSHh7zg+001620
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMUAh7zg+001620
  19:09:30 STEP 1621 H= 405:15 +CPU= 12.964
  19:09:43 STEP 1622 H= 405:30 +CPU= 13.117
  19:09:56 STEP 1623 H= 405:45 +CPU= 13.058
  19:10:10 STEP 1624 H= 406:00 +CPU= 13.605
  19:10:23 STEP 1625 H= 406:15 +CPU= 13.142
  19:10:36 STEP 1626 H= 406:30 +CPU= 13.181
  19:10:49 STEP 1627 H= 406:45 +CPU= 13.136
  19:11:03 STEP 1628 H= 407:00 +CPU= 13.388
  19:11:16 STEP 1629 H= 407:15 +CPU= 12.916
  19:11:29 STEP 1630 H= 407:30 +CPU= 12.938
  19:11:42 STEP 1631 H= 407:45 +CPU= 12.904
  19:12:01 STEP 1632 H= 408:00 +CPU= 19.876
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMGGh7zg+001632
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMSHh7zg+001632
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMUAh7zg+001632
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMGGh7zg+001536
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMSHh7zg+001536
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMUAh7zg+001536
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMGGh7zg+001548
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMSHh7zg+001548
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMUAh7zg+001548
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMGGh7zg+001560
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMSHh7zg+001560
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMUAh7zg+001560
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMGGh7zg+001572
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMSHh7zg+001572
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMUAh7zg+001572
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMGGh7zg+001584
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMSHh7zg+001584
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMUAh7zg+001584
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMGGh7zg+001596
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMSHh7zg+001596
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMUAh7zg+001596
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMGGh7zg+001608
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMSHh7zg+001608
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMUAh7zg+001608
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMGGh7zg+001620
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMSHh7zg+001620
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMUAh7zg+001620
Zipping up the intermediate file: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_a11r_2016092300_20_1018_12289686_0_r1342456576_16.zip
Uploading the intermediate file: upload_file_16.zip
  19:12:14 STEP 1633 H= 408:15 +CPU= 12.860
  19:12:27 STEP 1634 H= 408:30 +CPU= 12.870
  19:12:40 STEP 1635 H= 408:45 +CPU= 12.939
  19:12:54 STEP 1636 H= 409:00 +CPU= 13.465
  19:13:07 STEP 1637 H= 409:15 +CPU= 12.922
  19:13:19 STEP 1638 H= 409:30 +CPU= 12.919
  19:13:32 STEP 1639 H= 409:45 +CPU= 12.881
  19:13:46 STEP 1640 H= 410:00 +CPU= 13.327
  19:13:59 STEP 1641 H= 410:15 +CPU= 12.872
  19:14:11 STEP 1642 H= 410:30 +CPU= 12.910
  19:14:24 STEP 1643 H= 410:45 +CPU= 12.895
  19:14:41 STEP 1644 H= 411:00 +CPU= 16.808
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMGGh7zg+001644
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMSHh7zg+001644
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMUAh7zg+001644
  19:14:54 STEP 1645 H= 411:15 +CPU= 12.895
  19:15:07 STEP 1646 H= 411:30 +CPU= 12.911
  19:15:20 STEP 1647 H= 411:45 +CPU= 12.893
  19:15:34 STEP 1648 H= 412:00 +CPU= 13.867
  19:15:47 STEP 1649 H= 412:15 +CPU= 13.206
  19:16:00 STEP 1650 H= 412:30 +CPU= 13.220
  19:16:13 STEP 1651 H= 412:45 +CPU= 13.221
  19:16:27 STEP 1652 H= 413:00 +CPU= 13.647
  19:16:40 STEP 1653 H= 413:15 +CPU= 13.217
  19:16:53 STEP 1654 H= 413:30 +CPU= 13.205
  19:17:07 STEP 1655 H= 413:45 +CPU= 13.213
  19:17:24 STEP 1656 H= 414:00 +CPU= 17.175
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMGGh7zg+001656
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMSHh7zg+001656
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMUAh7zg+001656
  19:17:37 STEP 1657 H= 414:15 +CPU= 13.070
  19:17:50 STEP 1658 H= 414:30 +CPU= 12.989
  19:18:03 STEP 1659 H= 414:45 +CPU= 13.115
  19:18:17 STEP 1660 H= 415:00 +CPU= 13.682
  19:18:30 STEP 1661 H= 415:15 +CPU= 13.244
  19:18:43 STEP 1662 H= 415:30 +CPU= 13.204
  19:18:56 STEP 1663 H= 415:45 +CPU= 13.229
  19:19:10 STEP 1664 H= 416:00 +CPU= 13.337
  19:19:23 STEP 1665 H= 416:15 +CPU= 12.856
  19:19:35 STEP 1666 H= 416:30 +CPU= 12.845
  19:19:48 STEP 1667 H= 416:45 +CPU= 12.979
  19:20:05 STEP 1668 H= 417:00 +CPU= 16.862
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMGGh7zg+001668
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMSHh7zg+001668
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMUAh7zg+001668
  19:20:18 STEP 1669 H= 417:15 +CPU= 12.989
  19:20:32 STEP 1670 H= 417:30 +CPU= 13.266
  19:20:45 STEP 1671 H= 417:45 +CPU= 13.193
  19:20:58 STEP 1672 H= 418:00 +CPU= 13.667
  19:21:12 STEP 1673 H= 418:15 +CPU= 13.251
  19:21:29 STEP 1674 H= 418:30 +CPU= 17.561
  19:21:50 STEP 1675 H= 418:45 +CPU= 20.666
  19:22:12 STEP 1676 H= 419:00 +CPU= 22.249
  19:22:34 STEP 1677 H= 419:15 +CPU= 21.755
  19:22:55 STEP 1678 H= 419:30 +CPU= 20.764
  19:23:21 STEP 1679 H= 419:45 +CPU= 25.815
  19:24:18 STEP 1680 H= 420:00 +CPU= 56.859
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMGGh7zg+001680
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMSHh7zg+001680
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMUAh7zg+001680
  19:24:57 STEP 1681 H= 420:15 +CPU= 38.609
  19:25:35 STEP 1682 H= 420:30 +CPU= 38.074
  19:26:17 STEP 1683 H= 420:45 +CPU= 41.658
  19:27:02 STEP 1684 H= 421:00 +CPU= 45.293
  19:27:45 STEP 1685 H= 421:15 +CPU= 42.911
  19:28:25 STEP 1686 H= 421:30 +CPU= 39.699
  19:29:09 STEP 1687 H= 421:45 +CPU= 43.873
  19:29:50 STEP 1688 H= 422:00 +CPU= 40.034
  19:30:34 STEP 1689 H= 422:15 +CPU= 44.452
  19:31:16 STEP 1690 H= 422:30 +CPU= 41.743
  19:32:00 STEP 1691 H= 422:45 +CPU= 43.758
  19:32:57 STEP 1692 H= 423:00 +CPU= 56.122
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMGGh7zg+001692
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMSHh7zg+001692
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMUAh7zg+001692
  19:33:34 STEP 1693 H= 423:15 +CPU= 36.716
  19:34:14 STEP 1694 H= 423:30 +CPU= 40.663
  19:34:53 STEP 1695 H= 423:45 +CPU= 38.133
  19:35:33 STEP 1696 H= 424:00 +CPU= 39.709
  19:36:17 STEP 1697 H= 424:15 +CPU= 43.057
  19:36:56 STEP 1698 H= 424:30 +CPU= 38.870
  19:37:32 STEP 1699 H= 424:45 +CPU= 35.531
  19:38:14 STEP 1700 H= 425:00 +CPU= 41.391
  19:38:59 STEP 1701 H= 425:15 +CPU= 44.304
  19:39:38 STEP 1702 H= 425:30 +CPU= 39.033
  19:40:23 STEP 1703 H= 425:45 +CPU= 45.408
  19:41:14 STEP 1704 H= 426:00 +CPU= 50.352
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMGGh7zg+001704
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMSHh7zg+001704
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMUAh7zg+001704
  19:41:53 STEP 1705 H= 426:15 +CPU= 39.081
  19:42:37 STEP 1706 H= 426:30 +CPU= 43.620
  19:43:14 STEP 1707 H= 426:45 +CPU= 37.214
  19:43:57 STEP 1708 H= 427:00 +CPU= 42.481
  19:44:39 STEP 1709 H= 427:15 +CPU= 41.635
  19:45:19 STEP 1710 H= 427:30 +CPU= 40.154
  19:46:03 STEP 1711 H= 427:45 +CPU= 43.153
(argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.13_x86_64-pc-linux-gnu
(argv1) start_date: 2016092300
(argv2) exptid: h7zg
(argv3) unique_member_id: a11r
(argv4) batchid: 1018
(argv5) wuid: 12289686
(argv6) fclen: 20
(argv7) app_name: oifs_43r3_bl
(argv8) nthreads: 1
Working directory is: /home/antonio/BOINC/slots/144
Project directory is: /home/antonio/BOINC/projects/climateprediction.net/
app name: oifs_43r3_bl
version: 1.13
Location of temp folder: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686
..mkdir for temp folder for results failed
Copying: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip to: /home/antonio/BOINC/slots/144/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /home/antonio/BOINC/slots/144/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_0ccfd319d62681388f0f4c7fc564dba6 to: /home/antonio/BOINC/slots/144/oifs_43r3_bl_a11r_2016092300_20_1018_12289686.zip
Unzipping the namelist zip file: /home/antonio/BOINC/slots/144/oifs_43r3_bl_a11r_2016092300_20_1018_12289686.zip
ic_ancil_file: ic_ancil_12289686
ifsdata_file: ifsdata_12289686
climate_data_file: clim_data_12289686
horiz_resolution: 159
vert_resolution: 91
grid_type: l_2
upload_interval: 96
utstep: 900
nfrres: restart dump frequency (steps) 48
Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /home/antonio/BOINC/slots/144/ic_ancil_12289686.zip
Unzipping the IC ancils zip file: /home/antonio/BOINC/slots/144/ic_ancil_12289686.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_279e89ca8f9c26245798ba58723c3c60 to: /home/antonio/BOINC/slots/144/ifsdata/ifsdata_12289686.zip
Unzipping the ifsdata_zip file: /home/antonio/BOINC/slots/144/ifsdata/ifsdata_12289686.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /home/antonio/BOINC/slots/144/159l_2/clim_data_12289686.zip
Unzipping the climate data zip file: /home/antonio/BOINC/slots/144/159l_2/clim_data_12289686.zip
Checking for progress XML file: /home/antonio/BOINC/slots/144/progress_file_12289686.xml
Opened progress file ok : /home/antonio/BOINC/slots/144/progress_file_12289686.xml
-- Model is restarting --
Adjusting last_iter, 1712, to previous model restart step.
Creating progress file: /home/antonio/BOINC/slots/144/progress_file_12289686.xml
last_cpu_time: 41264
upload_file_number: 17
last_iter: 1681
last_upload: 1468800
model_completed: 0
total_length_of_simulation: 1728000
result_base_name: oifs_43r3_bl_a11r_2016092300_20_1018_12289686_0_r1342456576
The child process has been launched with process id: 7140
Executing the command: /home/antonio/BOINC/slots/144/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:Calma:1:1:7140:7140] [20240614:204210:1718390530:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2091] fp = 0x314f440
[EC_DRHOOK:Calma:1:1:7140:7140] [20240614:204210:1718390530:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:Calma:1:1:7140:7140] [20240614:204210:1718390530:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:Calma:1:1:7140:7140] [20240614:204210:1718390530:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:Calma:1:1:7140:7140] [20240614:204210:1718390530:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:Calma:1:1:7140:7140] [20240614:204210:1718390530:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:Calma:1:1:7140:7140] [20240614:204210:1718390530:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:Calma:1:1:7140:7140] [20240614:204210:1718390530:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:Calma:1:1:7140:7140] [20240614:204210:1718390530:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:Calma:1:1:7140:7140] [20240614:204210:1718390530:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:Calma:1:1:7140:7140] [20240614:204210:1718390530:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:Calma:1:1:7140:7140] [20240614:204210:1718390530:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:Calma:1:1:7140:7140] [20240614:204210:1718390530:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:Calma:1:1:7140:7140] [20240614:204210:1718390530:0.000] [ignore_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:Calma:1:1:7140:7140] [20240614:204210:1718390530:0.000] [restore_default_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:Calma:1:1:7140:7140] [20240614:204210:1718390530:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Calma:1:1:7140:7140] [20240614:204210:1718390530:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Calma:1:1:7140:7140] [20240614:204210:1718390530:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Calma:1:1:7140:7140] [20240614:204210:1718390530:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Calma:1:1:7140:7140] [20240614:204210:1718390530:0.001] [trapfpe_treatment@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:Calma:1:1:7140:7140] [20240614:204210:1718390530:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Calma:1:1:7140:7140] [20240614:204210:1718390530:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Calma:1:1:7140:7140] [20240614:204210:1718390530:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Calma:1:1:7140:7140] [20240614:204210:1718390530:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Calma:1:1:7140:7140] [20240614:204210:1718390530:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Calma:1:1:7140:7140] [20240614:204210:1718390530:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Calma:1:1:7140:7140] [20240614:204210:1718390530:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Calma:1:1:7140:7140] [20240614:204210:1718390530:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Calma:1:1:7140:7140] [20240614:204210:1718390530:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Calma:1:1:7140:7140] [20240614:204210:1718390530:0.001] [catch_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  20:42:41 STEP 1680 H= 420:00 +CPU= 23.448
  20:42:58 STEP 1681 H= 420:15 +CPU= 17.365
  20:43:20 STEP 1682 H= 420:30 +CPU= 21.918
  20:43:42 STEP 1683 H= 420:45 +CPU= 22.071
  20:43:59 STEP 1684 H= 421:00 +CPU= 17.215
  20:44:16 STEP 1685 H= 421:15 +CPU= 16.921
  20:44:32 STEP 1686 H= 421:30 +CPU= 15.624
  20:44:47 STEP 1687 H= 421:45 +CPU= 15.498
  20:45:11 STEP 1688 H= 422:00 +CPU= 23.876
  20:45:35 STEP 1689 H= 422:15 +CPU= 23.503
  20:45:55 STEP 1690 H= 422:30 +CPU= 20.164
  20:46:25 STEP 1691 H= 422:45 +CPU= 29.903
  20:47:02 STEP 1692 H= 423:00 +CPU= 36.641
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMGGh7zg+001692
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMSHh7zg+001692
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMUAh7zg+001692
  20:47:26 STEP 1693 H= 423:15 +CPU= 23.964
  20:47:54 STEP 1694 H= 423:30 +CPU= 28.251
  20:48:13 STEP 1695 H= 423:45 +CPU= 18.960
  20:48:39 STEP 1696 H= 424:00 +CPU= 25.684
  20:49:03 STEP 1697 H= 424:15 +CPU= 24.355
  20:49:32 STEP 1698 H= 424:30 +CPU= 29.159
  20:49:59 STEP 1699 H= 424:45 +CPU= 26.515
  20:50:19 STEP 1700 H= 425:00 +CPU= 20.186
  20:50:40 STEP 1701 H= 425:15 +CPU= 21.135
  20:51:04 STEP 1702 H= 425:30 +CPU= 23.972
  20:51:25 STEP 1703 H= 425:45 +CPU= 21.106
  20:52:02 STEP 1704 H= 426:00 +CPU= 37.240
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMGGh7zg+001704
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMSHh7zg+001704
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMUAh7zg+001704
  20:52:31 STEP 1705 H= 426:15 +CPU= 28.984
  20:53:00 STEP 1706 H= 426:30 +CPU= 29.046
  20:53:31 STEP 1707 H= 426:45 +CPU= 31.104
  20:53:51 STEP 1708 H= 427:00 +CPU= 19.889
  20:54:14 STEP 1709 H= 427:15 +CPU= 22.641
  20:54:34 STEP 1710 H= 427:30 +CPU= 20.267
  20:54:54 STEP 1711 H= 427:45 +CPU= 19.620
  20:55:17 STEP 1712 H= 428:00 +CPU= 23.229
  20:55:36 STEP 1713 H= 428:15 +CPU= 19.054
  20:55:58 STEP 1714 H= 428:30 +CPU= 21.932
  20:56:27 STEP 1715 H= 428:45 +CPU= 29.255
  20:57:00 STEP 1716 H= 429:00 +CPU= 32.725
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMGGh7zg+001716
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMSHh7zg+001716
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMUAh7zg+001716
  20:57:22 STEP 1717 H= 429:15 +CPU= 21.927
  20:57:43 STEP 1718 H= 429:30 +CPU= 20.406
  20:58:06 STEP 1719 H= 429:45 +CPU= 23.818
  20:58:35 STEP 1720 H= 430:00 +CPU= 29.014
  20:59:03 STEP 1721 H= 430:15 +CPU= 27.769
  20:59:31 STEP 1722 H= 430:30 +CPU= 28.161
  21:00:01 STEP 1723 H= 430:45 +CPU= 29.873
  21:00:29 STEP 1724 H= 431:00 +CPU= 28.076
  21:00:57 STEP 1725 H= 431:15 +CPU= 28.080
  21:01:21 STEP 1726 H= 431:30 +CPU= 23.796
  21:01:48 STEP 1727 H= 431:45 +CPU= 26.789
  21:02:32 STEP 1728 H= 432:00 +CPU= 43.846
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMGGh7zg+001728
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMSHh7zg+001728
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMUAh7zg+001728
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMGGh7zg+001632
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMSHh7zg+001632
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMUAh7zg+001632
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMGGh7zg+001644
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMSHh7zg+001644
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMUAh7zg+001644
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMGGh7zg+001656
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMSHh7zg+001656
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMUAh7zg+001656
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMGGh7zg+001668
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMSHh7zg+001668
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMUAh7zg+001668
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMGGh7zg+001680
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMSHh7zg+001680
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMUAh7zg+001680
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMGGh7zg+001692
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMSHh7zg+001692
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMUAh7zg+001692
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMGGh7zg+001704
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMSHh7zg+001704
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMUAh7zg+001704
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMGGh7zg+001716
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMSHh7zg+001716
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMUAh7zg+001716
Zipping up the intermediate file: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_a11r_2016092300_20_1018_12289686_0_r1342456576_17.zip
Uploading the intermediate file: upload_file_17.zip
  21:03:01 STEP 1729 H= 432:15 +CPU= 28.995
  21:03:30 STEP 1730 H= 432:30 +CPU= 28.507
  21:03:56 STEP 1731 H= 432:45 +CPU= 26.555
  21:04:24 STEP 1732 H= 433:00 +CPU= 27.780
  21:04:51 STEP 1733 H= 433:15 +CPU= 26.843
  21:05:16 STEP 1734 H= 433:30 +CPU= 24.387
  21:05:42 STEP 1735 H= 433:45 +CPU= 26.023
  21:06:09 STEP 1736 H= 434:00 +CPU= 27.449
  21:06:37 STEP 1737 H= 434:15 +CPU= 27.272
  21:07:01 STEP 1738 H= 434:30 +CPU= 24.687
  21:07:26 STEP 1739 H= 434:45 +CPU= 24.746
  21:08:02 STEP 1740 H= 435:00 +CPU= 35.334
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMGGh7zg+001740
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMSHh7zg+001740
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMUAh7zg+001740
  21:08:27 STEP 1741 H= 435:15 +CPU= 25.139
  21:08:51 STEP 1742 H= 435:30 +CPU= 24.156
  21:09:22 STEP 1743 H= 435:45 +CPU= 30.582
  21:09:50 STEP 1744 H= 436:00 +CPU= 28.301
  21:10:19 STEP 1745 H= 436:15 +CPU= 28.730
  21:10:46 STEP 1746 H= 436:30 +CPU= 26.881
  21:11:09 STEP 1747 H= 436:45 +CPU= 23.271
  21:11:37 STEP 1748 H= 437:00 +CPU= 27.719
  21:12:06 STEP 1749 H= 437:15 +CPU= 29.205
  21:12:32 STEP 1750 H= 437:30 +CPU= 25.614
  21:12:56 STEP 1751 H= 437:45 +CPU= 23.865
  21:13:30 STEP 1752 H= 438:00 +CPU= 33.970
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMGGh7zg+001752
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMSHh7zg+001752
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMUAh7zg+001752
  21:13:54 STEP 1753 H= 438:15 +CPU= 24.059
  21:14:25 STEP 1754 H= 438:30 +CPU= 30.680
  21:14:48 STEP 1755 H= 438:45 +CPU= 22.675
  21:15:13 STEP 1756 H= 439:00 +CPU= 25.624
  21:15:38 STEP 1757 H= 439:15 +CPU= 25.190
  21:16:03 STEP 1758 H= 439:30 +CPU= 24.351
  21:16:28 STEP 1759 H= 439:45 +CPU= 25.312
  21:16:52 STEP 1760 H= 440:00 +CPU= 23.453
  21:17:18 STEP 1761 H= 440:15 +CPU= 25.737
  21:17:48 STEP 1762 H= 440:30 +CPU= 30.292
  21:18:15 STEP 1763 H= 440:45 +CPU= 26.460
  21:18:48 STEP 1764 H= 441:00 +CPU= 32.877
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMGGh7zg+001764
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMSHh7zg+001764
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMUAh7zg+001764
  21:19:13 STEP 1765 H= 441:15 +CPU= 25.438
  21:19:40 STEP 1766 H= 441:30 +CPU= 26.979
  21:20:11 STEP 1767 H= 441:45 +CPU= 31.061
  21:20:40 STEP 1768 H= 442:00 +CPU= 28.655
  21:21:08 STEP 1769 H= 442:15 +CPU= 28.277
  21:21:33 STEP 1770 H= 442:30 +CPU= 24.189
  21:22:03 STEP 1771 H= 442:45 +CPU= 30.573
  21:22:31 STEP 1772 H= 443:00 +CPU= 27.609
  21:23:00 STEP 1773 H= 443:15 +CPU= 29.049
  21:23:27 STEP 1774 H= 443:30 +CPU= 27.034
  21:23:51 STEP 1775 H= 443:45 +CPU= 23.884
  21:24:27 STEP 1776 H= 444:00 +CPU= 36.094
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMGGh7zg+001776
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMSHh7zg+001776
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMUAh7zg+001776
  21:24:50 STEP 1777 H= 444:15 +CPU= 22.449
  21:25:09 STEP 1778 H= 444:30 +CPU= 19.631
  21:25:38 STEP 1779 H= 444:45 +CPU= 28.918
  21:26:08 STEP 1780 H= 445:00 +CPU= 29.766
  21:26:27 STEP 1781 H= 445:15 +CPU= 19.253
  21:26:50 STEP 1782 H= 445:30 +CPU= 22.307
  21:27:08 STEP 1783 H= 445:45 +CPU= 17.957
  21:27:27 STEP 1784 H= 446:00 +CPU= 19.420
  21:27:47 STEP 1785 H= 446:15 +CPU= 19.976
  21:28:09 STEP 1786 H= 446:30 +CPU= 21.886
  21:28:36 STEP 1787 H= 446:45 +CPU= 26.622
  21:29:11 STEP 1788 H= 447:00 +CPU= 35.855
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMGGh7zg+001788
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMSHh7zg+001788
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMUAh7zg+001788
  21:29:31 STEP 1789 H= 447:15 +CPU= 19.510
  21:29:52 STEP 1790 H= 447:30 +CPU= 20.857
  21:30:13 STEP 1791 H= 447:45 +CPU= 20.776
  21:30:37 STEP 1792 H= 448:00 +CPU= 24.313
  21:31:04 STEP 1793 H= 448:15 +CPU= 27.191
  21:31:32 STEP 1794 H= 448:30 +CPU= 27.712
  21:31:59 STEP 1795 H= 448:45 +CPU= 27.445
  21:32:23 STEP 1796 H= 449:00 +CPU= 23.904
  21:32:43 STEP 1797 H= 449:15 +CPU= 20.298
  21:33:09 STEP 1798 H= 449:30 +CPU= 25.090
  21:33:28 STEP 1799 H= 449:45 +CPU= 19.246
  21:33:54 STEP 1800 H= 450:00 +CPU= 26.450
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMGGh7zg+001800
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMSHh7zg+001800
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMUAh7zg+001800
  21:34:24 STEP 1801 H= 450:15 +CPU= 29.283
  21:34:51 STEP 1802 H= 450:30 +CPU= 27.192
  21:35:16 STEP 1803 H= 450:45 +CPU= 25.240
  21:35:40 STEP 1804 H= 451:00 +CPU= 24.516
  21:36:04 STEP 1805 H= 451:15 +CPU= 23.770
  21:36:29 STEP 1806 H= 451:30 +CPU= 24.749
  21:36:56 STEP 1807 H= 451:45 +CPU= 26.817
  21:37:20 STEP 1808 H= 452:00 +CPU= 24.108
  21:37:38 STEP 1809 H= 452:15 +CPU= 17.867
  21:38:01 STEP 1810 H= 452:30 +CPU= 22.761
  21:38:27 STEP 1811 H= 452:45 +CPU= 26.417
  21:39:02 STEP 1812 H= 453:00 +CPU= 35.113
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMGGh7zg+001812
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMSHh7zg+001812
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMUAh7zg+001812
  21:39:30 STEP 1813 H= 453:15 +CPU= 27.837
  21:39:57 STEP 1814 H= 453:30 +CPU= 26.707
  21:40:25 STEP 1815 H= 453:45 +CPU= 28.172
  21:40:53 STEP 1816 H= 454:00 +CPU= 27.826
  21:41:22 STEP 1817 H= 454:15 +CPU= 29.097
  21:41:50 STEP 1818 H= 454:30 +CPU= 28.153
  21:42:14 STEP 1819 H= 454:45 +CPU= 24.166
  21:42:36 STEP 1820 H= 455:00 +CPU= 21.757
  21:42:56 STEP 1821 H= 455:15 +CPU= 19.600
  21:43:13 STEP 1822 H= 455:30 +CPU= 17.506
  21:43:37 STEP 1823 H= 455:45 +CPU= 24.392
  21:44:12 STEP 1824 H= 456:00 +CPU= 34.575
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMGGh7zg+001824
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMSHh7zg+001824
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMUAh7zg+001824
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMGGh7zg+001728
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMSHh7zg+001728
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMUAh7zg+001728
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMGGh7zg+001740
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMSHh7zg+001740
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMUAh7zg+001740
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMGGh7zg+001752
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMSHh7zg+001752
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMUAh7zg+001752
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMGGh7zg+001764
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMSHh7zg+001764
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMUAh7zg+001764
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMGGh7zg+001776
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMSHh7zg+001776
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMUAh7zg+001776
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMGGh7zg+001788
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMSHh7zg+001788
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMUAh7zg+001788
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMGGh7zg+001800
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMSHh7zg+001800
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMUAh7zg+001800
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMGGh7zg+001812
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMSHh7zg+001812
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMUAh7zg+001812
Zipping up the intermediate file: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_a11r_2016092300_20_1018_12289686_0_r1342456576_18.zip
  21:44:31 STEP 1825 H= 456:15 +CPU= 19.396
Uploading the intermediate file: upload_file_18.zip
  21:44:50 STEP 1826 H= 456:30 +CPU= 18.407
  21:45:10 STEP 1827 H= 456:45 +CPU= 19.914
  21:45:29 STEP 1828 H= 457:00 +CPU= 19.700
  21:45:56 STEP 1829 H= 457:15 +CPU= 26.325
  21:46:23 STEP 1830 H= 457:30 +CPU= 27.431
  21:46:48 STEP 1831 H= 457:45 +CPU= 24.949
  21:47:16 STEP 1832 H= 458:00 +CPU= 28.085
  21:47:45 STEP 1833 H= 458:15 +CPU= 28.750
  21:48:11 STEP 1834 H= 458:30 +CPU= 25.807
  21:48:39 STEP 1835 H= 458:45 +CPU= 27.755
  21:49:17 STEP 1836 H= 459:00 +CPU= 38.470
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMGGh7zg+001836
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMSHh7zg+001836
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMUAh7zg+001836
  21:49:40 STEP 1837 H= 459:15 +CPU= 23.020
  21:50:00 STEP 1838 H= 459:30 +CPU= 20.216
  21:50:23 STEP 1839 H= 459:45 +CPU= 22.496
  21:50:51 STEP 1840 H= 460:00 +CPU= 27.692
  21:51:19 STEP 1841 H= 460:15 +CPU= 28.701
  21:51:45 STEP 1842 H= 460:30 +CPU= 25.903
  21:52:11 STEP 1843 H= 460:45 +CPU= 25.627
  21:52:42 STEP 1844 H= 461:00 +CPU= 31.400
  21:53:04 STEP 1845 H= 461:15 +CPU= 21.594
  21:53:25 STEP 1846 H= 461:30 +CPU= 21.268
  21:53:44 STEP 1847 H= 461:45 +CPU= 18.549
  21:54:11 STEP 1848 H= 462:00 +CPU= 27.219
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMGGh7zg+001848
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMSHh7zg+001848
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMUAh7zg+001848
  21:54:37 STEP 1849 H= 462:15 +CPU= 25.988
  21:55:04 STEP 1850 H= 462:30 +CPU= 27.166
  21:55:24 STEP 1851 H= 462:45 +CPU= 19.925
  21:55:55 STEP 1852 H= 463:00 +CPU= 31.209
  21:56:20 STEP 1853 H= 463:15 +CPU= 24.515
  21:56:41 STEP 1854 H= 463:30 +CPU= 21.536
  21:57:03 STEP 1855 H= 463:45 +CPU= 21.715
  21:57:24 STEP 1856 H= 464:00 +CPU= 21.038
  21:57:45 STEP 1857 H= 464:15 +CPU= 20.945
  21:58:08 STEP 1858 H= 464:30 +CPU= 22.557
  21:58:28 STEP 1859 H= 464:45 +CPU= 20.712
  21:59:03 STEP 1860 H= 465:00 +CPU= 34.870
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMGGh7zg+001860
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMSHh7zg+001860
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMUAh7zg+001860
  21:59:32 STEP 1861 H= 465:15 +CPU= 29.189
  22:00:01 STEP 1862 H= 465:30 +CPU= 28.094
  22:00:27 STEP 1863 H= 465:45 +CPU= 26.249
  22:00:55 STEP 1864 H= 466:00 +CPU= 27.744
  22:01:20 STEP 1865 H= 466:15 +CPU= 25.219
  22:01:43 STEP 1866 H= 466:30 +CPU= 22.677
  22:02:08 STEP 1867 H= 466:45 +CPU= 25.379
  22:02:35 STEP 1868 H= 467:00 +CPU= 26.656
  22:03:03 STEP 1869 H= 467:15 +CPU= 28.134
  22:03:28 STEP 1870 H= 467:30 +CPU= 25.351
  22:03:55 STEP 1871 H= 467:45 +CPU= 26.798
  22:04:36 STEP 1872 H= 468:00 +CPU= 40.923
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMGGh7zg+001872
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMSHh7zg+001872
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMUAh7zg+001872
  22:05:06 STEP 1873 H= 468:15 +CPU= 30.401
  22:05:34 STEP 1874 H= 468:30 +CPU= 27.952
  22:06:02 STEP 1875 H= 468:45 +CPU= 27.267
  22:06:27 STEP 1876 H= 469:00 +CPU= 25.707
  22:06:50 STEP 1877 H= 469:15 +CPU= 22.938
  22:07:17 STEP 1878 H= 469:30 +CPU= 26.713
  22:07:44 STEP 1879 H= 469:45 +CPU= 27.368
  22:08:10 STEP 1880 H= 470:00 +CPU= 25.427
  22:08:37 STEP 1881 H= 470:15 +CPU= 26.814
  22:09:03 STEP 1882 H= 470:30 +CPU= 26.144
  22:09:23 STEP 1883 H= 470:45 +CPU= 20.392
  22:09:57 STEP 1884 H= 471:00 +CPU= 34.165
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMGGh7zg+001884
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMSHh7zg+001884
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMUAh7zg+001884
  22:10:21 STEP 1885 H= 471:15 +CPU= 23.006
  22:10:46 STEP 1886 H= 471:30 +CPU= 25.019
  22:11:08 STEP 1887 H= 471:45 +CPU= 22.799
  22:11:36 STEP 1888 H= 472:00 +CPU= 27.559
  22:11:56 STEP 1889 H= 472:15 +CPU= 19.730
  22:12:22 STEP 1890 H= 472:30 +CPU= 25.877
  22:12:42 STEP 1891 H= 472:45 +CPU= 20.754
  22:13:12 STEP 1892 H= 473:00 +CPU= 29.105
  22:13:31 STEP 1893 H= 473:15 +CPU= 19.638
  22:13:55 STEP 1894 H= 473:30 +CPU= 23.319
  22:14:13 STEP 1895 H= 473:45 +CPU= 18.549
  22:14:47 STEP 1896 H= 474:00 +CPU= 33.874
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMGGh7zg+001896
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMSHh7zg+001896
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMUAh7zg+001896
  22:15:15 STEP 1897 H= 474:15 +CPU= 28.265
  22:15:41 STEP 1898 H= 474:30 +CPU= 25.962
  22:16:04 STEP 1899 H= 474:45 +CPU= 22.902
  22:16:28 STEP 1900 H= 475:00 +CPU= 24.337
  22:16:56 STEP 1901 H= 475:15 +CPU= 27.321
  22:17:17 STEP 1902 H= 475:30 +CPU= 21.319
  22:17:43 STEP 1903 H= 475:45 +CPU= 26.064
  22:18:11 STEP 1904 H= 476:00 +CPU= 27.395
  22:18:32 STEP 1905 H= 476:15 +CPU= 21.576
  22:18:50 STEP 1906 H= 476:30 +CPU= 18.045
  22:19:10 STEP 1907 H= 476:45 +CPU= 20.119
  22:19:37 STEP 1908 H= 477:00 +CPU= 26.060
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMGGh7zg+001908
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMSHh7zg+001908
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMUAh7zg+001908
  22:19:57 STEP 1909 H= 477:15 +CPU= 20.226
  22:20:20 STEP 1910 H= 477:30 +CPU= 23.387
  22:20:47 STEP 1911 H= 477:45 +CPU= 27.270
  22:21:14 STEP 1912 H= 478:00 +CPU= 26.937
  22:21:43 STEP 1913 H= 478:15 +CPU= 28.754
  22:22:08 STEP 1914 H= 478:30 +CPU= 24.748
  22:22:36 STEP 1915 H= 478:45 +CPU= 28.528
  22:23:05 STEP 1916 H= 479:00 +CPU= 28.035
  22:23:22 STEP 1917 H= 479:15 +CPU= 17.682
  22:23:43 STEP 1918 H= 479:30 +CPU= 20.423
  22:24:11 STEP 1919 H= 479:45 +CPU= 28.473
  22:24:52 STEP 1920 H= 480:00 +CPU= 40.795
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

 
DDH------------------------------------------------------------------------
I                                                                         I
I TIME =  480.000H DDH * Diagnostic Var.,     AREA                GLOBAL  I
I                                                                         I
I-------------------------------------------------------------------------I
I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I      0.1471193163E-20      I       0.2184550149E-05      I
ICloud fractionI      0.0000000000E+00      I       0.1258793319E-01      I
I  Relat. Hum. I      0.1440222588E+00      I       0.2292633965E+00      I
I  PASS 01     I      0.0000000000E+00      I       0.2506508301E+03      I
DDH------------------------------------------------------------------------
  
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1920 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001920 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001920
 MPI-TASK:   1 -    309693204 BYTES IN      7 RECORDS TRANSFERRED IN    0.0009 SECONDS344103.6 Mbytes/s, TOTAL TIME=    0.0096( 9.4%)
 22:24:52 STEP 1920 H= 480:00 +CPU= 40.795
 END CNT3
 NSTEP =  1920 CNT0   000000000  25.317  25.317  25.370   0.998               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ           46/  1069125708 WRITTEN         7150/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1    128    0       46      1044068     7150 ************    30.3     3.8    26.6     5.3    38.9
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 6161791.2 6161791.2    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 6154693.5 6154693.5     99.88      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                  261    4153.6    4153.6     17.59      0.00
   9 SPCM     - SPECTRAL COMP.                     240     583.3     583.3      2.27      0.00
  10 SCAN2M - PHYSICS                              241   11930.6   11930.6     46.66      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                 20    1604.6    1604.6      0.52      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                 11      31.1      31.1      0.01      0.00
  17 GRIDFPOS IN CNT4                               20      37.5      37.5      0.01      0.00
  27 RESTART FILES - WRITING                         5    6418.4    6418.4      0.52      0.00
  28 RESTART FILES - READING                         1    6431.6    6431.6      0.10      0.00
  29 SU4FPOS IN CNT4                                20       0.1       0.1      0.00      0.00
  30 DYNFPOS IN CNT4                                20    6610.0    6610.0      2.15      0.00
  31 POSDDH IN STEPO                                 2       1.4       1.4      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                    241    5482.7    5482.7     21.44      0.00
  39 SU0YOMB                                         1     430.7     430.7      0.01      0.00
  51 SCAN2M   - SL COMM. PART 1                    241      13.3      13.3      0.05      0.00
  54 SPCM     - M TO S/S TO M TRANSP.              240      98.7      98.7      0.38      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.              240      43.0      43.0      0.17      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                 11       0.2       0.2      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM      524     427.6     427.6      3.64      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM       500     250.6     250.6      2.03      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM        500      91.9      91.9      0.75      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM       524     127.9     127.9      1.09      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1      37.6      37.6      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION            524      75.6      75.6      0.64      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION            500      32.8      32.8      0.27      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION            524      35.4      35.4      0.30      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION            500      21.3      21.3      0.17      0.00
 400 GSTATS                                      28864       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                 26802       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME     6161.8 CPU TIME    6154.4 VECTOR TIME     6154.4


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY      280.8
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMGGh7zg+001920
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMSHh7zg+001920
Moving to projects directory: /home/antonio/BOINC/slots/144/ICMUAh7zg+001920
Adding to the zip: /home/antonio/BOINC/slots/144/NODE.001_01
Adding to the zip: /home/antonio/BOINC/slots/144/ifs.stat
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMSHh7zg+001860
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMUAh7zg+001824
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMSHh7zg+001920
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMGGh7zg+001908
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMGGh7zg+001884
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMUAh7zg+001848
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMGGh7zg+001848
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMSHh7zg+001872
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMGGh7zg+001860
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMSHh7zg+001908
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMUAh7zg+001872
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMSHh7zg+001848
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMSHh7zg+001896
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMUAh7zg+001836
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMUAh7zg+001896
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMSHh7zg+001824
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMGGh7zg+001896
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMSHh7zg+001884
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMGGh7zg+001920
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMGGh7zg+001824
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMGGh7zg+001872
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMUAh7zg+001920
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMSHh7zg+001836
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMGGh7zg+001836
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMUAh7zg+001908
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMUAh7zg+001884
Adding to the zip: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_12289686/ICMUAh7zg+001860
Zipping up the final file: /home/antonio/BOINC/projects/climateprediction.net/oifs_43r3_bl_a11r_2016092300_20_1018_12289686_0_r1342456576_19.zip
Uploading the final file: upload_file_19.zip
Uploading trickle at timestep: 1727100
22:28:28 (6656): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
14 Jun 2024 20:44:25 1551266 22443273 oifs_43r3_bl_a11r_2016092300_20_1018_12289686_0 1,727,100 47,418 0.0275
14 Jun 2024 14:06:06 1551266 22443273 oifs_43r3_bl_a11r_2016092300_20_1018_12289686_0 864,000 26,072 0.0302


©2024 cpdn.org