climateprediction.net home page
Task 22448522

Task 22448522

Name oifs_43r3_bl_a49i_2016092300_20_1018_12293853_1
Workunit 12293853
Created 13 Jun 2024, 14:37:03 UTC
Sent 14 Jun 2024, 6:01:32 UTC
Report deadline 13 Aug 2024, 6:01:32 UTC
Received 17 Jun 2024, 20:26:35 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1463165
Run time 12 hours 28 min 44 sec
CPU time 12 hours 28 min 44 sec
Validate state Valid
Credit 2,635.55
Device peak FLOPS 4.64 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.13
x86_64-pc-linux-gnu
Peak working set size 5,191.57 MB
Peak swap size 5,981.07 MB
Peak disk usage 1,369.12 MB
Stderr
<core_client_version>7.24.1</core_client_version>
<![CDATA[
<stderr_txt>
1400 H= 350:00 +CPU= 21.672
  22:11:17 STEP 1401 H= 350:15 +CPU= 21.153
  22:11:38 STEP 1402 H= 350:30 +CPU= 21.154
  22:11:59 STEP 1403 H= 350:45 +CPU= 21.138
  22:12:25 STEP 1404 H= 351:00 +CPU= 26.222
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+001404
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+001404
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+001404
  22:12:47 STEP 1405 H= 351:15 +CPU= 21.123
  22:13:08 STEP 1406 H= 351:30 +CPU= 21.142
  22:13:29 STEP 1407 H= 351:45 +CPU= 21.142
  22:13:50 STEP 1408 H= 352:00 +CPU= 21.668
  22:14:12 STEP 1409 H= 352:15 +CPU= 21.131
  22:14:33 STEP 1410 H= 352:30 +CPU= 21.126
  22:14:54 STEP 1411 H= 352:45 +CPU= 21.130
  22:15:16 STEP 1412 H= 353:00 +CPU= 21.652
  22:15:37 STEP 1413 H= 353:15 +CPU= 21.130
  22:15:58 STEP 1414 H= 353:30 +CPU= 21.128
  22:16:19 STEP 1415 H= 353:45 +CPU= 21.130
  22:16:45 STEP 1416 H= 354:00 +CPU= 26.267
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+001416
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+001416
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+001416
  22:17:06 STEP 1417 H= 354:15 +CPU= 21.152
  22:17:28 STEP 1418 H= 354:30 +CPU= 21.141
  22:17:49 STEP 1419 H= 354:45 +CPU= 21.153
  22:18:10 STEP 1420 H= 355:00 +CPU= 21.672
  22:18:32 STEP 1421 H= 355:15 +CPU= 21.147
  22:18:53 STEP 1422 H= 355:30 +CPU= 21.157
  22:19:14 STEP 1423 H= 355:45 +CPU= 21.164
  22:19:36 STEP 1424 H= 356:00 +CPU= 21.693
  22:19:57 STEP 1425 H= 356:15 +CPU= 21.161
  22:20:18 STEP 1426 H= 356:30 +CPU= 21.165
  22:20:39 STEP 1427 H= 356:45 +CPU= 21.152
  22:21:05 STEP 1428 H= 357:00 +CPU= 26.247
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+001428
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+001428
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+001428
  22:21:27 STEP 1429 H= 357:15 +CPU= 21.155
  22:21:48 STEP 1430 H= 357:30 +CPU= 21.157
  22:22:09 STEP 1431 H= 357:45 +CPU= 21.151
  22:22:31 STEP 1432 H= 358:00 +CPU= 21.667
  22:22:52 STEP 1433 H= 358:15 +CPU= 21.150
  22:23:13 STEP 1434 H= 358:30 +CPU= 21.170
  22:23:34 STEP 1435 H= 358:45 +CPU= 21.164
  22:23:56 STEP 1436 H= 359:00 +CPU= 21.675
  22:24:17 STEP 1437 H= 359:15 +CPU= 21.152
  22:24:38 STEP 1438 H= 359:30 +CPU= 21.161
  22:24:59 STEP 1439 H= 359:45 +CPU= 21.139
  22:25:28 STEP 1440 H= 360:00 +CPU= 28.514
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+001440
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+001440
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMGGh7zg+001344
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMSHh7zg+001344
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMGGh7zg+001356
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMSHh7zg+001356
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMUAh7zg+001356
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMGGh7zg+001368
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMSHh7zg+001368
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMUAh7zg+001368
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMGGh7zg+001380
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMSHh7zg+001380
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMUAh7zg+001380
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMGGh7zg+001392
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMSHh7zg+001392
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMUAh7zg+001392
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMGGh7zg+001404
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMSHh7zg+001404
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMUAh7zg+001404
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMGGh7zg+001416
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMSHh7zg+001416
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMUAh7zg+001416
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMGGh7zg+001428
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMSHh7zg+001428
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMUAh7zg+001428
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a49i_2016092300_20_1018_12293853_1_r1364958700_14.zip
Uploading the intermediate file: upload_file_14.zip
  22:25:49 STEP 1441 H= 360:15 +CPU= 21.376
  22:26:10 STEP 1442 H= 360:30 +CPU= 21.205
  22:26:32 STEP 1443 H= 360:45 +CPU= 21.533
  22:26:54 STEP 1444 H= 361:00 +CPU= 22.040
  22:27:16 STEP 1445 H= 361:15 +CPU= 21.518
  22:27:37 STEP 1446 H= 361:30 +CPU= 21.256
  22:27:58 STEP 1447 H= 361:45 +CPU= 21.162
  22:28:20 STEP 1448 H= 362:00 +CPU= 21.681
  22:28:41 STEP 1449 H= 362:15 +CPU= 21.168
  22:29:02 STEP 1450 H= 362:30 +CPU= 21.167
  22:29:23 STEP 1451 H= 362:45 +CPU= 21.160
  22:29:50 STEP 1452 H= 363:00 +CPU= 26.241
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+001452
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+001452
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+001452
  22:30:11 STEP 1453 H= 363:15 +CPU= 21.170
  22:30:32 STEP 1454 H= 363:30 +CPU= 21.201
  22:30:53 STEP 1455 H= 363:45 +CPU= 21.176
  22:31:15 STEP 1456 H= 364:00 +CPU= 21.704
  22:31:36 STEP 1457 H= 364:15 +CPU= 21.182
  22:31:57 STEP 1458 H= 364:30 +CPU= 21.166
  22:32:18 STEP 1459 H= 364:45 +CPU= 21.166
  22:32:40 STEP 1460 H= 365:00 +CPU= 21.681
  22:33:01 STEP 1461 H= 365:15 +CPU= 21.158
  22:33:22 STEP 1462 H= 365:30 +CPU= 21.174
  22:33:44 STEP 1463 H= 365:45 +CPU= 21.163
  22:34:10 STEP 1464 H= 366:00 +CPU= 26.265
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+001464
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+001464
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+001464
  22:34:31 STEP 1465 H= 366:15 +CPU= 21.163
  22:34:52 STEP 1466 H= 366:30 +CPU= 21.152
  22:35:13 STEP 1467 H= 366:45 +CPU= 21.155
  22:35:35 STEP 1468 H= 367:00 +CPU= 21.678
  22:35:56 STEP 1469 H= 367:15 +CPU= 21.155
  22:36:17 STEP 1470 H= 367:30 +CPU= 21.157
  22:36:39 STEP 1471 H= 367:45 +CPU= 21.152
  22:37:00 STEP 1472 H= 368:00 +CPU= 21.683
  22:37:21 STEP 1473 H= 368:15 +CPU= 21.170
  22:37:43 STEP 1474 H= 368:30 +CPU= 21.174
  22:38:04 STEP 1475 H= 368:45 +CPU= 21.176
  22:38:30 STEP 1476 H= 369:00 +CPU= 26.264
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+001476
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+001476
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+001476
  22:38:51 STEP 1477 H= 369:15 +CPU= 21.146
  22:39:12 STEP 1478 H= 369:30 +CPU= 21.151
  22:39:34 STEP 1479 H= 369:45 +CPU= 21.143
  22:39:55 STEP 1480 H= 370:00 +CPU= 21.678
  22:40:16 STEP 1481 H= 370:15 +CPU= 21.158
  22:40:38 STEP 1482 H= 370:30 +CPU= 21.157
  22:40:59 STEP 1483 H= 370:45 +CPU= 21.158
  22:41:20 STEP 1484 H= 371:00 +CPU= 21.660
  22:41:42 STEP 1485 H= 371:15 +CPU= 21.146
  22:42:03 STEP 1486 H= 371:30 +CPU= 21.154
  22:42:24 STEP 1487 H= 371:45 +CPU= 21.151
  22:42:52 STEP 1488 H= 372:00 +CPU= 28.470
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+001488
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+001488
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+001488
  22:43:14 STEP 1489 H= 372:15 +CPU= 21.172
  22:43:35 STEP 1490 H= 372:30 +CPU= 21.157
  22:43:56 STEP 1491 H= 372:45 +CPU= 21.144
  22:44:18 STEP 1492 H= 373:00 +CPU= 21.669
  22:44:39 STEP 1493 H= 373:15 +CPU= 21.163
  22:45:00 STEP 1494 H= 373:30 +CPU= 21.165
  22:45:21 STEP 1495 H= 373:45 +CPU= 21.158
  22:45:43 STEP 1496 H= 374:00 +CPU= 21.679
  22:46:04 STEP 1497 H= 374:15 +CPU= 21.149
  22:46:25 STEP 1498 H= 374:30 +CPU= 21.161
  22:46:46 STEP 1499 H= 374:45 +CPU= 21.156
  22:47:13 STEP 1500 H= 375:00 +CPU= 26.260
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+001500
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+001500
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+001500
  22:47:34 STEP 1501 H= 375:15 +CPU= 21.155
  22:47:55 STEP 1502 H= 375:30 +CPU= 21.152
  22:48:16 STEP 1503 H= 375:45 +CPU= 21.146
  22:48:38 STEP 1504 H= 376:00 +CPU= 21.673
  22:48:59 STEP 1505 H= 376:15 +CPU= 21.130
  22:49:20 STEP 1506 H= 376:30 +CPU= 21.153
  22:49:41 STEP 1507 H= 376:45 +CPU= 21.149
  22:50:03 STEP 1508 H= 377:00 +CPU= 21.660
  22:50:24 STEP 1509 H= 377:15 +CPU= 21.152
  22:50:45 STEP 1510 H= 377:30 +CPU= 21.144
  22:51:06 STEP 1511 H= 377:45 +CPU= 21.161
  22:51:33 STEP 1512 H= 378:00 +CPU= 26.317
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+001512
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+001512
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+001512
  22:51:54 STEP 1513 H= 378:15 +CPU= 21.170
  22:52:15 STEP 1514 H= 378:30 +CPU= 21.154
  22:52:36 STEP 1515 H= 378:45 +CPU= 21.143
  22:52:58 STEP 1516 H= 379:00 +CPU= 21.665
  22:53:19 STEP 1517 H= 379:15 +CPU= 21.147
  22:53:40 STEP 1518 H= 379:30 +CPU= 21.147
  22:54:01 STEP 1519 H= 379:45 +CPU= 21.159
  22:54:23 STEP 1520 H= 380:00 +CPU= 21.667
  22:54:44 STEP 1521 H= 380:15 +CPU= 21.155
  22:55:05 STEP 1522 H= 380:30 +CPU= 21.153
  22:55:26 STEP 1523 H= 380:45 +CPU= 21.150
  22:55:53 STEP 1524 H= 381:00 +CPU= 26.247
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+001524
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+001524
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+001524
  22:56:14 STEP 1525 H= 381:15 +CPU= 21.157
  22:56:35 STEP 1526 H= 381:30 +CPU= 21.170
  22:56:56 STEP 1527 H= 381:45 +CPU= 21.162
  22:57:18 STEP 1528 H= 382:00 +CPU= 21.691
  22:57:39 STEP 1529 H= 382:15 +CPU= 21.187
  22:58:00 STEP 1530 H= 382:30 +CPU= 21.173
  22:58:21 STEP 1531 H= 382:45 +CPU= 21.188
  22:58:43 STEP 1532 H= 383:00 +CPU= 21.705
  22:59:04 STEP 1533 H= 383:15 +CPU= 21.170
  22:59:26 STEP 1534 H= 383:30 +CPU= 21.170
  22:59:47 STEP 1535 H= 383:45 +CPU= 21.178
  23:00:15 STEP 1536 H= 384:00 +CPU= 28.504
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+001536
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+001536
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+001536
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMGGh7zg+001440
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMSHh7zg+001440
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMGGh7zg+001452
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMSHh7zg+001452
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMUAh7zg+001452
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMGGh7zg+001464
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMSHh7zg+001464
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMUAh7zg+001464
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMGGh7zg+001476
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMSHh7zg+001476
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMUAh7zg+001476
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMGGh7zg+001488
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMSHh7zg+001488
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMUAh7zg+001488
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMGGh7zg+001500
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMSHh7zg+001500
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMUAh7zg+001500
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMGGh7zg+001512
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMSHh7zg+001512
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMUAh7zg+001512
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMGGh7zg+001524
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMSHh7zg+001524
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMUAh7zg+001524
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a49i_2016092300_20_1018_12293853_1_r1364958700_15.zip
Uploading the intermediate file: upload_file_15.zip
  23:00:37 STEP 1537 H= 384:15 +CPU= 21.431
  23:00:58 STEP 1538 H= 384:30 +CPU= 21.402
  23:01:20 STEP 1539 H= 384:45 +CPU= 21.566
  23:01:42 STEP 1540 H= 385:00 +CPU= 22.096
  23:02:03 STEP 1541 H= 385:15 +CPU= 21.481
  23:02:24 STEP 1542 H= 385:30 +CPU= 21.208
  23:02:46 STEP 1543 H= 385:45 +CPU= 21.191
  23:03:07 STEP 1544 H= 386:00 +CPU= 21.721
  23:03:29 STEP 1545 H= 386:15 +CPU= 21.196
  23:03:50 STEP 1546 H= 386:30 +CPU= 21.186
  23:04:11 STEP 1547 H= 386:45 +CPU= 21.181
  23:04:37 STEP 1548 H= 387:00 +CPU= 26.293
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+001548
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+001548
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+001548
  23:04:58 STEP 1549 H= 387:15 +CPU= 21.183
  23:05:20 STEP 1550 H= 387:30 +CPU= 21.206
  23:05:41 STEP 1551 H= 387:45 +CPU= 21.181
  23:06:03 STEP 1552 H= 388:00 +CPU= 21.706
  23:06:24 STEP 1553 H= 388:15 +CPU= 21.192
  23:06:45 STEP 1554 H= 388:30 +CPU= 21.174
  23:07:06 STEP 1555 H= 388:45 +CPU= 21.186
  23:07:28 STEP 1556 H= 389:00 +CPU= 21.705
  23:07:49 STEP 1557 H= 389:15 +CPU= 21.171
  23:08:10 STEP 1558 H= 389:30 +CPU= 21.179
  23:08:31 STEP 1559 H= 389:45 +CPU= 21.189
  23:08:58 STEP 1560 H= 390:00 +CPU= 26.296
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+001560
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+001560
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+001560
  23:09:19 STEP 1561 H= 390:15 +CPU= 21.164
  23:09:40 STEP 1562 H= 390:30 +CPU= 21.163
  23:10:01 STEP 1563 H= 390:45 +CPU= 21.164
  23:10:23 STEP 1564 H= 391:00 +CPU= 21.681
  23:10:44 STEP 1565 H= 391:15 +CPU= 21.172
  23:11:05 STEP 1566 H= 391:30 +CPU= 21.167
  23:11:27 STEP 1567 H= 391:45 +CPU= 21.179
  23:11:48 STEP 1568 H= 392:00 +CPU= 21.703
  23:12:09 STEP 1569 H= 392:15 +CPU= 21.186
  23:12:31 STEP 1570 H= 392:30 +CPU= 21.193
  23:12:52 STEP 1571 H= 392:45 +CPU= 21.181
  23:13:18 STEP 1572 H= 393:00 +CPU= 26.274
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+001572
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+001572
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+001572
  23:13:39 STEP 1573 H= 393:15 +CPU= 21.193
  23:14:00 STEP 1574 H= 393:30 +CPU= 21.175
  23:14:22 STEP 1575 H= 393:45 +CPU= 21.188
  23:14:43 STEP 1576 H= 394:00 +CPU= 21.702
  23:15:05 STEP 1577 H= 394:15 +CPU= 21.173
  23:15:26 STEP 1578 H= 394:30 +CPU= 21.173
  23:15:47 STEP 1579 H= 394:45 +CPU= 21.185
  23:16:09 STEP 1580 H= 395:00 +CPU= 21.703
  23:16:30 STEP 1581 H= 395:15 +CPU= 21.183
  23:16:51 STEP 1582 H= 395:30 +CPU= 21.190
  23:17:12 STEP 1583 H= 395:45 +CPU= 21.179
  23:17:41 STEP 1584 H= 396:00 +CPU= 28.453
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+001584
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+001584
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+001584
  23:18:02 STEP 1585 H= 396:15 +CPU= 21.259
  23:18:23 STEP 1586 H= 396:30 +CPU= 21.173
  23:18:44 STEP 1587 H= 396:45 +CPU= 21.163
  23:19:06 STEP 1588 H= 397:00 +CPU= 21.690
  23:19:27 STEP 1589 H= 397:15 +CPU= 21.194
  23:19:48 STEP 1590 H= 397:30 +CPU= 21.159
  23:20:10 STEP 1591 H= 397:45 +CPU= 21.172
  23:20:31 STEP 1592 H= 398:00 +CPU= 21.686
  23:20:52 STEP 1593 H= 398:15 +CPU= 21.157
  23:21:14 STEP 1594 H= 398:30 +CPU= 21.166
  23:21:35 STEP 1595 H= 398:45 +CPU= 21.171
  23:22:01 STEP 1596 H= 399:00 +CPU= 26.274
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+001596
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+001596
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+001596
  23:22:22 STEP 1597 H= 399:15 +CPU= 21.183
  23:22:43 STEP 1598 H= 399:30 +CPU= 21.192
  23:23:05 STEP 1599 H= 399:45 +CPU= 21.194
  23:23:26 STEP 1600 H= 400:00 +CPU= 21.711
  23:23:48 STEP 1601 H= 400:15 +CPU= 21.203
  23:24:09 STEP 1602 H= 400:30 +CPU= 21.196
  23:24:30 STEP 1603 H= 400:45 +CPU= 21.198
  23:24:52 STEP 1604 H= 401:00 +CPU= 21.722
  23:25:13 STEP 1605 H= 401:15 +CPU= 21.188
  23:25:34 STEP 1606 H= 401:30 +CPU= 21.200
  23:25:55 STEP 1607 H= 401:45 +CPU= 21.197
  23:26:22 STEP 1608 H= 402:00 +CPU= 26.319
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+001608
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+001608
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+001608
  23:26:43 STEP 1609 H= 402:15 +CPU= 21.206
  23:27:04 STEP 1610 H= 402:30 +CPU= 21.209
  23:27:25 STEP 1611 H= 402:45 +CPU= 21.203
  23:27:47 STEP 1612 H= 403:00 +CPU= 21.728
  23:28:08 STEP 1613 H= 403:15 +CPU= 21.201
  23:28:29 STEP 1614 H= 403:30 +CPU= 21.217
  23:28:51 STEP 1615 H= 403:45 +CPU= 21.195
  23:29:12 STEP 1616 H= 404:00 +CPU= 21.715
  23:29:34 STEP 1617 H= 404:15 +CPU= 21.201
  23:29:55 STEP 1618 H= 404:30 +CPU= 21.179
  23:30:16 STEP 1619 H= 404:45 +CPU= 21.200
  23:30:42 STEP 1620 H= 405:00 +CPU= 26.268
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+001620
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+001620
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+001620
  23:31:03 STEP 1621 H= 405:15 +CPU= 21.196
  23:31:25 STEP 1622 H= 405:30 +CPU= 21.203
  23:31:46 STEP 1623 H= 405:45 +CPU= 21.186
  23:32:08 STEP 1624 H= 406:00 +CPU= 21.703
  23:32:29 STEP 1625 H= 406:15 +CPU= 21.183
  23:32:50 STEP 1626 H= 406:30 +CPU= 21.180
  23:33:11 STEP 1627 H= 406:45 +CPU= 21.210
  23:33:33 STEP 1628 H= 407:00 +CPU= 21.722
  23:33:54 STEP 1629 H= 407:15 +CPU= 21.196
  23:34:15 STEP 1630 H= 407:30 +CPU= 21.198
  23:34:37 STEP 1631 H= 407:45 +CPU= 21.215
  23:35:05 STEP 1632 H= 408:00 +CPU= 28.538
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+001632
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+001632
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+001632
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMGGh7zg+001536
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMSHh7zg+001536
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMUAh7zg+001536
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMGGh7zg+001548
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMSHh7zg+001548
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMUAh7zg+001548
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMGGh7zg+001560
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMSHh7zg+001560
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMUAh7zg+001560
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMGGh7zg+001572
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMSHh7zg+001572
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMUAh7zg+001572
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMGGh7zg+001584
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMSHh7zg+001584
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMUAh7zg+001584
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMGGh7zg+001596
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMSHh7zg+001596
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMUAh7zg+001596
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMGGh7zg+001608
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMSHh7zg+001608
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMUAh7zg+001608
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMGGh7zg+001620
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMSHh7zg+001620
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMUAh7zg+001620
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a49i_2016092300_20_1018_12293853_1_r1364958700_16.zip
Uploading the intermediate file: upload_file_16.zip
  23:35:27 STEP 1633 H= 408:15 +CPU= 21.430
  23:35:48 STEP 1634 H= 408:30 +CPU= 21.253
  23:36:09 STEP 1635 H= 408:45 +CPU= 21.592
  23:36:32 STEP 1636 H= 409:00 +CPU= 22.119
  23:36:53 STEP 1637 H= 409:15 +CPU= 21.570
  23:37:14 STEP 1638 H= 409:30 +CPU= 21.316
  23:37:36 STEP 1639 H= 409:45 +CPU= 21.221
  23:37:57 STEP 1640 H= 410:00 +CPU= 21.742
  23:38:19 STEP 1641 H= 410:15 +CPU= 21.208
  23:38:40 STEP 1642 H= 410:30 +CPU= 21.208
  23:39:01 STEP 1643 H= 410:45 +CPU= 21.205
  23:39:27 STEP 1644 H= 411:00 +CPU= 26.306
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+001644
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+001644
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+001644
  23:39:49 STEP 1645 H= 411:15 +CPU= 21.214
  23:40:10 STEP 1646 H= 411:30 +CPU= 21.214
  23:40:31 STEP 1647 H= 411:45 +CPU= 21.204
  23:40:53 STEP 1648 H= 412:00 +CPU= 21.727
  23:41:14 STEP 1649 H= 412:15 +CPU= 21.204
  23:41:35 STEP 1650 H= 412:30 +CPU= 21.197
  23:41:56 STEP 1651 H= 412:45 +CPU= 21.197
  23:42:18 STEP 1652 H= 413:00 +CPU= 21.717
  23:42:39 STEP 1653 H= 413:15 +CPU= 21.185
  23:43:01 STEP 1654 H= 413:30 +CPU= 21.191
  23:43:22 STEP 1655 H= 413:45 +CPU= 21.189
  23:43:48 STEP 1656 H= 414:00 +CPU= 26.292
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+001656
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+001656
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+001656
  23:44:09 STEP 1657 H= 414:15 +CPU= 21.181
  23:44:30 STEP 1658 H= 414:30 +CPU= 21.181
  23:44:52 STEP 1659 H= 414:45 +CPU= 21.182
  23:45:13 STEP 1660 H= 415:00 +CPU= 21.694
  23:45:34 STEP 1661 H= 415:15 +CPU= 21.174
  23:45:56 STEP 1662 H= 415:30 +CPU= 21.178
  23:46:17 STEP 1663 H= 415:45 +CPU= 21.198
  23:46:39 STEP 1664 H= 416:00 +CPU= 21.719
  23:47:00 STEP 1665 H= 416:15 +CPU= 21.205
  23:47:21 STEP 1666 H= 416:30 +CPU= 21.202
  23:47:42 STEP 1667 H= 416:45 +CPU= 21.195
  23:48:09 STEP 1668 H= 417:00 +CPU= 26.289
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+001668
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+001668
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+001668
  23:48:30 STEP 1669 H= 417:15 +CPU= 21.203
  23:48:51 STEP 1670 H= 417:30 +CPU= 21.190
  23:49:12 STEP 1671 H= 417:45 +CPU= 21.193
  23:49:34 STEP 1672 H= 418:00 +CPU= 21.708
  23:49:55 STEP 1673 H= 418:15 +CPU= 21.190
  23:50:16 STEP 1674 H= 418:30 +CPU= 21.188
  23:50:37 STEP 1675 H= 418:45 +CPU= 21.190
  23:50:59 STEP 1676 H= 419:00 +CPU= 21.722
  23:51:20 STEP 1677 H= 419:15 +CPU= 21.191
  23:51:42 STEP 1678 H= 419:30 +CPU= 21.196
  23:52:03 STEP 1679 H= 419:45 +CPU= 21.202
  23:52:31 STEP 1680 H= 420:00 +CPU= 28.537
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+001680
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+001680
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+001680
  23:52:53 STEP 1681 H= 420:15 +CPU= 21.204
  23:53:14 STEP 1682 H= 420:30 +CPU= 21.203
  23:53:35 STEP 1683 H= 420:45 +CPU= 21.187
  23:53:57 STEP 1684 H= 421:00 +CPU= 21.714
  23:54:18 STEP 1685 H= 421:15 +CPU= 21.186
  23:54:39 STEP 1686 H= 421:30 +CPU= 21.185
  23:55:00 STEP 1687 H= 421:45 +CPU= 21.188
  23:55:22 STEP 1688 H= 422:00 +CPU= 21.709
  23:55:43 STEP 1689 H= 422:15 +CPU= 21.179
  23:56:04 STEP 1690 H= 422:30 +CPU= 21.180
  23:56:26 STEP 1691 H= 422:45 +CPU= 21.196
  23:56:52 STEP 1692 H= 423:00 +CPU= 26.276
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+001692
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+001692
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+001692
  23:57:13 STEP 1693 H= 423:15 +CPU= 21.190
  23:57:34 STEP 1694 H= 423:30 +CPU= 21.186
  23:57:55 STEP 1695 H= 423:45 +CPU= 21.170
  23:58:17 STEP 1696 H= 424:00 +CPU= 21.702
  23:58:38 STEP 1697 H= 424:15 +CPU= 21.180
  23:59:00 STEP 1698 H= 424:30 +CPU= 21.188
  23:59:21 STEP 1699 H= 424:45 +CPU= 21.190
  23:59:42 STEP 1700 H= 425:00 +CPU= 21.699
  00:00:04 STEP 1701 H= 425:15 +CPU= 21.171
  00:00:25 STEP 1702 H= 425:30 +CPU= 21.190
  00:00:46 STEP 1703 H= 425:45 +CPU= 21.199
  00:01:12 STEP 1704 H= 426:00 +CPU= 26.329
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+001704
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+001704
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+001704
  00:01:34 STEP 1705 H= 426:15 +CPU= 21.196
  00:01:55 STEP 1706 H= 426:30 +CPU= 21.204
  00:02:16 STEP 1707 H= 426:45 +CPU= 21.190
  00:02:38 STEP 1708 H= 427:00 +CPU= 21.709
  00:02:59 STEP 1709 H= 427:15 +CPU= 21.190
  00:03:20 STEP 1710 H= 427:30 +CPU= 21.195
  00:03:41 STEP 1711 H= 427:45 +CPU= 21.196
  00:04:03 STEP 1712 H= 428:00 +CPU= 21.716
  00:04:24 STEP 1713 H= 428:15 +CPU= 21.205
  00:04:45 STEP 1714 H= 428:30 +CPU= 21.202
  00:05:07 STEP 1715 H= 428:45 +CPU= 21.194
  00:05:33 STEP 1716 H= 429:00 +CPU= 26.296
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+001716
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+001716
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+001716
  00:05:54 STEP 1717 H= 429:15 +CPU= 21.189
  00:06:15 STEP 1718 H= 429:30 +CPU= 21.195
  00:06:37 STEP 1719 H= 429:45 +CPU= 21.187
  00:06:58 STEP 1720 H= 430:00 +CPU= 21.721
  00:07:19 STEP 1721 H= 430:15 +CPU= 21.185
  00:07:41 STEP 1722 H= 430:30 +CPU= 21.208
  00:08:02 STEP 1723 H= 430:45 +CPU= 21.200
  00:08:24 STEP 1724 H= 431:00 +CPU= 21.705
  00:08:45 STEP 1725 H= 431:15 +CPU= 21.187
  00:09:06 STEP 1726 H= 431:30 +CPU= 21.185
  00:09:27 STEP 1727 H= 431:45 +CPU= 21.181
  00:09:56 STEP 1728 H= 432:00 +CPU= 28.539
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+001728
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+001728
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+001728
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMGGh7zg+001632
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMSHh7zg+001632
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMUAh7zg+001632
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMGGh7zg+001644
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMSHh7zg+001644
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMUAh7zg+001644
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMGGh7zg+001656
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMSHh7zg+001656
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMUAh7zg+001656
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMGGh7zg+001668
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMSHh7zg+001668
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMUAh7zg+001668
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMGGh7zg+001680
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMSHh7zg+001680
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMUAh7zg+001680
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMGGh7zg+001692
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMSHh7zg+001692
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMUAh7zg+001692
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMGGh7zg+001704
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMSHh7zg+001704
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMUAh7zg+001704
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMGGh7zg+001716
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMSHh7zg+001716
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMUAh7zg+001716
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a49i_2016092300_20_1018_12293853_1_r1364958700_17.zip
Uploading the intermediate file: upload_file_17.zip
  00:10:17 STEP 1729 H= 432:15 +CPU= 21.407
  00:10:38 STEP 1730 H= 432:30 +CPU= 21.282
  00:11:00 STEP 1731 H= 432:45 +CPU= 21.558
  00:11:22 STEP 1732 H= 433:00 +CPU= 22.079
  00:11:44 STEP 1733 H= 433:15 +CPU= 21.550
  00:12:05 STEP 1734 H= 433:30 +CPU= 21.253
  00:12:26 STEP 1735 H= 433:45 +CPU= 21.180
  00:12:48 STEP 1736 H= 434:00 +CPU= 21.714
  00:13:09 STEP 1737 H= 434:15 +CPU= 21.181
  00:13:30 STEP 1738 H= 434:30 +CPU= 21.198
  00:13:51 STEP 1739 H= 434:45 +CPU= 21.180
  00:14:18 STEP 1740 H= 435:00 +CPU= 26.285
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+001740
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+001740
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+001740
  00:14:39 STEP 1741 H= 435:15 +CPU= 21.192
  00:15:00 STEP 1742 H= 435:30 +CPU= 21.164
  00:15:21 STEP 1743 H= 435:45 +CPU= 21.175
  00:15:43 STEP 1744 H= 436:00 +CPU= 21.696
  00:16:04 STEP 1745 H= 436:15 +CPU= 21.158
  00:16:25 STEP 1746 H= 436:30 +CPU= 21.174
  00:16:46 STEP 1747 H= 436:45 +CPU= 21.174
  00:17:08 STEP 1748 H= 437:00 +CPU= 21.699
  00:17:29 STEP 1749 H= 437:15 +CPU= 21.162
  00:17:51 STEP 1750 H= 437:30 +CPU= 21.176
  00:18:12 STEP 1751 H= 437:45 +CPU= 21.180
  00:18:38 STEP 1752 H= 438:00 +CPU= 26.316
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+001752
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+001752
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+001752
  00:18:59 STEP 1753 H= 438:15 +CPU= 21.184
  00:19:20 STEP 1754 H= 438:30 +CPU= 21.175
  00:19:42 STEP 1755 H= 438:45 +CPU= 21.173
  00:20:03 STEP 1756 H= 439:00 +CPU= 21.700
  00:20:24 STEP 1757 H= 439:15 +CPU= 21.178
  00:20:46 STEP 1758 H= 439:30 +CPU= 21.171
  00:21:07 STEP 1759 H= 439:45 +CPU= 21.182
  00:21:29 STEP 1760 H= 440:00 +CPU= 21.700
  00:21:50 STEP 1761 H= 440:15 +CPU= 21.181
  00:22:11 STEP 1762 H= 440:30 +CPU= 21.180
  00:22:32 STEP 1763 H= 440:45 +CPU= 21.183
  00:22:58 STEP 1764 H= 441:00 +CPU= 26.288
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+001764
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+001764
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+001764
  00:23:20 STEP 1765 H= 441:15 +CPU= 21.177
  00:23:41 STEP 1766 H= 441:30 +CPU= 21.169
  00:24:02 STEP 1767 H= 441:45 +CPU= 21.183
  00:24:24 STEP 1768 H= 442:00 +CPU= 21.689
  00:24:45 STEP 1769 H= 442:15 +CPU= 21.165
  00:25:06 STEP 1770 H= 442:30 +CPU= 21.162
  00:25:27 STEP 1771 H= 442:45 +CPU= 21.151
  00:25:49 STEP 1772 H= 443:00 +CPU= 21.684
  00:26:10 STEP 1773 H= 443:15 +CPU= 21.172
  00:26:31 STEP 1774 H= 443:30 +CPU= 21.164
  00:26:52 STEP 1775 H= 443:45 +CPU= 21.179
  00:27:21 STEP 1776 H= 444:00 +CPU= 28.509
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+001776
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+001776
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+001776
  00:27:42 STEP 1777 H= 444:15 +CPU= 21.212
  00:28:03 STEP 1778 H= 444:30 +CPU= 21.167
  00:28:25 STEP 1779 H= 444:45 +CPU= 21.168
  00:28:46 STEP 1780 H= 445:00 +CPU= 21.703
  00:29:07 STEP 1781 H= 445:15 +CPU= 21.176
  00:29:29 STEP 1782 H= 445:30 +CPU= 21.172
  00:29:50 STEP 1783 H= 445:45 +CPU= 21.170
  00:30:11 STEP 1784 H= 446:00 +CPU= 21.711
  00:30:33 STEP 1785 H= 446:15 +CPU= 21.171
  00:30:54 STEP 1786 H= 446:30 +CPU= 21.177
  00:31:15 STEP 1787 H= 446:45 +CPU= 21.178
  00:31:41 STEP 1788 H= 447:00 +CPU= 26.292
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+001788
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+001788
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+001788
  00:32:02 STEP 1789 H= 447:15 +CPU= 21.162
  00:32:24 STEP 1790 H= 447:30 +CPU= 21.177
  00:32:45 STEP 1791 H= 447:45 +CPU= 21.176
  00:33:07 STEP 1792 H= 448:00 +CPU= 21.685
  00:33:28 STEP 1793 H= 448:15 +CPU= 21.183
  00:33:49 STEP 1794 H= 448:30 +CPU= 21.164
  00:34:10 STEP 1795 H= 448:45 +CPU= 21.172
  00:34:32 STEP 1796 H= 449:00 +CPU= 21.701
  00:34:53 STEP 1797 H= 449:15 +CPU= 21.169
  00:35:14 STEP 1798 H= 449:30 +CPU= 21.176
  00:35:35 STEP 1799 H= 449:45 +CPU= 21.187
  00:36:02 STEP 1800 H= 450:00 +CPU= 26.312
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+001800
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+001800
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+001800
  00:36:23 STEP 1801 H= 450:15 +CPU= 21.185
  00:36:44 STEP 1802 H= 450:30 +CPU= 21.181
  00:37:05 STEP 1803 H= 450:45 +CPU= 21.169
  00:37:27 STEP 1804 H= 451:00 +CPU= 21.701
  00:37:48 STEP 1805 H= 451:15 +CPU= 21.178
  00:38:09 STEP 1806 H= 451:30 +CPU= 21.184
  00:38:31 STEP 1807 H= 451:45 +CPU= 21.171
  00:38:52 STEP 1808 H= 452:00 +CPU= 21.693
  00:39:13 STEP 1809 H= 452:15 +CPU= 21.168
  00:39:35 STEP 1810 H= 452:30 +CPU= 21.169
  00:39:56 STEP 1811 H= 452:45 +CPU= 21.182
  00:40:22 STEP 1812 H= 453:00 +CPU= 26.278
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+001812
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+001812
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+001812
  00:40:43 STEP 1813 H= 453:15 +CPU= 21.168
  00:41:04 STEP 1814 H= 453:30 +CPU= 21.180
  00:41:26 STEP 1815 H= 453:45 +CPU= 21.174
  00:41:47 STEP 1816 H= 454:00 +CPU= 21.704
  00:42:08 STEP 1817 H= 454:15 +CPU= 21.168
  00:42:30 STEP 1818 H= 454:30 +CPU= 21.184
  00:42:51 STEP 1819 H= 454:45 +CPU= 21.161
  00:43:13 STEP 1820 H= 455:00 +CPU= 21.687
  00:43:34 STEP 1821 H= 455:15 +CPU= 21.176
  00:43:55 STEP 1822 H= 455:30 +CPU= 21.177
  00:44:16 STEP 1823 H= 455:45 +CPU= 21.173
  00:44:45 STEP 1824 H= 456:00 +CPU= 28.561
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+001824
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+001824
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+001824
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMGGh7zg+001728
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMSHh7zg+001728
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMUAh7zg+001728
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMGGh7zg+001740
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMSHh7zg+001740
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMUAh7zg+001740
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMGGh7zg+001752
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMSHh7zg+001752
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMUAh7zg+001752
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMGGh7zg+001764
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMSHh7zg+001764
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMUAh7zg+001764
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMGGh7zg+001776
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMSHh7zg+001776
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMUAh7zg+001776
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMGGh7zg+001788
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMSHh7zg+001788
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMUAh7zg+001788
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMGGh7zg+001800
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMSHh7zg+001800
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMUAh7zg+001800
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMGGh7zg+001812
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMSHh7zg+001812
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMUAh7zg+001812
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a49i_2016092300_20_1018_12293853_1_r1364958700_18.zip
Uploading the intermediate file: upload_file_18.zip
  00:45:06 STEP 1825 H= 456:15 +CPU= 21.442
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.13_x86_64-pc-linux-gnu
(argv1) start_date: 2016092300
(argv2) exptid: h7zg
(argv3) unique_member_id: a49i
(argv4) batchid: 1018
(argv5) wuid: 12293853
(argv6) fclen: 20
(argv7) app_name: oifs_43r3_bl
(argv8) nthreads: 1
Working directory is: /var/lib/boinc/slots/0
Project directory is: /var/lib/boinc/projects/climateprediction.net/
app name: oifs_43r3_bl
version: 1.13
Location of temp folder: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853
..mkdir for temp folder for results failed
Copying: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip to: /var/lib/boinc/slots/0/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc/slots/0/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_c50b8c89f3f7a4570f88c66cba7550aa to: /var/lib/boinc/slots/0/oifs_43r3_bl_a49i_2016092300_20_1018_12293853.zip
Unzipping the namelist zip file: /var/lib/boinc/slots/0/oifs_43r3_bl_a49i_2016092300_20_1018_12293853.zip
ic_ancil_file: ic_ancil_12293853
ifsdata_file: ifsdata_12293853
climate_data_file: clim_data_12293853
horiz_resolution: 159
vert_resolution: 91
grid_type: l_2
upload_interval: 96
utstep: 900
nfrres: restart dump frequency (steps) 48
Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /var/lib/boinc/slots/0/ic_ancil_12293853.zip
Unzipping the IC ancils zip file: /var/lib/boinc/slots/0/ic_ancil_12293853.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_561cf633389cc1b4089ee9a4bb4fba06 to: /var/lib/boinc/slots/0/ifsdata/ifsdata_12293853.zip
Unzipping the ifsdata_zip file: /var/lib/boinc/slots/0/ifsdata/ifsdata_12293853.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc/slots/0/159l_2/clim_data_12293853.zip
Unzipping the climate data zip file: /var/lib/boinc/slots/0/159l_2/clim_data_12293853.zip
Checking for progress XML file: /var/lib/boinc/slots/0/progress_file_12293853.xml
Opened progress file ok : /var/lib/boinc/slots/0/progress_file_12293853.xml
-- Model is restarting --
Adjusting last_iter, 1825, to previous model restart step.
Creating progress file: /var/lib/boinc/slots/0/progress_file_12293853.xml
last_cpu_time: 42668
upload_file_number: 19
last_iter: 1825
last_upload: 1641600
model_completed: 0
total_length_of_simulation: 1728000
result_base_name: oifs_43r3_bl_a49i_2016092300_20_1018_12293853_1_r1364958700
The child process has been launched with process id: 27107
Executing the command: /var/lib/boinc/slots/0/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:mondain:1:1:27107:27107] [20240617:124636:1718649996:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2091] fp = 0x314f440
[EC_DRHOOK:mondain:1:1:27107:27107] [20240617:124636:1718649996:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:mondain:1:1:27107:27107] [20240617:124636:1718649996:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:mondain:1:1:27107:27107] [20240617:124636:1718649996:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:mondain:1:1:27107:27107] [20240617:124636:1718649996:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:mondain:1:1:27107:27107] [20240617:124636:1718649996:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:mondain:1:1:27107:27107] [20240617:124636:1718649996:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:mondain:1:1:27107:27107] [20240617:124636:1718649996:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:mondain:1:1:27107:27107] [20240617:124636:1718649996:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:mondain:1:1:27107:27107] [20240617:124636:1718649996:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:mondain:1:1:27107:27107] [20240617:124636:1718649996:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:mondain:1:1:27107:27107] [20240617:124636:1718649996:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:mondain:1:1:27107:27107] [20240617:124636:1718649996:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:mondain:1:1:27107:27107] [20240617:124636:1718649996:0.000] [ignore_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:mondain:1:1:27107:27107] [20240617:124636:1718649996:0.000] [restore_default_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:mondain:1:1:27107:27107] [20240617:124636:1718649996:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:mondain:1:1:27107:27107] [20240617:124636:1718649996:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:mondain:1:1:27107:27107] [20240617:124636:1718649996:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:mondain:1:1:27107:27107] [20240617:124636:1718649996:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x820cf0 (old at (nil))
[EC_DRHOOK:mondain:1:1:27107:27107] [20240617:124636:1718649996:0.000] [trapfpe_treatment@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:mondain:1:1:27107:27107] [20240617:124636:1718649996:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:mondain:1:1:27107:27107] [20240617:124636:1718649996:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:mondain:1:1:27107:27107] [20240617:124636:1718649996:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x820cf0 (old at (nil))
[EC_DRHOOK:mondain:1:1:27107:27107] [20240617:124636:1718649996:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:mondain:1:1:27107:27107] [20240617:124636:1718649996:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:mondain:1:1:27107:27107] [20240617:124636:1718649996:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:mondain:1:1:27107:27107] [20240617:124636:1718649996:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x820cf0 (old at (nil))
[EC_DRHOOK:mondain:1:1:27107:27107] [20240617:124636:1718649996:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x820cf0 (old at (nil))
[EC_DRHOOK:mondain:1:1:27107:27107] [20240617:124636:1718649996:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:mondain:1:1:27107:27107] [20240617:124636:1718649996:0.000] [catch_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  12:47:48 STEP 1824 H= 456:00 +CPU= 24.704
  12:48:12 STEP 1825 H= 456:15 +CPU= 23.548
  12:48:35 STEP 1826 H= 456:30 +CPU= 22.953
  12:48:58 STEP 1827 H= 456:45 +CPU= 22.669
  12:49:21 STEP 1828 H= 457:00 +CPU= 23.137
  12:49:44 STEP 1829 H= 457:15 +CPU= 22.615
  12:50:06 STEP 1830 H= 457:30 +CPU= 22.598
  12:50:29 STEP 1831 H= 457:45 +CPU= 22.604
  12:50:52 STEP 1832 H= 458:00 +CPU= 23.116
  12:51:15 STEP 1833 H= 458:15 +CPU= 22.600
  12:51:38 STEP 1834 H= 458:30 +CPU= 22.600
  12:52:00 STEP 1835 H= 458:45 +CPU= 22.580
  12:52:29 STEP 1836 H= 459:00 +CPU= 28.049
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+001836
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+001836
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+001836
  12:52:52 STEP 1837 H= 459:15 +CPU= 22.651
  12:53:14 STEP 1838 H= 459:30 +CPU= 22.636
  12:53:37 STEP 1839 H= 459:45 +CPU= 22.644
  12:54:00 STEP 1840 H= 460:00 +CPU= 23.161
  12:54:23 STEP 1841 H= 460:15 +CPU= 22.632
  12:54:46 STEP 1842 H= 460:30 +CPU= 22.641
  12:55:08 STEP 1843 H= 460:45 +CPU= 22.622
  12:55:32 STEP 1844 H= 461:00 +CPU= 23.157
  12:55:54 STEP 1845 H= 461:15 +CPU= 22.628
  12:56:17 STEP 1846 H= 461:30 +CPU= 22.643
  12:56:40 STEP 1847 H= 461:45 +CPU= 22.626
  12:57:08 STEP 1848 H= 462:00 +CPU= 28.040
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+001848
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+001848
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+001848
  12:57:31 STEP 1849 H= 462:15 +CPU= 22.632
  12:57:53 STEP 1850 H= 462:30 +CPU= 22.629
  12:58:16 STEP 1851 H= 462:45 +CPU= 22.606
  12:58:39 STEP 1852 H= 463:00 +CPU= 23.164
  12:59:02 STEP 1853 H= 463:15 +CPU= 22.649
  12:59:25 STEP 1854 H= 463:30 +CPU= 22.655
  12:59:48 STEP 1855 H= 463:45 +CPU= 22.636
  13:00:11 STEP 1856 H= 464:00 +CPU= 23.128
  13:00:33 STEP 1857 H= 464:15 +CPU= 22.578
  13:00:56 STEP 1858 H= 464:30 +CPU= 22.580
  13:01:19 STEP 1859 H= 464:45 +CPU= 22.583
  13:01:47 STEP 1860 H= 465:00 +CPU= 27.974
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+001860
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+001860
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+001860
  13:02:10 STEP 1861 H= 465:15 +CPU= 22.573
  13:02:32 STEP 1862 H= 465:30 +CPU= 22.574
  13:02:55 STEP 1863 H= 465:45 +CPU= 22.576
  13:03:18 STEP 1864 H= 466:00 +CPU= 23.123
  13:03:41 STEP 1865 H= 466:15 +CPU= 22.580
  13:04:03 STEP 1866 H= 466:30 +CPU= 22.598
  13:04:26 STEP 1867 H= 466:45 +CPU= 22.580
  13:04:49 STEP 1868 H= 467:00 +CPU= 23.120
  13:05:12 STEP 1869 H= 467:15 +CPU= 22.592
  13:05:35 STEP 1870 H= 467:30 +CPU= 22.605
  13:05:57 STEP 1871 H= 467:45 +CPU= 22.576
  13:06:28 STEP 1872 H= 468:00 +CPU= 30.164
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+001872
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+001872
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+001872
  13:06:50 STEP 1873 H= 468:15 +CPU= 22.635
  13:07:13 STEP 1874 H= 468:30 +CPU= 22.604
  13:07:36 STEP 1875 H= 468:45 +CPU= 22.585
  13:07:59 STEP 1876 H= 469:00 +CPU= 23.127
  13:08:22 STEP 1877 H= 469:15 +CPU= 22.611
  13:08:44 STEP 1878 H= 469:30 +CPU= 22.614
  13:09:07 STEP 1879 H= 469:45 +CPU= 22.622
  13:09:30 STEP 1880 H= 470:00 +CPU= 23.133
  13:09:53 STEP 1881 H= 470:15 +CPU= 22.615
  13:10:16 STEP 1882 H= 470:30 +CPU= 22.599
  13:10:38 STEP 1883 H= 470:45 +CPU= 22.614
  13:11:07 STEP 1884 H= 471:00 +CPU= 28.030
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+001884
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+001884
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+001884
  13:11:29 STEP 1885 H= 471:15 +CPU= 22.653
  13:11:52 STEP 1886 H= 471:30 +CPU= 22.685
  13:12:15 STEP 1887 H= 471:45 +CPU= 22.676
  13:12:38 STEP 1888 H= 472:00 +CPU= 23.199
  13:13:01 STEP 1889 H= 472:15 +CPU= 22.689
  13:13:24 STEP 1890 H= 472:30 +CPU= 22.702
  13:13:47 STEP 1891 H= 472:45 +CPU= 22.694
  13:14:10 STEP 1892 H= 473:00 +CPU= 23.250
  13:14:33 STEP 1893 H= 473:15 +CPU= 22.700
  13:14:56 STEP 1894 H= 473:30 +CPU= 22.700
  13:15:18 STEP 1895 H= 473:45 +CPU= 22.670
  13:15:46 STEP 1896 H= 474:00 +CPU= 28.072
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+001896
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+001896
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+001896
  13:16:09 STEP 1897 H= 474:15 +CPU= 22.656
  13:16:32 STEP 1898 H= 474:30 +CPU= 22.649
  13:16:55 STEP 1899 H= 474:45 +CPU= 22.672
  13:17:18 STEP 1900 H= 475:00 +CPU= 23.210
  13:17:41 STEP 1901 H= 475:15 +CPU= 22.677
  13:18:04 STEP 1902 H= 475:30 +CPU= 22.672
  13:18:26 STEP 1903 H= 475:45 +CPU= 22.693
  13:18:50 STEP 1904 H= 476:00 +CPU= 23.213
  13:19:12 STEP 1905 H= 476:15 +CPU= 22.678
  13:19:35 STEP 1906 H= 476:30 +CPU= 22.641
  13:19:58 STEP 1907 H= 476:45 +CPU= 22.632
  13:20:26 STEP 1908 H= 477:00 +CPU= 28.001
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+001908
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+001908
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+001908
  13:20:49 STEP 1909 H= 477:15 +CPU= 22.629
  13:21:12 STEP 1910 H= 477:30 +CPU= 22.652
  13:21:34 STEP 1911 H= 477:45 +CPU= 22.614
  13:21:57 STEP 1912 H= 478:00 +CPU= 23.159
  13:22:20 STEP 1913 H= 478:15 +CPU= 22.636
  13:22:43 STEP 1914 H= 478:30 +CPU= 22.610
  13:23:06 STEP 1915 H= 478:45 +CPU= 22.615
  13:23:29 STEP 1916 H= 479:00 +CPU= 23.183
  13:23:52 STEP 1917 H= 479:15 +CPU= 22.633
  13:24:14 STEP 1918 H= 479:30 +CPU= 22.628
  13:24:37 STEP 1919 H= 479:45 +CPU= 22.622
  13:25:06 STEP 1920 H= 480:00 +CPU= 28.549
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

 
DDH------------------------------------------------------------------------
I                                                                         I
I TIME =  480.000H DDH * Diagnostic Var.,     AREA                GLOBAL  I
I                                                                         I
I-------------------------------------------------------------------------I
I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I      0.4998011719E-21      I       0.2513880539E-06      I
ICloud fractionI      0.0000000000E+00      I       0.1351264319E-01      I
I  Relat. Hum. I      0.3539754518E+00      I       0.3937009549E+00      I
I  PASS 01     I      0.0000000000E+00      I       0.1024476208E+03      I
DDH------------------------------------------------------------------------
  
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1920 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001920 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001920
 MPI-TASK:   1 -    311807236 BYTES IN      7 RECORDS TRANSFERRED IN    0.0003 SECONDS******** Mbytes/s, TOTAL TIME=    0.0075( 4.0%)
 13:25:06 STEP 1920 H= 480:00 +CPU= 28.549
 END CNT3
 NSTEP =  1920 CNT0   000000000  21.699  21.699  21.848   0.993               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ           46/  1069125708 WRITTEN         2860/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1     53    0       46      1044068     2860 ************    48.3    45.3     3.0    46.0     6.8
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 2309403.4 2309403.4    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 2262340.4 2262340.4     97.96      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                  105    3031.9    3031.9     13.78      0.00
   9 SPCM     - SPECTRAL COMP.                      96     688.2     688.2      2.86      0.00
  10 SCAN2M - PHYSICS                               97   12573.5   12573.5     52.81      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                  8     539.7     539.7      0.19      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                  5      28.7      28.7      0.01      0.00
  17 GRIDFPOS IN CNT4                                8      19.9      19.9      0.01      0.00
  27 RESTART FILES - WRITING                         2    2145.6    2145.6      0.19      0.00
  28 RESTART FILES - READING                         1   46556.2   46556.2      2.02      0.00
  29 SU4FPOS IN CNT4                                 8       2.6       2.6      0.00      0.00
  30 DYNFPOS IN CNT4                                 8    4648.5    4648.5      1.61      0.00
  31 POSDDH IN STEPO                                 1      49.0      49.0      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                     97    4377.3    4377.3     18.39      0.00
  39 SU0YOMB                                         1     311.9     311.9      0.01      0.00
  51 SCAN2M   - SL COMM. PART 1                     97      13.3      13.3      0.06      0.00
  54 SPCM     - M TO S/S TO M TRANSP.               96     311.5     311.5      1.29      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.               96      30.5      30.5      0.13      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                  5       0.2       0.2      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM      212     298.2     298.2      2.74      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM       200     186.9     186.9      1.62      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM        200      62.4      62.4      0.54      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM       212     113.6     113.6      1.04      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1      34.8      34.8      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION            212      20.0      20.0      0.18      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION            200      13.7      13.7      0.12      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION            212      58.9      58.9      0.54      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION            200      18.6      18.6      0.16      0.00
 400 GSTATS                                      12215       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                 11311       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME     2309.4 CPU TIME    2255.9 VECTOR TIME     2255.9


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY      763.8
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+001920
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+001920
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+001920
Adding to the zip: /var/lib/boinc/slots/0/NODE.001_01
Adding to the zip: /var/lib/boinc/slots/0/ifs.stat
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMGGh7zg+001824
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMGGh7zg+001908
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMGGh7zg+001920
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMUAh7zg+001836
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMSHh7zg+001920
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMUAh7zg+001908
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMGGh7zg+001836
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMGGh7zg+001896
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMSHh7zg+001824
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMUAh7zg+001848
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMGGh7zg+001848
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMUAh7zg+001896
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMSHh7zg+001848
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMSHh7zg+001908
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMSHh7zg+001884
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMGGh7zg+001860
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMSHh7zg+001872
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMUAh7zg+001824
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMSHh7zg+001896
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMGGh7zg+001872
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMGGh7zg+001884
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMUAh7zg+001920
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMSHh7zg+001860
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMUAh7zg+001872
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMSHh7zg+001836
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMUAh7zg+001860
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12293853/ICMUAh7zg+001884
Zipping up the final file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a49i_2016092300_20_1018_12293853_1_r1364958700_19.zip
Uploading the final file: upload_file_19.zip
Uploading trickle at timestep: 1727100
13:28:35 (27104): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
17 Jun 2024 19:27:23 1463165 22448522 oifs_43r3_bl_a49i_2016092300_20_1018_12293853_1 1,727,100 44,924 0.0260
15 Jun 2024 00:15:25 1463165 22448522 oifs_43r3_bl_a49i_2016092300_20_1018_12293853_1 864,000 21,804 0.0252


©2024 cpdn.org