climateprediction.net home page
Task 22272983

Task 22272983

Name oifs_43r3_ps_0907_2001050100_123_970_12187551_0
Workunit 12187551
Created 23 Dec 2022, 1:20:08 UTC
Sent 7 Jan 2023, 15:54:52 UTC
Report deadline 6 Feb 2023, 15:54:52 UTC
Received 9 Jan 2023, 3:57:52 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 196 (0x000000C4) EXIT_DISK_LIMIT_EXCEEDED
Computer ID 1533427
Run time 10 hours 15 min 4 sec
CPU time 9 hours 16 min 12 sec
Validate state Invalid
Credit 7,620.48
Device peak FLOPS 1.00 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,418.70 MB
Peak swap size 4,978.08 MB
Peak disk usage 7,169.17 MB
Stderr
<core_client_version>7.18.1</core_client_version>
<![CDATA[
<message>
Disk usage limit exceeded</message>
<stderr_txt>
=1411:00 +CPU= 13.378
  00:00:56 STEP 1412 H=1412:00 +CPU= 13.738
  00:01:17 STEP 1413 H=1413:00 +CPU= 20.966
  00:01:31 STEP 1414 H=1414:00 +CPU= 13.672
  00:01:45 STEP 1415 H=1415:00 +CPU= 13.747
  00:02:10 STEP 1416 H=1416:00 +CPU= 24.778
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+001416
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+001416
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMGGhq0f+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMSHhq0f+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMUAhq0f+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMGGhq0f+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMSHhq0f+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMUAhq0f+001404
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0907_2001050100_123_970_12187551_0_r916483789_58.zip
Uploading the intermediate file: upload_file_58.zip
  00:02:23 STEP 1417 H=1417:00 +CPU= 12.986
  00:02:37 STEP 1418 H=1418:00 +CPU= 13.535
  00:02:58 STEP 1419 H=1419:00 +CPU= 21.000
  00:03:12 STEP 1420 H=1420:00 +CPU= 13.811
  00:03:26 STEP 1421 H=1421:00 +CPU= 13.421
  00:03:48 STEP 1422 H=1422:00 +CPU= 21.737
  00:04:02 STEP 1423 H=1423:00 +CPU= 13.525
  00:04:16 STEP 1424 H=1424:00 +CPU= 13.899
  00:04:38 STEP 1425 H=1425:00 +CPU= 21.204
  00:04:52 STEP 1426 H=1426:00 +CPU= 13.947
  00:05:06 STEP 1427 H=1427:00 +CPU= 13.544
  00:05:30 STEP 1428 H=1428:00 +CPU= 23.877
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+001428
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+001428
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+001428
  00:05:44 STEP 1429 H=1429:00 +CPU= 13.541
  00:05:58 STEP 1430 H=1430:00 +CPU= 13.903
  00:06:20 STEP 1431 H=1431:00 +CPU= 21.240
  00:06:34 STEP 1432 H=1432:00 +CPU= 13.901
  00:06:48 STEP 1433 H=1433:00 +CPU= 13.438
  00:07:10 STEP 1434 H=1434:00 +CPU= 21.699
  00:07:24 STEP 1435 H=1435:00 +CPU= 13.339
  00:07:38 STEP 1436 H=1436:00 +CPU= 13.911
  00:07:59 STEP 1437 H=1437:00 +CPU= 21.279
  00:08:14 STEP 1438 H=1438:00 +CPU= 13.907
  00:08:28 STEP 1439 H=1439:00 +CPU= 13.859
  00:08:54 STEP 1440 H=1440:00 +CPU= 25.642
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+001440
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+001440
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMGGhq0f+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMSHhq0f+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMUAhq0f+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMGGhq0f+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMSHhq0f+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMUAhq0f+001428
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0907_2001050100_123_970_12187551_0_r916483789_59.zip
Uploading the intermediate file: upload_file_59.zip
  00:09:08 STEP 1441 H=1441:00 +CPU= 13.507
  00:09:22 STEP 1442 H=1442:00 +CPU= 13.942
  00:09:44 STEP 1443 H=1443:00 +CPU= 21.203
  00:09:58 STEP 1444 H=1444:00 +CPU= 13.834
  00:10:12 STEP 1445 H=1445:00 +CPU= 13.411
  00:10:34 STEP 1446 H=1446:00 +CPU= 21.659
  00:10:48 STEP 1447 H=1447:00 +CPU= 13.415
  00:11:02 STEP 1448 H=1448:00 +CPU= 13.947
  00:11:24 STEP 1449 H=1449:00 +CPU= 21.236
  00:11:38 STEP 1450 H=1450:00 +CPU= 13.959
  00:11:52 STEP 1451 H=1451:00 +CPU= 13.470
  00:12:16 STEP 1452 H=1452:00 +CPU= 23.905
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+001452
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+001452
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+001452
  00:12:30 STEP 1453 H=1453:00 +CPU= 13.438
  00:12:44 STEP 1454 H=1454:00 +CPU= 13.902
  00:13:06 STEP 1455 H=1455:00 +CPU= 21.239
  00:13:20 STEP 1456 H=1456:00 +CPU= 13.986
  00:13:34 STEP 1457 H=1457:00 +CPU= 13.501
  00:13:56 STEP 1458 H=1458:00 +CPU= 21.706
  00:14:10 STEP 1459 H=1459:00 +CPU= 13.411
  00:14:24 STEP 1460 H=1460:00 +CPU= 13.935
  00:14:46 STEP 1461 H=1461:00 +CPU= 21.287
  00:15:00 STEP 1462 H=1462:00 +CPU= 13.821
  00:15:14 STEP 1463 H=1463:00 +CPU= 13.856
  00:15:41 STEP 1464 H=1464:00 +CPU= 25.635
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+001464
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+001464
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+001464
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMGGhq0f+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMSHhq0f+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMUAhq0f+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMGGhq0f+001452
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMSHhq0f+001452
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMUAhq0f+001452
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0907_2001050100_123_970_12187551_0_r916483789_60.zip
Uploading the intermediate file: upload_file_60.zip
  00:15:55 STEP 1465 H=1465:00 +CPU= 13.492
  00:16:10 STEP 1466 H=1466:00 +CPU= 13.997
  00:16:31 STEP 1467 H=1467:00 +CPU= 21.277
  00:16:46 STEP 1468 H=1468:00 +CPU= 13.923
  00:16:59 STEP 1469 H=1469:00 +CPU= 13.359
  00:17:22 STEP 1470 H=1470:00 +CPU= 21.914
  00:17:36 STEP 1471 H=1471:00 +CPU= 13.604
  00:17:50 STEP 1472 H=1472:00 +CPU= 13.980
  00:18:12 STEP 1473 H=1473:00 +CPU= 21.327
  00:18:26 STEP 1474 H=1474:00 +CPU= 13.886
  00:18:40 STEP 1475 H=1475:00 +CPU= 13.485
  00:19:04 STEP 1476 H=1476:00 +CPU= 23.889
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+001476
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+001476
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+001476
  00:19:18 STEP 1477 H=1477:00 +CPU= 13.602
  00:19:32 STEP 1478 H=1478:00 +CPU= 13.924
  00:19:54 STEP 1479 H=1479:00 +CPU= 21.257
  00:20:08 STEP 1480 H=1480:00 +CPU= 13.910
  00:20:22 STEP 1481 H=1481:00 +CPU= 13.481
  00:20:44 STEP 1482 H=1482:00 +CPU= 21.800
  00:20:58 STEP 1483 H=1483:00 +CPU= 13.458
  00:21:12 STEP 1484 H=1484:00 +CPU= 13.880
  00:21:34 STEP 1485 H=1485:00 +CPU= 21.197
  00:21:48 STEP 1486 H=1486:00 +CPU= 13.942
  00:22:02 STEP 1487 H=1487:00 +CPU= 13.865
  00:22:29 STEP 1488 H=1488:00 +CPU= 25.715
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+001488
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+001488
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+001488
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMGGhq0f+001464
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMSHhq0f+001464
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMUAhq0f+001464
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMGGhq0f+001476
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMSHhq0f+001476
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMUAhq0f+001476
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0907_2001050100_123_970_12187551_0_r916483789_61.zip
Uploading the intermediate file: upload_file_61.zip
  00:22:43 STEP 1489 H=1489:00 +CPU= 13.534
  00:22:57 STEP 1490 H=1490:00 +CPU= 13.925
  00:23:19 STEP 1491 H=1491:00 +CPU= 21.370
  00:23:33 STEP 1492 H=1492:00 +CPU= 13.957
  00:23:47 STEP 1493 H=1493:00 +CPU= 13.530
  00:24:09 STEP 1494 H=1494:00 +CPU= 21.677
  00:24:23 STEP 1495 H=1495:00 +CPU= 13.490
  00:24:37 STEP 1496 H=1496:00 +CPU= 13.936
  00:24:59 STEP 1497 H=1497:00 +CPU= 21.279
  00:25:13 STEP 1498 H=1498:00 +CPU= 13.926
  00:25:27 STEP 1499 H=1499:00 +CPU= 13.504
  00:25:51 STEP 1500 H=1500:00 +CPU= 23.889
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+001500
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+001500
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+001500
  00:26:05 STEP 1501 H=1501:00 +CPU= 13.455
  00:26:20 STEP 1502 H=1502:00 +CPU= 13.938
  00:26:41 STEP 1503 H=1503:00 +CPU= 21.237
  00:26:56 STEP 1504 H=1504:00 +CPU= 13.944
  00:27:09 STEP 1505 H=1505:00 +CPU= 13.503
  00:27:31 STEP 1506 H=1506:00 +CPU= 21.648
  00:27:45 STEP 1507 H=1507:00 +CPU= 13.536
  00:27:59 STEP 1508 H=1508:00 +CPU= 13.925
  00:28:21 STEP 1509 H=1509:00 +CPU= 21.272
  00:28:36 STEP 1510 H=1510:00 +CPU= 14.014
  00:28:51 STEP 1511 H=1511:00 +CPU= 14.072
  00:29:17 STEP 1512 H=1512:00 +CPU= 25.768
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+001512
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+001512
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+001512
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMGGhq0f+001488
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMSHhq0f+001488
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMUAhq0f+001488
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMGGhq0f+001500
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMSHhq0f+001500
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMUAhq0f+001500
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0907_2001050100_123_970_12187551_0_r916483789_62.zip
Uploading the intermediate file: upload_file_62.zip
  00:29:32 STEP 1513 H=1513:00 +CPU= 13.490
  00:29:46 STEP 1514 H=1514:00 +CPU= 13.951
Uploading trickle at timestep: 5443200
  00:30:08 STEP 1515 H=1515:00 +CPU= 21.280
  00:30:22 STEP 1516 H=1516:00 +CPU= 14.001
  00:30:36 STEP 1517 H=1517:00 +CPU= 13.556
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:31:51 STEP 1518 H=1518:00 +CPU= 23.494
  00:32:07 STEP 1519 H=1519:00 +CPU= 16.158
  00:32:23 STEP 1520 H=1520:00 +CPU= 15.569
  00:32:47 STEP 1521 H=1521:00 +CPU= 24.151
  00:33:03 STEP 1522 H=1522:00 +CPU= 15.425
  00:33:19 STEP 1523 H=1523:00 +CPU= 15.704
  00:33:46 STEP 1524 H=1524:00 +CPU= 27.636
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+001524
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+001524
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+001524
  00:34:01 STEP 1525 H=1525:00 +CPU= 14.877
  00:34:18 STEP 1526 H=1526:00 +CPU= 16.349
  00:34:42 STEP 1527 H=1527:00 +CPU= 23.584
  00:34:58 STEP 1528 H=1528:00 +CPU= 16.640
  00:35:14 STEP 1529 H=1529:00 +CPU= 15.788
  00:35:39 STEP 1530 H=1530:00 +CPU= 24.803
  00:35:55 STEP 1531 H=1531:00 +CPU= 16.292
  00:36:11 STEP 1532 H=1532:00 +CPU= 15.615
  00:36:36 STEP 1533 H=1533:00 +CPU= 24.695
  00:36:51 STEP 1534 H=1534:00 +CPU= 15.265
  00:37:07 STEP 1535 H=1535:00 +CPU= 15.864
  00:37:36 STEP 1536 H=1536:00 +CPU= 29.032
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+001536
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+001536
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+001536
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMGGhq0f+001512
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMSHhq0f+001512
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMUAhq0f+001512
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMGGhq0f+001524
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMSHhq0f+001524
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMUAhq0f+001524
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0907_2001050100_123_970_12187551_0_r916483789_63.zip
Uploading the intermediate file: upload_file_63.zip
  00:37:52 STEP 1537 H=1537:00 +CPU= 15.250
  00:38:08 STEP 1538 H=1538:00 +CPU= 15.604
  00:38:32 STEP 1539 H=1539:00 +CPU= 24.064
  00:38:47 STEP 1540 H=1540:00 +CPU= 15.777
  00:39:03 STEP 1541 H=1541:00 +CPU= 15.348
  00:39:27 STEP 1542 H=1542:00 +CPU= 24.221
  00:39:43 STEP 1543 H=1543:00 +CPU= 15.674
  00:39:58 STEP 1544 H=1544:00 +CPU= 15.727
  00:40:23 STEP 1545 H=1545:00 +CPU= 24.267
  00:40:39 STEP 1546 H=1546:00 +CPU= 15.635
  00:40:55 STEP 1547 H=1547:00 +CPU= 15.878
  00:41:22 STEP 1548 H=1548:00 +CPU= 27.277
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+001548
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+001548
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+001548
  00:41:37 STEP 1549 H=1549:00 +CPU= 15.416
  00:41:54 STEP 1550 H=1550:00 +CPU= 16.331
  00:42:17 STEP 1551 H=1551:00 +CPU= 23.619
  00:42:34 STEP 1552 H=1552:00 +CPU= 16.172
  00:42:49 STEP 1553 H=1553:00 +CPU= 15.671
  00:43:14 STEP 1554 H=1554:00 +CPU= 24.230
  00:43:29 STEP 1555 H=1555:00 +CPU= 15.065
  00:43:44 STEP 1556 H=1556:00 +CPU= 15.560
  00:44:08 STEP 1557 H=1557:00 +CPU= 23.105
  00:44:24 STEP 1558 H=1558:00 +CPU= 15.861
  00:44:39 STEP 1559 H=1559:00 +CPU= 15.210
  00:45:06 STEP 1560 H=1560:00 +CPU= 27.408
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+001560
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+001560
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+001560
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMGGhq0f+001536
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMSHhq0f+001536
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMUAhq0f+001536
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMGGhq0f+001548
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMSHhq0f+001548
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMUAhq0f+001548
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0907_2001050100_123_970_12187551_0_r916483789_64.zip
Uploading the intermediate file: upload_file_64.zip
  00:45:22 STEP 1561 H=1561:00 +CPU= 15.548
  00:45:37 STEP 1562 H=1562:00 +CPU= 14.897
  00:46:01 STEP 1563 H=1563:00 +CPU= 23.803
  00:46:16 STEP 1564 H=1564:00 +CPU= 14.813
  00:46:31 STEP 1565 H=1565:00 +CPU= 15.216
  00:46:55 STEP 1566 H=1566:00 +CPU= 23.334
  00:47:10 STEP 1567 H=1567:00 +CPU= 15.033
  00:47:25 STEP 1568 H=1568:00 +CPU= 15.389
  00:47:49 STEP 1569 H=1569:00 +CPU= 23.966
  00:48:05 STEP 1570 H=1570:00 +CPU= 15.642
  00:48:20 STEP 1571 H=1571:00 +CPU= 15.339
  00:48:47 STEP 1572 H=1572:00 +CPU= 26.634
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+001572
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+001572
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+001572
  00:49:02 STEP 1573 H=1573:00 +CPU= 14.747
  00:49:17 STEP 1574 H=1574:00 +CPU= 15.465
  00:49:40 STEP 1575 H=1575:00 +CPU= 22.824
  00:49:56 STEP 1576 H=1576:00 +CPU= 15.787
  00:50:11 STEP 1577 H=1577:00 +CPU= 15.190
  00:50:36 STEP 1578 H=1578:00 +CPU= 24.381
  00:50:51 STEP 1579 H=1579:00 +CPU= 14.956
  00:51:07 STEP 1580 H=1580:00 +CPU= 15.604
  00:51:30 STEP 1581 H=1581:00 +CPU= 23.218
  00:51:46 STEP 1582 H=1582:00 +CPU= 15.801
  00:52:01 STEP 1583 H=1583:00 +CPU= 14.780
  00:52:30 STEP 1584 H=1584:00 +CPU= 28.691
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+001584
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+001584
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+001584
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMGGhq0f+001560
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMSHhq0f+001560
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMUAhq0f+001560
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMGGhq0f+001572
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMSHhq0f+001572
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMUAhq0f+001572
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0907_2001050100_123_970_12187551_0_r916483789_65.zip
Uploading the intermediate file: upload_file_65.zip
  00:52:45 STEP 1585 H=1585:00 +CPU= 15.428
  00:53:01 STEP 1586 H=1586:00 +CPU= 15.352
  00:53:24 STEP 1587 H=1587:00 +CPU= 23.717
  00:53:40 STEP 1588 H=1588:00 +CPU= 15.523
  00:53:56 STEP 1589 H=1589:00 +CPU= 15.361
  00:54:20 STEP 1590 H=1590:00 +CPU= 23.728
  00:54:35 STEP 1591 H=1591:00 +CPU= 15.288
  00:54:51 STEP 1592 H=1592:00 +CPU= 15.854
  00:55:14 STEP 1593 H=1593:00 +CPU= 23.305
  00:55:29 STEP 1594 H=1594:00 +CPU= 15.233
  00:55:45 STEP 1595 H=1595:00 +CPU= 15.254
  00:56:11 STEP 1596 H=1596:00 +CPU= 26.430
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+001596
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+001596
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+001596
  00:56:27 STEP 1597 H=1597:00 +CPU= 15.162
  00:56:42 STEP 1598 H=1598:00 +CPU= 15.465
  00:57:06 STEP 1599 H=1599:00 +CPU= 23.573
  00:57:21 STEP 1600 H=1600:00 +CPU= 15.657
  00:57:36 STEP 1601 H=1601:00 +CPU= 14.929
  00:58:01 STEP 1602 H=1602:00 +CPU= 24.334
  00:58:16 STEP 1603 H=1603:00 +CPU= 14.783
  00:58:31 STEP 1604 H=1604:00 +CPU= 14.888
  00:58:53 STEP 1605 H=1605:00 +CPU= 22.395
  00:59:08 STEP 1606 H=1606:00 +CPU= 14.996
  00:59:23 STEP 1607 H=1607:00 +CPU= 14.314
  00:59:49 STEP 1608 H=1608:00 +CPU= 26.613
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+001608
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+001608
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+001608
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMGGhq0f+001584
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMSHhq0f+001584
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMUAhq0f+001584
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMGGhq0f+001596
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMSHhq0f+001596
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMUAhq0f+001596
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0907_2001050100_123_970_12187551_0_r916483789_66.zip
Uploading the intermediate file: upload_file_66.zip
  01:00:03 STEP 1609 H=1609:00 +CPU= 13.716
  01:00:18 STEP 1610 H=1610:00 +CPU= 14.881
  01:00:40 STEP 1611 H=1611:00 +CPU= 22.075
  01:00:54 STEP 1612 H=1612:00 +CPU= 14.022
  01:01:08 STEP 1613 H=1613:00 +CPU= 14.036
  01:01:30 STEP 1614 H=1614:00 +CPU= 21.861
  01:01:44 STEP 1615 H=1615:00 +CPU= 13.445
  01:01:58 STEP 1616 H=1616:00 +CPU= 14.061
  01:02:19 STEP 1617 H=1617:00 +CPU= 21.110
  01:02:33 STEP 1618 H=1618:00 +CPU= 13.705
  01:02:47 STEP 1619 H=1619:00 +CPU= 13.632
  01:03:11 STEP 1620 H=1620:00 +CPU= 23.687
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+001620
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+001620
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+001620
  01:03:24 STEP 1621 H=1621:00 +CPU= 13.536
  01:03:38 STEP 1622 H=1622:00 +CPU= 14.033
  01:03:59 STEP 1623 H=1623:00 +CPU= 20.953
  01:04:13 STEP 1624 H=1624:00 +CPU= 14.013
  01:04:27 STEP 1625 H=1625:00 +CPU= 13.401
  01:04:49 STEP 1626 H=1626:00 +CPU= 21.895
  01:05:02 STEP 1627 H=1627:00 +CPU= 13.462
  01:05:16 STEP 1628 H=1628:00 +CPU= 13.701
  01:05:37 STEP 1629 H=1629:00 +CPU= 21.035
  01:05:51 STEP 1630 H=1630:00 +CPU= 13.810
  01:06:05 STEP 1631 H=1631:00 +CPU= 13.629
  01:06:30 STEP 1632 H=1632:00 +CPU= 25.145
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+001632
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+001632
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+001632
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMGGhq0f+001608
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMSHhq0f+001608
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMUAhq0f+001608
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMGGhq0f+001620
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMSHhq0f+001620
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMUAhq0f+001620
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0907_2001050100_123_970_12187551_0_r916483789_67.zip
Uploading the intermediate file: upload_file_67.zip
  01:06:43 STEP 1633 H=1633:00 +CPU= 13.125
  01:06:57 STEP 1634 H=1634:00 +CPU= 13.626
  01:07:18 STEP 1635 H=1635:00 +CPU= 21.020
  01:07:32 STEP 1636 H=1636:00 +CPU= 13.754
  01:07:46 STEP 1637 H=1637:00 +CPU= 13.333
  01:08:07 STEP 1638 H=1638:00 +CPU= 21.487
  01:08:21 STEP 1639 H=1639:00 +CPU= 13.337
  01:08:35 STEP 1640 H=1640:00 +CPU= 13.809
  01:08:56 STEP 1641 H=1641:00 +CPU= 21.052
  01:09:10 STEP 1642 H=1642:00 +CPU= 13.868
  01:09:23 STEP 1643 H=1643:00 +CPU= 13.334
  01:09:47 STEP 1644 H=1644:00 +CPU= 23.385
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+001644
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+001644
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+001644
  01:10:00 STEP 1645 H=1645:00 +CPU= 13.173
  01:10:14 STEP 1646 H=1646:00 +CPU= 13.692
  01:10:34 STEP 1647 H=1647:00 +CPU= 20.771
  01:10:48 STEP 1648 H=1648:00 +CPU= 13.802
  01:11:02 STEP 1649 H=1649:00 +CPU= 13.278
  01:11:23 STEP 1650 H=1650:00 +CPU= 21.265
  01:11:36 STEP 1651 H=1651:00 +CPU= 13.259
  01:11:50 STEP 1652 H=1652:00 +CPU= 13.622
  01:12:11 STEP 1653 H=1653:00 +CPU= 20.663
  01:12:24 STEP 1654 H=1654:00 +CPU= 13.597
  01:12:38 STEP 1655 H=1655:00 +CPU= 13.620
  01:13:04 STEP 1656 H=1656:00 +CPU= 25.342
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+001656
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+001656
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMGGhq0f+001632
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMSHhq0f+001632
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMUAhq0f+001632
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMGGhq0f+001644
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMSHhq0f+001644
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMUAhq0f+001644
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0907_2001050100_123_970_12187551_0_r916483789_68.zip
Uploading the intermediate file: upload_file_68.zip
  01:13:17 STEP 1657 H=1657:00 +CPU= 13.113
  01:13:30 STEP 1658 H=1658:00 +CPU= 13.522
  01:13:51 STEP 1659 H=1659:00 +CPU= 20.675
  01:14:05 STEP 1660 H=1660:00 +CPU= 13.523
  01:14:18 STEP 1661 H=1661:00 +CPU= 13.166
  01:14:40 STEP 1662 H=1662:00 +CPU= 21.412
  01:14:53 STEP 1663 H=1663:00 +CPU= 13.220
  01:15:07 STEP 1664 H=1664:00 +CPU= 13.777
[EC_DRHOOK:ito-desktop:1:1:190218:190218] [20230109:011515:1673194515:6942.675] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1538] Received signal#15 (SIGTERM) :: 4035MB (heap), 4419MB (maxrss), 0MB (maxstack), 0 (paging), nsigs = 1
[EC_DRHOOK:ito-desktop:1:1:190218:190218] [20230109:011515:1673194515:6942.676] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1542] Also activating Harakiri-alarm (SIGALRM=14) to expire after 500s elapsed to prevent hangs, nsigs = 1
[EC_DRHOOK:ito-desktop:1:1:190218:190218] [20230109:011515:1673194515:6942.676] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1544] Harakiri signal handler 'signal_harakiri' for signal#14 (SIGALRM) installed at 0x81f3c0 (old at (nil))
[EC_DRHOOK:ito-desktop:1:1:190218:190218] [20230109:011515:1673194515:6942.676] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1617] Signal#15 was caused by unrecognized si_code [memaddr=0x1], nsigs = 1
[EC_DRHOOK:ito-desktop:1:1:190218:190218] [20230109:011515:1673194515:6942.676] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1686] Starting DrHook backtrace for signal#15, nsigs = 1
[EC_DRHOOK:ito-desktop:1:1:190218:190218] [20230109:011515:1673194515:6942.676] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3843] 4035 MB (maxheap), 4419 MB (maxrss), 0 MB (maxstack)
[EC_DRHOOK:ito-desktop:1:1:190218:190218] [20230109:011515:1673194515:6942.677] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :  MASTER 
[EC_DRHOOK:ito-desktop:1:1:190218:190218] [20230109:011515:1673194515:6942.677] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :   CNT0 
[EC_DRHOOK:ito-desktop:1:1:190218:190218] [20230109:011515:1673194515:6942.677] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :    CNT1 
[EC_DRHOOK:ito-desktop:1:1:190218:190218] [20230109:011515:1673194515:6942.677] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :     CNT2 
[EC_DRHOOK:ito-desktop:1:1:190218:190218] [20230109:011515:1673194515:6942.677] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :      CNT3 
[EC_DRHOOK:ito-desktop:1:1:190218:190218] [20230109:011515:1673194515:6942.677] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :       CNT4 
[EC_DRHOOK:ito-desktop:1:1:190218:190218] [20230109:011515:1673194515:6942.677] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :        STEPO 
[EC_DRHOOK:ito-desktop:1:1:190218:190218] [20230109:011515:1673194515:6942.677] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :         SCAN2M 
[EC_DRHOOK:ito-desktop:1:1:190218:190218] [20230109:011515:1673194515:6942.677] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :          GP_MODEL_HEAP 
[EC_DRHOOK:ito-desktop:1:1:190218:190218] [20230109:011515:1673194515:6942.677] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :           GP_MODEL 
[EC_DRHOOK:ito-desktop:1:1:190218:190218] [20230109:011515:1673194515:6942.677] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :            RADDRV 
[EC_DRHOOK:ito-desktop:1:1:190218:190218] [20230109:011515:1673194515:6942.677] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :             RADINTG 
[EC_DRHOOK:ito-desktop:1:1:190218:190218] [20230109:011515:1673194515:6942.677] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :              >OMP-RADINTG-RADLSW       (1210) 
[EC_DRHOOK:ito-desktop:1:1:190218:190218] [20230109:011515:1673194515:6942.677] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :               RADIATION_SCHEME 
[EC_DRHOOK:ito-desktop:1:1:190218:190218] [20230109:011515:1673194515:6942.677] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :                radiation_interface:radiation 
[EC_DRHOOK:ito-desktop:1:1:190218:190218] [20230109:011515:1673194515:6942.677] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :                 radiation_mcica_sw:solver_mcica_sw 
[EC_DRHOOK:ito-desktop:1:1:190218:190218] [20230109:011516:1673194516:6943.677] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1734] DrHook backtrace done for signal#15, nsigs = 1
[EC_DRHOOK:ito-desktop:1:1:190218:190218] [20230109:011516:1673194516:6943.677] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1785] Calling previous signal handler at 0x1ce8bb0 for signal#15, nsigs = 1
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source             
oifs_43r3_model.e  0000000001CE916B  Unknown               Unknown  Unknown
oifs_43r3_model.e  000000000081FFF1  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DC9090  Unknown               Unknown  Unknown
oifs_43r3_model.e  000000000188C278  radiation_two_str         405  radiation_two_stream.F90
oifs_43r3_model.e  000000000196A573  radiation_mcica_s         259  radiation_mcica_sw.F90
oifs_43r3_model.e  0000000001862DC8  radiation_interfa         419  radiation_interface.F90
oifs_43r3_model.e  00000000012D30E5  radiation_scheme_         484  radiation_scheme.F90
oifs_43r3_model.e  000000000129A415  radintg_                 1455  radintg.F90
oifs_43r3_model.e  0000000001270124  raddrv_                   537  raddrv.F90
oifs_43r3_model.e  0000000000BFD839  gp_model_                 482  gp_model.F90
oifs_43r3_model.e  00000000012E9482  gp_model_heap_             74  gp_model_heap.F90
oifs_43r3_model.e  0000000000BBC1CE  scan2m_                   535  scan2m.F90
oifs_43r3_model.e  000000000057A664  stepo_                    327  stepo.F90
oifs_43r3_model.e  000000000055DEEC  cnt4_                    1133  cnt4.F90
oifs_43r3_model.e  00000000005471C9  cnt3_                     267  cnt3.F90
oifs_43r3_model.e  0000000000546412  cnt2_                      88  cnt2.F90
oifs_43r3_model.e  0000000000545E28  cnt1_                      92  cnt1.F90
oifs_43r3_model.e  000000000040708D  cnt0_                     146  cnt0.F90
oifs_43r3_model.e  000000000040220F  MAIN__                     96  master.F90
oifs_43r3_model.e  00000000004021A2  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DCA390  Unknown               Unknown  Unknown
oifs_43r3_model.e  000000000040206E  Unknown               Unknown  Unknown
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2001050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0907
(argv4) batchid: 970
(argv5) wuid: 12187551
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/17
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/17/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/17/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_5e118a569b4d2060e17b5da07931dfe2 to: /var/lib/boinc-client/slots/17/oifs_43r3_ps_0907_2001050100_123_970_12187551.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/17/oifs_43r3_ps_0907_2001050100_123_970_12187551.zip
ic_ancil_file: ic_ancil_12187551
ifsdata_file: ifsdata_12187551
climate_data_file: clim_data_12187551
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_495117c31f512e4c4d2adc1ee2286f43 to: /var/lib/boinc-client/slots/17/ic_ancil_12187551.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/17/ic_ancil_12187551.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_ba85f819ba1700881af2b41c4f3e02ab to: /var/lib/boinc-client/slots/17/ifsdata/ifsdata_12187551.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/17/ifsdata/ifsdata_12187551.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/17/159l_2/clim_data_12187551.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/17/159l_2/clim_data_12187551.zip
Checking for progress XML file: /var/lib/boinc-client/slots/17/progress_file_12187551.xml
Opened progress file ok : /var/lib/boinc-client/slots/17/progress_file_12187551.xml
-- Model is restarting --
Adjusting last_iter, 1664, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/17/progress_file_12187551.xml
last_cpu_time: 29599
upload_file_number: 69
last_iter: 1655
last_upload: 5961600
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0907_2001050100_123_970_12187551_0_r916483789
The child process has been launched with process id: 3112
Executing the command: /var/lib/boinc-client/slots/17/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:ito-desktop:1:1:3112:3112] [20230109:102656:1673227616:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:ito-desktop:1:1:3112:3112] [20230109:102656:1673227616:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:ito-desktop:1:1:3112:3112] [20230109:102656:1673227616:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:ito-desktop:1:1:3112:3112] [20230109:102656:1673227616:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:ito-desktop:1:1:3112:3112] [20230109:102656:1673227616:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:ito-desktop:1:1:3112:3112] [20230109:102656:1673227616:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:ito-desktop:1:1:3112:3112] [20230109:102656:1673227616:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:ito-desktop:1:1:3112:3112] [20230109:102656:1673227616:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:ito-desktop:1:1:3112:3112] [20230109:102656:1673227616:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:ito-desktop:1:1:3112:3112] [20230109:102656:1673227616:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:ito-desktop:1:1:3112:3112] [20230109:102656:1673227616:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:ito-desktop:1:1:3112:3112] [20230109:102656:1673227616:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:ito-desktop:1:1:3112:3112] [20230109:102656:1673227616:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:ito-desktop:1:1:3112:3112] [20230109:102656:1673227616:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:ito-desktop:1:1:3112:3112] [20230109:102656:1673227616:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:ito-desktop:1:1:3112:3112] [20230109:102656:1673227616:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ito-desktop:1:1:3112:3112] [20230109:102656:1673227616:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:ito-desktop:1:1:3112:3112] [20230109:102656:1673227616:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ito-desktop:1:1:3112:3112] [20230109:102656:1673227616:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:ito-desktop:1:1:3112:3112] [20230109:102656:1673227616:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:ito-desktop:1:1:3112:3112] [20230109:102656:1673227616:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ito-desktop:1:1:3112:3112] [20230109:102656:1673227616:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ito-desktop:1:1:3112:3112] [20230109:102656:1673227616:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:ito-desktop:1:1:3112:3112] [20230109:102656:1673227616:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ito-desktop:1:1:3112:3112] [20230109:102656:1673227616:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ito-desktop:1:1:3112:3112] [20230109:102656:1673227616:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ito-desktop:1:1:3112:3112] [20230109:102656:1673227616:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:ito-desktop:1:1:3112:3112] [20230109:102656:1673227616:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:ito-desktop:1:1:3112:3112] [20230109:102656:1673227616:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:ito-desktop:1:1:3112:3112] [20230109:102656:1673227616:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  10:27:21 STEP 1656 H=1656:00 +CPU= 22.809
  10:27:34 STEP 1657 H=1657:00 +CPU= 12.816
  10:27:47 STEP 1658 H=1658:00 +CPU= 13.628
  10:28:08 STEP 1659 H=1659:00 +CPU= 20.946
  10:28:22 STEP 1660 H=1660:00 +CPU= 13.764
  10:28:36 STEP 1661 H=1661:00 +CPU= 13.376
  10:28:58 STEP 1662 H=1662:00 +CPU= 21.838
  10:29:12 STEP 1663 H=1663:00 +CPU= 13.172
  10:29:26 STEP 1664 H=1664:00 +CPU= 13.870
  10:29:47 STEP 1665 H=1665:00 +CPU= 20.678
  10:30:00 STEP 1666 H=1666:00 +CPU= 13.579
  10:30:14 STEP 1667 H=1667:00 +CPU= 13.412
  10:30:38 STEP 1668 H=1668:00 +CPU= 23.442
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+001668
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+001668
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+001668
  10:30:51 STEP 1669 H=1669:00 +CPU= 13.195
  10:31:05 STEP 1670 H=1670:00 +CPU= 13.995
  10:31:26 STEP 1671 H=1671:00 +CPU= 21.025
  10:31:39 STEP 1672 H=1672:00 +CPU= 13.456
  10:31:53 STEP 1673 H=1673:00 +CPU= 13.400
  10:32:15 STEP 1674 H=1674:00 +CPU= 21.684
  10:32:28 STEP 1675 H=1675:00 +CPU= 13.040
  10:32:42 STEP 1676 H=1676:00 +CPU= 13.670
  10:33:03 STEP 1677 H=1677:00 +CPU= 20.685
  10:33:16 STEP 1678 H=1678:00 +CPU= 13.431
  10:33:30 STEP 1679 H=1679:00 +CPU= 13.628
  10:33:55 STEP 1680 H=1680:00 +CPU= 25.032
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+001680
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+001680
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+001680
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMGGhq0f+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMSHhq0f+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMUAhq0f+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMGGhq0f+001668
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMSHhq0f+001668
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMUAhq0f+001668
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0907_2001050100_123_970_12187551_0_r916483789_69.zip
Uploading the intermediate file: upload_file_69.zip
  10:34:08 STEP 1681 H=1681:00 +CPU= 13.309
  10:34:22 STEP 1682 H=1682:00 +CPU= 13.730
  10:34:43 STEP 1683 H=1683:00 +CPU= 20.939
  10:34:57 STEP 1684 H=1684:00 +CPU= 13.656
  10:35:10 STEP 1685 H=1685:00 +CPU= 13.346
  10:35:32 STEP 1686 H=1686:00 +CPU= 21.595
  10:35:45 STEP 1687 H=1687:00 +CPU= 13.337
  10:35:59 STEP 1688 H=1688:00 +CPU= 13.664
  10:36:20 STEP 1689 H=1689:00 +CPU= 20.976
  10:36:34 STEP 1690 H=1690:00 +CPU= 13.588
  10:36:47 STEP 1691 H=1691:00 +CPU= 13.351
  10:37:12 STEP 1692 H=1692:00 +CPU= 23.609
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+001692
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+001692
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+001692
  10:37:25 STEP 1693 H=1693:00 +CPU= 13.422
  10:37:39 STEP 1694 H=1694:00 +CPU= 13.574
  10:38:00 STEP 1695 H=1695:00 +CPU= 21.186
  10:38:14 STEP 1696 H=1696:00 +CPU= 14.015
  10:38:28 STEP 1697 H=1697:00 +CPU= 13.242
  10:38:49 STEP 1698 H=1698:00 +CPU= 21.499
  10:39:03 STEP 1699 H=1699:00 +CPU= 13.342
  10:39:16 STEP 1700 H=1700:00 +CPU= 13.499
  10:39:37 STEP 1701 H=1701:00 +CPU= 20.897
  10:39:51 STEP 1702 H=1702:00 +CPU= 13.659
  10:40:05 STEP 1703 H=1703:00 +CPU= 13.580
  10:40:30 STEP 1704 H=1704:00 +CPU= 25.012
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+001704
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+001704
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMGGhq0f+001680
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMSHhq0f+001680
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMUAhq0f+001680
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMGGhq0f+001692
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMSHhq0f+001692
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMUAhq0f+001692
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0907_2001050100_123_970_12187551_0_r916483789_70.zip
Uploading the intermediate file: upload_file_70.zip
  10:40:43 STEP 1705 H=1705:00 +CPU= 13.359
  10:40:57 STEP 1706 H=1706:00 +CPU= 13.509
  10:41:18 STEP 1707 H=1707:00 +CPU= 20.738
  10:41:32 STEP 1708 H=1708:00 +CPU= 13.662
  10:41:45 STEP 1709 H=1709:00 +CPU= 13.183
  10:42:06 STEP 1710 H=1710:00 +CPU= 21.372
  10:42:20 STEP 1711 H=1711:00 +CPU= 13.408
  10:42:34 STEP 1712 H=1712:00 +CPU= 13.696
  10:42:55 STEP 1713 H=1713:00 +CPU= 20.937
  10:43:08 STEP 1714 H=1714:00 +CPU= 13.757
  10:43:22 STEP 1715 H=1715:00 +CPU= 13.113
  10:43:45 STEP 1716 H=1716:00 +CPU= 23.620
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+001716
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+001716
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+001716
  10:43:59 STEP 1717 H=1717:00 +CPU= 13.549
  10:44:13 STEP 1718 H=1718:00 +CPU= 13.659
  10:44:34 STEP 1719 H=1719:00 +CPU= 21.207
  10:44:48 STEP 1720 H=1720:00 +CPU= 14.137
  10:45:02 STEP 1721 H=1721:00 +CPU= 13.325
  10:45:23 STEP 1722 H=1722:00 +CPU= 21.539
  10:45:37 STEP 1723 H=1723:00 +CPU= 13.472
  10:45:50 STEP 1724 H=1724:00 +CPU= 13.669
  10:46:11 STEP 1725 H=1725:00 +CPU= 21.009
  10:46:25 STEP 1726 H=1726:00 +CPU= 13.882
  10:46:39 STEP 1727 H=1727:00 +CPU= 13.711
  10:47:05 STEP 1728 H=1728:00 +CPU= 25.453
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+001728
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+001728
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMGGhq0f+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMSHhq0f+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMUAhq0f+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMGGhq0f+001716
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMSHhq0f+001716
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMUAhq0f+001716
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0907_2001050100_123_970_12187551_0_r916483789_71.zip
Uploading the intermediate file: upload_file_71.zip
  10:47:18 STEP 1729 H=1729:00 +CPU= 13.424
  10:47:32 STEP 1730 H=1730:00 +CPU= 13.963
  10:47:53 STEP 1731 H=1731:00 +CPU= 20.933
  10:48:07 STEP 1732 H=1732:00 +CPU= 13.578
  10:48:21 STEP 1733 H=1733:00 +CPU= 13.541
  10:48:42 STEP 1734 H=1734:00 +CPU= 21.709
  10:48:56 STEP 1735 H=1735:00 +CPU= 13.343
  10:49:10 STEP 1736 H=1736:00 +CPU= 13.979
  10:49:31 STEP 1737 H=1737:00 +CPU= 21.188
  10:49:45 STEP 1738 H=1738:00 +CPU= 13.690
  10:49:58 STEP 1739 H=1739:00 +CPU= 13.531
  10:50:22 STEP 1740 H=1740:00 +CPU= 23.726
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+001740
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+001740
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+001740
  10:50:35 STEP 1741 H=1741:00 +CPU= 13.163
  10:50:49 STEP 1742 H=1742:00 +CPU= 13.927
  10:51:10 STEP 1743 H=1743:00 +CPU= 21.043
  10:51:24 STEP 1744 H=1744:00 +CPU= 13.643
  10:51:38 STEP 1745 H=1745:00 +CPU= 13.579
  10:52:01 STEP 1746 H=1746:00 +CPU= 21.690
  10:52:15 STEP 1747 H=1747:00 +CPU= 13.459
  10:52:29 STEP 1748 H=1748:00 +CPU= 13.836
  10:52:51 STEP 1749 H=1749:00 +CPU= 21.295
  10:53:06 STEP 1750 H=1750:00 +CPU= 13.896
  10:53:20 STEP 1751 H=1751:00 +CPU= 13.940
  10:53:46 STEP 1752 H=1752:00 +CPU= 25.427
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+001752
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+001752
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMGGhq0f+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMSHhq0f+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMUAhq0f+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMGGhq0f+001740
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMSHhq0f+001740
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMUAhq0f+001740
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0907_2001050100_123_970_12187551_0_r916483789_72.zip
Uploading the intermediate file: upload_file_72.zip
  10:54:00 STEP 1753 H=1753:00 +CPU= 13.656
  10:54:14 STEP 1754 H=1754:00 +CPU= 13.765
  10:54:36 STEP 1755 H=1755:00 +CPU= 21.028
  10:54:50 STEP 1756 H=1756:00 +CPU= 13.872
  10:55:04 STEP 1757 H=1757:00 +CPU= 13.044
  10:55:25 STEP 1758 H=1758:00 +CPU= 21.237
  10:55:39 STEP 1759 H=1759:00 +CPU= 13.618
  10:55:54 STEP 1760 H=1760:00 +CPU= 14.121
  10:56:16 STEP 1761 H=1761:00 +CPU= 21.945
  10:56:31 STEP 1762 H=1762:00 +CPU= 14.776
  10:56:45 STEP 1763 H=1763:00 +CPU= 13.868
  10:57:12 STEP 1764 H=1764:00 +CPU= 24.714
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+001764
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+001764
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+001764
  10:57:27 STEP 1765 H=1765:00 +CPU= 14.113
  10:57:42 STEP 1766 H=1766:00 +CPU= 14.448
  10:58:07 STEP 1767 H=1767:00 +CPU= 22.267
  10:58:21 STEP 1768 H=1768:00 +CPU= 14.261
  10:58:36 STEP 1769 H=1769:00 +CPU= 14.197
  10:59:00 STEP 1770 H=1770:00 +CPU= 22.611
  10:59:14 STEP 1771 H=1771:00 +CPU= 13.986
  10:59:29 STEP 1772 H=1772:00 +CPU= 14.817
  10:59:51 STEP 1773 H=1773:00 +CPU= 21.608
  11:00:06 STEP 1774 H=1774:00 +CPU= 14.069
  11:00:21 STEP 1775 H=1775:00 +CPU= 14.536
  11:00:47 STEP 1776 H=1776:00 +CPU= 26.075
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+001776
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+001776
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMGGhq0f+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMSHhq0f+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMUAhq0f+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMGGhq0f+001764
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMSHhq0f+001764
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMUAhq0f+001764
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0907_2001050100_123_970_12187551_0_r916483789_73.zip
Uploading the intermediate file: upload_file_73.zip
  11:01:01 STEP 1777 H=1777:00 +CPU= 13.466
  11:01:15 STEP 1778 H=1778:00 +CPU= 14.183
  11:01:37 STEP 1779 H=1779:00 +CPU= 21.555
  11:01:51 STEP 1780 H=1780:00 +CPU= 14.153
  11:02:05 STEP 1781 H=1781:00 +CPU= 13.434
  11:02:27 STEP 1782 H=1782:00 +CPU= 22.073
  11:02:41 STEP 1783 H=1783:00 +CPU= 14.251
  11:02:55 STEP 1784 H=1784:00 +CPU= 14.027
  11:03:17 STEP 1785 H=1785:00 +CPU= 21.486
  11:03:31 STEP 1786 H=1786:00 +CPU= 13.997
  11:03:44 STEP 1787 H=1787:00 +CPU= 13.177
  11:04:08 STEP 1788 H=1788:00 +CPU= 23.954
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+001788
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+001788
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+001788
  11:04:22 STEP 1789 H=1789:00 +CPU= 13.674
  11:04:36 STEP 1790 H=1790:00 +CPU= 13.915
  11:04:57 STEP 1791 H=1791:00 +CPU= 21.405
  11:05:12 STEP 1792 H=1792:00 +CPU= 14.588
  11:05:25 STEP 1793 H=1793:00 +CPU= 13.648
  11:05:47 STEP 1794 H=1794:00 +CPU= 21.992
  11:06:01 STEP 1795 H=1795:00 +CPU= 13.824
  11:06:15 STEP 1796 H=1796:00 +CPU= 13.937
  11:06:37 STEP 1797 H=1797:00 +CPU= 21.668
  11:06:51 STEP 1798 H=1798:00 +CPU= 14.080
  11:07:06 STEP 1799 H=1799:00 +CPU= 14.311
  11:07:31 STEP 1800 H=1800:00 +CPU= 25.186
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+001800
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+001800
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMGGhq0f+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMSHhq0f+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMUAhq0f+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMGGhq0f+001788
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMSHhq0f+001788
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMUAhq0f+001788
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0907_2001050100_123_970_12187551_0_r916483789_74.zip
Uploading the intermediate file: upload_file_74.zip
  11:07:45 STEP 1801 H=1801:00 +CPU= 13.565
  11:07:59 STEP 1802 H=1802:00 +CPU= 14.043
  11:08:20 STEP 1803 H=1803:00 +CPU= 21.575
  11:08:35 STEP 1804 H=1804:00 +CPU= 14.639
  11:08:50 STEP 1805 H=1805:00 +CPU= 14.319
  11:09:14 STEP 1806 H=1806:00 +CPU= 23.137
  11:09:28 STEP 1807 H=1807:00 +CPU= 13.730
  11:09:42 STEP 1808 H=1808:00 +CPU= 14.278
  11:10:06 STEP 1809 H=1809:00 +CPU= 22.580
  11:10:23 STEP 1810 H=1810:00 +CPU= 15.221
  11:10:39 STEP 1811 H=1811:00 +CPU= 14.892
  11:11:07 STEP 1812 H=1812:00 +CPU= 26.114
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+001812
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+001812
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+001812
  11:11:24 STEP 1813 H=1813:00 +CPU= 15.186
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  12:31:54 STEP 1814 H=1814:00 +CPU= 19.225
  12:32:20 STEP 1815 H=1815:00 +CPU= 22.537
  12:32:34 STEP 1816 H=1816:00 +CPU= 14.038
  12:32:48 STEP 1817 H=1817:00 +CPU= 13.984
  12:33:11 STEP 1818 H=1818:00 +CPU= 22.126
  12:33:25 STEP 1819 H=1819:00 +CPU= 13.880
  12:33:39 STEP 1820 H=1820:00 +CPU= 14.398
  12:34:01 STEP 1821 H=1821:00 +CPU= 21.884
  12:34:16 STEP 1822 H=1822:00 +CPU= 14.514
  12:34:31 STEP 1823 H=1823:00 +CPU= 14.234
  12:35:00 STEP 1824 H=1824:00 +CPU= 26.589
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+001824
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+001824
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMGGhq0f+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMSHhq0f+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMUAhq0f+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMGGhq0f+001812
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMSHhq0f+001812
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMUAhq0f+001812
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0907_2001050100_123_970_12187551_0_r916483789_75.zip
Uploading the intermediate file: upload_file_75.zip
  12:35:15 STEP 1825 H=1825:00 +CPU= 14.346
  12:35:29 STEP 1826 H=1826:00 +CPU= 14.553
  12:35:52 STEP 1827 H=1827:00 +CPU= 22.438
  12:36:07 STEP 1828 H=1828:00 +CPU= 14.788
  12:36:22 STEP 1829 H=1829:00 +CPU= 14.178
  12:36:44 STEP 1830 H=1830:00 +CPU= 22.234
  12:36:58 STEP 1831 H=1831:00 +CPU= 13.849
  12:37:13 STEP 1832 H=1832:00 +CPU= 14.816
  12:37:35 STEP 1833 H=1833:00 +CPU= 22.118
  12:37:50 STEP 1834 H=1834:00 +CPU= 14.338
  12:38:04 STEP 1835 H=1835:00 +CPU= 14.132
  12:38:29 STEP 1836 H=1836:00 +CPU= 24.580
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+001836
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+001836
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+001836
  12:38:43 STEP 1837 H=1837:00 +CPU= 13.914
  12:38:58 STEP 1838 H=1838:00 +CPU= 14.985
  12:39:20 STEP 1839 H=1839:00 +CPU= 21.939
  12:39:34 STEP 1840 H=1840:00 +CPU= 14.199
  12:39:47 STEP 1841 H=1841:00 +CPU= 13.365
  12:40:10 STEP 1842 H=1842:00 +CPU= 22.471
  12:40:25 STEP 1843 H=1843:00 +CPU= 14.344
  12:40:39 STEP 1844 H=1844:00 +CPU= 14.070
  12:41:00 STEP 1845 H=1845:00 +CPU= 21.771
  12:41:15 STEP 1846 H=1846:00 +CPU= 14.487
  12:41:29 STEP 1847 H=1847:00 +CPU= 13.837
  12:41:55 STEP 1848 H=1848:00 +CPU= 26.125
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+001848
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+001848
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMGGhq0f+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMSHhq0f+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMUAhq0f+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMGGhq0f+001836
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMSHhq0f+001836
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMUAhq0f+001836
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0907_2001050100_123_970_12187551_0_r916483789_76.zip
Uploading the intermediate file: upload_file_76.zip
  12:42:10 STEP 1849 H=1849:00 +CPU= 14.356
  12:42:25 STEP 1850 H=1850:00 +CPU= 14.841
  12:42:48 STEP 1851 H=1851:00 +CPU= 22.270
  12:43:03 STEP 1852 H=1852:00 +CPU= 14.531
  12:43:18 STEP 1853 H=1853:00 +CPU= 14.565
  12:43:42 STEP 1854 H=1854:00 +CPU= 22.986
  12:43:56 STEP 1855 H=1855:00 +CPU= 13.762
  12:44:12 STEP 1856 H=1856:00 +CPU= 15.557
  12:44:38 STEP 1857 H=1857:00 +CPU= 23.489
  12:44:53 STEP 1858 H=1858:00 +CPU= 14.483
  12:45:08 STEP 1859 H=1859:00 +CPU= 14.797
  12:45:38 STEP 1860 H=1860:00 +CPU= 25.782
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+001860
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+001860
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+001860
  12:45:56 STEP 1861 H=1861:00 +CPU= 15.230
  12:46:13 STEP 1862 H=1862:00 +CPU= 15.287
  12:46:40 STEP 1863 H=1863:00 +CPU= 23.445
  12:46:58 STEP 1864 H=1864:00 +CPU= 15.718
  12:47:15 STEP 1865 H=1865:00 +CPU= 14.506
  12:47:40 STEP 1866 H=1866:00 +CPU= 23.422
  12:47:56 STEP 1867 H=1867:00 +CPU= 14.856
  12:48:13 STEP 1868 H=1868:00 +CPU= 15.048
  12:48:37 STEP 1869 H=1869:00 +CPU= 22.715
  12:48:54 STEP 1870 H=1870:00 +CPU= 15.072
  12:49:10 STEP 1871 H=1871:00 +CPU= 15.248
  12:49:40 STEP 1872 H=1872:00 +CPU= 27.298
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+001872
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+001872
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMGGhq0f+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMSHhq0f+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMUAhq0f+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMGGhq0f+001860
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMSHhq0f+001860
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12187551/ICMUAhq0f+001860
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0907_2001050100_123_970_12187551_0_r916483789_77.zip
Uploading the intermediate file: upload_file_77.zip
  12:49:56 STEP 1873 H=1873:00 +CPU= 14.207
  12:50:12 STEP 1874 H=1874:00 +CPU= 14.973
  12:50:36 STEP 1875 H=1875:00 +CPU= 22.240
  12:50:52 STEP 1876 H=1876:00 +CPU= 14.541
  12:51:08 STEP 1877 H=1877:00 +CPU= 14.580
  12:51:32 STEP 1878 H=1878:00 +CPU= 23.011
Abort request received from BOINC client, ending the child process

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:12:51 1533427 22272983 oifs_43r3_ps_0907_2001050100_123_970_12187551_0 5,443,200 26,926 0.0049
09 May 2023 16:12:47 1533427 22272983 oifs_43r3_ps_0907_2001050100_123_970_12187551_0 4,320,000 21,560 0.0050
09 May 2023 16:12:22 1533427 22272983 oifs_43r3_ps_0907_2001050100_123_970_12187551_0 1,900,800 9,257 0.0049
09 May 2023 16:12:20 1533427 22272983 oifs_43r3_ps_0907_2001050100_123_970_12187551_0 1,036,800 5,194 0.0050


©2024 cpdn.org